赵欣洋, 尹琦云, 刘志远, 陆洪建, 王拯. 异源特征差异化融合引导的变电站场景语义分割[J]. 宁夏电力, 2023, (S1): 85-92.
引用本文: 赵欣洋, 尹琦云, 刘志远, 陆洪建, 王拯. 异源特征差异化融合引导的变电站场景语义分割[J]. 宁夏电力, 2023, (S1): 85-92.
ZHAO Xinyang, YIN Qiyun, LIU Zhiyuan, LU Hongjian, WANG Zheng. Differential fusion of heterogeneous features for semantic segmentation in transformer substation scenes[J]. Ningxia Electric Power, 2023, (S1): 85-92.
Citation: ZHAO Xinyang, YIN Qiyun, LIU Zhiyuan, LU Hongjian, WANG Zheng. Differential fusion of heterogeneous features for semantic segmentation in transformer substation scenes[J]. Ningxia Electric Power, 2023, (S1): 85-92.

异源特征差异化融合引导的变电站场景语义分割

Differential fusion of heterogeneous features for semantic segmentation in transformer substation scenes

  • 摘要: 变电站场景图像语义分割能够为巡检机器人提供像素级的场景理解,是变电站智能化巡检、管控的关键步骤之一,但由于设备种类众多、背景环境复杂,仅依赖单一模态图像的语义分割方法准确性受限。针对该问题,提出一种基于多尺度特征差异化融合的语义分割网络,根据不同层次、不同模态特征图的特点,利用差异化的融合策略,提取红外与可见光图像在空间细节与语义信息的互补内容,从而利用融合信息引导解码过程,实现稳定的异源图像语义分割。为了验证算法的性能,利用无人机与机器人平台采集大量异源图像,手工标注并构建了数据集。实验证明本文提出的算法可以准确识别各类电力设备,对于保障电力系统安全稳定的运行具有实用价值。

     

    Abstract: The semantic segmentation of the image of power equipment in the transformer substation can provide the capability of scene interpretation for inspection robots, which is the key and the basis to realize the intelligent inspection and management.However, due to the variety of power equipments and the complex background environment, the accuracy of existing semantic segmentation methods that only relies on single-modal images is limited.To solve the above mentioned problem, a semantic segmentation network based on differential fusion of heterogeneozus features is proposed.According to the characteristics of different levels and modalities feature maps, a differentiated fusion strategy is applied to extract the complementary advantages of spatial details and semantic information with infrared and visible images so as to utilize fusion information to guide the decoding process and to realize stable semantic segmentation of heterogeneous images.In order to verify the performance of the proposed method, a large number of heterogeneous images were collected by unmanned aerial vehicles and robot platforms.In this way, semantic segmentation dataset for power scene is manually annotated and constructed.The test shows that the proposed method could accurately identify the various types of power equipment, which has practical value for ensuring the safe and stable operation of power systems.

     

/

返回文章
返回