吉林大学学报(工学版) ›› 2025, Vol. 55 ›› Issue (6): 2131-2137.doi: 10.13229/j.cnki.jdxbgxb.20240503

• 计算机科学与技术 • 上一篇    下一篇

多时相高分辨率卫星遥感图像语义分割算法

于营1,2(),王春平1,2,寇人可1,杨博雄2,王雷3,4,赵福军2,付强1()   

  1. 1.陆军工程大学,石家庄 050003
    2.三亚学院 容淳铭院士工作站,海南 三亚 572022
    3.海南空天信息创新研究院 海南省地球观测重点实验室,海南 三亚 572029
    4.中国科学院空天信息创新研究院 海南省地球观测重点实验室,北京 100094
  • 收稿日期:2024-05-10 出版日期:2025-06-01 发布日期:2025-07-23
  • 通讯作者: 付强 E-mail:yingyu@sanyau.edu.cn;Fu_Qiang@aeu.edu.cn
  • 作者简介:于营(1990-),女,副教授,博士研究生.研究方向:语义分割,计算机视觉.E-mail:yingyu@sanyau.edu.cn
  • 基金资助:
    国家重点研发计划项目(2021YFB3901301);海南省院士创新平台专项项目(YSPTZX202145);海南省高等学校教育教学改革研究项目(Hnjg2023ZD-44)

Semantic segmentation algorithm for multi temporal high⁃resolution satellite remote sensing images

Ying YU1,2(),Chun-ping WANG1,2,Ren-ke KOU1,Bo-xiong YANG2,Lei WANG3,4,Fu-jun ZHAO2,Qiang FU1()   

  1. 1.Army Engineering University of PLA,Shijiazhuang 050003,China
    2.Academician Workstation of Chunming Rong,University of Sanya,Sanya 572022,China
    3.Key Laboratory of Earth Observation of Hainan Province,Hainan Aerospace Information Research Institute,Sanya 572029,China
    4.Key Laboratory of Earth Observation of Hainan Province,Aerospace Information Research Institute,Chinese Academy of Sciences,Beijing 100094,China
  • Received:2024-05-10 Online:2025-06-01 Published:2025-07-23
  • Contact: Qiang FU E-mail:yingyu@sanyau.edu.cn;Fu_Qiang@aeu.edu.cn

摘要:

为了解决单一时相低分辨率图像无法准确识别遥感图像中各类语义对象的问题,提出了多时相高分辨率卫星遥感图像语义分割算法。通过求解图像信息的多时相分辨率,进行遥感目标分区处理,准确识别并提取遥感图像中各类语义对象及特征;基于尺度函数定义式计算分割权重,实现对遥感图像语义对象的精确识别与分割。实验结果表明,本文方法显著提高了语义对象的识别准确率,分割后地物信息中各项语义对象占比的实验值与真实值之间的最大数值差未超过0.2%,为遥感图像的应用提供了有力支持。

关键词: 多时相高分辨率, 卫星遥感图像, 语义分割, 显著遥感区域, 尺度函数, 分割权重

Abstract:

In order to solve the problem of inaccurate recognition of various semantic objects in remote sensing images using a single temporal low resolution image, a multi temporal high-resolution satellite remote sensing image semantic segmentation algorithm was proposed. By solving the multi temporal resolution of image information, remote sensing targets are partitioned, and various semantic objects and features of remote sensing images are accurately identified and extracted. Based on the definition of scale function, the segmentation weight is calculated to realize accurate recognition and segmentation of semantic objects in remote sensing images. The experimental results show that the recognition accuracy of semantic objects is significantly improved by the proposed method, and the maximum numerical difference between the experimental value and the real value of each semantic object content in the segmented ground object information does not exceed 0.2%, which provides strong support for the application of remote sensing images.

Key words: multi temporal high-resolution, satellite remote sensing images, semantic segmentation, significant remote sensing areas, scale function, segmentation weight

中图分类号: 

  • TN929

图1

图像遥感目标分区示意图"

图2

卫星遥感图像数据集影像"

表1

卫星遥感数据集语义信息的标注参数"

标记地物信息名称标记颜色BRG颜色值
1背景物(0,0,0)
2植物(127,0,255)
3建筑结构(0,255,255)
4水系结构(255, 0,191)
5连通道路(60,220,20)

图3

色彩标注后的卫星遥感图像数据集"

图4

卫星遥感图像数据集中的语义对象占比"

图5

卫星遥感图像语义分割结果对比"

[1] 王志敏, 王加胜, 王丽蒙. 基于注意力机制的U型网络遥感影像分割[J]. 计算机仿真, 2023, 40(3): 232-235, 240.
Wang Zhi-min, Wang Jia-sheng, Wang Li-meng. Remote sensing image segmentation based on U-shaped network fused with attention mechanism[J]. Computer Simulation, 2023, 40(3): 232-235, 240.
[2] Lang F K, Zhang M, Zhao J Q, et al. Semantic segmentation for multisource remote sensing images incorporating feature slice reconstruction and attention upsampling[J]. International Journal of Remote Sensing, 2024, 45(8): 2761-2785.
[3] 王兴武, 雷涛, 王营博, 等. 基于多模态互补特征学习的遥感影像语义分割[J]. 智能系统学报, 2022, 17(6): 1123-1133.
Wang Xing-wu, Lei Tao, Wang Ying-bo, et al. Semantic segmentation of remote sensing image based on multimodal complementary feature learning[J]. CAAI Transactions on Intelligent Systems, 2022, 17(6): 1123-1133.
[4] 谭大宁, 刘瑜, 姚力波, 等. 基于视觉注意力机制的多源遥感图像语义分割[J]. 信号处理, 2022, 38(6): 1180-1191.
Tan Da-ning, Liu Yu, Yao Li-bo, et al. Semantic segmentation of multi-source remote sensing images based on visual attention mechanism[J]. Journal of Signal Processing, 2022, 38(6): 1180-1191.
[5] Hou Y D, Wu Z B, Ren X H, et al. BFFNet: a bidirectional feature fusion network for semantic segmentation of remote sensing objects[J]. International Journal of Intelligent Computing and Cybernetics, 2024, 17(1): 20-37.
[6] 蔡超丽, 李纯纯, 黄琳, 等. 基于多尺度特征融合注意力CNN的遥感图像语义分割方法[J]. 桂林理工大学学报, 2022, 42(4): 968-976.
Cai Chao-li, Li Chun-chun, Huang Lin, et al. Remote sensing image semantic segmentation method based on multi-scale feature fusion attention CNN[J]. Journal of Guilin University of Technology, 2022, 42(4): 968-976.
[7] 夏英, 黄秉坤. 采用改进YOLOv3的高分辨率遥感图像目标检测[J]. 重庆邮电大学学报:自然科学版, 2022, 34(3): 383-392.
Xia Ying, Huang Bing-kun. Object detection of high resolution remote sensing images based on improved YOLOv3[J]. Journal of Chongqing University of Posts and Telecommunications (Natural Science Edition), 2022, 34(3): 383-392.
[8] 张文凯, 刘文杰, 孙显, 等. 多源特征自适应融合网络的高分遥感影像语义分割[J]. 中国图象图形学报, 2022, 27(8): 2516-2526.
Zhang Wen-kai, Liu Wen-jie, Sun Xian, et al. Multi-source features adaptation fusion network for semantic segmentation in high-resolution remote sensing images[J]. Journal of Image and Graphics, 2022, 27(8): 2516-2526.
[9] 刘春娟, 乔泽, 闫浩文, 等. 基于多尺度互注意力的遥感图像语义分割网络[J]. 浙江大学学报: 工学版, 2023, 57(7): 1335-1344.
Liu Chun-juan, Qiao Ze, Yan Hao-wen, et al. Semantic segmentation network for remote sensing image based on multi-scale mutual attention[J]. Journal of Zhejiang University (Engineering Science), 2023, 57(7): 1335-1344.
[10] 朱冰, 李紫薇, 李奇. 基于改进SegNet的遥感图像建筑物分割方法[J]. 吉林大学学报: 工学版, 2023, 53(1): 248-254.
Zhu Bing, Li Zi-wei, Li Qi. Building segmentation method of remote sensing image based on improved SegNet[J]. Journal of Jilin University (Engineering and Technology Edition), 2023, 53(1): 248-254.
[11] 苏志鹏, 李景文, 姜建武, 等. 基于改进DeepLabV3+的遥感影像语义分割方法[J]. 激光与光电子学进展, 2023, 60(6): 359-366.
Su Zhi-peng, Li Jing-wen, Jiang Jian-wu, et al. Semantic segmentation method for remote sensing images based on improved DeepLabV3+[J]. Laser & Optoelectronics Progress, 2023, 60(6): 359-366.
[12] 杨军, 于茜子. 结合空洞卷积的FuseNet变体网络高分辨率遥感影像语义分割[J]. 武汉大学学报: 信息科学版, 2022, 47(7): 1071-1080.
Yang Jun, Yu Xi-zi. Semantic segmentation of high resolution remote sensing images based on improved FuseNet combined with atrous convolution[J]. Geomatics and Information Science of Wuhan University, 2022, 47(7): 1071-1080.
[13] 张金锋, 刘军, 谢枫, 等. 基于改进Deeplabv3+网络的遥感图像选站选线语义分割[J]. 控制工程, 2022, 29(3): 558-563.
Zhang Jin-feng, Liu Jun, Xie Feng, et al. Semantic segmentation of station selection and line selection in remote sensing image based on improved Deeplabv3+ network[J]. Control Engineering of China, 2022, 29(3): 558-563.
[14] 王春华, 李恩泽, 肖敏. 多特征融合和孪生注意力网络的高分辨率遥感图像目标检测[J]. 吉林大学学报: 工学版, 2024, 54(1): 240-250.
Wang Chun-hua, Li En-ze, Xiao Min. Object detection in high-resolution remote sensing images based on multi-feature fusion and twin attention network[J].Journal of Jilin University (Engineering and Technology Edition), 2024, 54(1): 240-250.
[1] 才华,王玉瑶,付强,马智勇,王伟刚,张晨洁. 基于注意力机制和特征融合的语义分割网络[J]. 吉林大学学报(工学版), 2025, 55(4): 1384-1395.
[2] 阙云,季雪,蒋子平,戴伊,王叶飞,陈嘉. GAN数据增强下路面裂缝语义分割算法[J]. 吉林大学学报(工学版), 2023, 53(11): 3166-3175.
[3] 陈雪云,贝学宇,姚渠,金鑫. 基于G⁃UNet的多场景行人精确分割与检测[J]. 吉林大学学报(工学版), 2022, 52(4): 925-933.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
[1] 刘仁云,张义民,于繁华 . 基于灰色粒子群算法的可靠性稳健优化设计[J]. 吉林大学学报(工学版), 2006, 36(06): 893 -897 .
[2] 卢守峰,杨兆升,刘喜敏 . 基于多智能体的交通信号控制与路径诱导的协同[J]. 吉林大学学报(工学版), 2006, 36(增刊2): 143 -146 .
[3] 李鹤;赵晓晖;刘熠 . 比例速率约束下基于遗传策略的多用户OFDM系统资源自适应分配算法[J]. 吉林大学学报(工学版), 2008, 38(03): 709 -0714 .
[4] 施刚,石永久,王元清. 钢结构梁柱连接节点域剪切变形计算方法[J]. 吉林大学学报(工学版), 2006, 36(04): 462 -466 .
[5] 张健红,左春柽,钱生君,齐培正 . 基于轴承间隙模型的摆锤碰撞试验台仿真研究[J]. 吉林大学学报(工学版), 2007, 37(03): 553 -0557 .
[6] 郭孔辉,吴海东,卢荡 . 冰面上轮胎稳态侧偏刷子模型[J]. 吉林大学学报(工学版), 2007, 37(02): 253 -0258 .
[7] 赵丁选,冯石柱,巩明德,邓乐 .

遥操作工程机器人改进力反馈控制方法

[J]. 吉林大学学报(工学版), 2008, 38(03): 575 -0579 .
[8] 钱颖,张鹰,于永森,郑伟,张玉书 . 基于特殊悬臂梁的光纤Bragg光栅应力传感器
[J]. 吉林大学学报(工学版), 2006, 36(05): 757 -0760 .
[9] 于生宝,张贤涛,陈天琦,王兆明 . 基于不接触电极的电阻率探测方法[J]. 吉林大学学报(工学版), 2008, 38(02): 370 -0373 .
[10] 金敬福, 丛茜, 杨晓东. 常用工程材料的冻黏特性及冻黏界面破坏形态[J]. 吉林大学学报(工学版), 2005, 35(05): 486 -0489 .