结合DCNN与短距条件随机场的遥感影像道路提取

赫晓慧; 陈明扬; 李盼乐; 田智慧; 周广胜

doi:10.13203/j.whugis20210464

结合DCNN与短距条件随机场的遥感影像道路提取

doi: 10.13203/j.whugis20210464

1. 郑州大学, 地球科学与技术学院, 河南郑州, 450052;
2. 郑州大学, 信息工程学院, 河南郑州, 450052;
3. 中国气象科学研究院郑州大学生态气象联合实验室郑州, 450052

基金项目:

第二次青藏高原综合考察研究项目（2019QZKK0106）

详细信息

作者简介:
赫晓慧，教授，博士生导师，主要从事人工智能，遥感影像处理及数据挖掘。hexh@zzu.edu.cn

中图分类号: TP75

Road Extraction from Remote Sensing Image by Integrating DCNN with Short Range Conditional Random Field(SRCRF)

1. School of Earth Science and Technology, Zhengzhou University, Zhengzhou 450052, China;
2. School of Information Engineering, Zhengzhou University, Zhengzhou 450052, China;
3. Joint Laboratory of Eco-Meteorology, Chinese Academy of Meteorological Sciences, Zhengzhou University, Zhengzhou 450052

Funds:

The Second Comprehensive Investigation and Research Project on Qinghai-Tibet Plateau.(2019QZKK0106)

摘要: 深度卷积神经网络（Deep Convolutional Neural Network，DCNN）在高分辨率遥感图像（High-Resolution Remote Sensing images，HRSIs）自动道路提取领域被广泛应用，但现有方法难以对预测结果中像素间的上下文关系建模。针对此问题，已有研究利用全连接条件随机场(Fully Connected Crf ，FullCrf）结合上下文信息对语义分割结果进行二次优化，但无法有效改善道路结构不连续问题。为改善道路结构的完整性，本研究提出一种结合DCNN的短距条件随机场模型（Short Range Conditional Random Filed，SRCRF），SRCRF利用DCNN强大的特征提取能力并控制FullCrf的推理范围缓解过渡平滑现象，解决提道路取结果中的结构不连续、不完整问题。实验结果表明，在Zimbawe-Roads数据集与Cheng-Roads数据集中SRCRF的F1值相比DCNN分别上升大约4.01%与3.73%，相比FullCrf分别上升大约3.25%和2.28%。
- 遥感影像 /
- 道路提取 /
- 深度学习 /
- 条件随机场 /
- 语义分割
Abstract: Objective: Deep Convolutional Neural Network (DCNN) is widely used in automatic road extraction from high-resolution Remote Sensing images (HRSIs). However, the existing methods are difficult to model the context relationship between pixels in the predicted results. To solve this problem, some studies have used Fully Connected Crf (FullCrf) to perform secondary optimization of semantic segmentation results combined with context information, but the discontinuity problem of road structure cannot be effectively improved. In order to improve the integrity of road structure, this study proposes a Short Range Conditional Random Filed (SRCRF) model combined with DCNN. Methods: SRCRF mainly includes unary potential function based on road pre-segmentation, binary potential function based on spectral spatial features and k-neighborhood mean field inference algorithm. Firstly, the priori knowledge of road pre-segmentation results is obtained by using the powerful feature extraction capability of DCNN as the unary potential function of SRCRF, Secondly, the dependence of the binary potential function defined by the linear combination of Gaussian kernel functions on the surrounding nodes is modeled. The binary potential function enables the classification results to have local consistency that is, adjacent pixels with similar spectral features have the same label. Finally, K-neighborhood mean field inference algorithm based on mean field approximation inference algorithm optimizes the inference range to make full use of the spatial context information and spectral feature context information of the road, and then calculates the optimal label corresponding to each pixel based on the space and spectral feature to optimize the road accurately. The convolution method is adopted to control the inference range of SRCRF within the radius of K in order to improve the proportion of feature vectors (road-road). Results: The experimental results show that SRCRF alleviates the transition smoothness of FullCrf, and alleviates the structural discontinuity and incompleteness in the road acquisition results of high resolution remote sensing images. In Zimbawe-Roads dataset and Cheng-Roads dataset, F1 values of SRCRF increased by about 4.01% and 3.73% respectively compared with DCNN, and about 3.25% and 2.28% respectively compared with FullCrf. Conclusion: Compared with traditional deep learning methods for road extraction from high resolution remote sensing images, this paper proposes a new road extraction scheme for remote sensing images, SRCRF. This scheme combines the advantages of DCNN and optimizes the fully connected structure of traditional conditional random fields into k-neighborhood structure, which reduces the inference scope and improves the proportion of feature vectors (road to road). Compared with FullCrf, SRCRF can make better use of image color features and spatial features to accurately optimize the road extraction results of deep learning output. According to the results of SRCRF on Cheng-Roads and Zimbawe-Roads data sets, the performance of this method is improved compared with DCNN and FullCrf, and the time is shortened by one order of magnitude compared with FullCrf. In future work, we will further investigate the potential for learning Gaussian features and investigate more complex CRF architectures to better capture global context information. Finally, we are particularly interested in exploring the application potential of SRCRF in other fields, such as building extraction, vehicle extraction, lake extraction, etc.
- Remote sensing image /
- Road extraction /
- Deep learning /
- Conditional random field /
- Semantic segmentation

[1]	Abdollahi A, Pradhan B, Shukla N, et al.Deep Learning Approaches Applied to Remote Sensing Datasets for Road Extraction:A State-of-the-Art Review[J].Remote Sensing, 2020, 12(9):1444
[2]	Soulard C E, Acevedo W, Stehman S V.Removing Rural Roads from the National Land Cover Database to Create Improved Urban Maps for the United States, 1992 to 2011[J].Photogrammetric Engineering&Remote Sensing, 2018, 84(2):101-109
[3]	Li D M, Deng L B, Cai Z M, et al.Notice of Retraction:Intelligent Transportation System in Macao Based on Deep Self-Coding Learning[J].IEEE Transactions on Industrial Informatics, 2018, 14(7):3253-3260
[4]	Vargas-Muñoz J E, Lobry S, Falcão A X, et al.Correcting Rural Building Annotations in OpenStreetMap Using Convolutional Neural Networks[J].ISPRS Journal of Photogrammetry and Remote Sensing, 2019, 147:283-293
[5]	Xu Y Y, Xie Z, Wu L, et al.Multilane Roads Extracted from the OpenStreetMap Urban Road Network Using Random Forests[J].Transactions in GIS, 2019, 23(2):224-240
[6]	Bruzzone L, Persello C.A Novel Context-Sensitive Semisupervised SVM Classifier Robust to Mislabeled Training Samples[J].IEEE Transactions on Geoscience and Remote Sensing, 2009, 47(7):2142-2154
[7]	Shelhamer E, Long J, Darrell T.Fully Convolutional Networks for Semantic Segmentation[J].IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39(4):640-651
[8]	Badrinarayanan V, Kendall A, Cipolla R.SegNet:A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation[J].IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39(12):2481-2495
[9]	Abderrahim N Y Q, Abderrahim S, Rida A.Road Segmentation using U-Net architecture[C]//2020 IEEE International conference of Moroccan Geomatics (Morgeo).Casablanca, Morocco.:1-4
[10]	Ronneberger O, Fischer P, Brox T.U-Net:Convolutional Networks for Biomedical Image Segmentation[M]//Lecture Notes in Computer Science.Cham:Springer International Publishing, 2015:234-241
[11]	Cheng G L, Wang Y, Xu S B, et al.Automatic Road Detection and Centerline Extraction via Cascaded End-to-End Convolutional Neural Network[J].IEEE Transactions on Geoscience and Remote Sensing, 2017, 55(6):3322-3337
[12]	Zhang Z X, Liu Q J, Wang Y H.Road Extraction by Deep Residual U-Net[J].IEEE Geoscience and Remote Sensing Letters, 2018, 15(5):749-753
[13]	He K M, Zhang X Y, Ren S Q, et al.Deep residual learning for image recognition[C]//2016 IEEE Conference on Computer Vision and Pattern Recognition.Las Vegas, NV, USA.:770-778
[14]	He H, Yang D F, Wang S C, et al.Road Extraction by Using Atrous Spatial Pyramid Pooling Integrated Encoder-Decoder Network and Structural Similarity Loss[J].Remote Sensing, 2019, 11(9):1015
[15]	Chen L C, Papandreou G, Schroff F, et al.Rethinking Atrous Convolution for Semantic Image Segmentation[EB/OL].2017:arXiv:1706.05587.https://arxiv.org/abs/1706.05587
[16]	Zhao H S, Shi J P, Qi X J, et al.Pyramid scene parsing network[C]//2017 IEEE Conference on Computer Vision and Pattern Recognition.Honolulu, HI, USA.:6230-6239
[17]	Rao Y B, Liu W, Pu J S, et al.Roads detection of aerial image with FCN-CRF model[C]//2018 IEEE Visual Communications and Image Processing.Taichung, China.:1-4
[18]	Krähenbühl P, Koltun V.Efficient Inference in Fully Connected CRFS with Gaussian Edge Potentials[EB/OL].2012:arXiv:1210.5644.https://arxiv.org/abs/1210.5644
[19]	Alam F I, Zhou J, Liew A W C, et al.Conditional Random Field and Deep Feature Learning for Hyperspectral Image Classification[J].IEEE Transactions on Geoscience and Remote Sensing, 2019, 57(3):1612-1628
[20]	Alam F I, Zhou J, Liew A W C, et al.CRF learning with CNN features for hyperspectral image segmentation[C]//2016 IEEE International Geoscience and Remote Sensing Symposium.Beijing, China.:6890-6893
[21]	Teichmann M, Cipolla R.Convolutional CRFS for Semantic Segmentation[J].ArXiv Preprint ArXiv:180504777, 2018
[22]	Li Q Y, Shi Y L, Huang X, et al.Building Footprint Generation by Integrating Convolution Neural Network with Feature Pairwise Conditional Random Field (FPCRF)[J].IEEE Transactions on Geoscience and Remote Sensing, 2020, 58(11):7502-7519
[23]	Li S Z.Markov random field modeling in image analysis[M].3rd ed.London:Springer, 2009
[24]	Adams A, Baek J, Davis M A.Fast High-Dimensional Filtering Using the Permutohedral Lattice[J].Computer Graphics Forum, 2010, 29(2):753-762

[1]	赵之若, 王少宇, 王心宇, 钟燕飞. 一种改进的火星车多光谱影像深度新颖目标探测方法 . 武汉大学学报 ( 信息科学版), doi: 10.13203/j.whugis20220119
[2]	郭从洲, 李可, 李贺, 童晓冲, 王习文. 遥感图像质量等级分类的深度卷积神经网络方法 . 武汉大学学报 ( 信息科学版), doi: 10.13203/j.whugis20200292
[3]	张三强, 宋国民, 贾奋励, 陈令羽. 人物经历信息模型及其信息提取方法 . 武汉大学学报 ( 信息科学版), doi: 10.13203/j.whugis20190424
[4]	李彦胜, 张永军. 耦合知识图谱和深度学习的新一代遥感影像解译范式 . 武汉大学学报 ( 信息科学版), doi: 10.13203/j.whugis20210652
[5]	李鹏程, 白文浩. 基于Transformer结构的遥感影像敏感目标自动隐藏方法 . 武汉大学学报 ( 信息科学版), doi: 10.13203/j.whugis20220219
[6]	杨军, 于茜子. 结合空洞卷积的FuseNet变体网络高分辨率遥感影像语义分割 . 武汉大学学报 ( 信息科学版), doi: 10.13203/j.whugis20200305
[7]	邵振峰, 孙悦鸣, 席江波, 李岩. 智能优化学习的高空间分辨率遥感影像语义分割 . 武汉大学学报 ( 信息科学版), doi: 10.13203/j.whugis20200640
[8]	陈行, 罗斌. 利用动态上采样滤波深度网络进行多角度遥感影像超分辨率重建 . 武汉大学学报 ( 信息科学版), doi: 10.13203/j.whugis20200651
[9]	季顺平, 罗冲, 刘瑾. 基于深度学习的立体影像密集匹配方法综述 . 武汉大学学报 ( 信息科学版), doi: 10.13203/j.whugis20200620
[10]	柴华彬, 严超, 邹友峰, 陈正超. 利用PSP Net实现湖北省遥感影像土地覆盖分类 . 武汉大学学报 ( 信息科学版), doi: 10.13203/j.whugis20190296
[11]	陆川伟, 孙群, 赵云鹏, 孙士杰, 马京振, 程绵绵, 李元復. 一种基于条件生成式对抗网络的道路提取方法 . 武汉大学学报 ( 信息科学版), doi: 10.13203/j.whugis20190159
[12]	蒋腾平, 杨必胜, 周雨舟, 朱润松, 胡宗田, 董震. 道路点云场景双层卷积语义分割 . 武汉大学学报 ( 信息科学版), doi: 10.13203/j.whugis20200081
[13]	邬伦, 刘磊, 李浩然, 高勇. 基于条件随机场的中文地名识别方法 . 武汉大学学报 ( 信息科学版), doi: 10.13203/j.whugis20141009
[14]	赵金奇, 杨杰, 李平湘, 邓少平, 李小娟, 路嘉铭. 改进剖面匹配和EKF对SAR影像道路半自动提取 . 武汉大学学报 ( 信息科学版), doi: 10.13203/j.whugis20150200
[15]	陈光, 眭海刚, 涂继辉, 宋志娜. 基于P-N学习的高分遥感影像道路半自动提取方法 . 武汉大学学报 ( 信息科学版), doi: 10.13203/j.whugis20140999
[16]	余洁, 余峰, 张晶, 刘振宇. 结合区域生长与道路基元的高分辨率遥感影像道路提取 . 武汉大学学报 ( 信息科学版),
[17]	余长慧, 易尧华. 利用MRF方法的高分辨率影像道路提取 . 武汉大学学报 ( 信息科学版),
[18]	吴小波, 杨辽, 沈金祥, 王杰. 利用空间连续性进行高分辨率遥感影像道路提取 . 武汉大学学报 ( 信息科学版),
[19]	余长慧, 孟令奎, 秦昆. 基于标点随机过程的遥感影像道路提取 . 武汉大学学报 ( 信息科学版),
[20]	刘少创, 林宗坚. 航空遥感影像中道路的半自动提取 . 武汉大学学报 ( 信息科学版),

点击查看大图

计量

文章访问数: 278
HTML全文浏览量: 34
PDF下载量: 11
被引次数: 0

姓名
邮箱
手机号码
标题
留言内容
验证码

留言板

结合DCNN与短距条件随机场的遥感影像道路提取

doi: 10.13203/j.whugis20210464

作者简介:
赫晓慧，教授，博士生导师，主要从事人工智能，遥感影像处理及数据挖掘。hexh@zzu.edu.cn

Road Extraction from Remote Sensing Image by Integrating DCNN with Short Range Conditional Random Field(SRCRF)

计量

结合DCNN与短距条件随机场的遥感影像道路提取

doi: 10.13203/j.whugis20210464

1. 郑州大学, 地球科学与技术学院, 河南郑州, 450052;

2. 郑州大学, 信息工程学院, 河南郑州, 450052;

3. 中国气象科学研究院郑州大学生态气象联合实验室郑州, 450052

作者简介:
赫晓慧，教授，博士生导师，主要从事人工智能，遥感影像处理及数据挖掘。hexh@zzu.edu.cn

English Abstract

Road Extraction from Remote Sensing Image by Integrating DCNN with Short Range Conditional Random Field(SRCRF)

1. School of Earth Science and Technology, Zhengzhou University, Zhengzhou 450052, China;

2. School of Information Engineering, Zhengzhou University, Zhengzhou 450052, China;

3. Joint Laboratory of Eco-Meteorology, Chinese Academy of Meteorological Sciences, Zhengzhou University, Zhengzhou 450052

全文HTML

目录

留言板

结合DCNN与短距条件随机场的遥感影像道路提取

doi: 10.13203/j.whugis20210464

作者简介: 赫晓慧，教授，博士生导师，主要从事人工智能，遥感影像处理及数据挖掘。hexh@zzu.edu.cn

Road Extraction from Remote Sensing Image by Integrating DCNN with Short Range Conditional Random Field(SRCRF)

计量

出版历程

结合DCNN与短距条件随机场的遥感影像道路提取

doi: 10.13203/j.whugis20210464

1. 郑州大学, 地球科学与技术学院, 河南 郑州, 450052; 2. 郑州大学, 信息工程学院, 河南 郑州, 450052; 3. 中国气象科学研究院郑州大学生态气象联合实验室 郑州, 450052

作者简介: 赫晓慧，教授，博士生导师，主要从事人工智能，遥感影像处理及数据挖掘。hexh@zzu.edu.cn

English Abstract

Road Extraction from Remote Sensing Image by Integrating DCNN with Short Range Conditional Random Field(SRCRF)

1. School of Earth Science and Technology, Zhengzhou University, Zhengzhou 450052, China; 2. School of Information Engineering, Zhengzhou University, Zhengzhou 450052, China; 3. Joint Laboratory of Eco-Meteorology, Chinese Academy of Meteorological Sciences, Zhengzhou University, Zhengzhou 450052

全文HTML

目录

作者简介:
赫晓慧，教授，博士生导师，主要从事人工智能，遥感影像处理及数据挖掘。hexh@zzu.edu.cn

1. 郑州大学, 地球科学与技术学院, 河南郑州, 450052;

2. 郑州大学, 信息工程学院, 河南郑州, 450052;

3. 中国气象科学研究院郑州大学生态气象联合实验室郑州, 450052

作者简介:
赫晓慧，教授，博士生导师，主要从事人工智能，遥感影像处理及数据挖掘。hexh@zzu.edu.cn

1. School of Earth Science and Technology, Zhengzhou University, Zhengzhou 450052, China;

2. School of Information Engineering, Zhengzhou University, Zhengzhou 450052, China;

3. Joint Laboratory of Eco-Meteorology, Chinese Academy of Meteorological Sciences, Zhengzhou University, Zhengzhou 450052