唐小川, 涂子涵, 任绪清, 方成勇, 王宇, 刘鑫, 范宣梅. 一种识别植被覆盖滑坡的多模态深度神经网络模型[J]. 武汉大学学报 ( 信息科学版). DOI: 10.13203/j.whugis20230099
引用本文: 唐小川, 涂子涵, 任绪清, 方成勇, 王宇, 刘鑫, 范宣梅. 一种识别植被覆盖滑坡的多模态深度神经网络模型[J]. 武汉大学学报 ( 信息科学版). DOI: 10.13203/j.whugis20230099
TANG Xiaochuan, TU Zihan, REN Xuqing, FANG Chengyong, WANG Yu, LIU Xin, FAN Xuanmei. A Multi-Modal Deep Neural Network Model for Forested Landslide Detection[J]. Geomatics and Information Science of Wuhan University. DOI: 10.13203/j.whugis20230099
Citation: TANG Xiaochuan, TU Zihan, REN Xuqing, FANG Chengyong, WANG Yu, LIU Xin, FAN Xuanmei. A Multi-Modal Deep Neural Network Model for Forested Landslide Detection[J]. Geomatics and Information Science of Wuhan University. DOI: 10.13203/j.whugis20230099

一种识别植被覆盖滑坡的多模态深度神经网络模型

A Multi-Modal Deep Neural Network Model for Forested Landslide Detection

  • 摘要: 我国西南山区植被茂盛,该区域光学遥感影像上的滑坡常被植被遮挡、难以辨识,基于光学遥感影像的植被覆盖滑坡识别错误率较高,难以满足实际需求。针对这一问题,利用机载激光雷达(light detectionand ranging,LiDAR)生成的数字高程模型(digital elevation model,DEM)和山体阴影图去除滑坡表面的植被覆盖,构建了一个植被覆盖山区的滑坡数据集。在此基础上,提出一种基于多模态深度学习的智能滑坡识别模型,综合利用DEM和山体阴影图识别植被覆盖条件下的滑坡,模型主要包括三个神经网络模块:自动提取DEM数据特征的Transformer神经网络,自动提取山影图特征的Transformer神经网络,以及融合多模态遥感数据的卷积注意力神经网络。通过实验对比了ResU-Net、LandsNet、HRNet、SeaFormer模型,实验结果表明,所提出的模型达到了最高的滑坡预测精度,IoU和F1分别提高了9.3%和6.8%。因此,LiDAR能够有效地去除植被干扰,适用于识别西南山区植被覆盖条件下的滑坡;本文提出的LiDAR滑坡识别模型能够预测滑坡的位置,为滑坡监测设备选址提供有力支撑。

     

    Abstract: Objectives : Vegetation widely spread in the southwestern mountainous regions of China. In the remote sensing images of this area, the landslides are usually shaded by vegetation. The error rate of forested landslide detection in remote sensing images is high, which is hard to meet practical needs. Methods : To address this issue, this article uses light detection and ranging (LiDAR)-derived digital elevation mode (DEM) and Hillshade to remove the forest on the landslides. In addition, a new dataset for forested landslide detection is also constructed. On this basis, an intelligent landslide detection model base on multimodal deep learning is proposed. The proposed model uses DEM and hillshade to identify forested landslides, which consists of three neural network models. First, a Transformer network for automatic extraction of DEM features is proposed. Second, a Transformer network for automatically extracting hillshade features is proposed. Third, a convolution neural network with attention mechanism for merging multimodal remote sensing data is proposed. Results . The proposed model is compared with ResU-Net, LandsNet, HRNet and SeaFormer. Experimental results show that the proposed model achieves the highest prediction accuracy. IoU and F1 is improved by 9.3% and 6.8%. Conclusions . LiDAR is able to remove the impact of forest cover, which is suitable for identifying the forested landslides in the southwest mountain areas of China. The proposed LiDAR-based landslide detection model is able to predict the position of landslides, which is useful for deciding the position of landslide monitoring devices.

     

/

返回文章
返回