基于双对抗网络的多源多时相遥感影像云去除

Multi-source Multi-temporal Remote Sensing Image Cloud Removal Based on Dual Adversarial Network

  • 摘要: 光学遥感影像易受云层遮挡导致下垫面地物信息缺失,因此,遥感影像云去除对提高影像利用率至关重要。合成孔径雷达(SAR)影像可穿透云层获取地表地物散射信息,能够为遥感影像云去除恢复地物光学信息提供有效信息。但由于光学和SAR的成像模式存在明显差异,导致现有云去除方法在城镇等地表细节复杂区域恢复能力偏弱。针对以上问题,本研究提出一种基于双对抗网络的多源多时相遥感影像云去除方法。首先,基于Sentinel构建一个覆盖全球主要城市、涵盖多时相光学影像和SAR的城镇去云数据集(UCR-1.0)。其次,提出双对抗去云网络(DGAN)。通过双对抗协同优化与自适应注意力机制,提升跨模态遥感影像生成的空间一致性与语义保真度的同时,实现光学影像云污染区域的精准修复。最后使用UCR-1.0对多个模型进行训练与测试,实验证明DGAN在SSIM和PSNR等指标上均优于其它模型。证明本研究方法在城镇区域恢复中取得了良好效果。

     

    Abstract: Optical remote sensing imagery is often affected by cloud cover, leading to the loss of ground object information. Therefore, cloud removal from remote sensing imagery is crucial for improving the utilization of these images. Synthetic Aperture Radar (SAR) imagery, which can penetrate clouds and capture surface scattering information, provides effective information for recovering optical data obscured by clouds. However, due to significant differences in the imaging modes of optical and SAR data, existing cloud removal methods exhibit weak recovery capabilities in areas with complex surface details, such as urban regions. To address this issue, this study proposes a multi-source, multi-temporal cloud removal method for remote sensing imagery based on a dual adversarial network. First, a cloud removal dataset (UCR-1.0) is constructed, covering major cities worldwide and including multi-temporal optical imagery and SAR data from Sentinel. Then, a Dual Adversarial Cloud Removal Network (DGAN) is introduced. Through dual adversarial collaborative optimization and an adaptive attention mechanism, the proposed method enhances the spatial consistency and semantic fidelity of cross-modal remote sensing image generation, while accurately repairing the cloud-contaminated areas in optical imagery. Finally, experiments are conducted using UCR-1.0 to train and test multiple models. The results show that DGAN outperforms other models in terms of SSIM and PSNR metrics, demonstrating the effectiveness of the proposed method in urban region restoration.

     

/

返回文章
返回