一种适用于高山复杂气候条件下的加权掩膜云去除模型

A Weighted Masking Cloud Removal Model Suitable for Complex Alpine Climatic Conditions

  • 摘要: 云雾覆盖是制约光学遥感研究的关键因素之一,尤其是在藏东南地区,其平均云量高达62%,严重降低了光学遥感影像的可用性。与时序去云方法相比,单幅影像去云具有更强的时效性,但实现难度较高。且现有的云层不透度估计方法难以恢复厚云覆盖区域的地表信息,而生成对抗网络方法则常常伴随伪影且可解释性差。针对上述问题,提出了一种适用于高山复杂气候条件下的加权掩膜云去除模型。所提模型采用改进的Transformer模块作为生成器,并重构了多头注意力机制,有效融合了薄云去除与厚云地表信息修复的能力。经哨兵2号Level-2A数据测试表明,所提模型在高保真恢复地表信息的同时有效减少了厚云修复时的伪影现象。实验验证结果表明,所提模型在各项性能指标上均优于现有方法,实现了高保真度的地表信息恢复,其平均绝对误差和均方根误差分别为0.025 6和0.035 6,峰值信噪比和结构相似性则分别为30.185 1和0.899 6。该研究成果可为高山复杂气候条件下的云雾去除提供参考,并为山地研究提供数据支持。

     

    Abstract:
    Objectives Cloud cover hampers optical remote sensing, especially in high-altitude alpine regions. In Southeastern Tibetan Plateau, cloud cover reaches 62%, which limits the use of optical image. While single-image cloud removal method is faster than temporal methods, it faces technical hurdles. The existing methods struggle under thick clouds, and generative adversarial network-based approaches often produce artifacts and poor interpretability. We propose a weighted masking cloud removal model designed for complex alpine climates, aiming for accurate surface restoration under various cloud conditions, reducing artifacts and improving robustness in mountainous terrains with snow cover.
    Methods The proposed model combines cloud opacity estimation with an advanced image generation framework. It begins by formalizing assumptions about cloud opacity and brightness to address stratified cloud phenomena in remote sensing images. And its core is an improved Transformer-based generator, which introduces a redesigned multi-head mask attention (MMA) mechanism. This mechanism uses a dynamically generated weighted mask created from estimated cloud opacity and brightness compensation maps to modulate neuron activation. The mask strategically suppresses features from heavily cloud-obscured pixels during aggregation, focusing the model's attention first on clearer regions and cloud edges. Additionally, a progressive sliding window mask update strategy is adopted, which gradually shrinks the inhibitory mask as the network deepens. This allows the model to iteratively propagate reliable information from outer regions into thick cloud cores, enabling full restoration. The model architecture adopts a dual-generator design, in which the first generator is responsible for estimating cloud opacity and brightness compensation values to generate guiding masks and the second generator integrated with MMA blocks is dedicated to synthesizing the final cloud-free image. Training is guided by a composite loss function that integrates non-saturating adversarial loss, structural similarity (SSIM) loss, and perceptual loss, ensuring visual fidelity, structural accuracy, and feature consistency. For evaluation, a dedicated alpine dataset is built using Sentinel-2 Level-2A imagery in Southeastern Tibetan Plateau. Cloud masks from S2cloudless are used to create precise cloudy-clear pairs, and a simulation protocol generates physically realistic training samples with corresponding opacity and compensation ground truth.
    Results The proposed model is rigorously evaluated against three state-of-the-art methods. On quantitative metrics, it outperforms all counterparts, achieving a mean absolute error of 0.025 6, root mean square error of 0.035 6, peak signal-to-noise ratio of 30.185 1, and SSIM index of 0.899 6. Visually, it excels in texture preservation and artifact reduction, especially under moderate (20%-30%) and heavy (>30%) cloud cover, where others show significant distortion. The proposed model also demonstrates robustness in snow-covered alpine scenes.
    Conclusions This work presents an effective cloud removal model for alpine regions by unifying thin-cloud correction and thick-cloud inpainting within a Transformer framework. The weighted mask and progressive update strategy provide a targeted explainable restoration process. This approach significantly enhances optical image usability in cloudy mountain areas and offers valuable support for related scientific research.

     

/

返回文章
返回