针对高光谱遥感图像变化检测的混合注意力和双向门控网络
Hybrid attention and bidirectional-gated network for hyperspectral image change detection
- 2024年 页码:1-11
网络出版日期: 2024-10-08
DOI: 10.11834/jig.240360
移动端阅览
浏览全部资源
扫码关注微信
网络出版日期: 2024-10-08 ,
移动端阅览
李相潭,高峰,孙悦等.针对高光谱遥感图像变化检测的混合注意力和双向门控网络[J].中国图象图形学报,
Li Xiangtan,Gao Feng,Sun Yue,et al.Hybrid attention and bidirectional-gated network for hyperspectral image change detection[J].Journal of Image and Graphics,
目的
2
高光谱图像能提供丰富的光谱和空间信息,但常受到多种噪声的干扰,增加了其在变化检测领域应用的复杂性。为了解决上述问题,本文提出一种基于混合注意力和双向门控网络的高光谱图像变化检测方法,旨在提升变化检测的性能,从而在复杂环境和多变条件下实现更可靠的变化检测。
方法
2
本文方法通过整合局部和全局特征,改进了Transformer中的自注意力和前馈神经网络。具体而言,本文提出了混合注意力模块,采用CNN和gMLP的并行结构,分别提取图像的局部特征和全局上下文信息,有效平衡了局部细节和全局上下文的特征提取,起到抑制噪声的作用。同时,构建了双向门控网络,强化了通道和空间维度的特征提取,进一步增强了全局与局部信息的融合,实现了多时相高光谱图像特征的深度融合。
结果
2
实验在3个数据集上与主流的6种方法进行了比较,在Framland数据集中,相比于BiT模型,准确率和Kappa系数分别提高了0.34%和2.02%;在Hermiston数据集中,相比于CBANet模型,准确率和Kappa系数分别提高了1%和2.08%。同时消融实验结果证明,混合注意力模块和双向门控网络能有效融合局部与全局信息,提升变化检测的精度。
结论
2
本文方法通过高效融合局部和全局特征,显著提升了变化检测的准确性,证明了其在实际应用中的潜力。在三个高光谱数据集的大量实验结果表明,本文方法在变化检测任务中性能优异,显著优于BiT、CBANet等当前主流方法。
Objective
2
Hyperspectral images (HSIs) provide rich spectral and spatial information, which is essential for a wide range of applications, including disaster assessment, resource management, and land surveys. The rich data content of HSIs allows for the detailed analysis of various materials and surfaces, making them invaluable in monitoring environmental changes, assessing natural disasters, and managing agricultural resources. However, the application of HSIs in change detection tasks is often hindered by several challenges, primarily due to the presence of various types of noise. HSIs are particularly susceptible to Gaussian noise, which is typically introduced during the image acquisition process due to sensor limitations and environmental conditions. This type of noise can obscure the spectral signatures of materials, making it difficult to accurately detect changes over time. Additionally, striping noise, which occurs due to inconsistencies in the sensor response across different spectral bands, further complicates the interpretation of HSIs. These noise types can significantly degrade the quality of the data, leading to less reliable change detection results. Given these challenges, there is a pressing need for advanced methods that can effectively mitigate the impact of noise and enhance the accuracy of change detection in HSIs. Traditional methods often fall short in addressing the intricate balance between preserving local details and capturing global context, both of which are crucial for accurate change detection. This is particularly challenging in complex and variable environments where the nature of changes can be subtle and distributed across different spatial and spectral dimensions.
Method
2
To address these issues, this paper proposes a novel hyperspectral image change detection method based on hybrid attention and bidirectional gated networks. The proposed method integrates local and global features by enhancing the self-attention mechanism and feedforward neural network in the Transformer architecture. Specifically, a hybrid attention module (HAM) is introduced, which employs parallel structures of Convolutional Neural Networks (CNN) and MLP layers with gating (gMLP) to extract local features and global contextual information, respectively. CNNs are particularly effective at identifying fine details and local patterns in the spatial domain, which are crucial for detecting subtle changes in hyperspectral images. By using convolutional layers, the HAM can efficiently extract and represent local information. gMLP layers with gating mechanisms are adept at modeling long-range dependencies and global interactions within the data. This allows the HAM to balance the detailed local information extracted by the CNNs with a broader, global perspective, ensuring that the overall feature representation is comprehensive and robust against noise. This dual approach effectively balances the extraction of fine local details and broad global context, thereby reducing the impact of noise and enhancing feature representation. Additionally, a bidirectional gated network (BGFN) is constructed to further improve feature extraction and integration. The BGFN is designed to enhance feature extraction and integration across both channel and spatial dimensions, providing a more holistic understanding of the hyperspectral data. The BGFN leverages a bidirectional gating mechanism to selectively emphasize relevant features while suppressing irrelevant ones. This selective emphasis is crucial for dealing with the noise inherent in HSIs, as it allows the network to focus on the most informative and significant features, improving the accuracy of change detection. By enhancing interactions across both channel and spatial dimensions, the BGFN ensures that the extracted features are well-integrated and representative of the underlying data. This comprehensive fusion of local and global information is key to achieving deep integration of multi-temporal hyperspectral image features, enabling more accurate and reliable change detection.
Result
2
Extensive experiments were conducted on three hyperspectral datasets: Framland, Hermiston, and River dataset. The proposed method was compared with six mainstream methods, including BiT and CBANet, to evaluate its performance in terms of accuracy and Kappa coefficient. On the River dataset, HBFormer achieves a reduction in False Positive (FP), False Negative (FN), and Overall Error (OE), an improvement of 0.13% in accuracy, and an improvement of 0.77% in Kappa coefficient compared to CBANet. On the Farmland dataset, HBFormer achieves the lowest False Alarm Number (FP), with 0.34% improvement in accuracy and 2.02% improvement in Kappa coefficient over BiT, while on the Hermiston dataset, HBFormer achieves the lowest FP and OE, with 1% and 2.08% improvement in accuracy and Kappa coefficient over CBANet, respectively. The accuracy and Kappa coefficient are improved by 1% and 2.08% respectively over CBANet. Ablation experiments were also conducted to assess the contribution of each component of the proposed method. The results demonstrated that both the hybrid attention module and the bidirectional gated network play crucial roles in enhancing change detection accuracy by effectively integrating local and global information. The proposed method consistently outperformed the mainstream methods across all datasets, showcasing its superior capability in handling noise and providing accurate change detection. The results underline the importance of integrating local and global features and highlight the robustness of the hybrid attention and bidirectional gated network approach.
Conclusion
2
The comprehensive experiments on three hyperspectral datasets validate the efficacy of the proposed method in change detection tasks. The hybrid attention and bidirectional gated network approach not only enhances accuracy and robustness but also offers a scalable solution for various hyperspectral image analysis applications. The overarching goal of this research is to enhance the performance of change detection in HSIs, making it more accurate and reliable even under complex and variable conditions. The method's ability to effectively fuse local and global features results in improved accuracy and resilience to noise, making it a valuable tool for remote sensing tasks. The significant performance gains over current mainstream methods such as BiT and CBANet underscore the method's potential for practical deployment in real-world scenarios. Furthermore, the study opens avenues for future research to explore the application of this method across diverse datasets and environments. Enhancing the generalization capabilities of the proposed method could lead to even broader applicability and stronger support for real-world remote sensing tasks. In conclusion, the proposed hyperspectral image change detection method based on hybrid attention and bidirectional gated networks presents a significant advancement in the field. It addresses the challenges posed by noise and the need for robust feature integration, providing a reliable and effective solution for complex and variable environments. The promising results and potential for further improvements make this method a valuable contribution to hyperspectral image analysis and remote sensing.
变化检测高光谱图像遥感技术双向注意力Transformer
change detectionhyperspectral imageremote sensingbidirectional attentiontransformer
Cao G, Li Y P, Liu Y Z and Shang Y F. 2014. Automatic change detection in high-resolution remote-sensing images by means of level set evolution and support vector machine classification. International Journal of Remote Sensing, 35(16): 6255-6270 [DOI: 10.5555/2674477.2674495http://dx.doi.org/10.5555/2674477.2674495]
Chen H, Qi Z P, Shi Z W. 2022. Remote sensing image change detection with transformers. IEEE Transactions on Geoscience and Remote Sensing, 60: 1-14 [DOI: 10.1109/TGRS.2021.3095166http://dx.doi.org/10.1109/TGRS.2021.3095166]
Chen J, Yuan Z Y, Peng J, Chen L, Huang H Z, Zhu J W, Liu Y and Li H F. 2021. DASNet: Dual attentive fully convolutional siamese networks for change detection in high-resolution satellite images. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 14: 1194-1206 [DOI: 10.1109/JSTARS.2020.3037893http://dx.doi.org/10.1109/JSTARS.2020.3037893]
Cui B G, Fang X, Lu Y, Huang L, Liu R J. 2023. RTDNet: red tide detection network for high-resolution satellite images. Journal of Image and Graphics, 28(12): 3911-3921 [DOI: 10.11834/jig.221174http://dx.doi.org/10.11834/jig.221174]
崔宾阁, 方喜, 路燕, 黄玲, 刘荣杰. 2023. RTDNet:面向高分辨率卫星影像的赤潮探测网络. 中国图象图形学报, 28(12): 3911-3921 [DOI: 10.11834/jig.221174http://dx.doi.org/10.11834/jig.221174]
Eftekhari A, Samadzadegan F and Dadrass Javan F. 2023. Building change detection using the parallel spatial-channel attention block and edge-guided deep network. International Journal of Applied Earth Observation and Geoinformation, 117: 103180 [DOI: 10.1016/j.jag.2023.103180http://dx.doi.org/10.1016/j.jag.2023.103180]
Fang S, Li K Y, Shao J Y and Li Z. 2022. SNUNet-CD: A densely connected siamese network for change detection of VHR images. IEEE Geoscience and Remote Sensing Letters, 19: 1-5 [DOI: 10.1109/LGRS.2021.3056416http://dx.doi.org/10.1109/LGRS.2021.3056416]
He K, Zhang X, Ren S and Sun J. 2016. Deep Residual Learning for Image Recognition. IEEE Conference on Computer Vision and Pattern Recognition , 770-778 [DOI: 10.1109/CVPR.2016.90http://dx.doi.org/10.1109/CVPR.2016.90]
Huang W, Zhao Z B, Sun L and Ju M. 2022. Dual-branch attention-assisted CNN for hyperspectral image classification. Remote Sensing, 14(23): 6158 [DOI: 10.3390/rs14236158http://dx.doi.org/10.3390/rs14236158]
Li Y H, Ren J C, Yan Y J, Liu Q Y, Ma P, Petrovski A and Sun H J. 2023. CBANet: An end-to-end cross-band 2-D attention network for hyperspectral change detection in remote sensing. IEEE Transactions on Geoscience and Remote Sensing, 61: 1-11 [DOI: 10.1109/TGRS.2023.3276589http://dx.doi.org/10.1109/TGRS.2023.3276589]
Lin Y, Li S T, Fang L Y and Ghamisi P. 2020. Multispectral change detection with bilinear convolutional neural networks. IEEE Geoscience and Remote Sensing Letters, 17(10): 1757-1761 [DOI: 10.1109/LGRS.2019.2953754http://dx.doi.org/10.1109/LGRS.2019.2953754]
Liu H X, Dai Z H, So D R and Le Q V. 2021. Pay attention to MLPs. Neural Information Processing Systems, 34: 9204-9215
Ma X R, Ha L, Shen D B, Mei L, Wang H Y. 2024. Cross-dataset hyperspectral image classification based on fusion feature optimization. Journal of Image and Graphics, 29(8): 2175-2187 [DOI: 10.11834/jig.230503http://dx.doi.org/10.11834/jig.230503]
马晓瑞, 哈林, 谌敦斌, 梅亮, 王洪玉. 2024. 融合特征优化的跨数据集高光谱图像分类. 中国图象图形学报, 29(8): 2175-2187 [DOI: 10.11834/jig.230503http://dx.doi.org/10.11834/jig.230503]
Mou L C, Bruzzone L and Zhu X X. 2019. Learning spectral-spatial-temporal features via a recurrent convolutional neural network for change detection in multispectral imagery. IEEE Transactions on Geoscience and Remote Sensing, 57(2): 924-935 [DOI: 10.1109/TGRS.2018.2863224http://dx.doi.org/10.1109/TGRS.2018.2863224]
Peng Z L, Guo Z H, Huang W, Wang Y W, Xie L X, Jiao J B, Tian Q and Ye Q X. 2023. Conformer: Local features coupling global representations for recognition and detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(8): 9454-9468 [DOI: 10.1109/TPAMI.2023.3243048http://dx.doi.org/10.1109/TPAMI.2023.3243048]
Qu J H, Hou S X, Dong W Q, Li Y S and Xie W Y. 2022. A multilevel encoder–decoder attention network for change detection in hyperspectral images. IEEE Transactions on Geoscience and Remote Sensing, 60: 1-13 [DOI: 10.1109/TGRS.2021.3130122http://dx.doi.org/10.1109/TGRS.2021.3130122]
Wang C X, Zhao D P, Qi X H, Liu Z R and Shi Z W. 2023. A hierarchical decoder architecture for multilevel fine-grained disaster detection. IEEE Transactions on Geoscience and Remote Sensing, 61: 1-14 [DOI: 10.1109/TGRS.2023.3264811http://dx.doi.org/10.1109/TGRS.2023.3264811]
Wang X, Li Y Y, Zhang X L. 2024. Ghost-guided UNet++ for high-resolution remote sensing image change detection. Journal of Image and Graphics, 29(5): 1460-1478 [DOI: 10.11834/jig.230212http://dx.doi.org/10.11834/jig.230212]
王鑫, 李莹莹, 张香梁. 2024. Ghost引导UNet++的高分遥感影像变化检测. 中国图象图形学报, 29(5): 1460-1478 [DOI: 10.11834/jig.230212http://dx.doi.org/10.11834/jig.230212]
YANG B, MAO Y, CHEN J, LIU J Q, CHEN J and YAN K. 2023. Review of Remote Sensing Change Detection in Deep Learning: Bibliometric and Analysis. National Remote Sensing Bulletin, 27(09): 1988-2005
杨彬, 毛银, 陈晋, 刘建强, 陈杰, 闫凯. 2023. 深度学习的遥感变化检测综述:文献计量与分析. 遥感学报, 27(09): 1988-2005[DOI: 10.11834/jrs.20222156http://dx.doi.org/10.11834/jrs.20222156]
Zhai C, Wang L J and Yuan J. 2023. New fusion network with dual-branch encoder and triple-branch decoder for remote sensing image change detection. Applied Sciences, 13(10): 6167 [DOI: 10.3390/app13106167http://dx.doi.org/10.3390/app13106167]
Zhang C, Wei S Q, Ji S P and Lu M. 2019. Detecting large-scale urban land cover changes from very high resolution remote sensing images using CNN-based classification. ISPRS International Journal of Geo-Information, 8(4): 189 [DOI: 10.3390/ijgi8040189http://dx.doi.org/10.3390/ijgi8040189]
Zhang Y B, Yu H M, Liu C S, Tao Y, Sui J X, Shen H O and Song J H. 2023. Ecological environment assessment of Mengjialing mining area based on remote sensing ecological index. Engineering Investigation, 51(12): 46-53
张熠斌, 于海明, 刘传深, 陶勇, 隋佳轩, 沈海鸥, 宋金红. 2023. 基于遥感生态指数的孟家岭矿区生态环境评价. 工程勘察, 51(12): 46-53
Zhou C L, Shi Q, Li J and Zhang X C. 2024. Spectral-frequency domain attribute pattern fusion for hyperspectral image change detection. National Remote Sensing Bulletin, 28(1): 105-120
周承乐, 石茜, 李军, 张新长. 2024. 光谱—频域属性模式融合的高光谱遥感图像变化检测. 遥感学报, 28(1): 105-120 [DOI: 10.11834/jrs.20232600http://dx.doi.org/10.11834/jrs.20232600]
相关作者
相关机构