| Citation: |
GAO Kuiliang, LIU Bing, YU Xuchu, YU Anzhu, SUN Yifan. Automatic Network Structure Search Method for Hyperspectral Image Classification[J]. Geomatics and Information Science of Wuhan University, 2024, 49(2): 225-235. DOI: 10.13203/j.whugis20210380
|
The quality of network structure is the key to obtain excellent classification performance. Most of existing deep models are designed by the trial-and-error method. When the same model processes different hyperspectral images (HSIs), different network hyperparameters need to be set artificially to adapt to the data characteristics of different images, greatly increasing the difficulty of network design. Aiming at the problem of deep learning model design in hyperspectral image classification, this paper proposes an automatic network structure search method for HSI classification.
In the proposed method, the differentiable structure search technology is first used to search the network structure on the source HSI data sets, then the deep network model is constructed by stacking cells, and finally the classification performance is evaluated on the target HSIs. It should be pointed out that, the proposed method only conducts one search on the source HSI data sets, and the obtained deep model can be applied to other target HSI classification tasks, which can effectively improve the utilization rate of the model. To improve the generalization ability and classification accuracy of the model, multi-source and multi-resolution HSIs are employed to construct the precollected data set, and the partial channel connection operation is introduced to further improve the search efficiency.
Three HSIs inculding Houston, Chikusei and Pavia Center are selected as source data. Four HSIs including University of Pavia, Indian Pines, Salinas and Houston 2018 are selected as the target HSIs. The source data is used to determine the network model and the target HSIs are used to evaluate the classification performance. Experimental results show that the proposed method can automatically search out a universal deep network model suitable for HSI classification task, and this model can achieve better classification performance than the conventional deep learning models. The overall classification accuracies of University of Pavia, Indian Pines, Salinas and Houston 2018 are 98.15%, 98.74%, 97.30% and 74.47%, respectively.
Compared with other deep models, the model in this paper is automatically determined by differentiable architecture search algorithm according to the data characteristics of HSIs, effectively improving the classification accuracy of target HSIs while avoiding complex network design. Extensive experiments verify the applicability and effectiveness of the proposed method in HSI classification.
| [1] |
吴骅,李秀娟,李召良,等. 高光谱热红外遥感：现状与展望[J]. 遥感学报,2021,25（8）： 1567-1590.
Wu Hua,Li Xiujuan,Li Zhaoliang,et al. Hyperspectral Thermal Infrared Remote Sensing： Current Status and Perspectives[J]. National Remote Sensing Bulletin,2021,25（8）： 1567-1590.
|
| [2] |
Paoletti M E,Haut J M,Plaza J,et al. Deep Learning Classifiers for Hyperspectral Imaging： A Review[J]. ISPRS Journal of Photogrammetry and Remote Sensing,2019,158： 279-317.
|
| [3] |
张立强,李洋,侯正阳,等. 深度学习与遥感数据分析[J]. 武汉大学学报（信息科学版）,2020,45（12）： 1857-1864.
Zhang Liqiang,Li Yang,Hou Zhengyang,et al. Deep Learning and Remote Sensing Data Analysis[J]. Geomatics and Information Science of Wuhan University,2020,45（12）： 1857-1864.
|
| [4] |
Tan K,Du P J. Classification of Hyperspectral Image Based on Morphological Profiles and Multi-kernel SVM[C]//The 2nd Workshop on Hyperspectral Image and Signal Processing： Evolution in Remote Sensing,Reykjavik,Iceland,2010.
|
| [5] |
职露,余旭初,邹滨,等. 多层级二值模式的高光谱影像空-谱分类[J]. 武汉大学学报（信息科学版）,2019,44（11）： 1659-1666.
Zhi Lu,Yu Xuchu,Zou Bin,et al. A Multi-layer Binary Pattern Based Method for Hyperspectral Imagery Classification Using Combined Spatial-Spectral Characteristics[J]. Geomatics and Information Science of Wuhan University,2019,44（11）： 1659-1666.
|
| [6] |
Chen Y S,Lin Z H,Zhao X,et al. Deep Learning-Based Classification of Hyperspectral Data[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing,2014,7（6）： 2094-2107.
|
| [7] |
Zhong P,Gong Z Q,Schönlieb C. A Diversified Deep Belief Network for Hyperspectral Image Classification[J].International Archives of the Photogrammetry,Remote Sensing and Spatial Information Sciences,2016,XLI-B7： 443-449.
|
| [8] |
Zhang X R,Sun Y J,Jiang K,et al. Spatial Sequential Recurrent Neural Network for Hyperspectral Image Classification[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing,2018,11（11）： 4141-4155.
|
| [9] |
Hu W,Huang Y,Wei L,et al. Deep Convolutional Neural Networks for Hyperspectral Image Classification[J]. Journal of Sensors,2015,2015： 258619.
|
| [10] |
魏祥坡,余旭初,张鹏强,等. 联合局部二值模式的CNN高光谱图像分类[J]. 遥感学报,2020,24（8）： 1000-1009.
Wei Xiangpo,Yu Xuchu,Zhang Pengqiang,et al. CNN with Local Binary Patterns for Hyperspectral Images Classification[J]. Journal of Remote Sensing,2020,24（8）： 1000-1009.
|
| [11] |
Gao K L,Guo W Y,Yu X C,et al. Deep Induction Network for Small Samples Classification of Hyperspectral Images[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing,2020,13： 3462-3477.
|
| [12] |
Gao K L,Liu B,Yu X C,et al. Deep Relation Network for Hyperspectral Image Few-shot Classification[J]. Remote Sensing,2020,12（6）： 923.
|
| [13] |
Liu B,Yu X C,Zhang P Q,et al. Supervised Deep Feature Extraction for Hyperspectral Image Classification[J]. IEEE Transactions on Geoscience and Remote Sensing,2018,56（4）： 1909-1921.
|
| [14] |
Xu Q,Xiao Y,Wang D Y,et al. CSA-MSO3DCNN： Multiscale Octave 3D CNN with Channel and Spatial Attention for Hyperspectral Image Classification[J]. Remote Sensing,2020,12（1）： 188.
|
| [15] |
Li X,Ding M L,Pižurica A. Deep Feature Fusion via Two-Stream Convolutional Neural Network for Hyperspectral Image Classification[J].IEEE Transactions on Geoscience and Remote Sensing,2020,58（4）： 2615-2629.
|
| [16] |
Li S T,Song W W,Fang L Y,et al.Deep Learning for Hyperspectral Image Classification： An Overview[J]. IEEE Transactions on Geoscience and Remote Sensing,2019,57（9）： 6690-6709.
|
| [17] |
李竺强,朱瑞飞,高放,等. 三维卷积神经网络模型联合条件随机场优化的高光谱遥感影像分类[J]. 光学学报,2018,38（8）： 0828001.
Li Zhuqiang,Zhu Ruifei,Gao Fang,et al. Hyperspectral Remote Sensing Image Classification Based on Three-Dimensional Convolution Neural Network Combined with Conditional Random Field Optimization[J].Acta Optica Sinica,2018,38（8）：0828001.
|
| [18] |
张号逵,李映,姜晔楠. 深度学习在高光谱图像分类领域的研究现状与展望[J]. 自动化学报,2018,44（6）： 961-977.
Zhang Haokui,Li Ying,Jiang Yenan.Deep Learning for Hyperspectral Imagery Classification： The State of the Art and Prospects[J].Acta Automatica Sinica,2018,44（6）： 961-977.
|
| [19] |
Lee H,Kwon H. Going Deeper with Contextual CNN for Hyperspectral Image Classification[J]. IEEE Transactions on Image Processing,2017,26（10）： 4843-4855.
|
| [20] |
Zhang M M,Li W,Du Q. Diverse Region-Based CNN for Hyperspectral Image Classification[J]. IEEE Transactions on Image Processing： A Publication of the IEEE Signal Processing Society,2018,27（6）： 2623-2634.
|
| [21] |
高奎亮,余旭初,宋治杭,等. 联合空谱信息的高光谱影像深度胶囊网络分类[J]. 遥感学报,2021,25（6）： 1257-1269.
Gao Kuiliang,Yu Xuchu,Song Zhihang,et al. Deep Capsule Network Combined with Spatial-spectral Information for Hyperspectral Image Classification[J]. National Remote Sensing Bulletin,2021,25（6）： 1257-1269.
|
| [22] |
Audebert N,Le Saux B,Lefevre S. Deep Learning for Classification of Hyperspectral Data： A Comparative Review[J]. IEEE Geoscience and Remote Sensing Magazine,2019,7（2）： 159-173.
|
| [23] |
Liu H,Simonyan K,Yang Y.DARTS： Differentiable Architecture Search [M]. 2018.
|
| [24] |
Xu Y,Xie L,Zhang X,et al. PC-DARTS： Partial Channel Connections for Memory-Efficient Differentiable Architecture Search [M]. DOI：10.48550/arXiv.1907.05737. doi: 10.48550/arXiv.1907.05737
|
| [25] |
He K M,Zhang X Y,Ren S Q,et al.Deep Residual Learning for Image Recognition[C]// IEEE Conference on Computer Vision and Pattern Recognition,Las Vegas,USA,2016.
|
| [26] |
岑奕,张立福,张霞,等. 雄安新区马蹄湾村航空高光谱遥感影像分类数据集[J]. 遥感学报,2020,24（11）： 1299-1306.
Cen Yi,Zhang Lifu,Zhang Xia,et al. Aerial Hyperspectral Remote Sensing Classification Dataset of Xiongan New Area （Matiwan Village）[J]. Journal of Remote Sensing,2020,24（11）： 1299-1306.
|
| [27] |
Chen X,Xie L X,Wu J,et al.Progressive Differentiable Architecture Search： Bridging the Depth Gap Between Search and Evaluation[C]// IEEE/CVF International Conference on Computer Vision,Seoul,Korea,2019.
|
| [28] |
Yue J,Zhao W Z,Mao S J,et al. Spectral–Spatial Classification of Hyperspectral Images Using Deep Convolutional Neural Networks[J]. Remote Sensing Letters,2015,6（6）： 468-477.
|
| [29] |
刘冰,余旭初,张鹏强,等. 联合空-谱信息的高光谱影像深度三维卷积网络分类[J]. 测绘学报,2019,48（1）： 53-63.
Liu Bing,Yu Xuchu,Zhang Pengqiang,et al. Deep 3D Convolutional Network Combined with Spatial-Spectral Features for Hyperspectral Image Classification[J]. Acta Geodaetica et Cartographica Sinica,2019,48（1）： 53-63.
|
| 1. |
穆庆禄，王长青，闫易浩，钟敏，冯伟，梁磊，朱紫彤. 不同指向模式下星载冷原子梯度仪对重力场解算精度的影响. 地球物理学报. 2024(07): 2528-2545 .
| |
| 2. |
刘滔，钟波，李贤炮，谭江涛. GOCE卫星重力梯度数据反演重力场的滤波器设计与比较分析. 武汉大学学报(信息科学版). 2023(05): 694-701 .
| |
| 3. |
朱广彬，常晓涛，瞿庆亮，周苗. 利用卫星引力梯度确定地球重力场的张量不变方法研究. 武汉大学学报(信息科学版). 2022(03): 334-340 .
| |
| 4. |
罗志才，钟波，周浩，吴云龙. 利用卫星重力测量确定地球重力场模型的进展. 武汉大学学报(信息科学版). 2022(10): 1713-1727 .
| |
| 5. |
陈鑑华，张兴福，陈秋杰，梁建青，沈云中. 融合GOCE和GRACE卫星数据的无约束重力场模型Tongji-GOGR2019S. 地球物理学报. 2020(09): 3251-3262 .
|
Supported by: Beijing Renhe Information Technology Co., Ltd. 
DownLoad: