The task of land cover classification from hyperspectral images (HSI) has recently witnessed sharp improvements with the applications of deep convolutional networks (CNN). This is mainly attributed to the hierarchical spectral-spatial feature learning capabilities of the CNN models. However, it is important to encode the short to long range spatial dependencies to predict the pixelwise labels without inducing additional redundancy at the feature level. The standard CNN based land cover classification models for HSI overlook this aspect in general. To overcome this, we propose a hybrid attention based 3D classification model for hyperspectral images. Our model comprises of 1D and 2D CNNs to individually generate the attention masks that respectively highlight the spectral and spatial characteristics of our input image. For optimal learning the spectral and spatial features in our model are combined adaptively with the original input and sent to the 3D classification module. To enhance the classification performance, we incorporate classwise Wasserstein loss alongwith the crossentropy loss. Our methods are evaluated on three widely used hyperspectral datasets: Houston datasets (DFC-2013 and DFC-2018) and Salinas dataset, and has satisfactorily outperformed all the prior benchmark methods.
Tensorflow 2
1. Download the dataset from the provided URL in data folder
2. Run data_prepare.py
3. Run hybrid_att_model.py
If using the concept or code, kindly cite the paper as: S. Pande and B. Banerjee. Adaptive hybrid attention network for hyperspectral image classification. In Pattern Recognition Letters, vo. 144, pages 6-12, Jan 2021.
You can also use the bibtex as:
@article{pande2021adaptive,
title={Adaptive hybrid attention network for hyperspectral image classification},
author={Pande, Shivam and Banerjee, Biplab},
journal={Pattern Recognition Letters},
volume={144},
pages={6--12},
year={2021},
publisher={Elsevier}
}