Skip to main navigation Skip to search Skip to main content

Graph-infused hybrid vision transformer: Advancing GeoAI for enhanced land cover classification

  • Muhammad Hassaan Farooq Butt
  • , Jian Ping Li*
  • , Muhammad Ahmad
  • , Muhammad Adnan Farooq Butt
  • *Corresponding author for this work

Research output: Contribution to journal › Article › peer-review

34 Scopus citations

Abstract

Hyperspectral Image Classification (HSIC) is a challenging task due to the high-dimensional nature of Hyperspectral Imaging (HSI) data and the complex relationships between spectral and spatial information. This paper proposes a Graph-Infused Hybrid spatial–spectral Transformer (GFormer) for HSIC. The GFormer combines the power of graph and spatial–spectral transformer to capture both spectral relationships and spatial context. We represent the HSI data as a graph, where nodes represent pixels and edges capture spectral similarities. By incorporating an attention mechanism, the GFormer learns spatial–spectral fusion representations, allowing it to effectively discriminate between different classes. The model can capture long-range dependencies among spectral bands, enabling it to understand complex interactions in the HSI data. Moreover, the GFormer adapts to different spectral resolutions by dynamically adjusting attention weights for each spectral band. Experimental results on benchmark HSI datasets demonstrate that the GFormer outperforms state-of-the-art (SOTA) methods, achieving superior classification accuracy.

Original languageEnglish
Article number103773
JournalInternational Journal of Applied Earth Observation and Geoinformation
Volume129
DOIs
StatePublished - May 2024
Externally publishedYes

Bibliographical note

Publisher Copyright:
© 2024

Keywords

  • Graph attention transformers
  • Hyperspectral image classification
  • Land cover classification
  • Spatial–spectral transformer
  • Vision transformers

ASJC Scopus subject areas

  • Global and Planetary Change
  • Earth-Surface Processes
  • Computers in Earth Sciences
  • Management, Monitoring, Policy and Law

Fingerprint

Dive into the research topics of 'Graph-infused hybrid vision transformer: Advancing GeoAI for enhanced land cover classification'. Together they form a unique fingerprint.

Cite this