Transformer-Driven Active Transfer Learning for Cross-Hyperspectral Image Classification

Muhammad Ahmad*, Francesco Mauro, Rana Aamir Raza, Manuel Mazzara, Salvatore Distefano, Adil Mehmood Khan, Silvia Liberata Ullo

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

2 Scopus citations

Abstract

Hyperspectral image (HSI) classification presents inherent challenges due to high spectral dimensionality, significant domain shifts, and limited availability of labeled data. To address these issues, we propose a novel Active Transfer Learning (ATL) framework built upon a spatial-spectral transformer (SST) backbone. The framework integrates multistage transfer learning with an uncertainty-diversity-driven active learning mechanism that strategically selects highly informative and diverse samples for annotation, thereby significantly reducing labeling costs and mitigating sample redundancy. A dynamic layer freezing strategy is introduced to enhance transferability and computational efficiency, enabling selective adaptation of model layers based on domain shift characteristics. Furthermore, we incorporate a self-calibrated attention mechanism that dynamically refines spatial and spectral weights during adaptation, guided by uncertainty-aware feedback. A diversity-promoting sampling strategy ensures broad spectral coverage among selected samples, preventing overfitting to specific classes. Extensive experiments on benchmark cross-domain HSI datasets demonstrate that the proposed SST-ATL framework achieves superior classification performance compared to conventional approaches.

Original languageEnglish
Pages (from-to)19635-19648
Number of pages14
JournalIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Volume18
DOIs
StatePublished - 2025

Bibliographical note

Publisher Copyright:
© IEEE. 2008-2012 IEEE.

Keywords

  • Hyperspectral image (HSI) classification
  • active learning (AL)
  • hybrid query function
  • spatial-spectral transformer (SST)
  • transfer learning

ASJC Scopus subject areas

  • Computers in Earth Sciences
  • Atmospheric Science

Fingerprint

Dive into the research topics of 'Transformer-Driven Active Transfer Learning for Cross-Hyperspectral Image Classification'. Together they form a unique fingerprint.

Cite this