Skip to main navigation Skip to search Skip to main content

Diverse features discovery transformer for pedestrian attribute recognition

  • Aihua Zheng
  • , Huimin Wang
  • , Jiaxiang Wang
  • , Huaibo Huang*
  • , Ran He
  • , Amir Hussain
  • *Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

18 Scopus citations

Abstract

Recently, Swin Transformer has been widely explored as a general backbone for computer vision, which helps to improve the performance of vision tasks due to the ability to establish associations for long-range dependencies of different spatial locations. By implementing the pedestrian attribute recognition with Swin Transformer, we observe that Swin Transformer tends to focus on a relatively small number of local regions within which attributes may be correlated with other attributes, which leads Swin Transformer to predict attributes in those neglected regions based on such correlation. In fact, discriminative information may exist within these neglected regions, which is crucial for attribute identification. To address this problem, we propose a novel diverse features discovery transformer (DFDT) which can find more attribute relationship regions for robust pedestrian attribute recognition. First, Swin Transformer is used as a feature extraction network to acquire attribute features with the long-distance association, which predicts the corresponding attribute information. Second, we propose a diverse features suppression module (DFSM) to obtain semantic features directly associated with attributes by suppressing the peak locations of the most discriminative features and randomly selected feature regions to spread the feature regions that Swin Transformer is interested in. Third, we plug the diverse features suppression module into different stages of Swin Transformer to learn detailed texture features to help recognition. In addition, we have divided the attribute features into multiple vertical feature regions to improve the focus on local attribute features. Experiments on three benchmark datasets validate the effectiveness of the proposed algorithm.

Original languageEnglish
Article number105708
JournalEngineering Applications of Artificial Intelligence
Volume119
DOIs
StatePublished - Mar 2023
Externally publishedYes

Bibliographical note

Publisher Copyright:
© 2022 Elsevier Ltd

Keywords

  • Features suppression
  • Pedestrian attribute recognition
  • Vision transformer

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Electrical and Electronic Engineering
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'Diverse features discovery transformer for pedestrian attribute recognition'. Together they form a unique fingerprint.

Cite this