Abstract
In recent times, the Visual Transformer (VT) has emerged as a powerful alternative to the conventional Convolutional Neural Networks (CNNs) for their superior attention mechanism and pattern recognition abilities. Within a short time, the VT paradigm has given rise to many variants, each showcasing enhanced accuracy and optimized performance for various computer vision applications. Our study introduces a multitransformer pipeline for optimal VT architecture exploration in AD detection and classification. Through a comparative evaluation among the VT variants, this study also aims to contribute valuable insights into the applicability of VTs in Alzheimer's Disease (AD) classification using OASIS and ADNI datasets. Furthermore, VT performances are systematically compared with CNNs to determine the basic capabilities of the models and their limitations in capturing intricate patterns indicative of early AD stages under both data-rich and data-scarce situations. The results resonate with the fact that the attention mechanism of VTs is of pivotal importance for achieving superior performance in AD diagnosis. The codes used in the study are made publicly available.
| Original language | English |
|---|---|
| Title of host publication | 2024 International Joint Conference on Neural Networks, IJCNN 2024 - Proceedings |
| Publisher | Institute of Electrical and Electronics Engineers Inc. |
| ISBN (Electronic) | 9798350359312 |
| DOIs | |
| State | Published - 2024 |
| Externally published | Yes |
| Event | 2024 International Joint Conference on Neural Networks, IJCNN 2024 - Yokohama, Japan Duration: 30 Jun 2024 → 5 Jul 2024 |
Publication series
| Name | Proceedings of the International Joint Conference on Neural Networks |
|---|
Conference
| Conference | 2024 International Joint Conference on Neural Networks, IJCNN 2024 |
|---|---|
| Country/Territory | Japan |
| City | Yokohama |
| Period | 30/06/24 → 5/07/24 |
Bibliographical note
Publisher Copyright:© 2024 IEEE.
Keywords
- Alzheimer's Disease
- BEiT
- DeiT
- Swin Transformer
- Vision Transformers
ASJC Scopus subject areas
- Software
- Artificial Intelligence