An ensemble face recognition mechanism based on three-way decisions

  • Anwar Shah
  • , Bahar Ali
  • , Masood Habib
  • , Jaroslav Frnda
  • , Inam Ullah
  • , Muhammad Shahid Anwar*
  • *Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

34 Scopus citations

Abstract

The explainable human–computer interaction (HCI) is about designing approaches capable of using cognitive characteristics like humans. One such characteristic is human vision and its accuracy. The accuracy measures the trust in that system. Therefore, improving accuracy in the authorization with identification process is a primary concern for a visual-based explainable human–computer interaction system. In this article, we propose a three-way decision based ensembled face recognition mechanism called E3FRM. The E3FRM uses a three-way approach to determine the match cases and the respective worth of the captured image with the match cases. Features are extracted using PCA/FLD, and the ensembled face recognition algorithms utilize the extracted features to process the image. Ensemble Face recognition approaches find the match cases based on a given threshold. Finally, the three-way decision model evaluates the suitability of the captured image for acceptance, rejection, or deferred cases with a dual verification mechanism. Experimental results on well-known eighteen datasets suggest improvements in commonly used metrics of F1, Accuracy and Recall by up to 0.8% to 12.8%, 1% to 9.6% and 1.2% to 13.9%, respectively, in comparison to the state-of-the-art methods available, including SPCA +, ML-EM, FLDA-SVD, DMMA, Fast-DMMA, LU, LPP, TDL, KCFT, RBF + DT, and NMF. Furthermore, the proposed approach is comparatively analyzed with ensembled face recognition methods that result in an outperformed F1, Accuracy and Recall by up to 1.1% to 10.3%, 0.1% to 7.3% and 0.9% to 10.5%, respectively. These results suggest that the proposed model may improve face recognition accuracy and the resulting trust in the machines.

Original languageEnglish
Pages (from-to)196-208
Number of pages13
JournalJournal of King Saud University - Computer and Information Sciences
Volume35
Issue number4
DOIs
StatePublished - Apr 2023
Externally publishedYes

Bibliographical note

Publisher Copyright:
© 2023 The Author(s)

Keywords

  • Deep Face
  • E3FRM
  • Ensemble
  • Face Recognition
  • Three- way Clustering
  • Three-way Decisions

ASJC Scopus subject areas

  • General Computer Science

Fingerprint

Dive into the research topics of 'An ensemble face recognition mechanism based on three-way decisions'. Together they form a unique fingerprint.

Cite this