Validation of machine learning classifiers using metamorphic testing and feature selection techniques

Sadam Al-Azani, Jameleddine Hassine*

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

7 Scopus citations


Testing involves examining the behavior of a system in order to discover potential faults. Given an input for a system, the challenge of distinguishing the correct behavior from potentially incorrect one, is called the “test oracle problem”. Metamorphic testing has shown great potential in overcoming the test oracle problem. In this work, we apply metamorphic testing to validate experimentally machine learning classification algorithms, namely Naïve Bayes (NB) and k-Nearest Neighbor (k-NN) individually and in combination (i.e., ensemble classifications methods), using real-world biomedical datasets. Furthermore, advanced feature selection techniques and synthetic minority over-sampling technique (SMOTE) are used in order to generate our test suite and meet the requirements of the specified metamorphic relations. While, this study reveal that NB and k-NN satisfy the specified metamorphic relations, it also concludes that it is not compulsory that the metamorphic relations that are necessary for NB and k-NN individually, are also necessary for their ensemble classifier.

Original languageEnglish
Title of host publicationMulti-disciplinary Trends in Artificial Intelligence - 11th International Workshop, MIWAI 2017, Proceedings
EditorsSomnuk Phon-Amnuaisuk, Swee-Peng Ang, Soo-Young Lee
PublisherSpringer Verlag
Number of pages15
ISBN (Print)9783319694559
StatePublished - 2017

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume10607 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Bibliographical note

Publisher Copyright:
© Springer International Publishing AG 2017.

ASJC Scopus subject areas

  • Theoretical Computer Science
  • General Computer Science


Dive into the research topics of 'Validation of machine learning classifiers using metamorphic testing and feature selection techniques'. Together they form a unique fingerprint.

Cite this