SpecSeg Network for Specular Highlight Detection and Segmentation in Real-World Images

Atif Anwer*, Samia Ainouz, Mohamad Naufal Mohamad Saad, Syed Saad Azhar Ali, Fabrice Meriaudeau

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

4 Scopus citations

Abstract

Specular highlights detection and removal in images is a fundamental yet non-trivial problem of interest. Most modern techniques proposed are inadequate at dealing with real-world images taken under uncontrolled conditions with the presence of complex textures, multiple objects, and bright colours, resulting in reduced accuracy and false positives. To detect specular pixels in a wide variety of real-world images independent of the number, colour, or type of illuminating source, we propose an efficient Specular Segmentation (SpecSeg) network based on the U-net architecture that is expeditious to train on nominal-sized datasets. The proposed network can detect pixels strongly affected by specular highlights with a high degree of precision, as shown by comparison with the state-of-the-art methods. The technique proposed is trained on publicly available datasets and tested using a large selection of real-world images with highly encouraging results.

Original languageEnglish
Article number6552
JournalSensors
Volume22
Issue number17
DOIs
StatePublished - Sep 2022

Bibliographical note

Publisher Copyright:
© 2022 by the authors.

Keywords

  • image segmentation
  • specular highlights

ASJC Scopus subject areas

  • Analytical Chemistry
  • Information Systems
  • Instrumentation
  • Atomic and Molecular Physics, and Optics
  • Electrical and Electronic Engineering
  • Biochemistry

Fingerprint

Dive into the research topics of 'SpecSeg Network for Specular Highlight Detection and Segmentation in Real-World Images'. Together they form a unique fingerprint.

Cite this