Real-Time Bangla Sign Language Detection and Recognition Using YOLOv10

Shakil Ahmed, Monir Hossain, Amit Azim Amit, Mahdia Tahsin, Mufti Mahmud, M. Shamim Kaiser*

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

There is a critical need for accurate Bangladeshi Sign Language (BdSL) detection systems which create a more inclusive environment for people who are deaf and mute. Recognizing the social isolation faced by deaf-mute individuals due to communication barriers, we propose a system that translates BdSL hand gestures into text, facilitating seamless communication. Our approach leverages the power of YOLOv10, a state-of-the-art object detection model, to achieve accurate and efficient BdSL detection. We train a custom YOLOv10 model on a meticulously curated dataset of labeled BdSL gesture images, focusing on static signs for comprehensive coverage. This in-depth training aims to significantly enhance the robustness and accuracy of BdSL recognition. This technological advancement promises a transformative impact on the lives of deaf-mute individuals. By bridging the communication gap, it fosters greater social inclusion and reduces isolation. Furthermore, this research not only contributes to the field of sign language recognition technology but also holds the potential to bring positive change to the daily lives of those who rely on BdSL. Our proposed method has been tested on a custom dataset of 1949 images of 14 unique signs and obtained an F1-Confidence rate of 86%, Recall-Confidence rate of 98%, Precision-Confidence rate of 100%, and Precision-Recall rate of 90.3% for all classes. The overall average accuracy for 14 unique signs is 90.67%.

Original languageEnglish
Title of host publicationProceedings of the 5th International Conference on Trends in Computational and Cognitive Engineering - TCCE 2023
EditorsM. Shamim Kaiser, Raghvendra Singh, Anirban Bandyopadhyay, Mufti Mahmud, Kanad Ray
PublisherSpringer Science and Business Media Deutschland GmbH
Pages383-400
Number of pages18
ISBN (Print)9789819601844
DOIs
StatePublished - 2025
Externally publishedYes
Event5th International Conference on Trends in Computational and Cognitive Engineering, TCCE 2023 - Kanpur, India
Duration: 24 Nov 202325 Nov 2023

Publication series

NameLecture Notes in Networks and Systems
Volume1208
ISSN (Print)2367-3370
ISSN (Electronic)2367-3389

Conference

Conference5th International Conference on Trends in Computational and Cognitive Engineering, TCCE 2023
Country/TerritoryIndia
CityKanpur
Period24/11/2325/11/23

Bibliographical note

Publisher Copyright:
© The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2025.

Keywords

  • Bangladeshi sign langauge dataset (BdSL)
  • Hand gesture
  • Social inclusion
  • YOLOv10

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Signal Processing
  • Computer Networks and Communications

Fingerprint

Dive into the research topics of 'Real-Time Bangla Sign Language Detection and Recognition Using YOLOv10'. Together they form a unique fingerprint.

Cite this