Malaysian Sign Language (MSL) Detection: Comparison of YOLOv5 and CNN

In addressing the underrepresentation of Malaysian Sign Language (MSL) in sign language detection research, this study evaluates the performance of deep learning models on an MSL dataset to achieve high accuracy, precision, and recall for hand gesture detection and translation. Methodologically, the...

詳細記述

書誌詳細
出版年:2024 IEEE 15TH CONTROL AND SYSTEM GRADUATE RESEARCH COLLOQUIUM, ICSGRC 2024
主要な著者: Halim, Abdul Hadi Abdul; Ab Rahim, A'zraa Afhzan; Rozaini, Nur Athirah; Hassan, Siti Lailatul Mohd; Halim, Ili Shairah Abdul; Abdullah, Noor Ezan
フォーマット: Proceedings Paper
言語:English
出版事項: IEEE 2024
主題:
オンライン・アクセス:https://www-webofscience-com.uitm.idm.oclc.org/wos/woscc/full-record/WOS:001345150000006
その他の書誌記述
要約:In addressing the underrepresentation of Malaysian Sign Language (MSL) in sign language detection research, this study evaluates the performance of deep learning models on an MSL dataset to achieve high accuracy, precision, and recall for hand gesture detection and translation. Methodologically, the study compares two algorithms: YOLOv5, known for its object detection capabilities, and the Convolutional Neural Network (CNN), which excels in learning features directly from raw images. The dataset, comprising ten common MSL phrases, was collected using a webcam and OpenCV from four non-deaf individuals, incorporating variations in hand gestures and lighting. The findings indicate that YOLOv5 significantly outperforms CNN, with YOLOv5 achieving an overall accuracy of 0.99, precision of 0.93, and recall of 0.99, while CNN achieves an overall accuracy of 0.94, precision of 0.76, and recall of 0.71. The study concludes that YOLOv5 offers a more robust and accurate model for MSL detection, which can serve as a valuable communication aid for MSL users. However, the study acknowledges limitations such as using a non-deaf contributor dataset and a modest sample size, which may not fully represent the diversity of MSL users. Future research is suggested to incorporate data from deaf individuals to enhance the model's applicability and accuracy, considering that signing patterns may vary between non-deaf and deaf signers.
ISSN:2638-1710
DOI:10.1109/ICSGRC62081.2024.10691273