Driver Drowsiness Detection Using Vision Transformer

This work explores the capability of the new neural network architecture called Vision Transformer (ViT) in addressing prevalent issue of road accidents attributed to drowsy driving. The development of the ViT model involves the use of a pre-trained ViT_B_16 model with initial weight from IMAGENET1K...

وصف كامل

التفاصيل البيبلوغرافية
الحاوية / القاعدة:2024 IEEE 14TH SYMPOSIUM ON COMPUTER APPLICATIONS & INDUSTRIAL ELECTRONICS, ISCAIE 2024
المؤلفون الرئيسيون: Azmi, Muhammad Muizuddin Bin Mohamad; Zaman, Fadhlan Hafizhelmi Kamaru
التنسيق: Proceedings Paper
اللغة:English
منشور في: IEEE 2024
الموضوعات:
الوصول للمادة أونلاين:https://www-webofscience-com.uitm.idm.oclc.org/wos/woscc/full-record/WOS:001283898700030
الوصف
الملخص:This work explores the capability of the new neural network architecture called Vision Transformer (ViT) in addressing prevalent issue of road accidents attributed to drowsy driving. The development of the ViT model involves the use of a pre-trained ViT_B_16 model with initial weight from IMAGENET1K_V1 and was trained using our own driver behavior dataset. The dataset undergoes a thorough preprocessing pipeline, including face extraction, normalization, and data augmentation techniques resulting in 33,034 images for training data. With a focus on detecting normal, yawning, and nodding behaviors, the system achieves remarkable accuracy, reaching 98.07% in training and 93% in testing. The ViT's implementation is demonstrated through webcam-based inferences with the model deployment on a Raspberry Pi 4 by measuring the FPS of the video inferences for capturing real time input in which it achieves unfavorable performance of 0.59 fps. However, on a better performance system, the model can achieve up to 21 fps. Overall, the project contributes to advancing driver monitoring systems and investigation of the ViT model's potential for real-time applications and highlighting the issues for implementing ViT in real world applications considering its computational demand for a low resource embedded system.
تدمد:2836-4864
DOI:10.1109/ISCAIE61308.2024.10576317