Facial Expression Electric Wheelchair Control Instruction Using Image Processing

• Published in: ICCSCE 2022 - Proceedings: 2022 12th IEEE International Conference on Control System, Computing and Engineering
• Main Author: Sobri M.F.A.; Hussain Z.; Yahaya S.Z.; Boudville R.; Aziz N.A.A.
• Format: Conference paper
• Language: English
• Published: Institute of Electrical and Electronics Engineers Inc. 2022
• Online Access: https://www.scopus.com/inward/record.uri?eid=2-s2.0-85142413060&doi=10.1109%2fICCSCE54767.2022.9935639&partnerID=40&md5=a0204c40b9f2334f38a394868f990eb6

Tetraplegia is a type of paralysis that affects upper and lower limbs due to damage of spinal cord or brain. This condition causes difficulty to move and most of the time caretaker is needed to help the patients. This project proposed the design and implementation of an image processing technique in capturing and categorizing different facial gesture and use it as control instructions for electric wheelchair. The aim was to reduce the dependency to caretaker especially for mobility oftetraplegia patient. The deep learning Haar Cascade Classifier identify the expression of a face through image processing in livevideo capture. The Open Computer Vision (OpenCV) in Python was used to detect, recognize, and analyze the facial expression. Convolution Neural Network (CNN), a deep learning operation will act as trainer that analyze an open-source data to create a model as reference for the facial expression recognition. In orderto make the system operated as a standalone system, the Raspberry Pi module that connects with Pi Camera was used as the platform to capture the live video, perform processing, and produce the output control that give instructions to move such as forward, right, left and stop. Based on the analysis of the system performance, the system was capable to produce high accuracyof detection and correctly produce the electric wheelchair controlinstruction according to the facial expressions. © 2022 IEEE.