This paper is published in Volume-10, Issue-1, 2024
Area
Computer Science, Human Computer Interaction
Author
Muralikrishna K. S., Nikhitha Prakasan, Haritha T. K., Asha J. George, Rini T. Paul
Org/Univ
Mar Athanasius College of Engineering, Kothamangalam, Kerala, India
Pub. Date
10 April, 2024
Paper ID
V10I1-1298
Publisher
Keywords
Malayalam Sign Language (MSL), Dataset, Support Vector Machine (SVM), Machine Learning, Real-Time Operating System, Sign Language Detection

Citationsacebook

IEEE
Muralikrishna K. S., Nikhitha Prakasan, Haritha T. K., Asha J. George, Rini T. Paul. Smart glove for Malayalam sign language recognition and audio output, International Journal of Advance Research, Ideas and Innovations in Technology, www.IJARIIT.com.

APA
Muralikrishna K. S., Nikhitha Prakasan, Haritha T. K., Asha J. George, Rini T. Paul (2024). Smart glove for Malayalam sign language recognition and audio output. International Journal of Advance Research, Ideas and Innovations in Technology, 10(1) www.IJARIIT.com.

MLA
Muralikrishna K. S., Nikhitha Prakasan, Haritha T. K., Asha J. George, Rini T. Paul. "Smart glove for Malayalam sign language recognition and audio output." International Journal of Advance Research, Ideas and Innovations in Technology 10.1 (2024). www.IJARIIT.com.

Abstract

Sign language, which is a medium of communication for deaf and mute people, uses manual communication and body language to convey meaning, as opposed to using sound. In this system, we are proposing a hand-wearable device by which deaf and mute people can communicate with normal people through the glove. The National Institute of Speech and Hearing (NISH) recently introduced Signs for Malayalam Alphabets. The Malayalam Sign Language alphabet is distinguished by this wearable system combining five flex sensors, a three -axis MPU sensor, an Arduino nano microcontroller, and a WiFi--BT--BLE MCU module. The glove tracks hand and finger movements through sensors, sending data via Wi-Fi to a mobile app that converts it into text and audio. The RTOS enables concurrent task management with deterministic timing, ensuring efficient operation of multiple functions like sensor data acquisition, gesture interpretation, and communication. The system emphasizes dataset creation for this newly formed sign language, training a model using Support Vector Machine (SVM) to recognize these signs, and integrating the model into a flutter application for ease of access.