SignAssist: Sign Language Interpreter using Deep Learning

• Author(s): Karan Kharbanda ; Utsav Sachdeva ; Prof. Dr. Anu Rathee
• Paper ID: 1704651
• Page: 387-393
• Published Date: 14-06-2023
• Published In: Iconic Research And Engineering Journals
• Publisher: IRE Journals
• e-ISSN: 2456-8880
• Volume/Issue: Volume 6 Issue 12 June-2023

Abstract

Effective communication is essential for individuals to express their ideas and emotions. However, persons with speech or hearing disabilities often face significant communication barriers. To address this issue, deep learning models, specifically LSTM and GRU, are proposed to recognize and translate signs from isolated American Sign Language (ASL) video frames. In this research, transfer learning and data augmentation techniques are utilized to develop a deep learning model for the ASL dataset. The proposed models achieve up to 95% accuracy in recognizing signs from ASL datasets. This research aims to develop a more natural and efficient way of communication for persons with hearing impairments and promote collaboration with people not trained in sign language. Overall, this study demonstrates the potential of deep learning models to reduce communication barriers and promote inclusivity.

Keywords

American Sign Language, SignAssist, Deep Learning, Sign Recognition, Gesture Recognition

Citations

IRE Journals:
Karan Kharbanda , Utsav Sachdeva , Prof. Dr. Anu Rathee "SignAssist: Sign Language Interpreter using Deep Learning" Iconic Research And Engineering Journals Volume 6 Issue 12 2023 Page 387-393

IEEE:
Karan Kharbanda , Utsav Sachdeva , Prof. Dr. Anu Rathee "SignAssist: Sign Language Interpreter using Deep Learning" Iconic Research And Engineering Journals, 6(12)