Signtist

Abstract

Today. people in Pakistan with hearing and speaking disabilities face many issues while communicating with those around them. This is due to the huge gap in communication between natural language and sign language speakers. People with Such disabilities can only communicate through gestures and symbols but natural language speakers are not familiar with sign language. Therefore, a system must be developed so that both groups can learn to communicate with each other effectively. Although special education schools are available throughout Pakistan, the problem is that there are still some teachers who are not familiar with Sign language as this is not their first language to communicate. Another issue that teachers face is that sign language is not easy to learn and understand which results in fewer teachers with knowledge about sign language. Focussing on facilitating and making communication easy for children with speaking and hearing disabilities is the main objective of Signtist. This system will be used as an interpreter for sign language speakers and a translator for natural language speakers. Signtist uses speech recognition, audio and Visual cues, 3D signed animations, and bags of words to help both disabled and non-disabled people learn both sign and natural language. This project's main focus is to help disabled children, this means the system should be able to deal with usability issues and make users understand the information displayed on the screen. Signtist is a necessity in today's day and age and with an increase in awareness about these disabilities and the advancements in technology, this system will eventually be used on a daily basis within every household with disabled people. Keywords: Speech Recognition, 3D Animation, Bag of words, Simax, Mimix, Sign Language, System Development, System Deployment