Sign Language App for Learning and Communication
- The purpose of this presentation is to suggest a tablet application to support learning sign language and communication for students with/without disabilities, especially those with hearing disabilities and developmental disorders. Our tablet application recognizes words spoken by their communication partners using a speech recognition system and arranges the movie clips of sign-language words (“sign-language clips”) corresponding to the speech-recognized words in a sequence. Over the past few years, many studies on mobile devices, such as smartphones and tablets, have been conducted in the field of Argumentative and Alternative Communication. However, little progress seems to have been made in developing tablet applications that employ sign language sequences for the benefit of people with hearing difficulties. Our tablet application, “Sign-Tongue” will impact the lives of students with and without hearing disabilities and developmental disorders. It has three functions: registering a new sign-language clip, making a sequence by those, and browsing the sequence to learn for students with hearing difficulties themselves, and using communication for other students without sign language literacy. Each sign-language clip has some tags, and our tablet application searches for a sign-language clip utilizing the tag. We developed a prototype of “Sign-Tongue” and conducted a preliminary experiment in cooperation with university students. The participants of the experiment were 26 parsons. They made a pair and communicated in the designated situations. The comments received from the experimental participants suggested that “Sign-Tongue” could be useful for those who have difficulties in communication with spoken language and preparing for transitions between activities. However, it also found that there are still problems in terms of operability and the like. “Sign-Tongue” will support students or persons with/without hearing difficulties or developmental disorders in interacting, understanding, and preparing for learning in their daily, school, and social lives. We organized this presentation to discuss what is needed for future development.
- Information & Communications Technology
- Disability Specific
- K-12 Education
- Research & Development
- Audience Level
- Session Summary (Abstract)
- The purpose of this presentation is to suggest a tablet application to support learning sign language and communication for students with/without disabilities, especially those with hearing disabilities and developmental disorders. It helps them interact, understand, and prepare for learning in their daily, school, and social lives.
- Session Type
- General Track
- Augmentative and Alternative Communications (AAC)
- Cognitive & Learning Disabilities
- Deaf and Hard of Hearing
- Mobile Technology
- Kuniomi Shibata