Virtual Sign Language System for Communication Accessibility
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Individuals with oral communication issues, such as deafness or mutism, face challenges in communicating through written modalities that match oral languages due to the distinct grammar and lexicon of sign language, and the difficulty in learning phonetics and formal oral language training.
Innovation Solution
A virtual sign language system that receives sign language element inputs from a virtual keyboard, processes these inputs using parameters and phonological restrictions to provide outputs in both video and textual forms, allowing users to communicate effectively without requiring formal oral language training.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If individuals with oral communication issues learn phonetics and formal oral language training to communicate through written modalities, then communication capability is improved, but the difficulty of learning and time required increases significantly
Solution Approach 1:
The patent introduces a virtual keyboard as an intermediary tool that translates sign language inputs directly into written language outputs. This mediator system includes a sign language input area, translation processing unit, and written language output area, eliminating the need for users to learn phonetics and oral language training while maintaining effective communication capability
Solution Approach 2:
The patent replaces the traditional mechanical learning process (phonetics and oral language training) with an automated translation system. The virtual keyboard system automatically converts sign language gestures into written text through computational processing, substituting the need for extensive human learning and training
2Adaptability or versatility
If individuals with oral communication issues learn phonetics and formal oral language training to communicate through written modalities, then communication capability is improved, but the complexity of the learning process increases
Solution Approach 1:
The virtual keyboard acts as an intermediary that handles the complexity of translation internally. Users simply perform sign language gestures in the input area, and the system manages the complex translation process to produce written language output, shielding users from learning complexity
Solution Approach 2:
The translation system performs self-service by automatically processing sign language inputs and generating written language outputs without requiring users to understand or learn the complex underlying translation rules, phonetics, or grammar conversions
3Ease of operation
If a virtual keyboard provides both sign language input and written language output, then communication effectiveness is improved, but the device complexity increases
Solution Approach 1:
The virtual keyboard is segmented into distinct functional areas: a sign language input area for gesture recognition, a translation processing unit, and a written language output area. This segmentation allows each component to specialize in its function while working together to achieve effective communication
Solution Approach 2:
The virtual keyboard serves multiple functions within a single device: it captures sign language gestures, translates them into written text, and displays the output. This multi-functionality consolidates what would otherwise require separate systems into one integrated communication tool
Data Source
Figure 1
Figure 2
Figure 3
AI summary
One embodiment provides a method, the method including: receiving, at an information handling device utilizing a virtual sign language system, sign language element inputs from a user provided on a virtual keyboard; determining, utilizing the virtual sign language system, a set of sign language element search results resulting from the sign language element inputs; receiving, from the user at the virtual keyboard, input selecting one search result from the set of search results; and providing, utilizing the virtual sign language system, an output corresponding to the selected one search result. Other aspects are claimed and described.