Lip Motion Input Method for Accessibility and Versatility
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional input methods, such as handwriting and audio input, are inadequate for users with speech difficulties and limit the interactive experience in electronic devices, particularly in recreational applications like games.
Innovation Solution
An input method utilizing an electronic device with an image capturing unit, processing module, lip motion code database, and display module to capture and recognize lip motion, facial expressions, and hand gestures, converting them into text for input, with an automatic learning mechanism to improve convenience and accuracy over time.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of time
If audio input method is used, then time consumption in handwriting input is reduced, but users with speech difficulties cannot use it
Solution Approach 1:
The input method is segmented into multiple independent modes: audio input mode, handwriting input mode, and lip motion input mode. Each mode can be selected based on user capability, allowing users with speech difficulties to use lip motion or handwriting modes while others can use audio mode for faster input.
Solution Approach 2:
The system provides multi-functional input capabilities by integrating audio input, handwriting input, and lip motion recognition into a single platform. This universal design ensures that different user groups can access the input method according to their abilities, with lip motion recognition specifically accommodating users with speech difficulties.
2Device complexity
If single input method is used, then device complexity is reduced, but user convenience and adaptability are limited
Solution Approach 1:
The input method system is designed to be dynamic and adaptable, allowing users to switch between different input modes (audio, handwriting, lip motion) based on their immediate needs and capabilities. The system automatically detects and adapts to user input methods without requiring manual configuration, maintaining simplicity while providing versatility.
3Adaptability or versatility
If lip motion recognition is added, then user accessibility is improved, but device complexity increases
Solution Approach 1:
An intermediary processing module is introduced between the image capturing unit and the input recognition system. This intermediary module specifically processes lip motion images, extracts relevant features, and converts them into text input, thereby isolating the complexity of lip motion recognition from the rest of the system and making it modular and manageable.
Data Source
AI summary
An input method applicable for inputting into an electronic device, which includes the steps of capturing a lip motion of a person; receiving an image of the lip motion; encoding the lip motion image to obtain a lip motion code; comparing the lip motion code with a plurality of standard lip motion codes to obtain a first text result matching the lip motion code; and displaying the first text result on the electronic device if the first text result is obtained. If the first text result is not obtained, the method may further include activating an auxiliary analyzing mode for the electronic device for recognizing a facial expression, a hand gesture, or an audio signal to be inputted. The input method can diversify input methods for the electronic device.