Wearable Lip-Reading Communication Device for Continuous Conversation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing communication devices fail to facilitate seamless verbal communication between deaf or hearing impaired individuals and able-bodied individuals, particularly when they speak different languages or use different sign languages, and do not support continuous, fluid conversations.
Innovation Solution
A communication device with a support structure, a first voice synthesizer to detect lip movements and convert them into words, a sound emitter, a second synthesizer to process sound into word processing, and an optional display to visually reproduce the processed words, enabling real-time understanding and fluid communication.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If speech synthesizers are used to translate text into sound, then communication between hearing impaired people is facilitated, but the communication remains discontinuous and not similar to natural verbal communication
Solution Approach 1:
The system enables continuous real-time translation of speech between different languages through simultaneous processing. The first synthesizer continuously converts lip movements to words, the sound emitter continuously reproduces the translated speech, and the second synthesizer continuously processes the emitted sound back into word processing, creating an unbroken communication flow rather than discrete translations.
Solution Approach 2:
The communication device acts as an intermediary between speakers of different languages. The first synthesizer mediates by converting lip movements into words in one language, the sound emitter mediates by reproducing the translated speech, and the second synthesizer mediates by converting the emitted sound back into word processing, enabling natural verbal communication between hearing impaired and able-bodied people.
2Loss of information
If electronic devices are used to capture sounds and convert them into synthesized words, then hearing impaired people can receive information, but fluid and continuous conversation is not allowed
Solution Approach 1:
The system maintains continuous information flow by simultaneously processing speech in real-time. The first synthesizer continuously detects lip movements and converts them to words, the sound emitter continuously reproduces the translated speech, and the second synthesizer continuously processes the emitted sound back into word processing, eliminating information loss while maintaining conversation fluidity.
Solution Approach 2:
The system replaces traditional mechanical speech-to-text conversion with an integrated electronic system that simultaneously performs detection, translation, sound emission, and re-processing. This substitution enables real-time continuous processing rather than sequential discrete operations, improving both information reception and conversation productivity.
3Measurement precision
If multiple cameras are used to detect lip positioning, then speech reproduction accuracy is improved, but the device cannot transform the acquired data into sound
Solution Approach 1:
The communication device integrates multiple functions into a single system: the first synthesizer detects lip movements and converts them to words, the sound emitter reproduces the translated speech, and the second synthesizer processes the emitted sound back into word processing. This multi-functional integration enables both precise measurement and versatile transformation capabilities.
Solution Approach 2:
The first synthesizer acts as an intermediary that receives lip positioning data and transforms it into words. The sound emitter acts as an intermediary that converts the words into audible speech. The second synthesizer acts as an intermediary that processes the emitted sound back into word processing. This chain of intermediaries enables both precise detection and versatile transformation.
4Adaptability or versatility
If translation is performed sentence by sentence with waiting for responses, then language barriers are overcome, but the communication becomes discontinuous and useful only for brief exchanges
Solution Approach 1:
The system eliminates communication delays by performing continuous real-time translation. The first synthesizer continuously converts lip movements to words, the sound emitter continuously reproduces the translated speech, and the second synthesizer continuously processes the emitted sound back into word processing, enabling fluid conversation without waiting for sentence-by-sentence translation.
Solution Approach 2:
The system prepares for continuous communication by having all translation components ready and simultaneously operational. The first synthesizer, sound emitter, and second synthesizer are all prepared to process speech in real-time, eliminating the need to wait for each translation cycle to complete before starting the next one.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables real-time, natural verbal communication between deaf or hearing impaired individuals and able-bodied individuals, overcoming language barriers and allowing confidential conversations.
Implementation Method 1
a first synthesizer (3) integral to said support structure and provided with sensors adapted to detect the user's lip and to transform it into the corresponding words
Implementation Method 2
emitting means (4) for the emission of sound and/or data and suitable for reproducing the words generated by the first synthesizer (3)
Implementation Method 3
a second synthesizer (5) suitable for transforming the sound produced by said emitting means (4) into word processing
Data Source
AI summary
A communication device comprises a support structure (2, 102, 202) adapted to be worn by a user at eye level, a first synthesizer (3, 103, 203) integral with the support structure (2, 102, 202) and provided with one or more sensors suitable for detecting the lip produced by the user and turn it into the corresponding words, reproduction means (4, 104, 204) suitable for reproducing sound and/or data corresponding to the words generated by the first synthesizer (3, 103, 203), a second synthesizer (5, 105, 205) suitable to turn into audio and/or word processing the sound and/or data produced by the reproduction means (4, 104, 204) and/or received from the outside.