Gaze-Tracking Head-Mounted Unit for Hearing Assistance
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Hearing-impaired individuals face difficulties in noisy environments with conventional hearing aids, as they require manual assistance from clip-on microphones, which can be inconvenient and impractical for multiple speakers or situations where direct access is not feasible.
Innovation Solution
A head-mounted unit that monitors the user's gaze direction to detect sound sources, using computer vision and speech recognition, along with neural networks, to identify and amplify speech from specific individuals, providing information through text, audio, or sign language, allowing the user to focus on conversations without distractions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If conventional hearing aids amplify ambient sound, then hearing-impaired users can hear better in quiet environments, but they cannot effectively filter background noise in noisy environments
Solution Approach 1:
The system applies different processing to different spatial locations by using gaze direction to identify a region of interest and selectively enhancing sound from that direction while suppressing sounds from other directions, creating local quality enhancement rather than uniform amplification
Solution Approach 2:
The system introduces an intermediary processing layer between the ambient sound and the user's perception, using computer vision to detect the user's gaze direction and neural networks to selectively process and filter sounds based on spatial location relative to the gaze direction
2Reliability
If clip-on microphones are used to transmit audio from specific speakers, then hearing-impaired users can hear presentations clearly, but the solution becomes inconvenient and impractical for multiple speakers or when direct access is not feasible
Solution Approach 1:
The system enables self-service by automatically detecting the user's gaze direction using computer vision and autonomously identifying and tracking sound sources in the gaze direction, eliminating the need for manual setup or assistance from speakers
Solution Approach 2:
The system dynamically adapts to changing situations by continuously tracking the user's gaze direction and automatically adjusting which sound sources are enhanced, allowing seamless transition between multiple speakers without manual reconfiguration
3Reliability
If multiple clip-on microphones are provided for different speakers, then hearing-implied users can hear each speaker clearly, but the solution becomes impractical and burdensome
Solution Approach 1:
The system achieves universality by using a single integrated head-mounted device that can automatically handle multiple speakers through gaze-based detection and tracking, replacing the need for multiple specialized clip-on microphones
Solution Approach 2:
The system replaces the mechanical approach of physically attaching multiple microphones to different speakers with an automated computer vision and audio processing system that detects and tracks speakers based on the user's gaze direction
Data Source
AI summary
A head-mounted unit for assisting a user, such as a hearing-impaired user, is provided. The head-mounted unit comprises tracking sensors for monitoring a user wearing the head-mounted unit in order to determine a gaze direction which the user is looking. A sensor detects a sound source located in the identified gaze direction. Sound from the sound source may be recognised using speech recognition on captured audio from the sound source or computer vision on images of the sound source. A user interface provides information to the user to assist the user in recognising sound from the sound source.