Ear-Wearable Audio Cues With Visual Sound Direction Display
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Hearing-impaired individuals face challenges in detecting sounds, understanding sound sources, and determining sound directions, particularly with high-frequency sounds, even with hearing aids.
Innovation Solution
A hearing assistance system comprising ear-wearable devices with microphones and electroacoustic transducers, combined with a wearable vision device like augmented reality glasses or contact lenses, processes audio signals to provide visual representations of sound content and direction, using multiple microphones and signal processing to identify audio content and direction, and optionally includes a gateway device for communication.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If hearing aids amplify audio from the environment, then sound detection capability is improved, but direction detection and sound source understanding remain challenging
Solution Approach 1:
The patent combines audio signal processing with visual display technology by integrating a hearing assistance device with a vision device. Audio information from multiple microphones is processed to determine sound direction, and this directional information is visually represented through arrows or indicators on the vision device display, merging auditory and visual modalities to compensate for directional detection limitations
Solution Approach 2:
The patent adds a visual dimension to audio direction detection by projecting directional information onto a two-dimensional display interface. Instead of relying solely on spatial auditory cues, the system represents sound direction through visual arrows and indicators on the vision device, transforming three-dimensional spatial audio information into two-dimensional visual representations that the user can interpret
2Measurement precision
If multiple microphones are used to identify audio content and direction, then measurement precision is improved, but device complexity increases
Solution Approach 1:
The vision device serves multiple functions: it displays visual information, processes audio signals from multiple microphones, determines sound direction, and provides visual feedback through arrows and indicators. By making the vision device multi-functional, the system achieves improved directional accuracy without proportionally increasing overall device complexity, as one device performs multiple roles
Solution Approach 2:
The patent introduces a processing system that acts as an intermediary between the multiple microphones and the display interface. This intermediary component analyzes audio signals from multiple microphones, calculates directional information, and translates it into visual representations, simplifying the overall system architecture by centralizing the complex signal processing function
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enhances sound detection and direction perception for hearing-impaired users by providing visual cues about sound sources and directions, aiding in identifying emergency notifications and everyday sounds, and supporting user interaction through visual displays.
Implementation Method 1
direct sound from a first electroacoustic transducer toward the user's ear
Implementation Method 2
receiving, from the first microphone, the first input audio signal; receive, from the second microphone, a second input audio signal
Data Source
AI summary
A hearing assisting system is included having a first microphone and a second microphone. The system further includes a vision device having a display device, where the display device is configured to display visual information to the user when the user is wearing the vision device. The system is further configured to process audio signals to identify first audio content information and first audio direction information related to the first audio content information. The system further can transmit, to the vision device, first display information to cause the vision device to display a non-transcript content representation of the first audio content information and a direction representation of the first audio direction information using the display device.