Head-Mountable Device Sound Source Localization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Head-mountable devices struggle to effectively provide audio-based feedback to users, particularly in identifying sound sources within or outside their field of view, due to ambient noise and reverberation, which hampers the user's ability to locate sounds accurately.
Innovation Solution
The implementation of a head-mountable device equipped with multiple microphones, including directional and omnidirectional microphones, which use beamforming techniques to isolate sound sources and reject ambient noise, combined with a display and speaker system that provides visual and audio outputs based on detected sound sources and user gaze direction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If multiple microphones are used for directional audio detection, then sound source location accuracy is improved, but device complexity increases
Solution Approach 1:
The audio detection system is segmented into multiple independent microphone units distributed across the head-mountable device. Each microphone captures audio from its specific spatial position, and the controller processes these segmented signals separately before combining them to determine sound source location, thereby improving accuracy while maintaining manageable complexity
Solution Approach 2:
The controller acts as an intermediary that receives signals from multiple microphones, processes them through beamforming algorithms, and generates composite audio output. This intermediary processing layer enables accurate sound source localization by mathematically combining the segmented microphone signals without requiring direct physical integration of all microphones
2Reliability
If beamforming techniques are used to isolate sound sources, then audio clarity is improved, but processing requirements and device complexity increase
Solution Approach 1:
The beamforming process performs preliminary signal separation and noise filtering before the audio is presented to the user. By pre-processing the audio signals from multiple microphones to isolate sound sources and reject ambient noise, the system delivers clear audio output without requiring complex real-time processing during user interaction
Solution Approach 2:
The patent replaces physical acoustic filtering mechanisms with computational beamforming algorithms. Instead of using physical barriers or acoustic lenses to isolate sound sources, the system uses digital signal processing to achieve the same effect, reducing mechanical complexity while improving audio clarity
3Measurement precision
If visual indicators are provided for sound sources outside field of view, then sound source identification is improved, but display complexity increases
Solution Approach 1:
The system transitions from two-dimensional display presentation to three-dimensional spatial audio visualization. By providing visual indicators that represent sound sources in 3D space, including those outside the current field of view, the system enables accurate sound source identification without requiring complex multi-display configurations
Solution Approach 2:
The display system serves multiple functions: it shows the user's field of view, indicates sound source locations, and provides spatial orientation cues. By integrating these multiple functions into a single display interface, the system improves sound source identification without proportionally increasing display complexity
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This solution enhances the user's ability to accurately identify sound sources by providing clear audio and visual cues, reducing the burden of separating multiple sounds through directional audio detection and targeted audio output based on user gaze.
Implementation Method 1
multiple microphones, including directional and omnidirectional microphones, which use beamforming techniques to isolate sound sources and reject ambient noise
Data Source
AI summary
A head-mountable device can include multiple microphones for directional audio detection. The head-mountable device can also include a speaker for audio output and/or a display for visual output. The head-mountable device can be configured to provide visual outputs based on audio inputs by displaying an indicator on a display based on a location of a source of a sound. The head-mountable device can be configured to audio outputs based on audio inputs by modifying an audio output of the speaker based on a detected sound and a target characteristic. Such characteristics can be based on a direction of a gaze of the user, as detected by an eye sensor.