Pinna Image-Based Spatial Audio Cue Generation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Personalized audio delivery devices such as headphones and hearing aids fail to accurately reproduce spatial audio cues, as they do not interact with the human anatomy, preventing users from perceiving the direction of sound sources due to the earcup covering the pinna and bone conduction bypassing it.
Innovation Solution
A method and system that characterize an individual's pinna using image or sound-based techniques to determine a non-linear transfer function, which is then used to artificially generate audio cues for spatial localization, allowing the device to simulate the interaction of sound with the pinna and provide accurate spatial audio perception.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If earcup is used to deliver sound into ear canal, then sound reproduction accuracy is improved, but spatial audio cue perception deteriorates due to prevention of sound interaction with pinna
Solution Approach 1:
The patent captures an image of the user's pinna and uses image processing to create a digital model (copy) of the pinna's geometric features. This digital model is then used to generate HRTF data that replicates the acoustic effects of the actual pinna, allowing spatial audio cues to be synthesized without requiring physical sound interaction with the pinna.
Solution Approach 2:
The patent introduces an intermediary processing system that includes an image sensor to capture pinna geometry, an image processing engine to extract geometric features, and an HRTF generation module to create transfer functions. This intermediary system bridges the gap between the earcup-delivered sound and the user's actual pinna geometry, enabling personalized spatial audio processing.
2Productivity
If bone conduction is used to conduct sound to inner ear, then sound delivery is improved, but spatial audio cue generation deteriorates by bypassing pinna interaction
Solution Approach 1:
The patent creates a digital copy of the pinna's geometric features through image capture and processing. This digital model enables the generation of HRTF data that replicates the acoustic transformation that would occur with natural pinna interaction, even when sound is delivered via bone conduction that bypasses the pinna physically.
Solution Approach 2:
The patent transforms the pinna's physical geometric parameters into digital parameters through image processing. The extracted geometric features are converted into HRTF parameters that characterize the acoustic transformation, allowing the system to apply appropriate spatial filtering to bone conduction or other sound delivery methods.
3Measurement precision
If pinna image capture is implemented, then spatial audio processing is improved, but device complexity increases due to additional sensors and processing
Solution Approach 1:
The patent leverages the existing camera or image sensor in mobile devices to capture pinna images, making the system work with already-available components. The same image processing capabilities used for general photography are repurposed for pinna geometry extraction, reducing the need for specialized hardware.
Solution Approach 2:
The system uses the user's own mobile device, which they already possess and operate daily. The device's existing camera, processor, and software ecosystem are utilized to perform pinna imaging and processing, eliminating the need for separate specialized equipment and reducing overall system complexity.
Data Source
AI summary
An image of a pinna is captured. Based on the image of the pinna, a non-linear transfer function is determined which characterizes how sound is transformed at the pinna. A signal is output indicative of one or more audio cues to facilitate spatial localization of sound via the pinna, where the one or more audio cues is based on the non-linear transfer function.