Audio Encoding Transform Parameters for Personalized Binaural Playback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing audio playback technologies face challenges in delivering immersive content over mobile devices with limited processing power and battery life, and fail to provide personalized spatial audio reproduction due to individual differences in human hearing profiles.
Innovation Solution
A method of encoding audio content using multiple binaural representations and transform parameters based on individual hearing profiles, allowing for personalized binaural playback presentations by optimizing the difference between binaural representations and approximations, and applying personalized transform parameters for improved reproduction quality and efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If binaural pre-rendering is performed prior to transmission, then device-side computational complexity and bandwidth requirements are reduced, but spatial cues are applied twice during playback causing undesired artifacts
Solution Approach 1:
The patent segments the binaural rendering process into two distinct parts: (1) spatial cues are applied during content creation/encoding to create a loudspeaker-compatible signal presentation, and (2) transform parameters are computed and transmitted to enable device-side transformation to personalized binaural output. This segmentation prevents double-application of spatial cues while maintaining low device complexity.
Solution Approach 2:
The patent introduces transform parameters as an intermediary element that bridges the encoded signal presentation and the final personalized binaural output. These parameters contain the necessary spatial information without directly applying spatial cues, allowing the playback device to generate accurate binaural sound without re-applying cues already present in the encoded signal.
2Adaptability or versatility
If generic transform parameters are used for binaural playback, then device compatibility is improved, but individual hearing profile differences are not accounted for reducing reproduction accuracy
Solution Approach 1:
The patent enables dynamic adaptation of transform parameters based on individual hearing profiles. Instead of using fixed generic parameters, the system allows transform parameters to be customized for each user's specific hearing characteristics (ITD, ILD, spectral cues), achieving both device compatibility and individualized accuracy.
Solution Approach 2:
The patent changes the parameters of the transform based on individual hearing profiles. By adjusting transform parameters to match each user's specific interaural time differences, interaural level differences, and spectral cues, the system maintains compatibility across devices while achieving precise spatial reproduction for each individual.
3Measurement precision
If multiple transform parameter sets are computed for different hearing profiles, then personalized reproduction quality is improved, but encoding complexity and data transmission requirements increase
Solution Approach 1:
The patent applies partial action by computing transform parameters for a limited number of representative hearing profiles rather than all possible variations. This provides personalized reproduction quality for multiple user types while keeping encoding complexity manageable by focusing on the most significant hearing profile variations.
Data Source
AI summary
Encoding/decoding techniques where multiple transform parameter sets are encoded together with a rendered playback presentation of an input audio content. The multiple transform parameters are used on the decoder side to transform the playback presentation to provide a personalized binaural playback presentation optimized for an individual listener with respect to their hearing profile. This may be achieved by selection or combination of the data present in the metadata streams.