Object-Based Audio Encoding for Creator-Directed Distance Rendering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing object-based audio technologies lack the ability to reproduce a sense of distance based on the content creator's intention, as gain control and filter processing are predetermined, limiting flexibility in sound reproduction.
Innovation Solution
An encoding device and method that includes sense-of-distance control information determination, encoding, and multiplexing with audio data and metadata, and a decoding device and method that perform sense-of-distance control processing to generate reproduction audio data based on the content creator's intent, using gain control, filter processing, and reverb processing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If predetermined gain control and filter processing are used for distance reproduction, then the audio reproduction process is simple, but the ability to reproduce sense of distance based on content creator's intention is lost
Solution Approach 1:
The patent applies preliminary action by pre-calculating and encoding sense-of-distance control information during the audio encoding phase. The encoding device determines control parameters (gain values, filter coefficients) based on distance information before transmission, so that the decoding device can directly apply these predetermined controls without complex real-time calculations, thus achieving flexible distance reproduction without excessive processing complexity.
Solution Approach 2:
The patent implements dynamics by making the sense-of-distance control information adaptable and variable. Instead of fixed predetermined controls, the system dynamically adjusts gain control parameters and filter characteristics based on distance information and content creator's intentions. This allows the audio reproduction to flexibly adapt to different listening scenarios while maintaining manageable system complexity through structured control mechanisms.
2Adaptability or versatility
If flexible sense-of-distance control is implemented, then content creator's intention can be reproduced, but the processing complexity increases
Solution Approach 1:
The patent applies segmentation by dividing the sense-of-distance control functionality into distinct modular components: gain control processing, filter processing, and reverb processing. Each component handles a specific aspect of distance reproduction independently, allowing them to be developed, implemented, and adjusted separately. This modular approach enables flexible control according to content creator's intentions while keeping individual processing stages manageable and easier to implement.
3Reliability
If predetermined processing is used, then device complexity is low, but the audio reproduction quality and realism are limited
Solution Approach 1:
The patent implements feedback by using distance information as a control input that influences the sense-of-distance processing. The system calculates distance between audio objects and listening positions, then feeds this information back to adjust gain control, filter characteristics, and reverb parameters accordingly. This feedback mechanism ensures accurate and realistic distance reproduction while maintaining systematic processing through structured control loops.
Data Source
AI summary
The present technology relates to an encoding device and method, a decoding device and method, and a program capable of realizing sense-of-distance control based on intention of a content creator.The encoding device includes: an object encoding unit that encodes audio data of an object; a metadata encoding unit that encodes metadata including position information of the object; a sense-of-distance control information determination unit that determines sense-of-distance control information for sense-of-distance control processing to be performed on the audio data; a sense-of-distance control information encoding unit that encodes the sense-of-distance control information; and a multiplexer that multiplexes the coded audio data, the coded metadata, and the coded sense-of-distance control information to generate coded data. The present technology can be applied to a content reproduction system.