Object-Based Audio Rendering for Flexible Listening Position Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing audio reproduction technologies, both channel-based and object-based, lack flexibility in allowing users to dynamically adjust sound localization according to their preferred listening positions, limiting the ability to replicate the intended sound experience across different listening environments.
Innovation Solution
An audio processing device that includes an input unit, position information correction unit, gain/frequency characteristic correction unit, spatial acoustic characteristic addition unit, rendering processor, and convolution processor, which allows users to specify an assumed listening position and modify object positions, performing gain and frequency corrections, adding spatial acoustic characteristics, and rendering signals to multiple channels before downmixing to two channels for flexible audio reproduction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a sound image is formed by a pair of stereo speakers for a listener at a specific position, then the sound image can be correctly reproduced for that specific position, but the sound image cannot be correctly reproduced for a listener at a different position
Solution Approach 1:
The system pre-calculates and stores transfer function data for multiple assumed listening positions in advance. When processing audio signals, it selects and applies the appropriate transfer function based on the actual listening position, avoiding real-time complex calculations and enabling accurate sound image reproduction across different positions.
Solution Approach 2:
The system changes the transfer function parameters based on the listening position. By selecting different transfer functions corresponding to different assumed listening positions, the system adapts the audio signal processing parameters to match the actual listening conditions, thereby maintaining sound image accuracy across various positions.
2Measurement precision
If position information of objects is corrected based on assumed listening position, then sound image accuracy is improved for the assumed position, but the system complexity increases due to multiple correction units
Solution Approach 1:
The system pre-calculates transfer functions for multiple assumed listening positions and stores them in advance. This preliminary preparation eliminates the need for complex real-time calculations when processing actual audio signals, reducing the computational burden and simplifying the real-time processing architecture.
Solution Approach 2:
The system dynamically selects the appropriate transfer function based on the actual listening position rather than using a fixed processing approach. This dynamic adaptation allows the system to maintain high accuracy across different positions without requiring a permanently complex multi-unit architecture for all possible scenarios.
3Speed
If transfer function data for multiple assumed listening positions is stored in advance, then processing speed is improved, but the memory requirements increase
Solution Approach 1:
The system pre-calculates and stores transfer function data for multiple assumed listening positions during system initialization or offline processing. This preliminary action transfers the computational burden from real-time operation to setup phase, enabling fast real-time audio processing by simply selecting pre-computed transfer functions based on the actual listening position.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
The present technology relates to an audio processing device, a method therefor, and a program therefor capable of achieving more flexible audio reproduction. An input unit receives input of an assumed listening position of sound of an object, which is a sound source, and outputs assumed listening position information indicating the assumed listening position. A position information correction unit corrects position information of each object on the basis of the assumed listening position information to obtain corrected position information. A gain/frequency characteristic correction unit performs gain correction and frequency characteristic correction on a waveform signal of an object on the basis of the position information and the corrected position information. A spatial acoustic characteristic addition unit further adds a spatial acoustic characteristic to the waveform signal resulting from the gain correction and the frequency characteristic correction on the basis of the position information of the object and the assumed listening position information. The present technology is applicable to an audio processing device.