Object Audio Signal Processing for Directional Sound Reproduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies fail to provide a sufficiently high realistic feeling in sound reproduction, particularly in free-viewpoint content, as they do not adequately consider the directional characteristics of sound sources, leading to inaccuracies in sound localization and movement.
Innovation Solution
A signal processing device that acquires audio data and metadata including position and direction information of audio objects, generating reproduction signals that account for distance and directional characteristics to enhance the realism of sound reproduction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If gain correction and frequency characteristic correction are performed based on distance from listening position to audio object, then sound field reproduction is improved, but directional characteristics of the audio object are not adequately considered
Solution Approach 1:
The audio object's directional characteristics are segmented into multiple transfer characteristics corresponding to different directions. The signal processing device acquires and applies appropriate transfer characteristics based on the audio object's direction relative to the listening position, thereby preserving directional information that would otherwise be lost in conventional distance-based correction methods.
Solution Approach 2:
The system changes the parameter of transfer characteristics dynamically based on the audio object's direction. By selecting and applying different transfer characteristics according to directional parameters (azimuth and elevation angles), the system maintains accurate directional representation in the reproduced sound field.
2Measurement precision
If audio data is recorded for each sound source, then sound source localization is improved, but realistic feeling is insufficient without considering direction of audio objects
Solution Approach 1:
The system dynamically adapts the reproduction process by continuously adjusting which transfer characteristics are applied based on the real-time direction of audio objects. This dynamic adjustment ensures that the reproduced sound field maintains realistic characteristics even as listening positions or audio object directions change.
Solution Approach 2:
Transfer characteristics act as an intermediary that bridges the recorded audio data and the final reproduced sound. By introducing direction-dependent transfer characteristics as this intermediary layer, the system preserves realistic sound field characteristics that would otherwise be lost in conventional localization methods.
3Device complexity
If conventional sound field reproduction methods are used, then processing complexity is reduced, but directional characteristics and realism are compromised
Solution Approach 1:
Transfer characteristics are acquired and prepared in advance for different directions of audio objects. This preliminary preparation allows the signal processing device to efficiently select and apply the appropriate transfer characteristics during reproduction without requiring complex real-time calculations, thereby maintaining low processing complexity while improving directional accuracy.
Data Source
AI summary
The present technology relates to a signal processing device, signal processing method, and program capable of providing a higher realistic feeling.A signal processing device includes: an acquisition unit that acquires audio data of an audio object and metadata including position information indicating a position of the audio object and direction information indicating a direction of the audio object; and a signal generation unit that generates a reproduction signal for reproducing a sound of the audio object at a listening position on the basis of listening position information indicating the listening position, listener direction information indicating a direction of a listener at the listening position, the position information, the direction information, and the audio data. The present technology is applicable to a transmission reproduction system.