Spatial Audio Rendering from Downmix Signals for Surround Playback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current methods and apparatuses are unable to generate a surround signal with multi-channel features in environments capable only of producing mono or stereo signals, limiting the efficient processing of media signals.
Innovation Solution
An apparatus and method that utilize spatial information to convert a media signal into a surround signal by generating source mapping information, applying filter information to achieve a surround effect, and integrating this information with a downmix signal to produce a surround signal.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If conventional methods are used to generate multi-channel signals, then multi-channel features can be achieved, but the system cannot operate in environments capable only of producing mono or stereo signals
Solution Approach 1:
The system dynamically adapts its operation mode based on the playback environment. When multi-channel playback is available, it operates in full multi-channel mode; when only stereo/mono playback is available, it automatically switches to downmix mode while still generating surround effects through spatial information processing, ensuring reliable surround signal generation across all environments
Solution Approach 2:
The apparatus is designed to perform multiple functions: it can generate true multi-channel surround signals when the environment supports it, and alternatively generate virtual surround effects from downmix signals when the environment only supports stereo or mono playback. This multi-functionality ensures the system remains versatile and reliable across different playback configurations
2Adaptability or versatility
If spatial information is used to generate surround signals in stereo-only environments, then surround effects can be achieved, but the system complexity increases
Solution Approach 1:
The system performs preliminary processing by extracting and encoding spatial information from the multi-channel signal before downmixing. This pre-processed spatial information is then reused in the stereo-only environment to generate surround effects, avoiding the need for complex real-time analysis and reducing overall processing complexity
Solution Approach 2:
The system extracts essential spatial characteristics (such as inter-channel level differences, inter-channel time differences, and spatial position information) from the original multi-channel signal and separates them from the full signal processing chain. This extracted spatial information is then applied to the downmix signal to create surround effects without requiring the entire multi-channel processing pipeline, thereby reducing complexity
Data Source
AI summary
An apparatus for processing a media signal and method thereof are disclosed, by which the media signal can be converted to a surround signal by using spatial information of the media signal. The present invention provides a method of processing a signal, the method comprising of generating source mapping information corresponding to each source of multi-sources by using spatial information indicating features between the multi-sources; generating sub-rendering in formation by applying filter information giving a surround effect to the source mapping in formation per the source; generating rendering information for generating a surround signal by integrating the at least one of the sub-rendering information; and generating the surround signal by applying the rendering information to a downmix signal generated by downmixing the multi-sources.