Object-Based 3D Audio Scene Synthesis for User-Controlled Playback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional 3-D audio systems fail to effectively transmit real audio contents three-dimensionally based on objects and allow user interaction, as they are limited to virtual sound modeling and simplify space information, making them unsuitable for natural 3-D audio services in broadcasting, cinema, and disc production.
Innovation Solution
An object-based 3-D audio system comprising an audio input unit, editing/producing unit, encoding unit, decoding unit, scene-synthesizing unit, and user control unit that separates and processes sound sources into object and background sounds, encodes 3-D information, and allows user control for personalized audio scene reproduction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If conventional digital audio spatializing systems are used to synthesize 3-D audio, then spatial distribution of sound sources can be achieved, but the system cannot transmit real audio contents three-dimensionally on the basis of objects and user interaction is impossible
Solution Approach 1:
The audio content is segmented into multiple independent sound objects, each with its own spatial coordinates and properties. This segmentation allows each object to be individually processed and interacted with, enabling both faithful transmission of audio information and user interaction with specific objects in the 3-D space.
Solution Approach 2:
The system transitions from conventional 2-D audio mixing to 3-D object-based audio spatialization. By adding the spatial dimension (x, y, z coordinates) to audio objects, the system enables realistic 3-D sound field reproduction while maintaining editability and interactivity of individual sound objects.
2Reliability
If the number of object sounds increases to provide natural 3-D audio services, then audio realism is improved, but the system architecture becomes complicated and the number of encoding means increases
Solution Approach 1:
The patent establishes a universal object-based audio framework where all sound objects, regardless of type or number, are processed through the same spatialization and encoding mechanisms. This multi-functional approach allows the system to handle any number of audio objects with a unified architecture, avoiding the need for separate processing paths for different object types.
Solution Approach 2:
The system uses parameter-based control for audio objects, where each object is defined by a set of parameters (spatial coordinates, velocity, size, etc.) rather than complex structural definitions. This parameterization allows efficient handling of large numbers of objects with simplified data structures and processing algorithms.
3Ease of manufacture
If conventional virtual sound modeling is used, then computer sound processing is simplified, but the system is too simple to effectively employ in real acoustic environments
Solution Approach 1:
The system introduces an acoustic environment model as an intermediary between virtual sound objects and real acoustic spaces. This model includes parameters for room geometry, surface materials, and acoustic properties, allowing virtual objects to interact realistically with simulated acoustic environments while maintaining the simplicity of object-based processing.
Data Source
AI summary
An object-based 3-D audio system. An audio input unit receives object-based sound sources. An audio editing/producing unit converts the sound sources into 3-D audio scene information. An audio encoding unit encodes 3-D information and object signals of the 3-D audio scene to transmit them through a medium. An audio decoding unit receives the encoded data through the medium, and decodes the same. An audio scene-synthesizing unit selectively synthesizes the object signals and 3-D information into a 3-D audio scene. A user control unit outputs a control signal according to the user's selection so as to selectively synthesize the audio scene by the audio scene synthesizing unit. An audio reproducing unit reproduces the audio scene synthesized by the audio scene-synthesizing unit.