Sound Object Integration in Spatial Audio Signals
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for mixing spatial audio signals with moving sound objects often result in the background sound obscuring the foreground sound, especially when recorded at different times and locations, leading to poor audio perception and experience.
Innovation Solution
A method and apparatus that determine the direction and active duration of a sound object audio file and integrate it with a spatial audio signal, using optimized starting directions and times to minimize spatial energy overlap, ensuring the sound object is perceived as moving and audible throughout the recording.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If new background sounds are mixed with foreground sound from moving sources, then the overall audio experience is enhanced, but the background sound can obscure portions of the foreground sound
Solution Approach 1:
The system performs preliminary analysis of the background ambiance to identify suitable spatiotemporal locations before mixing the sound objects. By pre-processing the background audio to find optimal mixing points, the system ensures that foreground sounds are placed in locations where they will not be obscured, thus enhancing the audio experience while preserving foreground sound clarity.
Solution Approach 2:
The patent introduces an automated mixing system that acts as an intermediary between the background ambiance and foreground sound objects. This intermediary system analyzes both audio streams and intelligently combines them by selecting optimal spatiotemporal locations, thereby enhancing the overall audio experience while preventing foreground sound obscuration through intelligent mediation.
2Adaptability or versatility
If sound objects are mixed to background ambiance at different times and places, then spatial audio mixing flexibility is improved, but some elements of background ambiance may mask some of the objects
Solution Approach 1:
The system employs feedback mechanisms by continuously analyzing the background ambiance and evaluating the audibility of sound objects at different spatiotemporal locations. This feedback loop allows the system to adjust mixing parameters and select optimal locations that maintain sound object audibility while preserving the flexibility to mix sounds from different times and places.
Solution Approach 2:
The patent utilizes parameter changes by dynamically adjusting spatial and temporal parameters of sound object placement based on background ambiance analysis. By changing these parameters intelligently, the system maintains flexibility in mixing sounds from different sources while ensuring reliable audibility of foreground objects through optimized parameter selection.
3Manufacturing precision
If automated analysis of background ambiance is performed to find suitable mixing locations, then mixing precision is improved, but computational complexity increases
Solution Approach 1:
The system applies segmentation by dividing the background ambiance analysis into distinct processing stages: initial ambiance analysis, spatiotemporal location identification, and sound object placement optimization. This segmentation allows the complex computational task to be broken down into manageable segments, improving mixing precision while reducing overall computational complexity through structured processing.
Data Source
AI summary
Embodiments of these teachings concern integrating a sound object such as an audio object recorded by, e.g., a lavalier microphone to a spatial audio signal. First the sound object is obtained and then a direction and an active duration of the sound object is determined. The spatial audio signal is compiled from audio signals of multiple microphones and could be pre-recorded and obtained after the fact. Then, using the determined direction, the sound object is integrated with the spatial audio signal over the active duration. If there are further moving sound sources to integrate the same procedure is followed for them all individually. One technique specifically shown herein to find the optimized direction and starting time is steered response power with phase transform weighting.