Spatial Audio Repositioning for Scene Differentiation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing spatial audio technologies struggle to effectively differentiate between multiple audio scenes captured from different locations, leading to confusion and disorientation for users during teleconferencing or mediated reality applications, as sound sources from different scenes overlap and blend together.
Innovation Solution
An apparatus and method for repositioning spatial audio streams by modifying audio signals and spatial metadata based on repositioning information, allowing sound sources and ambient sounds from different scenes to be positioned in distinct angular ranges, enabling users to distinguish between them.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If spatial audio streams from multiple audio scenes are reproduced without repositioning, then the audio content is preserved, but users cannot differentiate between different audio scenes due to overlapping sound sources
Solution Approach 1:
The patent applies dimensionality change by manipulating the spatial dimension of audio streams. It modifies spatial metadata parameters (azimuth, elevation, distance) to reposition audio sources from different scenes into distinct spatial locations, allowing users to differentiate scenes through spatial separation rather than spectral or temporal modifications.
Solution Approach 2:
The patent changes spatial parameters of audio streams by modifying metadata attributes such as azimuth angles, elevation angles, and distance values. These parameter changes reposition audio sources in the spatial domain, enabling scene differentiation while preserving the original audio content and minimizing processing complexity.
2Measurement precision
If spatial metadata is modified to reposition audio streams, then spatial differentiation is improved, but the original spatial accuracy may be altered
Solution Approach 1:
The patent performs preliminary action by detecting audio scenes and determining their spatial relationships before reproducing the audio streams. It pre-calculates repositioning parameters based on scene identification, ensuring that spatial modifications are applied systematically to achieve both differentiation and maintained spatial accuracy.
Solution Approach 2:
The patent implements feedback by continuously monitoring the spatial relationships between audio streams and adjusting repositioning parameters accordingly. It uses the detected spatial metadata to inform repositioning decisions, ensuring that modifications enhance differentiation while preserving the relative spatial accuracy of the original audio scenes.
3Ease of operation
If audio streams are repositioned to prevent overlap, then user orientation is improved, but additional processing steps are required
Solution Approach 1:
The patent applies segmentation by dividing the audio processing into distinct stages: audio scene detection, spatial relationship determination, and selective repositioning. This segmented approach allows the system to process only the necessary spatial metadata parameters, reducing overall processing complexity while maintaining user orientation through systematic spatial manipulation.
Data Source
AI summary
Examples of the disclosure relate to apparatus, methods and computer programs for repositioning spatial audio streams. The apparatus is configured to receive a plurality of spatial audio streams wherein the spatial audio streams include one or more audio signals and associated spatial metadata. The apparatus is also configured to receive obtaining repositioning information relating to at least one of the plurality of spatial audio streams and repositioning the at least one of the plurality of spatial audio streams based on the repositioning information.