Spatial Audio Orientation Compensation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current spatial audio capture technologies face challenges in isolating and stabilizing audio focus signals from background noise during image capturing, as changes in device orientation affect the perceived audio direction, leading to undesirable movement impressions of stationary background sounds.
Innovation Solution
An apparatus and method that capture spatial audio data during image capturing, determine the device's orientation using sensors, generate an audio focus signal focused on objects in the image direction, and modify background audio data to compensate for orientation changes by rotating it to maintain the background audio's perceived stationary position.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If spatial audio data is captured during image capturing without compensation, then the audio focus signal can be generated, but the background audio appears to move with device orientation changes
Solution Approach 1:
The patent applies preliminary anti-action by rotating the captured spatial audio data in the opposite direction of device orientation changes. The audio data is rotated by an angle equal in magnitude but opposite in sign to the device rotation angle, thereby counteracting the apparent movement of background audio sources and maintaining their stationary perceived positions.
Solution Approach 2:
The patent changes the orientation parameter of the audio data to compensate for device movement. By modifying the angular parameter of the spatial audio data based on detected device orientation changes, the system maintains accurate representation of audio source positions relative to the scene rather than relative to the moving device.
2Reliability
If the device orientation changes during capture, then the focus object can be tracked, but the background audio sources appear to move
Solution Approach 1:
The patent segments the spatial audio data into focus audio data and background audio data. The focus audio data is processed to track the focus object, while the background audio data is separately processed with rotation compensation to maintain stationary appearance. This segmentation allows independent optimization of each component's behavior.
Solution Approach 2:
The patent applies different processing qualities to different parts of the audio data. Focus audio data receives processing optimized for tracking accuracy, while background audio data receives rotation compensation processing optimized for position stability. Each region of the audio data receives the specific treatment it needs to achieve its desired characteristic.
3Device complexity
If no orientation compensation is applied, then the processing is simpler, but the spatial audio accuracy deteriorates
Solution Approach 1:
The patent introduces an intermediary processing step that rotates the background audio data based on device orientation information. This intermediary rotation operation serves as a bridge between the raw captured audio and the final output, correcting the positional accuracy without requiring complete reprocessing of all audio data.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach ensures that the audio output signal effectively isolates the focus object's audio while maintaining the background audio as stationary, enhancing the spatial audio experience by accurately representing the audio sources' positions relative to the device.
Implementation Method 1
The means for generating said audio focus signal may comprise one or more beamforming arrangements
Implementation Method 2
emphasize audio (e.g., the captured spatial audio data) in the image capturing direction of the apparatus
Implementation Method 3
rotating the captured spatial audio data corresponding to the one or more background objects to counter determined changes in the orientation of the apparatus
Data Source
Figure 1
Figure 2
Figure 3
AI summary
An apparatus, method and computer program is described comprising capturing spatial audio data during an image capturing process, determining an orientation of an image capturing device during the spatial audio data capture, generating an audio focus signal from said captured spatial audio data (wherein said audio focus signal is focussed in an image capturing direction of said image capturing device), generating modified spatial audio data (e.g. by modifying the captured spatial audio data to compensate for changes in orientation during the spatial audio data capture), and generating an audio output signal from a combination of the audio focus signal and the modified spatial audio data.