Adaptive Audio Signal Weighting for Movable Lens Orientation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In electronic devices with movable lenses, such as gimbal cameras, the sound source orientation indicated by recorded audio does not match the changing angle of view of captured images, leading to inconsistent visual and auditory senses of orientation.
Innovation Solution
An audio processing method that obtains relative attitude information between the lens and microphones, determines weight information for original audio signals based on this information, and synthesizes these signals to produce a target audio signal that matches the images captured by the lens.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of moving object
If the lens rotates to change the angle of view, then the visual coverage is improved, but the sound source orientation in the audio does not match the changed angle of view, resulting in inconsistent visual and auditory senses
Solution Approach 1:
The patent applies dynamics by making the audio signal processing adaptive to the lens rotation state. The system dynamically adjusts the audio rendering based on the current lens angle, transforming the static audio capture into a dynamic process that follows the lens movement. This resolves the contradiction by enabling the audio to adapt to the changing visual angle of view in real-time.
Solution Approach 2:
The patent changes the parameter of audio signal weighting based on the lens rotation angle. By adjusting the weighting coefficients of audio signals from different microphones according to the lens orientation, the system aligns the sound source orientation with the visual angle of view. This parameter adjustment resolves the inconsistency between visual and auditory orientation.
2Adaptability or versatility
If multiple microphones are used to capture audio from different orientations, then the audio coverage is improved, but the complexity of audio signal processing increases
Solution Approach 1:
The patent applies local quality by assigning different weighting coefficients to audio signals from different microphones based on their specific orientations relative to the lens. Each microphone's contribution is locally optimized according to the current lens angle, allowing the system to achieve comprehensive audio coverage while managing processing complexity through selective signal emphasis.
Solution Approach 2:
The patent uses partial action by selectively weighting only the necessary microphone signals based on the lens orientation. Rather than processing all microphone signals equally, the system focuses computational resources on the most relevant audio sources, reducing overall processing complexity while maintaining adequate audio coverage.
Data Source
AI summary
An audio processing method includes: obtaining relative attitude information between a lens and a plurality of microphones, where the lens is movable relative to at least one of the plurality of microphones; obtaining original audio signals acquired by the plurality of microphones; determining weight information corresponding to the original audio signals based on the relative attitude information; and synthesizing the original audio signals based on the weight information to obtain a target audio signal, where the target audio signal is played with images captured by the lens. The method disclosed in this application resolves a problem that a sound source orientation indicated by recorded audio does not match the images captured by the lens.