Audio Zooming Synchronized with Image Zooming via Beamforming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video recording or live broadcast systems fail to synchronize audio zooming with image zooming, leading to inconsistent audio-visual experiences for viewers.
Innovation Solution
A method and electronic device that perform audio zooming by processing audio signals through beamforming and blind source separation techniques, enhancing or suppressing sounds based on image zoom ratios, using multiple microphones to isolate and fuse target audio signals.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Length of moving object
If image zooming is performed by increasing focal length, then the photographed object size is enlarged, but the audio signal of the target photographed object is not amplified and audio signals of other sound sources are not suppressed
Solution Approach 1:
The audio signal processing is segmented into multiple independent steps: beamforming for spatial filtering, blind source separation for identifying target sound sources, and gain adjustment for volumetric control. This segmentation allows the system to independently process audio components based on their spatial and temporal characteristics, enabling audio zooming that synchronizes with image zooming while maintaining clarity of target objects and suppressing background noise.
Solution Approach 2:
The patent introduces an intermediary processing chain between the microphone array and the final audio output. This intermediary system includes beamforming filters, blind source separation algorithms, and gain control modules that mediate the relationship between visual zoom level and audio output, translating image zoom operations into corresponding audio adjustments through intermediate processing stages.
2Quantity of substance
If multiple audio signals from different sound sources are collected, then the audio information is rich, but it is difficult to identify and separate target sound sources from background noise
Solution Approach 1:
The system implements feedback mechanisms where the blind source separation algorithm continuously analyzes the mixture of audio signals and adjusts the separation parameters based on the identified target sound sources. This feedback loop enables the system to adapt to changing acoustic environments and maintain accurate identification of target objects even when multiple sound sources are present, improving the difficulty of detection problem dynamically.
Solution Approach 2:
The patent replaces traditional mechanical or simple filtering approaches with computational methods including beamforming and blind source separation algorithms. These computational mechanisms substitute for physical filtering by using signal processing techniques to separate and identify target sound sources from background noise, achieving superior performance in complex acoustic environments without additional hardware complexity.
Data Source
Figure 1A(a)
Figure 1A(b)
Figure 1B
AI summary
This application provides a video processing method and a related electronic device. The video processing method includes: When generating a video, the electronic device may perform image zooming based on a change in a zoom ratio, or may perform audio zooming on an audio based on a change in a zoom ratio. That the electronic device performs audio zooming on the audio includes: When the zoom ratio increases and an angle of view decreases, suppressing a sound of an object outside a photographing range and enhancing a sound of a photographed object within the photographing range; when the zoom ratio decreases and the angle of view increases, suppressing a sound of an object outside the photographing range and weakening a sound of a photographed object within the photographing range.