Audio Zooming for Mobile Terminals Using Beamforming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current mobile terminal audio capture methods fail to effectively isolate and synchronize sound from a specific subject during video capture and reproduction, especially when the sound source is not at the center of the screen, leading to unwanted background noise and limited control over sound capture range.
Innovation Solution
An audio zooming method and mobile terminal configuration that uses beamforming and noise suppression technologies to dynamically adjust sound capture range and direction based on user input and image zoom, allowing for precise control over sound capture during both capture and reproduction phases.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If manual pointing method is used to capture sound from a specific subject, then the user can select a specific sound source, but the user must point each sound source individually and the sound capture is not synchronized with the capture image
Solution Approach 1:
The system automatically identifies and tracks the sound source corresponding to the captured subject without requiring manual intervention. The sound capture range is automatically adjusted based on the subject's position and the capture parameters, enabling the system to serve itself in selecting and capturing the relevant sound.
Solution Approach 2:
The system uses feedback from the capture image and subject position to dynamically adjust the sound capture range. By continuously monitoring the subject's location and the capture parameters, the system automatically updates the sound capture area to remain synchronized with the visual capture, eliminating the need for manual adjustment.
2Ease of operation
If the sound capture range is fixed to the center of the screen, then the system simplifies sound capture control, but it cannot capture sound when the sound source is located away from the center
Solution Approach 1:
The sound capture range is made dynamic rather than fixed. It automatically adjusts its position and size based on the subject's location in the capture image and the current capture parameters. This dynamic adjustment allows the sound capture area to follow the subject anywhere in the frame, providing both simplicity and flexibility.
Solution Approach 2:
The system changes the parameters of the sound capture range (position, size, orientation) based on the subject's position and capture settings. By dynamically modifying these parameters, the system maintains simple control while adapting to various sound source locations throughout the capture area.
3Adaptability or versatility
If the sound capture range is expanded to capture all sounds in a wide screen, then the system captures all possible sound sources, but it also captures unnecessary background screens and surrounding noises
Solution Approach 1:
Instead of uniformly capturing sound from the entire wide screen, the system applies local quality by creating a focused sound capture area centered on the subject. This localized approach ensures that only sounds from the relevant region are captured, excluding unnecessary background noises while maintaining comprehensive coverage of the subject area.
Solution Approach 2:
The sound capture area is segmented from the full wide screen view. By dividing the capture space into a focused region around the subject and the surrounding area, the system selectively captures sounds only from the relevant segment, effectively filtering out background noises while preserving subject sounds.
4Measurement precision
If beamforming and noise suppression technologies are used to dynamically adjust sound capture, then the sound isolation and noise reduction are improved, but the device complexity increases
Solution Approach 1:
The system replaces complex mechanical sound isolation methods with signal processing techniques such as beamforming and noise suppression. These software-based approaches achieve precise sound isolation and noise reduction without requiring complex physical structures, thereby reducing overall device complexity while maintaining high precision.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables optimal capture and reproduction of sound from a specific subject by automatically adjusting sound capture range and direction, reducing background noise and improving sound isolation, even when the sound source is not at the image center, and allowing for detailed control over sound capture settings.
Implementation Method 1
a voice or sound generated by the subject is captured and stored by a microphone array
Implementation Method 2
An audio zooming method and mobile terminal configuration that uses beamforming and noise suppression technologies to dynamically adjust sound capture range and direction
Implementation Method 3
An audio zooming method and mobile terminal configuration that uses beamforming and noise suppression technologies to dynamically adjust sound capture range and direction
Data Source
Figure 1
Figure 2
Figure 3~4
AI summary
The present disclosure relates to a mobile terminal and an audio zooming method thereof capable of effectively capturing audio based on an image while capturing and reproducing video. According to the present disclosure, if an event for changing the capture location or range or capture mode of a subject occurs when capturing the subject while capturing the sound of the subject in a predetermined sound capture range, the sound of the subject may be captured by changing a sound capture angle and automatically controlling a sound capture range according to the relevant event, and if an event for changing the capture location or range or capture mode of a subject occurs, the sound of the subject may be captured by automatically controlling a sound capture range according to the event. Furthermore, when capturing and reproducing an image, the capture location and range of the sound may be automatically controlled in connection with the user's input for a specific region edit function on the screen, and the capture location and range of the sound source of the subjects captured through the front and rear cameras may be readjusted to reproduce an optimal sound source in a reproduction mode.