Stereo Camera Angle Determination for Audio Source Separation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing mobile devices struggle to accurately determine the angle of a target object with respect to the device, especially in noisy environments and when the target and device are in motion, which affects the quality of audio and video recordings by failing to effectively separate target information from extraneous noise.
Innovation Solution
The system uses at least two cameras on a device to capture target object information simultaneously, determining the angle by correlating images or estimating distances using autofocus functions, and providing this angle to audio source separation algorithms to enhance signal identification and noise reduction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If audio and video recording capabilities assume the target is directly in front of and perpendicular to the device, then the system complexity remains low, but the measurement precision of target angle deteriorates when target or device moves
Solution Approach 1:
The patent transitions from assuming a single-dimensional front-facing target position to measuring angles in multiple dimensions using a stereo camera arrangement. By capturing images from two different camera positions and calculating triangulation relations, the system determines target angles in three-dimensional space, thereby improving measurement precision while accounting for device and target movement.
2Loss of information
If source separation algorithms are used to distinguish target audio from other sources, then the purity of target information improves, but the device complexity increases due to additional processing requirements
Solution Approach 1:
The patent introduces an intermediary angle determination system that uses stereo cameras and triangulation calculations to provide accurate target angle information to source separation algorithms. This intermediary component enables the audio processing to focus on spatial separation based on precise angle data, improving target information quality while distributing the processing complexity across multiple specialized modules rather than requiring one complex all-in-one system.
3Adaptability or versatility
If the target and device are in motion during acquisition, then the adaptability of the system to real-world conditions improves, but the measurement precision of target position deteriorates due to shifting focus
Solution Approach 1:
The patent implements a dynamic angle determination system that continuously captures images from stereo cameras and recalculates triangulation relations in real-time. This dynamic approach allows the system to track moving targets and adjust to changing positions, maintaining measurement precision even when the target or device is in motion, thereby achieving both adaptability and precision simultaneously.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This method accurately determines the angle of a target object relative to the device, improving the quality of audio and video recordings by effectively isolating target information from background noise, even when the target and device are moving.
Implementation Method 1
First target object information captured using a first camera on the device and second target object information captured using a second camera on the device
Implementation Method 2
The estimated distance can be acquired, for example, using an autofocus function of the first and second cameras
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Systems, methods, and computer media for determining the angle of a target object with respect to a device are provided herein. Target object information captured at approximately the same time by at least two cameras can be received. The target object information can comprise images or distances from the target object to the corresponding camera. An angle between the target object and the device can be determined based on the target object information. When the target object information includes images, the angle can be determined based on a correlation between two images. When the target object information includes distances from the target object to the corresponding camera, the angle can be calculated geometrically.