Audio-Visual Acquisition Equipment With Dynamic Pickup-Angle Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing sound localization technologies face challenges in accurately and efficiently tracking sound sources, particularly in complex environments with multiple sound sources, and visual recognition tracking technologies struggle with objects in motion or deformation.
Innovation Solution
A combined audio and visual system that uses a microphone array and image acquisition device to process optical images for precise sound source tracking, enhancing accuracy and efficiency by aligning sound pickup angles with object positions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If sound localization technology is used to track sound sources, then passive detection and non-contact measurement are achieved, but accuracy deteriorates in complex environments with multiple sound sources
Solution Approach 1:
The patent combines audio signal processing with visual recognition technology to create a hybrid tracking system. The visual system identifies and tracks the target object's position and motion state, while the audio system processes sound signals. By merging these two independent detection systems, the patent achieves accurate sound source localization even in complex environments with multiple sound sources, as the visual component provides spatial context that disambiguates audio sources.
Solution Approach 2:
The patent introduces visual recognition as an intermediary system that bridges the gap between audio signals and sound source identification. The visual system first identifies the target object's location and motion state, which then serves as a reference for the audio processing system to selectively enhance and identify sounds originating from that specific location, effectively filtering out interference from other sound sources.
2Measurement precision
If visual recognition tracking is used to monitor objects, then object position can be detected, but tracking accuracy deteriorates for objects in motion or deformation
Solution Approach 1:
The patent implements dynamic tracking by continuously monitoring the target object's motion state and updating the sound pick-up angle in real-time. The system adapts to moving objects by adjusting the audio acquisition parameters based on the current position and velocity information obtained from visual recognition, enabling continuous accurate tracking even when the target is in motion or deforming.
3Object-affected harmful factors
If microphone array with beam forming is used to filter audio signals, then sounds from specific directions are emphasized, but device complexity increases
Solution Approach 1:
Instead of using a complex full 3D beam forming system, the patent applies partial action by focusing beam forming only on the horizontal plane and specifically on the azimuth angle direction. The system calculates the azimuth angle based on visual position information and applies directional filtering primarily in the horizontal dimension, which sufficiently reduces noise interference while avoiding the excessive complexity of complete spherical beam forming.
Data Source
Figure 1~2
Figure 3~4A
Figure 4B
AI summary
An acquisition equipment, a sound acquisition method, a sound source tracking system and a sound source tracking method are provided. The acquisition equipment (101) includes an audio acquisition device (102), an image acquisition device (104), an information processing device (105) and an angle control device (108). The audio acquisition device (102) is configured to acquire the sound of a target object; the image acquisition device (104) is configured to acquire an optical image including an acquisition object; the information processing device (105) is configured to process the optical image to determine position information of the target object; and the angle control device (108) is configured to receive the position information of the target object sent by the information processing device (105), and control the sound pick-up angle of the audio acquisition device (102) according to the position information of the target object.