Microphone Array Speaker Tracking for Low-Movement Video Capture
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional automatic tracking methods in video shooting processes suffer from poor tracking accuracy, particularly in scenarios where the key object does not exhibit obvious movements.
Innovation Solution
A tracking control system utilizing microphone arrays for sound source localization, combined with camera positioning and image recognition, to determine the location and orientation of the sound source, enabling precise tracking without relying on obvious movements of the object.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Extent of automation
If image recognition is used to identify speakers, then the tracking process can be automated, but tracking accuracy deteriorates when speakers do not have obvious mouth movements
Solution Approach 1:
The patent replaces the visual recognition mechanism (camera-based image recognition) with an acoustic mechanism (microphone array-based sound source localization). By using sound signals instead of visual images to identify speakers, the system achieves both automation and high accuracy, especially for speakers without obvious mouth movements. The microphone array captures acoustic information to determine speaker location, eliminating the dependency on visual characteristics.
Solution Approach 2:
The patent introduces sound signals as an intermediary to bridge the gap between speaker identification and camera control. Instead of directly analyzing visual images for speaker detection, the system uses acoustic signals as an intermediate medium to identify speakers and their locations, then translates this information into camera tracking commands. This intermediary approach enables more reliable speaker identification.
2Measurement precision
If manual tracking is used, then tracking accuracy can be maintained, but operational complexity and time consumption increase
Solution Approach 1:
The patent implements self-service automation where the system automatically identifies speakers and controls camera tracking without requiring manual intervention. The microphone array continuously monitors sound signals, automatically determines speaker locations through sound source localization, and triggers camera adjustments autonomously. This eliminates the need for manual tracking operations while maintaining high accuracy.
Solution Approach 2:
The patent establishes a feedback loop where the system continuously monitors acoustic signals, processes speaker location information, and adjusts camera positioning in real-time. This closed-loop feedback mechanism ensures that the camera automatically follows the correct speaker throughout the conference, eliminating manual tracking requirements while maintaining precision.
3Measurement precision
If multiple microphone arrays are used for sound source localization, then tracking accuracy improves, but device complexity increases
Solution Approach 1:
The patent divides the audio processing function into separate modular components: multiple microphone arrays are distributed throughout the conference space, with each array independently capturing local acoustic signals. The control device then integrates information from these segmented measurements to determine overall speaker location. This segmentation allows for improved localization accuracy while maintaining manageable system complexity through modular architecture.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Improves tracking accuracy by locating the sound source based on sound, eliminating the need for obvious movements, thus enhancing the precision of automatic tracking systems.
Implementation Method 1
When a sound source object makes a sound, the control device determines a location of the sound source object based on a location of the sound source object relative to the first microphone array, a location of the sound source object relative to the second microphone array
Data Source
AI summary
Embodiments of this application disclose a tracking control method. When a sound source object makes a sound, a control device determines an azimuth θ1 of the sound source object relative to a first microphone array based on detection data of the first microphone array, and determines an azimuth θ2 of the sound source object relative to a second microphone array based on detection data of the second microphone array. The control device determines a location of the sound source object based on the azimuth θ1, the azimuth θ2, a location of the first microphone array, and a location of the second microphone array. The control device controls, based on the location of the sound source object, a camera to shoot the sound source object to obtain a tracking video image. According to this application, a speaker can be accurately recognized, to improve accuracy of automatic tracking.