Directional Sound Collection via Image Focus Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing electronic devices, such as mobile phones, struggle to accurately collect sound from a specific direction during video recording, resulting in sound sources from other directions being inadvertently captured, leading to mismatched sound collection.
Innovation Solution
A method and electronic device that determine a focus object during image acquisition, obtain position relationship information, and control a microphone array to collect sound from the corresponding direction, processing multiple sound sources to isolate the sound information from the focus object.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a single microphone collects all sounds from surroundings during video recording, then the audio collection covers all directions, but sound sources from other directions are inadvertently captured causing sound collection mismatch
Solution Approach 1:
The audio collection is segmented by direction using multiple microphones positioned at different locations. Each microphone captures sound from a specific direction, and the system processes these segmented audio signals to isolate the sound source corresponding to the focus object, resolving the contradiction between comprehensive coverage and directional accuracy.
Solution Approach 2:
Multiple microphones are combined into a microphone array system that works together to achieve both wide coverage and precise directional identification. By merging the capabilities of multiple microphones and combining their signals through processing, the system simultaneously achieves comprehensive audio collection and accurate sound source localization.
2Measurement precision
If multiple microphones are used to collect sound from different directions, then directional accuracy improves, but device complexity increases
Solution Approach 1:
The microphone array serves multiple functions: it captures sound from all directions simultaneously and identifies the specific direction of the sound source. This multi-functionality reduces the need for separate systems for audio collection and direction detection, thereby managing device complexity while maintaining high directional accuracy.
Solution Approach 2:
The system replaces complex mechanical directional selection mechanisms with signal processing methods. Instead of physically directing a single microphone toward the sound source, the patent uses electronic signal processing to identify and isolate sounds from specific directions, reducing mechanical complexity while maintaining precision.
3Reliability
If the microphone collects all surrounding sounds, then no sound source is missed, but sound collection does not correspond to the focused visual content
Solution Approach 1:
The system uses feedback from image analysis to guide audio processing. The focus object identified in the video frame provides feedback that directs the audio system to prioritize and enhance sounds from that specific direction, ensuring that the collected sound corresponds to the visual content while maintaining reliability through the underlying multi-directional capture capability.
Solution Approach 2:
The system performs preliminary identification of the focus object from the video content before finalizing audio collection and processing. This preliminary action allows the system to pre-configure the audio processing parameters to match the visual focus, ensuring sound-source-image correspondence while maintaining complete sound capture as a foundation.
Data Source
AI summary
A sound collection method and an electronic device are disclosed. The method is applicable to an electronic device that includes an image acquisition unit and an audio collection unit. The method includes determining a focus object when the image acquisition unit is acquiring images; obtaining a position relationship information between the focus object and the image acquisition unit based on the focus object; obtaining a first direction information based on the position relationship information; and controlling the audio collection unit to collect the sound from a sound source corresponding to the first direction based on the first direction information.