Balancing Stereo Audio via Camera-Detected Object Position
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing electronic apparatuses face challenges in balancing stereo sound data when recording videos, as the positions of cameras and microphones can lead to unbalanced voice recordings, especially in scenarios like ASMR where close-range recording is common.
Innovation Solution
An electronic apparatus equipped with a camera, two microphones, and a processor that identifies objects in image data and adjusts the volume information of sound data based on object position information, ensuring balanced stereo sound.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If stereo sound data is recorded using microphones positioned beside the electronic apparatus, then the camera can capture the speaker in front of it, but the voice recording becomes unbalanced left and right sides
Solution Approach 1:
The system uses image data from the camera to detect the speaker's position, then feeds this position information back to adjust the volume of sound data from different microphones. This closed-loop feedback mechanism ensures that the sound balance matches the visual position of the speaker, resolving the contradiction between positional accuracy and sound balance.
Solution Approach 2:
The system dynamically changes the volume parameter of sound data based on the detected speaker position. By adjusting the volume parameter according to position information, the system achieves balanced stereo sound recording even when the speaker is not centered relative to the microphone array.
2Area of stationary object
If the distance between the electronic apparatus and the speaker is increased, then the recording range is improved, but the relative ratio of distance between microphones and speaker increases causing severe sound imbalance
Solution Approach 1:
The system continuously monitors the speaker's position through image data and uses this information to adjust microphone volume levels in real-time. This feedback mechanism allows the system to maintain sound balance across varying distances, enabling extended recording range without sacrificing sound quality.
3Adaptability or versatility
If microphones are positioned away from the camera to enable stereo recording, then stereo sound capability is achieved, but the sound balance becomes inconsistent with the visual position on screen
Solution Approach 1:
The system uses the camera's image data as a reference to determine the speaker's visual position, then adjusts the volume of sound data from spatially separated microphones to match this visual position. This feedback-based synchronization ensures that stereo recording capability is maintained while achieving sound-image consistency.
Solution Approach 2:
The system introduces position information derived from image data as an intermediary element that mediates between the physical positions of microphones and the visual position on screen. This intermediary allows the system to reconcile the spatial separation of microphones with the visual-center reference frame, achieving sound-image synchronization.
Data Source
Figure 1~2
Figure 3~4
Figure 5
AI summary
Disclosed is an electronic apparatus. The electronic apparatus includes: a camera; a first microphone; a second microphone; and a processor configured to: control the electronic apparatus to obtain first sound data through the first microphone, control the electronic apparatus to obtain second sound data through the second microphone, identify an object corresponding to the first sound data and the second sound data in image data obtained through the camera, obtain position information of the identified object from the image data, and change volume information of at least one of the first sound data or the second sound data based on the obtained position information.