Image Pickup Device Microphone Array Voice Source Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional image pickup devices use a single stereo microphone for audio recording, which limits the ability to distinguish between the photographer and the subject, resulting in suboptimal audio capture during dual-lens photography.
Innovation Solution
An image pickup device with multiple microphones and image processing units that sense the photographer's voice using phase difference, combine images in a Picture-In-Picture (PIP) format, and convert audio to text for subtitle addition, allowing for enhanced audio and visual capture.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a single stereo microphone is used for audio recording, then the device complexity is reduced, but the ability to distinguish between photographer and subject is deteriorated
Solution Approach 1:
The single stereo microphone is segmented into multiple independent microphones (first microphone, second microphone, third microphone) positioned at different locations. Each microphone captures audio from its specific direction, enabling the system to distinguish between photographer and subject voices through spatial separation and phase difference analysis.
2Measurement precision
If multiple microphones are used to distinguish audio sources, then the audio capture quality is improved, but the device complexity increases
Solution Approach 1:
Multiple microphones are merged into a unified audio processing system that combines their outputs. The audio processing unit integrates signals from all microphones and applies phase difference analysis to identify the photographer's voice, thereby improving audio source detection without requiring separate processing systems for each microphone.
Solution Approach 2:
The microphone array system performs self-identification of audio sources through automatic phase difference analysis. The audio processing unit automatically determines which microphone detected the photographer's voice first and selects the corresponding image pickup unit, eliminating the need for manual configuration or external assistance.
3Device complexity
If only one image pickup unit is used, then the device complexity is reduced, but the ability to capture both photographer and subject is deteriorated
Solution Approach 1:
The system dynamically switches between single and dual image pickup unit operation based on detected conditions. When the audio processing unit identifies the photographer's voice through phase difference analysis, the control unit automatically activates the second image pickup unit to capture the photographer, enabling adaptive dual-lens photography without requiring permanent dual-unit configuration.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables vivid audio recording and improved visual capture by distinguishing the photographer's voice and adding text subtitles, enhancing the dual-lens photography experience.
Implementation Method 1
The audio processing unit may sense the voice of a photographer using phase difference of the voice sensed through the plurality of microphones
Data Source
AI summary
An image pickup device includes an image processing unit which processes an image input through the plurality of image pickup units, a plurality of microphones which are spaced apart from each other, an audio processing unit which senses a voice of a photographer using the plurality of microphones, and a control unit which, when the voice of a photographer is sensed through the audio processing unit, controls the image processing unit to combine an image of an image pickup unit corresponding to a location of the photographer with an image of an image pickup unit currently performing photographing.