Video-Coupled Audio Directionality Using Target Object Location
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing audio recording methods fail to provide a sense of realism and space when capturing video, as audio signals lack directionality information, often recorded in mono and lacking spatial cues.
Innovation Solution
An electronic device with a communication module, camera, and processor that establishes a connection with an external device to receive audio signals, identifies target objects in the video frame, estimates their actual locations, and processes the audio based on this information to apply directionality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If a single external electronic device is used to record audio while shooting video, then the device complexity is reduced, but the audio signal lacks directionality information and cannot provide a sense of realism and space
Solution Approach 1:
The patent segments the audio recording function by using multiple external electronic devices (microphones) positioned at different locations. Each device captures audio from its specific position, and the processor separates and processes these audio signals to determine directionality information, thereby resolving the contradiction between reduced device complexity and loss of directionality information.
Solution Approach 2:
The processor acts as an intermediary that receives audio signals from multiple external devices, determines the location of each device, and processes the audio signals to extract directionality information. This intermediary function enables the system to utilize multiple recording devices effectively without requiring complex integrated hardware, thus addressing both the information loss and device complexity issues.
2Loss of information
If audio is recorded in mono to simplify the recording process, then the ease of operation is improved, but the audio signal becomes monotonous and lacks a sense of realism and space
Solution Approach 1:
The system performs preliminary action by having multiple external electronic devices capture audio signals from different positions before the processing stage. The processor then uses the determined locations of these devices to process the audio signals and generate directionality information, thereby preserving spatial cues while keeping the recording process simple and the ease of operation high.
3Reliability
If the audio signal is processed to include directionality information, then the sense of realism and space is improved, but the device complexity increases due to additional processing requirements
Solution Approach 1:
The processor uses feedback by determining the locations of external electronic devices based on their audio signals and using this location information to guide the processing of audio signals for directionality. This feedback mechanism enables the system to achieve reliable audio realism with controlled processing complexity, as the location information directs the processing approach.
Data Source
AI summary
An electronic device includes a communication module for supporting short-range wireless communication; a camera module for capturing a video; a display for displaying the video being captured; and a processor operatively connected to the communication module, camera module, and display. The processor may be configured to: connect with the external electronic device using the communication module; receive an audio signal from the external electronic device at the same time as the capturing of the video; confirm a target object among at least one object included in the video being captured; confirm first location information about the location at which the target object is displayed on the display; estimate, on the basis of the first location information, the actual location of the target object; generate second location information about the actual location; and process the audio signal on the basis of the generated second location information.