Dual-Camera Voice Identification for Low-Power Audio Rendering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Portable consumer devices face challenges in enhancing audio quality during video recordings due to microphone placement, background noise, and sound reverberation, making it difficult to achieve near-cinematic audio quality in diverse environments.
Innovation Solution
Concurrently process audio signals in real-time during video recording to calculate statistics, generating metadata that is stored with the original audio and video signals, enabling efficient, low-power audio rendering downstream.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If audio processing is performed in real-time during video recording, then audio quality can be enhanced, but power consumption increases
Solution Approach 1:
The patent performs audio statistics calculation and metadata generation during the video recording process itself, preparing audio processing data in advance. This preliminary action enables deferred audio rendering to be performed later with lower power consumption, while still achieving high audio quality through Cinematic Audio Rendering (CAR) technology.
Solution Approach 2:
The patent divides audio processing into two distinct stages: (1) real-time audio statistics calculation and metadata generation during recording, and (2) deferred audio rendering during playback. This segmentation allows the system to perform intensive processing only when necessary, reducing overall power consumption while maintaining audio quality.
2Measurement precision
If multiple audio processing operations are performed simultaneously during recording, then audio fidelity can be improved, but device complexity increases
Solution Approach 1:
The patent segments audio processing into distinct functional modules: audio statistics calculation, metadata generation, and deferred audio rendering. Each module handles specific tasks independently, reducing overall system complexity while maintaining high audio fidelity through specialized processing at each stage.
Solution Approach 2:
The system performs preliminary audio statistics calculation and metadata generation during recording, preparing all necessary processing parameters in advance. This preliminary action simplifies the deferred rendering stage, as the complex analysis work has already been completed, reducing real-time processing complexity during playback.
3Measurement precision
If audio rendering is performed immediately after recording, then audio quality can be optimized, but processing time increases
Solution Approach 1:
The patent performs audio statistics calculation and metadata generation during the video recording process itself, preparing audio processing data in advance. This preliminary action enables deferred audio rendering to be performed later with minimal additional processing time, as the heavy analysis work has already been completed during recording.
Data Source
AI summary
A device may include a front camera, a rear camera, one or more microphones, and one or more processors. The device can receive a front video signal from the front camera, a rear video signal from the rear camera, and an audio signal from the one or more microphones. The device can digitally process the audio signal to identify voices of persons captured in a fields of view of the cameras, and ambient sounds of sound sources outside of the fields of view. The device can generate an audio track to enable an audio renderer to render the voices, and selectively attenuate the ambient sounds, during playback of the front video signal and the rear video signal concurrently. The device can store a video container including the front video signal, the rear video signal, and the audio track. Other aspects are also described and claimed.