Subject-Linked Audio Mixing for Multi-Person Video Recording
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for synchronizing sound data with moving image data in camera systems do not efficiently adjust sound volumes based on the states of multiple subjects, such as speaking, direction, and distance, leading to inefficient post-processing tasks.
Innovation Solution
A data creation method and program that associate microphones with subjects, automatically detect their states through image processing, and add identification codes or adjust sound volumes accordingly, allowing for efficient volume adjustments during or after synthesis with moving image data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If sound data is recorded for multiple subjects simultaneously, then comprehensive audio coverage is achieved, but manual volume adjustment becomes time-consuming and complex
Solution Approach 1:
The system performs preliminary detection of subject states (speaking, direction, distance) during the recording process itself, and pre-calculates appropriate volume adjustments. This preliminary action eliminates the need for time-consuming manual volume adjustment after recording, as the identification codes are already embedded in the moving image data to guide automatic volume control.
Solution Approach 2:
The system enables automatic volume adjustment by having the imaging apparatus self-analyze subject states through image processing and automatically determine appropriate volume levels based on detected conditions. The system serves itself by using its own recording data to control audio output, eliminating the need for external manual intervention in volume adjustment.
2Productivity
If automatic detection of subject states is implemented, then volume adjustment efficiency is improved, but system complexity increases
Solution Approach 1:
The imaging apparatus performs multiple functions using its existing image processing capabilities: it detects subject presence, determines speaking states, calculates distances, and identifies directions. By making the image processing unit multi-functional, the system achieves automatic volume adjustment without adding separate dedicated detection devices, thus improving productivity while limiting complexity increase.
Solution Approach 2:
The system merges the detection and volume control functions into the existing imaging apparatus. The image processing unit that already processes video data is also used to detect subject states for audio control. This merging approach allows automatic volume adjustment to be achieved by utilizing existing system resources rather than adding independent complex detection systems.
3Extent of automation
If identification codes are added to moving image data, then automated volume control is enabled, but data processing load increases
Solution Approach 1:
The identification codes for volume control are generated and embedded in the moving image data during the recording process itself. This preliminary encoding ensures that all necessary volume control information is prepared in advance, allowing for efficient automated playback without requiring complex real-time analysis during reproduction, thus managing data processing energy requirements.
4Manufacturing precision
If multiple microphones are used for multiple subjects, then audio quality per subject is improved, but synchronization and mixing complexity increases
Solution Approach 1:
The system uses identification codes as intermediaries between the multiple microphones and the final audio output. Each microphone's sound data is tagged with identification codes that encode subject state information. During playback, these intermediate codes automatically guide the mixing and volume adjustment process, simplifying the coordination of multiple microphones without requiring complex manual synchronization.
Data Source
AI summary
There is provided a data creation method for efficiently performing volume adjustment of a sound of each subject according to a state of each of a plurality of subjects. A data creation method includes: an association step (step S10 and step S11) of associating the microphone with each subject possessing each of the microphones; a recording step (step S12, step S20, and step S21) of recording moving image data using the imaging apparatus; a sound recording step (step S13) of recording sound data of each subject using each of the microphones in synchronization with a start of the recording step; a detection step (step S14 and step S15) of automatically detecting a state of the subject during the recording step; and an addition step (step S16 to step S19) of adding, to the moving image data, an identification code for volume adjustment of the sound data of each subject based on a result of the detection step.