Signal Processing Using Delay Measurement for Time-Code Synchronization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing virtual viewpoint acoustic techniques fail to address the shift between time codes and acoustic data delays, particularly in lip synchronization adjustments, and require separate acoustic tracks for time code synchronization.
Innovation Solution
A signal processing apparatus that includes a time code generation unit, sound collection unit, signal processing unit, synchronization unit, and recording unit, which measures processing delays to correct time codes and synchronize acoustic data without requiring separate acoustic tracks.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If acoustic signals are delayed by lip synchronization adjustment or signal processing, then the acoustic signal can be synchronized with video content, but a time shift occurs between the time code and the delayed acoustic data
Solution Approach 1:
The patent measures the processing time of signal processing in advance (before actual acoustic signal processing) and stores this measurement value. This preliminary measurement allows the system to pre-calculate the corrected time code without needing to measure during actual processing, thus preventing time code shifts while maintaining synchronization accuracy.
Solution Approach 2:
The patent implements a feedback mechanism where the measured processing time is used to correct the time code. The system measures the actual processing time, compares it with the original time code, and generates a corrected time code that compensates for the delay introduced by signal processing operations like lip synchronization.
2Reliability
If a separate acoustic track is prepared for time code on the sound collection apparatus, then time code synchronization can be achieved, but the system complexity and preparation requirements increase
Solution Approach 1:
The patent extracts the time code measurement function from the acoustic signal processing path. Instead of embedding time code in the acoustic track, the system separately measures the processing time of the acoustic signal and uses this measurement to correct the time code independently, eliminating the need for separate acoustic tracks for time code.
Solution Approach 2:
The patent introduces an intermediary measurement value (processing time measurement) that mediates between the acoustic signal processing and the time code. This intermediary allows the system to synchronize time code with processed acoustic signals without requiring direct embedding of time code in the acoustic track, thus simplifying the system configuration.
3Loss of information
If time code is embedded in acoustic data during signal processing, then synchronization information is preserved, but the acoustic data structure becomes more complex
Solution Approach 1:
The patent creates a copy of the time code information in the form of a measurement value that represents processing time. Instead of embedding the actual time code in the acoustic data structure, the system copies the essential synchronization information (processing duration) and uses it to generate corrected time codes, thereby preserving synchronization information while maintaining simple data structures.
Data Source
AI summary
A signal processing apparatus includes one or more memories configured to store instructions, and one or more processors configured to execute the instructions to acquire first time information, perform signal processing on an acoustic signal to generate first acoustic data including the acquired first time information, measure processing time for the signal processing based on the acquired first time information and the first acoustic data, acquire second time information indicating a time after measuring the processing time, perform signal processing on the acoustic signal to generate second acoustic data that does not include the first time information and the acquired second time information, correct the second time information based on the processing time, and record the second acoustic data synchronized in time with the corrected second time information.