Image Processor Audio Video Synchronization via Dual Timer Merging
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processors in portable terminals face challenges in synchronizing audio and video data effectively, leading to irregular video time increments and potential interruptions or desynchronization during recording and playback.
Innovation Solution
An image processor with an audio data processing unit and a video data processing unit, each equipped with timers to provide time increment information, generates and stores video frames, and a memory to synchronize audio and video data, using error detection and correction mechanisms to ensure precise timing alignment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If the portable terminal uses a single timer in only one chip (MODEM or DSP) for synchronization, then the device complexity is reduced, but the reliability of audio-video synchronization deteriorates when data is abnormally transferred
Solution Approach 1:
The patent combines timer resources from both MODEM chip and DSP chip to create a redundant synchronization system. Each chip maintains its own timer independently, and both timers work together to provide synchronized timing information, eliminating the single point of failure in the previous single-timer configuration.
Solution Approach 2:
The patent prepares for potential data transfer abnormalities by implementing error detection mechanisms and alternative timing sources in advance. When abnormality is detected in audio time increment data, the system can switch to using video frame timing information, preventing synchronization failures before they occur.
2Productivity
If the DSP chip calculates video time increment based on received audio time increment without regard to video frame, then the processing speed is improved, but the manufacturing precision of video time increment calculation deteriorates
Solution Approach 1:
The patent implements a feedback mechanism where the calculated video time increment is continuously monitored and compared against expected values based on video frame rates. When deviations are detected, the system adjusts the calculation to maintain accuracy, creating a closed-loop control system that balances speed and precision.
Solution Approach 2:
The patent dynamically changes the calculation parameters for video time increment based on the detected abnormality level. Under normal conditions, it uses the fast audio-based calculation method. When abnormality is detected, it switches to a more precise video frame-based calculation method, adapting the parameter selection to current system conditions.
3Ease of operation
If audio time increment is transferred constantly at fixed intervals, then the ease of operation is improved, but the reliability of synchronization deteriorates when data transfer abnormalities occur
Solution Approach 1:
The patent transforms the static, fixed-interval audio data transfer into a dynamic system that can adapt its behavior based on detected conditions. The system maintains the simple fixed-interval transfer for normal operation but introduces dynamic error detection and corrective actions when abnormalities occur, making the system both easy to operate and reliable.
Data Source
AI summary
An image processor and an operating method thereof are provided. The image processor includes: an audio data processing unit having a timer for providing audio data and information about time increment thereof; an image capturing unit for generating a number of video frames through photographing; a video data processing unit for generating each of video data and information about time increment thereof using the number of video frames, and providing the video data and the information about the time increments thereof; and a memory for storing the audio data and the information about the audio time increment, the video data and the information about the video time increment.