Electronic Device Audio Video Synchronization via Timestamp Headers
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In electronic devices, maintaining synchronization between image and audio data during multimedia playback is challenging due to the offloaded playback method, where different components process these data types, leading to difficulties in coordinating their processing times.
Innovation Solution
The electronic device separates moving image data into image and audio frames, generates second audio data by adding header data, and synchronizes playback using time information received from the auxiliary processor, ensuring that image and audio data are played back in sync, even when encoded in AAC format.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If the offloaded playback method is used to process image and audio data using different components, then processing time is reduced, but synchronization between image and audio data becomes more difficult to maintain
Solution Approach 1:
The patent introduces an intermediary mechanism (synchronization controller and timestamp system) that coordinates between the main processor handling image data and the auxiliary processor handling audio data. This mediator collects playback status information from both processors and adjusts timing to maintain synchronization, resolving the contradiction by enabling parallel processing while preserving sync quality through centralized coordination.
2Reliability
If header data is added to each audio frame to enable synchronization tracking, then synchronization quality is improved, but data processing complexity increases
Solution Approach 1:
The patent applies preliminary action by pre-adding header data containing timestamp information to each audio frame during the encoding stage, before playback occurs. This advance preparation enables the synchronization system to simply read and use the pre-prepared timing information during playback, avoiding complex real-time calculations and reducing processing complexity while maintaining sync quality.
3Measurement precision
If timestamp information is collected and processed to adjust playback timing, then synchronization accuracy is improved, but processing overhead increases
Solution Approach 1:
The patent implements self-service by having the auxiliary processor automatically generate and return playback status information including timestamps for its own audio frames, without requiring intensive external intervention. The main processor simply collects this self-generated information and makes minimal adjustments, reducing overall processing overhead while maintaining high synchronization accuracy through the self-measuring, self-reporting system.
Data Source
AI summary
An example electronic device according to various embodiments of this document may include: at least one auxiliary processor; and a main processor operably connected to the at least one auxiliary processor, wherein the main processor may be configured to: obtain moving image data; separate the moving image data into image data including plural consecutive image frames, first audio data including plural consecutive audio frames, and plural timestamps corresponding respectively to the plural consecutive audio frames; generate second audio data using the first audio data by adding header data to each of the plural audio frames; transmit the second audio data to the at least one auxiliary processor; generate, based on first time information successively received from the at least one auxiliary processor, second time information; and play back the image data based on the second time information, and wherein the at least one auxiliary processor may be configured to: play back an audio signal based on the received second audio data; and generate the first time information about a playback time of the audio signal based on the header data.