Audio-Video Synchrony Testing System Using Embedded Frame Marks
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current systems lack the ability to easily identify and measure asynchrony between audio and video frames during video reproduction on devices like smartphones, which is crucial for ensuring synchronized playback despite running applications and background tasks.
Innovation Solution
A testing system that uses specifically prepared audio and video data with unique marks, allowing for simultaneous reproduction and recording, followed by analysis to determine the synchrony between audio and video frames using a test processor that extracts and compares these marks, employing techniques like Short-Time-Fourier transformation for audio frames.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If audio and video data are reproduced simultaneously on a device with multiple applications running, then the device can perform normal operations, but asynchrony between audio frames and video frames occurs
Solution Approach 1:
The patent embeds unique marks in audio frames and video frames during the data preparation stage, before reproduction. These marks serve as preliminary identifiers that enable later detection of asynchrony without affecting the device's normal operation with multiple applications.
2Device complexity
If traditional separate testing of audio and video reproduction is performed, then testing complexity is reduced, but synchrony between audio and video cannot be tested
Solution Approach 1:
The patent combines audio testing and video testing into a single integrated system. The test processor simultaneously processes both audio and video streams, extracting unique marks from both and analyzing their synchrony, thereby achieving comprehensive testing without significantly increasing complexity.
Solution Approach 2:
The patent introduces unique marks as intermediary elements that facilitate synchrony measurement. These marks act as mediators between the audio and video streams, enabling the test processor to easily identify and compare corresponding audio frames and video frames for asynchrony detection.
3Measurement precision
If unique marks are embedded in every audio and video frame for synchrony detection, then asynchrony can be precisely identified, but data size and processing requirements increase
Solution Approach 1:
Instead of adding substantial data to every frame, the patent uses compact unique marks that occupy minimal space within audio and video frames. These localized markers provide precise identification capability without significantly increasing overall data size or processing requirements.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
The present invention provides a testing system (1, 60) for a video and audio reproduction system (100, 101), the testing system (1, 60) comprising a data source (2), comprising video and audio data (3, 61) for reproduction by the video and audio reproduction system (100, 101), the video and audio data (3, 61) comprising unique marks (5, 65 - 67, 7, 46 - 53, 71 - 73) in every video frame (4, 30 - 37, 62 - 64) and every audio frame (6, 38 - 45, 68 - 70), a recording unit (8, 74), configured to record a video stream (9, 77) and an audio stream (10, 78) generated by the video and audio reproduction system (100, 101) based on the video and audio data (3, 61), and a test processor (11, 79), configured to extract the unique marks (5, 65 - 67, 7, 46 - 53, 71 - 73) from the recorded video stream (9, 77) and the recorded audio stream (10, 78), and to verify if respective unique marks (5, 65 - 67, 7, 46 - 53, 71 - 73) of simultaneous video frames (4, 30 - 37, 62 - 64) and audio frames (6, 38 - 45, 68 - 70) have been recorded by the recording unit (8, 74) simultaneously. Furthermore, the present invention provides a testing method, a computer program product, and a non-transitory computer readable data carrier.