Audio Video Sync via Embedded Signal Markers

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional methods for synchronizing audio and video during playback are inadequate as the timestamps in audio and video streams are independent, leading to potential desynchronization issues.

Innovation Solution

Embedding video and audio sync signals into the respective signals, allowing a receiving device to synchronize them by processing the signals based on the occurrence times of these sync signals, thereby ensuring accurate alignment during playback.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If independent timestamps are used in audio and video streams, then the playback order and speed can be controlled, but the synchronization between audio and video cannot be guaranteed

Engineering Contradiction:
Improveplayback controlVSAvoidaudio-video synchronization
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent embeds a video synchronization signal into the video stream and an audio synchronization signal into the audio stream, creating a unified reference framework. Both streams now share common synchronization markers that allow the receiving device to align them accurately during playback, resolving the independence issue while maintaining playback control

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The synchronization signals embedded in both streams provide continuous reference points that enable the receiving device to monitor and adjust the relative timing of audio and video playback. This feedback mechanism ensures that any drift between the two streams is detected and corrected, maintaining synchronization throughout playback

Inventive Principle:
Principle #23Feedback

2Productivity

If timestamps are added to audio and video bit streams, then playback can proceed in specified order and speed, but accurate synchronization between audio and video is not achieved

Engineering Contradiction:
Improveplayback efficiencyVSAvoidsynchronization accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent introduces synchronization signals as intermediary reference markers embedded within both audio and video streams. These intermediary signals act as common reference points that mediate between the independent timestamp systems, enabling precise alignment without disrupting the efficient timestamp-based playback control mechanism

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS10178427B2Method, apparatus and system of synchronizing audio with video
Publication Date: 2019.01.08 TENCENT TECHNOLOGY (SHENZHEN) CO LTD
  • US10178427B2 patent drawing
  • US10178427B2 patent drawing
  • US10178427B2 patent drawing

AI summary

The present disclosure provides a method, apparatus and a system of synchronizing audio with video. A receiving device receives a video signal embedded with a video sync signal and an audio signal embedded with an audio sync signal provided by a sending device; searches for the video sync signal in the video signal, searches for the audio sync signal in the audio signal; and processes the video signal and the audio signal according to a time when the video sync signal occurs in the video signal and a time when the audio sync signal occurs in the audio signal to make the processed audio signal synchronized with the processed video signal during playback.