Display Apparatus Audio-Video Synchronization via Decoding Time Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional display apparatuses face challenges in accurately synchronizing video and audio frames due to differences in decoding and output times between display and audio devices, leading to user inconvenience and the need for manual adjustments that are not efficient, especially when image quality or mode changes occur.

Innovation Solution

A display apparatus with a processor that decodes video and audio frames, transmits decoding time information, and adjusts audio frame delays to synchronize with video frames, using a communication interface to coordinate with the audio apparatus, thereby automatically synchronizing outputs with minimal user intervention.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a user manually adjusts audio frame output time to synchronize video and audio frames, then synchronization can be achieved, but it causes user inconvenience and requires continuous manual intervention

Engineering Contradiction:
Improvesynchronization accuracyVSAvoiduser convenience
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The display apparatus automatically measures decoding times for video and audio frames, calculates the time difference, and adjusts audio frame output timing without user intervention. The system self-regulates synchronization by having the audio apparatus output audio frames at calculated future time points based on measured decoding performance

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The display apparatus transmits measured video and audio decoding time information to the audio apparatus, which uses this feedback to automatically adjust its audio frame output timing. This closed-loop feedback mechanism enables automatic synchronization adjustment without requiring manual user intervention

Inventive Principle:
Principle #23Feedback

2Manufacturing precision

If the display apparatus outputs high-quality video frames, then image quality is improved, but the decoding time becomes longer causing synchronization difficulties with audio frames

Engineering Contradiction:
Improvevideo qualityVSAvoiddecoding time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The system dynamically adjusts audio frame output timing based on actual measured decoding times for both video and audio frames. When video quality settings change affecting decoding time, the system automatically recalculates and adjusts audio output timing to maintain synchronization, making the synchronization mechanism adaptive to changing decoding conditions

Inventive Principle:
Principle #15Dynamics

3Measurement precision

If the display apparatus transmits detailed decoding time information to the audio apparatus, then synchronization precision is improved, but data transmission complexity increases

Engineering Contradiction:
Improvesynchronization precisionVSAvoiddata transmission complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The display apparatus extracts and transmits only the essential decoding time information needed for synchronization to the audio apparatus, rather than transmitting all possible video and audio parameters. This selective extraction of critical timing data achieves precise synchronization while minimizing data transmission complexity

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS11190806B2Display apparatus and method of controlling thereof
Publication Date: 2021.11.30 SAMSUNG ELECTRONICS CO LTD
  • US11190806B2 patent drawing
  • US11190806B2 patent drawing
  • US11190806B2 patent drawing

AI summary

A display apparatus is disclosed. The display apparatus includes a display, a communication interface, a receiver, and a processor configured to decode an encoded video frame and an encoded audio frame, received through the receiver, transmit information on decoding time of the decoded video frame to an audio apparatus through the communication interface, delay the decoded audio frame by a first time, and transmit information on decoding time of the decoded audio frame, information on the first time, and an audio frame delayed by the first time to the audio apparatus through the communication interface, in response to the transmission, receive information on a second time delayed in the audio apparatus to output the audio frame from the audio apparatus through the communication interface, and synchronize an audio frame output from the audio apparatus with a video frame output through the display based on the information on the second time.