Media Bridge Converter Synchronizing Link Training to Reduce Buffering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for converting streaming media between different formats, such as DisplayPort and MIPI CSI2, suffer from significant buffering requirements, leading to lag and jerkiness due to the need for large memory buffers during link training, which interferes with power saving and link initialization processes.

Innovation Solution

A method and apparatus that determine a wait interval based on the time difference between video frames or frame configuration parameters to initiate link training and data transfer, minimizing the need for buffering by synchronizing the initialization of interfaces, thereby reducing memory requirements and ensuring seamless conversion.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If large memory buffers are used for format conversion, then conversion completeness is ensured, but video smoothness deteriorates due to lag and jerkiness

Engineering Contradiction:
Improveconversion completenessVSAvoidvideo smoothness
Core Design Contradiction:
ReliabilityVSDuration of action of moving object

Solution Approach 1:

The patent applies preliminary action by initiating link training during the vertical blanking interval before the next video frame arrives. The timing logic detects the frame timing signal and starts a timer for the wait interval, then initiates link training after the timer expires, ensuring the link is ready before data transfer begins. This allows format conversion to proceed without requiring large buffers to compensate for training delays.

Inventive Principle:
Principle #10Preliminary action

2Use of energy by stationary object

If link training is performed during idle bus states, then power saving is improved, but video smoothness deteriorates due to interference with data transfer

Engineering Contradiction:
Improvepower savingVSAvoidvideo smoothness
Core Design Contradiction:
Use of energy by stationary objectVSDuration of action of moving object

Solution Approach 1:

The patent performs link training in advance during the vertical blanking interval, which is an idle period between video frames. By using the timing logic to detect frame timing signals and calculate appropriate wait intervals, the system initiates link training before the active video transfer begins. This ensures power saving during idle states while maintaining video smoothness during active transfer.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent utilizes the periodic nature of video frame transmission by performing link training during the periodic vertical blanking intervals. The timing logic synchronizes link training initiation with the periodic frame timing signals, ensuring that training occurs only during designated idle periods without interfering with continuous video data transfer.

Inventive Principle:
Principle #19Periodic action

3Duration of action of moving object

If format conversion is performed continuously, then video smoothness is maintained, but power consumption increases due to inability to enter idle states

Engineering Contradiction:
Improvevideo smoothnessVSAvoidpower consumption
Core Design Contradiction:
Duration of action of moving objectVSUse of energy by moving object

Solution Approach 1:

The patent enables periodic idle states by scheduling link training during vertical blanking intervals between video frames. The timing logic detects frame timing signals and calculates wait intervals that align with the periodic frame transmission, allowing the system to enter low-power idle states during blanking periods while maintaining continuous video smoothness during active transfer periods.

Inventive Principle:
Principle #19Periodic action

Data Source

PatentUS10841355B2Methods and apparatus for streaming media conversion with reduced buffering memories
Publication Date: 2020.11.17 APPLE INC
  • US10841355B2 patent drawing
  • US10841355B2 patent drawing
  • US10841355B2 patent drawing

AI summary

Methods and apparatus for converting streaming media between different formats. A bridging device for e.g., Camera Serial Interface (CSI) and DisplayPort is disclosed. Both the CSI and DisplayPort technologies use low power mode operation during blanking intervals of a video transmission. However, the CSI interface can wake up in a very short amount of time (e.g., ˜400 ns), but the DisplayPort interface takes significantly longer to perform link training (e.g., ˜1 ms). Various embodiments of the present disclosure use frame signaling trigger to start a wait time interval timer; the wait time interval can be used by the bridge device to wake up the DisplayPort interface ahead of the CSI2 D-PHY interface, thereby ensuring that both links are active at the same time. This “wake-up” technique can greatly reduce the size of buffering memories that are required.