Intermediate Module Error Correction for Low-Latency Video Streaming

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional error correction methods for low-latency streaming video, such as retransmission and redundant transmission, are inadequate for bandwidth-limited and lossy networks, as they either exceed latency budgets or are insufficient due to bandwidth limitations.

Innovation Solution

An intermediate module intercepts video streams from a bandwidth-limited network, generates error correction data based on lossy network conditions, and transmits a modified stream with error correction data over the lossy network to the client device, overcoming bandwidth limitations and ensuring sufficient error correction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If retransmission is used to correct packet loss, then error correction is achieved, but latency exceeds the latency budget

Engineering Contradiction:
Improveerror correctionVSAvoidlatency
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent applies preliminary action by generating and transmitting forward error correction (FEC) codes along with the video stream before packet loss occurs. This allows the client to correct errors without needing to request retransmission, thereby avoiding the latency penalty of round-trip communication while maintaining reliable error correction.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If redundant transmission with FEC information is used, then error correction capability is improved, but bandwidth is consumed limiting the amount of FEC information that can be transmitted

Engineering Contradiction:
Improveerror correction capabilityVSAvoidbandwidth availability
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent introduces an intermediary device (such as a gateway or router) between the server and the lossy network. This intermediary generates additional FEC codes specifically tailored for the lossy network segment, allowing sufficient error correction capability without consuming bandwidth on the bandwidth-limited connection from the server.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Quantity of substance

If limited FEC information is appended at the server, then bandwidth consumption is reduced, but error correction is insufficient for lossy networks

Engineering Contradiction:
Improvebandwidth consumptionVSAvoiderror correction sufficiency
Core Design Contradiction:
Quantity of substanceVSReliability

Solution Approach 1:

The patent segments the transmission path into two distinct segments: a bandwidth-limited segment from the server to the intermediary, and a lossy network segment from the intermediary to the client. Different error correction strategies are applied to each segment - minimal FEC at the server for the bandwidth-limited segment, and additional FEC generation at the intermediary for the lossy network segment.

Inventive Principle:
Principle #1Segmentation

4Reliability

If more FEC information is transmitted over the bandwidth-limited network, then error correction for lossy network is improved, but bandwidth limitation is exceeded

Engineering Contradiction:
Improveerror correction for lossy networkVSAvoidbandwidth limitation
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The intermediary device acts as a mediator that receives video data with minimal FEC from the server, generates additional FEC codes locally, and forwards the combined stream to the client. This architecture allows sufficient error correction for the lossy network without exceeding the bandwidth limitations of the server connection.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS9673936B2Method and system for providing error correction to low-latency streaming video
Publication Date: 2017.06.06 GOOGLE LLC
  • US9673936B2 patent drawing
  • US9673936B2 patent drawing
  • US9673936B2 patent drawing

AI summary

Disclosed is a method for providing error correction to a video stream transmitted from a server to a client device, wherein the server is connected to an intermediate module over a bandwidth-limited network and the intermediate module is connected to the client device over a lossy network. The method includes intercepting data transmitted from the bandwidth-limited network to the lossy network by the intermediate module, identifying the video stream for error correction from the intercepted data at the intermediate module, generating error correction data for the video stream by the intermediate module and transmitting a modified stream that includes the video stream and the error correction data over the lossy network to the client device by the intermediate module.