Live Video Stream Error Correction via Multi-Stream Redundancy

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Media sharing services face issues with stream corruption and errors during live video streaming, leading to visible artifacts and potential decoder crashes due to the unreliable nature of digital video stream protocols like UDP.

Innovation Solution

A system that generates and combines multiple live video streams by synchronizing and correcting errors using metadata fingerprints, replacing lost or corrupted packets from one stream with error-free packets from another, and assigning weights based on reliability or location to create a substantially error-free master video stream.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If multiple live video streams are combined to create a master video stream, then reliability is improved, but device complexity increases

Engineering Contradiction:
Improvevideo stream reliabilityVSAvoidstream processing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent combines multiple live video streams (at least two streams) into a single master video stream. The combination component merges these streams by synchronizing them using fingerprint matching and replacing corrupted packets from one stream with corresponding packets from another stream, thereby improving reliability through redundancy while managing complexity through systematic processing

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces a combination component as an intermediary system that mediates between multiple input video streams and the output master stream. This intermediary performs synchronization using fingerprints, detects corruption, and replaces lost packets, acting as a buffer and processing layer that manages the complexity of multi-stream integration

Inventive Principle:
Principle #24Intermediary (Mediator)

2Manufacturing precision

If stream synchronization is performed using fingerprint matching, then manufacturing precision is improved, but loss of time increases

Engineering Contradiction:
Improvestream synchronization precisionVSAvoidsynchronization processing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent performs fingerprint extraction and matching as preliminary actions during the stream combination process. By pre-computing and comparing fingerprints of video segments before final assembly, the system achieves precise synchronization without requiring extensive post-processing time, as the fingerprint matching enables quick identification of corresponding segments across streams

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent replaces traditional time-based or frame-count-based synchronization methods with fingerprint-based content matching. Instead of relying on temporal metadata that may be unreliable in live streams, the system uses content-based fingerprinting to identify and align corresponding video segments, achieving higher precision without proportional time loss

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Manufacturing precision

If packet replacement is performed to correct stream errors, then purity is improved, but loss of substance increases

Engineering Contradiction:
Improvevideo stream purityVSAvoiddata transmission volume
Core Design Contradiction:
Manufacturing precisionVSLoss of substance

Solution Approach 1:

The patent applies packet replacement selectively rather than universally. The combination component identifies specific corrupted or lost packets through fingerprint mismatch or error detection, and replaces only those specific packets with corresponding packets from alternative streams. This localised approach maintains video stream purity by correcting only the affected segments while preserving the majority of original stream data

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS10205970B2System, apparatus and method to facilitate live video streaming
Publication Date: 2019.02.12 GOOGLE LLC
  • US10205970B2 patent drawing
  • US10205970B2 patent drawing
  • US10205970B2 patent drawing

AI summary

Systems and methods for generating a master video stream from at least two live video streams are provided in this disclosure. The systems include a combination component that combines the live video streams to generate the master video stream. In one aspect, the live video streams can be copies of the same recording that are multicast from different locations according to User Datagram Protocol. The live video streams suffer different errors, such as stream corruption or stream error, due to the transmission. The combination component eliminates the errors in the live video streams due to transmission and creates a substantially error-free master video stream.