Video Stream Synchronization via Scene Change Matching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The variability in video encoding and decoding processes, including differences in starting points, noise levels, and calibration, leads to inconsistent output video signals across set-top boxes, even when receiving the same video stream, affecting perceived video quality and synchronization.

Innovation Solution

A device and method for synchronizing two video streams by comparing frames and adjusting for time differences, noise, and calibration variations, allowing for quality assessment and detection of content similarities or copies.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of substance

If video encoding is performed with temporal compression schemes, then video signal compression efficiency is improved, but encoding consistency across different sessions deteriorates

Engineering Contradiction:
Improvevideo data redundancyVSAvoidencoding consistency
Core Design Contradiction:
Loss of substanceVSReliability

Solution Approach 1:

The system changes the parameter of reference frame selection by using a fixed number of reference frames from the I-frame rather than relying on variable temporal compression decisions. This ensures that the encoding process produces consistent results across different encoding sessions while still maintaining compression efficiency through controlled reference frame usage.

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If different decoding algorithms are used in set-top boxes, then decoding adaptability is improved, but output video consistency deteriorates

Engineering Contradiction:
Improvedecoding algorithm varietyVSAvoidoutput video consistency
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The system performs preliminary normalization of the encoded video signal by controlling the encoding process to produce a standardized reference frame structure. This preliminary action ensures that regardless of which decoding algorithm is used in different set-top boxes, the input to the decoder is consistent, thereby producing consistent output video while still allowing various decoding algorithms to operate.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The encoding system changes parameters to produce a standardized output format with controlled reference frame sequences. By adjusting encoding parameters to generate consistent I-frame and reference frame structures, the system enables different decoding algorithms to process identical input data, ensuring output consistency while maintaining decoding algorithm diversity.

Inventive Principle:
Principle #35Parameter changes

3Adaptability or versatility

If set-top boxes are calibrated differently for hue, color, and saturation, then device adaptability is improved, but video signal comparability deteriorates

Engineering Contradiction:
Improvecalibration flexibilityVSAvoidvideo signal comparability
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The system performs preliminary color space transformation and normalization during the encoding process, converting video signals to a standardized color space with controlled saturation and hue parameters. This preliminary action ensures that all set-top boxes receive identically calibrated reference frames, enabling accurate video signal comparability while still allowing individual devices to perform their own calibration adjustments if needed.

Inventive Principle:
Principle #10Preliminary action

4Adaptability or versatility

If video encoding starts at different points in the video program, then encoding flexibility is improved, but frame synchronization deteriorates

Engineering Contradiction:
Improveencoding starting point flexibilityVSAvoidframe synchronization
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The system performs preliminary identification and marking of I-frames and reference frame positions during the encoding process. By establishing a standardized reference point structure before actual encoding begins, the system ensures that regardless of where encoding starts in the video program, the resulting bitstream contains properly synchronized reference frames that maintain frame synchronization accuracy.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS8928809B2Synchronizing videos
Publication Date: 2015.01.06 VERIZON PATENT & LICENSING INC
  • US8928809B2 patent drawing
  • US8928809B2 patent drawing
  • US8928809B2 patent drawing

AI summary

A device may receive a first video, receive a second video, and locate first frames, in the first video, in which a first change in scene occurs. In addition, the device may locate second frames, in the second video, in which a second change in scene occurs. Further, the device may determine whether the first change in scene matches the second change in scene and achieve synchronization when the first change in scene matches the second change in scene.