Scalable Video Packet Reordering for Legacy Compatibility

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Scalable video coding schemes, which separate digital video signals into base and enhancement layers, pose complexity issues for existing video systems, particularly in supporting functionalities like indexing, splicing, and trick mode playback, as they were not originally designed to handle such layered structures.

Innovation Solution

The method involves reordering packets in a transport stream such that initial enhancement layer packets follow initial base layer packets for each picture, with specific delay constraints to ensure seamless processing and compatibility with existing systems, allowing operations on the base layer to implicitly handle enhancement layers.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If scalable video coding schemes separate video signals into base and enhancement layers, then visual quality is improved through higher picture resolution and HDR benefits, but system complexity increases and compatibility with existing video systems deteriorates

Engineering Contradiction:
Improvevisual qualityVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The video signal is segmented into base layer and enhancement layer packets, allowing existing systems to process the base layer while enhancement layers provide quality improvements. This segmentation enables backward compatibility while maintaining the ability to deliver enhanced visual quality when supported.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Instead of requiring existing systems to adapt to scalable video coding structures, the patent inverts the approach by making the base layer compatible with existing systems and adding enhancement layers on top. This allows existing infrastructure to continue functioning while gradually introducing advanced features.

Inventive Principle:
Principle #13The other way round (Inversion)

2Measurement precision

If scalable video coding uses multiple PID flows in MPEG-2 Transport Stream, then visual quality is enhanced, but functionality for indexing, splicing, and trick mode playback deteriorates

Engineering Contradiction:
Improvevisual qualityVSAvoidfunctionality support
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent merges base layer and enhancement layer packets into a unified transport stream structure with specific ordering constraints. This combining allows existing indexing, splicing, and trick mode operations to work on the base layer while enhancement layers are seamlessly integrated, maintaining functionality while providing quality improvements.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The base layer is designed to be universally compatible with existing video system functionalities (indexing, splicing, trick mode playback), while the enhancement layer adds additional capabilities. This multi-functionality approach ensures that the system can operate in both enhanced and legacy modes.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Adaptability or versatility

If packet reordering is implemented to place enhancement layer packets after base layer packets, then compatibility with existing systems is improved, but processing complexity increases due to delay constraints

Engineering Contradiction:
ImprovecompatibilityVSAvoidprocessing complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent applies preliminary ordering constraints to packets during encoding and transport stream generation, ensuring that base layer packets are delivered before enhancement layer packets. This preliminary action eliminates the need for complex reordering operations at playback, reducing processing complexity while maintaining compatibility.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The transport stream structure is designed to be self-organizing, with packets automatically ordered according to the specified constraints. This self-service approach reduces the burden on playback systems, as the ordering is already established in the transmitted stream without requiring complex intervention.

Inventive Principle:
Principle #25Self-service

4Reliability

If minimum delay amounts are enforced between base and enhancement layer packets, then seamless processing is achieved, but loss of time increases

Engineering Contradiction:
Improveseamless processingVSAvoiddelay
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent defines specific parameter constraints for minimum delay amounts between base and enhancement layer packets. By optimizing these parameters, the system achieves seamless processing with minimal delay, balancing reliability requirements against time loss through carefully controlled timing parameters.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS10554711B2Packet placement for scalable video coding schemes
Publication Date: 2020.02.04 CISCO TECHNOLOGY INC
  • US10554711B2 patent drawing
  • US10554711B2 patent drawing
  • US10554711B2 patent drawing

AI summary

Methods and systems for pre-conditioning a video stream are provided herein. For example, an apparatus comprising a memory and one or more processors configured to execute instructions stored in the memory are provided. The instructions: identify packets of a first bitstream in a transport stream, such first bitstream corresponding to a base layer; identify packets of a second bitstream in the transport stream, such second bitstream corresponding to an enhancement layer; identify an initial packet corresponding to an ith picture in the first bitstream; identify an initial packet corresponding to the ith picture in the second bitstream; and reorder packets in the transport stream such that the initial packet corresponding to the ith picture in the second bitstream occurs after the initial packet corresponding to the ith picture in the first bitstream.