Scalable Video Coding Integrity Check Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In scalable video coding systems, particularly with the SVC standard, there is a lack of provision for providing feedback on the integrity and completeness of transmitted NAL units, leading to potential errors and reduced video quality due to truncation or loss of FGS or MGS data during transmission.

Innovation Solution

The implementation of integrity check codes, where a first integrity check code is calculated at the encoder and sent as an SEI message, allowing the decoder to verify the accuracy of received NAL units, and an error tracking algorithm is used to determine if NAL units are correct in content, enabling feedback on decoding status.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If integrity check codes are implemented to verify NAL unit accuracy, then video quality and reliability are improved, but device complexity and processing overhead increase

Engineering Contradiction:
ImproveNAL unit transmission reliabilityVSAvoidencoder and decoder complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent implements integrity check codes (CRC) that are calculated at the encoder and transmitted alongside NAL units. The decoder verifies these codes to ensure NAL unit integrity. This feedback mechanism allows the system to detect and report transmission errors, enabling reliability improvement without requiring complex error correction mechanisms.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The integrity check codes are calculated and prepared in advance at the encoder before transmission. This preliminary action ensures that verification can be performed efficiently at the decoder without adding significant processing delay, as the check codes are already available when the NAL units arrive.

Inventive Principle:
Principle #10Preliminary action

2Manufacturing precision

If error tracking algorithms are used to verify NAL unit content accuracy, then video quality is improved, but processing time and computational resources increase

Engineering Contradiction:
Improvevideo coding precisionVSAvoiddecoding time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The error tracking algorithm provides feedback about the accuracy of decoded NAL units to the encoder. This allows the encoder to adjust its encoding strategy based on actual decoding performance, improving video quality precision while the feedback mechanism itself adds minimal processing overhead compared to the benefits achieved.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent replaces complex mechanical error detection methods with more efficient computational approaches. Instead of using computationally intensive error correction codes, the system uses simpler integrity check codes combined with error tracking algorithms that operate on already-decoded data, reducing processing time while maintaining precision.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Productivity

If feedback mechanisms are implemented to report decoding status, then coding efficiency is improved, but device complexity and protocol overhead increase

Engineering Contradiction:
Improvevideo coding efficiencyVSAvoidfeedback protocol complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent implements a feedback mechanism where the decoder reports decoding status and integrity information back to the encoder. This feedback enables the encoder to optimize its encoding strategy based on actual reception conditions, improving coding efficiency. The feedback protocol uses standard SEI messages and existing RTP/RTCP mechanisms, avoiding the need for complex custom protocols.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The feedback mechanism leverages existing universal protocols (RTP/RTCP) and standard SEI message formats, allowing the same infrastructure to serve multiple purposes: integrity verification, quality reporting, and encoding optimization. This multi-functionality reduces overall system complexity compared to implementing dedicated feedback channels.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS8275051B2Feedback based scalable video coding
Publication Date: 2012.09.25 NOKIA TECHNOLOGIES OY
  • US8275051B2 patent drawing
  • US8275051B2 patent drawing
  • US8275051B2 patent drawing

AI summary

A system and method provides a first integrity check code that can be calculated at an encoder and then sent to a decoder as a supplemental enhancement information message. The decoder can then calculate a second integrity check code over the actual received network abstraction layer units. This second integrity check code can be compared with the encoder-generated first integrity check code sent via the supplemental enhancement information message to indicate if in fact all of the transmitted NAL units from which the integrity check code was generated have been received without changes in their content. In addition, an error tracking algorithm is provided that can be run at either the encoder or the decoder in order to determine if the network abstraction layer units are correct in content at the decoder level. Therefore, pictures that are sent as just intra coded frames and pictures that are sent as just inter coded frames can both be checked for errors. Hence, error checking can be provided in those situations where the decoder fails to provide adequate information to the encoder as to what has actually been decoded.