Enhancement Layer Decoder Output Signaling for Hybrid Video Coding

Solution Overview

Problem

In codec-hybrid multi-layer video coding, there is a lack of clear signaling for the external system on whether the base layer should be output for display, as the enhancement layer video decoder does not receive indications from the external system about the base layer's output status, leading to uncertainty in bitstream conformance and decoder conformance, especially when the base layer is provided externally and uses a different codec standard.

Innovation Solution

The enhancement layer video decoder sends output indications to the external system about whether base layer decoded pictures need to be output for display, and specifies bitstream and decoder conformance for codec-hybrid multi-layer video coding, ensuring that only enhancement layer encoded pictures are included in the bitstream, with no base layer encoded pictures, and that the base layer decoded pictures are provided by the external system.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If the enhancement layer video decoder operates independently without receiving base layer output status indications, then the decoder can process enhancement layer data autonomously, but the external system cannot determine whether the base layer should be output for display, leading to conformance uncertainty

Engineering Contradiction:

Improvedecoder autonomyVSAvoidoutput status information

Core Design Contradiction:

Ease of operationVSLoss of information

Solution Approach 1:

The enhancement layer video decoder sends output status indications back to the external system, creating a feedback loop that allows the external system to determine whether base layer decoded pictures should be output for display. This resolves the information loss by establishing a communication channel from decoder to external system.

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

The patent introduces an intermediary signaling mechanism that mediates between the enhancement layer decoder and the external system. This intermediary allows the external system to infer base layer output status from enhancement layer processing information, resolving the conformance uncertainty without requiring direct base layer decoder control.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Adaptability or versatility

If the base layer is provided by an external system using a different codec standard, then codec-hybrid multi-layer video coding is enabled, but clear signaling for output status is lost, creating ambiguity in bitstream and decoder conformance

Engineering Contradiction:

Improvecodec standard integrationVSAvoidconformance certainty

Core Design Contradiction:

Adaptability or versatilityVSReliability

Solution Approach 1:

The enhancement layer video decoder performs multiple functions: it decodes enhancement layer data and simultaneously generates output status indications for the base layer. This multi-functionality allows the system to maintain reliability across different codec standards by using a universal signaling mechanism that works regardless of the base layer codec type.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent introduces an intermediary signaling mechanism that mediates between the enhancement layer decoder and the external system. This intermediary allows the external system to infer base layer output status from enhancement layer processing information, resolving the conformance uncertainty without requiring direct base layer decoder control.

Inventive Principle:

Principle #24Intermediary (Mediator)

3Reliability

If the enhancement layer decoder sends output indications to the external system, then clear signaling of base layer output status is achieved, but the system complexity increases due to additional signaling requirements

Engineering Contradiction:

Improveoutput status signalingVSAvoidsignaling mechanism

Core Design Contradiction:

ReliabilityVSDevice complexity

Solution Approach 1:

The patent merges the output status indication function with the existing enhancement layer decoding process. The same decoder that processes enhancement layer data also generates the output status indications, eliminating the need for separate signaling hardware or software modules and reducing overall system complexity.

Inventive Principle:

Principle #5Merging (Combining)

Solution Approach 2:

The enhancement layer video decoder performs multiple functions: it decodes enhancement layer data and simultaneously generates output status indications for the base layer. This multi-functionality allows the system to maintain reliability across different codec standards by using a universal signaling mechanism that works regardless of the base layer codec type.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Data Source

PatentUS10455242B2Signaling output indications in codec-hybrid multi-layer video coding

Publication Date: 2019.10.22 QUALCOMM INC

AI summary

Techniques are described for sending output indications in codec-hybrid multi-layer video coding, in which a base layer of video data is provided by an external system and conforms to a different video codec standard than one or more enhancement layers of the video data. An enhancement layer video decoder receives an enhancement layer bitstream that includes at least one enhancement layer to be decoded, an indication that the base layer is provided externally, and an indication of which layers are target output layers to be output for display. The external system does not receive a target output layer indication in a base layer bitstream. The disclosed techniques enable the enhancement layer video decoder, when the base layer is provided by the external system, to send an output indication to the external system indicating whether the base layer or specific base layer decoded pictures need to be output for display.