Multiview Video HRD Buffering Constraints

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current Hypothetical Reference Decoders (HRDs) for Multiview Video Coding (MVC) lack defined rules for validating bitstreams, leading to insufficient buffering constraints and potential buffer overflows or underflows, especially with the large number of interoperability points (IOPs) in MVC bitstreams.

Innovation Solution

The proposed solution defines HRD constraints for each interoperability point in MVC, using new SEI messages and modified syntax structures to specify buffering parameters, allowing for flexible decoding of multiple views while ensuring compliance with buffering limitations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If HRD constraints are defined for each interoperability point in MVC, then buffering compliance and reliability are improved, but device complexity and rule specification complexity increase

Engineering Contradiction:
Improvebuffering complianceVSAvoidHRD rule complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent segments the HRD validation process by defining separate HRD parameter sets for each interoperability point in MVC. Each IOP has its own buffer size (VbvBufferSize) and bit rate (VbvTargetBitRate) parameters, allowing independent validation of each view combination. This segmentation enables precise control of buffering compliance for different decoding scenarios without requiring a single complex unified rule set.

Inventive Principle:
Principle #1Segmentation

2Quantity of substance

If buffer sizes are constrained to be finite, then memory usage is controlled, but bit-rate variations must be strictly limited reducing flexibility

Engineering Contradiction:
Improvebuffer sizeVSAvoidbit-rate flexibility
Core Design Contradiction:
Quantity of substanceVSAdaptability or versatility

Solution Approach 1:

The patent applies parameter changes by allowing different VbvBufferSize and VbvTargetBitRate values for different interoperability points. This enables the system to adapt bit-rate constraints dynamically based on the specific view combination being decoded, rather than enforcing a single fixed buffer configuration. The HRD parameters can be adjusted per IOP to match the actual buffering requirements of each decoding scenario.

Inventive Principle:
Principle #35Parameter changes

3Adaptability or versatility

If multiple views are decoded simultaneously, then application flexibility is improved, but buffering complexity and overflow risk increase

Engineering Contradiction:
Improvedecoding flexibilityVSAvoidbuffering management complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent segments the buffering management by creating separate virtual buffer models for different view combinations. When multiple views are decoded simultaneously, each interoperability point has its own HRD parameter set that defines the buffering requirements for that specific combination. This segmentation simplifies buffering management by treating each view combination as an independent validation unit rather than managing a single complex shared buffer.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentEP2145483B1Hypothetical reference decoder for multiview video coding
Publication Date: 2020.10.21 INTERDIGITAL VC HOLDINGS INC
  • EP2145483B1 patent drawingFigure 1
  • EP2145483B1 patent drawingFigure 2
  • EP2145483B1 patent drawingFigure 3

AI summary

A method and apparatus to define a Hypothetical Reference Decoder (HRD) for Multiview Video Coding (MVC) defines constraints for each possible interoperability point. Each combination of M views denotes an interoperability point. The principles of the present invention also allow for constraints to be defined for a set of interoperable points and other sets are derived from the defined set. The method also allow for the rules of the interoperability points to be derived from information in the bitstream syntax.