Multi-View Video Slice Group Encoding for Error Resilience

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video encoding and decoding technologies face challenges in efficiently handling multi-view video content, particularly in error resiliency and region of interest coding, due to limitations in the flexibility of slice group allocation and inter prediction constraints in current standards.

Innovation Solution

The use of multiple slice groups in the MPEG-4 AVC standard for encoding and decoding multi-view video content, allowing for flexible allocation of macroblocks and independent coding of each view as a separate slice group, with enhanced Supplemental Enhancement Information messages for inter prediction constraints.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If multiple slice groups are used for multi-view video coding, then error resiliency and region of interest coding are enhanced, but the complexity of slice group allocation and macroblock mapping increases

Engineering Contradiction:
Improveerror resiliencyVSAvoidslice group allocation complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent divides the video picture into multiple slice groups, where each slice group can be independently coded and decoded. This segmentation allows error resiliency by isolating errors to specific slice groups rather than affecting the entire picture, and enables region of interest coding by assigning different priorities to different slice groups containing important content.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces dynamic slice group allocation where the number and configuration of slice groups can change between pictures. The slice group map type can be dynamically switched between different patterns (e.g., horizontal, vertical, interleaved), allowing the system to adapt to different content requirements while maintaining error resiliency and ROI capabilities.

Inventive Principle:
Principle #15Dynamics

2Adaptability or versatility

If each view is coded as a separate slice group, then independent coding of views is achieved, but the overhead for slice group mapping and inter prediction constraints increases

Engineering Contradiction:
Improveindependent view codingVSAvoidslice group mapping overhead
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent makes the slice group structure universal across multiple views by applying the same slice group configuration to all views. The slice group map type is defined at the sequence or picture parameter set level, allowing it to be reused across multiple views without requiring separate mapping for each view, thereby reducing overhead while maintaining independent view coding capability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent performs preliminary configuration of slice group parameters at the sequence parameter set or picture parameter set level before actual encoding. By pre-defining the number of slice groups, their configuration, and mapping patterns, the system avoids repeated signaling of these parameters for each picture or view, reducing overhead while enabling independent view coding.

Inventive Principle:
Principle #10Preliminary action

3Productivity

If slice groups are used for parallel processing, then processing efficiency is improved, but the constraints on inter prediction across slice group boundaries increase complexity

Engineering Contradiction:
Improveparallel processing efficiencyVSAvoidinter prediction constraint complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent applies different inter prediction constraints to different slice groups based on their content characteristics and importance. Rather than applying uniform constraints across all slice groups, the system can selectively enable or disable inter prediction across slice group boundaries for specific slice groups, optimizing parallel processing efficiency while managing complexity through localized constraint application.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS10158886B2Methods and apparatus for the use of slice groups in encoding multi-view video coding (MVC) information
Publication Date: 2018.12.18 INTERDIGITAL MADISON PATENT HLDG
  • US10158886B2 patent drawing
  • US10158886B2 patent drawing
  • US10158886B2 patent drawing

AI summary

There are provided methods and apparatus for the use of slice groups in encoding and decoding multi-view video coding (MVC) information. An apparatus and method are described which encodes at least two views corresponding to multi-view video content using multiple slice groups. Furthermore, an apparatus and method are described for decoding at least two views corresponding to multi-view video content using multiple slice groups.