Adaptive Video Decoder Reference Image Selection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video coding techniques for multiview image sequences do not effectively exploit inter-view correlations, leading to inefficient compression and transmission of video data.

Innovation Solution

A method for encoding and decoding image sequences that adapts the encoding and decoding modes based on the reference image used, allowing for different decoding and encoding parameters depending on the reference image, thereby optimizing the compression of multiview image sequences by utilizing specific decoding and encoding modes tailored to the reference image.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If conventional video coding techniques are used for multiview image sequences, then the encoding and decoding process is simple and uniform, but the compression efficiency is poor because inter-view correlations are not exploited

Engineering Contradiction:
Improvecompression efficiencyVSAvoidencoding and decoding complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent applies dynamics by making the reference image selection adaptive rather than fixed. The system dynamically determines which reference image (current image or complementary view image) to use based on prediction quality metrics, allowing the encoding/decoding process to adapt to different block characteristics and maximize compression efficiency while managing complexity through selective application of different modes

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent applies local quality by allowing different blocks within the same image to use different reference images and prediction modes. Each block can independently select whether to reference the current image or the complementary view image based on its own prediction quality, enabling localized optimization of compression efficiency without uniformly increasing complexity across the entire image

Inventive Principle:
Principle #3Local quality

2Adaptability or versatility

If a single reference image is used for all blocks, then the encoding and decoding process is simple, but the ability to exploit inter-view correlations is limited

Engineering Contradiction:
Improvereference image adaptabilityVSAvoidreference image management complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system dynamically switches between two reference image modes (current image and complementary view image) based on prediction quality assessment. This dynamic adaptation allows the system to exploit inter-view correlations when beneficial while maintaining simplicity when not needed, achieving high adaptability without proportionally increasing complexity

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent makes the reference image structure multi-functional by allowing the same reference image memory to serve both conventional inter-frame prediction (current image) and inter-view prediction (complementary view image). This universal reference structure enables the system to handle both single-view and multiview scenarios with the same hardware/software architecture

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11064193B2Methods and devices for encoding and decoding a data stream representative of an image sequence
Publication Date: 2021.07.13 ORANGE SA
  • US11064193B2 patent drawing
  • US11064193B2 patent drawing
  • US11064193B2 patent drawing

AI summary

A method for decoding a data stream representative of an image sequence. At least one current block of a current image in the image sequence is encoded using a predictor block of a reference image, the predictor block being identified in the reference image via location information. An information item enabling the reference image to be identified from a set of reference images is obtained. When the reference image satisfies a predetermined criterion, the location information of the predictor block is decoded using a first decoding mode, otherwise the location information of the predictor block is decoded using a second decoding mode, the first and second decoding modes including at least a different decoding parameter. The current block is then reconstructed from the predictor block.