Video Coding Motion Information Storage Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video coding schemes require storing multiple pictures at both encoders and decoders, leading to significant transmission and storage burdens due to the need for extensive motion information storage, particularly with the increasing complexity of newer standards like VVC.

Innovation Solution

A system that determines whether coding units are part of a single collocated picture and encodes motion information accordingly, using normalized motion vectors and indicators to reduce the memory burden by storing only the necessary motion information for the collocated picture, rather than all reference pictures.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If multiple pictures are stored at encoder and decoder for video coding, then video coding performance is improved, but transmission and storage burdens increase significantly

Engineering Contradiction:
Improvevideo coding performanceVSAvoidtransmission and storage burden
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent extracts only the necessary motion information from multiple reference pictures by identifying collocated pictures and their corresponding coding units. Instead of storing motion information for all reference pictures, the system selectively extracts motion vectors and motion prediction modes only from collocated coding units, significantly reducing the quantity of stored data while maintaining coding performance.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent changes the storage parameter from storing complete motion information for multiple reference pictures to storing only differential motion information for collocated pictures. By storing motion vector differences and motion prediction mode indicators rather than full motion vectors, the system reduces storage requirements while enabling reconstruction of complete motion information when needed.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If motion information for all reference pictures is stored, then accurate motion prediction is achieved, but memory requirements at encoder and decoder increase

Engineering Contradiction:
Improvemotion prediction accuracyVSAvoidmemory requirements
Core Design Contradiction:
Measurement precisionVSVolume of stationary object

Solution Approach 1:

The patent extracts only the essential motion information from reference pictures by identifying collocated coding units and storing only their motion vector differences and motion prediction mode indicators. This selective extraction maintains motion prediction accuracy for collocated pictures while eliminating the need to store motion information for non-collocated pictures, thereby reducing memory requirements.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

Instead of storing complete motion information for all reference pictures and then selecting what is needed, the patent inverts the approach by storing only the differential information and using it to reconstruct complete motion information when collocated pictures are identified. This inversion reduces storage requirements while maintaining the ability to access accurate motion information when needed.

Inventive Principle:
Principle #13The other way round (Inversion)

3Quantity of substance

If normalized motion vectors are used for collocated pictures, then memory burden is reduced, but additional processing steps are required

Engineering Contradiction:
Improvememory burdenVSAvoidprocessing steps
Core Design Contradiction:
Quantity of substanceVSDevice complexity

Solution Approach 1:

The patent applies preliminary normalization to motion vectors when storing them for collocated pictures. By pre-normalizing motion vectors to a reference picture, the system reduces the memory burden of storing motion information while the normalization can be easily reversed or applied during decoding. This preliminary processing step simplifies storage requirements without significantly increasing overall system complexity.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11457233B2Motion information storage for video coding and signaling
Publication Date: 2022.09.27 ARRIS ENTERPRISES LLC
  • US11457233B2 patent drawing
  • US11457233B2 patent drawing
  • US11457233B2 patent drawing

AI summary

A method for inter-coding video in which encoder and decoder memory requirements associated with storage of motion information related to collocated coding units is reduced. In the method motion information related to only a single or reduced set of collocated coding unit(s) may be stored at the encoder and decoder. In operation, if the encoder determines that motion information for a current coding unit should replace a currently stored motion information for currently stored motion information for the collocated coding unit, then the encoder can replace the motion information at the encoder and transmit an indicator with the current coding unit to signal to the decoder that currently stored motion information currently should be updated or replaced with the motion information associated with the current coding unit.