Inter-layer Motion Vector Compression for HEVC Storage

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The existing image processing technologies, particularly in the context of High Efficiency Video Coding (HEVC), face an increase in storage capacity requirements due to the lack of motion vector compression in Inter-View Motion Prediction (IVMP), leading to higher memory needs for encoding and decoding processes.

Innovation Solution

An image processing device and method that includes a motion compensating unit for decoding and compressing motion vectors, with optional higher compression rates and selective compression strategies to manage storage capacity, utilizing a receiving unit for flags and a selecting unit to choose between compressed and uncompressed motion vectors based on received flags.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If motion vectors are stored with full precision (4x4 units) for IVMP, then prediction accuracy is improved, but storage capacity increases significantly

Engineering Contradiction:
Improvemotion vector precisionVSAvoidstorage capacity
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent changes the precision parameter of motion vectors by compressing them from 4x4 unit precision to 16x16 unit precision for storage in the temporal buffer. This parameter change reduces storage capacity requirements while maintaining adequate prediction accuracy for inter-view motion prediction.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent creates a compressed copy of motion vectors at reduced precision (16x16 units) for storage in the temporal buffer, while the original high-precision motion vectors (4x4 units) are still used for actual prediction operations. This copying approach allows the system to maintain prediction accuracy while reducing storage requirements.

Inventive Principle:
Principle #26Copying

2Quantity of substance

If motion vectors are compressed to reduce storage capacity, then memory usage is reduced, but prediction accuracy deteriorates

Engineering Contradiction:
Improvestorage capacityVSAvoidmotion vector precision
Core Design Contradiction:
Quantity of substanceVSMeasurement precision

Solution Approach 1:

The patent creates a compressed copy of motion vectors at reduced precision (16x16 units) for storage in the temporal buffer, while the original high-precision motion vectors (4x4 units) are still used for actual prediction operations. This copying approach allows the system to maintain prediction accuracy while reducing storage requirements.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent changes the precision parameter of motion vectors by compressing them from 4x4 unit precision to 16x16 unit precision for storage in the temporal buffer. This parameter change reduces storage capacity requirements while maintaining adequate prediction accuracy for inter-view motion prediction.

Inventive Principle:
Principle #35Parameter changes

3Quantity of substance

If multiple layers of motion vector compression are applied, then storage capacity is further reduced, but decoding complexity increases

Engineering Contradiction:
Improvestorage capacityVSAvoiddecoding complexity
Core Design Contradiction:
Quantity of substanceVSDevice complexity

Solution Approach 1:

The patent applies a single level of compression (to 16x16 units) rather than multiple levels, which reduces storage capacity while avoiding excessive decoding complexity. The compression level is optimized to provide sufficient reduction without over-compressing to the point of increasing system complexity.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentEP3687173A1Image processing device and method with inter-layer motion vector compression
Publication Date: 2020.07.29 SONY GROUP CORP
  • EP3687173A1 patent drawingFigure 1
  • EP3687173A1 patent drawingFigure 2
  • EP3687173A1 patent drawingFigure 3

AI summary

The present disclosure relates to an image processing device and method which are capable of suppressing an increase in a storage capacity necessary for encoding and decoding. A motion compensating unit that performs motion compensation in decoding of a current layer and a first compressing unit that compresses a motion vector of the current layer that is reconstructed by the motion compensating unit and used for the motion compensation in decoding of another layer are provided. Alternatively, a motion predicting/compensating unit that performs motion prediction and compensation in encoding of a current layer and a first compressing unit that compresses a motion vector of the current layer that is generated by the motion predicting/compensating unit and used in the motion prediction and compensation in encoding of another layer are provided. For example, the present disclosure can be applied to an image processing device.