Coframe Motion Vectors for Video Coding Prediction Accuracy

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current image and video compression techniques face challenges in efficiently encoding and decoding data over limited bandwidth channels, particularly in accurately predicting frames using motion information, which can lead to suboptimal compression efficiency and increased bandwidth utilization.

Innovation Solution

The method involves using motion prediction coding with coframe motion vectors, where a reference coframe is generated to improve prediction accuracy by aligning and interpolating motion information across frames, and encoding this information in the bitstream to reduce redundancy and enhance compression efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of substance

If motion prediction coding is used to compress video data, then compression efficiency is improved, but prediction accuracy deteriorates leading to suboptimal compression

Engineering Contradiction:
Improvedata redundancyVSAvoidprediction accuracy
Core Design Contradiction:
Loss of substanceVSMeasurement precision

Solution Approach 1:

The patent segments motion information processing into two distinct types: coframe motion vectors (for temporal prediction within a frame) and inter-frame motion vectors (for prediction across frames). This segmentation allows each type to be optimized independently, improving overall prediction accuracy while maintaining compression efficiency.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a temporal dimension by generating a reference coframe at a temporal location corresponding to the current frame. This reference coframe provides an additional reference source that enhances prediction accuracy by capturing motion information at the correct temporal position, rather than relying solely on previously decoded frames.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Loss of substance

If reference frames are used for motion prediction, then compression efficiency is improved, but bandwidth utilization increases

Engineering Contradiction:
Improvedata redundancyVSAvoidbandwidth utilization
Core Design Contradiction:
Loss of substanceVSQuantity of substance

Solution Approach 1:

The patent performs preliminary action by generating the reference coframe in advance at the encoder side, containing pre-computed motion information. This allows the decoder to utilize this pre-prepared reference data without requiring additional bandwidth for transmitting reference frame information, as the reference coframe is derived locally using the same algorithm.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system employs self-service by enabling the decoder to generate its own reference coframe using the transmitted coframe motion vectors and the same reference coframe generation algorithm. This eliminates the need for the encoder to transmit the entire reference coframe data, significantly reducing bandwidth utilization while maintaining prediction accuracy.

Inventive Principle:
Principle #25Self-service

3Measurement precision

If coframe motion vectors are encoded for all blocks, then prediction accuracy is improved, but encoding complexity increases

Engineering Contradiction:
Improveprediction accuracyVSAvoidencoding complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies local quality by selectively encoding coframe motion vectors only for blocks that benefit from temporal prediction, rather than uniformly encoding them for all blocks. The encoder determines on a block-by-block basis whether coframe motion vectors should be used, allowing high prediction accuracy where needed while minimizing encoding complexity where simple prediction suffices.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent changes the parameter of motion vector encoding by introducing a hybrid approach where blocks can be encoded with either coframe motion vectors, inter-frame motion vectors, or a combination thereof. This parameter flexibility allows the encoder to adapt to different block characteristics and motion patterns, optimizing the balance between prediction accuracy and encoding complexity.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS20230308679A1Motion prediction coding with coframe motion vectors
Publication Date: 2023.09.28 GOOGLE LLC
  • US20230308679A1 patent drawing
  • US20230308679A1 patent drawing
  • US20230308679A1 patent drawing

AI summary

Video coding using motion prediction coding with coframe motion vectors includes generating a reference coframe spatiotemporally concurrent with a current frame from a sequence of input frames, wherein each frame from the sequence of input frames has a respective sequential location in the sequence of input frames, and wherein the current frame has a current sequential location in the sequence of input frames, generating an encoded frame by encoding the current frame using the reference coframe, including the encoded frame in an encoded bitstream, and outputting the encoded bitstream.