Predicted Reference Information Generating Method for Video Encoding

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional video encoding methods struggle to efficiently generate predicted vectors or disparity information when the motion of an imaged object or camera is not linear uniform, leading to increased code differences and reduced encoding efficiency, especially when adaptive motion or disparity compensation is used for each block.

Innovation Solution

A predicted reference information generating apparatus and method that processes video images by dividing them into areas, applying interframe prediction encoding, and generating predicted reference information using reference frames and corresponding information from adjacent areas, updating this information to accurately reflect time and viewpoint relationships, even without temporal continuity across frames.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If conventional interframe prediction encoding is used assuming linear uniform motion, then encoding simplicity is maintained, but encoding efficiency deteriorates when motion is non-linear

Engineering Contradiction:

Improveencoding simplicityVSAvoidencoding efficiency

Core Design Contradiction:

Ease of manufactureVSProductivity

Solution Approach 1:

The patent applies preliminary action by generating predicted reference information in advance using reference areas from previously processed adjacent blocks. This predicted information is prepared before the actual encoding of the current block, allowing the encoder to start with a better initial prediction that accounts for non-linear motion patterns, thereby improving encoding efficiency without significantly increasing complexity

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent implements feedback by using the reference information from adjacent blocks (which have already been processed) to inform and improve the prediction for the current block. This feedback loop allows the encoding process to adapt to non-linear motion by continuously incorporating information from previously encoded areas, resolving the contradiction between simplicity and efficiency

Inventive Principle:

Principle #23Feedback

2Measurement precision

If adaptive motion or disparity compensation is applied for each block, then encoding precision is improved, but device complexity increases

Engineering Contradiction:

Improveencoding precisionVSAvoiddevice complexity

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies segmentation by dividing the image into blocks and processing each block independently with adaptive motion or disparity compensation. This allows high precision encoding for each block while managing complexity through modular processing, where each block can be handled by the same standardized procedure

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent introduces predicted reference information as an intermediary element that facilitates adaptive motion or disparity compensation. Instead of directly computing complex motion vectors for each block, the system uses predicted reference information derived from adjacent blocks as a mediator, simplifying the overall process while maintaining high encoding precision

Inventive Principle:

Principle #24Intermediary (Mediator)

3Measurement precision

If reference information from adjacent areas is used for prediction, then prediction accuracy is improved, but information accuracy deteriorates when temporal continuity is absent

Engineering Contradiction:

Improveprediction accuracyVSAvoidinformation accuracy

Core Design Contradiction:

Measurement precisionVSReliability

Solution Approach 1:

The patent applies local quality by using reference information from spatially adjacent blocks (local areas) rather than relying on temporal continuity from previous frames. This approach prioritizes spatial correlation over temporal correlation, allowing accurate prediction even when temporal continuity is absent, as each block uses locally derived reference information appropriate to its specific context

Inventive Principle:

Principle #3Local quality

Data Source

PatentUS8675735B2Predicted reference information generating method, video encoding and decoding methods, apparatuses therefor, programs therefor, and storage media which store the programs

Publication Date: 2014.03.18 NIPPON TELEGRAPH & TELEPHONE CORP

AI summary

When video images are processed by applying temporal or spatial interframe prediction encoding to each divided area, and generating a predicted image of a processing target area based on a reference frame of the processing target area and reference information which indicates a predicted target position of the processing target area in the reference frame, predicted reference information is generated as predicted information of the reference information. Reference information used when an area adjacent to the processing target area was processed is determined as predicted reference information prediction data used for predicting the reference information of the processing target area. Reference area reference information is generated using one or more pieces of reference information used when a reference area indicated by the prediction data was processed. The predicted reference information prediction data is updated using the reference area reference information. The predicted reference information is generated using one or more pieces of the updated predicted reference information prediction data.