Motion Estimation Using User Input Displacement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional motion estimation techniques in video encoding are inefficient, particularly in real-time applications where rapid video frame changes occur, as they often start searching for best matches in the reference frame at the same position as the current block, leading to delays in finding accurate matches and ensuring real-time transmission.

Innovation Solution

A method and apparatus that utilize user inputs to determine displacement coordinates, allowing for a more efficient search area in the reference frame to find best-match blocks, thereby reducing computational effort and improving real-time encoding capabilities.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If conventional motion estimation techniques start searching for best matches at the same position as the current block in the reference frame, then the block matching procedure is simple and consistent, but the processing time increases and real-time transmission is delayed

Engineering Contradiction:
Improveprocessing speedVSAvoiddelay in finding matches
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent applies preliminary action by using user input to predict the likely position of blocks in the reference frame before the actual block matching search begins. The system calculates predicted block positions based on user input data, allowing the search to start from more informed positions rather than defaulting to the same position as current blocks. This preliminary prediction step reduces the average search distance and accelerates the motion estimation process.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If conventional motion estimation searches the entire reference frame for best matches, then accurate matches are found, but computational effort and processing time increase

Engineering Contradiction:
Improveaccuracy of block matchingVSAvoidcomputational efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent applies local quality by adapting the block matching search strategy based on local information from user input. Instead of uniformly searching the entire reference frame with the same effort, the system uses user input to identify regions of interest and adjusts search parameters locally. This allows concentrated computational effort in areas where accurate matching is most critical while reducing search intensity in less important regions, thereby maintaining overall matching accuracy while improving computational efficiency.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11310513B2Apparatus and method for enhancing motion estimation based on user input
Publication Date: 2022.04.19 NVIDIA CORP
  • US11310513B2 patent drawing
  • US11310513B2 patent drawing
  • US11310513B2 patent drawing

AI summary

A method and apparatus for enhancing motion estimation based on user input are provided. The motion estimation apparatus used for video encoding comprises a receiver operable to receive a user based input and an input analysis module operable to analyzed the user based input. The apparatus also comprises an encoder that is operable to compute displacement coordinates from the analyzed user based input for a current block in a target frame of a video stream and operable to determine a search area in a reference frame to search for a best match for the current block using the displacement coordinates. The encoder can also comprise a block match module operable to find a best match block for the current block in the search area of the reference frame using a block matching procedure.