Multi-Frame Motion Estimation for Video Compression

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The high computational cost of motion estimation in video compression, particularly in H.264, due to the need to examine all five reference frames, results in increased processing time and reduced efficiency.

Innovation Solution

A method for intelligent selection of reference frames and motion vectors using classification of regions and frames, allowing for reduced candidate frames and locations to be evaluated, with optional local searches at integer-pixel and sub-pixel precision, to form a predictive frame and residue frame.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If all five reference frames are examined for motion estimation, then coding quality is improved, but processing time increases linearly

Engineering Contradiction:
Improvecoding qualityVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The current frame is divided into multiple blocks, and for each block, only selected reference frames are examined rather than all five reference frames. This segmentation of the search space allows the system to maintain coding quality while reducing the overall processing time by avoiding redundant examinations of all reference frames for every block.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Instead of performing exhaustive motion estimation on all five reference frames for every block, the patent applies partial action by examining only a subset of reference frames that are most likely to contain the best match. This partial examination approach maintains sufficient coding quality while significantly reducing processing time.

Inventive Principle:
Principle #16Partial or excessive action

2Reliability

If five reference frames are used for motion estimation, then coding result is improved, but computation increases five-fold

Engineering Contradiction:
Improvecoding resultVSAvoidcomputation
Core Design Contradiction:
ReliabilityVSPower

Solution Approach 1:

The reference frame search space is segmented by examining only specific reference frames for each block rather than all five frames uniformly. This selective segmentation reduces computational power requirements while maintaining coding result quality by focusing computational resources on the most promising reference frames.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different blocks in the current frame may use different numbers of reference frames based on local characteristics. This local quality approach allows the system to allocate computational power efficiently, using more reference frames for blocks that benefit from it while using fewer for blocks where it is unnecessary, thus reducing overall computation while maintaining coding results.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS7720148B2Efficient multi-frame motion estimation for video compression
Publication Date: 2010.05.18 THE HONG KONG UNIV OF SCI & TECH
  • US7720148B2 patent drawing
  • US7720148B2 patent drawing
  • US7720148B2 patent drawing

AI summary

There is disclosed a method of digital signal compression, coding and representation, and more particularly a method of video compression, coding and representation system that uses multi-frame motion estimation and includes both device and method aspects. The invention also provides a computer program product, such as a recording medium, carrying program instructions readable by a computing device to cause the computing device to carry out a method according to the invention.