Video Coding Using Content-Based Metadata for Region-Specific Motion Estimation

Solution Overview

Problem

Existing video coding standards like H.264, AVC, and HEVC face inefficiencies in image data compression, particularly in motion estimation and mode decision processes, which consume significant memory bandwidth and power due to the computational intensity of determining motion vectors across large frames.

Innovation Solution

The method employs display-related metadata to classify frames into static, scroll, and dirty regions, reducing the computational load by omitting unnecessary motion estimation and encoding processes for static and scroll regions, and optimizing block partitions based on this metadata for more efficient video encoding.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If motion estimation is performed on all blocks across the entire frame to determine accurate motion vectors, then video coding quality is improved, but computational complexity and power consumption increase significantly

Engineering Contradiction:

Improvemotion vector accuracyVSAvoidpower consumption

Core Design Contradiction:

Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent divides the frame into multiple regions (first region, second region, third region) based on motion characteristics. Motion estimation is performed selectively in different regions using different methods (e.g., template matching in first region, gradient-based methods in second region, simplified methods in third region), thereby reducing overall computational complexity while maintaining accuracy where needed.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

Different motion estimation methods and precision levels are applied to different regions of the frame based on their specific characteristics. High-precision methods are used only in regions requiring accurate motion vectors, while simplified methods are used in regions where lower precision is acceptable, optimizing the trade-off between quality and power consumption.

Inventive Principle:

Principle #3Local quality

2Measurement precision

If motion estimation is performed on all blocks across the entire frame to determine accurate motion vectors, then video coding quality is improved, but computational complexity increases

Engineering Contradiction:

Improvemotion vector accuracyVSAvoidcomputational complexity

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The patent divides the frame into multiple regions (first region, second region, third region) based on motion characteristics. Motion estimation is performed selectively in different regions using different methods (e.g., template matching in first region, gradient-based methods in second region, simplified methods in third region), thereby reducing overall computational complexity while maintaining accuracy where needed.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

Different motion estimation methods and precision levels are applied to different regions of the frame based on their specific characteristics. High-precision methods are used only in regions requiring accurate motion vectors, while simplified methods are used in regions where lower precision is acceptable, optimizing the trade-off between quality and computational complexity.

Inventive Principle:

Principle #3Local quality

3Measurement precision

If a large number of pixels over a wide area of the frame are searched for motion estimation, then motion vector accuracy is improved, but memory bandwidth consumption increases

Engineering Contradiction:

Improvemotion vector accuracyVSAvoidmemory bandwidth consumption

Core Design Contradiction:

Measurement precisionVSLoss of energy

Solution Approach 1:

The patent divides the frame into multiple regions (first region, second region, third region) based on motion characteristics. Motion estimation is performed selectively in different regions using different methods (e.g., template matching in first region, gradient-based methods in second region, simplified methods in third region), thereby reducing overall computational complexity while maintaining accuracy where needed.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

Different motion estimation methods and precision levels are applied to different regions of the frame based on their specific characteristics. High-precision methods are used only in regions requiring accurate motion vectors, while simplified methods are used in regions where lower precision is acceptable, optimizing the trade-off between quality and computational complexity.

Inventive Principle:

Principle #3Local quality

Data Source

PatentUS10440366B2Method and system of video coding using content based metadata

Publication Date: 2019.10.08 INTEL CORP

AI summary

Techniques related to video coding using content based metadata.