Complexity-Scalable Motion Estimation for Video Coding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Video encoding processes in mobile devices and real-time systems are power-intensive and computationally inefficient, limiting device operation time and requiring a method for complexity-scalable video coding to efficiently allocate computations.

Innovation Solution

A method and apparatus for complexity-scalable video coding that allocates a specified maximum number of computations among video frames for motion estimation, ensuring efficient video coding performance by dividing computations into base and enhancement layers and allocating them among macroblocks based on classification strategies.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If computationally intensive video coding processes are used to improve coding performance, then video quality and compression efficiency are improved, but power consumption increases and device operation time is limited

Engineering Contradiction:
Improvevideo coding performanceVSAvoidpower consumption
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The patent segments the video coding process into multiple complexity layers (base layer and enhancement layers). The base layer performs essential motion estimation with reduced complexity, while enhancement layers add additional complexity only when needed and when power budget allows. This segmentation enables the system to achieve good coding performance without always consuming maximum power, thus resolving the contradiction between coding performance and power consumption.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements dynamic complexity scaling where the motion estimation algorithm adapts its computational complexity based on available power budget and coding requirements. The system can dynamically switch between different complexity levels (e.g., from full complexity to reduced complexity modes) during video encoding, allowing optimal balance between coding performance and power consumption rather than fixed high performance at high cost.

Inventive Principle:
Principle #15Dynamics

2Productivity

If computationally intensive video coding processes are used to improve coding performance, then video quality is improved, but computation time increases and real-time processing becomes inefficient

Engineering Contradiction:
Improvevideo coding performanceVSAvoidcomputation time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent divides the motion estimation computation into segmented complexity layers that can be processed in a hierarchical manner. The base layer computation is performed first with lower complexity, and enhancement layers are added sequentially. This segmentation enables real-time processing by allowing the system to achieve acceptable performance quickly without requiring the full computationally intensive process, thus reducing computation time while maintaining real-time efficiency.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies partial action by performing only the necessary level of computation required for acceptable coding performance rather than always executing the full complex algorithm. When time constraints are present, the system can stop at the base layer or early enhancement layers, avoiding unnecessary computation time while still achieving sufficient video coding performance for real-time applications.

Inventive Principle:
Principle #16Partial or excessive action

3Measurement precision

If maximum computations are allocated to motion estimation to improve coding accuracy, then video quality is improved, but device operation time is severely limited

Engineering Contradiction:
Improvemotion estimation accuracyVSAvoiddevice operation time
Core Design Contradiction:
Measurement precisionVSDuration of action of moving object

Solution Approach 1:

The patent segments the computation budget into base layer and enhancement layers, allowing the system to achieve acceptable motion estimation accuracy with the base layer alone and only adding enhancement complexity when power budget permits. This segmentation enables extended device operation time by preventing continuous maximum complexity computation, while still maintaining sufficient accuracy for most applications through the base layer.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent changes the computation complexity parameter dynamically based on power availability. When power is constrained, the system operates at lower complexity parameters (base layer only), extending battery life. When power is abundant, the system increases complexity parameters to enhance motion estimation accuracy. This parameter adaptation resolves the contradiction between accuracy and operation duration by making accuracy achievable only when power allows.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS8750379B2Method and apparatus for complexity-scalable motion estimation
Publication Date: 2014.06.10 ARRIS ENTERPRISES LLC
  • US8750379B2 patent drawing
  • US8750379B2 patent drawing
  • US8750379B2 patent drawing

AI summary

Embodiments of the invention generally provide a method and apparatus for complexity-scalable video coding. One embodiment of a method for video coding includes receiving a sequence of one or more video frames, obtaining a budget for the one or more video frames, the budget specifying a maximum number of computations that may be used in performing motion estimation for the one or more video frames, allocating the maximum number of computations among individual ones of the one or more video frames, performing motion estimation in accordance with the allocating, and outputting a motion estimate for the sequence.