Video Processing Complexity Scaling via Power Saving Factor

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video codecs have fixed or limited computation complexity, which is inadequate for dynamic environments with varying processing power, power capacity, and workload, leading to visual quality degradation when trying to adjust complexity.

Innovation Solution

A video processing system that adjusts computation complexity based on a power saving factor (PSF), using prioritized layered coding to dynamically modify coding methods and tools, such as reducing sub-pixel interpolation, motion search window, and deblocking filtering, to prioritize higher efficiency functions while conserving power and processing resources.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If computation complexity is increased to improve video quality, then visual quality is improved, but power consumption and processing resource usage increase

Engineering Contradiction:
Improvevideo qualityVSAvoidpower consumption
Core Design Contradiction:
Manufacturing precisionVSUse of energy by moving object

Solution Approach 1:

The patent implements dynamic adjustment of computation complexity based on real-time power availability and operating conditions. The system transitions from fixed complexity to variable complexity by monitoring power state and dynamically selecting appropriate coding methods, allowing the video processing system to adapt its computational demands to match available power resources.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes operational parameters (computation complexity level) based on power availability. By introducing a power state-dependent complexity scaling mechanism, the system adjusts coding parameters such as motion search window size, sub-pixel interpolation depth, and deblocking filter strength according to the detected power state, thereby optimizing the trade-off between video quality and power consumption.

Inventive Principle:
Principle #35Parameter changes

2Device complexity

If computation complexity is fixed to simplify system design, then device complexity is reduced, but adaptability to varying power and workload conditions deteriorates

Engineering Contradiction:
Improvesystem design complexityVSAvoidadaptability to varying conditions
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The patent segments the video coding process into multiple complexity levels with different coding methods and tools enabled at each level. By dividing the coding functionality into hierarchical layers (e.g., high complexity with full motion search and sub-pixel interpolation, medium complexity with reduced search windows, low complexity with integer-only processing), the system can selectively activate appropriate segments based on power state without redesigning the entire system.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system achieves multi-functionality by designing a unified video codec architecture that can operate across multiple complexity levels. The same base codec structure supports varying degrees of computational complexity through conditional enabling/disabling of specific coding tools and parameters, allowing one system to serve multiple operating conditions (battery-powered mobile devices, plugged-in devices, different network conditions) without requiring separate specialized implementations.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Productivity

If existing complexity reduction methods are applied (reducing picture size or frame rate), then computation complexity is reduced, but visual quality degradation increases

Engineering Contradiction:
Improvecomputation efficiencyVSAvoidvisual quality
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent applies local quality by selectively adjusting complexity parameters within the video coding process rather than globally degrading quality. Instead of uniformly reducing picture size or frame rate, the system locally optimizes computation by adjusting specific coding tools (motion search window size, sub-pixel interpolation precision, deblocking filter strength) at appropriate locations in the coding pipeline, maintaining visual quality where possible while reducing complexity where beneficial.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11330293B2Scaling video processing complexity based on power savings factor
Publication Date: 2022.05.10 NXP USA INC
  • US11330293B2 patent drawing
  • US11330293B2 patent drawing
  • US11330293B2 patent drawing

AI summary

A method of scaling complexity of a video processing system including determining a power saving factor based on an operating parameter and adjusting processing of video information based on the power saving factor to reduce computation complexity. The operating parameter may include available power and/or available processing capacity. A method of complexity scalability for a video processing system using prioritized layered coding including determining a power saving factor based on one or more metrics, such as power capacity and/or available processing capacity, and reducing processing complexity of multiple prioritized coding functions in a predetermined order of priority based on the level of the power saving factor. A video processing system including a power management circuit which determines the power saving factor and a video encoder system which correspondingly adjusts computation complexity.