Video Decoding Adaptation for Energy Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The increasing energy consumption of information and communication technologies, particularly in data centers and media content delivery, poses a challenge as it contributes significantly to global energy consumption and carbon footprint, necessitating innovative methods to reduce energy usage without compromising user experience.

Innovation Solution

A video processing system that adapts media processing operations based on environmental conditions, such as viewing distance, angle, and ambient light, by adjusting filtering strengths, motion compensation, and prediction modes, to minimize energy consumption while maintaining quality of experience.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If video decoding is performed with high processing quality (full filtering, motion compensation, prediction modes), then video quality is improved, but energy consumption increases

Engineering Contradiction:
Improvevideo qualityVSAvoidenergy consumption
Core Design Contradiction:
Manufacturing precisionVSUse of energy by moving object

Solution Approach 1:

The patent implements dynamic adaptation of decoding processing based on viewing conditions. The system adjusts filtering strength, motion compensation accuracy, and prediction mode complexity in real-time according to detected parameters such as viewing distance, screen size, and ambient light levels. This allows the decoder to transition between high-quality and energy-efficient processing modes, resolving the contradiction between maintaining video quality and reducing energy consumption.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes multiple decoding parameters simultaneously based on viewing conditions: filtering strength (e.g., loop filter intensity), motion compensation precision (e.g., motion vector accuracy), and prediction mode selection (e.g., intra vs. inter prediction). By coordinating changes across these parameters, the system achieves significant energy reduction while maintaining perceptual video quality appropriate for the specific viewing scenario.

Inventive Principle:
Principle #35Parameter changes

2Use of energy by moving object

If adaptive decoding is implemented based on viewing conditions, then energy consumption is reduced, but device complexity increases

Engineering Contradiction:
Improveenergy consumptionVSAvoiddevice complexity
Core Design Contradiction:
Use of energy by moving objectVSDevice complexity

Solution Approach 1:

The patent divides the adaptive decoding system into separate functional modules: a viewing condition detection module that senses environmental parameters, a decision module that determines appropriate decoding adjustments based on detected conditions, and an execution module that applies specific decoding parameter changes. This segmentation allows each component to remain relatively simple while the integrated system achieves energy efficiency through coordinated adaptation.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The decoding system performs self-adaptation by automatically detecting viewing conditions and adjusting its own processing parameters without external control. The decoder monitors its own energy consumption patterns and viewing environment, then autonomously modifies filtering, motion compensation, and prediction operations to optimize the balance between quality and power usage.

Inventive Principle:
Principle #25Self-service

3Use of energy by moving object

If viewing conditions are monitored and processing is adapted in real-time, then energy efficiency is improved, but measurement precision requirements increase

Engineering Contradiction:
Improveenergy efficiencyVSAvoidviewing condition detection accuracy
Core Design Contradiction:
Use of energy by moving objectVSMeasurement precision

Solution Approach 1:

The patent implements partial monitoring of viewing conditions by focusing on the most impactful parameters (such as ambient light level and basic viewing distance estimation) rather than attempting to measure all possible viewing aspects with high precision. The system accepts approximate measurements for less critical parameters and uses threshold-based detection for key parameters, achieving sufficient energy efficiency improvements without requiring ultra-precise measurement systems.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS20240357113A1Systems and methods for processing video content based on viewing conditions
Publication Date: 2024.10.24 INTERDIGITAL CE PATENT HOLDINGS SAS
  • US20240357113A1 patent drawing
  • US20240357113A1 patent drawing
  • US20240357113A1 patent drawing

AI summary

Systems, methods, and instrumentalities are disclosed for adapting media (e.g., video) processing operations and/or parameters based on one or more viewing conditions in a media environment (e.g., to achieve power saving). Such viewing conditions may include a distance between a display device and a viewer, a viewpoint or viewing direction of the viewer towards the display device, and/or an ambient light level in the media environment. Aspects of the medical processing that may be adapted based on the viewing conditions may be associated with deblocking, sample adaptive offset (SAO) filtering, adaptive loop filtering (ALF), cross component adaptive loop filtering (CCALF), motion compensation, post-inter prediction processing, bi-prediction, residual scaling, luma mapping, chroma residual scaling (LMCS), geometric block partitioning, HDR signal reconstruction, etc.