Adaptive Multimedia Streaming Using Energy Indices

Solution Overview

Problem

Current adaptive streaming methods for multimedia content on mobile terminals primarily rely on resolution and bitrate, failing to adequately address energy consumption, which limits the reactivity and efficiency of battery-operated devices in managing energy usage during video playback.

Innovation Solution

A method that calculates and uses energy indices to optimize multimedia stream decoding, independent of the coder and processor, by determining the Power Saving Ratio (PSR) and Decoding Operation Ratio (DOR) to select representations based on energy consumption, allowing for dynamic adjustment of playback quality and energy management.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If adaptive streaming methods use resolution and bitrate as selection criteria, then video quality is improved, but energy consumption increases

Engineering Contradiction:

Improvevideo qualityVSAvoidenergy consumption

Core Design Contradiction:

Manufacturing precisionVSUse of energy by moving object

Solution Approach 1:

The patent introduces energy consumption as a new parameter for stream selection, alongside resolution and bitrate. By calculating energy indices for different video representations and using them as a selection criterion, the system dynamically adjusts the balance between video quality and energy consumption based on terminal battery status, thereby resolving the contradiction between improving video quality and reducing energy usage

Inventive Principle:

Principle #35Parameter changes

Solution Approach 2:

The system dynamically adapts the stream selection strategy based on real-time terminal conditions. The energy index calculation and stream selection are performed dynamically during playback, allowing the terminal to adjust between quality and energy saving modes according to changing battery levels and user needs, thus resolving the static quality-energy trade-off

Inventive Principle:

Principle #15Dynamics

2Manufacturing precision

If high bitrate and high resolution segments are downloaded, then decoding complexity increases, but video quality improves

Engineering Contradiction:

Improvevideo qualityVSAvoiddecoding complexity

Core Design Contradiction:

Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent introduces energy consumption as a new parameter for stream selection, alongside resolution and bitrate. By calculating energy indices for different video representations and using them as a selection criterion, the system dynamically adjusts the balance between video quality and energy consumption based on terminal battery status, thereby resolving the contradiction between improving video quality and reducing energy usage

Inventive Principle:

Principle #35Parameter changes

Solution Approach 2:

The system dynamically adapts the stream selection strategy based on real-time terminal conditions. The energy index calculation and stream selection are performed dynamically during playback, allowing the terminal to adjust between quality and energy saving modes according to changing battery levels and user needs, thus resolving the static quality-energy trade-off

Inventive Principle:

Principle #15Dynamics

3Use of energy by moving object

If processor frequency and supply voltage are adjusted dynamically, then energy consumption is optimized, but system reactivity decreases

Engineering Contradiction:

Improveenergy consumptionVSAvoidsystem reactivity

Core Design Contradiction:

Use of energy by moving objectVSSpeed

Solution Approach 1:

The server pre-calculates and provides energy indices for different video representations before playback begins. This preliminary action allows the terminal to make informed stream selection decisions without needing to perform complex real-time energy calculations, thereby optimizing energy consumption while maintaining system reactivity

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The energy index acts as an intermediary parameter that bridges the gap between video representation characteristics and terminal energy constraints. Instead of directly adjusting processor frequency and voltage based on complex real-time analysis, the system uses the pre-computed energy index as a mediator to guide stream selection, simplifying the control mechanism while achieving energy optimization

Inventive Principle:

Principle #24Intermediary (Mediator)

Data Source

PatentUS10097889B2Method of adaptive broadcasting of multimedia streams by using an energy index

Publication Date: 2018.10.09 HARMONIC INC

AI summary

Method of adaptive broadcasting of multimedia data streams Fi originating from a service provider (20), during a download between a reception terminal (40) and a server (30), as a function of an energy criterion, comprising the following steps:determining, for N representations Fi, at least one first energy index by calculating, for each of the representations Fi of a multimedia segment, a value of energy Ei(t) consumed to decode the representation Fi at the instant t, the maximum energy value Emax(t) associated with the most energy-consuming representation, and the values of the ratios correspondingEi⁡(t)EMax⁡(t) storing these values in a file associating with a representation Fi at least one ratioEi⁡(t)EMax⁡(t),measuring the consumption of energy used by the terminal in the course of the playback of the representation Fi, and choosing another representation Fj or altering the quality of playback of the representation if the energy reserve of the terminal is insufficient to play back the content of the multimedia data stream on the basis of the representation Fi.