Layered Video Coding for Mobile Power and Quality

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional video processing systems for mobile devices are inadequate for adapting to the unique viewing environments of handheld devices, as they often rely on techniques suited for stationary devices and do not efficiently manage video content transmission and decoding for mobile use.

Innovation Solution

A video processing system that employs layered video coding, where a video stream is encoded into an independent video layer stream and one or more dependent video layer streams, allowing for flexible decoding modes based on device parameters and channel characteristics, enabling efficient transmission and decoding of video content on mobile devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If conventional video processing systems are used for mobile devices, then video transmission and decoding can be performed, but the systems are not adapted to mobile viewing environments and consume excessive power

Engineering Contradiction:
Improveadaptation to mobile viewing environmentVSAvoidpower consumption
Core Design Contradiction:
Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

The video stream is divided into an independent video layer stream and one or more dependent video layer streams. The independent layer contains essential video data that can be decoded alone, while dependent layers contain additional data for enhanced quality. This segmentation allows the system to transmit and decode only the necessary independent layer on mobile devices with limited resources, reducing power consumption while maintaining basic viewing capability, and optionally add dependent layers when conditions permit.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system dynamically selects which video layer streams to transmit and decode based on real-time assessment of mobile device parameters (such as processing capability, display resolution) and channel characteristics (signal strength, interference). This dynamic adaptation allows the system to optimize power consumption by using simpler decoding modes on battery-powered devices while maintaining high quality when conditions allow.

Inventive Principle:
Principle #15Dynamics

2Measurement precision

If video streams are transmitted with full quality for mobile devices, then viewing quality is maintained, but transmission bandwidth and processing requirements exceed mobile device capabilities

Engineering Contradiction:
Improvevideo qualityVSAvoiddecoding complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The video stream is segmented into independent and dependent layers, allowing mobile devices to decode only the independent layer which provides basic viewing quality without requiring complex processing. The dependent layers containing enhancement data are optionally decoded only when device capabilities and channel conditions permit, thus maintaining quality flexibility without forcing high complexity decoding.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system changes the decoding parameters and selected video layers based on assessed device parameters (resolution, frame rate capabilities) and channel characteristics. When channel conditions are poor or device resources are limited, the system uses parameter changes to select lower quality independent layers only, reducing decoding complexity while maintaining acceptable viewing quality.

Inventive Principle:
Principle #35Parameter changes

3Adaptability or versatility

If video layer streams are transmitted over wireless channels, then flexible transmission is achieved, but channel errors and interference affect transmission reliability

Engineering Contradiction:
Improvetransmission flexibilityVSAvoidtransmission reliability
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

By segmenting the video stream into independent and dependent layers, the system ensures that the independent layer contains sufficient data for acceptable quality viewing even when transmitted over error-prone wireless channels. This segmentation provides transmission flexibility because the system can adapt which layers to transmit based on channel conditions, while reliability is maintained through the self-contained nature of the independent layer that does not require dependent layers for basic decoding.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The independent video layer is designed to provide sufficient video quality on its own without requiring dependent layers, acting as a cushion against channel errors. This beforehand cushioning ensures that even when wireless transmission introduces errors or when bandwidth is limited, the basic viewing experience remains reliable and acceptable.

Inventive Principle:
Principle #11Beforehand cushioning (Prior cushioning)

4Adaptability or versatility

If multiple video layer streams are transmitted, then quality adaptation is enabled, but transmission time and processing overhead increase

Engineering Contradiction:
Improvequality adaptation capabilityVSAvoidtransmission time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The video stream is segmented into an independent layer and dependent layers, allowing the system to transmit only the independent layer when time is constrained or bandwidth is limited. Quality adaptation is enabled by optionally transmitting dependent layers that provide enhancement data, but the independent layer ensures basic viewing is available immediately without waiting for additional layers, thus reducing transmission time while maintaining adaptability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system uses partial action by transmitting and decoding only the independent layer when time or bandwidth resources are limited, rather than transmitting all video layers. This partial decoding approach reduces transmission time and processing overhead while still providing acceptable viewing quality. The dependent layers are transmitted only when time permits, achieving quality adaptation without excessive time consumption.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS10070108B2Video processing system with layered video coding and methods for use therewith
Publication Date: 2018.09.04 AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE LTD
  • US10070108B2 patent drawing
  • US10070108B2 patent drawing
  • US10070108B2 patent drawing

AI summary

A video processing system includes a video encoder that encodes a video stream into an independent video layer stream and a first dependent video layer stream based on a motion vector data or grayscale and color data.