Video Coding Error Propagation Distortion Map

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video encoding technologies face challenges in balancing bitrate and distortion, particularly in real-time video streaming where computational and memory resources are limited, leading to high complexity and resource demands.

Innovation Solution

A method for encoding video streams that optimizes encoding modes by using an error propagation distortion map with simplified calculations, assuming zero motion to reduce computational complexity and memory requirements, while maintaining acceptable quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional error propagation distortion calculation methods are used, then measurement precision of distortion is improved, but device complexity increases

Engineering Contradiction:
Improvedistortion measurement precisionVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent uses simplified, disposable approximation methods for distortion calculation that do not require maintaining complex historical distortion maps. Instead of using elaborate weighted sum calculations across multiple reference blocks, the invention employs straightforward distortion measures that can be computed independently for each block, sacrificing some precision for dramatically reduced complexity.

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

Solution Approach 2:

The patent changes the parameters of distortion calculation by using simplified distortion measures and assuming zero motion for error propagation. This transforms the complex multi-parameter weighted calculation into a simpler single-parameter approach, reducing computational burden while maintaining acceptable performance for real-time encoding.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If traditional error propagation distortion calculation methods are used, then measurement precision of distortion is improved, but use of energy increases

Engineering Contradiction:
Improvedistortion measurement precisionVSAvoidcomputational energy
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent employs inexpensive, disposable distortion calculation methods that require minimal computational energy. By avoiding the maintenance of complex historical distortion maps and using simple independent block-wise calculations, the energy consumption is dramatically reduced while still providing sufficient distortion measurement for mode selection.

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

Solution Approach 2:

The patent transforms the energy-intensive multi-parameter distortion calculation into a low-energy single-parameter approach by assuming zero motion and using simplified distortion measures. This parameter change enables real-time encoding on resource-constrained devices with limited energy budgets.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If traditional error propagation distortion calculation methods are used, then measurement precision of distortion is improved, but device memory requirements increase

Engineering Contradiction:
Improvedistortion measurement precisionVSAvoidmemory resources
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent extracts only the essential distortion information needed for mode selection, discarding the complex historical distortion map data. By taking out only the necessary current block distortion measurement and assuming zero motion for error propagation, the patent eliminates the need to store and process large amounts of historical distortion data, significantly reducing memory requirements.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent uses disposable, lightweight distortion measurements for each block independently rather than maintaining persistent complex distortion maps in memory. This approach uses minimal memory resources while still providing sufficient information for encoding mode selection.

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

Data Source

PatentUS8804836B2Video coding
Publication Date: 2014.08.12 MICROSOFT TECHNOLOGY LICENSING LLC
  • US8804836B2 patent drawing
  • US8804836B2 patent drawing
  • US8804836B2 patent drawing

AI summary

A method comprising: for each target image portion to be encoded in a frame, selecting one of a set of encoding modes by optimizing a function comprising an estimate of distortion for the target image portion and a measure of bit rate required to encode the target image portion, encoding the target image portion into the encoded video stream using the selected mode. The encoded video stream is transmitted over a lossy channel. An error propagation distortion map is maintained, which comprises a plurality of error propagation distortion values mapping to respective frame partitions, the error propagation distortion values being based on previous encoding mode selections. The estimate of distortion used to select the encoding mode for each of the target image portions is based on a corresponding portion from the error propagation distortion map, and that corresponding portion is constrained to being co-located with the target image portion.