Video Decoder Memory Optimization via Residual Coefficient Extraction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Media content decoding consumes large amounts of memory resources on viewer devices, making it challenging for older or low-memory devices to play back high-quality video content efficiently.

Innovation Solution

The technique involves encoding media content using a reduced residual coefficient matrix, where only non-zero coefficients from the frequency domain are stored, along with metadata indicating the size of the full matrix, allowing decoders to select appropriate inverse transform matrices for efficient reconstruction, thereby reducing memory and computational requirements.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional decoding algorithms are used to reconstruct media content, then video quality is maintained, but memory resources are excessively consumed

Engineering Contradiction:
Improvevideo qualityVSAvoidmemory resources
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent extracts and removes zero coefficients from the residual coefficient matrix, storing only non-zero coefficients. This extraction principle directly reduces the memory resources required for decoding while maintaining the ability to reconstruct video content of acceptable quality, as the removed zero coefficients do not contribute to the final output.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies partial action by using only the necessary portion of the transform matrix required for reconstruction. Instead of always applying the full-size inverse transform matrix, the system selectively applies only the needed coefficients and matrix portions, reducing memory usage while maintaining reconstruction capability.

Inventive Principle:
Principle #16Partial or excessive action

2Measurement precision

If full residual coefficient matrices are stored and processed, then complete reconstruction accuracy is achieved, but device complexity increases

Engineering Contradiction:
Improvereconstruction accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts only the essential non-zero coefficients from the residual matrix, removing unnecessary zero coefficients. This reduces processing complexity by decreasing the number of elements that need to be stored, transmitted, and processed, while still achieving sufficient reconstruction accuracy for the application.

Inventive Principle:
Principle #2Taking out (Extraction)

3Measurement precision

If larger transform matrices are used for decoding, then reconstruction quality improves, but processing time increases

Engineering Contradiction:
Improvereconstruction qualityVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent applies partial action by using only the necessary portion of the transform matrix required for reconstruction. Instead of always applying the full-size inverse transform matrix, the system selectively applies only the needed coefficients and matrix portions, reducing processing time while maintaining reconstruction capability.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11418802B2Video decoder memory optimization
Publication Date: 2022.08.16 AMAZON TECH INC
  • US11418802B2 patent drawing
  • US11418802B2 patent drawing
  • US11418802B2 patent drawing

AI summary

Techniques are described for optimizing video decoder operations.