Video Decoder Adaptability Latency Memory

Solution Overview

Problem

Decoding video data encoded at multiple bit rates with changing encoding factors introduces significant latency and increased memory usage due to frequent reinitialization of the video decoder and memory allocation requirements.

Innovation Solution

A video processing system that configures the video decoder to change decoding factors without reinitialization and reduces memory utilization by using an array of textures, allowing efficient switching between different encoding formats and contexts.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the video decoder reinitializes when encoding factors change, then the decoder can adapt to new encoding formats, but significant latency is introduced and memory resources are consumed

Engineering Contradiction:

Improveadapter to encoding factor changesVSAvoiddecoding latency

Core Design Contradiction:

Adaptability or versatilityVSLoss of time

Solution Approach 1:

The patent applies preliminary action by pre-allocating memory resources for multiple encoding formats before format changes occur. The system maintains pre-configured decoding contexts and memory buffers for different encoding factors, allowing the decoder to switch between formats without reinitialization. This eliminates the need to wait for full reinitialization when encoding factors change, thereby reducing latency while maintaining adaptability.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent implements dynamics by enabling the video decoder to dynamically switch between different encoding contexts without complete reinitialization. The decoder maintains multiple active decoding contexts that can be dynamically activated based on the current encoding factors, allowing flexible adaptation to changing formats while preserving decoding state and avoiding the time penalty of full reinitialization.

Inventive Principle:

Principle #15Dynamics

2Adaptability or versatility

If the video decoder reinitializes when encoding factors change, then the decoder can adapt to new encoding formats, but additional memory resources are consumed

Engineering Contradiction:

Improveadapter to encoding factor changesVSAvoidmemory resources

Core Design Contradiction:

Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The patent applies preliminary action by pre-allocating memory resources for multiple encoding formats before format changes occur. The system maintains pre-configured decoding contexts and memory buffers for different encoding factors, allowing the decoder to switch between formats without reinitialization. This eliminates the need to wait for full reinitialization when encoding factors change, thereby reducing latency while maintaining adaptability.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent implements universality by designing a memory management system where a single memory pool serves multiple encoding contexts. The decoder uses a unified memory structure that can accommodate different encoding factors through virtual addressing and context switching, rather than allocating separate physical memory for each format. This multi-functional memory approach reduces overall memory consumption while maintaining the ability to handle various encoding formats.

Inventive Principle:

Principle #6Universality (Multi-functionality)

3Productivity

If the video decoder stores encoded bitstream in memory while decoding, then decoding can continue without interruption, but memory utilization increases

Engineering Contradiction:

Improvecontinuous decoding capabilityVSAvoidmemory utilization

Core Design Contradiction:

ProductivityVSQuantity of substance

Solution Approach 1:

The patent applies segmentation by dividing the encoded bitstream into smaller decode-ready units and processing them in segments. Instead of loading the entire bitstream into memory, the system decodes data in manageable chunks, maintaining only the currently active decoding context and recent frames in memory. This segmented approach enables continuous decoding while minimizing memory utilization by discarding or compressing older data that is no longer needed.

Inventive Principle:

Principle #1Segmentation

Data Source

PatentUS9832476B2Multiple bit rate video decoding

Publication Date: 2017.11.28 MICROSOFT TECHNOLOGY LICENSING LLC

AI summary

In a video processing system including a video decoder, to handle frequent changes in the bit rate of an encoded bitstream, a video decoder can be configured to process a change in bit rates without reinitializing. The video decoder can be configured to reduce memory utilization. The video decoder can be configured both to process a change in bit rate without reinitializing while reducing memory utilization. In one implementation, the video processing system can include an interface between an application running on a host processor and the video decoder which allows the video decoder to communicate with the host application about the configuration of the video decoder.