Bitstream Interruption Handling via Context Switching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image and video decoding technologies face difficulties in handling interruptions in compressed bitstreams, leading to incomplete data streams and challenges in resuming the decoding process effectively.

Innovation Solution

A data stream accessor compatible with context switching is implemented, allowing the decoder to pause and resume decoding by storing and restoring execution contexts, enabling seamless handling of interruptions and partial data streams without affecting the decoder's operation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the decoder waits for complete bitstream data before decoding, then decoding accuracy is improved, but decoding speed and responsiveness deteriorate

Engineering Contradiction:
Improvedecoding accuracyVSAvoiddecoding speed
Core Design Contradiction:
Measurement precisionVSSpeed

Solution Approach 1:

The decoder performs preliminary decoding operations on available data portions before receiving complete bitstream data. The execution context is saved and restored to continue decoding later, allowing partial decoding to proceed in advance rather than waiting for complete data arrival.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The bitstream is divided into decodable portions that can be processed independently. The decoder processes available segments separately, saving execution context between segments, rather than requiring the entire bitstream to be available before starting decoding.

Inventive Principle:
Principle #1Segmentation

2Adaptability or versatility

If the decoder handles bitstream interruptions frequently, then adaptability to network conditions is improved, but system complexity increases

Engineering Contradiction:
Improveadaptability to interruptionsVSAvoiddecoder complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

An execution context saving/restoring mechanism acts as an intermediary between the decoder and interruptions. This intermediary layer handles the complexity of state management, allowing the decoder to pause and resume without requiring complex interruption handling logic throughout the decoding pipeline.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The decoder automatically saves and restores its own execution context without external intervention. The system self-manages the pausing and resuming of decoding operations, reducing the need for external control mechanisms and simplifying the overall system architecture.

Inventive Principle:
Principle #25Self-service

3Productivity

If the decoder processes data continuously without pausing, then productivity is improved, but reliability during interruptions deteriorates

Engineering Contradiction:
Improvedecoding throughputVSAvoidhandling reliability
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The decoding process dynamically adjusts between continuous operation and pausing based on data availability. The decoder transitions smoothly between processing states and idle states, maintaining high productivity when data is available while reliably handling interruptions when data arrives intermittently.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The decoder maintains continuous useful action by processing available data portions immediately rather than waiting. Execution context is preserved to enable seamless continuation, ensuring that decoding productivity is maximized during data availability while maintaining reliability during interruptions.

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentUS11475601B2Image decoding during bitstream interruptions
Publication Date: 2022.10.18 GOOGLE LLC
  • US11475601B2 patent drawing
  • US11475601B2 patent drawing
  • US11475601B2 patent drawing

AI summary

A data stream accessor seeks to simulate an uninterrupted bitstream for a decoder during network interruptions. The accessor performs a set of operations including receiving an available amount of image data and storing a current execution context of the call site, passing execution flow to the decoder, and performing a subset of operations. The subset includes receiving an indication of a desired amount of image data from the decoder. If a total amount of image data at the accessor is greater than or equal to the desired amount, the desired amount is transmitted to the decoder for decoding. Otherwise, and unless an error issues, a current execution context of the decoder is stored, execution flow is passed from the decoder to the call site, and the restorable execution context is loaded as the current execution context of the call site. The subset is repeated unless the image is completely decoded.