Video Decoding Feedback Circuit for Encoding Indicator Availability

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video encoding and decoding methods, such as VP9, face challenges in ensuring consistent availability of encoding indicators across frames, leading to potential gaps in decoding information, especially when encoding indicators are disabled or default for certain frames, which can impact the decoding process and video quality.

Innovation Solution

The method involves parsing and feeding back encoding information, including motion vectors and segment IDs, for each frame to ensure that encoding indicators are always available for subsequent frames, even when they are not explicitly encoded, by using indicators from previous frames when necessary, and combining this information into a single stream for efficient processing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of substance

If encoding indicators are disabled or defaulted for certain frames to reduce data transmission, then file size reduction is improved, but decoding reliability deteriorates due to potential gaps in decoding information

Engineering Contradiction:
Improvefile sizeVSAvoiddecoding reliability
Core Design Contradiction:
Loss of substanceVSReliability

Solution Approach 1:

The patent applies preliminary action by generating and storing encoding indicators for all frames in advance, including frames where they would normally be disabled or defaulted. This ensures that decoding information is always available without increasing the transmitted file size, as the indicators are prepared beforehand and only retrieved when needed during decoding.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces an intermediary mechanism (the encoding indicator map or segment map) that mediates between the encoded video data and the decoding process. This intermediary structure allows the system to provide decoding information on-demand without including it in every frame's data stream, thus reducing file size while maintaining decoding reliability through selective retrieval from the intermediary storage.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If encoding indicators are provided for every frame to ensure decoding availability, then decoding reliability is improved, but device complexity increases

Engineering Contradiction:
Improvedecoding availabilityVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies segmentation by dividing encoding indicators into frame-specific segments and global segments. Frame-specific indicators are provided only when necessary for each frame, while global indicators apply to multiple frames. This segmented approach ensures decoding availability without requiring full encoding indicator sets for every frame, thereby reducing system complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements universality by creating encoding indicator structures that can serve multiple functions: they can be used for current frame decoding, stored for future frame reference, or selectively applied based on decoding needs. This multi-functional design allows a single encoding indicator set to serve various purposes across different frames, reducing the overall complexity while maintaining reliability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Productivity

If encoding indicators are stored in memory for all frames, then decoding efficiency is improved, but memory storage requirements increase

Engineering Contradiction:
Improvedecoding efficiencyVSAvoidmemory storage
Core Design Contradiction:
ProductivityVSQuantity of substance

Solution Approach 1:

The patent applies dynamics by implementing a dynamic memory management system for encoding indicators. Instead of statically allocating memory for all possible indicators, the system dynamically allocates and retrieves indicators based on actual decoding needs. Indicators are loaded into memory only when required for specific frames, allowing efficient decoding while minimizing memory storage requirements through on-demand retrieval.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent implements discarding and recovering by selectively discarding encoding indicators from memory after they have been used for decoding, and recovering (re-loading) them only when needed for subsequent frames. This approach maintains high decoding efficiency by having indicators readily available when needed, while reducing memory storage by discarding unused indicators, creating an efficient cycle of allocation and release.

Inventive Principle:
Principle #34Discarding and recovering

Data Source

PatentUS10609408B2Video data processing system using encoding information derived from a previous frame in a sequence of video frames
Publication Date: 2020.03.31 ARM LTD
  • US10609408B2 patent drawing
  • US10609408B2 patent drawing
  • US10609408B2 patent drawing

AI summary

An apparatus for decoding a sequence of frames of encoded video data includes parsing circuitry configured to parse the encoded video image data for a frame to derive encoding information for each block of the frame. The apparatus also includes feedback circuitry configured to feed back, to the parsing circuitry, encoding information for a frame for use when parsing the encoded video image data of the next frame. The encoding information includes an encoding indicator for each block. When the encoding indicators were enabled when encoding the blocks of the frame, the encoding indicator fed back for a block is the encoding indicator that was used to encode that block. When the encoding indicators for the blocks of the frame were disabled when encoding the video image data for the frame, the encoding indicator fed back for a block is an encoding indicator derived from a previous frame.