Video Decoding Toolset Extraction for Bitstream Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video coding technologies face challenges in efficiently decoding video streams without parsing the entire file, particularly in determining the required decoding tools for bitstreams conforming to standards like Essential Video Coding (EVC) within the ISO Base Media File Format (ISOBMFF).

Innovation Solution

Incorporating a toolset indication syntax element in the configuration record that identifies the necessary video decoding tools, allowing devices to determine if they can decode a file without parsing the majority of it, and using MIME type parameters to specify the required tools for decoding.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If a device parses the entire video file to determine required decoding tools, then complete information about decoding requirements is obtained, but processing time and computational resources are excessively consumed

Engineering Contradiction:
Improvedecoding tool informationVSAvoidprocessing time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The patent extracts the toolset indication syntax element from the configuration record, which is itself extracted from the video bitstream. This element contains only the necessary information about required decoding tools, separating it from the rest of the video data. The device retrieves only this specific extracted information rather than parsing the entire file, thus obtaining complete tool information while minimizing processing time.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The toolset indication syntax element is prepared in advance during video encoding and stored in the configuration record before the video is played back. This preliminary preparation allows the decoding device to quickly obtain tool requirements without performing extensive analysis during playback, resolving the contradiction between complete information acquisition and processing time.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If a device retrieves and processes the entire video bitstream to identify required tools, then accurate decoding capability determination is achieved, but device complexity and processing overhead increase

Engineering Contradiction:
Improvedecoding capability determinationVSAvoidprocessing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent extracts the toolset indication syntax element from the configuration record, which contains precise information about required decoding tools. This extracted element provides accurate decoding capability determination without requiring the device to process the entire complex bitstream structure, thus maintaining reliability while reducing processing complexity.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

Instead of processing the entire video bitstream (excessive action), the patent processes only the necessary toolset indication syntax element (partial action). This partial processing approach is sufficient to determine decoding capabilities accurately without the overhead of analyzing the complete bitstream, resolving the contradiction between reliability and device complexity.

Inventive Principle:
Principle #16Partial or excessive action

3Productivity

If video decoding tools are not properly identified before retrieval, then decoding efficiency is improved by avoiding unnecessary processing, but incorrect tools may be selected leading to decoding failures

Engineering Contradiction:
Improvedecoding efficiencyVSAvoiddecoding success
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent performs preliminary identification of required decoding tools by extracting and analyzing the toolset indication syntax element from the configuration record before retrieving the video bitstream. This preliminary action ensures that the correct tools are selected in advance, guaranteeing decoding success while avoiding unnecessary processing of incompatible formats, thus resolving the contradiction between efficiency and reliability.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The toolset indication syntax element provides feedback information about the required decoding tools, allowing the device to verify compatibility before full retrieval and processing. This feedback mechanism ensures that only appropriate video streams are processed with the available tools, maintaining both high efficiency and reliability by preventing futile decoding attempts.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11706460B2Storage and delivery of video data for video coding
Publication Date: 2023.07.18 QUALCOMM INC
  • US11706460B2 patent drawing
  • US11706460B2 patent drawing
  • US11706460B2 patent drawing

AI summary

A device for processing video data can be configured to receive a configuration record for decoding a bitstream of the video data, wherein the configuration record for the bitstream includes a toolset indication syntax element that includes information identifying, from a set of video decoding tools, tools that are required to decode the bitstream associated with the configuration record; based on the toolset indication syntax element, determine whether to retrieve the bitstream associated with the configuration record; and based on the determination to retrieve the bitstream associated with the configuration record, retrieve the bitstream and outputting the bitstream to a video decoder for decoding.