Video File Parameter Set Handling for Multi-Track Stream Access

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video file formats struggle with efficient decoding and resource utilization due to unnecessary handling of parameter sets across multiple tracks, leading to increased buffer space and computational effort.

Innovation Solution

A file format parser that inspects descriptive data to determine if parameter sets are required for joint decoding across multiple tracks, forwarding them only when necessary, thereby optimizing resource usage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If parameter sets are forwarded for all tracks in multi-track video files, then decoding compatibility is improved, but buffer space and computational effort increase

Engineering Contradiction:
Improvedecoding compatibilityVSAvoidbuffer space
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent extracts and removes unnecessary parameter sets from the multi-track video file structure. The system identifies which parameter sets are actually required for decoding specific tracks and eliminates redundant ones, thereby reducing buffer space requirements while maintaining decoding compatibility for necessary parameters

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent segments the parameter set handling by track, allowing selective forwarding of parameter sets based on individual track requirements rather than uniformly forwarding all parameter sets for all tracks. This segmentation enables precise control over which parameter sets are maintained in buffer space

Inventive Principle:
Principle #1Segmentation

2Reliability

If parameter sets are forwarded for all tracks in multi-track video files, then decoding compatibility is improved, but computational effort increases

Engineering Contradiction:
Improvedecoding compatibilityVSAvoidcomputational effort
Core Design Contradiction:
ReliabilityVSPower

Solution Approach 1:

The patent extracts and removes unnecessary parameter sets from the multi-track video file structure. The system identifies which parameter sets are actually required for decoding specific tracks and eliminates redundant ones, thereby reducing computational effort while maintaining decoding compatibility for necessary parameters

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies partial action by forwarding only the necessary subset of parameter sets required for each track's decoding rather than forwarding all parameter sets. This partial forwarding approach reduces computational effort while sufficient for maintaining decoding compatibility

Inventive Principle:
Principle #16Partial or excessive action

3Productivity

If a flexible file format concept is used to allow efficient extraction of video stream portions, then resource utilization is improved, but device complexity increases

Engineering Contradiction:
Improveresource utilizationVSAvoidfile format complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments the video file into distinct tracks, each with its own parameter set requirements. This segmentation enables efficient extraction of specific video stream portions by selectively processing only the necessary tracks and their associated parameter sets, improving resource utilization while managing complexity through structured organization

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary analysis of track dependencies and parameter set requirements during file parsing. By pre-identifying which parameter sets are needed for which tracks, the system prepares an optimized decoding plan that improves resource utilization during playback while avoiding the need for complex real-time decisions

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20250343936A1File format schemes allowing efficient roi, stream access and parameter set handling
Publication Date: 2025.11.06 FRAUNHOFER GESELLSCHAFT ZUR FORDERUNG DER ANGEWANDTEN FORSCHUNG EV
  • US20250343936A1 patent drawing
  • US20250343936A1 patent drawing
  • US20250343936A1 patent drawing

AI summary

File format concepts for video files are described. It is proposed to that descriptive data of a file indicates whether a parameter set for a track of a file is forwarded when jointly decoding a sub-stream of the track and a further track, and/or that a file includes, for a sub-stream of a video stream signaled in the file, an alternative parameter set to a parameter set for fully decoding the track, the alternative parameter set being for decoding the sub-stream, so as to allow for switching between multiple tracks of a file, and/or that step-wise stream access pictures of a track of a file are marked as stream access point pictures for accessing the track, and/or that a temporal length within which a decoder refresh in case of a joint decoding of sub-streams distributed over multiple tracks is indicated in a file, and/or that a file provides information from which it is derivable whether a pixel aspect ratio varies.