Video File Format Parameter Handling for ROI Stream Access
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video file formats lack flexibility in handling sub-streams and parameter sets, leading to inefficient decoding and resource utilization, particularly when multiple tracks are involved, and do not allow for dynamic extraction of regions of interest or varying pixel aspect ratios.
Innovation Solution
A file format parser that determines whether parameter sets for specific tracks are required during joint decoding of sub-streams across multiple tracks, forwarding them only when necessary, and identifies non-random access points for efficient decoding and dynamic pixel aspect ratio handling.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If parameter sets are always forwarded for joint decoding of sub-streams across multiple tracks, then decoding compatibility is maintained, but buffer space and computational resources are wasted
Solution Approach 1:
The patent changes the parameter of parameter set forwarding from a static always-forward approach to a dynamic condition-based approach. The parser inspects descriptive data to determine whether parameter sets should be forwarded, changing the system behavior based on the decoded state of track identifiers and sub-stream distribution patterns. This resolves the contradiction by adapting resource allocation to actual decoding needs.
Solution Approach 2:
The file format parser performs self-inspection of descriptive data within the file to autonomously determine whether parameter sets should be forwarded for joint decoding. By embedding the decision logic within the parser itself, the system eliminates the need for external control mechanisms and automatically optimizes resource usage based on the file's own structural information.
2Productivity
If parameter sets are selectively ignored based on descriptive data inspection, then resource efficiency improves, but decoder complexity increases
Solution Approach 1:
The patent applies preliminary action by having the parser inspect descriptive data and determine parameter set forwarding requirements before the actual joint decoding process begins. This advance determination allows the decoder to be simpler, as it receives pre-processed information about which parameter sets to use, eliminating the need for complex runtime decisions during decoding.
3Reliability
If all parameter sets are processed during joint decoding, then complete video stream decoding is ensured, but processing time increases
Solution Approach 1:
The patent extracts only the necessary parameter sets from the complete set of available parameter sets. By inspecting descriptive data to identify which parameter sets are actually required for joint decoding of distributed sub-streams, the system removes unnecessary processing steps and focuses computational effort only on essential parameters, thereby reducing processing time while maintaining complete decoding capability.
Data Source
AI summary
File format concepts for video files are described. It is proposed to that descriptive data of a file indicates whether a parameter set for a track of a file is forwarded when jointly decoding a sub-stream of the track and a further track, and/or that a file includes, for a sub-stream of a video stream signaled in the file, an alternative parameter set to a parameter set for fully decoding the track, the alternative parameter set being for decoding the sub-stream, so as to allow for switching between multiple tracks of a file, and/or that step-wise stream access pictures of a track of a file are marked as stream access point pictures for accessing the track, and/or that a temporal length within which a decoder refresh in case of a joint decoding of sub-streams distributed over multiple tracks is indicated in a file, and/or that a file provides information from which it is derivable whether a pixel aspect ratio varies.