Hierarchical Video Encoding Time Information Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data transmission methods fail to accurately specify the decoding time of access units in extended layers, leading to increased processing load and inefficiency in rearranging data for decoding and display.
Innovation Solution
A data transmission method that includes time information in the encoded stream, allowing for the specification of decoding and display processing times for both basic and extended layers, enabling independent decoding and display of access units based on reference clocks.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If time information is not included in the encoded stream, then the data structure remains simple, but the decoding time and display time of access units cannot be accurately specified
Solution Approach 1:
The time information is segmented into two distinct types: first time information for basic layer access units and second time information for extended layer access units. This segmentation allows precise time specification for each layer independently, resolving the contradiction between measurement precision and data structure complexity by organizing time data in a structured, layered manner that mirrors the video encoding structure.
Solution Approach 2:
Time information is embedded in the encoded stream during the encoding phase, before transmission and decoding. This preliminary action ensures that both basic layer and extended layer access units carry their respective time information (first time information and second time information) in advance, enabling accurate time specification without requiring complex post-processing or additional signaling mechanisms.
2Adaptability or versatility
If hierarchical encoding with multiple layers is implemented, then video scalability is achieved, but the processing load for rearranging and decoding data increases
Solution Approach 1:
The system dynamically adapts to different decoding scenarios by providing separate time information for each layer. Receivers can selectively process only the time information relevant to their decoding capabilities (basic layer only or both basic and extended layers), enabling scalable performance from low-complexity to high-complexity decoding without requiring complete processing of all layer data, thus improving productivity while maintaining adaptability.
Solution Approach 2:
Access units from both basic layer and extended layer are pre-arranged in decoding order within the encoded stream, with their respective time information (first time information for basic layer, second time information for extended layer) embedded in advance. This preliminary arrangement eliminates the need for complex runtime rearranging operations, significantly reducing processing load while preserving video scalability across different receiver capabilities.
3Productivity
If access units are arranged in transmission order, then transmission efficiency is improved, but decoding order rearrangement becomes necessary and complex
Solution Approach 1:
Access units are pre-arranged in decoding order during the encoding phase, with first time information and second time information embedded to indicate their respective decoding times. This preliminary arrangement allows receivers to directly process access units in the correct decoding sequence without requiring complex runtime rearrangement operations, simultaneously improving transmission efficiency and reducing processing complexity by eliminating the need for separate rearrangement stages.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A transmission method for transmitting encoded data obtained by hierarchically encoding a video image includes: generating an encoded stream that includes time information and the encoded data, the time information indicating a time at which decoding or displaying processing of the encoded data is performed, and transmitting the generated encoded stream, wherein the encoded data includes a plurality of sets each including a plurality of access units and the time information includes first time information which indicates a time at which the processing performed on a first access unit of the first set is performed and which is based on a reference clock, and second time Information used to specify a time at which the processing performed on a second access unit of the second set is performed and which is based on the reference clock.