Video File Encapsulation With Temporal Layer Metadata
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video encoding technologies do not effectively indicate temporal layer information in encoded bitstreams, leading to high computational resource usage and incompatibility with network devices lacking decoding algorithms, hindering efficient video transmission and decoding.
Innovation Solution
A file encapsulation method that includes indicating temporal layer information in the encapsulated file, allowing devices to obtain this information without decoding the bitstream, thereby reducing computational load and enabling efficient transmission and decoding processes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If temporal layer information is embedded in the encoded bitstream, then measurement precision of temporal structure is improved, but device complexity increases due to decoding requirements
Solution Approach 1:
The patent extracts temporal layer information from the encoded bitstream and places it in the encapsulated file format (e.g., MP4, MKV) metadata sections. This separation allows devices to access temporal layer information directly from the container format without needing to decode the video bitstream, thereby reducing decoding complexity while maintaining precise temporal structure indication.
Solution Approach 2:
The encapsulated file format acts as an intermediary between the encoded bitstream and the playback device. It carries temporal layer information in its metadata structure, serving as a mediator that provides this information to devices without requiring them to perform complex decoding operations on the video data itself.
2Loss of information
If full encoded bitstream is transmitted, then information completeness is improved, but network transmission load increases
Solution Approach 1:
The patent extracts only the essential temporal layer information from the full encoded bitstream and embeds it in the encapsulated file. This selective extraction maintains the necessary information for temporal structure understanding while significantly reducing the data volume that needs to be transmitted over the network.
Solution Approach 2:
The patent segments the video data structure into separate components: the encoded video bitstream and the temporal layer information metadata. This segmentation allows the temporal information to be carried independently in the container format, enabling efficient transmission where only the essential temporal structure data needs to be communicated separately from the full video data.
3Measurement precision
If decoding is performed to obtain temporal layer information, then measurement precision is improved, but computational resource consumption increases
Solution Approach 1:
The patent extracts temporal layer information and stores it in the encapsulated file format metadata, allowing playback devices to read this information directly without performing decoding operations. This extraction approach maintains accurate temporal layer information while eliminating the computational overhead of decoding video bitstreams solely to obtain temporal structure data.
Solution Approach 2:
The temporal layer information is prepared and embedded in the encapsulated file format during the encoding and containerization phase, before transmission and playback. This preliminary action ensures that the information is readily available in an accessible format, eliminating the need for computational decoding operations at playback time and reducing energy consumption.
Data Source
AI summary
A file encapsulation method and apparatus, a file transmission method and apparatus, a file decoding method and apparatus, an electronic device, and a storage medium. The file encapsulation method includes: obtaining an encoded target video and temporal layer information of samples determined during encoding of the target video, encapsulating the encoded target video according to the temporal layer information of the samples to generate a first encapsulated file, the first encapsulated file including the temporal layer information of the samples, and transmitting the first encapsulated file to a first device.