Video Packet Header Frame ID Extraction for XR Decoding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video transmission technologies face challenges in efficiently processing and managing video data packets, particularly in extended reality (XR) media services, due to the lack of direct access to payload data and the need for accurate identification of video frames and dependencies within packets, which affects decoding and resource allocation in network devices.
Innovation Solution
Incorporating video frame identifiers, such as picture order count (POC) values and temporal layer identifiers, into packet headers allows network devices to determine frame dependencies and prioritize packet processing, enabling efficient decoding and resource management without direct access to payload data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If video data is packetized for transmission, then transmission efficiency is improved, but the ability to identify frame dependencies and process packets correctly deteriorates
Solution Approach 1:
The patent extracts critical frame dependency information (such as picture order count, temporal layer identifier, and dependency flags) from the video payload and places it in the packet header. This separation allows network devices to access dependency information without needing to process the entire payload, resolving the contradiction between transmission efficiency and information accessibility.
Solution Approach 2:
The packet header acts as an intermediary structure that carries both transmission control information and frame dependency information. This intermediary layer enables network devices to make informed decisions about packet processing and resource allocation without directly accessing the encrypted or compressed payload data.
2Measurement precision
If packet headers are enlarged to include video frame identifiers, then frame identification accuracy is improved, but packet processing overhead increases
Solution Approach 1:
The patent applies local quality by adding frame identification fields only to the packet header portion that is actually needed for network device processing, rather than encrypting or processing the entire packet. This selective approach ensures accurate frame identification while minimizing the impact on overall packet processing complexity.
Solution Approach 2:
The packet structure is segmented into header and payload portions, with the header containing essential frame identification information (picture order count, temporal layer identifier) and the payload containing the actual video data. This segmentation allows network devices to process only the header for identification purposes, reducing processing overhead while maintaining accuracy.
3Reliability
If network devices lack direct access to payload data, then security and bandwidth are improved, but the ability to prioritize and manage video packets deteriorates
Solution Approach 1:
The packet header serves as an intermediary that provides network devices with the information needed for packet prioritization and management without requiring direct access to the payload. The header contains frame dependency information, temporal layer identifiers, and other metadata that enable intelligent packet handling while maintaining security and bandwidth efficiency.
Solution Approach 2:
The packet header includes feedback information such as picture order count and temporal layer identifiers that allow network devices to assess packet importance and make real-time decisions about prioritization. This feedback mechanism enables effective packet management while keeping payload data protected and accessible only when necessary.
Data Source
AI summary
An example device for retrieving media data includes a memory; and a processing system comprising one or more processors implemented in circuitry, the processing system being configured to: receive a packet including a packet header and a payload including at least a portion of a frame of video data, the packet header being separate from the payload; extract, from the packet header, a video frame identifier for the frame of video data; and process the payload according to the video frame identifier.