Spatially Partitioned RTP for Selective Immersive Media Transport
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing immersive media streaming technologies face challenges in selectively transporting and delivering partial content regions, such as regions of interest, due to the need for codec-specific parsing and high computational resources, which are not suitable for secure transport channels and do not meet real-time requirements.
Innovation Solution
A generic and versatile real-time communication edge network is implemented using a spatial partition/tile/slice-based Real-Time Transport Protocol (RTP) layer that does not require inspecting the bitstream payload, enabling efficient and secure delivery of immersive media content.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If codec-specific parsing is used to deliver partial content regions, then content selection precision is improved, but computational resources and processing time increase
Solution Approach 1:
The patent segments the media content into spatial partitions (tiles, slices, or regions) that can be independently selected and transmitted. This segmentation allows the system to deliver only the required content regions without needing to parse the entire bitstream, thereby reducing computational resources while maintaining content selection precision.
Solution Approach 2:
The patent introduces a packet-filter based relay server as an intermediary that operates at the network layer rather than requiring deep inspection of the bitstream payload. This intermediary uses packet filters to selectively forward content based on spatial partition information, eliminating the need for computationally intensive codec-specific parsing while achieving accurate content selection.
2Measurement precision
If codec-specific parsing is used to deliver partial content regions, then content selection precision is improved, but processing time increases
Solution Approach 1:
The patent replaces the mechanical process of codec-specific bitstream parsing with a network-layer packet filtering mechanism. By substituting the complex parsing operation with simpler packet filtering based on spatial partition identifiers, the system achieves content selection precision without the processing time penalty associated with deep packet inspection.
3Reliability
If secure transport channels are used, then data security is improved, but codec-specific parsing becomes inapplicable
Solution Approach 1:
The patent employs a packet-filter based relay server as an intermediary that operates at the network layer, allowing it to function effectively with encrypted payloads. Since the relay server makes decisions based on packet headers and spatial partition information rather than parsing the encrypted bitstream payload, it maintains adaptability while preserving data security through secure transport channels.
4Reliability
If full content is transported, then delivery reliability is improved, but bandwidth efficiency deteriorates
Solution Approach 1:
The patent segments media content into spatial partitions that can be independently selected and transmitted. This segmentation enables the system to deliver only the necessary content regions to clients, significantly reducing bandwidth consumption while maintaining delivery reliability through selective transport of relevant content rather than transmitting the entire content stream.
Data Source
AI summary
Systems and techniques for selective transport of spatially partitioned immersive media content are described herein. In an example, the system may negotiate an attribute for media content between a media producer and a media consumer. A content structure for the media content may be determined based on the negotiation of the attribute, and a network packet may be created with information corresponding to the determined content structure encoded into a transport protocol header of the network packet. The network packet may be filtered to produce filtered media content. The filtered media content may be transmitted to the media consumer.