Volumetric Point Cloud Streaming via RTP Multiplexing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current wireless communication systems face challenges in efficiently streaming volumetric video content, which requires real-time delivery of 6 degree of freedom (6 DoF) immersive media experiences, due to the large amount of data involved and the need for efficient compression techniques to support typical broadband access systems.
Innovation Solution
The use of session description protocol (SDP) and real-time protocol (RTP) based procedures for generating and multiplexing codec bitstreams, including occupancy map, geometry, and attribute data, to create a dedicated RTP stream for volumetric video, with additional streams for compressed patch sequences and metadata, enabling efficient point cloud video streaming.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If volumetric video content is streamed to deliver 6 DoF immersive media experiences, then user interaction and immersion are enhanced, but the amount of data to be transmitted increases significantly
Solution Approach 1:
The patent segments volumetric video data into multiple independent codec bitstreams (occupancy map, geometry, attributes, compressed patch sequences). Each bitstream is encoded separately and can be transmitted through dedicated RTP streams, enabling selective delivery and efficient data management while maintaining the complete 6 DoF immersive experience.
Solution Approach 2:
The patent implements a nested stream structure where multiple codec bitstreams are multiplexed into a single result RTP stream. The result RTP stream contains embedded sub-streams for occupancy maps, geometry data, attributes, and compressed patch sequences, allowing efficient data organization and transmission within a unified protocol framework.
2Productivity
If multiple codec bitstreams are generated and multiplexed into dedicated RTP streams, then efficient data compression and delivery is achieved, but protocol complexity increases
Solution Approach 1:
The patent extends SDP and RTP protocols to serve multiple functions: they not only transmit traditional audio and video streams but also carry volumetric point cloud data, compressed patch sequences, and associated metadata. This multi-functionality allows the same protocol infrastructure to handle both conventional and immersive media without requiring entirely new communication standards.
Solution Approach 2:
The patent introduces SDP attributes and RTP header extensions as intermediary mechanisms to signal and manage the complex multi-bitstream structure. These extensions act as mediators that carry metadata about the nested streams, enabling receivers to properly parse and process the volumetric content without requiring direct complex parsing of the raw bitstream structure.
3Speed
If real-time delivery protocols are updated to support volumetric content, then real-time streaming capability is improved, but system compatibility requirements increase
Solution Approach 1:
The patent implements dynamic protocol extensions where SDP attributes and RTP header extensions can be selectively activated based on the content type and receiver capabilities. The system can dynamically switch between traditional video streaming modes and volumetric content modes, allowing gradual adoption and maintaining compatibility with existing infrastructure while enabling real-time immersive media delivery.
Data Source
AI summary
A process for real time protocol (RTP) data streaming includes generating a plurality of codec bitstreams, each codec bitstream being configured to carry encoded information that includes one of occupancy map data, geometry data, or attribute data for a volumetric video. The process includes generating, for each codec bitstream of the plurality, a dedicated RTP stream, the dedicated RTP stream including a RTP payload format based on the respective codec bitstream for that RTP stream. The process includes multiplexing each dedicated RTP stream into a result RTP stream for the volumetric video.