Volumetric Media Streaming Extraction for Latency Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current immersive digital media technologies face challenges in creating resource-efficient ecosystems for real-time, immersive user experiences due to high resource intensity and latency issues, particularly when streaming volumetric data of dynamic environments.
Innovation Solution
The system leverages predefined and distributed assets to reduce data transmission and processing requirements by identifying and inserting pre-defined volumetric visual and audio assets into captured data, adjusting for user perspectives and interests, and using a content sync device to minimize latency through caching and proxying.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If volumetric data is streamed in real-time to create immersive user experiences, then user experience quality is improved, but resource consumption and latency increase
Solution Approach 1:
The patent extracts and removes portions of the environment that do not contain objects or people of interest from the volumetric data stream. By identifying regions without relevant content and excluding them from transmission, the system reduces bandwidth consumption and processing requirements while maintaining immersive experience quality for relevant content.
Solution Approach 2:
The system performs preliminary identification of objects and people of interest before full volumetric data transmission. By pre-processing the environment data to locate relevant content, the system can then focus resources on transmitting only necessary portions, reducing overall resource consumption while maintaining experience quality.
2Measurement precision
If complete volumetric data is transmitted for accurate environment representation, then immersion accuracy is improved, but bandwidth requirements increase
Solution Approach 1:
The patent extracts only the portions of volumetric data that contain objects or people of interest, removing unnecessary data from regions without relevant content. This extraction approach maintains accurate representation of important elements while significantly reducing the total data transmission volume required.
Solution Approach 2:
The system applies different data transmission quality levels to different regions of the environment based on local importance. Areas containing objects or people of interest receive high-fidelity volumetric data transmission, while areas without relevant content receive reduced or no transmission, optimizing bandwidth usage while maintaining accuracy where needed.
3Speed
If real-time processing of volumetric data is performed, then responsiveness is improved, but processing time and resource intensity increase
Solution Approach 1:
The patent extracts identification of objects and people of interest as a preliminary step before full volumetric processing. This early extraction reduces the volume of data requiring intensive real-time processing, thereby reducing processing time and resource intensity while maintaining system responsiveness.
Solution Approach 2:
The system segments the volumetric data processing into distinct stages: identification of relevant content, selective data extraction, and focused transmission/rendering. This segmentation allows parallel processing of different data portions and reduces overall processing time by avoiding unnecessary processing of irrelevant regions.
Data Source
AI summary
This disclosure describes systems, methods, and devices related to immersive digital media. A method may include receiving, at a first device, first volumetric data, and second volumetric data including a first volumetric time slice of a first volumetric media stream. The method may include determining that the first volumetric time slice includes a first portion and a second portion, the first portion representing a first object and including an amount of the second volumetric data. The method may include determining that the first volumetric data represents the first object. The method may include generating a second volumetric time slice including the first volumetric data and the second portion of the first volumetric time slice, and generating a second volumetric media stream including the second volumetric time slice. The method may include sending the second volumetric media for presentation at a third device.