Client-Controlled 3D Streaming With Volumetric Fidelity Selection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing adaptive streaming protocols are inadequate for native 3D content streaming, as they do not optimize network delivery of 3D primitives, which require exponentially more data than 2D images, and existing 2D content streaming techniques cannot be applied directly to 3D formats.
Innovation Solution
Client-controlled adaptive streaming system that partitions 3D space into volumetric spatial units, assigns indices, and generates a manifest for different fidelities, allowing clients to selectively request 3D primitives based on network and rendering resources, user focus, and field-of-view changes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If 3D primitives are streamed at high fidelity, then visual quality is improved, but network bandwidth consumption increases exponentially
Solution Approach 1:
The system segments 3D content into volumetric spatial units (VSUs) that are independently streamable. Each VSU represents a discrete portion of 3D space that can be requested and transmitted separately, allowing selective streaming of only the regions currently visible or relevant to the user, thereby reducing overall bandwidth consumption while maintaining visual quality for critical regions.
Solution Approach 2:
The system applies different fidelity levels to different volumetric spatial units based on their importance and visibility. Regions closer to the user's field of view or containing important objects are streamed at higher fidelity, while distant or less important regions are streamed at lower fidelity, optimizing the balance between visual quality and bandwidth usage.
2Measurement precision
If all 3D primitives in the field-of-view are streamed at maximum fidelity, then visual quality is improved, but rendering load on the client increases
Solution Approach 1:
The system applies different fidelity levels to different volumetric spatial units based on their importance and visibility. Regions closer to the user's field of view or containing important objects are streamed at higher fidelity, while distant or less important regions are streamed at lower fidelity, optimizing the balance between visual quality and rendering load.
Solution Approach 2:
The system dynamically adjusts the fidelity of streamed 3D primitives based on real-time conditions including user head position, field-of-view changes, network bandwidth availability, and client rendering capacity. This allows the system to adaptively optimize the balance between visual quality and rendering load as conditions change.
3Quantity of substance
If the streaming system waits for client resource checks before sending content, then bandwidth usage is optimized, but streaming latency increases
Solution Approach 1:
The system performs preliminary actions by pre-processing 3D content into volumetric spatial units and maintaining them in a ready-to-stream state on the server. When a client requests content, the system can immediately begin transmitting the appropriate VSUs without needing to wait for resource checks or on-the-fly processing, thereby reducing latency while still allowing for adaptive fidelity selection based on client capabilities.
4Stability of the object's composition
If 3D content is streamed as complete scenes, then content integrity is maintained, but network bandwidth consumption increases
Solution Approach 1:
The system segments 3D content into volumetric spatial units (VSUs) that are independently streamable. Each VSU represents a discrete portion of 3D space that can be requested and transmitted separately, allowing selective streaming of only the regions currently visible or relevant to the user, thereby reducing overall bandwidth consumption while maintaining visual quality for critical regions.
Solution Approach 2:
The system implements partial streaming by transmitting only the subset of 3D content that is currently needed by the client based on their field-of-view and position. Rather than streaming complete scenes, the system delivers partial content (only the visible or relevant VSUs) and updates them as the user moves or as new regions become visible, reducing bandwidth consumption while maintaining content integrity for the relevant portions.
Data Source
AI summary
A three-dimensional (3D) streaming system provides client-controlled adaptive streaming of 3D content in which the client may receive the 3D primitives of 3D content at different fidelities that the client selects. The system includes generating a 3D model at different fidelities, partitioning the 3D model into different volumetric spatial units, generating a manifest with an index for each volumetric spatial unit and an identifier for each fidelity, and presenting the 3D primitives in a first set of volumetric spatial units at a first fidelity and the 3D primitives in a second set of volumetric spatial units at a second fidelity in response to a request that includes indices of the first set of volumetric spatial units with a first identifier for the first fidelity and indices of the second set of volumetric spatial units with a second identifier for the second fidelity.


