3D Content Streaming With Multi-Format Fidelity Progression
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The challenge of real-time streaming of 3D content is exacerbated by the large data requirements, leading to buffering and disrupted experiences, and uniform reduction in quality or resolution compromises visual detail.
Innovation Solution
A system that streams initial 3D content in a low-fidelity format, progressively increasing fidelity based on network performance, using various encoding formats like 2D images, mesh models, and point clouds to ensure continuous and uninterrupted streaming.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If high-fidelity 3D content is streamed, then visual quality and detail are improved, but data transfer time and buffering increase
Solution Approach 1:
The patent segments 3D content into multiple fidelity levels (low, medium, high) and streams them in sequence. The system divides the content delivery process into stages: first streaming a low-fidelity version for immediate display, then progressively streaming higher-fidelity versions to replace or enhance the initial content, thereby resolving the contradiction between quality and time.
Solution Approach 2:
The patent applies preliminary action by pre-streaming a low-fidelity version of the 3D content before the high-fidelity version is ready. This preliminary low-quality content is displayed immediately to avoid buffering, and the system prepares and streams the high-fidelity content in the background to replace it later, thus eliminating initial buffering time while ensuring eventual high quality.
2Productivity
If uniform quality reduction is applied to fit bandwidth constraints, then data transfer time is reduced, but visual detail is lost
Solution Approach 1:
The patent implements dynamic quality adjustment where the fidelity of streamed content is not fixed but changes over time based on buffering status and network conditions. The system dynamically switches between different fidelity levels, starting low and progressively increasing to high fidelity as content is buffered, thereby maintaining both streaming speed and visual detail.
Solution Approach 2:
The patent changes the quality parameter of streamed content over time. Instead of maintaining a uniform quality level, the system varies the fidelity parameter dynamically - starting with low-fidelity content for fast streaming, then progressively increasing to medium and high fidelity as more data is buffered, thus achieving both fast initial streaming and high final quality.
3Manufacturing precision
If high-resolution 3D content is streamed, then visual quality is improved, but network bandwidth consumption increases
Solution Approach 1:
The patent segments the total data volume into multiple quality tiers. Instead of transmitting the full high-resolution dataset at once, it transmits segmented portions at different fidelity levels in sequence, allowing the system to deliver acceptable visual quality with progressively increasing data volumes as buffering permits.
Data Source
AI summary
A real-time streaming system and associated methods are provided for initially presenting three-dimensional (3D) content at a low-fidelity first encoding format so that the initial visualization of the 3D content on the requesting device is presented with no or insignificant delay and for streaming prioritized 3D assets within the initial visualization at higher fidelities in different encoding formats that preserve the real-time responsiveness of the system. The system generates and streams a two-dimensional (2D) image for a first presentation of the 3D content at a first fidelity. The system increases a fidelity of a prioritized 3D asset while the 3D content does not change by streaming 3D primitives for the prioritized 3D asset in a second encoding format that increases the fidelity of the prioritized 3D asset in a second presentation of the 3D content from the first fidelity to a greater second fidelity.