Focus-Driven 3D Asset Streaming for Bandwidth-Limited Detail
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Digital content streaming, particularly of 3D assets, faces challenges with insufficient bandwidth leading to buffering, stuttering, and lag due to high data requirements, while compression and lowering resolution compromise user experience by losing important visual elements.
Innovation Solution
A streaming system that tracks user focus on 3D content, generates heatmaps to prioritize elements, and dynamically adjusts resolution and detail based on user engagement, using generative AI to enhance important elements when bandwidth allows.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If 3D content is streamed at high resolution and full detail, then user experience quality is improved, but network bandwidth requirements increase causing buffering and stuttering
Solution Approach 1:
The patent applies local quality by differentiating the level of detail across different regions of the 3D content based on user focus. High-detail rendering is applied only to regions where the user is looking (determined by eye tracking), while peripheral regions are rendered at lower detail levels. This resolves the contradiction by maintaining high visual quality where needed while reducing overall data volume for transmission.
2Quantity of substance
If compression is applied to reduce data size, then bandwidth requirements are reduced, but processing delay increases and visual quality deteriorates
Solution Approach 1:
The patent employs dynamics by making the compression level adaptive rather than static. The compression applied to different regions of the 3D content dynamically adjusts based on real-time user focus data from eye tracking. Regions of interest receive minimal compression to preserve quality and reduce processing delay, while non-critical regions receive higher compression to reduce data size.
3Quantity of substance
If resolution is uniformly lowered across the entire 3D content, then data transmission load is reduced, but important visual elements are lost or undifferentiable
Solution Approach 1:
The patent resolves this contradiction by applying different resolution levels to different spatial regions rather than uniformly across the entire content. The eye tracking system identifies foveal regions (where the user is looking) and assigns them high resolution to preserve important visual elements, while peripheral regions are rendered at lower resolutions to reduce data transmission load.
4Manufacturing precision
If full detail 3D assets are streamed, then visual quality is maintained, but network bandwidth is insufficient causing buffering and lag
Solution Approach 1:
The patent applies partial action by streaming only the necessary portion of full-detail 3D assets rather than complete high-fidelity models. Based on eye tracking data, the system identifies which specific regions require high detail and streams only those portions at full quality, while other regions are streamed at reduced detail. This maintains visual quality where needed while improving streaming performance by reducing overall data transmission requirements.
Data Source
AI summary
A streaming system performs a dynamic densification of streamed content based on tracked user focus. The streaming system streams different content having a common classification to one or more users, and tracks a focus of the one or more users on different parts of the different content. The streaming system receives a request for new content, classifies the new content with the common classification, and streams a first parts of new content with greater detail than second parts of the new content in response to the request based on corresponding first parts from the different parts of the different content receiving more of the focus than corresponding second parts from the different parts of the different content.