Hybrid 3D Object Streaming for Scalable Remote Rendering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for remote rendering of 3D scenes, such as geometry streaming and pixel streaming, face challenges in scalability, bandwidth consumption, and client hardware requirements, leading to inefficiencies and limitations in rendering quality and reactivity.
Innovation Solution
A computer-implemented method that partitions the 3D scene into two parts, with one part streamed as pixel data and the other as geometry, allowing for dynamic balancing of payload between the client and server based on hardware capabilities and network conditions, and enabling selective protection of scene assets during collaborative work.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If pixel streaming is used for remote rendering, then rendering quality is improved, but scalability deteriorates because computation is heavily concentrated on the server side
Solution Approach 1:
The patent segments the rendering workload by dividing the 3D scene into different parts: some objects are rendered on the server (pixel streaming) while others are rendered on the client (geometry streaming). This segmentation allows the system to achieve both high rendering quality for complex objects and good scalability for simpler objects, resolving the contradiction between rendering quality and scalability.
2Adaptability or versatility
If geometry streaming is used, then scalability is improved, but network bandwidth consumption increases leading to lag
Solution Approach 1:
The patent applies local quality by adapting the streaming method to each object's characteristics and the client's capabilities. Complex objects that require high rendering quality are streamed as pixel data, while simpler objects are streamed as geometry. This localized approach optimizes bandwidth usage by sending only the necessary data for each object, resolving the contradiction between scalability and bandwidth consumption.
3Ease of operation
If pixel streaming is used, then client hardware requirements are reduced, but server computation cost increases
Solution Approach 1:
The patent implements a dynamic hybrid streaming system that adapts the rendering approach based on real-time conditions including client hardware capabilities, network status, and object complexity. This dynamic adjustment allows the system to minimize server computation cost by using geometry streaming for objects that don't require heavy rendering, while still meeting client hardware requirements through selective pixel streaming.
4Use of energy by stationary object
If geometry streaming is used, then server computation is reduced, but network latency increases affecting reactivity
Solution Approach 1:
The patent uses preliminary action by pre-processing scene data on the server side to identify which objects are suitable for pixel streaming versus geometry streaming. This pre-processing allows the system to prepare optimized data streams in advance, reducing the computational burden during real-time rendering while minimizing network latency through efficient data transmission.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
The invention notably relates to a computer-implemented method for displaying a 3D assembly of modeled objects. The method comprises streaming from a first computer to a second computer at least one raster image of a first 3D modeled object, and rendering on the second computer the 3D assembly of modeled objects by merging a second 3D modeled object with the streamed at least one raster image.