Hybrid Spatial Data Rendering for Interactive 3D Scenes
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current surface light field solutions struggle to support interactive scene element behaviors, wider area navigation, and adaptability to varying client capabilities, limiting their ability to provide high-quality, interactive, and immersive experiences, especially on devices with sub-optimal performance.
Innovation Solution
The proposed solution involves a hybrid format for content delivery, where scene elements can be selectively provided in an optimized surface light field format or in a full 3D asset format. This allows for dynamic and interactive elements by combining static scenes optimized as surface light fields with real-time rendered content elements, enabling full global light transport in real-time rendering.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If surface light field format is used for all scene elements, then data transmission efficiency is improved, but interactivity and dynamic behavior support deteriorate
Solution Approach 1:
The patent applies local quality by differentiating the representation format for different scene elements based on their interactivity requirements. Static scene elements are represented using surface light field format for compression, while dynamic/interactive elements are represented using full 3D asset format to support interactivity. This selective application of different formats to different parts of the scene resolves the contradiction between data efficiency and interactive support.
2Adaptability or versatility
If full 3D asset format is used for all scene elements, then interactivity and dynamic behavior support is improved, but data transmission efficiency and rendering performance deteriorate
Solution Approach 1:
The patent applies local quality by differentiating the representation format for different scene elements based on their interactivity requirements. Static scene elements are represented using surface light field format for compression, while dynamic/interactive elements are represented using full 3D asset format to support interactivity. This selective application of different formats to different parts of the scene resolves the contradiction between data efficiency and interactive support.
3Adaptability or versatility
If real-time 3D rendering is used for all scene elements, then interactivity is improved, but processing load and device performance requirements deteriorate
Solution Approach 1:
The patent applies local quality by differentiating the representation format for different scene elements based on their interactivity requirements. Static scene elements are represented using surface light field format for compression, while dynamic/interactive elements are represented using full 3D asset format to support interactivity. This selective application of different formats to different parts of the scene resolves the contradiction between data efficiency and interactive support.
4Adaptability or versatility
If hybrid format is used for scene elements, then adaptability to client capabilities is improved, but system complexity deteriorates
Solution Approach 1:
The patent applies local quality by differentiating the representation format for different scene elements based on their interactivity requirements. Static scene elements are represented using surface light field format for compression, while dynamic/interactive elements are represented using full 3D asset format to support interactivity. This selective application of different formats to different parts of the scene resolves the contradiction between data efficiency and interactive support.
Solution Approach 2:
The patent applies dynamics by making the scene element representation format adaptive rather than static. The system dynamically selects between surface light field format and full 3D asset format based on the interactivity requirements of each scene element, allowing the system to adapt to varying client capabilities and interaction needs without requiring a completely complex rearchitecture.
Data Source
AI summary
Systems and methods are described for providing spatial content using a hybrid format. In some embodiments, a client device receives, from a server, surface light field representations of a plurality of scene elements in a 3D scene, including a first scene element. The client device provides to the server an indication of a dynamic behavior of a second scene element different from the first scene element. Further, in response to the indication, the client device receives from the server information defining the first scene element in a 3D asset format. The client device then renders at least the first scene element in the 3D asset format.