3D Asset Container for Physically Based Rendering Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current real-time, photorealistic rendering solutions are often proprietary and not cross-platform, leading to limitations in rendering features when porting to mobile platforms. Additionally, web and mobile-based 3D graphics APIs do not support some physically based rendering (PBR) specifications, resulting in non-photorealistic rendering of materials like glass, gems, and metals.
Innovation Solution
A method is disclosed that involves obtaining visualization data of a three-dimensional item, identifying its materials, generating physically based rendering data, and forming a container that includes both visualization and PBR data. This container can be stored using a file format that does not natively support PBR data, such as glTF, by inserting the PBR data into a free-form extras field.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If proprietary rendering solutions are used to achieve photorealistic rendering, then rendering quality is improved, but platform compatibility deteriorates
Solution Approach 1:
The patent segments the rendering data into distinct components: visualization data (geometry, basic materials) and physically based rendering data (advanced material properties, lighting parameters). This segmentation allows each component to be handled independently, with PBR data being an optional addition that can be included or excluded based on platform capabilities, thus maintaining compatibility while enabling high-quality rendering when supported.
Solution Approach 2:
The container format is designed to be universal and multi-functional, supporting both simple visualization data for basic rendering and advanced PBR data for photorealistic rendering. The same container structure can be used across different platforms and file formats (glTF, glB, FBX, USDZ), allowing a single solution to serve multiple rendering quality levels and platform requirements without requiring separate proprietary solutions for each platform.
2Adaptability or versatility
If web and mobile graphics APIs are used to ensure cross-platform support, then platform compatibility is improved, but rendering feature support deteriorates
Solution Approach 1:
The patent implements a dynamic approach where the rendering system can adaptively use available PBR data based on platform capabilities. The container includes PBR data that can be utilized when the platform's graphics API supports it, and gracefully degraded when it doesn't. This dynamic adaptation allows web and mobile platforms to achieve photorealistic rendering when their APIs support PBR features, while maintaining basic functionality on all platforms.
Solution Approach 2:
The container format acts as an intermediary layer between the 3D asset data and the platform-specific graphics APIs. It carries PBR data that can be translated and utilized by different graphics APIs (WebGL, OpenGL ES, Vulkan, Metal) according to their capabilities, thus bridging the gap between universal data representation and platform-specific rendering implementations.
3Ease of operation
If standard file formats are used to ensure broad compatibility, then ease of operation is improved, but support for advanced rendering data deteriorates
Solution Approach 1:
The patent embeds PBR data within the existing structure of standard file formats like glTF, glB, FBX, and USDZ. The PBR data is nested within the container's existing data structures (e.g., as extensions or additional properties), allowing standard file formats to maintain their broad compatibility while carrying advanced PBR information. This nested approach enables existing tools and pipelines to continue working with standard formats while gaining access to advanced rendering capabilities.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The solution enables photorealistic rendering of materials across different platforms and file formats, overcoming the limitations of current technologies by including essential PBR data within the container, thus achieving high-quality rendering of gems, metals, and transparent materials.
Implementation Method 1
generating the physically based rendering data comprises computing reflected and refracted light for the one or more materials using one or more Fresnel equations
Implementation Method 2
performing ray tracing starting at the front face
Implementation Method 3
assessing refracted light rays that exit the gem and sampling an environment map associated with the gem
Data Source
AI summary
In one embodiment, a device obtains visualization data that depicts a three-dimensional item. The device identifies, from the visualization data, one or more materials of the three-dimensional item. The device generates, based on the visualization data, physically based rendering data for the one or more materials of the three-dimensional item. The device forms a container that includes the visualization data and the physically based rendering data. The visualization data is stored using a file format that does not support the physically based rendering data.