Cloud 3D Model Rendering via Octree Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current 3D modeling technologies face challenges in providing a detailed virtual reality experience by efficiently rendering large datasets, leading to high memory usage and computational costs, and lack integration of non-spatial information beyond basic spatial features.

Innovation Solution

A cloud-based system that uploads 3D model data to a network of servers, partitions it into voxel cells with portal graphs, and displays only visible parts based on user location, incorporating additional non-spatial information such as light, sound, and environmental attributes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If large datasets corresponding to object geometries are processed to compose lifelike 3D models in real time, then the virtual reality detail and quality are improved, but the memory usage and computational cost increase significantly

Engineering Contradiction:
Improvevirtual reality detailVSAvoidmemory usage
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The 3D model data is divided into a hierarchical structure of octree nodes, where the scene is recursively subdivided into smaller volumetric regions. This segmentation allows the system to manage large datasets by organizing them into manageable hierarchical levels, enabling efficient memory allocation and rendering only of visible portions while maintaining high virtual reality detail.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a hierarchical spatial dimension through octree structures, transforming the flat memory management approach into a multi-level spatial hierarchy. This dimensional organization allows the system to navigate and render 3D space efficiently by traversing the octree from root to leaf nodes, enabling detailed rendering only where necessary while reducing overall memory footprint.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If large datasets are processed to compose lifelike 3D models in real time, then the virtual reality detail is improved, but the processing time increases

Engineering Contradiction:
Improvevirtual reality detailVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary processing by pre-computing and storing the octree hierarchical structure and portal graphs during an offline phase. This preliminary action prepares the data in advance, allowing the runtime system to quickly traverse the pre-organized structure and render only visible portions, significantly reducing real-time processing time while maintaining high virtual reality detail.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent applies local quality by rendering detailed geometry only in regions that are currently visible to the user, while using lower-detail representations for occluded or distant regions. The octree structure enables this by allowing selective refinement of specific spatial regions, ensuring high visual quality where needed while minimizing overall computational effort and processing time.

Inventive Principle:
Principle #3Local quality

3Quantity of substance

If only visible parts of the 3D model are displayed based on user location, then the memory usage is reduced, but the system complexity increases

Engineering Contradiction:
Improvememory usageVSAvoidsystem complexity
Core Design Contradiction:
Quantity of substanceVSDevice complexity

Solution Approach 1:

The visible portion determination is achieved through segmentation of the 3D space into octree cells and portal regions. The system divides the scene into discrete spatial units and determines visibility by checking which segments are currently in the user's field of view, simplifying the complexity management through structured spatial division.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces portal graphs as an intermediary data structure that mediates between the octree spatial structure and the rendering system. These portal graphs act as a middle layer that pre-computes visibility relationships, allowing the system to efficiently determine which octree nodes are visible without requiring complex real-time ray tracing, thus reducing system complexity while enabling selective rendering.

Inventive Principle:
Principle #24Intermediary (Mediator)

4Measurement precision

If additional non-spatial information is included with spatial and visibility information, then the virtual reality experience is enhanced, but the data processing requirements increase

Engineering Contradiction:
Improvevirtual reality experienceVSAvoiddata processing efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent merges multiple types of information (spatial coordinates, visibility status, and non-spatial attributes like lighting and material properties) into a unified octree node data structure. This consolidation allows the system to process and transmit all necessary information in a single integrated framework, improving virtual reality experience while managing data processing efficiency through unified handling rather than separate processing of each data type.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS10713845B2Three-dimensional modelling with improved virtual reality experience
Publication Date: 2020.07.14 AMAZON TECH INC
  • US10713845B2 patent drawing
  • US10713845B2 patent drawing
  • US10713845B2 patent drawing

AI summary

A cloud network server system, a method, and a software program product for experiencing a three-dimensional (3D) model are provided. 3D model data associated with a 3D video game is uploaded to the cloud network server system. The system and method are used to design for example a computer game that renders non-spatial characteristics such as, smell, reflection and/or refraction of light, wind direction, sound reflection, etc., along with spatial and visibility information associated with 3D objects displayed in the 3D video game. Different versions of the 3D model are created based on memory, streaming bandwidth, and/or processing power requirements of different user terminal computers. Based on a virtual location of a user in the 3D model, parts of at least one version of the 3D model are rendered to the user.