3D Model Rendering Visibility Scoring for Limited Memory Devices

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The challenge lies in visualizing large 3D models on small devices with limited memory, graphics, and processing power, while also efficiently transferring and rendering the models, especially when the user can navigate randomly within the model.

Innovation Solution

The method involves downloading unique identifiers and associated positions for digital objects within a 3D model, determining the position and orientation of a virtual camera relative to these objects, computing a visibility score for each object, and selectively downloading and rendering the polygon meshes of the most visible objects based on their visibility scores.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If large 3D models are downloaded and rendered on remote devices, then visualization quality is improved, but memory and processing power requirements exceed device capabilities

Engineering Contradiction:
Improvevisualization qualityVSAvoidmemory requirements
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent divides the large 3D model into multiple smaller sub-models or chunks, each representing a portion of the overall scene. Only the necessary sub-models are downloaded and rendered on the remote device at any given time, reducing memory requirements while maintaining visualization quality for the visible portion of the model.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent extracts and downloads only the essential geometric data and rendering information needed for displaying the 3D model on remote devices, separating the full model data from the rendered output. This extraction allows the remote device to work with minimal data while preserving visualization quality.

Inventive Principle:
Principle #2Taking out (Extraction)

2Measurement precision

If complete 3D models are transferred to remote devices, then rendering accuracy is improved, but bandwidth consumption increases significantly

Engineering Contradiction:
Improverendering accuracyVSAvoidbandwidth consumption
Core Design Contradiction:
Measurement precisionVSLoss of substance

Solution Approach 1:

The patent segments the 3D model data into manageable portions that can be transferred incrementally over the network. By dividing the complete model into smaller data sets representing different spatial regions or levels of detail, the system reduces bandwidth consumption while ensuring rendering accuracy for the currently visible portions.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary processing on the server to pre-compute and prepare only the necessary model data for remote devices, such as pre-calculated geometry, textures, and rendering parameters. This preliminary action reduces the amount of data that needs to be transferred over the network while maintaining rendering accuracy.

Inventive Principle:
Principle #10Preliminary action

3Loss of information

If all digital objects in a 3D model are rendered, then completeness of display is improved, but frame rate decreases due to processing limitations

Engineering Contradiction:
Improvecompleteness of displayVSAvoidframe rate
Core Design Contradiction:
Loss of informationVSProductivity

Solution Approach 1:

The patent applies local quality by rendering digital objects with higher visual fidelity only when they are visible or near the user's viewpoint, while using lower quality or simplified representations for objects that are not currently visible. This approach maintains the completeness of the overall model display while preserving frame rate by reducing processing demands on invisible objects.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent implements partial action by rendering only a subset of digital objects in each frame based on visibility calculations, rather than rendering all objects. The system determines which objects are visible from the current viewpoint and renders only those, achieving acceptable completeness for the user's perspective while maintaining high frame rates.

Inventive Principle:
Principle #16Partial or excessive action

4Measurement precision

If high-detail polygon meshes are downloaded for all objects, then rendering quality is improved, but memory and bandwidth requirements increase

Engineering Contradiction:
Improverendering qualityVSAvoidmemory requirements
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent applies local quality by downloading and rendering high-detail polygon meshes only for digital objects that are visible or near the user's viewpoint, while using lower-detail representations or placeholders for objects that are not currently visible. This maintains rendering quality for relevant objects while reducing memory requirements overall.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS12322131B2Method and system for displaying a large 3D model on a remote device
Publication Date: 2025.06.03 UNITY TECH APS
  • US12322131B2 patent drawing
  • US12322131B2 patent drawing
  • US12322131B2 patent drawing

AI summary

A method of displaying a digital object on a device is disclosed. A set of unique identifiers and associated is downloaded for a set of digital objects within a 3D model. A position and an orientation of a virtual camera is determined relative to the positions of the set of digital objects. A visibility score for each digital object of the set of digital objects is computed based on a position of the digital object relative to the position and the orientation of the virtual camera. A polygon mesh associated with a digital object with a highest visibility score is downloaded based on the polygon mesh being absent. The downloading uses a unique identifier of the set of unique identifiers associated with the polygon mesh. The polygon mesh of the digital object with the highest score is rendered and displayed on a display device.