XR Virtual Object Rendering on Physical Surfaces

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current techniques for rendering virtual objects in extended reality environments lack efficiency in utilizing geometric representations of physical surfaces, leading to resource-intensive rendering and potential lag when moving objects across complex surfaces.

Innovation Solution

The system determines the appropriate level of granularity for geometric representations of physical surfaces, using a less granular representation if normals are sufficiently similar and switching to a more granular representation when differences are detected, optimizing resource usage and maintaining realistic rendering.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If a more granular geometric representation is used for rendering virtual objects, then rendering precision and realism are improved, but resource consumption and processing time increase

Engineering Contradiction:
Improverendering precisionVSAvoidresource consumption
Core Design Contradiction:
Manufacturing precisionVSUse of energy by moving object

Solution Approach 1:

The patent applies local quality by selecting different levels of geometric representation granularity based on the specific characteristics of each surface region. For flat surfaces, a less granular representation is used, while for complex surfaces requiring higher realism, a more granular representation is employed. This localized adaptation of representation quality optimizes resource consumption while maintaining rendering precision where necessary.

Inventive Principle:
Principle #3Local quality

2Use of energy by moving object

If a less granular geometric representation is used, then resource consumption is reduced, but rendering realism and accuracy deteriorate

Engineering Contradiction:
Improveresource consumptionVSAvoidrendering accuracy
Core Design Contradiction:
Use of energy by moving objectVSManufacturing precision

Solution Approach 1:

The patent implements dynamics by dynamically switching between different levels of geometric representation granularity based on real-time assessment of surface characteristics. The system evaluates surface complexity and adapts the representation level accordingly, transitioning from less granular to more granular representations when moving from flat to complex surfaces, thereby maintaining rendering accuracy while optimizing resource usage.

Inventive Principle:
Principle #15Dynamics

3Manufacturing precision

If a more granular geometric representation is used for complex surfaces, then rendering realism is improved, but processing speed and object movement smoothness deteriorate

Engineering Contradiction:
Improverendering realismVSAvoidprocessing speed
Core Design Contradiction:
Manufacturing precisionVSSpeed

Solution Approach 1:

The patent applies local quality by restricting high-granularity geometric representations only to specific complex surface regions where realism is critical, while using less granular representations for flat surfaces. This localized approach maintains processing speed by avoiding unnecessary computational overhead in regions where high detail is not required, while still achieving rendering realism where needed.

Inventive Principle:
Principle #3Local quality

4Measurement precision

If geometric representation granularity is increased, then surface detail accuracy is improved, but computational complexity and lag increase

Engineering Contradiction:
Improvesurface detail accuracyVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies segmentation by dividing the physical surface into distinct regions based on geometric characteristics (flat vs. complex surfaces). Each region is then assigned an appropriate level of geometric representation granularity. This segmentation strategy reduces overall computational complexity by applying high-detail representations only to necessary segments, while using simplified representations for other areas, thereby improving surface detail accuracy without excessive computational overhead.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS12079945B2XR preferred movement along planes
Publication Date: 2024.09.03 APPLE INC
  • US12079945B2 patent drawing
  • US12079945B2 patent drawing
  • US12079945B2 patent drawing

AI summary

Presenting a virtual object includes obtaining, by a first device, a first geometric representation and a second geometric representation corresponding to a physical surface in a real environment, determining an initialization location on the first physical surface for a virtual object, obtaining a first normal for the first representation and a second normal for the second representation at the initialization location, and rendering the virtual object at the initialization location based on the first normal and the second normal.