AR Object Mesh Direction Reversal for Interior Rendering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality (AR) systems fail to provide realistic interactions between users and AR objects, as users entering AR objects often result in undefined interior textures and loss of ambient environment visibility, leading to a less immersive experience.

Innovation Solution

The method involves rendering AR environments where the transparency of an object's outside surface is increased when a viewer enters, allowing the inside surface to be illuminated and rendered without pre-defined interior textures, using techniques like mesh direction reversal and shader applications to simulate materials like glass or water, and repositioning objects based on viewer movement without altering their appearance or location.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the viewer enters an AR object, then the interaction realism is improved, but the interior texture definition is lost

Engineering Contradiction:
Improveinteraction realismVSAvoidinterior texture definition
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The patent applies the outside surface texture to the inside surface by copying the texture definition from the exterior of the object to its interior. When the viewer enters the object, the system renders the inside surface using the same texture that defines the outside appearance, creating a plausible interior representation without requiring separate interior texture definitions.

Inventive Principle:
Principle #26Copying

2Reliability

If the viewer enters an AR object, then the interaction immersion is improved, but the ambient environment visibility is lost

Engineering Contradiction:
Improveinteraction immersionVSAvoidambient environment visibility
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The patent dynamically changes the transparency parameter of the outside surface when the viewer enters the object. By adjusting the transparency from opaque to transparent, the system allows the viewer to see through the object's exterior while inside it, maintaining visibility of the ambient environment and preventing loss of spatial context.

Inventive Principle:
Principle #35Parameter changes

3Reliability

If the mesh direction is reversed to render the inside surface, then the inside view is improved, but the rendering complexity increases

Engineering Contradiction:
Improveinside surface renderingVSAvoidrendering process complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent inverts the normal direction of the mesh when rendering the inside surface. Instead of rendering from the traditional outside-in perspective, the system flips the mesh orientation so that the same geometric definition can be rendered from the inside out, enabling plausible interior views without creating separate interior geometry models.

Inventive Principle:
Principle #13The other way round (Inversion)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enhances the realism of user interactions within AR objects by maintaining ambient environment visibility and providing plausible transitions between outside and inside views, improving user immersion without requiring additional visual content or light sources.

Implementation Method 1

reversing the direction of at least part of the mesh

Methodology Applied
Scientific EffectMesh direction reversal:

Implementation Method 2

increasing a transparency of the outside surface

Methodology Applied
Scientific EffectTransparency increase:

Implementation Method 3

the inside surface is illuminated by light from outside the object due to the increased transparency

Methodology Applied
Scientific EffectLight transmission: Light

Data Source

PatentUS11263819B2Interaction between a viewer and an object in an augmented reality environment
Publication Date: 2022.03.01 GOOGLE LLC
  • US11263819B2 patent drawing
  • US11263819B2 patent drawing
  • US11263819B2 patent drawing

AI summary

A method includes: triggering rendering of an augmented reality (AR) environment having a viewer configured for generating views of the AR environment; triggering rendering, in the AR environment, of an object with an outside surface visualized using a mesh having a direction oriented away from the object; performing a first determination that the viewer is inside the object as a result of relative movement between the viewer and the object; and in response to the first determination, increasing a transparency of the outside surface, reversing the direction of at least part of the mesh, and triggering rendering of an inside surface of the object using the part of the mesh having the reversed direction, wherein the inside surface is illuminated by light from outside the object due to the increased transparency.