AR Object Anchoring on Arbitrary 3D Planes

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current augmented reality systems face challenges in precisely placing and orienting virtual objects relative to physical objects with surfaces that are neither horizontal nor vertical, leading to imprecision and difficulty in user interactions.

Innovation Solution

A computer-implemented method that detects the orientation of a client device, projects a line to a physical object, identifies a location on the object, determines coordinates, and anchors an augmented reality object based on these coordinates and orientation, allowing for precise placement and orientation of virtual objects.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the AR device detects only horizontal or vertical 2D planes, then the detection process is simple, but the precision of virtual object placement on non-horizontal and non-vertical surfaces deteriorates

Engineering Contradiction:
Improveprecision of virtual object placementVSAvoidcomplexity of plane detection system
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent transitions from detecting only horizontal and vertical planes (2D orientation) to detecting planes with arbitrary orientations in 3D space. The system now identifies planes defined by three non-collinear points, enabling detection of inclined surfaces and surfaces at any angle, thus resolving the contradiction by adding dimensional capability without excessive complexity

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent changes the detection parameters from restricted horizontal/vertical orientations to arbitrary 3D plane orientations defined by normal vectors and passing points. This parameter expansion allows precise placement on any surface orientation while maintaining computational feasibility through standardized plane equations

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If the AR device selects the nearest horizontal or vertical plane for non-horizontal and non-vertical surfaces, then the detection process remains simple, but the accuracy of virtual object orientation deteriorates

Engineering Contradiction:
Improveaccuracy of virtual object orientationVSAvoidcomplexity of plane selection algorithm
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system moves beyond the constrained horizontal/vertical plane selection to arbitrary 3D plane orientation detection. By calculating plane normals from three points and using these normals to determine virtual object orientation, the system achieves accurate placement on surfaces of any orientation while maintaining algorithmic efficiency

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent changes the orientation parameters from discrete horizontal/vertical categories to continuous 3D angular parameters defined by plane normal vectors. This allows precise matching of virtual object orientation to the actual surface orientation, eliminating the approximation errors of nearest-plane selection

Inventive Principle:
Principle #35Parameter changes

3Reliability

If the AR device fails to detect any 2D plane for certain surface angles, then the detection system remains simple, but the reliability of virtual object anchoring deteriorates

Engineering Contradiction:
Improvereliability of virtual object anchoringVSAvoidcomplexity of plane detection coverage
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent creates a universal plane detection capability that works for all surface orientations. By using three non-collinear points to define any plane in 3D space, the system achieves multi-functional detection coverage for horizontal, vertical, inclined, and arbitrarily oriented surfaces, eliminating detection failures and improving anchoring reliability

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system expands from 2D plane detection (horizontal/vertical only) to full 3D plane detection with arbitrary orientations. This dimensional expansion ensures that planes at any angle can be detected and used for virtual object anchoring, eliminating the detection failures that occurred with restricted 2D plane detection

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS11657582B1Precise plane detection and placement of virtual objects in an augmented reality environment
Publication Date: 2023.05.23 CISCO TECHNOLOGY INC
  • US11657582B1 patent drawing
  • US11657582B1 patent drawing
  • US11657582B1 patent drawing

AI summary

A mobile device executes an augmented reality (AR) software application that detects an orientation of a client device. The AR software application projects a line from a reference position on the client device to a physical object. The AR software application identifies a first location on the physical object that intersects with the line. The AR software application determines an x-coordinate and a y-coordinate of a portion of the physical object included in an image displayed on the client device based on the first location. The AR software application receives a z-coordinate of the portion of the physical object. In response to receiving user input via the client device, the AR software application anchors an augmented reality object at a second location that corresponds to the x-coordinate, the y-coordinate, and the z-coordinate. The orientation of the augmented reality object corresponds to the orientation of the client device.