Center-Locked AR Annotation Interface for Precise 3D Placement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional augmented reality annotation techniques are inefficient due to the 'tap-to-place' model, which obscures the screen and often results in inaccurate placement of annotations, and require additional device movement for accurate surface detection, leading to suboptimal user experience.

Innovation Solution

A graphical user interface (GUI) with a central, center-locked element that allows users to place three-dimensional virtual annotations precisely by providing a preview of the annotation's direction and scale, enabling intuitive orientation and placement on detected surfaces within the augmented reality environment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If the tap-to-place model is used for annotation placement, then the operation is simple, but the annotation placement accuracy deteriorates and the screen is obscured

Engineering Contradiction:
Improveannotation placement operationVSAvoidannotation placement accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

A central placement indicator is introduced as an intermediary element that remains visible on screen during annotation placement. This indicator shows the exact future placement location, allowing users to accurately position annotations without tapping blindly, thus resolving the contradiction between simple operation and placement accuracy.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system performs preliminary actions by displaying a preview indicator at the intended annotation location before the user finalizes placement. This preliminary visualization allows users to adjust their positioning in real-time, ensuring accurate placement without obscuring the screen during the operation.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If additional device movement is required for surface detection, then the surface detection accuracy improves, but the user experience deteriorates

Engineering Contradiction:
Improvesurface detection accuracyVSAvoiduser experience
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The system performs self-service by automatically detecting surfaces using the device's current position and orientation without requiring additional user movements. The surface detection algorithm processes the existing camera view to identify placement surfaces, eliminating the need for users to move the device and thereby maintaining good user experience while achieving accurate surface detection.

Inventive Principle:
Principle #25Self-service

3Ease of operation

If the screen is obscured during annotation placement, then the operation is simplified, but the visual data capture for surface detection deteriorates

Engineering Contradiction:
Improveannotation placement operationVSAvoidvisual data for surface detection
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The system performs preliminary surface detection and displays a placement indicator before the user completes the annotation placement. This preliminary action captures visual data and processes surface information in advance, so when the user does tap to place the annotation, the screen is not obscured during the critical detection phase, preserving both operational simplicity and visual data quality.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11523063B2Systems and methods for placing annotations in an augmented reality environment using a center-locked interface
Publication Date: 2022.12.06 MICROSOFT TECHNOLOGY LICENSING LLC
  • US11523063B2 patent drawing
  • US11523063B2 patent drawing
  • US11523063B2 patent drawing

AI summary

Annotation techniques are implemented in an augmented reality environment. A user is presented with a GUI configured to place three-dimensional virtual annotations in an environment displayed via the user's computing device. The GUI presents a central GUI element that is center-locked with respect to the environment displayed via the user's computing device. The central GUI element is coplanar to a detected surface of the environment on which the central GUI element is virtually located. The annotation may be a three-dimensional arrow. While viewing the environment, a preview of the three-dimensional arrow pointing towards the central GUI element is presented to the user. Upon providing user input, the arrow is placed on the detected surface. The user may provide additional input that rotates the three-dimensional arrow around the central GUI element before placing the arrow.