Augmented Reality Camera Registration via Marker Graph

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality systems require significant time, labor, and care to accurately register a camera in a physical space using markers, limiting the user experience and the physical space where augmented reality can be displayed, as the system relies on markers placed at precise locations.

Innovation Solution

A method and system that identify an origin marker and expansion markers in a physical space, constructing a marker graph to calculate the camera's position in real-time, allowing for camera registration using a computing device, which enables accurate tracking of the camera's position relative to known markers and improves registration accuracy over time.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If markers are placed at precise known locations to register the camera, then registration accuracy is improved, but the time, labor, and care required increase significantly

Engineering Contradiction:
Improvecamera registration accuracyVSAvoidtime and labor for marker placement
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system pre-establishes a database of markers with their known locations and optical codes before the augmented reality session begins. During operation, the system automatically detects these pre-placed markers and uses them for camera registration without requiring real-time manual placement or adjustment, thus improving registration accuracy while reducing the time and labor needed during actual use.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If markers are placed at precise known locations to register the camera, then registration accuracy is improved, but the physical space is limited to where markers have been placed

Engineering Contradiction:
Improvecamera registration accuracyVSAvoidphysical space coverage
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The system creates a universal marker database that can be used across multiple physical spaces and sessions. The same database of markers and their known locations serves multiple purposes: camera registration, spatial mapping, and augmented reality object placement. This universal approach allows the system to operate in various physical spaces without requiring separate marker placements for each space, thereby expanding the adaptable physical space coverage while maintaining registration accuracy.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If the system relies on markers placed at known locations, then camera registration can be performed, but the user experience is detracted due to the careful construction required

Engineering Contradiction:
Improvecamera registration accuracyVSAvoiduser experience
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The system automatically detects markers in the environment and performs camera registration without requiring user intervention for marker placement or adjustment. The automated detection and processing of marker locations and optical codes eliminates the need for users to carefully place and position markers, significantly improving ease of operation and user experience while maintaining accurate camera registration through automated image processing and spatial calculation.

Inventive Principle:
Principle #25Self-service

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach allows for more efficient and accurate camera registration in a wider physical space, enhancing the user experience by enabling augmented reality displays beyond the initially marked area and improving registration accuracy through continuous recalibration.

Implementation Method 1

Image processing techniques are used to identify the optical codes in the markers in the captured images of the physical space. From the location of the markers in the images, and the known location of the markers in the physical space, the position of the camera is determined.

Methodology Applied
Scientific EffectImage processing: Image Processing

Data Source

PatentUS9524436B2Augmented reality camera registration
Publication Date: 2016.12.20 MICROSOFT TECHNOLOGY LICENSING LLC
  • US9524436B2 patent drawing
  • US9524436B2 patent drawing
  • US9524436B2 patent drawing

AI summary

A system and method executable by a computing device of an augmented reality system for registering a camera in a physical space is provided. The method may include identifying an origin marker in a series of images of a physical space captured by a camera of an augmented reality system, and defining a marker graph having an origin marker node. The method may further include analyzing in real-time the series of images to identify a plurality of expansion markers with locations defined relative to previously imaged markers, and defining corresponding expansion marker nodes in the marker graph. The method may further include calculating a current position of the camera of the augmented reality system in the physical space based on a location of a node in the marker graph corresponding to a most recently imaged marker, relative to the origin marker and any intermediate markers.