AR Headset Image Alignment via Affine Correction

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

In augmented reality technology, head-mounted displays face challenges in maintaining registration between sensed image data and displayed information due to changes in the spatial positional relationship between the image sensing device and the image display device, leading to discordance and mismatch, which complicates the realization of accurate augmented reality.

Innovation Solution

A head-mounted display system with a correction mechanism that includes an eyeglasses frame, an image display device, an image sensing device, and a see-through type light guide, where the correction means adjusts sensed image data to align the real-basis image observed through the light guide with the generated image, using processes like rotation, scaling, and transfer based on affine transformation matrices, ensuring accurate positional alignment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If the head mounted display is mounted on an observer's head, then the spatial positional relationship between the image sensing device and the image display device changes, but this causes discordance and mismatch between the sensed image data and displayed information

Engineering Contradiction:

Improvemounting on observer's headVSAvoidpositional alignment accuracy

Core Design Contradiction:

Ease of operationVSManufacturing precision

Solution Approach 1:

The system performs preliminary calibration to acquire the spatial positional relationship between the image sensing device and image display device before actual operation. Correction data is pre-computed based on this calibration, enabling the system to compensate for positional changes when mounted on the observer's head, thereby maintaining alignment accuracy despite the flexibility of wearable mounting.

Inventive Principle:

Principle #10Preliminary action

2Manufacturing precision

If correction processing is performed to align sensed image data with displayed information, then positional accuracy is improved, but the complexity of the system increases

Engineering Contradiction:

Improveimage alignment accuracyVSAvoidcorrection mechanism complexity

Core Design Contradiction:

Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent replaces complex mechanical adjustment mechanisms with computational correction. Instead of using movable parts or mechanical alignment systems, the invention uses image processing techniques including affine transformation matrices and coordinate system conversions to achieve precise alignment digitally, thereby reducing mechanical complexity while maintaining high positional accuracy.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

3Adaptability or versatility

If a single head mounted display is used by multiple users, then versatility is improved, but maintaining accurate registration for each user becomes more difficult

Engineering Contradiction:

Improvemulti-user compatibilityVSAvoidregistration accuracy for each user

Core Design Contradiction:

Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The system dynamically adapts to different users by performing individual calibration for each observer. The correction data is computed based on the specific spatial relationship between the image sensing device and image display device for each user's mounting configuration, enabling the system to maintain accurate registration across multiple users with different head shapes, sizes, and mounting styles.

Inventive Principle:

Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution enables secure and easy realization of augmented reality by maintaining high positional accuracy of additional information on real-world images, simplifying image correction processing, and allowing a single head-mounted display to be used by multiple users comfortably.

Implementation Method 1

see-through type light guide means which is mounted to the image generating device, on which beams emitted from the image generating device are incident, through which the beams are guided

Methodology Applied

Scientific EffectRefraction: Refraction

Implementation Method 2

light guide means... through which the beams are guided, and from which the beams are emitted toward an observer's pupil

Methodology Applied

Scientific EffectTotal internal reflection: Total Internal Reflection

Data Source

PatentUS10203501B2Head mounted display, and image displaying method in head mounted display

Publication Date: 2019.02.12 META PLATFORMS INC

AI summary

Disclosed herein is A head mounted display including: (A) an eyeglasses frame-like frame to be mounted to an observer's head; (B) an image display device; (C) an image sensing device mounted to the frame; and (D) a correction section, wherein the image display device includes (B-1) an image generating device, and (B-2) see-through type light guide section which is mounted to the image generating device, on which beams emitted from the image generating device are incident, through which the beams are guided, and from which the beams are emitted toward an observer's pupil.