HMD View Matrix Calibration via Alignment Hologram

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Head-mounted display (HMD) devices often use an average inter-pupillary distance (IPD) for calibration, leading to user discomfort and inaccurate virtual object placement in augmented reality experiences due to deviations from individual users' actual IPD, especially noticeable when compared to the real-world background.

Innovation Solution

The HMD device detects a physical feature at a threshold distance, generates an alignment hologram, and adjusts its view matrix based on user input to align the hologram with the feature, allowing for calibration of the user's specific IPD, ensuring accurate virtual object placement relative to the real-world environment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If an average IPD is used for calibration, then the device can be manufactured and deployed without individual customization, but the user experience deteriorates due to IPD mismatch causing discomfort and inaccurate virtual object placement

Engineering Contradiction:
Improvecalibration processVSAvoidIPD accuracy
Core Design Contradiction:
Ease of manufactureVSMeasurement precision

Solution Approach 1:

The system performs self-calibration by automatically detecting the user's IPD through camera-based eye tracking and using this detected information to adjust the view matrix, eliminating the need for manual measurement or pre-calibration while achieving accurate individualized results

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The calibration process is performed preliminarily during the first use or setup phase, where the system captures eye position data and computes the calibrated view matrix before actual augmented reality usage, so that subsequent operations benefit from accurate individualized calibration without requiring repeated setup

Inventive Principle:
Principle #10Preliminary action

2Device complexity

If stereoscopic displays use stereopsis techniques with average IPD calibration, then device complexity is reduced, but user comfort deteriorates due to inability to verge images correctly

Engineering Contradiction:
ImproveIPD calibration systemVSAvoidimage verging
Core Design Contradiction:
Device complexityVSEase of operation

Solution Approach 1:

The system changes the view matrix parameters based on the detected user IPD, adjusting the horizontal separation and convergence points of the stereoscopic images to match the individual user's eye geometry, enabling correct image verging without complex mechanical adjustment mechanisms

Inventive Principle:
Principle #35Parameter changes

3Ease of manufacture

If average IPD calibration is used in augmented reality, then manufacturing and deployment are simplified, but virtual object alignment with real-world background deteriorates

Engineering Contradiction:
Improvecalibration processVSAvoidvirtual object placement
Core Design Contradiction:
Ease of manufactureVSManufacturing precision

Solution Approach 1:

The system automatically detects the user's IPD and computes the calibrated view matrix without requiring manual measurement or pre-calibration, enabling accurate virtual object placement relative to the real-world background while maintaining simple manufacturing and deployment processes

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system uses camera-based eye tracking to detect actual eye positions and uses this feedback information to compute and adjust the view matrix, ensuring that virtual objects are placed accurately relative to the real-world background by compensating for individual IPD variations

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS9746675B2Alignment based view matrix tuning
Publication Date: 2017.08.29 MICROSOFT TECHNOLOGY LICENSING LLC
  • US9746675B2 patent drawing
  • US9746675B2 patent drawing
  • US9746675B2 patent drawing

AI summary

A head-mounted display device is disclosed, which includes an at least partially see-through display, a processor configured to detect a physical feature, generate an alignment hologram based on the physical feature, determine a view of the alignment hologram based on a default view matrix for a first eye of a user of the head-mounted display device, display the view of the alignment hologram to the first eye of the user on the at least partially see-through display, output an instruction to the user to enter an adjustment input to visually align the alignment hologram with the physical feature, determine a calibrated view matrix based on the default view matrix and the adjustment input, and adjust a view matrix setting of the head-mounted display device based on the calibrated view matrix.