HMD Display–Eye-Tracking Camera Calibration After Frame Drift

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The position and orientation of a display in a head-mounted device (HMD) relative to an eye-tracking camera can drift during use due to flexibility in the frame, causing discomfort for the user.

Innovation Solution

Perform calibration of the display with respect to the eye-tracking camera after usage by determining the current position of reflected pixels within the eye-tracking camera's field of view and comparing it to the factory-calibrated position, adjusting the display's position accordingly.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the frame of the HMD is made flexible to improve user comfort and adaptability, then the display position and orientation drift relative to the eye-tracking camera, but this drift causes discomfort and reduces measurement precision

Engineering Contradiction:
Improveframe flexibilityVSAvoiddisplay-camera alignment
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The system captures images of the display through the eye-tracking camera to detect the actual position and orientation of the display. This feedback information is used to calculate transformation parameters that compensate for drift, thereby maintaining alignment between the display and camera despite frame flexibility

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system dynamically adjusts transformation parameters (rotation and translation) based on detected display position and orientation. By changing these parameters in real-time, the system compensates for drift caused by frame flexibility while maintaining measurement precision

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Maintains calibration of the display with respect to the eye-tracking camera, ensuring user comfort during HMD usage.

Implementation Method 1

capturing, via an eye-tracking camera on a head-mounted display (HMD), a reflection of a pixel from a first lens of the HMD where the pixel is illuminated within a display

Methodology Applied
Scientific EffectReflection: Reflection

Data Source

PatentUS12380603B2Extrinsic calibration between display and eye-tracking camera in head-mounted devices
Publication Date: 2025.08.05 GOOGLE LLC
  • US12380603B2 patent drawing
  • US12380603B2 patent drawing
  • US12380603B2 patent drawing

AI summary

Techniques include performing a calibration of the display with respect to the eye-tracking camera after usage. The calibration involves determining a current position of a reflected pixel of the display within a field of view of the eye-tracking camera and comparing that position with a calibration position, for example a position seen at the factory. The pixel may then be shifted according to the difference between the current position and the calibration position.