Automatic Pupil Detection Using Eye Reflections for WHUD Fitting

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing wearable heads-up displays (WHUDs) require precise alignment of the user's eyes with the eyebox, necessitating manual pupillary distance measurements that are often imprecise, posing a barrier to widespread adoption due to the need for eye exams by professionals.

Innovation Solution

A computer-implemented method using a camera and light source to detect pupillary positions by capturing image data, identifying eye reflections, and estimating pupillary positions through convolution kernels, adjusting for lighting conditions and optical axes to ensure accurate alignment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual measurement methods are used to determine IPD, then the measurement process is simple, but the measurement precision is insufficient for WHUD sizing

Engineering Contradiction:
Improvepupillary position measurement precisionVSAvoidmeasurement system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces manual mechanical measurement methods with an automated optical system using a camera and light source to capture and analyze pupillary reflections, thereby improving measurement precision while eliminating the need for professional eye examiners

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system enables self-measurement of IPD by capturing images of the user's eyes and automatically processing the data to determine pupillary positions, allowing users to perform the measurement themselves without requiring professional assistance

Inventive Principle:
Principle #25Self-service

2Measurement precision

If professional eye exams are required for IPD measurement, then measurement precision is improved, but the ease of operation deteriorates due to accessibility barriers

Engineering Contradiction:
Improvepupillary position measurement precisionVSAvoidaccessibility of measurement
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The system enables users to perform their own IPD measurements using a portable electronic device, eliminating the need to visit eye doctors or clinics and making the measurement process accessible to anyone with the device

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces the need for professional eye examiners with an automated computational system that uses image processing algorithms to accurately determine pupillary positions from captured images

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Productivity

If automated pupillary detection is implemented, then productivity is improved, but measurement precision may deteriorate without proper lighting control

Engineering Contradiction:
Improvemeasurement efficiencyVSAvoidpupillary position accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The system uses a flash light source that activates periodically during image capture to provide controlled illumination, ensuring consistent lighting conditions that enhance the accuracy of pupillary reflection detection while maintaining high measurement efficiency

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The patent changes the lighting parameter by introducing a flash-based illumination system that temporarily increases light intensity during capture, thereby improving the visibility of pupillary reflections and the accuracy of automated detection without requiring prolonged exposure

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables precise and automated pupillary position detection without the need for professional measurements, facilitating efficient sizing and fitting of WHUDs.

Implementation Method 1

causing the camera to capture image data representative of a front portion of the head of the subject

Methodology Applied
Scientific EffectLight reflection: Reflection

Implementation Method 2

detecting a reflection of the light source on each identified eye

Methodology Applied
Scientific EffectLight reflection: Reflection

Data Source

PatentUS12605065B2Method and system for automatic pupil detection
Publication Date: 2026.04.21 GOOGLE LLC
  • US12605065B2 patent drawing
  • US12605065B2 patent drawing
  • US12605065B2 patent drawing

AI summary

Systems and methods of detecting pupillary positions on a head of a subject are described. While a camera and a light source are positioned in front of the head of the subject, the camera is caused to capture image data representative of a frontal portion of the head of the subject. From the image data, a face of the subject is detected. Up to two eyes are identified from the detected face. A reflection of the light source on each identified eye is detected. A pupillary position of each identified eye is estimated based on a position of the detected light source reflection on the identified eye. One or more of interpupillary distance, left pupil distance, and right pupil distance may be determined from the estimated pupillary positions.