Millimeter Wave Eye Tracking for HMD Aberration Correction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Virtual reality head-mounted displays (HMDs) often present distorted images due to optical aberrations when the user looks away from the center of the field of view, as existing technologies fail to accurately track eye movement and adjust images in real-time to eliminate such distortions.
Innovation Solution
The use of a backscatter method on millimeter waves with a circular array of miniaturized antenna elements outside the user's field of view to track eye position and adjust image data in real-time, eliminating chromatic aberrations by comparing multidimensional data from the antenna array with stored data to determine the user's gaze position.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If traditional optical methods are used for eye tracking, then the system structure is simple, but the measurement precision and accuracy of eye position tracking deteriorates
Solution Approach 1:
The patent replaces traditional optical/mechanical eye tracking methods with millimeter wave radar technology. The system uses mmWave antennas to transmit and receive electromagnetic waves that interact with the eye, enabling non-contact, high-precision eye position tracking without complex optical components or mechanical movements.
Solution Approach 2:
The patent changes the physical parameter used for measurement from optical methods to electromagnetic wave parameters (millimeter waves). By using mmWave signals and analyzing their interaction with the eye (backscatter, phase, amplitude), the system achieves high measurement precision while simplifying the overall device structure.
2Reliability
If real-time image adjustment is implemented to eliminate optical aberrations, then the viewing quality improves, but the processing time and system response delay worsen
Solution Approach 1:
The system performs preliminary eye position detection using millimeter wave radar to determine gaze direction before image rendering. By pre-calculating the required image adjustments based on detected eye position, the system reduces real-time processing delays and achieves smoother, more responsive visual output.
Solution Approach 2:
The patent implements a feedback loop where millimeter wave eye tracking continuously monitors eye position, feeds this information to the image processing system, and dynamically adjusts the displayed image in real-time. This closed-loop feedback mechanism ensures high viewing quality while minimizing processing delays through efficient real-time coordination.
3Productivity
If millimeter wave antenna arrays are used for eye tracking, then the measurement precision and tracking speed improve, but the device complexity and power consumption worsen
Solution Approach 1:
The patent divides the eye tracking function into multiple antenna elements arranged in specific patterns. Each antenna element handles a portion of the measurement task, and the results are combined to achieve comprehensive eye position tracking. This segmentation enables high tracking speed and precision while distributing the system complexity across multiple simple, identical components.
Solution Approach 2:
The millimeter wave antenna elements serve multiple functions: transmitting radar signals, receiving backscatter signals, and enabling eye position detection. By making the antenna array multi-functional, the system achieves high productivity and measurement precision without proportionally increasing device complexity, as the same components perform multiple tasks.
4Reliability
If optical aberrations are corrected through image processing, then the viewing quality improves, but the energy consumption and processing load worsen
Solution Approach 1:
The system performs preliminary eye position detection using low-power millimeter wave radar to determine gaze direction before intensive image processing. By pre-determining the required corrections based on eye position, the system reduces the computational load and energy consumption during actual image rendering and adjustment operations.
Solution Approach 2:
The patent changes the approach from processing complex optical aberration data to using simple millimeter wave parameters (phase, amplitude, frequency) for eye tracking. This parameter change enables efficient, low-power eye position detection that guides subsequent image processing, reducing overall energy consumption while maintaining high viewing quality.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach provides low-power, fast, and accurate eye tracking, resulting in an improved viewing experience by eliminating optical and chromatic aberrations, offering a more stable and distortion-free virtual reality environment.
Implementation Method 1
receiving backscatter waves from the eye of the user
Implementation Method 2
transmitting a first signal by a first antenna element... receiving a second signal by at least a second antenna element
Data Source
AI summary
The disclosed computer-implemented method may include transmitting a first signal by a first antenna element included in a head mounted display system, analyzing the second signal to determine multidimensional data for the second signal, comparing the multidimensional data for the second signal to known multidimensional data related to positions of a gaze of an eye of a user in the head mounted display system, identifying a position of a gaze for an eye of a user in the head mounted display system based on the comparison, and adjusting image data for display on a display device included in the head mounted display system based on the identified position of the gaze of the eye of the user. Various other methods, systems, and computer-readable media are also disclosed.