Head-Mounted Display Distance Estimation via Vestibulo-Ocular Reflex
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing head-mounted display apparatuses face challenges in accurately estimating distances to target objects in virtual reality, augmented reality, or mixed reality environments, as they rely on schematic estimations or multiple stereo cameras, which may not provide seamless integration of virtual objects with peripheral scenes.
Innovation Solution
A head-mounted display apparatus equipped with at least one camera, sensor, and processor that acquires head pose and gaze direction information to estimate gaze lines and distances to target points, utilizing the vestibulo-ocular reflex to stabilize gaze and enhance distance estimation accuracy.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If multiple stereo cameras are used to acquire distance information of peripheral objects, then measurement precision of distance is improved, but device complexity increases
Solution Approach 1:
The patent extracts and utilizes the natural vestibulo-ocular reflex (VOR) mechanism from the user's biological system to perform distance estimation. Instead of relying on complex multi-camera hardware, the system leverages the user's own eye movement responses to head rotation, thereby achieving accurate depth perception with simpler sensor requirements.
Solution Approach 2:
The system makes the user's own physiological response (VOR) serve the distance estimation function. The user's natural eye movement in response to head rotation provides the necessary data for depth calculation, eliminating the need for external active sensing mechanisms and reducing overall system complexity.
2Measurement precision
If depth camera is used to estimate distance to target object, then measurement precision is improved, but device complexity increases
Solution Approach 1:
The patent replaces mechanical/optical depth sensing systems (such as structured light projectors or time-of-flight sensors) with a computational approach that utilizes natural physiological responses. The distance estimation is achieved through algorithmic processing of eye movement data rather than through complex mechanical or optical ranging mechanisms.
3Device complexity
If schematic estimation through user's eyes is used, then device complexity is reduced, but measurement precision deteriorates
Solution Approach 1:
The system implements a feedback mechanism by continuously monitoring the user's eye movement in response to controlled head rotation. The processor analyzes the relationship between head pose changes and gaze direction changes, using this feedback loop to calculate accurate distance information without requiring complex hardware.
Solution Approach 2:
The patent introduces dynamic head rotation as an active probe to elicit the vestibulo-ocular reflex. By dynamically changing the head pose and measuring the corresponding dynamic eye movement response, the system transforms a static estimation problem into a dynamic measurement process, thereby improving accuracy with simple sensors.
Data Source
AI summary
A head-mounted display apparatus is provided. The head-mounted display apparatus includes at least one camera, at least one sensor, and at least one processor operatively connected to the at least one camera and the at least one sensor. The at least one processor may be configured to acquire information about head pose and head-based gaze direction of a user, based on data input from the at least one sensor and multiple key points input from the at least one camera according to recognizing rotation of a user's head, estimate gaze lines of the user, based on the acquired information about head pose and head-based gaze direction, and estimate a distance to a target point, based on the gaze lines of the user, according to identifying that vestibulo-ocular reflex is activated based on the gaze lines of the user.