Head-Mounted Display Dynamic Image Repositioning for Gaze Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing head-mounted displays (HMDs) cannot provide a clear image of objects near the optical axis when the user's visual line is shifted away from the center of the display, as the image of such objects is fixed to the center and cannot be dynamically adjusted to follow the user's gaze direction.
Innovation Solution
The HMD system includes a camera with adjustable optical axes and sensors to track the user's visual line, allowing the image of objects near the optical axis to be dynamically repositioned within the display to align with the user's visual line, ensuring a clear and stable image presentation regardless of the user's gaze direction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If the image of objects near the optical axis is fixed to the center of the display, then the device complexity is reduced, but the image clarity when the user's visual line is shifted away from the center deteriorates
Solution Approach 1:
The patent implements dynamic image positioning where the image of objects near the optical axis is no longer fixed to the display center but is instead repositioned according to the user's visual line direction. The display control unit dynamically adjusts the image position based on real-time detection of the user's gaze, allowing the clear image to follow the user's visual attention regardless of where they are looking on the display.
Solution Approach 2:
The system employs visual line detection to track the user's gaze direction and uses this feedback information to control the positioning of the clear image on the display. The display control unit continuously receives visual line direction data and adjusts the image position accordingly, creating a closed-loop system that maintains image clarity aligned with user attention.
2Manufacturing precision
If the image position is dynamically adjusted to follow the user's visual line, then the image clarity is improved, but the device complexity increases
Solution Approach 1:
The display control unit performs multiple functions: it processes the captured image data, detects the user's visual line direction, calculates the appropriate image position, and renders the final display output. By consolidating these functions into a single control unit, the system achieves dynamic image positioning without proportionally increasing overall device complexity.
Solution Approach 2:
The display control unit acts as an intermediary between the image capture unit and the display unit, processing visual line detection data and adjusting image positioning accordingly. This intermediary layer enables sophisticated image positioning functionality while maintaining a relatively simple overall system architecture by handling complexity within a dedicated control module.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This solution enables the user to maintain a clear view of objects by adjusting the image position within the display to match the visual line direction, enhancing the usability and effectiveness of the HMD system by maintaining a clear image of objects regardless of the user's gaze direction.
Implementation Method 1
In the image captured by a camera, an object appears more clearly the closer it is to the optical axis of the camera
Implementation Method 2
there exists a technology for visual line tracking allowing the direction of the user's visual line to be tracked using iris detection
Data Source
Figure 1
Figure 2
Figure 3~4
AI summary
There are provided a head-mounted display, a display control method, and a program for changing the position of the image of an object near the optical axis of a camera in an image displayed on a display section. A camera control section (62) controls the direction of the optical axis of the camera capturing an image of what is ahead of the display section disposed in front of the user's eyes. A display control section (70) causes the display section to display a partial image cut out from the image captured by the camera, the partial image constituting a portion corresponding to the optical axis direction of the camera.