Head-Mounted Display Line-of-Sight Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing head-mounted display devices face limitations in operability, convenience, and the ability to control functions without manual input, particularly in recognizing and controlling virtual interfaces and external scenery, with existing technologies relying on eye movements, eyelid status, and requiring external interfaces like keyboards.
Innovation Solution
A transmissive head-mounted display device that includes an image display unit, a detection unit for line-of-sight direction and shielding objects, and a control unit to manage image light based on detected inputs, allowing users to control the device solely with their line-of-sight direction and eyelid status without external interfaces.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If head-mounted display devices use traditional input devices like keyboards and mice, then operational control is achieved, but device complexity and portability are reduced
Solution Approach 1:
The patent replaces mechanical input devices (keyboards, mice) with an optical detection system that tracks eye movements and eyelid positions. The detection unit captures images of the user's eyes, and the control unit translates these visual inputs into control commands, eliminating the need for external mechanical interfaces and enabling hands-free operation.
Solution Approach 2:
The system uses the user's own physiological features (eye movements, eyelid status) as the input mechanism. The detection unit monitors the user's natural eye behaviors, and the control unit interprets these self-generated signals to control the device, allowing the user to operate the system without external tools.
2Ease of operation
If head-mounted display devices allow visual recognition of outside scenery, then user convenience is improved, but control precision is reduced
Solution Approach 1:
The detection unit separately processes information from each eye independently. By capturing and analyzing images of both eyes separately, the system can determine line-of-sight direction and eyelid status for each eye individually, then integrate this information to achieve precise control while maintaining the ability to recognize outside scenery.
Solution Approach 2:
The patent introduces an image processing intermediary system that captures visual information about the eyes and outside scenery simultaneously. The detection unit acts as an intermediary that separates and processes eye-related signals from the broader visual field, enabling precise eye movement detection while maintaining awareness of the external environment.
3Extent of automation
If head-mounted display devices use eye movement detection for control, then hands-free operation is achieved, but operability complexity increases
Solution Approach 1:
The detection unit serves multiple functions: it detects line-of-sight direction, determines eyelid status (open/closed/partially closed), and identifies user intent. This multi-functional detection system consolidates what would otherwise require separate sensors and processing units, achieving high automation while managing system complexity through functional integration.
Solution Approach 2:
Instead of using external devices to detect eye movements, the patent inverts the approach by using the head-mounted display's own display medium to both present information and detect eye responses. The display unit serves dual purposes: showing content and providing the detection surface for analyzing eye position and eyelid status, thereby simplifying the overall system architecture.
Data Source
AI summary
A transmissive head-mounted display device includes an image display unit, a detection unit, a control unit, an imaging unit, and an imaging setting unit. The display unit generates image light representing an image, allows a user to visually recognize the image light, and transmits outside scenery when worn on a head of a user. The detection unit detects a shielding object that is located at a predetermined distance from an eye of the user. A control unit performs control of the image light based on the detection result of the detection unit. The imaging unit images the outside scenery. The imaging setting unit adjusts the imaging unit. The imaging setting unit shifts a display mode of the image display unit to an imaging adjustment mode based on the detection result of the detection unit.