Eye Tracking Near-Eye Display Interaction Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing near-eye display devices face challenges in efficiently rendering 3D environments and providing intuitive user interactions, particularly in virtual reality, augmented reality, and mixed reality applications.
Innovation Solution
The integration of eye tracking technology with other input methods, such as finger gestures, hand gestures, body movements, and secondary device inputs, allows for precise control of interaction with displayed content in near-eye display devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If traditional input methods (buttons, controllers) are used in near-eye display devices, then user interaction control is achieved, but device complexity and power consumption increase
Solution Approach 1:
The patent replaces mechanical input devices (buttons, controllers) with an optical-based eye tracking system. The eye tracking system uses cameras and image processing to detect eye movements, gaze direction, and facial expressions, substituting mechanical interaction with optical and computational methods. This reduces the physical complexity of the device while maintaining or improving ease of operation.
Solution Approach 2:
The eye tracking system enables the device to automatically detect and interpret user intent through natural eye movements and facial expressions without requiring manual activation of controls. The system continuously monitors眼部 movements and automatically translates them into interaction commands, making the device more responsive and easier to operate without additional mechanical components.
2Ease of operation
If traditional input methods are used in near-eye display devices, then user interaction is achieved, but power consumption increases
Solution Approach 1:
The patent replaces power-intensive mechanical input devices with a more energy-efficient eye tracking system. The eye tracking cameras and processing algorithms consume less power than traditional controllers, buttons, or haptic feedback mechanisms, thereby reducing overall device power consumption while maintaining ease of operation.
Solution Approach 2:
The eye tracking system uses periodic sampling of eye movements and facial expressions at optimized intervals rather than continuous high-power monitoring. This periodic action reduces power consumption while still capturing sufficient data for accurate interaction control, balancing energy efficiency with operational responsiveness.
3Measurement precision
If eye tracking is integrated with multiple input methods, then interaction precision is improved, but device complexity increases
Solution Approach 1:
The patent merges eye tracking data with other input sources (head movement sensors, touch inputs, voice commands) into a unified interaction system. By combining multiple sensing modalities, the system achieves higher interaction precision through data fusion and cross-validation, while the integrated architecture manages complexity through coordinated processing rather than separate systems.
Solution Approach 2:
The eye tracking system serves multiple functions simultaneously: detecting gaze direction, determining selection intent, measuring interaction duration, and triggering actions. This multi-functionality reduces the need for separate specialized components, managing device complexity while enhancing interaction precision through diverse data collection from a single integrated system.
Data Source
AI summary
Mixed reality (MR) user interactions are enabled through a combination of eye tracking (user gaze determination) and secondary inputs such as finger gestures, hand gestures, eye gestures, wrist band device input, handheld controller input, and the like. A location of interest (LOI) may be identified in displayed content and/or the external environment through the user's gaze, fixation, and/or saccades, and then other actions, such as zoom, rotate, pan, move, open actionable menus, etc., may be performed on the LOI based on the secondary inputs.