Hand Tracking for Transparent Head-Mounted Display Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current head-mounted displays (HMDs) have limited and inefficient input methods, such as buttons and touch pads, which hinder user interaction with graphical user interfaces (GUIs) and augmented reality applications.
Innovation Solution
The use of object tracking technology within HMDs allows users to interact with GUIs and augmented reality by using their hands or other objects, enabling selection of visual elements within larger active regions, which simplifies navigation and interaction by tracking the movement and position of physical objects within the display area.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If buttons and touch pads are used for input in HMDs, then input functionality is provided, but the input devices become bulky and operation efficiency deteriorates
Solution Approach 1:
The patent removes traditional physical input devices (buttons, touch pads) from the HMD system and replaces them with hand-based interaction. The hand itself becomes the input device, eliminating the need for separate bulky components while maintaining input functionality through natural gestures and positioning.
Solution Approach 2:
The hand serves multiple input functions simultaneously - positioning, selecting, and navigating - replacing multiple specialized input devices. The same hand gesture can perform different operations depending on context, making the input system more efficient and less complex.
2Measurement precision
If precise selection of visual elements is required, then selection accuracy is improved, but the time and difficulty of interaction increases
Solution Approach 1:
The patent divides the selection process into two parts: the visual element itself and a surrounding active region. Users select elements by positioning their hand within the larger active region rather than precisely targeting the small visual element, maintaining accuracy while reducing interaction time and difficulty.
Solution Approach 2:
The patent adds spatial dimension to selection by introducing active regions that extend beyond the visual elements themselves. This creates a tolerance zone in three-dimensional space, allowing users to select elements through approximate positioning rather than precise targeting.
Data Source
AI summary
Embodiments of the present invention are directed toward enabling a user to quickly interact with a graphical user interface (GUI) displayed by the HMD. Utilizing techniques provided herein, a hand or other object can be used to select visual elements displayed by the HMD. The visual elements can be located within larger active regions, allowing the user to more easily select a visual element by selecting the active region in which the visual element is disposed.