Transparent HMD Hand Orientation Control for Immersive Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional wearable devices, such as head-mounted displays (HMDs), limit user convenience through interactions based on voice recognition or physical touch recognition, which do not provide an immersive experience.
Innovation Solution
An HMD device that understands user intentions by analyzing the direction in which the user's hand is facing, allowing for interactions based on hand gestures to enhance immersion.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If voice recognition or physical touch recognition is used for interaction, then the device can be operated, but user convenience and immersion are limited
Solution Approach 1:
The patent replaces traditional mechanical interaction methods (voice recognition, physical touch) with air gesture recognition. The controller detects hand movements and gestures in the air space around the device, substituting physical contact-based interaction with motion-based interaction. This is achieved through sensors that capture hand position and gesture data, which the controller then processes to execute commands without requiring voice or touch input.
2Adaptability or versatility
If conventional interaction methods are used, then the device functions can be accessed, but immersive experience is reduced
Solution Approach 1:
The patent introduces dynamic gesture recognition that adapts to user movements in real-time. The system recognizes various hand gestures (pointing, swiping, pinching) and dynamically responds to them, creating a more immersive experience. The gesture recognition system continuously tracks hand position and movement patterns, allowing for natural and intuitive interaction that enhances user immersion while maintaining versatile functionality.
Data Source
Figure 1
Figure 2(a)~3
Figure 4~5
AI summary
Provided are an HMD device and operating method thereof. The operating method of an HMD device includes displaying at least one object in a display area of a transparent display, obtaining an image of a hand of a user interacting with the displayed object; determining a direction in which the hand is facing based on the obtained image, and performing a function for the object corresponding the direction in which the hand is facing.