HMD Hand Detection Feedback Loop
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current head-mounted display (HMD) systems for augmented reality (AR) struggle with continuous hand detection, requiring improvement in detection accuracy, versatility, and cost-effectiveness, as users often lose track of their hand's position within the detection region.
Innovation Solution
A head-mounted display apparatus equipped with an augmented-reality processing unit, a detecting unit, and a notifying unit that generates image data to embed a partial hand image or frame within the virtual image, providing notifications through sound or visual cues when the hand approaches the detection region's periphery, ensuring continuous detection and improved accuracy.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the user moves the hand based on past experience and projected virtual image, then the user can operate the system, but the hand detection accuracy deteriorates because the hand moves out of the detection region
Solution Approach 1:
The system provides visual feedback by overlaying the detected hand image onto the virtual image, allowing the user to see the hand's position in real-time. This feedback loop enables the user to adjust hand position to maintain detection accuracy while continuing to operate the system intuitively.
Solution Approach 2:
The patent introduces an intermediary visual representation (the overlaid hand image) that mediates between the user's physical hand and the detection system. This intermediary allows the user to understand the detection status without directly observing the camera's field of view, solving the contradiction between natural hand movement and detection accuracy.
2Reliability
If the hand detection region is made larger to improve detection reliability, then the detection coverage increases, but the device complexity increases due to additional notification mechanisms
Solution Approach 1:
The patent merges the notification function with the existing virtual image display system by overlaying visual cues directly onto the virtual image. This integration approach provides additional detection region guidance without requiring separate notification hardware, thus improving reliability while minimizing increases in device complexity.
Solution Approach 2:
The visual notification elements serve as intermediaries that convey detection region boundary information to the user without requiring direct modification of the detection region itself. This allows the system to maintain reliable detection while providing guidance through the virtual image interface.
3Measurement precision
If the hand detection is made more sensitive to improve accuracy, then the detection precision increases, but the loss of information increases when the hand moves near the detection boundary
Solution Approach 1:
The system provides continuous visual feedback showing the hand's position relative to the detection region boundaries. When the hand approaches the boundary, the notification mechanism alerts the user, preventing complete loss of detection information and allowing the user to adjust before the hand exits the detection region.
Solution Approach 2:
The notification mechanism acts as a cushioning measure by alerting the user before the hand completely exits the detection region. This advance warning prevents total loss of detection information and gives the user time to adjust hand position, maintaining continuous detection accuracy.
Data Source
AI summary
When a hand of the user is recognized in an image pickup region of a camera, a head mounted display monitors behavior of the hand in the image pickup region. When the hand of the user in the image pickup region reaches an outer peripheral region forming an outer periphery of the image pickup region, a notification is give to the user.