HMD Gesture Recognition via Hand Shape Detection and Timing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users unfamiliar with operations using head-mounted displays (HMDs) face difficulties in performing intuitive gestures for designating and specifying regions due to the lack of a proper input interface, leading to misrecognition and reduced efficiency in field work applications.
Innovation Solution
An image processing apparatus that recognizes intuitive operations performed in the air by detecting specific hand shapes and movements, allowing for correct identification of designation and specification operations, even if the user is unfamiliar with the interface, by using a processor to analyze images from an integrated image capturing device and display device.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If head-mounted displays are used for field work applications, then hands-free operation is enabled, but user unfamiliarity with intuitive gestures leads to misrecognition and reduced efficiency
Solution Approach 1:
The system provides visual feedback by displaying the detected hand shape and recognition results on the HMD display. This allows users to confirm whether their gestures are being correctly recognized, enabling them to adjust their hand shapes if misrecognition occurs, thereby improving both ease of operation and productivity
Solution Approach 2:
The system performs preliminary recognition of hand shapes before executing operations. By detecting and validating hand shapes in advance, the system ensures accurate operation recognition before committing to actions, reducing misrecognition errors and improving work efficiency
2Measurement precision
If complex gesture recognition is implemented for accurate operation detection, then recognition accuracy improves, but system complexity increases
Solution Approach 1:
The gesture recognition system is divided into distinct functional modules: hand shape detection module, operation type determination module, and display control module. Each module handles a specific aspect of gesture recognition, making the overall system more manageable and easier to implement while maintaining high recognition accuracy
Solution Approach 2:
The system recognizes different operation types by detecting changes in hand shape parameters (such as finger extension, hand orientation, and shape configuration). By monitoring parameter changes rather than requiring complex absolute position tracking, the system achieves accurate recognition with relatively simple processing
Data Source
AI summary
An image processing apparatus including a memory, and a processor configured to make a display device display an image captured by an image capturing device, measure a time for which a hand region remains still when detecting the hand region in a first specific shape corresponding to a designation operation of designating a part in the image, identify the part designated by the designation operation when the time for which the hand region remains still reaches a predetermined time, and make a display device display an image resulting from execution of predetermined image processing for the identified part when at least one of a hand region in a second specific shape and a specific movement of a hand region is detected in the image captured by the image capturing device.