HMD Hand Authentication Using Motion-Guided Visual Recognition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing HMD authentication methods are either insecure, allowing operation by unauthorized hands after authentication, or require expensive sensor devices that burden users.
Innovation Solution
A control apparatus for HMDs that captures a wearer's field of view, prompts a motion instruction, and authenticates the hand performing the motion closest to the instruction using image recognition and comparison, without the need for additional sensor devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If authentication is performed based on determination pattern input by HMD wearer, then HMD wearer authentication is achieved, but control right is not granted to authenticated hand allowing operation by others
Solution Approach 1:
The authentication process is segmented into two distinct phases: first, determining whether the hand belongs to the authorized wearer through determination pattern matching; second, assigning control right to the specific hand that successfully authenticated. This segmentation ensures both reliable authentication and proper control right assignment to the authenticated hand.
Solution Approach 2:
The system provides feedback by displaying the determination pattern on the HMD screen, allowing the wearer to confirm their hand is correctly identified. The control right is then assigned based on this feedback, ensuring the authenticated hand receives control authority.
2Measurement precision
If sensor device is attached to hand for authentication, then hand authentication accuracy is improved, but device cost and user burden increase
Solution Approach 1:
Instead of using expensive sensor devices attached to the hand, the system creates a visual copy of the hand's determination pattern through image capture. This optical copy is then processed to authenticate the hand, eliminating the need for physical sensor attachments while maintaining authentication accuracy.
Solution Approach 2:
The mechanical sensor device is replaced with an optical imaging system. The image sensor captures visual information about the hand's determination pattern, and the control apparatus processes this visual data to achieve hand authentication without requiring physical sensor attachments.
3Reliability
If multiple hands are detected in field of view, then hands of others can be identified, but authentication complexity increases
Solution Approach 1:
The system applies local quality by focusing the authentication process on specific local features of the hand - the determination pattern formed by the fingers or hand posture. This localized feature extraction allows accurate identification of the wearer's hand among multiple hands present in the field of view.
Solution Approach 2:
The determination pattern is captured and processed in advance before actual control operations begin. By pre-establishing which hand corresponds to the wearer through the determination pattern, the system simplifies subsequent authentication processing and reduces complexity during actual use.
Data Source
AI summary
A control apparatus for a head-mounted display (HMD) according to the present disclosure includes an image sensor and a display, wherein the control apparatus is configured to give a motion instruction that prompts the wearer to perform a motion to be executed using a hand or finger, and in a case where it is determined that a plurality of hands detected from a captured image obtained by the image sensor are performing a motion according to the motion instruction, authenticate a hand performing a motion closest to a motion according to the motion instruction among the plurality of hands as a hand of the wearer.