AR Display Frame Retention After Hand-Gesture Recognition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality systems require users to maintain hand gestures for framing, leading to fatigue and potential hand shadows, which can disrupt intended processing.
Innovation Solution
An information processing device that recognizes a particular hand gesture, displays a framing frame based on it, and maintains the frame for a predetermined time, allowing for continued processing even after the gesture is completed.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the user maintains a hand gesture for framing in real-time, then the shooting frame can be determined intuitively, but the user's arms become fatigued and the position of the shooting frame changes
Solution Approach 1:
The system captures the hand gesture frame information at the moment the gesture is formed, stores it temporarily, and then uses this pre-captured information for a predetermined period. This preliminary capture of the gesture data allows the shooting frame to be determined intuitively when the gesture is made, while the stored frame information maintains position stability during the subsequent display period even after the user releases the gesture.
2Ease of operation
If the user forms a trimming pose in AR space, then the angle of view can be determined intuitively, but shadows from the user's hands appear on the subject
Solution Approach 1:
The system captures the hand gesture frame information at the moment the gesture is formed and then displays this captured frame information for a predetermined period. This allows the angle of view to be determined intuitively through the hand gesture, while the processing is based on the captured frame data rather than requiring continuous gesture maintenance, thereby preventing hand shadows from appearing on the subject during the display period.
3Productivity
If the system requires continuous hand gesture recognition for frame display, then the framing remains responsive to user input, but the user experiences fatigue and operational difficulty
Solution Approach 1:
The system captures the hand gesture frame information at the moment the gesture is formed and then displays this captured information for a predetermined period without requiring continuous gesture recognition. This preliminary capture approach maintains framing responsiveness at the moment of gesture input while eliminating the need for continuous gesture maintenance, thereby improving user operational comfort and reducing fatigue.
Data Source
AI summary
An information processing device is capable of causing a user to visually recognize a real space via a display. The information processing device recognizes a particular hand gesture performed by the user. The information processing device 1) displays a first frame in accordance with the particular hand gesture on the display, and 2) continues displaying the first frame for at least a predetermined amount of time after the particular hand gesture is recognized, even in a case where a state transitions to a state where the particular hand gesture is not recognized after the first frame is displayed The information processing device, in a state where the first frame is displayed on the display, executes particular processing with regard to a range of the real space indicated by the first frame out of the real space.