Head-Mounted Display Gesture Control Without Handheld Controllers
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing head-mounted display systems require users to hold a handheld controller for inputting data or commands, limiting quick and efficient operation.
Innovation Solution
A head-mounted display system that includes an image capturing device and processor to analyze real-time images and inertial measurement parameters from a wearable device, generating control signals based on user postures and gestures without the need for a handheld controller.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If users operate physical buttons on a handheld controller, then control input can be achieved, but the user cannot perform additional operations and input efficiency is reduced
Solution Approach 1:
The patent replaces the mechanical button-pressing system with an optical recognition system. The image capturing device captures images of the user's hand gestures, and the processor analyzes these images to recognize gestures and generate corresponding control signals, eliminating the need for physical button interaction.
Solution Approach 2:
The patent uses image copying to capture and analyze hand gesture information. Instead of requiring direct physical interaction with controller buttons, the system captures visual copies of hand gestures through the image capturing device and processes these copies to generate control signals.
2Ease of operation
If users hold a handheld controller, then control operations can be performed, but the user's hands are occupied and cannot perform other operations
Solution Approach 1:
The system uses the user's own body (hands) as the control interface instead of requiring an external controller. The image capturing device captures images of the user's hands, and the processor recognizes gestures to generate control signals, allowing the user to control the head-mounted display using their own hands without needing to hold an external device.
3Ease of operation
If physical buttons on a controller are used for data input, then control commands can be input, but quick input is difficult to achieve
Solution Approach 1:
The image capturing device continuously captures images at regular intervals, allowing the system to detect and recognize gestures in real-time. This periodic capture enables quick gesture recognition and control signal generation without requiring the user to deliberately press buttons at specific moments.
Solution Approach 2:
The system preliminarily captures images of the user's hands continuously, so when a gesture is made, the system is already prepared to detect and recognize it immediately. This preliminary image capture eliminates the delay associated with waiting for button presses or deliberate input actions.
Data Source
AI summary
A head-mounted display, controlling method, and non-transitory computer readable storage medium thereof are provided. The head-mounted display determines a first posture among a plurality of postures based on a plurality of real-time images. The head-mounted display generates a first gesture among a plurality of gestures corresponding to a user according to a plurality of inertial measurement parameters corresponding to a first body part of the user. The head-mounted display generates a control signal corresponding to a first output event among a plurality of output events based on the first gesture and the first gesture.