VR Gesture Control Using Depth Zones
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing VR devices with HMDs face limitations in control functionality, efficiency, and user-friendliness due to reliance on physical hardware like handles and touchpads, leading to fatigue and difficulty in complex operations, as well as the inability to interact with external environments.
Innovation Solution
A gesture control method using a depth sensor to detect hand movements and differentiate between selection and command areas based on depth distance, allowing users to interact with VR devices without external hardware, enabling intuitive control of applications and page navigation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If physical hardware such as handles or touchpads is used for control operations, then the device can perform basic navigation functions, but the control function is limited and instruction implementation efficiency is low
Solution Approach 1:
The patent introduces depth distance as a new dimension for gesture recognition. By detecting the depth distance between the hand and the display interface, the system distinguishes between selection gestures (hand close to interface) and command gestures (hand far from interface), enabling more complex operations without additional physical hardware.
Solution Approach 2:
The control space is segmented into multiple depth zones: a first depth distance range for selection operations and a second depth distance range for command operations. This segmentation allows different types of interactions to be performed in different spatial zones, expanding control functionality while maintaining efficiency.
2Ease of operation
If physical hardware such as touchpads is used for control operations, then basic navigation is possible, but the control operation is not user-friendly and easily causing fatigue
Solution Approach 1:
The patent replaces mechanical control systems (physical handles and touchpads requiring continuous hand holding) with a gesture-based system that uses natural hand movements in 3D space. Users can perform operations by moving their hands to different depth positions without needing to maintain a gripping posture, significantly reducing fatigue.
3Ease of operation
If physical hardware such as handles is used for control operations, then interface control is possible, but after HMD device is worn, user cannot see external environment and difficult to find handle or touchpad, usually causing incidental touch
Solution Approach 1:
The patent moves the control interface from a 2D surface (physical handle or touchpad location) to a 3D spatial domain. Users control the interface by positioning their hands at specific depth distances from the display, making the control mechanism visible and intuitive while eliminating the need to locate physical components in the dark.
Solution Approach 2:
The system creates a virtual representation of the control interface in the user's visual field. The display interface itself becomes the control surface, with virtual elements responding to hand gestures at different depths, eliminating the need for separate physical controls that are hard to locate.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This solution simplifies user interaction by allowing precise control of VR device functions through hand gestures, reducing fatigue and misoperations, and providing a more immersive experience by eliminating the need for external hardware inputs.
Implementation Method 1
detecting a depth distance between a hand of the user and the depth sensor, where the depth distance is a distance from the depth sensor to a primary plane on which a hand centroid is located or a distance from the depth sensor to a hand centroid
Data Source
AI summary
A gesture control method applied to a virtual reality (VR) device, where gesture location information of a user of the VR device is obtained, a depth distance from a depth sensor to a hand of the user is detected using the depth sensor, and a hand movement area of the user is divided into a selection area and a command area based on a result of comparing the depth distance with a preset depth threshold. When the detected depth distance is not greater than the preset depth threshold, the user may select a to-be-operated object on a current display page, and when the detected depth distance is greater than the preset depth threshold, the user may perform a command operation on the to-be-operated object.