Hand Gesture Object Movement Control in Extended Reality
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current object movement control in extended reality scenarios lacks intelligence and user experience, relying on joystick devices for control which is not immersive or intuitive.
Innovation Solution
A method and apparatus for object movement control using hand gestures, where a predefined selection gesture determines a target object and a predefined movement confirmation gesture sets its display position, enabling 'bare hand' control and enhancing user interaction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If traditional control devices like joysticks are used for object movement control, then control functionality is achieved, but operation intelligence and user experience are insufficient
Solution Approach 1:
The patent extracts the control functionality from traditional physical control devices (joysticks) and transfers it to hand gesture recognition. The system identifies specific hand gestures (such as pinching gestures) to represent selection and movement commands, eliminating the need for separate control devices while maintaining full control capability.
Solution Approach 2:
The patent replaces the mechanical control system (physical joysticks and buttons) with an optical/recognition-based system that detects hand gestures through sensors and image processing. This substitution enables more intuitive and immersive control by directly mapping user hand movements to object manipulation in the extended reality environment.
2Extent of automation
If hand gesture recognition is implemented for object control, then operation intelligence and user experience are improved, but gesture recognition accuracy and reliability must be ensured
Solution Approach 1:
The system performs preliminary classification of hand gestures into distinct categories (such as pinching gestures for selection, open hand gestures for movement confirmation) before executing control actions. This preliminary classification ensures that the system accurately understands user intent by distinguishing between different gesture types, thereby maintaining high recognition accuracy and control reliability.
Solution Approach 2:
The system provides visual feedback by displaying the selected object and its intended movement trajectory in response to detected hand gestures. This feedback mechanism allows users to verify that their gestures are correctly recognized and interpreted, enabling real-time correction of misrecognized gestures and thereby enhancing overall system reliability.
Data Source
AI summary
A method of object movement control is proposed. The method includes: in response to a hand gesture of a hand of a user being a predefined selection gesture, determining a target object corresponding to the hand gesture; in response to the hand gesture of the hand of the user changing to a predefined movement confirmation gesture, determining a target display position; and controlling the target object to be displayed at the target display position. Therefore, movement control of an object according to a hand gesture operation and “bare hand” control of an object can be achieved. This further enhances user experience of operations while improving the operation intelligence of object movement control.