Wearable Gesture Recognition System for Contactless Virtual Tool Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current man-machine interaction methods using virtual reality require direct physical contact with devices, making them inconvenient for users.
Innovation Solution
A system comprising a wearable device with an image acquiring module, processor, and image projecting module that captures and interprets user gestures to generate virtual tool images, allowing users to control virtual tools without physical devices, thereby enhancing interaction convenience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If physical input devices (mouse, keyboard) are used for man-machine interaction, then the computer can be operated to achieve various functions, but the operation process becomes complex and inconvenient
Solution Approach 1:
The patent replaces physical mechanical input devices (mouse, keyboard) with gesture recognition technology. The image acquiring module captures hand gestures, the processor analyzes gesture images to determine gesture categories, and generates control instructions accordingly. This substitutes the mechanical interaction system with an optical recognition system, eliminating the need for physical devices and simplifying the interaction process.
Solution Approach 2:
The patent introduces an intermediary system consisting of the image acquiring module, processor, and gesture database. This intermediary captures the user's natural gestures, processes them through pattern recognition, and translates them into computer control instructions. This intermediary layer bridges the gap between natural human movement and digital command execution, making interaction more intuitive and convenient.
2Adaptability or versatility
If virtual reality technique is used for man-machine interaction, then immersive experience is achieved, but direct physical contact with devices is required making it inconvenient
Solution Approach 1:
The patent replaces physical VR controllers and input devices with gesture recognition technology. Instead of requiring users to manipulate physical VR controllers, the system uses the image acquiring module to capture hand gestures in the VR environment, processes them through the processor, and generates corresponding control instructions. This eliminates the need for physical contact with VR devices while maintaining immersive interaction capabilities.
Solution Approach 2:
The patent creates a virtual copy of physical tools through the virtual tool image generation module. When a gesture is recognized, the system generates a corresponding virtual tool image that appears in the VR environment. This virtual tool copy allows users to interact with virtual objects as if using physical tools, maintaining the familiarity and convenience of tool-based interaction while eliminating the need for physical devices.
Data Source
AI summary
A man-machine interaction system, method, and apparatus, the man-machine interaction system includes a wearable device and a display device. The wearable device includes an image acquiring module, a memory, a processor, an image projecting module, and an information transmission interface. The image acquiring module acquires a current gesture image of a user and a display image on the display device; the processor matches the current gesture image with gestures in a gesture database pre-stored in the memory, determines a gesture category of a matched gesture, determines a control instruction corresponding to the gesture category, and generates a virtual tool image corresponding to the control instruction based on the control instruction; the image projecting module projects a virtual image that includes the virtual tool image and the display image; and the information transmission interface transmits the control instruction to the display device.