Virtual Reality Interaction Using Image-Based Gesture Recognition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current virtual reality technologies fail to provide a convenient and accurate method for users to interact with virtual objects, such as flipping pages in a virtual book, as they require special instruments and cannot distinguish hand actions effectively.
Innovation Solution
A virtual reality interaction method and system that continuously acquires image information, recognizes preset identifiers on interactive objects, and simulates user actions based on hand movements and object positions, using an image capturing module, identifier recognizing module, and gesture recognizing module to accurately simulate interactions in a virtual environment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If special electronic instruments or manipulators are used for interaction, then interaction accuracy is improved, but device complexity increases
Solution Approach 1:
The patent replaces mechanical manipulators and special electronic instruments with an image-based recognition system. The image capturing module captures hand gestures and object positions, and the processor simulates interactions based on image analysis, eliminating the need for complex mechanical or electronic interaction devices.
Solution Approach 2:
The system creates a virtual copy of the real-world interaction by capturing images of hand gestures and object positions, then simulating the interaction in a virtual environment. This allows users to interact with virtual objects using natural hand gestures rather than specialized instruments.
2Ease of operation
If hand actions are recognized without special instruments, then ease of operation is improved, but measurement precision deteriorates
Solution Approach 1:
The patent replaces specialized electronic instruments with an image-based recognition system that processes visual information from the image capturing module. This allows natural hand gestures to be recognized without requiring users to wear or operate complex devices.
Solution Approach 2:
The image capturing module serves as an intermediary between the user's hand gestures and the system's recognition. It captures visual information that the processor then analyzes to determine hand actions and object positions, providing accurate recognition without requiring special instruments.
3Ease of operation
If position-based interaction is used, then ease of operation is improved, but interaction accuracy deteriorates
Solution Approach 1:
The patent merges position information with hand gesture recognition to determine interaction operations. By combining these two types of information, the system can accurately distinguish different operation relationships (such as pointing vs. grasping) while maintaining ease of operation through natural gestures.
Solution Approach 2:
The processor acts as an intermediary that combines position data from the image capturing module with hand gesture analysis. This integration allows the system to accurately determine operation relationships by considering both where the hand is positioned and what gesture is being made.
Data Source
AI summary
A virtual reality interaction method includes: rendering content including an object; tracking the object in the content; and performing gesture tracking for supporting gesture control on the object; wherein an application programing interface API framework is provided to allow a user to define at least one of the content, the tracking module and the interactivity module.