Virtual Object Gesture Recognition via Image Vector Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing computing applications face challenges in user input due to the difficulty in learning and mapping physical actions to virtual controls, leading to a barrier between users and applications, as traditional controls often differ from actual actions.
Innovation Solution
A system and method that processes image data to interpret user input through an input object by analyzing images for indicators, generating vectors to determine orientation, and tracking movements to animate avatars or control applications, allowing users to interact with applications using natural gestures.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If traditional controls (controllers, remotes, keyboards, mice) are used, then application functionality can be achieved, but user learning difficulty increases and barrier to entry is created
Solution Approach 1:
The patent replaces traditional mechanical input devices (controllers, remotes, keyboards, mice) with a gesture-based recognition system that uses image processing and computer vision to detect and interpret user gestures in the air, eliminating the need to learn complex control mappings
Solution Approach 2:
The system creates a virtual copy of the user's physical gesture and maps it directly to the corresponding virtual action, allowing intuitive control without learning traditional control schemes
2Reliability
If traditional controls are used, then application control is achieved, but correspondence between control input and actual action is poor
Solution Approach 1:
The system continuously tracks the user's gesture movements and provides real-time feedback by displaying the corresponding virtual avatar or object response, ensuring that the control input directly reflects the intended action
Solution Approach 2:
The gesture recognition system segments the user's physical movement into discrete gesture components and maps each segment to a specific virtual action, maintaining precise correspondence between physical and virtual domains
Data Source
AI summary
An image of a scene may be observed, received, or captured. The image may then be scanned to determine one or more signals emitted or reflected by an indicator that belongs to an input object. Upon determining the one or more signals, the signals may be grouped together into a cluster that may be used to generate a first vector that may indicate the orientation of the input object in the captured scene. The first vector may then be tracked, a virtual object and/or an avatar associated with the first vector may be rendered, and/or controls to perform in an application executing on the computer environment may be determined based on the first vector.