Gesture Management System Using Expression Evaluation Engine
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Motion-controlled systems, such as those using KINECT, have limited functionality due to the direct mapping of user movements to virtual objects, restricting interaction complexity and making them suitable only for simple applications like games.
Innovation Solution
A gesture recognition system that stores gesture definitions and evaluates expressions referencing these definitions, triggering actions when conditions are met, allowing for more complex interactions and navigation of virtual interfaces like pie menus through logical combinations of user movements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If motion input is mapped directly to virtual objects, then the system is easy to operate, but the functionality is limited
Solution Approach 1:
The patent introduces gesture recognition as an intermediary layer between motion input and virtual object control. Instead of directly mapping motion to virtual objects, the system first recognizes gestures from motion data, then triggers corresponding actions or menu items. This mediator enables complex interactions while maintaining natural motion-based operation.
2Adaptability or versatility
If gesture recognition with logical combinations is implemented, then the adaptability is improved, but the device complexity increases
Solution Approach 1:
The patent segments the gesture recognition system into distinct components: motion data collection, gesture definition storage, expression evaluation engine, and action triggering. This modular segmentation allows complex gesture logic to be managed through separate, manageable modules, reducing overall system complexity while maintaining high adaptability.
Solution Approach 2:
The system performs preliminary action by pre-defining gesture expressions and their corresponding actions in a database. Instead of processing complex logic in real-time during interaction, the system prepares gesture definitions and evaluation rules beforehand, enabling faster and simpler real-time processing while supporting sophisticated gesture combinations.
Data Source
AI summary
For storing gesture definitions and evaluating expressions that reference the gesture definitions, an expression evaluation engine evaluates the expressions to determine whether movements of a user satisfy the expressions. The expression evaluation engine receives expressions in user or application requests, or the expression evaluation engine may automatically evaluate the expressions when a gesture recognition system receives updated information about tracked body parts of the user. An expression includes a logical operator that relates different conditions to each other, and the different conditions may reference different gestures or other criteria that are based on the tracked body parts of the user. The expression is satisfied when the logical operator is satisfied. If an expression is satisfied, the expression evaluation engine triggers an action associated with a corresponding gesture definition. An example gesture may trigger display and navigation of a pie menu.