Evolving Universal Gesture Sets for Computing Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users face barriers in interacting with computing applications due to the complexity and variability of input controls, which differ from actual actions and require learning multiple methods for different controllers across various computing environments.
Innovation Solution
A gesture-based system that evolves a common set of input gestures across components, allowing users to interact using a subset of gestures, with the system generating or modifying gesture recognition data based on user data to improve effectiveness and usability.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple types of controllers are provided for different computing environments, then the system can support various computing applications, but the user must learn multiple control methods creating a barrier to interaction
Solution Approach 1:
The patent implements a universal gesture-based control system that works across multiple computing environments (televisions, personal computers, mobile devices). Instead of requiring separate controllers for each device type, the system uses a common set of gestures that can be recognized by different computing systems, making the control method universal and device-independent.
Solution Approach 2:
The patent replaces traditional mechanical controllers (remote controls, keyboards, mice) with gesture-based input. Users interact with computing systems through natural hand gestures in the air rather than pressing buttons or moving physical devices, eliminating the need to learn different mechanical control schemes for different systems.
2Device complexity
If a default set of gestures is used for all users, then the system maintains simplicity, but the gestures may not be effective for certain users
Solution Approach 1:
The patent implements dynamic adaptation where the gesture recognition system continuously learns and adjusts to individual user patterns. The system monitors how users naturally perform gestures and automatically modifies the gesture recognition parameters to match each user's unique style, transitioning from a static default gesture set to a dynamic, user-specific gesture interpretation system.
Solution Approach 2:
The system performs self-calibration by automatically observing and learning from user interactions. Instead of requiring manual configuration or user input to customize gestures, the system serves itself by analyzing user behavior patterns and autonomously adapting the gesture recognition to match each user's natural movements, improving effectiveness without increasing user burden.
3Ease of operation
If gesture recognition data is generated for each user individually, then the system adapts to user preferences, but the system complexity increases
Solution Approach 1:
The patent combines gesture data from multiple users into a unified gesture recognition system. Instead of maintaining completely separate gesture datasets for each user, the system merges and aggregates gesture patterns across users, identifying commonalities and establishing a shared gesture vocabulary that can be dynamically adjusted for individual users while maintaining overall system simplicity.
Data Source
AI summary
In a gesture-based system, gestures may control aspects of a computing environment or application, where the gestures may be derived from a user's position or movement in a physical space. Gesture recognition data, used to recognize gestures from captured data representative of a user's input gestures, may be evolved based on captured data from a plurality of users. A common set or default set of gesture recognition data may be evolved by selecting a plurality of users for tracking. Captured data of the plurality of users may be processed to identify input gesture data for the plurality of users, and the gesture recognition data may be evolved based on features of the input gesture data that is common to multiple users. The evolved gesture recognition data may be implemented not only for the users tracked, but for users not tracked. An identifier may identify when the evolved gesture recognition data applies and implement the evolved gesture recognition data when the identifier is present.