Centralized Gesture Recognition Framework for Multi-App Input Routing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing user interface processing systems face complexity in recognizing and responding to touch-based gestures across different applications and contexts, requiring frequent revisions with updates or additions to applications.
Innovation Solution
A method for an electronic device with a touch-sensitive display to execute multiple software applications, where each application includes gesture recognizers and handlers, allowing for the detection and processing of touch inputs by delivering them to the appropriate application based on recognized gesture recognizers.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If gesture recognizers are integrated into each application, then gesture recognition accuracy in different contexts is improved, but system complexity increases and requires frequent revisions
Solution Approach 1:
The patent introduces an intermediary gesture recognizer framework that acts as a mediator between the touch input system and individual applications. This framework includes a gesture recognizer manager that centrally manages gesture recognition logic and a delegate pattern that allows applications to register interest in specific gestures without implementing recognition logic themselves. This resolves the contradiction by maintaining high gesture recognition accuracy through centralized intelligent management while reducing software complexity by eliminating redundant gesture recognizer implementations across multiple applications.
Solution Approach 2:
The patent implements a universal gesture recognition framework that serves multiple applications through a single centralized system. The gesture recognizer manager can handle gestures for any application that registers interest through the delegate pattern, making the system multi-functional rather than requiring separate gesture recognition logic in each application. This universal approach maintains accurate gesture recognition across different contexts while significantly reducing overall system complexity.
2Reliability
If gesture recognizers are updated with each application update, then gesture recognition remains accurate, but development time and maintenance complexity increase
Solution Approach 1:
The centralized gesture recognizer manager acts as an intermediary that maintains the single source of truth for gesture recognition logic. When applications need to respond to gestures, they simply register interest through the delegate pattern rather than containing their own gesture recognition code. This ensures gesture recognition reliability remains high while dramatically reducing maintenance time, as updates to gesture recognition logic occur only once in the manager rather than requiring coordination across multiple applications.
Solution Approach 2:
The patent segments gesture recognition into two distinct parts: a centralized gesture recognizer manager that handles the recognition logic and a set of delegate applications that handle the response logic. This segmentation allows the recognition logic to be maintained centrally for reliability while applications can be developed and updated independently, reducing overall maintenance time and complexity.
3Adaptability or versatility
If multiple applications have separate gesture recognizers, then each application can have customized gestures, but the overall system becomes complex and harder to manage
Solution Approach 1:
The gesture recognizer manager serves as an intermediary that enables application-specific gesture customization without requiring each application to implement its own gesture recognition logic. Applications register interest in specific gestures through the delegate pattern, and the manager handles the actual recognition and routing of gestures to appropriate applications. This maintains adaptability and versatility for customized gestures while significantly reducing system management complexity through centralized coordination.
Solution Approach 2:
The universal gesture recognition framework provides a single multi-functional system that can serve all applications with customized gesture support. Rather than having separate gesture recognition systems in each application, the universal manager handles gestures for any registered application, maintaining the ability for application-specific customization while eliminating the complexity of managing multiple separate systems.
Data Source
AI summary
An electronic device, in response to detecting an input that includes a combination of eye movement and finger movement: processes the input with a first gesture recognizer for an operating system application; and processes the input with a second gesture recognizer for a first software application, distinct from the operating system application. If the first gesture recognizer recognizes the input, based on the combination of eye movement and finger movement, the electronic device performs an operation defined by the operating system application and transitions the second gesture recognizer into an event impossible state. If the second gesture recognizer recognizes the input, the electronic device delays performance of an operation defined by the first software application for the input until the first gesture recognizer indicates that the input does not match the gesture definition of the first gesture recognizer.