Gesture Control Integration Across Operating System and Applications
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current gesture-based control systems for devices lack the ability to seamlessly integrate gesture recognition across both operating systems and applications, leading to inefficiencies in performing multi-step tasks, such as opening apps and transferring data between them.
Innovation Solution
A method that detects gesture inputs via a user interface, identifies corresponding operating system and application operations, and passes data through an API to perform these operations, allowing gestures to trigger actions on both the operating system and applications, such as opening apps, copying, pasting, and deleting data, by correlating touch screen coordinates with predefined gestures.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If gesture-based control is implemented separately in operating systems and applications, then each system can be controlled independently, but integration between operating system and application gesture control is lacking
Solution Approach 1:
The patent merges operating system-level gesture control and application-level gesture control into a unified architecture. The operating system maintains a gesture database that stores gesture definitions and associated operations, while applications can subscribe to gesture inputs through standardized APIs. This combining allows gestures to trigger both OS operations (e.g., copying data, opening apps) and application-specific operations (e.g., adding recipients, opening notes) seamlessly, resolving the integration problem while managing complexity through modular design.
2Productivity
If multiple separate actions are required to perform multi-step tasks, then each action can be executed precisely, but user interaction efficiency is reduced
Solution Approach 1:
The patent implements preliminary action by pre-defining gesture sequences that correspond to multi-step task sequences. The operating system stores in its gesture database not only individual gestures but also sequences of gestures that map to sequences of operations. When a user performs a predefined gesture sequence, the system automatically executes the corresponding sequence of operations (e.g., copy data from one app, open another app, paste data) without requiring the user to manually execute each step, thereby improving productivity while maintaining precise execution of each individual action.
3Adaptability or versatility
If gesture data is passed only at the operating system level, then system-wide control is achieved, but application-specific gesture handling is limited
Solution Approach 1:
The patent introduces an intermediary mechanism in the form of standardized application programming interfaces (APIs) that enable data passing between the operating system and applications. The operating system detects gestures, identifies corresponding operations, and passes gesture data through these intermediary APIs to subscribed applications. This intermediary layer allows applications to receive and handle gesture data specifically, enabling application-specific gesture handling while maintaining system-wide control through the OS-level gesture database and coordination mechanism.
Data Source
AI summary
In an operating system running on a processing device, detecting a gesture input via a user interface; identifying an operating system operation that corresponds to the gesture; performing the operating system operation; identifying an application running on the operating system that has subscribed to gesture input; and passing data corresponding to the gesture to the application for use by the application.