Hands-Free Navigation for Touch-Based Operating Systems
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Touch-based operating systems require manual interaction, which can be impractical or impossible in certain situations, and previous solutions were cumbersome, inflexible, and often required modification of source code, limiting compatibility with existing applications.
Innovation Solution
A system and method for facilitating hands-free navigation of touch-based operating systems by analyzing user interfaces to identify scrolling features and control dialogues, converting motion and voice inputs into touch-based commands, allowing users to interact without physical touch input.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If touch-based operating systems require manual interaction, then device control functionality is achieved, but usability is reduced in situations where manual interaction is impractical or impossible
Solution Approach 1:
The patent introduces an intermediary layer (hands-free navigation application) that sits between the user and the touch-based operating system. This intermediary translates hands-free inputs (voice commands, motion gestures) into touch-based commands, enabling hands-free operation without modifying the underlying operating system or applications. The intermediary acts as a mediator that bridges the gap between hands-free input methods and touch-based interfaces.
Solution Approach 2:
The patent replaces mechanical touch-based interaction with alternative input methods such as voice recognition and motion-based gestures. Instead of requiring physical contact with the device, users can interact through speech or body movements, substituting the mechanical touch interface with acoustic and kinematic input modalities.
2Ease of operation
If previous solutions modified source code to enable hands-free input, then hands-free functionality was achieved, but device complexity and implementation difficulty increased
Solution Approach 1:
The hands-free navigation application serves as an intermediary that eliminates the need for source code modification. Instead of altering existing applications or operating system code, this intermediary layer intercepts and translates hands-free inputs into standard touch commands that existing applications can process without any modifications.
Solution Approach 2:
The patent creates a virtual copy of the touch interface through the hands-free navigation application. This copy mimics the behavior and response of the original touch interface, allowing hands-free inputs to be translated into equivalent touch commands without requiring changes to the original applications or their source code.
3Productivity
If speech recognition is used for textual input, then input speed is improved, but reliability decreases when Internet connection is unavailable
Solution Approach 1:
The hands-free navigation application provides multiple input modalities (voice recognition, motion gestures, keyboard shortcuts) within a single system. This multi-functionality ensures that if one input method fails or is unavailable (such as speech recognition without Internet), other methods can be used to achieve the same goal, maintaining reliability across different operating conditions.
Solution Approach 2:
The system dynamically changes operational parameters based on availability. When Internet connection is available, speech recognition is enabled for fast text input. When Internet is unavailable, the system switches to alternative parameters such as motion-based gestures or pre-configured shortcuts, maintaining functionality without requiring Internet connectivity.
Data Source
AI summary
Aspects of the present invention facilitate the customization of binary application user interfaces without modification of the underlying source code. Embodiments described herein can provide for hands-free operation or accessibility services, such as touchless operation of compiled applications, with minimal intervention. Described embodiments can automatically interface with the touch-based operating system to generate hands-free commands that, when detected (e.g., voice detection), can cause corresponding touch-based commands to be executed. Embodiments can utilize audio inputs, by way of example, to facilitate hands-free interaction with the touch-based operating system and applications executing thereon.