Hands-Free Navigation for Touch-Based Operating Systems
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Touch-based operating systems require manual interaction, which can be impractical or impossible in certain situations, and existing solutions for hands-free interaction are cumbersome, inflexible, and often require modifying source code, limiting compatibility with existing applications.
Innovation Solution
A system and method for hands-free navigation of touch-based operating systems using a head-mounted computing device that analyzes touch-based user interfaces to identify scrolling features and control dialogues, converting motion and voice inputs into touch-based commands, allowing users to interact with touch-based operating systems without modifying source code.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If touch-based operating systems require manual interaction, then they provide precise control and direct user input, but they become impractical or impossible when users cannot physically interact with the device
Solution Approach 1:
The patent introduces an intermediary layer (the hands-free interaction system) that translates voice commands and head movements into touch-based commands. This mediator enables hands-free operation without requiring modifications to existing touch-based applications, as it operates at the interface between the user and the operating system.
Solution Approach 2:
The patent replaces the mechanical touch-based input system with a voice and motion-based system. Instead of requiring physical contact with the device, users can issue commands through speech and head movements, which are then converted into equivalent touch commands by the system.
2Adaptability or versatility
If previous solutions for hands-free interaction required modification of source code, then they could provide custom hands-free functionality, but they limited compatibility to only modified applications
Solution Approach 1:
The hands-free interaction system serves as a mediator that operates between the user and the operating system without requiring modifications to application source code. It captures voice commands and head movements, then translates them into touch commands that the existing applications can understand and execute.
Solution Approach 2:
The patent creates a universal hands-free interaction layer that works across multiple applications and the operating system itself. This single solution provides hands-free capability for diverse functions including scrolling, navigation, and control dialogues without requiring separate modifications for each application.
3Productivity
If speech recognition is used for textual input, then typing speed can be improved, but it requires Internet connection and is limited to textual input only
Solution Approach 1:
The patent segments the input methods into distinct categories: voice commands for navigation and control, and head movements for scrolling and positioning. This segmentation allows each input method to be optimized for its specific function while working together to provide comprehensive hands-free interaction capability.
Solution Approach 2:
The system dynamically adapts between different input methods based on the context. It can switch between voice commands and head movement detection, and combine them seamlessly to provide versatile input capability without requiring Internet connection or being limited to text-only input.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Aspects of the present invention allow hands-free navigation of touch-based operating systems. The system may automatically interface with a touch-based operating system and generate hands-free commands that are associated with touch-based commands, Embodiments may utilize motion and/or audio inputs to facilitate hands-free interaction with the touch-based operating system.