Dynamic User Interface for Speech Input Mode Switching
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional graphical user interfaces (GUIs) for position-determining devices are configured for specific input modes, making it difficult or impossible to switch between touch screen and speech input modes, limiting user interaction, especially in scenarios where physical interaction is unsafe or impractical.
Innovation Solution
A dynamic user interface is generated that can account for multiple input modes, allowing the GUI to switch between touch screen and speech input modes by reconfiguring graphical elements and prompts, enabling both modes to be active simultaneously and allowing users to select icons or functionalities through speech input.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a traditional graphical user interface is configured for a specific input mode (e.g., touch screen), then the interface can provide detailed graphical controls and visual feedback, but it becomes difficult or impossible to switch to speech input mode
Solution Approach 1:
The user interface is designed to dynamically reconfigure its graphical elements based on the active input mode. When speech input mode is activated, the GUI transforms touch-oriented icons and buttons into speech-responsive elements with audio icons, indicating they can be selected via speech. This dynamic adaptation allows the same interface to serve both touch and speech input modes effectively.
Solution Approach 2:
The patent creates a universal interface framework that can accept multiple types of input (touch and speech) through the same graphical elements. Each graphical element is designed to be multi-functional, responding to both touch interactions and speech commands, thereby eliminating the need for separate interfaces for different input modes.
2Adaptability or versatility
If the user interface is designed for speech input mode, then speech-based interaction is enabled, but detailed graphical controls and visual feedback are reduced
Solution Approach 1:
The interface dynamically adjusts its graphical representation based on the active input mode. When in speech input mode, the GUI displays speech-responsive indicators on graphical elements while maintaining their visual presence, allowing users to see what speech commands are recognized and how the system is responding, thus preserving visual feedback while enabling speech interaction.
Solution Approach 2:
The patent introduces speech recognition technology as an intermediary between the user and the graphical interface. This intermediary translates speech inputs into actions that manipulate the graphical interface, allowing users to interact with detailed graphical controls through speech without requiring direct touch or physical manipulation.
3Ease of operation
If automated speech recognition is used for input, then hands-free operation is enabled for safety, but certain functions become difficult to implement due to ASR limitations
Solution Approach 1:
The patent segments the user interface into distinct functional areas with different input requirements. Certain functions are designated as speech-responsive while others remain touch-oriented, allowing the system to optimize for hands-free operation where appropriate while maintaining touch capability for functions that benefit from precise graphical interaction.
Solution Approach 2:
The system performs preliminary actions by pre-configuring graphical elements to be responsive to specific speech commands. Before the user speaks, the interface is already prepared to recognize and respond to anticipated speech inputs, reducing the complexity of speech-based function implementation and improving recognition accuracy.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Techniques are described for generating a dynamic user interface for a position- determining device that may account for a variety of input modes. In one example, a position-determining device is initiated in a first input mode (e.g., a touch screen mode) and a graphical user interface (GUI) of the device is configured to accept input via the first input mode. The position-determining device then receives an indication to switch to a second input mode (e.g., a speech input mode) and the GUI is configured to receive input via the second input mode. The position-determining device can dynamically transition between GUI configurations based on a plurality of input modes.