Voice Interaction Component Libraries Embedded in Native GUIs
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing voice-based interaction systems for executable applications lack seamless integration with native graphical user interfaces, limiting effective voice control and interaction capabilities.
Innovation Solution
A system that embeds voice-user interface (VUI) components within native graphical user interfaces (GUIs) of executable applications, enabling speech recognition, natural-language processing, and semantic parsing to interpret voice inputs and perform application-specific actions, facilitated by a cloud-based voice-service provider system.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If voice-based interaction systems are implemented for executable applications, then voice control capabilities are improved, but integration with native graphical user interfaces is lacking
Solution Approach 1:
The patent introduces VUI component libraries as intermediary elements that bridge voice-based interaction systems and native graphical user interfaces. These libraries provide standardized components (microphone icons, speaker icons, help cards, text views, informational cards) that can be seamlessly integrated into existing native GUIs without requiring fundamental restructuring of the GUI architecture, thus resolving the integration complexity issue while maintaining voice control capabilities
2Ease of operation
If VUI components are embedded into native GUIs, then user experience is improved, but system complexity increases
Solution Approach 1:
The patent segments the voice-user interface functionality into distinct, modular VUI components (microphone icons, speaker icons, help cards, text views, informational cards) that can be independently developed, tested, and integrated into native GUIs. This segmentation allows for easier maintenance and updates while improving user experience through consistent, standardized voice interaction elements across different applications
Solution Approach 2:
The VUI component libraries provide universal, multi-functional components that can be applied across different native applications and GUI contexts. These standardized components serve multiple purposes (visual indication, user interaction, feedback display) and can be reused throughout the system, reducing overall complexity despite the enhanced user experience capabilities
Data Source
AI summary
The disclosed embodiments include computerized methods, systems, and devices, including computer programs encoded on a computer storage medium, for integrating voice-based interaction and control into a native graphical user interface (GUI) of an executed application. For example, a communications device may obtaining component data identifying a plurality of components of a voice-user interface from a computing system maintained by a voice-service provider, and may execute an application linked to a corresponding one of the components of the voice-user interface. The communications device may generate the native GUI based on an output of the executed application, and may generate an interface element representative of the corresponding one of the components of the voice-user interface. The communications device may present the generated interface element within the native GUI, which may embed the corresponding component of the voice-user interface into the native GUI.