Spoken Command Translation to UI Selection Sequences
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems for executing spoken commands are limited to pre-stored commands and cannot handle spoken commands that do not have direct correlations in the system.
Innovation Solution
A system configured to translate spoken commands into selection sequences by analyzing audio information, determining spoken terms, and correlating them with user interface elements to perform desired operations or generate new selection sequences when direct correlations are not found.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the system stores only pre-defined commands, then the system complexity is reduced and reliability is improved, but the adaptability and versatility of the system deteriorates
Solution Approach 1:
The system segments a spoken command into multiple individual term recognitions rather than requiring exact matching of complete pre-stored commands. Each term is recognized and processed separately, allowing the system to handle commands that were not explicitly pre-defined while maintaining reliable execution through structured term-by-term validation.
Solution Approach 2:
The system transitions from a single-dimension approach (exact command matching) to a multi-dimensional approach by analyzing commands as sequences of individual terms. This dimensional change allows the system to match spoken commands against stored terms in a flexible manner, enabling recognition of variations and combinations of known terms without requiring exact pre-stored command templates.
2Manufacturing precision
If the system recognizes only exact pre-stored commands, then the manufacturing precision and measurement precision are improved, but the ease of operation and user flexibility deteriorates
Solution Approach 1:
The system divides command recognition into segmented term matching, where each term in a spoken command is independently recognized and validated against stored terms. This segmentation maintains high accuracy by ensuring each term matches a known, validated term while allowing flexible combination of terms to form new commands.
Solution Approach 2:
The system implements dynamic command recognition that adapts to different user input patterns. Rather than requiring static exact matching, the system dynamically processes spoken commands by breaking them into terms, matching each term against stored vocabulary, and constructing valid commands from recognized term sequences, thereby accommodating varied user expressions.
3Speed
If the system processes complete spoken commands as single units, then the processing speed is improved, but the adaptability to unrecognized command variations deteriorates
Solution Approach 1:
The system segments spoken commands into individual terms for processing, allowing parallel or sequential term recognition rather than requiring complete command validation as a single unit. This segmentation enables faster processing by identifying recognized terms quickly while handling unrecognized portions through systematic term-by-term analysis.
Solution Approach 2:
The system performs preliminary action by pre-storing individual command terms and their associated operations rather than storing complete command phrases. This allows the system to quickly match spoken terms against the pre-stored vocabulary and construct valid commands from recognized term sequences, improving processing speed while maintaining adaptability.
Data Source
AI summary
Systems and methods to translate a spoken command to a selection sequence are disclosed. Exemplary implementations may: obtain audio information representing sounds captured by a client computing platform; analyze the sounds to determine spoken terms; determine whether the spoken terms include one or more of the terms that are correlated with the commands; responsive to determining that the spoken terms are terms that are correlated with a particular command stored in the electronic storage, perform a set of operations that correspond to the particular command; responsive to determine that the spoken terms are not the terms correlated with the commands stored in the electronic storage, determining a selection sequence that causes a result subsequent to the analysis of the sounds; correlate the spoken terms with the selection sequence; store the correlation of the spoken terms with the selection sequence; and perform the selection sequence to cause the result.