Voice Command Routing Across Foreground and Background Apps
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Electronic devices face challenges in accurately interpreting user voice inputs to perform tasks on applications that align with the user's intended actions, especially when multiple applications are running in the foreground or background, leading to discontinuity and inconvenience in task execution.
Innovation Solution
An integrated intelligent system comprising a user equipment (UE) and an intelligence server processes voice inputs to determine the user's intended action by analyzing application states and generating a path rule, allowing the UE to execute tasks on the appropriate application.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the electronic device processes voice input based on the currently displayed application, then the task execution is simple and fast, but it cannot fulfill user intent when the user wants to switch to a different application
Solution Approach 1:
The patent introduces an intermediary component (voice recognition processor or server) that mediates between the voice input and the application execution. This intermediary analyzes the voice command, identifies the intended application regardless of current display state, and routes the command appropriately, thus enabling application switching without complicating the user's voice input process
Solution Approach 2:
The system performs preliminary actions by pre-processing the voice input to identify the intended application before executing the task. The voice recognition processor analyzes the command structure and application context in advance, determining the target application ahead of time, which enables seamless switching without requiring the user to manually navigate to the desired application first
2Measurement precision
If the system requires the user to specify the application name accurately, then the task execution precision is high, but the user convenience decreases due to memorization requirements
Solution Approach 1:
The system implements feedback mechanisms where the voice recognition processor provides contextual information about detected applications or recent usage patterns to the user, and adjusts its recognition criteria based on user corrections or confirmations. This feedback loop enables the system to learn user preferences and improve application identification accuracy over time without requiring precise memorization
Solution Approach 2:
The patent employs parameter changes by dynamically adjusting the voice recognition thresholds, time windows for command validation, and application matching criteria based on contextual factors such as recently used applications, frequently accessed apps, and current device state. These parameter adjustments allow flexible application identification that balances accuracy with ease of use
3Speed
If the electronic device only processes voice input for the foreground application, then the processing speed is fast, but it causes discontinuity when users want to perform tasks on background applications
Solution Approach 1:
The system performs preliminary analysis of the voice command to determine the target application before executing the task. By pre-processing the voice input to identify whether the user intends to access a foreground or background application, the system can quickly route the command without requiring sequential checking, thus maintaining fast processing speed while ensuring continuous task execution across different application states
Solution Approach 2:
The voice recognition processor is designed with multi-functionality to handle both foreground and background application commands through a unified interface. It can identify and execute tasks on any running application regardless of its display state, making the voice control system universal across different application contexts while maintaining consistent processing speed
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A server may include a communication circuit, at least one processor electrically connected to the communication circuit, and at least one memory electrically connected to the at least one processor. The at least one memory stores instructions for receiving, from a first external device, first data related to a user input that requests performance of a task, receiving, second data associated with a plurality of application programs, determining a domain related to the task based on at least some of the first data and at least some of the second data, determining a likely intention of a user providing the user input, based on at least some of the first data, and determining a sequence of states of the first external device based on the domain and the likely intention, providing the sequence of states to the first external device.