Interaction Framework for Digital Assistant Task Automation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Digital assistants on mobile devices are limited in their ability to execute user instructions beyond the scope of services available on the device, often requiring users to manually interact with online services for tasks like ordering food or booking services.
Innovation Solution
A framework that includes an instruction processing agent interacting with a user agent to identify suitable domain agents and online services, allowing the execution of user instructions through a proxy interface to complete tasks on behalf of the user.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the digital assistant only uses functionality available on the mobile device, then the device complexity is reduced, but the adaptability to perform tasks beyond device capabilities is limited
Solution Approach 1:
The system is segmented into multiple independent components: user agent on the mobile device, instruction processing agent, domain agents, and online services. Each component has a specific responsibility, allowing the system to handle complex tasks without increasing the complexity of individual device components.
Solution Approach 2:
The instruction processing agent and domain agents serve as intermediaries between the user agent and online services. These intermediary components enable the mobile device to interact with external online services without requiring the device itself to contain all necessary functionality, thus improving adaptability while maintaining device simplicity.
2Ease of operation
If the digital assistant provides only hyperlinks to online services, then the ease of operation is improved, but the extent of automation is reduced
Solution Approach 1:
The instruction processing agent and domain agents perform preliminary actions by automatically identifying suitable online services, establishing connections, and executing user instructions before the user needs to manually intervene. This automation occurs in advance, reducing the user's operational burden while maintaining ease of use.
Solution Approach 2:
The system enables self-service automation where the digital assistant automatically completes tasks by interfacing with online services on behalf of the user. The user simply provides the instruction, and the system handles the entire execution process automatically, from service selection to task completion, without requiring manual navigation or intervention.
Data Source
AI summary
In order to complete user instructions beyond the scope of services that are provided on the user's own computing device, a framework an interaction framework for executing user instructions with online services is provided. The framework includes an instruction processing agent that interacts with a user agent on a computer user's computing device to execute instructions provided to the user agent. The instruction processing agent maintains a list of domain agents, each domain agent corresponding to a domain. Upon receiving a user instruction (from a user agent), the instruction processing agent identifies a suitable domain and corresponding domain agent for completing the user instruction and provides the instruction to the domain agent. The domain agent identifies an online service suitable for completing the user instruction and interfaces with the online service via a proxy for the online service to carry out the user instruction.