Contextual AI Control Surface for Expanded User Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing artificial intelligence agents for computing devices have slow and cumbersome interfaces that do not enable a full range of interactions between users and personal assistants, limiting their effectiveness.
Innovation Solution
A computing system with an artificial intelligence control surface featuring user-selectable tiles that correspond to contextually relevant actions, customizable based on user preferences, allowing dynamic and intuitive interaction with the AI system, including machine-learned models to generate and update these tiles based on context data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a limited set of verbal commands is used for interfacing with AI agents, then the system complexity is reduced, but the range of possible interactions is insufficient
Solution Approach 1:
The patent implements a unified control surface that serves multiple functions: it displays contextual information, presents actionable insights, and enables user interactions all in one interface component. This multi-functional design allows the interface to adapt to various interaction scenarios without requiring separate controls for each function, thereby increasing versatility while managing complexity.
Solution Approach 2:
The control surface dynamically adjusts its content and structure based on the context data received from the AI system. Tiles are added, removed, or modified in real-time according to the actionable insights generated, allowing the interface to adapt to different interaction scenarios without manual reconfiguration, thus enhancing versatility while keeping the interface manageable.
2Productivity
If manual input is required for all actions, then user control is maintained, but efficiency and productivity are reduced
Solution Approach 1:
The system performs preliminary actions by generating actionable insights and presenting them as selectable tiles on the control surface before the user needs to take action. The AI system proactively analyzes context data and prepares potential actions in advance, allowing users to simply select from pre-prepared options rather than manually constructing commands, thereby improving efficiency while maintaining ease of operation.
Solution Approach 2:
The AI system serves itself by automatically analyzing context data, generating actionable insights, and updating the control surface without requiring manual intervention from the user. The system self-manages the entire process from data analysis to interface updates, freeing the user to simply make selections rather than manage the entire workflow, thus enhancing productivity while keeping operation simple.
3Adaptability or versatility
If computing resources are used for AI processing, then intelligent interactions are enabled, but resource consumption increases
Solution Approach 1:
The system applies partial action by processing only the necessary context data required to generate actionable insights for the current situation. Rather than continuously analyzing all available data, the AI system selectively processes relevant information based on the user's current interaction state, reducing computing resource consumption while maintaining intelligent interaction capabilities.
4Ease of operation
If a traditional interface is used, then simplicity is maintained, but user control and customization are limited
Solution Approach 1:
The control surface is segmented into multiple independent tiles, each representing a specific actionable insight or piece of contextual information. This segmentation allows users to interact with individual elements independently, providing fine-grained control over which actions to take while keeping the overall interface structure organized and manageable through the tile-based layout.
Data Source
AI summary
A computing system can include an artificial intelligence system including one or more machine-learned models. The artificial intelligence system can be configured to receive context data and output data descriptive of a plurality of available control actions available for performance by the artificial intelligence system on behalf of a user of the computing system. The computing system can be configured to perform operations including obtaining the context data; inputting the context data into the artificial intelligence system; receiving, as an output of the artificial intelligence system, the data descriptive of the plurality of available control actions available for performance by the artificial intelligence system; and providing, within a user interface for display to a user, an artificial intelligence control surface. The artificial intelligence control surface can include a plurality of user-selectable tiles. The plurality of user-selectable tiles can respectively correspond to the plurality of available control actions.