Digital Assistant Action Replay for Command Interpretation

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional digital assistants face issues such as privacy concerns, misinterpretation of spoken commands, unavailability due to weak signals, and the need for specific dialects, leading to user frustration.

Innovation Solution

A crowd-sourced digital assistant system that creates and distributes reproducible action datasets, allowing the digital assistant to learn from users, mitigate unexpected events, and seamlessly reproduce operations across various applications and operating systems, reducing privacy concerns and improving command interpretation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional digital assistants use speech recognition technologies with natural language processing algorithms, then command interpretation capability is improved, but misinterpretation errors still occur and user frustration increases

Engineering Contradiction:

Improvecommand interpretation accuracyVSAvoidoperation reliability

Core Design Contradiction:

Measurement precisionVSReliability

Solution Approach 1:

The patent creates digital copies of user actions through action datasets that capture screen recordings, metadata, and event sequences. These copies enable exact reproduction of operations without relying on speech interpretation, thereby eliminating misinterpretation errors while maintaining high accuracy and reliability

Inventive Principle:

Principle #26Copying

Solution Approach 2:

The patent replaces the speech recognition and natural language processing mechanical system with a direct action replay system. Instead of interpreting spoken commands through algorithms, the system directly reproduces recorded actions, substituting the interpretation mechanism with a reproduction mechanism that achieves higher accuracy and reliability

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Productivity

If digital assistants require specific dialects for command structure, then command processing is improved, but ease of operation deteriorates due to uncomfortable dialect requirements

Engineering Contradiction:

Improvecommand processing efficiencyVSAvoidcommand issuance ease

Core Design Contradiction:

ProductivityVSEase of operation

Solution Approach 1:

The system records actions directly from user device interactions without requiring the user to speak or structure commands in any particular dialect. The digital assistant serves itself by capturing, storing, and replaying action datasets, eliminating the need for users to adapt to specific speech dialects while maintaining efficient operation reproduction

Inventive Principle:

Principle #25Self-service

3Adaptability or versatility

If digital assistants collect user data for learning and adaptation, then adaptability is improved, but privacy concerns worsen

Engineering Contradiction:

Improveuser adaptation capabilityVSAvoidprivacy concerns

Core Design Contradiction:

Adaptability or versatilityVSObject-affected harmful factors

Solution Approach 1:

The patent extracts only the necessary operational data (screen recordings, metadata, event sequences) required for action reproduction, separating this from sensitive personal information. By taking out only the essential action data needed for functionality, the system achieves adaptability through localized learning while minimizing privacy concerns through selective data extraction

Inventive Principle:

Principle #2Taking out (Extraction)

4Productivity

If digital assistants rely on network connectivity for operation, then service availability is improved, but reliability worsens due to unavailability during weak or lost signals

Engineering Contradiction:

Improveservice availabilityVSAvoidoperation reliability during signal loss

Core Design Contradiction:

ProductivityVSReliability

Solution Approach 1:

The system performs preliminary actions by recording and storing action datasets locally on the user device before they are needed. These pre-recorded action datasets include all necessary information for reproducing operations, enabling the digital assistant to function reliably during signal loss by executing previously captured actions without requiring real-time network connectivity

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS20180366113A1Robust replay of digital assistant operations

Publication Date: 2018.12.20 PELOTON INTERACTIVE INC

AI summary

Embodiments described herein facilitate the robust replay of reproducible computing events or tasks when an associated command is received by a digital assistant device. The digital assistant device can determine when a received command corresponds to one of a plurality of action datasets, select the corresponding action dataset to interpret instructions included therein, which can thereby initiate a particular feature of an application associated with the corresponding action dataset. During the process of initiating the particular feature, the digital assistant device can determine when unexpected behaviors of the associated application or the digital assistant device's operating system occur. In this way, the digital assistant device can dynamically switch to a different set of instructions included in the corresponding action dataset to address the unexpected behaviors and successfully initiate the particular feature associated with the received command.