Voice Interaction Development Tool for Real-Time Visual Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional tools for generating voice-assisted interactions lack support for specific interaction data, making it cumbersome to develop voice-assisted applications across different voice assistant platforms, which require platform-specific data formatting.

Innovation Solution

A voice interaction development tool that allows users to associate voice interaction data with visual objects in a digital medium, enabling the creation of voice commands and corresponding output content, and provides graphical feedback for testing voice-assisted interactions by highlighting flow diagram elements in real-time.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If conventional tools are used for generating voice-assisted interactions, then development can proceed with general-purpose tools, but data formatting becomes cumbersome and platform-specific requirements cannot be met

Engineering Contradiction:
Improveplatform compatibilityVSAvoiddata formatting ease
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The development tool is designed to support multiple voice assistant platforms (Alexa, Google Assistant, Siri) within a single unified interface. The tool maintains voice interaction data that can be formatted and exported to meet the specific requirements of different platforms, eliminating the need for separate development processes for each platform.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The tool automatically adjusts data formatting parameters based on the target platform. When a developer creates voice interaction data once, the system transforms the data into platform-specific formats with appropriate headers, payloads, and metadata structures required by different voice assistant platforms.

Inventive Principle:
Principle #35Parameter changes

2Reliability

If platform-specific data formatting is implemented for each voice assistant platform, then each platform's requirements are met, but the development process becomes unwieldy and cumbersome

Engineering Contradiction:
Improveplatform-specific complianceVSAvoiddevelopment tool complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The development tool acts as an intermediary layer between the developer and multiple voice assistant platforms. It provides a unified interface for creating and managing voice interaction data, then automatically formats and transforms this data into the specific structures required by each platform, shielding developers from platform-specific complexities.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The tool separates the voice interaction logic from the platform-specific formatting concerns. Voice interaction data is maintained in a platform-agnostic format, while formatting transformations are applied as separate, automated steps when deploying to specific platforms.

Inventive Principle:
Principle #1Segmentation

3Productivity

If visual feedback is provided in real-time during voice command testing, then developers can quickly identify issues, but the system requires complex real-time processing and graphical updates

Engineering Contradiction:
Improvedevelopment efficiencyVSAvoidreal-time processing complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The development tool provides real-time visual feedback during voice command testing by highlighting the specific flow diagram elements that correspond to spoken commands. As developers test voice interactions, the system dynamically updates the visual representation to show which parts of the flow diagram are currently active or being executed.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The tool replaces complex manual debugging processes with automated graphical highlighting. Instead of requiring developers to manually trace through code or check logs to identify which flow diagram elements are being triggered, the system automatically detects and visually indicates the relevant elements in real-time.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS10908883B2Voice interaction development tool
Publication Date: 2021.02.02 ADOBE INC
  • US10908883B2 patent drawing
  • US10908883B2 patent drawing
  • US10908883B2 patent drawing

AI summary

A voice interaction development tool is described. Initially, user input associating voice interaction data with a visual object is received via a user interface. The voice interaction data, for example, may include voice commands and corresponding output content. Subsequently, a request is received from a voice assistant platform, due to initiation via a voice command to the voice assistant platform. In real-time (e.g., as the user speaks the voice command) a visual object corresponding to the spoken voice command is graphically indicated, e.g., a flow diagram element corresponding to the voice command is emphasized. In real-time as output content corresponding to the voice command is output by a voice assistant device, the user interface provides a graphical indication of the visual object associated with the output content. In this way, the described system provides graphical feedback for testing voice interactions being developed.