Automatic Digital Tutorial Generation System

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional digital tutorial generation techniques require significant user intervention and are inefficient, especially for complex applications with numerous features, as they demand manual textual descriptions of tutorial steps, which can lead to inaccuracies and user frustration.

Innovation Solution

A digital tutorial generation system that automatically generates tutorials by monitoring user interactions with applications, using audio data and history data to identify tutorial steps and synchronize audio segments, allowing for the creation of tutorials without the need for manual textual descriptions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional techniques use manual textual descriptions for tutorial generation, then tutorial accuracy can be maintained, but user effort and time consumption increase significantly

Engineering Contradiction:
Improvetutorial accuracyVSAvoidtutorial creation time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system enables automatic tutorial generation by capturing user interactions and audio data, then automatically processing this data through step identification, audio segmentation, and synchronization modules to create tutorials without requiring manual textual description from users

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces the mechanical process of manual text typing and editing with an automated system that captures user actions and audio, then uses processing modules to generate tutorial content automatically, substituting human manual work with automated computational processes

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Adaptability or versatility

If integrated help manuals are used, then application functionality can be documented, but the scope is limited to scenarios envisioned by the developer and keyword searches are inaccurate

Engineering Contradiction:
Improvetutorial scopeVSAvoidfeature location accuracy
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The system allows users to independently create tutorials for any application features they encounter by capturing their actual interactions, eliminating the need for pre-defined help manual scenarios and enabling documentation of emerging or undocumented features

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

Instead of requiring users to search for features in pre-written help manuals using keywords, the system inverts the approach by automatically generating tutorials that demonstrate features based on captured user interactions and audio descriptions

Inventive Principle:
Principle #13The other way round (Inversion)

3Loss of information

If conventional tutorials use text output, then instructional information can be provided, but user experience degrades due to requiring attention to alternate between text and application interaction

Engineering Contradiction:
Improveinstructional information deliveryVSAvoiduser interaction continuity
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The system merges the tutorial presentation directly into the application interface by overlaying audio instructions and visual indicators on top of the active application, allowing users to receive guidance without switching contexts or dividing attention between separate text and application windows

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent replaces static text-based tutorial delivery with dynamic audio-based instruction delivery that can be overlaid on the application interface, substituting the mechanical act of reading and switching windows with immersive audio guidance

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

4Adaptability or versatility

If applications support tens of thousands of features, then functionality expands, but complexity increases making user interaction difficult without specialized knowledge

Engineering Contradiction:
Improveapplication functionalityVSAvoidapplication complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system enables users to create their own contextual tutorials for complex features they encounter, allowing them to document and learn about sophisticated functionality on-demand without requiring prior specialized knowledge of the entire application

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11119727B1Digital tutorial generation system
Publication Date: 2021.09.14 ADOBE INC
  • US11119727B1 patent drawing
  • US11119727B1 patent drawing
  • US11119727B1 patent drawing

AI summary

Digital tutorial generation techniques and systems are described in which a digital tutorial is generated automatically and without user intervention. History data is generated describing a sequence of user inputs provided as part of user interaction with an application and audio data is received capturing user utterances, e.g., speech, from a microphone of the computing device. A step-identification module of the tutorial generation system identifies a plurality of tutorial steps based on a sequence of user inputs described by the history data. A segmentation module of the tutorial generation system then generates a plurality of audio segments from the audio data corresponding to respective ones of the plurality of tutorial steps. The digital tutorial is then generated by a synchronization module of the tutorial generation system by synchronizing the plurality of audio segments as part of the plurality of tutorial steps, which is then output.