Context-Aware Visual Guidance for Software Applications

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Users face difficulties in locating and understanding guidance for software application features due to static documentation that does not account for the current context and state of the graphical user interface, making it hard for less skilled users to learn through visual means.

Innovation Solution

A method that captures user actions and generates real-time visual guidance within the context of the graphical user interface, displaying steps to use a feature, including motion to reveal hidden controls, ensuring the guidance matches the current application state and interface.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If static documentation is used to describe software features, then information can be provided, but users cannot easily locate and understand guidance in the context of their current application state

Engineering Contradiction:

Improveguidance information accessibilityVSAvoiduser comprehension difficulty

Core Design Contradiction:

Loss of informationVSEase of operation

Solution Approach 1:

The patent transforms static documentation into dynamic contextual guidance that adapts to the user's current application state. The system captures the current GUI context and user actions, then generates guidance content that is dynamically tailored to the specific state the user is in, making information both accessible and comprehensible.

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The patent provides guidance information localized to the specific context and state the user is currently in. Rather than providing generic documentation, the system delivers targeted guidance relevant to the current screen, controls visible, and user actions taken, ensuring information is both locateable and understandable.

Inventive Principle:

Principle #3Local quality

2Loss of information

If static documentation without visual motion is provided, then text-based guidance can be delivered, but users cannot visually see the performance of steps to learn through observation

Engineering Contradiction:

Improvestep guidance completenessVSAvoidvisual learning capability

Core Design Contradiction:

Loss of informationVSEase of operation

Solution Approach 1:

The patent replaces static text-based documentation with dynamic visual demonstrations that show the actual performance of steps. The system captures real user actions and presents them as visual guidance, substituting textual description with observable visual motion that enables users to learn by watching.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent creates visual copies of actual user actions and application responses. By capturing and replaying real interactions within the contextual GUI environment, the system provides authentic visual demonstrations that users can observe and learn from, rather than relying on text descriptions.

Inventive Principle:

Principle #26Copying

3Adaptability or versatility

If generic documentation not tailored to current application state is used, then general feature information can be provided, but guidance does not match the specific context and state of the user's interface

Engineering Contradiction:

Improvedocumentation generalityVSAvoidcontextual relevance

Core Design Contradiction:

Adaptability or versatilityVSLoss of information

Solution Approach 1:

The patent implements feedback by continuously monitoring the user's current application state, visible controls, and actions taken. This feedback information is used to dynamically adjust and tailor the guidance content to match the specific context, ensuring relevance while maintaining adaptability to different user situations.

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

The patent changes the parameters of guidance delivery based on the detected application state. Factors such as which controls are visible, the current screen context, and user actions influence how guidance is generated and presented, transforming generic information into context-specific guidance.

Inventive Principle:

Principle #35Parameter changes

Data Source

PatentUS11704141B2Real-time context preserving visual guidance

Publication Date: 2023.07.18 INTERNATIONAL BUSINESS MACHINE CORPORATION

AI summary

A method, apparatus, system, and computer program code for real-time visual guidance. A set of actions for a user instance of an application is captured during an operation of the user instance of the application by a user. A visual guidance of a set of steps performed to use a feature in the user instance of the application is generated in response to a user input requesting assistance with the feature. The visual guidance takes into account the set of actions and includes a context of a graphical user interface present for the user instance of the application displayed on a display system when the user input requesting the assistance with the feature is received during the operation of the user instance of the application. The visual guidance of the set of steps performed to use the feature is displayed on the display system.