Natural Language Guidance for Interactive UI Components

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users face difficulty in navigating complex software services with multiple interactive user interface components, as existing systems lack efficient guidance mechanisms for users to access specific functionalities through natural language inputs.

Innovation Solution

An automatic guidance system that utilizes natural language input to identify the user's intent and dynamically directs them to the relevant user interface components on a content page, highlighting the necessary buttons or entities to perform the desired actions, employing machine learning models and HTML tag analysis to map user requests to specific content pages and entities.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a graphical user interface with multiple interactive components is used to provide comprehensive functionality, then the software service can expose detailed features and capabilities, but users face difficulty in navigating and accessing specific functionalities efficiently

Engineering Contradiction:
Improvefunctionality exposureVSAvoidnavigation efficiency
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent introduces a visual guidance intermediary layer that sits between the user and the complex UI components. This guidance system uses visual indicators (such as highlights, arrows, or annotations) to mediate the interaction, directing users' attention to relevant UI elements based on their natural language input or current task state, thereby easing navigation without removing functionality

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent employs color changes and visual styling modifications to indicate interactive UI components that are relevant to the user's current needs. By dynamically changing the visual appearance (color, brightness, or styling) of UI elements based on context, the system guides users efficiently through complex interfaces while maintaining full functionality exposure

Inventive Principle:
Principle #32Color changes

2Ease of operation

If general or high-level functionality is initially exposed to users, then the interface remains simple and understandable, but users cannot access detailed or specific functionality without multiple navigation steps

Engineering Contradiction:
Improveinterface simplicityVSAvoidaccess time to functionality
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The patent implements preliminary action by pre-processing and analyzing user input (such as natural language queries) to identify intended functionality before the user completes navigation. The system anticipates user needs and prepares guidance information in advance, allowing users to access detailed functionality more directly without experiencing the full navigation sequence

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent adds a new dimensional layer of interaction by introducing visual guidance indicators that operate parallel to the traditional UI hierarchy. This guidance dimension provides contextual information and navigation hints without requiring users to traverse multiple UI levels, effectively adding a shortcut dimension to the interface navigation space

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS20240095448A1Automatic guidance to interactive entity matching natural language input
Publication Date: 2024.03.21 SERVICENOW INC
  • US20240095448A1 patent drawing
  • US20240095448A1 patent drawing
  • US20240095448A1 patent drawing

AI summary

A natural language input is received. The natural language input is provided to a machine learning model to identify a content page associated with an intent of the natural language input. The content page is dynamically analyzed to determine interactive entities of the content page. Among the interactive entities of the content page, a matching interactive entity corresponding to the natural language input is identified, and an indication of the matching interactive entity is provided.