Natural Language Interface for Data Visualization Updates

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current data visualization tools require users to learn complex interfaces, making it difficult for users to generate and update visualizations, especially for large or complex data sets, and often lead to errors when modifying natural language inputs without updating related phrases.

Innovation Solution

A natural language interface that automatically updates related phrases in data visualizations when a user modifies a portion of the input, reducing the cognitive burden and preventing errors by determining dependencies between phrases and updating them accordingly.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If a user manually updates each phrase in a natural language expression, then the data visualization can be updated accurately, but the operation becomes time-consuming and complex

Engineering Contradiction:
Improveaccuracy of data visualization updateVSAvoidtime to update natural language expression
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The system performs preliminary action by automatically identifying and updating dependent phrases before the user needs to manually edit them. When a user modifies one phrase, the system proactively detects other phrases that depend on it and updates them automatically, preventing errors and saving time.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system enables self-service by automatically managing the updates of dependent phrases without requiring user intervention. The natural language processing system independently analyzes dependencies between phrases and performs necessary updates, freeing the user from manual editing tasks.

Inventive Principle:
Principle #25Self-service

2Adaptability or versatility

If a complex user interface is provided to control all data visualization features, then full functionality is available, but the ease of operation decreases and training is required

Engineering Contradiction:
Improvedata visualization functionalityVSAvoiduser interface complexity
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The natural language interface acts as an intermediary between the user and the complex data visualization system. Instead of requiring users to directly interact with complex interface elements, they can use natural language commands that are automatically parsed and translated into appropriate visualization operations, maintaining full functionality while simplifying interaction.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system replaces the mechanical interaction with complex UI elements (clicking, dragging, configuring multiple parameters) with a linguistic-based interaction model. Users speak or type natural language instead of manipulating interface components, and the system automatically interprets these commands to achieve the desired data visualization results.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Ease of operation

If natural language input is accepted without automatic updates, then user input freedom is maintained, but errors occur when related phrases are not updated

Engineering Contradiction:
Improvenatural language input flexibilityVSAvoiderror prevention in expression
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The system implements feedback by continuously monitoring the natural language expression for dependencies between phrases. When a user modifies one phrase, the system provides automatic feedback by identifying and updating related phrases that depend on it, ensuring the expression remains consistent and error-free while maintaining natural language flexibility.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11048871B2Analyzing natural language expressions in a data visualization user interface
Publication Date: 2021.06.29 TABLEAU SOFTWARE INC
  • US11048871B2 patent drawing
  • US11048871B2 patent drawing
  • US11048871B2 patent drawing

AI summary

A method is performed at a computing device coupled with a display. The method includes displaying a graphical user interface on the display and analyzing a natural language input, received from a user, to identify a portion of the natural language input corresponding to a first phrase that includes a first term. The method further includes receiving, from the user, a second input that modifies the first term in the first phrase. In response to receiving the second input, the computing device updates a second phrase based on the second input. In response to updating the second phrase based on the second input, the computing device displays, on the graphical user interface, an updated natural language expression that comprises the modified first phrase and the updated second phrase and displays an updated data visualization representing the updated natural language expression.