Natural Language Data Visualization Updates

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current data visualization systems require significant user effort and training to perform visual analytical tasks, and there is a need for improved methods that support and refine natural language interactions to reduce cognitive burden and enhance efficiency.

Innovation Solution

A method that enables users to update data visualizations using natural language commands by extracting independent analytic phrases, determining proposed actions, and generating updated visualizations, which includes adding, removing, or replacing phrases that define the visualization, with options displayed in a user-friendly interface.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If traditional data visualization systems are used, then data analysis capability is provided, but user training requirement increases and cognitive burden increases

Engineering Contradiction:
Improveease of operationVSAvoidtraining requirement
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent replaces the mechanical interaction system (manual data entry, menu navigation, and configuration) with a natural language processing system. Users communicate with the visualization system through natural language commands, which are processed by NLP algorithms to automatically generate or modify visualizations. This substitution eliminates the need for users to learn complex system operations while maintaining full data analysis capability.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system performs self-service by automatically interpreting natural language commands and generating appropriate visualizations without requiring user intervention in the technical configuration process. The NLP system autonomously parses user intent, maps it to visualization parameters, and executes the desired analysis, freeing users from technical learning requirements.

Inventive Principle:
Principle #25Self-service

2Productivity

If comprehensive data visualization features are provided, then analysis capability increases, but interaction time increases

Engineering Contradiction:
Improveinteraction efficiencyVSAvoidtime to create visualization
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system performs preliminary action by pre-processing natural language commands into structured visualization specifications before execution. The NLP system analyzes and prepares the command parameters in advance, mapping natural language terms to appropriate visualization types and data fields, which accelerates the actual visualization generation process and reduces overall interaction time.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

Manual step-by-step configuration of visualization parameters is replaced by automated NLP processing that directly translates natural language commands into execution-ready visualization specifications. This eliminates intermediate manual configuration steps and significantly reduces the time required to create comprehensive data visualizations.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Ease of operation

If natural language interface is added, then ease of operation improves, but system complexity increases

Engineering Contradiction:
Improveuser accessibilityVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent introduces an intermediary layer in the form of an NLP processing module that mediates between the user's natural language commands and the core visualization system. This intermediary translates complex user intentions into standardized system commands, allowing the visualization system to maintain its technical complexity while appearing simple to users through natural language interaction.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS20240054162A1Incremental Updates to Natural Language Expressions in a Data Visualization User Interface
Publication Date: 2024.02.15 TABLEAU SOFTWARE INC
  • US20240054162A1 patent drawing
  • US20240054162A1 patent drawing
  • US20240054162A1 patent drawing

AI summary

A computing device displays a data visualization in a graphical user interface. The device receives user input to specify a natural language command related to the data visualization. The device determines that the natural language command includes a metacommand to modify the data visualization by: (1) adding a new data field, or (2) removing one of the one or more first data fields, or (3) replacing one of the one or more first data fields with another data field. The device determines one or more proposed actions in accordance with the metacommand and ranks the proposed actions based on the saliency or weight of a missing term that is inferred from the natural language command. The device receives user selection of a first proposed action. In response to the user selection, the device generates and displays an updated data visualization.