Natural Language Interface for Visual Analysis Drill Down

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current data visualization systems require significant user effort and training to interact with and analyze complex data sets, and they lack efficient methods for refining natural language interactions, which can lead to increased cognitive burden and reduced efficiency.

Innovation Solution

The implementation of a natural language interface that allows users to perform drill-down operations and generate data visualizations through user-selectable affordances and widgets, enabling quicker and easier incremental updates to natural language expressions, thereby reducing cognitive burden and enhancing interaction efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If traditional data visualization interfaces are used, then data analysis capability is provided, but user effort and training requirements increase significantly

Engineering Contradiction:
Improveuser effortVSAvoiddata analysis efficiency
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

The system automatically generates natural language expressions and updates them based on user interactions with the visualization. The interface self-updates the natural language description when users perform drill-down operations, filtering, or other data manipulation tasks, eliminating the need for users to manually construct or modify complex queries.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

Natural language expressions serve as an intermediary between the user and the complex data visualization system. Instead of directly interacting with complex filtering and aggregation mechanisms, users work with simple natural language descriptions that automatically translate into the appropriate data operations.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If traditional data visualization interfaces are used, then data analysis capability is provided, but cognitive burden on users increases

Engineering Contradiction:
Improvecognitive burdenVSAvoidinterface complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The interface automatically manages the complexity of natural language expressions by updating them in response to user actions. When users perform drill-down operations or apply filters, the system self-updates the natural language description without requiring users to understand or manage the underlying complexity.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system dynamically changes the parameters of the natural language expression based on the current state of the data visualization. As users interact with the visualization, the natural language description automatically adjusts to reflect the current filters, groupings, and data subset being displayed.

Inventive Principle:
Principle #35Parameter changes

3Ease of operation

If natural language interface is implemented, then ease of data interaction is improved, but processing power and energy consumption increase

Engineering Contradiction:
Improveinteraction efficiencyVSAvoidpower consumption
Core Design Contradiction:
Ease of operationVSUse of energy by moving object

Solution Approach 1:

The system updates only the specific portions of the natural language expression that are affected by user interactions, rather than completely regenerating the entire expression. This partial update approach reduces processing requirements and energy consumption while maintaining the benefits of the natural language interface.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11429253B2Integrated drill down within a natural language interface for visual analysis
Publication Date: 2022.08.30 TABLEAU SOFTWARE INC
  • US11429253B2 patent drawing
  • US11429253B2 patent drawing
  • US11429253B2 patent drawing

AI summary

A computing device displays a first data visualization that includes a first plurality of data marks. Each of the data marks corresponds to a respective distinct data value of a first data field from a dataset. In response to user selection of a first data mark that corresponds to a first data value of the first data field, the device displays a first data widget that includes one or more user-selectable affordances. In response to user selection of a first affordance of the affordances, the device displays a first drill down widget. The device receives user selection of a second data field from the dataset in the drill down widget. In response to the user selection, the device generates a second data visualization that includes a second plurality of data marks and displays the second data visualization.