Language-Based Data Visualization Manipulation on Mobile Devices
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Mobile devices with limited screen space and lack of physical keyboards struggle to effectively utilize manual controls for visual data analytics, limiting the functionality of visual data analytics tools compared to their desktop counterparts.
Innovation Solution
A system that allows language-based manipulation of data visualizations, using natural language processing to interpret user input and perform interactions on multidimensional data sets, presenting candidates for user selection and generating commands to manipulate data visualizations without requiring specific subset identification.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If manual controls are used for visual data analytics on mobile devices, then data manipulation functionality is provided, but screen space is insufficient and operation becomes difficult
Solution Approach 1:
The patent replaces manual mechanical controls (buttons, sliders, and other graphical interface elements) with a voice-based natural language processing system. Users can manipulate data visualizations by speaking commands such as 'show me sales by region' or 'filter data for Q1 2024', eliminating the need for physical interaction with limited screen controls and enabling full data analytics functionality on mobile devices with small screens.
2Adaptability or versatility
If comprehensive controls are provided for data manipulation, then functionality is enhanced, but device complexity increases
Solution Approach 1:
The patent introduces a natural language processing intermediary that translates spoken user intent into data manipulation commands. This intermediary layer handles the complexity of data analytics operations internally, allowing users to access comprehensive functionality through simple voice commands without exposing them to the underlying system complexity. The NLP intermediary manages filtering, aggregation, and visualization transformations through natural language interpretation rather than requiring users to navigate complex control interfaces.
3Ease of operation
If voice-based interaction is implemented, then ease of use on mobile devices improves, but processing time increases
Solution Approach 1:
The patent implements preliminary action by pre-processing and indexing the multidimensional dataset before user queries are submitted. The system maintains pre-computed aggregations, filters, and relationships in an optimized data structure, allowing voice-based queries to be resolved by matching against pre-prepared results rather than performing full data analysis in real-time. This reduces the processing time between voice command and visualization update while maintaining comprehensive analytical capabilities.
Data Source
AI summary
Techniques for language-based manipulation of data visualizations are disclosed. A system presents a data visualization representing a multidimensional data set. The system receives user input including language associated with a particular interaction with the data visualization. The particular interaction is configured to manipulate presentation of one or more subsets of the multidimensional data set. The user input does not identify any particular subset of the multidimensional data set. The system determines that the interaction is applicable to two or more candidate subsets of the multidimensional data set and presents, as candidates for the particular interaction, the two or more candidate subsets. The system receives user input selecting a particular subset from candidates. Based on the user inputs, the system generates a complete command corresponding to the particular interaction. Based on the complete command, the system performs the particular interaction to manipulate, in the data visualization, presentation of the particular subset.