Interactive Chart Data Partitioning for Large Datasets
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Developers face challenges in adding interactive charts to software applications due to the overwhelming volume of data, which is difficult to analyze and display in digestible formats, often overwhelming users and lacking logical interaction methods.
Innovation Solution
Systems and methods for managing data by determining data subsets on a networked server and local device, using data aggregation, filtering, and sub-view filtering to create interactive charts like time, pie, facet, and geography charts, with visual hints for user interaction, and periodic data updates.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If large amounts of data are displayed to provide comprehensive information, then data completeness is improved, but user distraction and difficulty in interaction increase
Solution Approach 1:
The system segments data into multiple hierarchical levels (e.g., summary level and detailed level) and divides the display into multiple views (chart view, table view, drill-down view). Users can navigate through these segments interactively, starting with overview and drilling down only when needed, thus maintaining data completeness while reducing initial cognitive load and interaction difficulty.
Solution Approach 2:
The system adds interaction dimensions through drill-down capabilities, where users can transition from summary statistics to detailed records by clicking on chart elements. This dimensional transition allows users to access comprehensive data only when necessary, transforming a static overwhelming display into a dynamic multi-level exploration interface.
2Loss of information
If all data is sent to the application for processing, then data availability is improved, but network bandwidth and processing resources are consumed
Solution Approach 1:
The server extracts and sends only the necessary summary data and metadata to the application, not the complete raw dataset. The server retains detailed data locally and provides it on demand through drill-down requests, significantly reducing network bandwidth consumption while maintaining data availability through selective retrieval.
Solution Approach 2:
The server acts as an intermediary between the data storage system and the application. It pre-processes and aggregates data, filtering out unnecessary details from the initial transfer and only providing granular data when explicitly requested by the user through interaction with the chart interface.
3Loss of information
If detailed data is displayed immediately, then information completeness is improved, but rendering time and processing speed decrease
Solution Approach 1:
The system performs preliminary aggregation and pre-processing of data on the server side before transfer to the application. Summary statistics, aggregates, and metadata are prepared in advance, enabling fast initial chart rendering. Detailed data is pre-organized in a structured manner that allows rapid retrieval and display when users initiate drill-down operations.
Data Source
AI summary
Systems, methods, and non-transitory computer readable media with instructions for methods here may be used to create and render interactive charts using large amounts of data, by efficiently dividing up the storage and processing of the data between a networked side and a local application side. In certain example embodiments, these two sides work in conjunction with one another, alternatively or additionally, in certain example embodiments, they may act independently and/or alone. The resulting charts may then be used by being embedded in external web pages.