Cloud Data Modeling With Vector Storage for Auditable Calculations
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Spreadsheets face challenges in verifying and auditing correctness due to complex and distributed models, leading to errors and limited collaboration and data sharing, especially as datasets grow.
Innovation Solution
A data modeling platform utilizing a multi-dimensional structure stored as one-dimensional vectors, with a calculation engine for dynamic calculations, user-specific data access, and chart generation, enabling secure and efficient data access for multiple users.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If spreadsheets are used to store and model data, then data storage and modeling capabilities are provided, but verification and auditing of correctness becomes increasingly difficult as models become more complex
Solution Approach 1:
The patent segments the complex spreadsheet model into a hierarchical structure with a calculation engine layer, data model layer, and user interface layer. The calculation engine processes formulas and references systematically, breaking down complex calculations into manageable steps that can be verified and audited individually, thereby maintaining reliability as model complexity increases.
Solution Approach 2:
The patent introduces a calculation engine as an intermediary between the user interface and the underlying data structure. This intermediary systematically processes formulas, manages dependencies, and tracks calculations, providing a verifiable audit trail that ensures correctness even as model complexity grows.
2Adaptability or versatility
If spreadsheets rely on fixed format or structure, then data storage is simplified, but the ability to see various views of a set of data is complicated
Solution Approach 1:
The patent implements a dynamic data structure where the underlying data model remains fixed and stable, but the presentation layer can dynamically adjust to provide various views of the data. Users can configure different visual representations and access patterns without altering the core data structure, enabling flexibility while maintaining structural integrity.
Solution Approach 2:
The patent adds an additional dimension of abstraction by separating the logical data structure from its physical representation. This allows the same data to be viewed from multiple perspectives through different interface configurations, formulas, and display formats without increasing the complexity of the underlying data model.
3Productivity
If spreadsheets are file-based, then data storage is simple, but the ability to share, collaborate, or protect the data is limited as datasets grow
Solution Approach 1:
The patent creates a universal data architecture that functions both as a local spreadsheet application and as a cloud-based collaborative platform. The system supports multiple users, real-time collaboration, and data protection features while maintaining the familiar spreadsheet interface, thereby enabling sharing and collaboration without requiring a complete architectural overhaul.
Solution Approach 2:
The patent introduces a cloud-based calculation engine and data management layer as intermediaries that enable collaboration and data protection features. This intermediary layer handles user authentication, permission management, and synchronized calculations across multiple users, allowing productivity enhancements without exposing the complexity of the collaborative infrastructure to end users.
Data Source
AI summary
Systems and methods for modeling data in accordance with embodiments of the invention are illustrated. One embodiment includes a system for modeling data, the system comprising a data modeling platform application configured to operate on a set of one or more servers to provide a database layer configured to store data for a set of one or more models. The data for each model is based on a multi-dimensional structure and is stored as a one-dimensional vector. The data modeling platform application is further configured to provide a data modeling application layer comprising a multi-dimensional data interface that provides access to the database layer, and a calculation engine configured to perform calculations across multi-dimensional structures for the set of models. The system further includes a client application configured to transmit requests for data for at least one of the set of models to the data modeling platform application.