Schema-less Data Access via SQL Mediator Layer
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for analyzing incompletely structured data in NoSQL databases are suboptimal, as they often require defining a schema beforehand, which is not compatible with traditional SQL tools and frameworks, limiting the use of third-party analysis and business intelligence tools.
Innovation Solution
A computer-implemented method for accessing stored partially structured data using a structure-based query language, where data is stored in key-value pairs and processed using a data management system that generates queries, allowing for tabular views and referencing both physical and virtual columns, enabling schema-less access and analysis.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If NoSQL databases use key-value stores for simple retrieval operations, then performance in terms of latency and throughput is improved, but the ability to analyze data using traditional SQL tools is lost
Solution Approach 1:
The patent introduces a mediator layer that translates between NoSQL key-value operations and SQL query operations. This mediator enables traditional SQL analysis tools to work with NoSQL databases by converting SQL queries into appropriate key-value store operations, thus maintaining compatibility with SQL tools while preserving the performance benefits of NoSQL storage.
2Ease of operation
If a schema is defined beforehand in relational databases, then data access and manipulation are simplified, but flexibility to store incompletely structured data is reduced
Solution Approach 1:
The patent implements dynamic schema evolution where the database system automatically adapts the schema structure based on the data being stored and accessed. This allows the system to maintain simple data access operations while simultaneously supporting incompletely structured data, as the schema dynamically adjusts to accommodate varying data formats without requiring predefined structures.
3Adaptability or versatility
If Hadoop MapReduce is used to analyze NoSQL data, then analysis capability is improved, but complexity of integration and skill requirements increase
Solution Approach 1:
The patent creates a simplified copy or view of the NoSQL data that presents a SQL-compatible interface. Instead of requiring complex Hadoop MapReduce jobs, the system provides a SQL interface layer that allows standard SQL tools to analyze NoSQL data directly, thereby maintaining analysis capability while dramatically reducing integration complexity and skill requirements.
4Productivity
If NoSQL databases remove up-front data management effort, then development speed is improved, but data analysis compatibility with third-party tools is reduced
Solution Approach 1:
The patent implements a universal interface layer that enables NoSQL databases to serve multiple functions: maintaining fast key-value retrieval operations while simultaneously providing SQL compatibility for third-party analysis tools. This multi-functionality allows the database to support both rapid application development and comprehensive data analysis capabilities without requiring separate systems.
Data Source
AI summary
A system, a method, and a computer program product for accessing stored partially structured data using a structure-based query language. A partially-structured data is stored in a data management system using at least one key-value pair. Using the data management system, a query of data is processed. The query is generated using a structured language.