Row Store Index for Transparent Multi-Temperature Data Access
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional approaches fail to provide transparent and efficient access to data in databases, leading to unnecessary data loading and processing costs, as users and developers struggle to determine whether 'hot' or 'cold' data should be queried, resulting in performance penalties and incorrect data retrieval.
Innovation Solution
A computer-implemented method that generates a row store index for a database, storing 'hot' data on a faster storage device and 'cold' data on a slower one, allowing for efficient partitioning and querying by primary or secondary keys, with index rows distributed across storage devices to optimize data access and aging.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If data is stored redundantly at different levels of storage hierarchy, then data accessibility is improved, but storage costs increase
Solution Approach 1:
The patent segments data into hot and cold portions based on access patterns, storing hot data in fast storage and cold data in slow storage. This segmentation allows differential storage strategies that balance accessibility and cost without redundant storage across all levels.
Solution Approach 2:
The patent applies local quality by assigning different storage characteristics to different data portions based on their specific access requirements. Hot data receives high-speed storage while cold data uses cost-effective storage, optimizing the system without universal redundancy.
2Productivity
If users specify whether cold data should be considered in queries, then query performance is improved, but user complexity increases
Solution Approach 1:
The patent implements self-service by automatically detecting data temperature and managing storage placement without user intervention. The system autonomously determines whether to query hot or cold data based on access patterns, eliminating the need for users to specify cold data considerations.
Solution Approach 2:
The patent introduces an intermediary layer (storage management system) that sits between the user and the heterogeneous storage, automatically translating user queries into appropriate storage operations without requiring users to understand underlying storage complexities.
3Measurement precision
If application logic derives determination of hot/cold data querying, then data access accuracy is improved, but implementation cost increases
Solution Approach 1:
The patent enables the storage system to automatically determine data temperature and manage hot/cold data separation without requiring application logic intervention. This self-service approach maintains accurate data access while eliminating the need for complex application-level implementation.
Solution Approach 2:
The patent creates a universal storage management layer that handles hot/cold data determination for all applications, replacing the need for each application to implement its own logic. This multi-functional approach achieves accurate data access with standardized, lower implementation costs.
4Speed
If hot data occupies top levels of storage hierarchy, then data access speed is improved, but storage costs increase
Solution Approach 1:
The patent segments data based on access patterns and places only hot data in expensive fast storage while storing cold data in cheaper slow storage. This segmentation maintains high access speed for frequently accessed data while reducing overall storage costs by eliminating the need to keep all data in fast storage.
Solution Approach 2:
The patent dynamically changes storage parameters (location, medium) based on data temperature characteristics. By monitoring access patterns and adjusting storage placement accordingly, the system optimizes the balance between access speed and storage cost, placing data in the most appropriate storage tier based on current needs.
Data Source
Figure 1
Figure 2a
Figure 2b
AI summary
A system, a computer-implemented method, and a computer readable medium having stored thereon a computer executable program code for providing access to a database on the system. The database comprises entries stored across partitions. The system comprises a first storage device, a second storage device, and a computing device. The first storage device comprises only one partition of the partitions. The second storage device comprises all of the other partitions except the one of the first partition. Each of the partitions has a respective partition identification for identification of that partition. Each of the entries comprises at least one data value indicative of allocation of the each of the entries in one of the partitions. Each of the entries is stored in one or more data rows of data tables stored in the database. Each of the data rows comprises a respective primary key for identification of that data row. The computing device comprises a memory storing processor-executable program code and a computer processor to execute the processor-executable program code in order to cause the computing device to perform the computer-implemented method.