Database Record Correlation via Intermediate Storage
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Large databases face performance issues due to records being stored in disparate locations, leading to increased access times when records frequently accessed together are stored across multiple disks and locations, resulting in diminished read or update performance for the benefit of efficient write performance.
Innovation Solution
Implementing an intermediate storage medium to collect and reorganize data records before writing them to the database, identifying correlations between records through usage patterns and storing them in close proximity to improve read and update performance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If records are distributed across multiple storage locations to increase storage capacity, then the database can store more data, but the access time increases when records frequently accessed together are stored in disparate locations
Solution Approach 1:
The patent segments the database storage into multiple locations while maintaining logical groupings. Records are divided into segments stored across different physical locations, but correlated records are kept together in the same segment or adjacent segments, allowing both high storage capacity and efficient access.
Solution Approach 2:
The patent introduces a new dimension of organization by creating correlation groups across existing storage locations. Instead of simply distributing records randomly or sequentially, the system adds a correlation-based dimensional layer that maps related records to the same or adjacent physical locations, reducing access time without compromising storage capacity.
2Loss of time
If records are stored in close proximity to improve read performance, then access time is reduced, but write performance may be compromised due to the need for reorganization
Solution Approach 1:
The patent performs preliminary analysis of record access patterns before finalizing storage locations. By monitoring and analyzing read operations in advance, the system identifies correlated records and pre-positions them in optimal locations before write operations occur, eliminating the need for costly post-write reorganization.
Solution Approach 2:
The patent implements a feedback mechanism that continuously monitors read access patterns and uses this information to optimize record placement. The system learns from actual usage patterns and dynamically adjusts storage locations to maintain optimal read performance without requiring extensive reorganization during write operations.
Data Source
AI summary
An embodiment includes deriving usage data associated with records of a database by monitoring requests to perform read operations on the records of the database. The embodiment generates record correlation data representative of correlations between respective groups of records of the database by parsing the usage data associated with the records of the database. The embodiment stores a plurality of records received as respective write requests during a first time interval in an intermediate storage medium. The embodiment identifies a correlation in the record correlation data between a first record of the plurality of records and a second record of the plurality of records. The embodiment selects, responsive to identifying the correlation, a first location in the database for writing the first record and a second location in the database for writing the second record based on a proximity of the first location to the second location.