Database Management System Optimizing Storage via Query Frequency Analysis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing databases face performance degradation and increased storage costs due to large amounts of data, where many data fields are not frequently queried, leading to delayed responses and potential storage device failures.
Innovation Solution
A database management system that identifies least-queried data fields by analyzing query logs, moves them to secondary storage, and removes them from the primary database, allowing for optimized storage and query performance by focusing on frequently accessed data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If additional data is stored in the database, then the database contains more complete information, but the database performance decreases and storage costs increase
Solution Approach 1:
The patent segments the database into two parts: a compressed primary database storing frequently queried data fields, and a secondary uncompressed database storing least-queried data fields. This segmentation allows the system to maintain high query performance for common queries while preserving complete data for infrequent queries, resolving the contradiction between data completeness and query performance.
Solution Approach 2:
The patent applies different storage qualities to different data fields based on their query frequency. Frequently queried data fields are stored in a compressed format in the primary database for fast access, while least-queried data fields are stored in an uncompressed format in the secondary database. This local differentiation of storage quality optimizes both performance and data retention.
2Quantity of substance
If additional storage devices are added to store more data, then the database can store more information, but the cost increases and reliability decreases
Solution Approach 1:
The patent changes the storage parameter by implementing compression on the primary database. By compressing frequently accessed data fields, the system reduces the storage capacity requirement by approximately 75%, allowing the same amount of data to be stored on fewer, more reliable storage devices while maintaining the ability to store additional information as needed.
3Adaptability or versatility
If all data fields are retained in the database, then all user queries can be satisfied, but the database size increases and performance decreases
Solution Approach 1:
The patent performs preliminary action by analyzing query logs in advance to identify least-queried data fields before implementing the storage optimization. This preliminary analysis allows the system to proactively move infrequently accessed data to the secondary database, reducing the primary database size while ensuring that all query types can still be satisfied by accessing the appropriate database.
Data Source
AI summary
A database management (DM) computing device for reducing an amount of data stored within an enhanced database while ensuring that data remaining within the enhanced database is able to satisfy a plurality of user queries is described. The DM computing device is in communication with the enhanced database and a secondary storage database. The DM computing device is configured to receive a log data file identifying a number of times each data field in the enhanced database has been queried, rank the data fields based on the number of times each data field has been queried, and identify least-queried data fields from the ranked data fields, wherein the least-queried data fields are defined by rules in a memory. The DM computing device is also configured to store in the secondary storage database the least-queried data fields from the enhanced database, and remove from the enhanced database the least-queried data fields.