External Large-Object Storage Links for Database Performance
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Storing and managing different types and sizes of data in relational databases can undermine performance, lead to suboptimal costs, and increase backup file sizes, especially with large object data, necessitating more efficient data management strategies.
Innovation Solution
A computer-implemented method for database management that stores large data objects in external cloud storage while maintaining links in the database system, allowing deletion operations to be performed on the links without deleting the data, thus preserving data integrity and enabling multi-version concurrency control.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If large object data is stored directly in relational database tables, then data accessibility and transactional integrity are improved, but storage costs increase and performance deteriorates
Solution Approach 1:
The patent segments data into two parts: metadata (stored in the relational database) and large object data (stored externally in cloud storage). This segmentation allows the database to maintain only references to large objects, improving performance while preserving data accessibility through the metadata links.
Solution Approach 2:
The patent extracts large object data from the relational database tables and stores it externally in cloud storage systems. Only links or references to these extracted objects remain in the database, reducing storage costs and improving performance while maintaining data accessibility through the external storage system.
2Device complexity
If all data is managed in the same manner in the database, then system simplicity is maintained, but operational efficiency deteriorates
Solution Approach 1:
The patent applies different storage and management strategies to different types of data based on their characteristics. Small data items are stored directly in the database for quick access, while large object data is stored externally in cloud storage, optimizing operational efficiency for each data type while maintaining manageable system complexity through standardized access procedures.
3Reliability
If backup files include all database data including large objects, then data recovery completeness is improved, but backup size and maintenance time increase
Solution Approach 1:
The patent extracts large object data from the database backup process and stores it separately in the cloud storage system. Backup files only contain metadata and links to external objects, dramatically reducing backup size and maintenance time while maintaining complete data recovery capability by restoring metadata and re-linking to existing external objects.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A computer-implemented method for database management is provided. The method comprises: receiving, from a client device (20), first data to be stored in a database system (10) that comprises first data storage (150, 160) configured to store a data table and a deletion history table; storing the first data in second data storage (30) that is external to the database system (10) and that is in communication with the database system (10) via a network; obtaining a link that enables access, via the network, to the first data stored in the second data storage (30); storing the link in the data table; and performing a deletion operation of the first data, in response to a request from the client device (20) to delete the first data from the database system (10), wherein the deletion operation comprises: deleting the link from the data table without deleting the first data from the second data storage (30); and storing the link in the deletion history table with a timestamp corresponding to a point in time when the link is deleted from the data table.