Multi-tenant Database File Concatenation for Storage Efficiency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional file systems face inefficiencies in storing a large number of files and are resource-intensive when creating copies, as they require copying all content, which is time-consuming and costly in terms of resources.
Innovation Solution
Implementing a method to store file system content in a multi-tenant on-demand database system by identifying files below a threshold size, concatenating them into a single file, and storing this concatenated file, while maintaining references to the original files on other devices to avoid redundant storage and copying.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If conventional file systems store a large number of files, then storage capacity is improved, but the number of files increases which reduces system efficiency
Solution Approach 1:
The patent merges multiple small files into a single concatenated file stored in the database. Instead of storing each small file separately in the traditional file system, the system combines them into one file and stores only the reference in the database, reducing the number of individual file objects while maintaining access to all original content.
Solution Approach 2:
The database serves as an intermediary layer between the traditional file system and the stored content. Rather than storing files directly in the file system, the database mediates by storing references to concatenated files, allowing efficient retrieval of individual files from the merged content without managing multiple separate file objects.
2Reliability
If a copy of the file system is created, then data redundancy is improved, but copying all content becomes time consuming and resource intensive
Solution Approach 1:
The patent extracts only the essential reference information (file metadata and pointers) from the original file system and stores these in the database, rather than copying the entire file system content. This allows creating copies by duplicating only the database references, which is much faster and less resource-intensive than copying all actual file content.
Solution Approach 2:
The system creates copies by duplicating database references rather than copying physical files. When a copy is needed, the database stores reference pointers to the original concatenated files, allowing multiple copies to share the same underlying file content without actual data duplication, significantly reducing copy time and resource consumption.
3Loss of information
If all file system content is copied to file system copies, then data completeness is improved, but resource consumption increases
Solution Approach 1:
The database serves multiple functions simultaneously: it stores reference information about files, maintains the concatenated file content, and enables copying through references. This multi-functionality eliminates the need for separate mechanisms to track file metadata and store content, reducing overall resource consumption while maintaining data completeness.
Solution Approach 2:
The system uses reference-based copying where multiple copies share the same underlying file content through database pointers. Instead of copying all data for each copy, the system creates lightweight references that point to the original content, maintaining data completeness across all copies while minimizing resource consumption through shared storage.
Data Source
AI summary
In accordance with embodiments, there are provided mechanisms and methods for storing file system content in a multi-tenant on-demand database system. These mechanisms and methods for storing file system content in a multi-tenant on-demand database system can enable embodiments to reduce a number of files stored on a file system, avoid copying of all file system content to file system copies, etc.