RAT File System Random Access Hard Disk Storage
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional data storage methods, such as sequential access on hard disks, are inefficient for large datasets like genomic data, leading to significant delays in data access and search times due to the difference between sequential and random access speeds.
Innovation Solution
A method is introduced to create a Record Allocation Table (RAT) and a Rack of Virtual RAM (RVR) file system that enables random access on hard disks, allowing for quick data search and management of large volumes of data by dividing data into units like pages, paragraphs, or words, and storing these in a format similar to DRAM for faster access.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If sequential access method is used on hard disk for large datasets, then storage capacity is improved, but data access speed deteriorates
Solution Approach 1:
The patent pre-calculates and stores random access addresses (highly integrated indexes) of all data records in the RAT file before actual data access. This preliminary action enables the hard disk to jump directly to any data location without sequential scanning, achieving random access speeds comparable to DRAM while maintaining large storage capacity on hard disks.
2Speed
If DRAM is used for fast data access, then data access speed is improved, but cost increases
Solution Approach 1:
The patent creates a virtual memory structure (RAT file) that copies the random access addressing capability of DRAM into a hard disk-based file system. The RAT file contains pre-calculated addresses that enable direct access to any data record, replicating DRAM's fast access characteristics while using inexpensive hard disk storage for large datasets.
3Speed
If highly integrated index technology is used for random access, then data access speed is improved, but data size handling capability deteriorates
Solution Approach 1:
The patent segments large datasets into individual data records with unique identifiers, and creates a separate RAT file that stores pre-calculated access addresses for each record. This segmentation allows the system to handle arbitrarily large datasets by maintaining a mapping structure that can scale independently from the actual data storage capacity.
Data Source
AI summary
A method for creating/storing a file that facilitates search of data stored in a storage medium, and a data search method using the same are disclosed. The file creating method creates a rack of virtual RAM (RAM) file that is divided into several units according to divisional units for individual divisional units, and a record allocation table (RAT) file that stores a record position of each divisional unit of the RVR file. As a result, a database (DB) of large-volume irregular data can be easily created, and data analysis can be quickly achieved.