Removable Media Object Store Using Key And Value Partitions
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data storage on removable media, such as magnetic tape, is inefficient due to suboptimal I/O patterns when using file-based formats, necessitating special accommodations.
Innovation Solution
Implementing an object store on removable storage media by partitioning the media into key and value store partitions, allowing data to be stored and retrieved efficiently, enabling compatibility across different systems.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If file-based formats are used to store data on removable media such as magnetic tape, then data can be stored in a flexible and globally readable format, but I/O patterns become suboptimal and require special accommodations
Solution Approach 1:
The patent segments data into fixed-size objects with unique identifiers, separating the data content from the storage medium. This segmentation allows the system to optimize I/O operations by working with discrete objects rather than continuous file streams, improving tape access efficiency while maintaining format flexibility through the object identifier mechanism.
Solution Approach 2:
The patent changes the fundamental parameters of data representation by using fixed-size objects with unique keys instead of variable-length files. This parameter change enables optimal I/O patterns on tape by allowing sequential access to fixed-size blocks, while the unique key system preserves the adaptability and global readability of the format.
2Productivity
If data is stored in application-specific formats on removable media, then storage efficiency may be improved, but flexibility and global readability are reduced
Solution Approach 1:
The patent creates a universal object store format that can be used across different applications and systems. The fixed-size object structure with unique keys provides a common interface that works efficiently on various removable media types, achieving both storage efficiency and broad compatibility simultaneously through its multi-functional design.
Solution Approach 2:
By changing from variable-length application-specific formats to fixed-size objects with unique identifiers, the system achieves efficient storage and retrieval operations while maintaining format flexibility. The parameter change to fixed-size objects enables optimal use of removable media capacity and access patterns.
3Adaptability or versatility
If special accommodations are made to use file-based formats on magnetic tape, then data can be stored on tape, but system complexity increases
Solution Approach 1:
The patent segments data into standardized objects that can be uniformly handled by the storage system. This segmentation eliminates the need for complex file-based accommodations on tape, as the fixed-size objects with unique keys can be directly written to and read from sequential media without requiring special file system layers or conversion mechanisms.
Solution Approach 2:
Instead of adapting the storage medium to accommodate file-based formats, the patent inverts the approach by designing a file-like interface that adapts to the constraints of sequential access media. The object store presents a simple key-based interface to users while internally optimizing for sequential access patterns, eliminating the need for complex accommodations.
Data Source
AI summary
A method for implementing an object store using removable storage media includes the steps of receiving a request to retrieve first data; determining a first data object in which at least a portion of the first data is stored; determining a removable storage medium on which the first data object is stored, the removable storage medium including a value store partition into which one or more data objects including at least the first data object are stored and a key store partition into which one or more keys identifying the one or more data objects are stored; retrieving the first data object from the value store partition; and retrieving the at least a portion of the first data from the first data object. The method can further be performed using a data management system and/or one or more non-transitory computer-readable storage media.