Storage System Data Correlation for Sequential Access Read Time
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In systems using object storage, reading objects from sequential access media like magnetic tapes is inefficient due to increased time taken to locate objects, leading to longer read times.
Innovation Solution
The storage system determines the correlation between data objects based on attribute information and stores highly correlated objects at neighboring locations on the memory, using a proxy server, object server, and archiver server to manage meta-information, calculate degrees of similarity, and optimize writing and reading processes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If objects are stored on sequential access media, then storage capacity is improved, but reading time increases due to longer location time
Solution Approach 1:
The system performs preliminary actions by calculating similarity between objects in advance and determining optimal storage locations before actual writing occurs. The archiver server computes similarity metrics and prepares the storage arrangement, so that when objects are read, they are already positioned optimally, reducing location time without sacrificing storage capacity
Solution Approach 2:
The system applies local quality by storing similar objects at neighboring locations on the sequential access medium. Instead of uniform distribution, objects with high similarity scores are placed adjacent to each other, creating localized clusters that reduce the physical distance the read head must travel when accessing related objects
2Loss of time
If objects are stored at neighboring locations to improve read efficiency, then reading time is reduced, but device complexity increases due to correlation calculation
Solution Approach 1:
The system segments the complexity by dividing the correlation calculation task among multiple servers. The proxy server handles initial processing, the object server manages storage operations, and the archiver server performs similarity calculations. This segmentation distributes the computational burden, reducing overall system complexity while maintaining the benefit of reduced reading time
Solution Approach 2:
The archiver server acts as an intermediary between the object server and the sequential access medium. It calculates similarity metrics and determines optimal storage locations, mediating the complexity of correlation calculations separately from the storage and retrieval operations. This intermediary approach isolates the computational complexity from the core storage function
Data Source
AI summary
An information processing apparatus includes: a memory; and a processor coupled to the memory and configured to: perform control to store data on the memory; determine a correlation between a plurality of pieces of data, based on pieces of attribute information of the plurality of pieces of data, wherein dispose pieces of data having a high correlation among the plurality of pieces of data at neighboring locations on the memory.