A very cold object magnetic tape storage system, access and management method

Abstract

In the extremely cold object tape storage system, access and management method, the extremely cold object index layer includes a storage device, and the storage device is used to store the extremely cold object index; the cold object data layer includes a storage device C1, which is used to store the extremely cold object data; the extremely cold object metadata layer includes a storage device D1, which is used to store the extremely cold object metadata; the extremely cold object index includes the name or number of the extremely cold object and the location information of the storage device D1 storing the extremely cold object metadata; the extremely cold object metadata includes the name or number of the extremely cold object and the location information of the storage device C1 storing the extremely cold object data; the storage device C1 is a tape storage device, and the storage device D1 is a tape storage device; the location information of the storage device D1 storing the extremely cold object metadata is found in the extremely cold object index according to the name or number; after obtaining the extremely cold object metadata, the location information of the storage device D1 storing the extremely cold object data is obtained; and then the extremely cold object data is obtained from the storage device D1.

Description

Technical Field

[0001] The present application belongs to the field of big data technology, and in particular relates to an extremely cold object magnetic tape storage system, access and management method. Background Art

[0002] With the development of Internet technology, large-scale data storage technology is evolving rapidly. With the development of e-commerce business, electronic payment, online file editing and storage, each user stores a large amount of personal sensitive data on the Internet.

[0003] Currently, every individual who enjoys Internet services generates a large amount of data every day. As time goes by, the probability of these data being accessed again gradually decreases. In software engineering, data management with different access frequencies is called heat management. Use cheap storage media to store low-heat data, and use storage media with high access speed to store high-heat data.

[0004] Chinese patent, CN202410373669.9, application date 2024.03.29, application name "A data recovery method and device in a distributed object storage system", proposes "using an object recovery component to restore backup data from a tape library to a distributed file system to obtain the entire content of the restored object; scanning the entire content of the restored object, parsing to obtain the metadata of each object and writing it into a distributed database; when receiving an object acquisition request initiated by a client, obtaining the corresponding object from the distributed file system according to the metadata of the corresponding object."

[0005] Chinese patent, CN202110317844.9, application date 2021.03.25, application name "A hierarchical data storage system and method, backup management server", proposes "backup management server, application server, distributed object storage cluster and tape library; the backup management server is used to generate and send a first backup request to the application server according to the remaining storage capacity and backup policy of the distributed object storage cluster; according to the remaining storage capacity of the tape library and the retention period of the backup data, generate and send a second backup request to the distributed object storage cluster; the application server is connected to the distributed object storage cluster, and is used to store the corresponding data in the application server in the distributed object storage cluster according to the first backup request; the distributed object storage cluster is connected to the tape library, and is used to store the corresponding data in the distributed object storage cluster in the tape library according to the second backup request. This article can improve the efficiency and success rate of data backup, and at the same time reduce operation and maintenance costs.".

[0006] Chinese patent, CN201510893902.7, application date 2015.12.07, application name "A data protection system and method based on tape library", proposes "a data protection system and method based on tape library, wherein the data protection system includes a data backup server and a tape library, and the data backup server includes: a backup data storage module, used to store data backed up from a production server and the corresponding point-in-time data set; a data archiving module, used to establish a data archiving task, and according to the data archiving task, archive the data stored in the backup data storage module to the tape library in units of point-in-time data sets, and record the position of each data object in the tape library; a position database, used to store the position of the data object in the tape library. Compared with the prior art, the present invention can not only effectively protect data, but also use the advantages of tapes to reduce costs, and conveniently manage data in tapes."

[0007] In the above-mentioned patents, the tape library is used as a general backup database, and the data in the tape library is generally not enabled if the primary data is not lost.

[0008] like Figure 8 When the tape library backs up the database, it saves part or all of the object library, and saves the object metadata together with the object data.

[0009] like Fig. 9 When the tape library backs up the database, it saves part or all of the object library, separates the object metadata from the object data, and saves them in different tape spaces. The object metadata is not responsible for indexing the object data.

[0010] In the prior art, tape devices are used as overall backup of object databases. This method of using tape devices cannot perform true object-oriented management with tape storage devices. When reading data, the data in the tape device needs to be restored to the database as a whole.

[0011] As business develops, the granularity of cold data becomes smaller and smaller, and the conversion of cold and hot data becomes more random. For example, transaction records on shopping websites, cold data from a few years ago, and extremely cold data, may need to be converted into warm data at any time because a user queries his or her consumption records. Under the impact of such business, the cold data system or tape backup system that uses batch storage needs to frequently move the tape backup data as a whole to the warm data area, resulting in a significant decline in system performance and a rapid increase in system power consumption.

[0012] Definitions of Abbreviations and Key Terms

[0013] MB, the abbreviation of English, is a storage unit in computers, and its full name is MByte. MB (full name MByte): A storage unit in computers, pronounced "Mega".

[0014] Object storage, also called object-based storage, is a general term used to describe the method of solving and processing discrete units, which are called objects.

[0015] ‌Object metadata is a set of name-value pairs that describe information about object properties. In object storage, object metadata includes the object's creation time, modification time, storage type, etc. This information can help manage and retrieve objects.

[0016] ‌Object data (Data), objects stored and managed in object storage.

[0017] SSD storage device: This application refers to a device that uses SSD as a storage medium. For example, SSD (Solid State Drive) is a storage device that uses flash memory storage technology. Unlike traditional mechanical hard drives, SSD has no mechanical moving parts.

[0018] Disk device: Disk refers to a storage device that uses magnetic recording technology to store data. Disk is the main storage medium of computers, which can store a large amount of binary data and keep the data intact even after power failure.

[0019] Magnetic tape equipment: Magnetic tape is a strip material with a magnetic layer used to record sound, images, numbers or other signals. It is the most widely used magnetic recording material with the largest output. It is usually made by coating a layer of granular magnetic material on a plastic film tape base (support) or evaporating and depositing a layer of magnetic oxide or alloy film. Summary of the invention

[0020] The present invention can realize the two-layer index relationship of "cold object index" ---> "cold object metadata" ---> "cold object data" through the index relationship of cold object metadata to cold object data, so as to realize the tape device to support object-oriented storage and access. Through the two-layer index relationship, the tape storage device can be managed by object-oriented storage addressing, without batch reading of tape data, which greatly improves the device access efficiency

[0021] A very cold object tape storage system comprises an extremely cold object index layer, a cold object data layer, and an extremely cold object metadata layer; the extremely cold object index layer comprises a storage device, and the storage device is used to store an extremely cold object index; the cold object data layer comprises a storage device C1, and the storage device C1 is used to store extremely cold object data; the extremely cold object metadata layer comprises a storage device D1, and the storage device D1 is used to store extremely cold object metadata; the extremely cold object index comprises the name or number of the extremely cold object and the location information of the storage device D1 storing the extremely cold object metadata; the extremely cold object metadata comprises the name or number of the extremely cold object and the location information of the storage device C1 storing the extremely cold object data; the storage device C1 is a tape storage device, and the storage device D1 is a tape storage device; the location information of the storage device D1 storing the extremely cold object metadata is found in the extremely cold object index according to the name or number; after obtaining the extremely cold object metadata, the location information of the storage device D1 storing the extremely cold object data is obtained; and then the extremely cold object data is obtained from the storage device D1.

[0022] It can be that the extremely cold object index layer includes an extremely cold level 1 object index layer; an extremely cold level 2 object index layer; and an extremely cold level 3 object index layer.

[0023] It can be that the ultra-cold level 1 object index layer includes an SSD storage device, and the SSD storage device is used to store the ultra-cold level 1 object index.

[0024] It can be that the extremely cold level 2 object index layer includes a hard disk storage device, and the hard disk storage device is used to store the extremely cold level 2 object index.

[0025] It can be that the extremely cold level 3 object index layer includes a tape storage device, and the tape storage device is used to store the extremely cold level 3 object index.

[0026] It may be that the extremely cold object index is stored in a database.

[0027] It can be that the extremely cold object index is stored using a key-value storage system.

[0028] It may be that it also includes a warm object data layer; the warm object data layer includes a storage device B1, and the storage device B1 is used to store warm object metadata; the warm object data layer includes a storage device B2, and the storage device B2 is used to store warm object data; the warm object metadata includes the warm object name or number and the location information of the storage device B2 for the warm object data; the storage device B1 is an SSD storage device, and the storage device B2 is a tape device or a disk device; first obtain the object metadata, and based on the content of the object metadata, confirm whether the data is on the disk or the tape; the warm object data is stored in an object storage system; the warm object metadata is stored in a key-value distributed storage system.

[0029] It may include a cold object data layer; the warm object data layer includes a storage device B3, and the storage device B3 is used to store cold object metadata; the cold object data layer includes a storage device C3, and the storage device C3 is used to store cold object data; the cold object metadata includes the cold object name or number and the location information of the storage device C3 for the cold object data; the storage device B3 is an SSD storage device or a hard disk device, and the storage device C3 is a tape storage device; the cold object metadata is stored in a key-value distributed storage system.

[0030] A method for accessing storage of extremely cold objects, including step C10: searching in an extremely cold object index library; step C20: whether a metadata number is found, if not, return and end; step D10: obtaining extremely cold object metadata in an extremely cold object metadata storage device according to the metadata number; step D20: obtaining extremely cold data in an extremely cold data storage device according to the extremely cold object metadata; the extremely cold object index is stored in an SSD, a disk or a tape storage device; the storage device of the extremely cold object metadata library is a tape device; the storage device of the extremely cold data is a tape device.

[0031] It may be that before step C10, the method further includes: step A10: searching in a warm object metadata database; step A20: whether warm object metadata is found; step A30: yes, obtaining warm object data according to the warm object metadata, and returning; step B10: no, searching for cold object metadata in a cold object metadata database; step B20: whether cold object metadata is found; step B30: yes, obtaining cold object data according to the cold object metadata, and returning; the storage device of the cold object metadata database is an SSD storage device or a disk device; the storage device of the cold object data is a tape device or a disk device; the storage device of the warm object metadata database is an SSD storage device; the storage device of the warm object data is an SSD storage device.

[0032] It can be that in step C, after obtaining the extremely cold object metadata, the extremely cold object metadata is moved to the cold object metadata database; in step D20, after obtaining the cold object metadata, the cold object data is moved to the SSD storage device.

[0033] A storage management method for extremely cold objects includes periodically checking an object metadata database; obtaining a temperature attribute and a last access time in the object metadata; if the temperature attribute is cold data, and if the last access time is greater than a set temperature value TC; the object metadata changes the temperature attribute of the data to extremely cold data; migrating the object metadata to a tape storage device, recording the index position of the object metadata in an extremely cold object index library, and deleting the object metadata in the object metadata database.

[0034] It can be that before the object metadata is migrated, the number of extremely cold metadata that needs to be migrated is counted, and if the number is greater than a migration threshold, the migration is started; the threshold is the minimum value of data written in a single time by the tape device.

[0035] It may also include, if the temperature attribute is warm data, if the most recent access time is greater than the set temperature value TH; changing the temperature attribute of the data in the object metadata to cold data; migrating the object data pointed to by the object metadata to the tape storage device, and recording the tape location information after the migration in the object metadata; deleting the original object data to release the storage location; before migrating the object data, counting the number of object data that need to be migrated, and starting the migration if the number is greater than the migration threshold; the threshold is the minimum value of data written by the tape device in a single time.

[0036] One of the technical effects of the above technical solution is: through the index relationship recorded from the extremely cold object metadata to the extremely cold object data, a two-layer index relationship of "extremely cold object index"--->"extremely cold object metadata"--->"extremely cold object data" can be realized, so that the tape device can support object-oriented storage and access.

[0037] One of the technical effects of the above technical solution is: through the two-layer index relationship, the tape storage device can be object-oriented storage addressing management, without the need to read tape data in batches, greatly improving the device access efficiency.

[0038] One of the technical effects of the above technical solution is that the ultra-cold object tape storage system can be established separately, independently of the existing object storage system, and managed independently.

[0039] One of the technical effects of the above technical solution is that the extremely cold object index layer includes multiple levels, which can realize heat management over a large time period.

[0040] One of the technical effects of the above technical solution is that the ultra-cold object index layer includes multiple levels, and ultra-cold object indexes of different levels use different storage media, which greatly reduces the storage cost of data with a large span.

[0041] One of the technical effects of the above technical solution is: for the extremely cold object index of the extremely cold level 1, it is stored in the SSD storage device, which can improve the search speed.

[0042] One of the technical effects of the above technical solution is: for the extremely cold object index of the extremely cold level 2, it is stored in the hard disk storage device, and the hard disk has a faster access speed.

[0043] One of the technical effects of the above technical solution is: for the extremely cold object index of the extremely cold level 2, it is stored in the tape storage device, which can save massive amounts of long-span extremely cold data, greatly reducing the storage cost.

[0044] One of the technical effects of the above technical solution is that it can save massive amounts of long-span extremely cold data, and for extremely low-frequency data access, single-object data addressing based on tape devices can be achieved, and the access efficiency of cold data is high.

[0045] One of the technical effects of the above technical solution is that the hierarchical storage of extremely cold data can effectively control the user's data waiting patience, and the user has the patience to wait for extremely cold object data.

[0046] One of the technical effects of the above technical solution is: warm objects and cold objects are also established as one, and data is gradually cooled to extremely cold object data and extremely cold object metadata, with low data movement overhead.

[0047] One of the technical effects of the above technical solution is: to convert a cold object to an ultra-cold object, only the metadata of the ultra-cold object needs to be moved, and there is no need to move the data of the ultra-cold object, so the system migration overhead is small. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] Figure 1 It is a schematic block diagram of an extremely cold object tape storage system;

[0049] Figure 2 is a very cold object tape storage system that includes a warm object data tier;

[0050] Figure 3 is an extremely cold object tape storage system including a cold object data tier;

[0051] Figure 4 It is a schematic diagram of an extremely cold object storage access method;

[0052] Figure 5 It is a schematic diagram of a warm object storage access method;

[0053] Figure 6 It is a schematic diagram of a method for managing storage of extremely cold objects;

[0054] Figure 7 It is a schematic diagram of a warm object storage management method;

[0055] Figure 8 It is a schematic diagram of a tape-based object storage backup method;

[0056] Fig. 9 The diagram is a tape-based object storage backup method. DETAILED DESCRIPTION

[0057] The content of this application is further described in detail below in conjunction with the accompanying drawings. It should be noted that the following is a description of the preferred embodiments of the present invention and does not constitute any limitation to the present invention. The description of the preferred embodiments of the present invention is only an illustration of the general principles of the present invention. The numbers such as "first", "second" and "A" and "B" involved in the present invention are only for the convenience of explanation and do not represent the order relationship in time or space. The combination of letters and numbers "TA", "TB" and "H" involved in the present invention are only for the convenience of explanation, and the meaning is determined by the vocabulary referred to.

[0058] like Figure 1 A very cold object tape storage system includes an extremely cold object index layer, a cold object data layer, and an extremely cold object metadata layer; the extremely cold object index layer includes a storage device, and the storage device is used to store the extremely cold object index; the cold object data layer includes a storage device C1, and the storage device C1 is used to store the extremely cold object data; the extremely cold object metadata layer includes a storage device D1, and the storage device D1 is used to store the extremely cold object metadata; the extremely cold object index includes the name or number of the extremely cold object and the location information of the storage device D1 storing the extremely cold object metadata; the extremely cold object metadata includes the name or number of the extremely cold object and the location information of the storage device C1 storing the extremely cold object data; the storage device C1 is a tape storage device, and the storage device D1 is a tape storage device; in the extremely cold object index, the location information of the storage device D1 storing the extremely cold object metadata is found according to the name or number; after obtaining the extremely cold object metadata, the location information of the storage device D1 storing the extremely cold object data is obtained; and then the extremely cold object data is obtained from the storage device D1.

[0059] The storage device C1 and the storage device D1 are tape storage devices, which can be physically isolated devices or the same physical device. An extremely cold object index layer is used to establish an index relationship between the object name and the extremely cold object metadata. Although the extremely cold object metadata is saved to the tape device, a single object can also be indexed and searched through the extremely cold object index.

[0060] By saving the extremely cold object metadata and extremely cold object data to the tape device, establishing an index relationship of the extremely cold object metadata through the extremely cold object index, and recording the index relationship of the extremely cold object metadata to the extremely cold object data, a two-layer index relationship of "extremely cold object index"--->"extremely cold object metadata"--->"extremely cold object data" can be realized, so that the tape device supports object-oriented storage and access.

[0061] Tape devices rotate in one direction, and the access speed is slow during the reading process. Traditional tape data is time-consuming and labor-intensive to address single objects. The amount of data stored in extremely cold objects is large, and the access frequency is low. However, for this type of access, users do not have high requirements for the real-time nature of data. For example, if a user queries a purchase data from a few years ago, the user has the patience to wait. Using tape devices to store extremely cold data can greatly reduce the pressure on the system's equipment costs. Using secondary indexes can reduce data cache overhead, and it is not necessary to read all the data on a disk before distinguishing extremely cold object metadata from extremely cold object data.

[0062] The ultra-cold object tape storage system can be established separately and managed independently from the existing object storage system.

[0063] It can be that the extremely cold object index layer includes an extremely cold level 1 object index layer; an extremely cold level 2 object index layer; and an extremely cold level 3 object index layer.

[0064] Although it is not expensive to store extremely cold object indexes in SSD storage devices or disk devices, for large systems, such as national shopping platforms, storing 10 or 20 years of shopping record data, even the index of object data is a very large amount of data. By grading extremely cold data, for example, according to the distance from the current year, extremely cold data is divided into level 1 corresponding to data within 10 years, level 2 corresponding to data from 10 to 20 years ago, and level 3 corresponding to data more than 20 years ago.

[0065] It can be that the ultra-cold level 1 object index layer includes an SSD storage device, and the SSD storage device is used to store the ultra-cold level 1 object index.

[0066] For the extremely cold object index of the extremely cold level 1, it is stored in the SSD storage device, which can improve the search speed.

[0067] It can be that the extremely cold level 2 object index layer includes a hard disk storage device, and the hard disk storage device is used to store the extremely cold level 2 object index.

[0068] The extremely cold object index of the extremely cold level 2 is stored in a hard disk storage device, and the hard disk has a faster access speed.

[0069] It can be that the extremely cold level 3 object index layer includes a tape storage device, and the tape storage device is used to store the extremely cold level 3 object index.

[0070] For the extremely cold object index of the extremely cold level 2, it is stored in the tape storage device. In extreme cases, it is necessary to access three independent tape storage devices separately, and the access speed of the search is relatively the slowest. However, the probability of this speed occurring is very small, and for individual users, this time overhead can be borne.

[0071] It may be that the extremely cold object index is stored in a database.

[0072] Use a database to save the cold object index. For the cold object index of level 2, the data of the entire data library of the tape storage device needs to be read into a cache disk, such as a disk, before it can be accessed. If a database is not used but a sequential table is used for storage, an algorithm search and access can be performed based on the relative position of the tape, such as binary search, to gradually find the location where the data is stored.

[0073] It can be that the extremely cold object index is stored using a key-value storage system.

[0074] For large data platforms, a key-value storage system can be used to store extremely cold object indexes. The elements stored in the extremely cold object index are simple, and can only store the name of the object and the tape device number and location. Large key-value storage systems can be used to store massive amounts of data.

[0075] like Figure 2 , it can be that it also includes a warm object data layer; the warm object data layer includes a storage device B1, and the storage device B1 is used to store warm object metadata; the warm object data layer includes a storage device B2, and the storage device B2 is used to store warm object data; the warm object metadata includes the warm object name or number and the location information of the storage device B2 for the warm object data; the storage device B1 is an SSD storage device, and the storage device B2 is a tape device or a disk device; first obtain the object metadata, and based on the content of the object metadata, confirm whether the data is on the disk or the tape; the warm object data is stored in an object storage system; the warm object metadata is stored in a key-value distributed storage system.

[0076] The ultra-cold object tape storage system can be used as a part of the system, and warm objects and cold objects can also be established as one, and the data is gradually cooled to the ultra-cold object data and ultra-cold object metadata.

[0077] For online document data platforms, after a file is generated, it will be read and modified repeatedly in a short period of time. The access frequency of these file object data, object metadata and object data is relatively frequent. A warm object data layer can be set up. In the warm object data layer, warm object metadata and warm object data are all stored in SSD storage devices. The warm object metadata stores the index location of the warm object data, the creation time of the warm object data, the nature of the data and other information.

[0078] like Figure 3, it can be, including a cold object data layer; the warm object data layer includes a storage device B3, and the storage device B3 is used to store cold object metadata; the cold object data layer includes a storage device C3, and the storage device C3 is used to store cold object data; the cold object metadata includes the cold object name or number and the location information of the storage device C3 of the cold object data; the storage device B3 is an SSD storage device or a hard disk device, and the storage device C3 is a tape storage device; the cold object metadata is stored in a key-value distributed storage system.

[0079] For online document data platforms or short video platforms, after a file is generated for a period of time, the frequency of modification and the frequency of access and reading gradually decrease. The number of such files on the platform is huge, and it is necessary to retain the timely reading of these data metadata information. For the object data itself, a faster reading speed is also required. This type of data can be defined as cold data. Another feature of cold data is that it is downgraded from warm data. Therefore, keep the object metadata of the data unchanged and migrate the object data to the cold data level. In the object metadata, modify the data attributes to cold objects to reduce the migration of cold object metadata.

[0080] Cold object metadata is a variation of warm object metadata. When the access frequency of a piece of data decreases, the data's attributes are modified to be a very cold object in the object metadata. The very cold object metadata also needs to be moved to a tape device, and a very cold object index is created in the very cold object index layer. Then, the object metadata in the warm object data layer is deleted.

[0081] like Figure 4 A method for accessing storage of extremely cold objects, including step C10: searching in an extremely cold object index library; step C20: checking whether a metadata number is found, if not, returning to the end; step D10: obtaining extremely cold object metadata in an extremely cold object metadata storage device according to the metadata number; step D20: obtaining extremely cold data in an extremely cold data storage device according to the extremely cold object metadata; the extremely cold object index is stored in an SSD, a disk or a tape storage device; the storage device of the extremely cold object metadata library is a tape device; the storage device of the extremely cold data is a tape device.

[0082] The extremely cold object tape storage system can be established and managed independently. When the extremely cold object tape storage system reads data, it needs to use the two-layer index relationship of "extremely cold object index"--->"extremely cold object metadata"--->"extremely cold object data" to realize the tape device's support for object-oriented storage and access.

[0083] The super cold object index is stored in SSD, disk or tape storage devices. The access speed is fastest in SSD and slowest in tape storage devices. For systems with SSD, disk and tape at the same time, the super cold object index needs to be accessed in sequence. Only when the super cold object index is not found in the tape storage device can it be determined that the object is not stored in the system.

[0084] like Figure 5 , it may be that before step C10, it also includes: step A10: searching in the warm object metadata database; step A20: whether the warm object metadata is found; step A30: yes, obtaining the warm object data according to the warm object metadata, and returning; step B10: no, searching the cold object metadata in the cold object metadata database; step B20: whether the cold object metadata is found; step B30: yes, obtaining the cold object data according to the cold object metadata, and returning; the storage device of the cold object metadata database is an SSD storage device or a disk device; the storage device of the cold object data is a tape device or a disk device; the storage device of the warm object metadata database is an SSD storage device; the storage device of the warm object data is an SSD storage device.

[0085] It can be that in step C, after obtaining the extremely cold object metadata, the extremely cold object metadata is moved to the cold object metadata database; in step D20, after obtaining the cold object metadata, the cold object data is moved to the SSD storage device.

[0086] For a system with warm objects or cold objects, it is necessary to search and access data in the order of warm objects, cold objects, and very cold objects, because the warm, cold, and very cold objects of the data are changing.

[0087] like Figure 6 A method for storing and managing extremely cold objects includes periodically checking an object metadata database; obtaining a temperature attribute and a last access time in the object metadata; if the temperature attribute is cold data, and if the last access time is greater than a set temperature value TC; changing the temperature attribute of data in the object metadata to extremely cold data; migrating the object metadata to a tape storage device, recording the index position of the object metadata in an extremely cold object index library, and deleting the object metadata in the object metadata database.

[0088] Periodic queries on object metadata can be performed based on business characteristics, such as in units of one day or one month. For data in large object data systems, the time records of the most recent access are checked to determine the popularity of the data, and the object data is migrated first, followed by the object metadata.

[0089] It can be that before the object metadata is migrated, the number of extremely cold metadata that needs to be migrated is counted, and if the number is greater than a migration threshold, the migration is started; the threshold is the minimum value of data written in a single time by the tape device.

[0090] For tape devices, it is best to adopt batch writing mode for single movement, which can greatly improve the utilization efficiency of the device. When the data to be moved is found, the tag to be moved can be recorded in the object metadata, and the data can be migrated at one time when the migration scale is reached.

[0091] like Figure 7 , it can be, and also includes, if the temperature attribute is warm data, if the most recent access time is greater than the set temperature value TH; in the object metadata, the temperature attribute of the data is changed to cold data; the object data pointed to by the object metadata is migrated to the tape storage device, and the tape location information after the migration is recorded in the object metadata; the original object data is deleted to release the storage location; before the object data is migrated, the number of object data that needs to be migrated is counted, and if the number is greater than the migration threshold, the migration is started; the threshold is the minimum value of data written by the tape device in a single time.

[0092] Although the present invention is illustrated and described according to the preferred embodiment and several alternatives, the invention is not limited by the specific description in this specification. Other additional replacement or equivalent components can also be used to practice the present invention.

Claims

1. A very cold object magnetic tape storage system, characterized in that: It includes the extremely cold object index layer, the cold object data layer, and the extremely cold object metadata layer; The extremely cold object index layer includes a storage device, and the storage device is used to store the extremely cold object index; The cold object data layer includes a storage device C1, which is used to store extremely cold object data; The extremely cold object metadata layer includes a storage device D1, and the storage device D1 is used to store extremely cold object metadata; The extremely cold object index includes the name or number of the extremely cold object and the location information of the storage device D1 where the extremely cold object metadata is stored; The extremely cold object metadata includes the extremely cold object name or number and the location information of the storage device C1 of the extremely cold object data; The storage device C1 is a magnetic tape storage device, and the storage device D1 is a magnetic tape storage device; Find the location information of the storage device D1 where the metadata of the extremely cold object is stored in the extremely cold object index according to the name or number; After obtaining the extremely cold object metadata, obtain the location information of the storage device D1 of the extremely cold object data; then obtain the extremely cold object data from the storage device D1; The extremely cold object index is stored in a database; Or the extremely cold object index is stored in a key-value storage system; In the extremely cold object index library, the index location of the object metadata is recorded. Search in the Extremely Cold Object Index; The metadata number is found; According to the metadata number, obtain the extremely cold object metadata in the extremely cold object metadata storage device D1; According to the extremely cold object metadata, extremely cold data is obtained in an extremely cold data storage device.

2. The extremely cold object magnetic tape storage system according to claim 1, characterized in that: include Feature T10: According to the distance from the current year, the extremely cold object index layer includes an extremely cold level 1 object index layer; an extremely cold level 2 object index layer; and an extremely cold level 3 object index layer; Includes any one or more of the following characteristics: Feature T20: The ultra-cold level 1 object index layer includes an SSD storage device, and the SSD storage device is used to store the ultra-cold level 1 object index; Feature T30: The extremely cold level 2 object index layer includes a hard disk storage device, and the hard disk storage device is used to store the extremely cold level 2 object index; Feature T40: The deep-cold level 3 object index layer includes a tape storage device, and the tape storage device is used to store the deep-cold level 3 object index.

3. The extremely cold object magnetic tape storage system according to claim 1, characterized in that: Includes warm object data layer; The warm object data layer includes a storage device B1, which is used to store warm object metadata; The warm object data layer includes a storage device B2, which is used to store warm object data; The temperature object metadata includes the temperature object name or number and the location information of the storage device B2 of the temperature object data; The storage device B1 is an SSD storage device, and the storage device B2 is a disk device; First, obtain the object metadata and confirm that the data is on the disk based on the content of the object metadata; The warm object data is stored in an object storage system; The warm object metadata is stored using a key-value distributed storage system.

4. The extremely cold object magnetic tape storage system according to claim 3, characterized in that: The warm object data layer includes a storage device B3, which is used to store cold object metadata; The cold object data layer includes a storage device C3, and the storage device C3 is used to store cold object data; The cold object metadata includes the cold object name or number and the location information of the storage device C3 of the cold object data; The storage device B3 is an SSD storage device or a hard disk device. The storage device C3 is a magnetic tape storage device; The cold object metadata is stored in a key-value distributed storage system.

5. A method for accessing an extremely cold object storage, used in the extremely cold object tape storage system according to any one of claims 1 to 4, characterized in that: include Step C10: Search in the extremely cold object index library; Step C20: Check whether the metadata number is found, if not, return to the end; Step D10: Obtaining the extremely cold object metadata in an extremely cold object metadata storage device according to the metadata number; Step D20: Obtaining extremely cold data in an extremely cold data storage device according to the extremely cold object metadata; The extremely cold object index is stored in an SSD, disk or tape storage device; In a system with SSDs, disks, and tapes, the index of extremely cold objects needs to be accessed sequentially. The storage device for the extremely cold object metadata is a magnetic tape device; The storage device for the extremely cold data is a magnetic tape device.

6. The method for accessing extremely cold object storage according to claim 5, characterized in that: Before step C10, it also includes Step A10: Search in the warm object metadata database; Step A20: whether the metadata of the warm object is found; Step A30: yes, obtain the temperature object data according to the temperature object metadata, and return; Step B10: No, search for cold object metadata in the cold object metadata database; Step B20: whether cold object metadata is found; Step B30: yes, obtain the cold object data according to the cold object metadata, and return; The storage device of the cold object metadata database is an SSD storage device or a disk device; The storage device of the cold object data is a magnetic tape device or a magnetic disk device; The storage device of the warm object metadata database is an SSD storage device; The storage device for the warm object data is an SSD storage device.

7. The method for accessing extremely cold object storage according to claim 5, characterized in that: In step C, after obtaining the extremely cold object metadata, the extremely cold object metadata is moved to a cold object metadata database; In step D20, after the cold object metadata is obtained, the cold object data is moved to the SSD storage device.

8. A method for managing storage of extremely cold objects, used in the extremely cold object magnetic tape storage system according to any one of claims 1 to 4, characterized in that: include Periodically check the object metadata database; obtain the temperature attribute and the last access time in the object metadata; If the temperature attribute is cold data, if the most recent access time is greater than the set temperature value TC; the temperature attribute of the object metadata change data is extremely cold data; The object metadata is migrated to a tape storage device, an index position of the object metadata is recorded in an extremely cold object index library, and the object metadata in the object metadata library is deleted.

9. The extremely cold object storage management method according to claim 8, characterized in that: Before object metadata migration, the number of extremely cold metadata that needs to be migrated is counted, and if the number is greater than a migration threshold, the migration is started; The threshold is the minimum value of data that can be written to the tape device in a single time.

10. The extremely cold object storage management method according to claim 8, characterized in that: Also includes If the temperature attribute is warm data, and if the most recent access time is greater than the set temperature value TH; in the object metadata, change the temperature attribute of the data to cold data; migrate the object data pointed to by the object metadata to a tape storage device, and record the tape location information after migration in the object metadata; Delete the original object data and release the storage location; Before object data is migrated, the number of object data to be migrated is counted, and if the number is greater than a migration threshold, migration is started; The threshold is the minimum value of data that can be written to the tape device in a single time.

Images