Data processing method, device and equipment of fusion storage system and storage medium

By identifying and segmenting multi-level directory hierarchies in the converged storage system, the problem of storage protocol incompleteness when SAN and NAS storage are merged is solved, and the complete storage of directory objects is achieved.

CN114996236BActive Publication Date: 2025-10-10JINAN INSPUR DATA TECH CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202210727061.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-06-24
Publication Date
2025-10-10
Estimated Expiration
2042-06-24

AI Technical Summary

Technical Problem

When SAN storage and NAS storage are merged, the S3 protocol cannot identify the directory hierarchy, resulting in incomplete storage protocol features after the merger.

Method used

By determining whether the storage directory in the object data contains a multi-level directory hierarchy, and dividing and creating multiple target directories in the converged storage system, a multi-level directory hierarchy is constructed to store the object data, ensuring the integrity of the storage protocol.

Benefits of technology

It supports uploading objects with directories in storage systems that integrate SAN and NAS protocols, ensuring the integrity of the storage protocols.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114996236B_ABST
    Figure CN114996236B_ABST
Patent Text Reader

Abstract

The application relates to the technical field of network storage, and discloses a data processing method and device of a converged storage system, equipment and a storage medium, which comprises the following steps: acquiring object data uploaded to a converged storage system through a first storage protocol; the converged storage system takes a storage mode supported by a second storage protocol as a data storage base, and the first storage protocol and the second storage protocol are converged and intercommunicated; judging whether a storage directory in the object data contains a multi-level directory level, if yes, the multi-level directory level is segmented to obtain a plurality of target directories; the multi-level directory level in the converged storage system is constructed by creating the target directories in the converged storage system respectively, and target objects in the object data are stored under the multi-level directory level in the converged storage system. The application can guarantee the integrity of the storage protocol after convergence and intercommunication.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of network storage technology, and in particular to a data processing method, device, equipment and storage medium of a fusion storage system. Background Art

[0002] With the development of computer informatization, converged storage has been deployed on a large scale across various industries. Converged storage, also known as unified storage, can significantly reduce overall storage costs. A piece of data may need to be used multiple times in a single business scenario. Without interoperable protocols, multiple data copies are required, which not only requires data migration but also consumes additional storage space.

[0003] Currently, the most common deployment is the converged deployment of SAN storage (Storage Area Network) and NAS storage (Network Attached Storage). For example, the S3 protocol (Simple Storage Service, SiMP22017531le Storage Service) and the NAS protocol (a type of SAN storage) are both examples. S3 is theoretically a global storage area network (SAN) that supports object storage, which is stored in buckets. However, the S3 storage architecture is a flat language that doesn't recognize directory hierarchies. The S3 protocol, based on object storage, supports uploading objects with directories. However, the storage system resulting from the converged interconnection of the SAN and S3 protocols is based on file storage and doesn't support uploading objects with directories, making the converged S3 protocol feature incomplete.

[0004] Therefore, the above technical problems are in urgent need of being solved by those skilled in the art. Summary of the Invention

[0005] In view of this, the purpose of the present invention is to provide a data processing method, device, equipment and storage medium for a converged storage system, which can ensure the integrity of the storage protocol after convergence and interoperability. The specific solution is as follows:

[0006] A first aspect of the present application provides a data processing method for a converged storage system, comprising:

[0007] Obtaining object data uploaded to a converged storage system through a first storage protocol; wherein the converged storage system uses a storage method supported by a second storage protocol as a data storage base and the first storage protocol and the second storage protocol are converged and interoperable;

[0008] determining whether the storage directory in the object data includes multiple directory hierarchies, and if so, dividing the multiple directory hierarchies to obtain multiple target directories;

[0009] The multi-level directory hierarchy in the converged storage system is constructed by creating the target directories in the converged storage system respectively, and the target objects in the object data are stored under the multi-level directory hierarchy in the converged storage system.

[0010] Optionally, the judging whether the storage directory in the object data contains the multi-level directory hierarchy comprises:

[0011] judging whether the storage directory in the object data contains a plurality of level identifiers, and if yes, determining that the storage directory in the object data contains the multi-level directory hierarchy.

[0012] Optionally, the splitting the multi-level directory hierarchy to obtain a plurality of target directories comprises:

[0013] identifying the names adjacent to each of the level identifiers;

[0014] determining the directory names and the object names from all the identified names, so as to obtain a plurality of the target directories according to the directory names.

[0015] Optionally, the constructing the multi-level directory hierarchy in the converged storage system by creating the target directories in the converged storage system respectively comprises:

[0016] dividing the plurality of target directories according to the positions of the level identifiers in the storage directory, and creating the target directories of the highest level in the converged storage system in the order of the divided levels;

[0017] judging whether the target directories of the next level exist under the target directories of the highest level after being created, and if not, creating the target directories of the next level under the target directories of the highest level after being created, until each of the target directories exists in the converged storage system, and then stopping the creation to obtain the multi-level directory hierarchy in the converged storage system.

[0018] Optionally, after the constructing the multi-level directory hierarchy in the converged storage system by creating the target directories in the converged storage system respectively, the method further comprises:

[0019] creating an empty folder named by the object name of the target object under the multi-level directory hierarchy in the converged storage system, so as to store the target object in the object data in the empty folder under the multi-level directory hierarchy in the converged storage system.

[0020] Optionally, the data processing method of the converged storage system further comprises:

[0021] The multi-level target hierarchy constructed in the fusion storage system is spliced with the name of the empty folder to obtain a storage directory of the target object in the fusion storage system, so that the client obtains the target object based on the storage directory of the target object in the fusion storage system.

[0022] Optionally, the client obtains the target object based on the storage directory of the target object in the fusion storage system, including:

[0023] When the client obtains the target object from the fusion storage system through the first storage protocol, the target object is directly obtained based on the storage directory of the target object in the fusion storage system;

[0024] When the client obtains the target object from the fusion storage system through the second storage protocol, the storage directory of the target object in the fusion storage system is mounted to the client in the form of an NFS shared directory, so that the client obtains the target object based on the mounted directory.

[0025] The second aspect of the present application provides a data processing device of a fusion storage system, including:

[0026] An object data obtaining module is configured to obtain object data uploaded to a fusion storage system through a first storage protocol; wherein the fusion storage system takes a storage mode supported by a second storage protocol as a data storage base, and the first storage protocol and the second storage protocol are fused and intercommunicate;

[0027] A judgment and division module is configured to judge whether a storage directory in the object data contains a multi-level directory hierarchy, and if so, to divide the multi-level directory hierarchy to obtain a plurality of target directories;

[0028] A creation storage module is configured to construct the multi-level directory hierarchy in the fusion storage system by creating the target directories in the fusion storage system respectively, and to store a target object in the object data under the multi-level directory hierarchy in the fusion storage system.

[0029] The third aspect of the present application provides an electronic device, including a processor and a memory; wherein the memory is configured to store a computer program, the computer program is loaded and executed by the processor to realize the data processing method of the fusion storage system.

[0030] A fourth aspect of the present application provides a computer-readable storage medium, in which computer-executable instructions are stored. When the computer-executable instructions are loaded and executed by a processor, the data processing method of the aforementioned fusion storage system is implemented.

[0031] In the present application, first, obtain the object data uploaded to the fusion storage system through the first storage protocol; wherein, the fusion storage system uses the storage method supported by the second storage protocol as the data storage base and the first storage protocol and the second storage protocol are integrated and interoperable; then determine whether the storage directory in the object data contains a multi-level directory hierarchy, if so, split the multi-level directory hierarchy to obtain multiple target directories; finally, construct the multi-level directory hierarchy in the fusion storage system by creating the target directories in the fusion storage system respectively, and store the target object in the object data under the multi-level directory hierarchy in the fusion storage system. It can be seen that the present application is for object data uploaded to the fusion storage system through the first storage protocol, the object data includes the target object and the storage directory of the target object, and the target object is also the object to be uploaded. First, identify whether the storage directory contains a multi-level directory hierarchy, if it contains a multi-level directory hierarchy, separate the individual directories, and then create the individual directories in the fusion storage system to finally construct the multi-level directory hierarchy, on this basis, store the target object under the multi-level directory hierarchy constructed in the fusion storage system, so as to ensure the integrity of the storage protocol after integration and interoperability. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are merely embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying any creative work.

[0033] Figure 1 A flow chart of a data processing method for a fusion storage system provided in this application;

[0034] Figure 2 A flowchart of a specific data processing method of a fusion storage system provided in this application;

[0035] Figure 3 A flowchart of a specific data processing method of a fusion storage system provided in this application;

[0036] Figure 4 A schematic diagram of the structure of a data processing device of a fusion storage system provided by this application;

[0037] Figure 5 This is a structural diagram of a data processing electronic device of a fusion storage system provided in this application. DETAILED DESCRIPTION

[0038] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of the present invention.

[0039] In the prior art, when two storage protocols are integrated and interconnected, the integrity of the storage protocol after integration and interconnection is often not guaranteed. For example, when integrating the S3 protocol and the NAS protocol, the S3 storage architecture is a flat language that does not recognize the directory hierarchy relationship. The S3 protocol based on object storage supports uploading objects with directories. The storage system after the integration and interconnection of the SAN and S3 protocols is based on file storage and does not support uploading objects with directories, which makes the characteristics of the S3 protocol after integration incomplete. In response to the above technical defects, the present application provides a data processing solution for a fusion storage system. For object data uploaded to the fusion storage system through a first storage protocol, the object data includes a target object and a storage directory of the target object. The target object is also the object to be uploaded. First, it is identified whether the storage directory contains a multi-level directory hierarchy. If it contains a multi-level directory hierarchy, each directory is separated. Then, each directory is created in the fusion storage system to finally construct the multi-level directory hierarchy. On this basis, the target object is stored under the multi-level directory hierarchy constructed in the fusion storage system, so that the integrity of the storage protocol after integration and interconnection can be guaranteed.

[0040] Figure 1 This is a flow chart of a data processing method for a fusion storage system provided in an embodiment of the present application. Figure 1 As shown, the data processing method of the fusion storage system includes:

[0041] S11: Acquire object data uploaded to a fusion storage system through a first storage protocol; wherein, the fusion storage system uses a storage method supported by a second storage protocol as a data storage base and the first storage protocol and the second storage protocol are fused and interoperable.

[0042] In this embodiment, the fused storage system uses the storage method supported by the second storage protocol as the data storage base, and the first storage protocol and the second storage protocol are integrated and interoperable. The storage method supported by the first storage protocol can be object storage, that is, the first storage protocol can use object storage as the data storage base. The storage method supported by the second storage protocol can be file storage, that is, the second storage protocol can use file storage as the data storage base. The fused storage system obtained by integrating and interoperating the first storage protocol and the second storage protocol uses file storage as the data storage base. At this time, the fused storage system does not support uploading objects with directories, which affects the integrity of the first storage protocol.

[0043] In this embodiment, object data uploaded to the converged storage system via a first storage protocol is first obtained. The object data can be uploaded to the converged storage system for storage by a user client, or by any server in a storage server cluster acting as a client. When uploading data, the client not only uploads the target object (i.e., the object to be uploaded) but also the storage directory of the target object on the client. In other words, the object data includes the target object and its storage directory.

[0044] Furthermore, in this embodiment, before obtaining the object data uploaded to the fusion storage system through the first storage protocol, it is necessary to first obtain the target data uploaded to the fusion system and determine the target storage protocol for uploading the target data. If the target storage protocol is the first storage protocol, the target data is determined as the object data. If the target storage protocol is the second storage protocol, the target data is directly stored in the fusion storage system in a storage method supported by the second storage protocol.

[0045] S12: Determine whether the storage directory in the object data contains multiple directory hierarchies. If yes, split the multiple directory hierarchies to obtain multiple target directories.

[0046] In this embodiment, after obtaining the object data, it is determined whether the storage directory in the object data contains a multi-level directory hierarchy. If the storage directory in the object data contains the multi-level directory hierarchy, the multi-level directory hierarchy is split to obtain multiple target directories. Including the multi-level directory hierarchy means that the storage directory in the object data is an object containing at least two directories, that is, the target object is an object stored in at least two directories in the client. For example, when the storage path in the object data is "bucket1 / dir1 / dir2 / object1", bucket1 is a container for storing objects (which can be considered as directory one, but generally does not need to be created separately), dir1 and dir2 represent two directories, object1 is the target object, and the storage directory is "bucket1 / dir1 / dir2 / ". After splitting the storage directory, three target directories are obtained.

[0047] S13: Construct the multi-level directory hierarchy in the fusion storage system by respectively creating the target directories in the fusion storage system, and store the target objects in the object data under the multi-level directory hierarchy in the fusion storage system.

[0048] In this embodiment, after obtaining multiple target directories, it is necessary to create the same storage directory in the fusion storage system, and then store the target object under the storage directory. Specifically, the multi-level directory hierarchy in the fusion storage system is first constructed by respectively creating the target directories in the fusion storage system, that is, the storage directory "bucket1 / dir1 / dir2 / " is constructed in the bucket1 container of the fusion storage system. Then, the target objects in the object data are stored under the multi-level directory hierarchy in the fusion storage system. Through the above steps, it is possible to support the S3 protocol to upload directory objects on a storage system that integrates and communicates with the S3 and NAS protocols based on files, thereby ensuring the integrity of the S3 protocol.

[0049] It can be seen that the embodiment of the application first acquires object data uploaded to the converged storage system through a first storage protocol; wherein the converged storage system takes a storage mode supported by a second storage protocol as a data storage base and the first storage protocol and the second storage protocol are converged and intercommunicated; then it is judged whether a storage directory in the object data contains a multi-level directory hierarchy, if yes, the multi-level directory hierarchy is segmented to obtain a plurality of target directories; finally, the multi-level directory hierarchy in the converged storage system is constructed by creating the target directories in the converged storage system respectively, and target objects in the object data are stored under the multi-level directory hierarchy in the converged storage system. The embodiment of the application is for object data uploaded to the converged storage system through the first storage protocol, the object data includes target objects and a storage directory of the target objects, the target objects are objects to be uploaded, it is first judged whether the storage directory contains a multi-level directory hierarchy, if yes, each directory is separated, then each directory is created in the converged storage system to finally construct the multi-level directory hierarchy, on this basis, the target objects are stored under the multi-level directory hierarchy constructed in the converged storage system, so that the integrity of the storage protocol after convergence and intercommunication can be ensured.

[0050] Figure 2 A specific data processing method flowchart of a converged storage system is provided for the embodiment of the application. Referring to FIG. 8, Figure 3 The data processing method of the converged storage system includes:

[0051] S21: acquiring object data uploaded to the converged storage system through a first storage protocol; wherein the converged storage system takes a storage mode supported by a second storage protocol as a data storage base and the first storage protocol and the second storage protocol are converged and intercommunicated.

[0052] In the embodiment, the specific process of step S21 can refer to the corresponding content disclosed in the foregoing embodiments, which will not be repeated here.

[0053] S22: judging whether a storage directory in the object data contains a plurality of level identifiers, if yes, it is determined that the storage directory in the object data contains the multi-level directory hierarchy.

[0054] S23: identifying names adjacent to each of the level identifiers, and determining directory names and object names from all the identified names to obtain a plurality of target directories according to the directory names.

[0055] In this embodiment, it is determined whether the storage directory in the object data contains multiple hierarchical identifiers. If so, it is determined that the storage directory in the object data contains the multiple directory hierarchies. The hierarchical identifier can be marked with the character " / ". As described in the previous embodiment, when the storage path in the object data is "bucket1 / dir1 / dir2 / object1", the storage path includes three hierarchical identifiers " / ".

[0056] In this embodiment, when multiple hierarchical identifiers are included, it is necessary to further identify the names adjacent to each hierarchical identifier and determine the directory name and object name from all identified names, thereby obtaining multiple target directories based on the directory names. After identifying the names adjacent to each hierarchical identifier in the above storage path, four names are obtained: bucket1, dir1, dir2, and object1. Bucket1, dir1, and dir2 are further identified as directory names, and object1 is identified as an object name. The three directory names bucket1, dir1, and dir2 can be used as the corresponding target directories, meaning that the target directories ultimately obtained are bucket1, dir1, and dir2.

[0057] S24: hierarchically dividing the plurality of target directories according to the positions of the hierarchical identifiers in the storage directory, and first creating the target directory of the highest level in the fusion storage system according to the hierarchical order after division.

[0058] S25: Determine whether there is a target directory of the next level under the target directory of the highest level after creation. If not, create the target directory of the next level under the target directory of the highest level after creation, and stop creating until each target directory exists in the fusion storage system to obtain the multi-level directory hierarchy in the fusion storage system.

[0059] In this embodiment, the process of creating a directory in the fused storage system is as follows: first, the multiple target directories are hierarchically divided according to the position of the hierarchical identifier in the storage directory, and the highest-level target directory is first created in the fused storage system according to the hierarchical order after the division. When performing the hierarchical division, the division can be performed according to the order in which the directories are located in the storage directory, with the directories closer to the target object name having a lower level, and the directories farther away from the target object name having a lower level. For example, bucket1 is the highest-level directory, dir1 is the middle-level directory, and dir2 is the lowest-level directory.

[0060] Then determine whether there is a target directory of the next level under the target directory of the highest level after creation. If not, create the target directory of the next level under the target directory of the highest level after creation. Stop creation until each target directory exists in the fusion storage system to obtain the multi-level directory hierarchy in the fusion storage system. Specifically, after bucket1 is created, it is necessary to first check whether there is a directory dir1 under bucket1. If the directory dir1 does not exist, create the directory dir1. If the directory exists in dir1, skip creating the directory dir1 and then create the directory dir2. When creating the directory dir2, first check whether there is a directory dir2 under bucekt1 / dir1. If the directory dir2 does not exist, execute the creation of the directory dir2. Once the creation is complete, the storage directory "bucket1 / dir1 / dir2 / " in the fusion storage system is obtained. It is understood that when creating a directory, a directory creation command can be generated and executed to create the directory, including but not limited to the mkdir command. When creating the directory dir1, the "mkdir dir1" command is executed. Similarly, when creating the directory dir2, the "mkdir dir2" command is executed.

[0061] S26: Storing the target object in the object data under the multi-level directory hierarchy in the fusion storage system.

[0062] In this embodiment, regarding the specific process of the above-mentioned step S26, reference may be made to the corresponding content disclosed in the above-mentioned embodiment, and no further details will be given here.

[0063] Figure 3 This is a flow chart of a specific data processing method of a fusion storage system provided in an embodiment of the present application. Figure 3 As shown, the data processing method of the fusion storage system includes:

[0064] S31: Acquire object data uploaded to a fusion storage system through a first storage protocol; wherein the fusion storage system uses a storage method supported by a second storage protocol as a data storage base and the first storage protocol and the second storage protocol are fusion-interoperable.

[0065] S32: Determine whether the storage directory in the object data contains multiple directory hierarchies. If yes, split the multiple directory hierarchies to obtain multiple target directories.

[0066] S33: Construct the multi-level directory hierarchy in the fusion storage system by respectively creating the target directories in the fusion storage system.

[0067] In this embodiment, regarding the specific process of the above steps S31 to S32, reference may be made to the corresponding content disclosed in the above embodiments, and no further details will be given here.

[0068] S34: creating an empty folder named with the object name of the target object under the multi-level directory hierarchy in the fusion storage system, so as to store the target object in the object data in the empty folder under the multi-level directory hierarchy in the fusion storage system.

[0069] S35: Concatenate the multi-level target hierarchy constructed in the fusion storage system with the name of the empty folder to obtain a storage directory of the target object in the fusion storage system.

[0070] In this embodiment, an empty folder named with the object name of the target object is first created under the multi-level directory hierarchy in the fusion storage system, so that the target object in the object data is stored in the empty folder under the multi-level directory hierarchy in the fusion storage system. For example, an empty file object1 is created, and then the target object is written to object1. The metadata of the target object is stored in the metadata storage pool, and the data is stored in the data storage pool. On this basis, the multi-level target hierarchy constructed in the fusion storage system is spliced ​​with the name of the empty folder to obtain the storage directory of the target object in the fusion storage system, so that the client can obtain the target object based on the storage directory of the target object in the fusion storage system. The above process is also the process of object name splicing, which mainly splices the multi-level directory and object into an object named bucekt1 / dir1 / dir2 / object1.

[0071] S36: When the client obtains the target object from the fusion storage system through the first storage protocol, the target object is directly obtained based on the storage directory of the target object in the fusion storage system.

[0072] S37: When the client obtains the target object from the fusion storage system through the second storage protocol, the storage directory of the target object in the fusion storage system is mounted to the client as an NFS shared directory, so that the client obtains the target object based on the mounted directory.

[0073] In this embodiment, because the first storage protocol and the second storage protocol in the converged storage system are integrated and interoperable, when retrieving data, the client can obtain objects with directories using either the first storage protocol or the second storage protocol. For example, objects with directories can be obtained using either the S3 protocol or the NAS protocol.

[0074] In one embodiment, when the client obtains the target object from the converged storage system using the first storage protocol, the target object is obtained directly based on the target object's storage directory in the converged storage system. In this scenario, the object dir1 / dir2 / object1 can be directly downloaded by executing the command "doscmd get s3: / / bucket1 / dir1 / dir2 / object1." In another embodiment, when the client obtains the target object from the converged storage system using the second storage protocol, the target object's storage directory in the converged storage system is mounted to the client as an NFS share, so that the client can obtain the target object based on the mounted directory. In this scenario, an NFS share is created for bucket1 and mounted to the client. After the client enters the mounted directory bucket1, it executes the switch command "cd dir1 / dir2 / " to enter the dir2 directory. Finally, the object object1 can be viewed by executing commands such as "ll." This embodiment does not limit the specific forms of the above commands.

[0075] See also Figure 4 As shown, the embodiment of the present application also discloses a data processing device of a fusion storage system, including:

[0076] An object data acquisition module 11 is configured to acquire object data uploaded to a converged storage system via a first storage protocol; wherein the converged storage system uses a storage method supported by a second storage protocol as a data storage base, and the first storage protocol and the second storage protocol are integrated and interoperable;

[0077] a determination and segmentation module 12 for determining whether the storage directory in the object data contains multiple directory hierarchies, and if so, segmenting the multiple directory hierarchies to obtain multiple target directories;

[0078] A storage module 13 is created, which is used to construct the multi-level directory hierarchy in the fusion storage system by respectively creating the target directories in the fusion storage system, and store the target objects in the object data under the multi-level directory hierarchy in the fusion storage system.

[0079] It can be seen that the embodiment of the present application first obtains the object data uploaded to the fusion storage system through the first storage protocol; wherein the fusion storage system uses the storage method supported by the second storage protocol as the data storage base and the first storage protocol and the second storage protocol are integrated and interoperable; then determines whether the storage directory in the object data contains a multi-level directory hierarchy. If so, the multi-level directory hierarchy is divided to obtain multiple target directories; finally, the multi-level directory hierarchy in the fusion storage system is constructed by creating the target directories in the fusion storage system respectively, and the target object in the object data is stored under the multi-level directory hierarchy in the fusion storage system. For the object data uploaded to the fusion storage system through the first storage protocol, the object data includes the target object and the storage directory of the target object, and the target object is also the object to be uploaded. First, it is identified whether the storage directory contains a multi-level directory hierarchy. If it contains a multi-level directory hierarchy, each directory is separated, and then each directory is created in the fusion storage system to finally construct the multi-level directory hierarchy. On this basis, the target object is stored under the multi-level directory hierarchy constructed in the fusion storage system, so as to ensure the integrity of the storage protocol after integration and interoperability.

[0080] In some specific embodiments, the determination and segmentation module 12 specifically includes:

[0081] a judging unit, configured to judge whether the storage directory in the object data contains multiple hierarchical identifiers, and if so, to determine that the storage directory in the object data contains the multiple directory hierarchies;

[0082] The segmentation unit is configured to identify the names adjacent to each of the hierarchical identifiers and determine a directory name and an object name from all the identified names, so as to obtain a plurality of target directories according to the directory names.

[0083] In some specific embodiments, the creating storage module 13 specifically includes:

[0084] a hierarchical division unit, configured to divide the plurality of target directories into hierarchical divisions according to positions of the hierarchical identifiers in the storage directory, and to create the target directory of the highest level first in the fusion storage system according to the hierarchical order after the division;

[0085] A cyclic creation unit is used to determine whether there is a target directory of the next level under the target directory of the highest level after creation. If not, the target directory of the next level is created under the target directory of the highest level after creation, and the creation is stopped until each target directory exists in the fusion storage system to obtain the multi-level directory hierarchy in the fusion storage system.

[0086] In some specific embodiments, the data processing device of the fusion storage system further includes:

[0087] a folder creation module, configured to create an empty folder named with the object name of the target object under the multi-level directory hierarchy in the fusion storage system, so as to store the target object in the object data in the empty folder under the multi-level directory hierarchy in the fusion storage system;

[0088] a concatenation module, configured to concatenate the multi-level target hierarchy constructed in the fusion storage system with the name of the empty folder to obtain a storage directory of the target object in the fusion storage system, so that the client can obtain the target object based on the storage directory of the target object in the fusion storage system;

[0089] a first acquisition module, configured to directly acquire the target object based on a storage directory of the target object in the fusion storage system when the client acquires the target object from the fusion storage system through the first storage protocol;

[0090] The first acquisition module is used to mount the storage directory of the target object in the fusion storage system to the client as an NFS shared directory when the client obtains the target object from the fusion storage system through the second storage protocol, so that the client obtains the target object based on the mounted directory.

[0091] Furthermore, an embodiment of the present application also provides an electronic device. Figure 5 This is a structural diagram of an electronic device 20 according to an exemplary embodiment. The content in the diagram should not be considered as any limitation to the scope of application of the present application.

[0092] Figure 5 This is a schematic diagram of the structure of an electronic device 20 provided in an embodiment of the present application. The electronic device 20 may include: at least one processor 21, at least one memory 22, a power supply 23, a communication interface 24, an input / output interface 25, and a communication bus 26. The memory 22 is used to store a computer program, which is loaded and executed by the processor 21 to implement the relevant steps of the data processing method of the converged storage system disclosed in any of the aforementioned embodiments.

[0093] In this embodiment, the power supply 23 is configured to provide operating voltage for each hardware device on the electronic device 20; the communication interface 24 is configured to create a data transmission channel between the electronic device 20 and external devices, and the communication protocol followed by the communication interface 24 can be any communication protocol applicable to the technical solution of the present application, which is not limited specifically herein; the input and output interface 25 is configured to obtain external input data or output data to the outside, and the specific interface type can be selected according to the specific application needs, which is not limited specifically herein.

[0094] In addition, the memory 22 as a carrier of resource storage can be a read-only memory, a random access memory, a magnetic disk or an optical disk, etc., and the resources stored thereon can include an operating system 221, a computer program 222 and data 223, etc., and the storage mode can be temporary storage or permanent storage.

[0095] The operating system 221 is configured to manage and control each hardware device on the electronic device 20 and the computer program 222, so as to realize the operation and processing of the processor 21 on the mass data 223 in the memory 22, and the operating system 221 can be Windows Server, Netware, Unix, Linux, etc. In addition to the computer program capable of completing the data processing method of the fusion storage system executed by the electronic device 20 disclosed in any one of the preceding embodiments, the computer program 222 can further include a computer program capable of completing other specific work. The data 223 can include the uploaded data collected by the electronic device 20.

[0096] Further, the present application further discloses a storage medium, wherein the storage medium stores a computer program, and the computer program is loaded and executed by a processor to realize the data processing method steps of the fusion storage system disclosed in any one of the preceding embodiments.

[0097] In the specification, each embodiment is described in a progressive manner, and each embodiment focuses on the difference from other embodiments, and the same or similar parts of each embodiment can be referred to each other. For the device disclosed in the embodiments, since it corresponds to the method disclosed in the embodiments, the description is relatively simple, and the related parts can be referred to the method part.

[0098] Finally, it should be noted that, in this document, relational terms such as first and second, etc., are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article, or device. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article, or device comprising the element.

[0099] The above is a detailed introduction to the data processing method, device, equipment and storage medium of the fusion storage system provided by the present invention. Specific examples are used in this article to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core ideas. At the same time, for general technical personnel in this field, according to the ideas of the present invention, there will be changes in the specific implementation methods and application scopes. In summary, the content of this specification should not be understood as limiting the present invention.

Claims

1. A data processing method for a fusion storage system, characterized in that: include: Obtaining object data uploaded to a converged storage system through a first storage protocol; wherein the converged storage system uses a storage method supported by a second storage protocol as a data storage base and the first storage protocol and the second storage protocol are converged and interoperable; the object data includes a target object and a storage directory of the target object; determining whether the storage directory in the object data includes multiple directory hierarchies, and if so, dividing the multiple directory hierarchies to obtain multiple target directories; Constructing the multi-level directory hierarchy in the fusion storage system by respectively creating the target directories in the fusion storage system, and storing the target objects in the object data under the multi-level directory hierarchy in the fusion storage system; After constructing the multi-level directory hierarchy in the fusion storage system by respectively creating the target directories in the fusion storage system, the method further includes: An empty folder named with the object name of the target object is created under the multi-level directory hierarchy in the fusion storage system to store the target object in the object data in the empty folder under the multi-level directory hierarchy in the fusion storage system.

2. The data processing method of the fusion storage system according to claim 1, characterized in that: The determining whether the storage directory in the object data contains multiple directory levels includes: It is determined whether the storage directory in the object data contains multiple hierarchical identifiers. If so, it is determined that the storage directory in the object data contains the multiple directory hierarchies.

3. The data processing method of the fusion storage system according to claim 2, characterized in that: The multi-level directory hierarchy is divided to obtain multiple target directories, including: Identifying a name adjacent to each of the level identifiers; A directory name and an object name are determined from all the recognized names to obtain a plurality of target directories according to the directory name.

4. The data processing method of the fusion storage system according to claim 2, characterized in that: The constructing the multi-level directory hierarchy in the fusion storage system by respectively creating the target directories in the fusion storage system includes: hierarchically dividing the plurality of target directories according to positions of the hierarchical identifiers in the storage directory, and first creating the target directory of the highest level in the fusion storage system according to the hierarchical order after division; Determine whether there is a target directory of the next level under the target directory of the highest level after creation. If not, create the target directory of the next level under the target directory of the highest level after creation. Stop creation until each target directory exists in the fusion storage system to obtain the multi-level directory hierarchy in the fusion storage system.

5. The data processing method of the fusion storage system according to claim 1, characterized in that: Also includes: The multi-level directory hierarchy constructed in the fusion storage system is concatenated with the name of the empty folder to obtain the storage directory of the target object in the fusion storage system, so that the client can obtain the target object based on the storage directory of the target object in the fusion storage system.

6. The data processing method of the fusion storage system according to claim 5, characterized in that: The client obtains the target object based on the storage directory of the target object in the fusion storage system, including: When the client obtains the target object from the fused storage system through the first storage protocol, the target object is directly obtained based on the storage directory of the target object in the fused storage system; When the client obtains the target object from the fusion storage system through the second storage protocol, the storage directory of the target object in the fusion storage system is mounted to the client as an NFS shared directory, so that the client obtains the target object based on the mounted directory.

7. A data processing device for a fusion storage system, characterized in that: include: an object data acquisition module, configured to acquire object data uploaded to a converged storage system via a first storage protocol; wherein the converged storage system uses a storage method supported by a second storage protocol as a data storage base, and the first storage protocol and the second storage protocol are interoperable; and the object data includes a target object and a storage directory of the target object; a determination and segmentation module, configured to determine whether the storage directory in the object data contains multiple directory hierarchies, and if so, segment the multiple directory hierarchies to obtain multiple target directories; Creating a storage module, configured to construct the multi-level directory hierarchy in the fusion storage system by respectively creating the target directories in the fusion storage system, and storing the target objects in the object data under the multi-level directory hierarchy in the fusion storage system; Also includes: A folder creation module is used to create an empty folder named with the object name of the target object under the multi-level directory hierarchy in the fusion storage system, so as to store the target object in the object data in the empty folder under the multi-level directory hierarchy in the fusion storage system.

8. An electronic device, characterized in that: The electronic device includes a processor and a memory; wherein the memory is used to store a computer program, and the computer program is loaded and executed by the processor to implement the data processing method of the fusion storage system according to any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that Used to store computer-executable instructions, which, when loaded and executed by a processor, implement the data processing method of the fusion storage system according to any one of claims 1 to 6.

Citation Information

Patent Citations

  • Data storage method, system and device

    CN111078653A