A data processing method, device, equipment and readable storage medium

By receiving and forwarding access control flows in a distributed storage system, determining the shared memory address, and realizing direct transmission of data flows, solving the problem of low data access efficiency and improving data access performance.

CN114827178BActive Publication Date: 2024-11-05JINAN INSPUR DATA TECH CO LTD
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
CN202210468189.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-04-29
Publication Date
2024-11-05
Estimated Expiration
2042-04-29

AI Technical Summary

Technical Problem

The existing data transmission path is long, resulting in low data access performance and efficiency. It requires client applications, client system interfaces, client network cards, and storage node network cards to reach the node's back-end disk.

Method used

In a distributed storage system, by receiving an access control flow sent by the client that does not carry the accessed data, other nodes stored in the accessed data are determined, and the access control flow is forwarded to other nodes, and the data is completed based on the shared memory address. Reading and writing, realize the separation of control flow and data flow, and directly arrive at the corresponding node from the client for data transmission.

Benefits of technology

It improves data access efficiency and performance, shortens the data transmission path, realizes direct data access between clients and nodes, and improves data access speed.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114827178B_ABST
    Figure CN114827178B_ABST
Patent Text Reader

Abstract

The present application discloses a data processing method, device, equipment and readable storage medium in the field of computer technology. The present application realizes the separation of control flow and data flow, and only needs to forward the transmission access control flow, while the data flow does not need to be forwarded between nodes, but directly reaches the corresponding node from the client. In addition, since each node storing the accessed data can share the memory address of the client, direct data acquisition between the client and the node can be achieved, then each node can directly access the client memory to obtain the data flow, thereby quickly completing the reading and writing of the accessed data, improving data access efficiency and performance. Correspondingly, a data processing device, equipment and readable storage medium provided by the present application also have the above-mentioned technical effects.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a data processing method, device, equipment and readable storage medium. Background Art

[0002] The existing data transmission path is long and needs to pass through the client application, client system interface, client network card, and storage node network card to reach the node's backend disk, which limits access performance and efficiency.

[0003] Therefore, how to improve data access efficiency is a problem that those skilled in the art need to solve. Summary of the invention

[0004] In view of this, the purpose of this application is to provide a data processing method, device, equipment and readable storage medium to improve data access efficiency. The specific scheme is as follows:

[0005] In a first aspect, the present application provides a data processing method, which is applied to any target node in a distributed storage system, comprising:

[0006] receiving an access control flow sent by a client without carrying accessed data; part of the accessed data is stored in the target node;

[0007] Determining other nodes where the accessed data is stored based on the access control flow;

[0008] The access control flow is forwarded to the other nodes, so that the other nodes and the target node determine the shared memory address of the client based on the access control flow, and then complete the reading and writing of the accessed data through the shared memory address.

[0009] Optionally, the other nodes and the target node determine the shared memory address of the client based on the access control flow, including:

[0010] The other nodes and the target node extract the shared memory address from the access control flow.

[0011] Optionally, if the access control flow corresponds to a read operation, the other nodes and the target node write the accessed data into the shared memory address so that the client reads the accessed data.

[0012] Optionally, if the access control flow corresponds to a write operation, the other nodes and the target node read the accessed data from the shared memory address and write the read data to a corresponding NVMe (Non-Volatile Memory express) disk.

[0013] Optionally, any node writes the read data to the corresponding NVMe disk, including:

[0014] Any node parses the access control flow to obtain the disk global statistical identifier corresponding to part of the accessed data at the current node; determines the target NVMe disk based on the disk global statistical identifier, and writes the read data to the target NVMe disk.

[0015] Optionally, after completing the reading and writing of the accessed data, the method further includes:

[0016] The metadata of the accessed data is updated.

[0017] Optionally, it also includes:

[0018] Any node counts the status information of all its NVMe disks and synchronizes the status information to the client.

[0019] In a second aspect, the present application provides a data processing device, applied to any target node in a distributed storage system, comprising:

[0020] A receiving module, configured to receive an access control flow sent by a client and not carrying accessed data; part of the accessed data is stored in the target node;

[0021] A determination module, configured to determine other nodes where the accessed data is stored based on the access control flow;

[0022] A forwarding module is used to forward the access control flow to the other nodes, so that the other nodes and the target node determine the shared memory address of the client based on the access control flow, and then complete the reading and writing of the accessed data through the shared memory address.

[0023] In a third aspect, the present application provides an electronic device, including:

[0024] Memory for storing computer programs;

[0025] The processor is used to execute the computer program to implement the data processing method disclosed above.

[0026] In a fourth aspect, the present application provides a readable storage medium for storing a computer program, wherein the computer program implements the aforementioned disclosed data processing method when executed by a processor.

[0027] It can be seen from the above scheme that the present application provides a data processing method, which is applied to any target node in a distributed storage system, including: receiving an access control flow sent by a client that does not carry accessed data; storing part of the accessed data in the target node; determining other nodes where the accessed data is stored based on the access control flow; forwarding the access control flow to the other nodes, so that after the other nodes and the target node determine the shared memory address of the client based on the access control flow, the reading and writing of the accessed data are completed through the shared memory address.

[0028] It can be seen that in this application, the access control flow does not carry the accessed data, so the transmission efficiency of the access control flow is faster; after the target node receives the access control flow, it can determine other nodes where the accessed data is stored based on the access control flow, and then forward the access control flow to other nodes, so that other nodes and the target node determine the shared memory address of the client based on the access control flow, and then complete the reading and writing of the accessed data through the shared memory address. It can be seen that this application realizes the separation of control flow and data flow, and only needs to forward the transmission access control flow, and the data flow does not need to be forwarded between each node, but directly reaches the corresponding node from the client. In addition, since each node storing the accessed data can share the memory address of the client, it is possible to directly obtain data between the client and the node, so each node can directly access the client memory to obtain the data flow, thereby quickly completing the reading and writing of the accessed data, improving data access efficiency and performance.

[0029] Correspondingly, a data processing device, equipment and readable storage medium provided by the present application also have the above-mentioned technical effects. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying any creative work.

[0031] Figure 1 A flow chart of a data processing method disclosed in this application;

[0032] Figure 2 A schematic diagram of a data stream transmission path disclosed in this application;

[0033] Figure 3 A flow chart of another data processing method disclosed in this application;

[0034] Figure 4A schematic diagram of a data processing device disclosed in this application;

[0035] Figure 5 This is a schematic diagram of an electronic device disclosed in this application. DETAILED DESCRIPTION

[0036] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0037] At present, the existing data transmission path is long and needs to pass through the client application, client system interface, client network card, and storage node network card to reach the back-end disk of the node, which limits the access performance and access efficiency. To this end, this application provides a data processing solution that can realize direct data acquisition between the client and the node and improve data access efficiency.

[0038] See also Figure 1 As shown, the embodiment of the present application discloses a data processing method, which is applied to any target node in a distributed storage system, including:

[0039] S101, receiving an access control flow sent by a client without carrying accessed data; part of the accessed data is stored in a target node.

[0040] In a distributed storage system, based on the characteristics of distributed storage, data is distributed and stored on different nodes, so the accessed data is also distributed and stored on multiple nodes. As for how many data blocks the accessed data is divided into and on which nodes these data blocks are distributed and stored, this depends on the distributed storage algorithm and strategy of the current distributed storage system. For details, please refer to the existing related technologies, and this embodiment will not be repeated. On this basis, the target node receiving the access control flow sent by the client is also determined by the distributed storage algorithm and strategy of the current distributed storage system, and of course it can also be determined randomly.

[0041] In this embodiment, the access control flow does not carry specific accessed data, but only records: the memory address in the client that can be shared by each node, the node information of several nodes where the accessed data is distributed and stored, and the disk global statistics identifier corresponding to each node. The disk global statistics identifier is used to distinguish different NVMe disks in the entire system.

[0042] S102: Determine other nodes where the accessed data is stored based on the access control flow.

[0043] Since the access control flow records the node information of several nodes where the accessed data is distributed and stored, all nodes where the accessed data is stored can be determined based on the access control flow. Among them, other nodes where the accessed data is stored can be: any node in the current distributed storage system except the target node.

[0044] S103, forwarding the access control flow to other nodes, so that the other nodes and the target node determine the shared memory address of the client based on the access control flow, and then complete the reading and writing of the accessed data through the shared memory address.

[0045] Since the access control flow records the memory address in the client that can be shared by each node, each node that receives the access control flow can determine the shared memory address of the client based on the access control flow, thereby directly passing through the client memory to obtain the data flow. Therefore, in a specific implementation, other nodes and the target node determine the shared memory address of the client based on the access control flow, including: other nodes and the target node extract the shared memory address from the access control flow.

[0046] Each node that receives the access control flow directly passes through the client memory, and can implement read and write operations. In a specific implementation, if the access control flow corresponds to a read operation, the other nodes and the target node write the accessed data to the shared memory address so that the client can read the accessed data. Specifically, the other nodes and the target node write the accessed data in the corresponding NVMe disk in themselves to the shared memory address. Since the disk global statistical identifier is recorded in the access control flow, each node that receives the access control flow can determine the disk global statistical identifier corresponding to the accessed data in itself based on the access control flow. Therefore, when the client performs a read operation, each node can read data from the corresponding NVMe disk and send it to the client memory.

[0047] In a specific embodiment, if the access control flow corresponds to a write operation, the other nodes and the target node read the accessed data from the shared memory address and write the read data to the corresponding NVMe disk. Accordingly, since the disk global statistical identifier is recorded in the access control flow, each node that receives the access control flow can determine the disk global statistical identifier corresponding to the accessed data in itself based on the access control flow. Therefore, when the client performs a write operation, each node can read the data that the client wants to store from the shared memory address of the client, and then write it to the corresponding NVMe disk. In a specific embodiment, any node writes the read data to the corresponding NVMe disk, including: any node parses the access control flow to obtain the disk global statistical identifier corresponding to part of the accessed data in the current node; determines the target NVMe disk based on the disk global statistical identifier, and writes the read data to the target NVMe disk.

[0048] It can be seen that this application has achieved the separation of control flow and data flow. It only needs to forward the transmission access control flow, and the data flow does not need to be forwarded between nodes, but directly reaches the corresponding node from the client. In addition, since each node storing the accessed data can share the client's memory address, it is possible to directly obtain data between the client and the node. Then each node can directly access the client's memory to obtain the data flow, thereby quickly completing the reading and writing of the accessed data, improving data access efficiency and performance.

[0049] Based on the above embodiments, it should be noted that after data is read or written, the corresponding metadata needs to be updated. Therefore, in a specific implementation, after completing the reading and writing of the accessed data, it also includes: updating the metadata of the accessed data.

[0050] In a specific implementation, any node counts the status information of all its NVMe disks and synchronizes the status information to the client. Specifically, the status information of the NVMe disk includes: online, offline, hardware address, usage, and global statistical identification, etc. The status information can be synchronously sent to the client in a subscription manner.

[0051] It should be noted that the present application can also implement: rollback and re-storage of distributed IO, so as to ensure data consistency. For example: during a write operation, if the write of an individual node fails, the node that successfully writes is rolled back to restore the data. Another example: if a node in the system fails, the data is redistributed and stored on other nodes that are not faulty.

[0052] The following embodiments adopt a CNC separation architecture, which divides the data request between the client and the server into a control flow and a data flow. The control flow can control the interconnection route between the client and the storage node, and the data flow goes directly from the client to the storage node. Figure 2 ,exist Figure 2 In the process, data flows directly from each client to the storage node.

[0053] The distributed storage system provided in this embodiment can manage the status of the NVMe disks of the entire system, including online, offline, hardware address, usage, and global statistical identification, etc. This information is collected and summarized, and sent to each client synchronously in a subscription manner. Among them, the client is: the user end of the distributed storage system, which can be installed on each host of a high-performance computer group.

[0054] It should be noted that, in addition to storing specific data, the distributed storage system also stores metadata of these data. According to general access logic, before accessing specific data, it is necessary to obtain the corresponding file lock and read the metadata of the data. In this embodiment, the acquisition of the file lock and the reading and writing of the metadata can be performed according to the existing relevant technology.

[0055] See also Figure 3 , the data access process provided in this embodiment includes:

[0056] In the first step, the client synchronizes the status information of each NVMe disk.

[0057] In the second step, the client obtains the distributed file lock and accesses the metadata of the data.

[0058] In the third step, the client sends the control flow to the current node.

[0059] In the fourth step, the current node determines other nodes based on the control flow and transmits the control flow to other nodes.

[0060] In the fifth step, each node that receives the control flow extracts the client memory address from the control flow and completes the client data reading and writing based on the client memory address.

[0061] Step 6: After data reading and writing are completed, each node modifies metadata information such as data size and modification time.

[0062] It can be seen that this embodiment realizes direct data transmission from the client to each node through digital control separation, improves data access efficiency, and shortens the data flow transmission path.

[0063] A data processing device provided in an embodiment of the present application is introduced below. The data processing device described below and the data processing method described above can be referenced to each other.

[0064] See also Figure 4 As shown, the embodiment of the present application discloses a data processing device, which is applied to any target node in a distributed storage system, including:

[0065] The receiving module 401 is used to receive the access control flow sent by the client without the accessed data; part of the accessed data is stored in the target node;

[0066] A determination module 402, configured to determine other nodes where accessed data is stored based on the access control flow;

[0067] The forwarding module 403 is used to forward the access control flow to other nodes, so that other nodes and the target node determine the shared memory address of the client based on the access control flow, and then complete the reading and writing of the accessed data through the shared memory address.

[0068] In one specific implementation, the other nodes and the target node extract the shared memory address from the access control flow.

[0069] In a specific implementation, if the access control flow corresponds to a read operation, the other nodes and the target node write the accessed data into a shared memory address so that the client can read the accessed data.

[0070] In a specific implementation, if the access control flow corresponds to a write operation, the other nodes and the target node read the accessed data from the shared memory address and write the read data to the corresponding NVMe disk.

[0071] In a specific implementation, any node writes the read data into the corresponding NVMe disk, including: any node parses the access control flow to obtain the disk global statistical identifier corresponding to part of the accessed data at the current node; determines the target NVMe disk based on the disk global statistical identifier, and writes the read data into the target NVMe disk.

[0072] In a specific embodiment, it also includes:

[0073] The metadata updating unit is used to update the metadata of the accessed data.

[0074] In a specific implementation, any node counts the status information of all its NVMe disks and synchronizes the status information to the client.

[0075] Among them, for more specific working processes of each module and unit in this embodiment, reference can be made to the corresponding contents disclosed in the aforementioned embodiments, which will not be repeated here.

[0076] It can be seen that this embodiment provides a data processing device that can realize direct data acquisition between a client and a node, thereby improving data access efficiency.

[0077] A distributed storage system provided in an embodiment of the present application is introduced below. The distributed storage system described below and the data processing method and device described above can be referenced to each other.

[0078] The distributed storage system provided in this embodiment includes N storage nodes, each of which is plugged with N NVMe disks. Any storage node can perform the following steps: receiving an access control flow sent by a client without carrying accessed data; storing part of the accessed data in the target node; determining other nodes where the accessed data is stored based on the access control flow; forwarding the access control flow to the other nodes, so that the other nodes and the target node determine the shared memory address of the client based on the access control flow, and then complete the reading and writing of the accessed data through the shared memory address.

[0079] In this embodiment, the other nodes and the target node extract the shared memory address from the access control flow.

[0080] In this embodiment, if the access control flow corresponds to a read operation, the other nodes and the target node write the accessed data into the shared memory address so that the client can read the accessed data.

[0081] In this embodiment, if the access control flow corresponds to a write operation, the other nodes and the target node read the accessed data from the shared memory address and write the read data to the corresponding NVMe disk.

[0082] In this embodiment, any node writes the read data into the corresponding NVMe disk, including: any node parses the access control flow to obtain the disk global statistical identifier corresponding to part of the accessed data at the current node; determines the target NVMe disk based on the disk global statistical identifier, and writes the read data into the target NVMe disk.

[0083] In this embodiment, any node counts the status information of all its NVMe disks and synchronizes the status information to the client.

[0084] An electronic device provided in an embodiment of the present application is introduced below. The electronic device described below and the data processing method and device described above can refer to each other.

[0085] See also Figure 5 As shown, the embodiment of the present application discloses an electronic device, including:

[0086] Memory 501, used for storing computer programs;

[0087] The processor 502 is used to execute the computer program to implement the method disclosed in any of the above embodiments.

[0088] A readable storage medium provided in an embodiment of the present application is introduced below. The readable storage medium described below and the data processing method, device and equipment described above can refer to each other.

[0089] A readable storage medium is used to store a computer program, wherein the computer program, when executed by a processor, implements the data processing method disclosed in the above embodiment. For the specific steps of the method, reference can be made to the corresponding contents disclosed in the above embodiment, and no further description will be given here.

[0090] The "first", "second", "third", "fourth", etc. (if any) referred to in this application are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments described herein can be implemented in an order other than that illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods or devices.

[0091] It should be noted that the descriptions involving "first", "second", etc. in this application are only for descriptive purposes and cannot be understood as indicating or implying their relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In addition, the technical solutions between the various embodiments can be combined with each other, but they must be based on the ability of ordinary technicians in this field to implement them. When the combination of technical solutions is contradictory or cannot be implemented, it should be deemed that such combination of technical solutions does not exist and is not within the scope of protection required by this application.

[0092] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0093] The steps of the method or algorithm described in conjunction with the embodiments disclosed herein may be implemented directly using hardware, a software module executed by a processor, or a combination of the two. The software module may be placed in a random access memory (RAM), a memory, a read-only memory (ROM), an electrically programmable ROM, an electrically erasable programmable ROM, a register, a hard disk, a removable disk, a CD-ROM, or any other form of readable storage medium known in the art.

[0094] Specific examples are used herein to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea. At the same time, for those skilled in the art, according to the idea of ​​the present application, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A data processing method, characterized in that: Applicable to any target node in a distributed storage system, including: Receive an access control flow sent by a client without carrying accessed data; part of the accessed data is stored in the target node; the access control flow does not carry the accessed data, and records: a memory address of the client shared by each node, node information of the node where the accessed data is distributed and stored, and a disk global statistical identifier corresponding to each node; Determining other nodes where the accessed data is stored based on the access control flow; Forwarding the access control flow to the other nodes, so that the other nodes and the target node determine the shared memory address of the client based on the access control flow, and then complete the reading and writing of the accessed data through the shared memory address; If the access control flow corresponds to a read operation, the other nodes and the target node write the accessed data into the shared memory address, so that the client reads the accessed data; If the access control flow corresponds to a write operation, the other nodes and the target node read the accessed data from the shared memory address and write the read data to the corresponding NVMe disk; if the write of an individual node fails, the node where the write is successful is rolled back to recover the data; if a node in the system fails, the data is redistributed and stored on other nodes that are not failed; Any node counts the status information of all its NVMe disks and synchronizes the status information to the client; the status information of the NVMe disk includes: online, offline, hardware address, usage and global statistical identification, and the status information is synchronously sent to the client in a subscription manner.

2. The method according to claim 1, characterized in that: The other nodes and the target node determine the shared memory address of the client based on the access control flow, including: The other nodes and the target node extract the shared memory address from the access control flow.

3. The method according to claim 1, characterized in that: Any node writes the read data to the corresponding NVMe disk, including: Any node parses the access control flow to obtain the disk global statistical identifier corresponding to part of the accessed data at the current node; determines the target NVMe disk based on the disk global statistical identifier, and writes the read data to the target NVMe disk.

4. The method according to any one of claims 1 to 3, characterized in that: After completing the reading and writing of the accessed data, the method further includes: The metadata of the accessed data is updated.

5. A data processing device, characterized in that: Applicable to any target node in a distributed storage system, including: A receiving module is used to receive an access control flow sent by a client without carrying accessed data; part of the accessed data is stored in the target node; the access control flow does not carry the accessed data, and records: a memory address of the client shared by each node, node information of the node where the accessed data is distributed and stored, and a disk global statistical identifier corresponding to each node; A determination module, configured to determine other nodes where the accessed data is stored based on the access control flow; A forwarding module, used for forwarding the access control flow to the other nodes, so that the other nodes and the target node determine the shared memory address of the client based on the access control flow, and then complete the reading and writing of the accessed data through the shared memory address; If the access control flow corresponds to a read operation, the other nodes and the target node write the accessed data into the shared memory address, so that the client reads the accessed data; If the access control flow corresponds to a write operation, the other nodes and the target node read the accessed data from the shared memory address and write the read data to the corresponding NVMe disk; if the write of an individual node fails, the node where the write is successful is rolled back to recover the data; if a node in the system fails, the data is redistributed and stored on other nodes that are not failed; Any node counts the status information of all its NVMe disks and synchronizes the status information to the client; the status information of the NVMe disk includes: online, offline, hardware address, usage and global statistical identification, and the status information is synchronously sent to the client in a subscription manner.

6. An electronic device, characterized in that: include: Memory for storing computer programs; A processor, configured to execute the computer program to implement the method according to any one of claims 1 to 4.

7. A readable storage medium, characterized in that: Used to store a computer program, wherein the computer program implements the method according to any one of claims 1 to 4 when executed by a processor.

Citation Information

Patent Citations

  • Data storage method and device for cloud storage

    CN105354250A

  • Device state detection method and electronic device

    CN107678919A

  • Memory system access method and device

    CN110235098A

  • Data synchronization method, access method and system of distributed storage system

    CN112468601A

  • Management method of storage equipment in storage system and storage system

    CN112615917A