Network traffic control method, device and equipment based on distributed storage system
By prioritizing data transmission based on service type within distributed storage systems, the method enhances bandwidth allocation accuracy by configuring layer-specific priority parameters, addressing the limitations of IP-based prioritization.
Patent Information
- Application Number
- CN202311697074.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-12-11
- Publication Date
- 2024-12-13
- Estimated Expiration
- 2043-12-11
AI Technical Summary
Existing distributed storage systems face inaccuracies in controlling network bandwidth during peak business times due to prioritization based on client IP, failing to account for varying data urgency across different services.
Implement a method to determine the priority of data based on its service type, configuring a first priority parameter at the transmission layer and converting it to a second priority parameter at the network layer to allocate bandwidth accurately.
This approach enables fine-grained traffic priority control, improving the accuracy of bandwidth management by ensuring high-priority data receives adequate network resources during peak usage.
Smart Images

Figure CN117544577B_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present disclosure relate to the field of distributed storage technology, and more particularly to a network traffic control method, apparatus, and device based on a distributed storage system. Background Art
[0002] A distributed storage system includes multiple data servers. In order to improve the disaster recovery capability of the distributed storage system, data is often required to be stored in multiple data servers in the form of multiple copies. This involves data transmission between data servers. However, during business peaks, the network bandwidth resources between data servers are often tight, which requires reasonable restrictions on the network bandwidth for data transmission.
[0003] In the related art, during the peak of business, the IP (Internet Protocol Address) of a certain client can be obtained first. Then, the priority corresponding to the IP of the client is obtained. If the priority corresponding to the IP of the client is higher, the network bandwidth between the data servers is increased, and the data corresponding to the IP of the client is stored preferentially.
[0004] However, the inventors have discovered that the prior art has at least the following technical problems: not all data from the same client requires expedited processing; therefore, the accuracy of controlling the traffic bandwidth through the priority corresponding to the client's IP is low. Summary of the invention
[0005] The embodiments of the present disclosure provide a network traffic control method, device and equipment based on a distributed storage system, which can improve the accuracy of controlling traffic bandwidth.
[0006] In a first aspect, an embodiment of the present disclosure provides a network traffic control method based on a distributed storage system, which is applied to a distributed storage system, wherein the distributed storage system includes a plurality of data servers; the method includes:
[0007] In response to a first data server in the distributed storage system receiving a transmission request for target data, acquiring a transmission link for transmitting the target data, wherein the transmission request carries priority information of a service type to which the target data belongs;
[0008] configuring, by the first data server, a first priority parameter for the transmission link according to priority information of the service type to which the target data belongs, wherein the first priority parameter indicates the priority of the transmission link at the transmission layer;
[0009] In response to transmitting the target data through the transmission link, the first data server configures a second priority parameter for the target data according to the first priority parameter of the transmission link, so that the data transmission device allocates network bandwidth to the target data according to the second priority parameter, wherein the second priority parameter represents the priority of the target data at the network layer, and the data transmission device is located on the transmission link and is used to forward the target data transmitted by the transmission link.
[0010] In a second aspect, an embodiment of the present disclosure provides a network traffic control device based on a distributed storage system, which is applied to a distributed storage system, wherein the distributed storage system includes a plurality of data servers; the device includes:
[0011] an acquisition module, configured to acquire a transmission link for transmitting the target data in response to a first data server in the distributed storage system receiving a transmission request for the target data, wherein the transmission request carries priority information of a service type to which the target data belongs;
[0012] a configuration module, configured to configure a first priority parameter for the transmission link according to priority information of a service type to which the target data belongs, through the first data server, wherein the first priority parameter indicates a priority of the transmission link at a transmission layer;
[0013] A transmission module, configured to, in response to transmitting the target data through the transmission link, configure a second priority parameter for the target data through the first data server according to the first priority parameter of the transmission link, so that the data transmission device allocates network bandwidth to the target data according to the second priority parameter, wherein the second priority parameter represents the priority of the target data at the network layer, and the data transmission device is located on the transmission link and is used to forward the target data transmitted by the transmission link.
[0014] In a third aspect, an embodiment of the present disclosure provides an electronic device, including:
[0015] A processor, and a memory communicatively connected to the processor;
[0016] The memory stores computer-executable instructions;
[0017] The processor executes the computer-executable instructions stored in the memory to implement the network traffic control method based on the distributed storage system as described in the first aspect above.
[0018] In a fourth aspect, an embodiment of the present disclosure provides a computer-readable storage medium, in which computer execution instructions are stored. When a processor executes the computer execution instructions, the network traffic control method based on the distributed storage system as described in the first aspect above is implemented.
[0019] In a fifth aspect, an embodiment of the present disclosure provides a computer program product, including a computer program, which, when executed by a processor, implements the network traffic control method based on a distributed storage system as described in the first aspect above.
[0020] The network traffic control method, device and equipment based on the distributed storage system provided in the present embodiment include: in response to a first data server in the distributed storage system receiving a transmission request for target data, obtaining a transmission link for transmitting the target data, wherein the transmission request carries the priority information of the service type to which the target data belongs; configuring a first priority parameter for the transmission link according to the priority information of the service type to which the target data belongs through the first data server, wherein the first priority parameter indicates the priority of the transmission link at the transmission layer; in response to transmitting the target data through the transmission link, configuring a second priority parameter for the target data according to the first priority parameter of the transmission link through the first data server, so that the data transmission device allocates network bandwidth to the target data according to the second priority parameter, wherein the second priority parameter indicates the priority of the target data at the network layer, wherein the data transmission device is located on the transmission link and is used to forward the target data transmitted by the transmission link. In the embodiment of the present application, since the first priority parameter can be configured for different traffic according to the priority of its own service, when transmitting data, the first priority parameter is converted into the second priority parameter of the network layer, so that the switch can allocate the corresponding network bandwidth to the target data according to the second priority parameter of the network layer, thereby realizing the control of the priority of data transmission according to the service type, realizing more fine-grained traffic priority control, and thus improving the accuracy of controlling traffic bandwidth. BRIEF DESCRIPTION OF THE DRAWINGS
[0021] In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.
[0022] Figure 1 A schematic diagram of an application scenario of a network traffic control method based on a distributed storage system provided in an embodiment of the present disclosure;
[0023] Figure 2A flow chart of a network traffic control method based on a distributed storage system provided in an embodiment of the present disclosure;
[0024] Figure 3 A schematic diagram of data writing provided by an embodiment of the present disclosure;
[0025] Figure 4 A schematic diagram of data reading provided by an embodiment of the present disclosure;
[0026] Figure 5 A structural block diagram of a network traffic control device based on a distributed storage system provided in an embodiment of the present disclosure;
[0027] Figure 6 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION
[0028] In order to make the purpose, technical solution and advantages of the embodiments of the present disclosure clearer, the technical solution in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are part of the embodiments of the present disclosure, not all of the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present disclosure.
[0029] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards, and provide corresponding operation entrances for users to choose to authorize or refuse.
[0030] A distributed storage system includes multiple data servers. In order to improve the disaster recovery capability of the distributed storage system, data is often required to be stored in multiple data servers in the form of multiple copies. This involves data transmission between data servers. However, during business peaks, the network bandwidth resources between data servers are often tight, which requires reasonable restrictions on the network bandwidth for data transmission.
[0031] In the related art, during the peak of business, the IP (Internet Protocol Address) of a certain client can be obtained first. Then, the priority corresponding to the IP of the client is obtained. If the priority corresponding to the IP of the client is higher, the network bandwidth between the data servers is increased, and the data corresponding to the IP of the client is stored preferentially.
[0032] However, not all data of the same client need to be processed urgently. Therefore, the accuracy of controlling the network bandwidth between data servers by the priority corresponding to the client IP is low.
[0033] It can be seen that how to improve the accuracy of controlling the network bandwidth between data servers is a problem that needs to be solved urgently.
[0034] In order to solve the above problems, this embodiment provides the following technical concept: first determine the priority of the business type corresponding to the data, and control the transmission speed of the data according to the priority of the business type, thereby realizing the limitation of the data transmission speed based on the business type, and improving the accuracy of controlling the traffic bandwidth.
[0035] The specific steps may include: first, in response to a first data server in a distributed storage system receiving a transmission request for target data, obtaining a transmission link for transmitting the target data, wherein the transmission request carries priority information of a service type to which the target data belongs; then, configuring a first priority parameter for the transmission link according to the priority information of the service type to which the target data belongs, by the first data server, wherein the first priority parameter indicates the priority of the transmission link at the transmission layer; finally, in response to transmitting the target data through the transmission link, configuring a second priority parameter for the target data according to the first priority parameter of the transmission link, by the first data server, so that the data transmission device allocates network bandwidth to the target data according to the second priority parameter, wherein the second priority parameter indicates the priority of the target data at the network layer.
[0036] Here, since the first priority parameter can be configured for different traffic according to the priority of its own business, when transmitting data, the first priority parameter is converted into the second priority parameter of the network layer. In this way, the switch can allocate the corresponding network bandwidth to the target data according to the second priority parameter of the network layer, thereby realizing the control of the priority of data transmission according to the business type, realizing more fine-grained traffic priority control, and thus improving the accuracy of controlling traffic bandwidth.
[0037] The application scenarios of the embodiments of the present disclosure are explained below:
[0038] The network traffic control method based on a distributed storage system provided by the embodiments of the present disclosure can be applied to data transmission scenarios of the distributed storage system. Figure 1 The following is a schematic diagram of an application scenario of a network traffic control method based on a distributed storage system provided by an embodiment of the present disclosure. Figure 1 As shown, the distributed storage system includes multiple data servers. The multiple data servers can be deployed in multiple computer rooms. For example, Figure 1 As shown, multiple data servers are deployed in computer room A, and multiple data servers are deployed in computer room B. When the first data server in computer room A needs to write data to the second data server in computer room B, the network flow control method based on the distributed storage system provided by the disclosed embodiment can be used to control the transmission speed of the data (that is, the speed of writing data). When the first data server in computer room A needs to read data from the second data server in computer room B, the network flow control method based on the distributed storage system provided by the disclosed embodiment can be used to control the transmission speed of the data (that is, the speed of reading data). The network flow control method based on the distributed storage system provided by the disclosed embodiment is described in detail below using a detailed embodiment.
[0039] Figure 2 The present invention provides a flow chart of a network traffic control method based on a distributed storage system. The network traffic control method is applied to a distributed storage system, which includes multiple data servers. Figure 2 As shown, the method includes:
[0040] S201. In response to a first data server in a distributed storage system receiving a transmission request for target data, obtaining a transmission link for transmitting the target data, wherein the transmission request carries priority information of a service type to which the target data belongs.
[0041] In the embodiment of the present disclosure, target data belongs to different service types and has different priorities, and thus the transmission speed of data of different service types can be controlled according to the priorities.
[0042] In some embodiments, Figure 3 As shown, the distributed storage system also includes a client and a metadata server, wherein the client is used to send a transmission request for target data to the first data server; the metadata server stores the correspondence between the storage directory of the business type and the priority information.
[0043] Correspondingly, obtaining the priority information of the business type to which the target data belongs includes: obtaining the priority information of the business type to which the target data belongs from a transmission request for the target data sent from the client via the first data server; the transmission request carries the priority information of the business type to which the target data belongs; wherein the priority information of the business type to which the target data belongs is obtained by the client from the correspondence between the storage directory of the business type stored on the metadata server and the priority information according to the storage directory corresponding to the business type to which the target data belongs.
[0044] Optionally, one business type of data corresponds to one file target. One business type of data may be data corresponding to an application, or data corresponding to a certain type of service in the application (e.g., a chat service). The metadata server may store a mapping relationship between file targets and priorities. Exemplarily, the priority may be represented by an integer between 0 and 10; wherein, the smaller the value of the priority, the higher the corresponding priority.
[0045] Optionally, the mapping relationship may be stored in a configuration table of the metadata server and loaded into the memory when the metadata server is started. The mapping relationship may be stored in a hash table.
[0046] For example, Figure 3 and Figure 4 As shown, the client can obtain the priority information of the business type to which the target data belongs from the metadata server, and when the client sends a transmission request for the target data to the first data server, the transmission request carries the priority information of the business type to which the target data belongs. It should be noted that in the distributed storage system, the client can be a client located in the computer room or a mobile client. Among them, the client can send a transmission request to the first data server.
[0047] In the embodiment of the present disclosure, the transmission request of the target data may be a request to write the target data or a request to read the target data.
[0048] In some embodiments, the transmission request includes a write request, which carries address information of a second data server to which target data is to be written; accordingly, obtaining a transmission link for transmitting the target data includes: obtaining, through the first data server, the address information of the second data server to which the target data is to be written from the write request; creating, through the first data server, a transmission link between the first data server and the second data server according to the address information of the second data server; wherein the transmission link is used by the first data server to write the target data to the second data server.
[0049] For example, Figure 3 As shown, the transmission request may be a write request sent by the client to the first data server. The write request carries the address information of the second data server to which the target data is to be written. The first data server may obtain the address information of the second data server from the write request.
[0050] Optionally, the metadata server may also store a correspondence between identification information of the data server and address information of the data server. Accordingly, obtaining the address information of the second data server to which the target data is to be written through the client includes: determining the identification information of the second data server to which the target data is to be written through the client, and obtaining the address information of the second data server from the address information corresponding to each of the multiple data servers stored in the metadata server according to the identification information.
[0051] In other embodiments, Figure 4 As shown, the distributed storage system also includes a client and a metadata server, wherein the client is used to send a read request for target data to the first data server; the metadata server stores the correspondence between the identification information of the data server and the address information of the data server. When the client sends a read request to the first data server, it is necessary to create a transmission link between the first data server and the client, and read the target data on the first data server through the transmission link.
[0052] Optionally, a transmission link between the first data server and the client may be created through the client, and the corresponding specific steps are: the client determines the identification information of the first data server storing the target data, and obtains the address information of the first data server from the correspondence between the identification information of the data server stored in the metadata server and the address information of the data server according to the identification information. The client creates a transmission link between the first data server and the client according to the address information of the first data server.
[0053] It should be noted that if Figure 4 As shown, the client can also obtain the priority information of the business type to which the target data belongs from the metadata server. The client sends a read request for the target data to the first data server, and the read request can also carry the priority information of the business type to which the target data belongs.
[0054] S202. Configure a first priority parameter for the transmission link according to priority information of the service type to which the target data belongs, through the first data server, wherein the first priority parameter is used to indicate the priority of the transmission link at the transmission layer.
[0055] Optionally, the first priority parameter is an integer of a preset type. Exemplarily, the first priority parameter is a so_mark parameter, and the so_mark parameter is an integer of uint32_t type.
[0056] The network permissions required to configure the first priority parameter are relatively high. An independent priority configuration process may be configured in the first data server. Figure 3As shown, a priority configuration process and a data transmission process are installed on the first data server; accordingly, this step includes: executing the data transmission process through the first data server, transmitting the priority information of the business type to which the target data belongs and the transmission link to the priority configuration process, and configuring the first priority parameter for the transmission link according to the priority information of the business type to which the target data belongs by executing the priority configuration process; wherein the network authority of the priority configuration process is higher than the network authority of the data transmission process. Exemplarily, the priority configuration process is an agent process.
[0057] The priority configuration process can configure the first priority parameter for the transmission link by calling a preset priority configuration function. Accordingly, by executing the priority configuration process, the first priority parameter is configured for the transmission link according to the priority information of the service type to which the target data belongs, including: calling the preset priority configuration function by executing the priority configuration process; configuring the first priority parameter for the transmission link according to the priority information of the service type to which the target data belongs through the preset priority configuration function; wherein the preset priority configuration function is the setsockopt function, and the first priority parameter is the so_mark parameter.
[0058] In the embodiment of the present disclosure, since the network permissions required to configure the so_mark parameter are relatively high, here, the so_mark parameter is configured for the transmission link through an independent priority configuration process (such as an agent process), and a higher permission mode (such as root mode) is configured for the agent process, while the first data server runs in a lower permission mode, which can reduce the probability of the first data server being attacked by the network.
[0059] S203. In response to transmitting the target data through the transmission link, the first data server configures a second priority parameter for the target data according to the first priority parameter of the transmission link, so that the data transmission device allocates network bandwidth to the target data according to the second priority parameter, wherein the second priority parameter is used to indicate the priority of the target data at the network layer, and the data transmission device is located on the transmission link and is used to forward the target data transmitted by the transmission link.
[0060] In the embodiment of the present disclosure, in response to the transmission link successfully configuring the first priority parameter, the target data is transmitted through the transmission link. Exemplarily, the first data server receives a response signal indicating that the transmission link successfully configures the first priority parameter, and transmits the target data through the transmission link.
[0061] The second priority parameter may be a priority of any network layer. Optionally, the second priority parameter is a DSCP (Differentiated Services Code Point) parameter.
[0062] In some embodiments, a second priority parameter can be configured for the target data through a preset configuration rule. Accordingly, this step is: obtaining a preset configuration rule through a first data server, wherein the preset configuration rule is used to convert the first priority parameter into a second priority parameter; converting the first priority parameter of the transmission link into the second priority parameter according to the preset configuration rule through the first data server; and configuring the second priority parameter for the target data through the first data server.
[0063] For example, Figure 3 As shown, the configuration center stores preset configuration rules, and the first data server can obtain the preset configuration rules from the configuration center through an agent process.
[0064] Optionally, the preset configuration rule may be an iptables rule, through which the so_mark value (i.e., the first priority parameter) may be converted into a DSCP value (i.e., the second priority parameter). Exemplarily, the target data is a TCP data packet. When a TCP data packet is transmitted through a transmission link, the iptables rule is used to fill in the corresponding DSCP value of the TCP data packet according to the so_mark value.
[0065] In some embodiments, the data transmission device may allocate corresponding network bandwidth to the target data according to the DSCP parameter. The data transmission device stores the correspondence between the priority parameter and the network bandwidth; accordingly, the data transmission device allocates the network bandwidth to the target data according to the second priority parameter, including: the data transmission device obtains the target network bandwidth corresponding to the second priority parameter from the stored correspondence between the priority parameter and the network bandwidth according to the second priority parameter; the data transmission device allocates the target network bandwidth to the target data.
[0066] It should be noted that if Figure 3 As shown, multiple data servers are located in multiple computer rooms, and at least one data server is deployed in each computer room; the distributed storage system also includes a data transmission device, wherein a data server in one computer room transmits data with a data server in another computer room through the data transmission device. Figure 4As shown, the data server in the computer room can also transmit data to the client through the data transmission device. It should be noted that during the process of writing data to a data server in one computer room, a copy of the data can be stored in a data server in another computer room, so that data transmission between computer rooms exists. During the reading process of a data server in a computer room, if data loss occurs, data transmission for reading across computer rooms may also occur.
[0067] Compared with the network bandwidth within the computer room, the network bandwidth across computer rooms is often tight. During business peaks, the network bandwidth often cannot meet the needs of all businesses. This requires us to distinguish the priority of business traffic, limit the speed of low-priority business data during peak hours, and ensure the network bandwidth of high-priority business data.
[0068] Among them, the data transmission device is located on the transmission link and is used to forward the target data transmitted by the transmission link. For example, in a data writing scenario, the transmission link is used by the first data server to write the target data to the second data server. The data transmission device is located on the transmission link, receives the target data sent by the first data server, and sends the target data to the second data server, thereby realizing the forwarding of the target data transmitted by the transmission link. For another example, in a data reading scenario, the transmission link is used by the client to read the target data from the first data server. The data transmission device is located on the transmission link, receives the target data sent by the first data server, and sends the target data to the client, thereby realizing the forwarding of the target data transmitted by the transmission link.
[0069] Optionally, the data transmission device may be a switch or a network switch. The data transmission device (e.g., a switch) may limit the speed of different data according to the priority parameter of the data. It should be noted that the higher the priority of the second priority parameter, the larger the allocated target network bandwidth and the faster the data transmission speed. It can be seen that the data transmission device may allocate network bandwidth to different service data according to the DSCP value of the service data, i.e., the priority situation, and high-priority services may obtain a larger network bandwidth.
[0070] For example, Figure 3 As shown, after allocating the target network bandwidth to the target data, the first data server can write the target data to the second data server through the transmission link according to the target network bandwidth. Figure 4 As shown, after allocating the target network bandwidth to the target data, the first data server can transmit the target data to the client through the transmission link according to the target network bandwidth.
[0071] The network traffic control method based on the distributed storage system provided in this embodiment is as follows: in response to a first data server in the distributed storage system receiving a transmission request for target data, a transmission link for transmitting the target data is obtained, wherein the transmission request carries the priority information of the service type to which the target data belongs; the first data server configures a first priority parameter for the transmission link according to the priority information of the service type to which the target data belongs, wherein the first priority parameter indicates the priority of the transmission link at the transmission layer; in response to transmitting the target data through the transmission link, the first data server configures a second priority parameter for the target data according to the first priority parameter of the transmission link, so that the data transmission device allocates network bandwidth to the target data according to the second priority parameter, wherein the second priority parameter indicates the priority of the target data at the network layer, wherein the data transmission device is located on the transmission link and is used to forward the target data transmitted by the transmission link. In the embodiment of the present application, since the first priority parameter can be configured for different traffic according to the priority of its own service, when transmitting data, the first priority parameter is converted into the second priority parameter of the network layer, so that the switch can allocate the corresponding network bandwidth to the target data according to the second priority parameter of the network layer, thereby realizing the control of the priority of data transmission according to the service type, realizing more fine-grained traffic priority control, and thus improving the accuracy of controlling traffic bandwidth.
[0072] Figure 5 This is a structural block diagram of a network traffic control device based on a distributed storage system provided by an embodiment of the present disclosure. Applied to a distributed storage system, the distributed storage system includes multiple data servers; see Figure 5 The device includes: an acquisition module 501, a configuration module 502 and a transmission module 503.
[0073] The acquisition module 501 is used to obtain a transmission link for transmitting the target data in response to a first data server in the distributed storage system receiving a transmission request for the target data, wherein the transmission request carries priority information of a service type to which the target data belongs;
[0074] A configuration module 502, configured to configure a first priority parameter for the transmission link according to priority information of a service type to which the target data belongs, through the first data server, wherein the first priority parameter indicates a priority of the transmission link at a transmission layer;
[0075] The transmission module 503 is used to configure a second priority parameter for the target data according to the first priority parameter of the transmission link through the first data server in response to transmitting the target data through the transmission link, so that the data transmission device allocates network bandwidth to the target data according to the second priority parameter, wherein the second priority parameter represents the priority of the target data at the network layer, and the data transmission device is located on the transmission link and is used to forward the target data transmitted by the transmission link.
[0076] According to one or more embodiments of the present disclosure, the distributed storage system also includes a client and a metadata server, wherein the client is used to send a transmission request for the target data to the first data server; the metadata server stores the correspondence between the storage directory of the business type and the priority information; accordingly, the acquisition module 501 is also used to obtain the priority information of the business type to which the target data belongs from the transmission request for the target data sent by the client from the first data server; the transmission request carries the priority information of the business type to which the target data belongs; wherein the priority information of the business type to which the target data belongs is obtained by the client from the correspondence between the storage directory of the business type stored in the metadata server and the priority information according to the storage directory corresponding to the business type to which the target data belongs.
[0077] According to one or more embodiments of the present disclosure, a priority configuration process and a data transmission process are installed on the first data server; accordingly, the configuration module 502 configures a first priority parameter for the transmission link through the first data server according to the priority information of the business type to which the target data belongs, including: executing the data transmission process through the first data server, transmitting the priority information of the business type to which the target data belongs and the transmission link to the priority configuration process, and configuring the first priority parameter for the transmission link according to the priority information of the business type to which the target data belongs by executing the priority configuration process; wherein the network authority of the priority configuration process is higher than the network authority of the data transmission process.
[0078] According to one or more embodiments of the present disclosure, the configuration module 502 configures a first priority parameter for the transmission link according to the priority information of the business type to which the target data belongs by executing the priority configuration process, including: calling a preset priority configuration function by executing the priority configuration process; configuring the first priority parameter for the transmission link according to the priority information of the business type to which the target data belongs through the preset priority configuration function; wherein the preset priority configuration function is a setsockopt function, and the first priority parameter is a so_mark parameter.
[0079] According to one or more embodiments of the present disclosure, the configuration module 502 configures the second priority parameter for the target data according to the first priority parameter of the transmission link through the first data server, including: obtaining a preset configuration rule through the first data server, wherein the preset configuration rule is used to convert the first priority parameter into the second priority parameter; converting the first priority parameter of the transmission link into the second priority parameter according to the preset configuration rule through the first data server; and configuring the second priority parameter for the target data through the first data server.
[0080] According to one or more embodiments of the present disclosure, the transmission request includes a write request, and the write request carries the address information of the second data server to which the target data is to be written; accordingly, the acquisition module 501 acquires the transmission link for transmitting the target data, including: acquiring, through the first data server, the address information of the second data server to which the target data is to be written from the write request; creating, through the first data server, a first transmission link between the first data server and the second data server according to the address information of the second data server; wherein the first transmission link is used by the first data server to transmit the target data to the second data server.
[0081] According to one or more embodiments of the present disclosure, the distributed storage system also includes a client and a metadata server, wherein the client is used to send a read request for the target data to the first data server; the metadata server stores a correspondence between identification information of the data server and address information of the data server; accordingly, the acquisition module 501 acquires a transmission link for transmitting the target data, including: determining, through the client, the identification information of the first data server storing the target data; acquiring, according to the identification information of the first data server, the address information of the first data server from the correspondence between the identification information of the data server stored in the metadata server and the address information of the data server; creating, through the client, a second transmission link between the first data server and the client according to the address information of the first data server, wherein the second transmission link is used for the first data server to transmit the target data to the client.
[0082] According to one or more embodiments of the present disclosure, the multiple data servers are located in multiple computer rooms, and at least one data server is deployed in each computer room; the distributed storage system also includes a data transmission device, wherein the data server in one computer room transmits data with the data server in another computer room through the data transmission device.
[0083] According to one or more embodiments of the present disclosure, the data transmission device stores a correspondence between a priority parameter and a network bandwidth; accordingly, the transmission module 503 allocates network bandwidth to the target data according to the second priority parameter through the data transmission device, including: the data transmission device obtains, according to the second priority parameter, the target network bandwidth corresponding to the second priority parameter from the stored correspondence between the priority parameter and the network bandwidth; the data transmission device allocates the target network bandwidth to the target data.
[0084] The acquisition module 501, configuration module 502 and transmission module 503 are connected in sequence. The network traffic control device based on the distributed storage system provided in this embodiment can implement the technical solution of the above method embodiment, and its implementation principle and technical effect are similar, which will not be repeated in this embodiment.
[0085] Figure 6 A schematic diagram of the hardware structure of an electronic device provided by an embodiment of the present disclosure. Figure 6The electronic device 600 may be a terminal device or a server. The terminal device may include but is not limited to mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, personal digital assistants (PDAs), tablet computers (Portable Android Devices, PADs), portable multimedia players (PMPs), vehicle terminals (such as vehicle navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 6 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.
[0086] like Figure 6 As shown, the electronic device 600 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 601, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 602 or a program loaded from a storage device 608 to a random access memory (RAM) 603. Various programs and data required for the operation of the electronic device 600 are also stored in the RAM 603. The processing device 601, the ROM 602, and the RAM 603 are connected to each other via a bus 604. An input / output (I / O) interface 605 is also connected to the bus 604.
[0087] Typically, the following devices may be connected to the I / O interface 605: input devices 606 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; output devices 607 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; storage devices 608 including, for example, a magnetic tape, a hard disk, etc.; and communication devices 609. The communication device 609 may allow the electronic device 600 to communicate with other devices wirelessly or by wire to exchange data. Although Figure 6 The electronic device 600 is shown with various devices, but it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead.
[0088] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device 609, or installed from a storage device 608, or installed from a ROM 602. When the computer program is executed by the processing device 601, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.
[0089] It should be noted that the computer-readable medium disclosed above may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, device or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.
[0090] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.
[0091] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device executes the method shown in the above embodiment.
[0092] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages or a combination thereof, including object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as an independent software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).
[0093] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.
[0094] The units involved in the embodiments described in the present disclosure may be implemented by software or hardware. The name of a unit does not limit the unit itself in some cases. For example, the first acquisition unit may also be described as a "unit for acquiring at least two Internet Protocol addresses".
[0095] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.
[0096] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
[0097] In a first aspect, according to one or more embodiments of the present disclosure, a network traffic control method based on a distributed storage system is provided, which is applied to the distributed storage system, wherein the distributed storage system includes a plurality of data servers; the method includes:
[0098] In response to a first data server in the distributed storage system receiving a transmission request for target data, acquiring a transmission link for transmitting the target data, wherein the transmission request carries priority information of a service type to which the target data belongs;
[0099] configuring, by the first data server, a first priority parameter for the transmission link according to priority information of the service type to which the target data belongs, wherein the first priority parameter is used to indicate the priority of the transmission link at the transmission layer;
[0100] In response to transmitting the target data through the transmission link, the first data server configures a second priority parameter for the target data according to the first priority parameter of the transmission link, so that the data transmission device allocates network bandwidth to the target data according to the second priority parameter, wherein the second priority parameter is used to indicate the priority of the target data at the network layer, and the data transmission device is located on the transmission link and is used to forward the target data transmitted by the transmission link.
[0101] According to one or more embodiments of the present disclosure, the distributed storage system also includes a client and a metadata server, wherein the client is used to send a transmission request for the target data to the first data server; the metadata server stores the correspondence between the storage directory of the business type and the priority information; accordingly, before configuring the first priority parameter for the transmission link according to the priority information of the business type to which the target data belongs through the first data server, it also includes: obtaining the priority information of the business type to which the target data belongs from the transmission request for the target data sent from the client through the first data server; the transmission request carries the priority information of the business type to which the target data belongs; wherein the priority information of the business type to which the target data belongs is obtained by the client from the correspondence between the storage directory of the business type stored in the metadata server and the priority information according to the storage directory corresponding to the business type to which the target data belongs.
[0102] According to one or more embodiments of the present disclosure, a priority configuration process and a data transmission process are installed on the first data server; accordingly, configuring a first priority parameter for the transmission link according to the priority information of the business type to which the target data belongs through the first data server comprises: executing the data transmission process through the first data server, transmitting the priority information of the business type to which the target data belongs and the transmission link to the priority configuration process, and configuring the first priority parameter for the transmission link according to the priority information of the business type to which the target data belongs by executing the priority configuration process; wherein the network authority of the priority configuration process is higher than the network authority of the data transmission process.
[0103] According to one or more embodiments of the present disclosure, configuring a first priority parameter for the transmission link according to the priority information of the business type to which the target data belongs by executing the priority configuration process includes: calling a preset priority configuration function by executing the priority configuration process; configuring the first priority parameter for the transmission link according to the priority information of the business type to which the target data belongs through the preset priority configuration function; wherein the preset priority configuration function is a setsockopt function, and the first priority parameter is a so_mark parameter.
[0104] According to one or more embodiments of the present disclosure, configuring the second priority parameter for the target data according to the first priority parameter of the transmission link through the first data server includes: obtaining a preset configuration rule through the first data server, wherein the preset configuration rule is used to convert the first priority parameter into a second priority parameter; converting the first priority parameter of the transmission link into the second priority parameter according to the preset configuration rule through the first data server; and configuring the second priority parameter for the target data through the first data server.
[0105] According to one or more embodiments of the present disclosure, the transmission request includes a write request, and the write request carries address information of a second data server to which target data is to be written; accordingly, obtaining a transmission link for transmitting the target data includes: obtaining, through the first data server, the address information of the second data server to which the target data is to be written from the write request; creating, through the first data server, a first transmission link between the first data server and the second data server according to the address information of the second data server; wherein the first transmission link is used by the first data server to transmit the target data to the second data server.
[0106] According to one or more embodiments of the present disclosure, the distributed storage system also includes a client and a metadata server, wherein the client is used to send a read request for the target data to the first data server; the metadata server stores the correspondence between the identification information of the data server and the address information of the data server; accordingly, obtaining the transmission link for transmitting the target data includes: determining the identification information of the first data server storing the target data through the client; obtaining the address information of the first data server from the correspondence between the identification information of the data server stored in the metadata server and the address information of the data server according to the identification information of the first data server; creating a second transmission link between the first data server and the client through the client according to the address information of the first data server, wherein the second transmission link is used for the first data server to transmit the target data to the client.
[0107] According to one or more embodiments of the present disclosure, the multiple data servers are located in multiple computer rooms, and at least one data server is deployed in each computer room; the distributed storage system also includes a data transmission device, wherein the data server in one computer room transmits data with the data server in another computer room through the data transmission device.
[0108] According to one or more embodiments of the present disclosure, the data transmission device stores a correspondence between a priority parameter and a network bandwidth; accordingly, the data transmission device allocates network bandwidth to the target data according to the second priority parameter, including: the data transmission device obtains, according to the second priority parameter, the target network bandwidth corresponding to the second priority parameter from the stored correspondence between the priority parameter and the network bandwidth; the data transmission device allocates the target network bandwidth to the target data.
[0109] In a second aspect, according to one or more embodiments of the present disclosure, a network traffic control device based on a distributed storage system is provided, which is applied to a distributed storage system, wherein the distributed storage system includes a plurality of data servers; the device includes:
[0110] an acquisition module, configured to acquire a transmission link for transmitting the target data in response to a first data server in the distributed storage system receiving a transmission request for the target data, wherein the transmission request carries priority information of a service type to which the target data belongs;
[0111] a configuration module, configured to configure a first priority parameter for the transmission link according to priority information of a service type to which the target data belongs, through the first data server, wherein the first priority parameter indicates a priority of the transmission link at a transmission layer;
[0112] A transmission module, configured to, in response to transmitting the target data through the transmission link, configure a second priority parameter for the target data through the first data server according to the first priority parameter of the transmission link, so that the data transmission device allocates network bandwidth to the target data according to the second priority parameter, wherein the second priority parameter represents the priority of the target data at the network layer, and the data transmission device is located on the transmission link and is used to forward the target data transmitted by the transmission link.
[0113] According to one or more embodiments of the present disclosure, the distributed storage system also includes a client and a metadata server, wherein the client is used to send a transmission request for the target data to the first data server; the metadata server stores the correspondence between the storage directory of the business type and the priority information; accordingly, the acquisition module is also used to obtain the priority information of the business type to which the target data belongs from the transmission request for the target data sent by the client from the first data server; the transmission request carries the priority information of the business type to which the target data belongs; wherein the priority information of the business type to which the target data belongs is obtained by the client from the correspondence between the storage directory of the business type stored in the metadata server and the priority information according to the storage directory corresponding to the business type to which the target data belongs.
[0114] According to one or more embodiments of the present disclosure, a priority configuration process and a data transmission process are installed on the first data server; accordingly, the configuration module configures a first priority parameter for the transmission link through the first data server according to the priority information of the business type to which the target data belongs, including: executing the data transmission process through the first data server, transmitting the priority information of the business type to which the target data belongs and the transmission link to the priority configuration process, and configuring the first priority parameter for the transmission link according to the priority information of the business type to which the target data belongs by executing the priority configuration process; wherein the network authority of the priority configuration process is higher than the network authority of the data transmission process.
[0115] According to one or more embodiments of the present disclosure, the configuration module configures a first priority parameter for the transmission link according to the priority information of the business type to which the target data belongs by executing the priority configuration process, including: calling a preset priority configuration function by executing the priority configuration process; configuring the first priority parameter for the transmission link according to the priority information of the business type to which the target data belongs through the preset priority configuration function; wherein the preset priority configuration function is a setsockopt function, and the first priority parameter is a so_mark parameter.
[0116] According to one or more embodiments of the present disclosure, the configuration module configures the second priority parameter for the target data according to the first priority parameter of the transmission link through the first data server, including: obtaining a preset configuration rule through the first data server, wherein the preset configuration rule is used to convert the first priority parameter into the second priority parameter; converting the first priority parameter of the transmission link into the second priority parameter according to the preset configuration rule through the first data server; and configuring the second priority parameter for the target data through the first data server.
[0117] According to one or more embodiments of the present disclosure, the transmission request includes a write request, and the write request carries the address information of the second data server to which the target data is to be written; accordingly, the acquisition module obtains the transmission link for transmitting the target data, including: obtaining, through the first data server, the address information of the second data server to which the target data is to be written from the write request; creating, through the first data server, a first transmission link between the first data server and the second data server according to the address information of the second data server; wherein the first transmission link is used by the first data server to transmit the target data to the second data server.
[0118] According to one or more embodiments of the present disclosure, the distributed storage system also includes a client and a metadata server, wherein the client is used to send a read request for the target data to the first data server; the metadata server stores the correspondence between the identification information of the data server and the address information of the data server; accordingly, the acquisition module obtains the transmission link for transmitting the target data, including: determining the identification information of the first data server storing the target data through the client; acquiring the address information of the first data server from the correspondence between the identification information of the data server stored in the metadata server and the address information of the data server according to the identification information of the first data server; creating a second transmission link between the first data server and the client through the client according to the address information of the first data server, wherein the second transmission link is used for the first data server to transmit the target data to the client.
[0119] According to one or more embodiments of the present disclosure, the multiple data servers are located in multiple computer rooms, and at least one data server is deployed in each computer room; the distributed storage system also includes a data transmission device, wherein the data server in one computer room transmits data with the data server in another computer room through the data transmission device.
[0120] According to one or more embodiments of the present disclosure, the data transmission device stores a correspondence between a priority parameter and a network bandwidth; accordingly, the transmission module allocates network bandwidth to the target data through the data transmission device according to the second priority parameter, including: the data transmission device obtains, according to the second priority parameter, the target network bandwidth corresponding to the second priority parameter from the stored correspondence between the priority parameter and the network bandwidth; the data transmission device allocates the target network bandwidth to the target data.
[0121] In a third aspect, according to one or more embodiments of the present disclosure, there is provided an electronic device, comprising: a processor, and a memory communicatively connected to the processor;
[0122] The memory stores computer-executable instructions;
[0123] The processor executes the computer-executable instructions stored in the memory to implement the network traffic control method based on the distributed storage system as described in the first aspect and various possible designs of the first aspect.
[0124] In a fourth aspect, according to one or more embodiments of the present disclosure, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer execution instructions. When a processor executes the computer execution instructions, the network traffic control method based on a distributed storage system as described in the first aspect and various possible designs of the first aspect is implemented.
[0125] In a fifth aspect, an embodiment of the present disclosure provides a computer program product, including a computer program, which, when executed by a processor, implements the network traffic control method based on a distributed storage system as described in the first aspect and various possible designs of the first aspect.
[0126] The above description is only a preferred embodiment of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in the present disclosure (but not limited to) by each other to form a technical solution.
[0127] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.
[0128] Although the subject matter has been described in language specific to structural features and / or methodological logical actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. On the contrary, the specific features and actions described above are merely example forms of implementing the claims.
Claims
1. A network traffic control method based on a distributed storage system, characterized in that: Applied to a distributed storage system, the distributed storage system includes a plurality of data servers; the method includes: In response to a first data server in the distributed storage system receiving a transmission request for target data, acquiring a transmission link for transmitting the target data, wherein the transmission request carries priority information of a service type to which the target data belongs; Calling a preset priority configuration function through a priority configuration process in the first data server; configuring a first priority parameter for a transmission link according to priority information of a service type to which target data belongs through the preset priority configuration function, wherein the first priority parameter is used to indicate the priority of the transmission link at a transmission layer; In response to transmitting the target data through the transmission link, the first data server configures a second priority parameter for the target data according to the first priority parameter of the transmission link, so that the data transmission device allocates network bandwidth to the target data according to the second priority parameter, wherein the second priority parameter is used to indicate the priority of the target data at the network layer, and the data transmission device is located on the transmission link and is used to forward the target data transmitted by the transmission link.
2. The method according to claim 1, characterized in that The distributed storage system also includes a client and a metadata server, wherein the client is used to send a transmission request for the target data to the first data server; the metadata server stores a correspondence between a storage directory of a business type and priority information; Correspondingly, before configuring the first priority parameter for the transmission link according to the priority information of the service type to which the target data belongs by the first data server, the method further includes: Acquire, through the first data server, from the transmission request for the target data sent from the client, priority information of the service type to which the target data belongs; the transmission request carries the priority information of the service type to which the target data belongs; The priority information of the business type to which the target data belongs is obtained by the client from the corresponding relationship between the storage directory of the business type stored in the metadata server and the priority information according to the storage directory corresponding to the business type to which the target data belongs.
3. The method according to claim 1, characterized in that The first data server is installed with a priority configuration process and a data transmission process; Accordingly, the priority configuration process in the first data server calls a preset priority configuration function; By using a preset priority configuration function, a first priority parameter is configured for the transmission link according to the priority information of the service type to which the target data belongs, including: Executing a data transmission process through the first data server, transmitting the priority information of the service type to which the target data belongs and the transmission link to the priority configuration process, calling a preset priority configuration function by executing the priority configuration process; configuring a first priority parameter for the transmission link according to the priority information of the service type to which the target data belongs through the preset priority configuration function; The network permission of the priority configuration process is higher than the network permission of the data transmission process.
4. The method according to claim 3, characterized in that The preset priority configuration function is a setsockopt function, and the first priority parameter is a so_mark parameter.
5. The method according to claim 1, characterized in that The configuring, by the first data server, a second priority parameter for the target data according to the first priority parameter of the transmission link comprises: Acquiring a preset configuration rule through the first data server, wherein the preset configuration rule is used to convert the first priority parameter into a second priority parameter; converting the first priority parameter of the transmission link into a second priority parameter according to the preset configuration rule by the first data server; The second priority parameter is configured for the target data through the first data server.
6. The method according to claim 1, characterized in that The transmission request includes a write request, and the write request carries address information of a second data server to which target data is to be written; Accordingly, the acquiring of a transmission link for transmitting the target data includes: Acquiring, through the first data server, address information of a second data server into which the target data is to be written from the write request; A first transmission link is created between the first data server and the second data server according to the address information of the second data server by the first data server; wherein the first transmission link is used by the first data server to transmit the target data to the second data server.
7. The method according to claim 1, characterized in that The distributed storage system further includes a client and a metadata server, wherein the client is used to send a read request of the target data to the first data server; the metadata server stores a correspondence between identification information of the data server and address information of the data server; Accordingly, the acquiring of a transmission link for transmitting the target data includes: Determine, by the client, identification information of a first data server storing target data; According to the identification information of the first data server, acquiring the address information of the first data server from the correspondence between the identification information of the data server and the address information of the data server stored in the metadata server; A second transmission link between the first data server and the client is created by the client according to the address information of the first data server, wherein the second transmission link is used for the first data server to transmit the target data to the client.
8. The method according to any one of claims 1 to 7, characterized in that: The multiple data servers are located in multiple computer rooms, each of which has at least one data server deployed in it; the distributed storage system also includes a data transmission device, wherein a data server in one computer room performs data transmission with a data server in another computer room through the data transmission device.
9. The method according to any one of claims 1 to 7, characterized in that: The data transmission device stores a correspondence between priority parameters and network bandwidth; Correspondingly, the data transmission device allocates network bandwidth to the target data according to the second priority parameter, including: The data transmission device acquires, according to the second priority parameter, a target network bandwidth corresponding to the second priority parameter from a stored correspondence relationship between the priority parameter and the network bandwidth; The data transmission device allocates the target network bandwidth to the target data.
10. A network traffic control device based on a distributed storage system, characterized in that: Applied to a distributed storage system, the distributed storage system includes a plurality of data servers; the device includes: an acquisition module, configured to acquire a transmission link for transmitting the target data in response to a first data server in the distributed storage system receiving a transmission request for the target data, wherein the transmission request carries priority information of a service type to which the target data belongs; A configuration module, configured to call a preset priority configuration function through a priority configuration process in the first data server; through the preset priority configuration function, configure a first priority parameter for the transmission link according to the priority information of the service type to which the target data belongs, wherein the first priority parameter indicates the priority of the transmission link at the transmission layer; A transmission module, configured to, in response to transmitting the target data through the transmission link, configure a second priority parameter for the target data through the first data server according to the first priority parameter of the transmission link, so that the data transmission device allocates network bandwidth to the target data according to the second priority parameter, wherein the second priority parameter represents the priority of the target data at the network layer, and the data transmission device is located on the transmission link and is used to forward the target data transmitted by the transmission link.
11. An electronic device, characterized in that: include: A processor, and a memory communicatively connected to the processor; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory to implement the network traffic control method based on the distributed storage system as described in any one of claims 1 to 9.
12. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions. When the processor executes the computer-executable instructions, the network traffic control method based on the distributed storage system as described in any one of claims 1 to 9 is implemented.
13. A computer program product, characterized in that It comprises a computer program, which, when executed by a processor, implements the network traffic control method based on a distributed storage system as claimed in any one of claims 1 to 9.
Citation Information
Patent Citations
Virtual enhanced transmission selection (VETS) for lossless ethernet
CN104104620A
Network traffic control method and network equipment thereof
CN107196877A
Service message sending method and device
CN110138610A
Quality of service (Qos) control method, equipment and storage medium
CN113453284A
Accurate data transmission method and device based on multi-network-port equipment and computer equipment
CN116016338A
Cited By
Network traffic flow control method based on distributed storage system, electronic device and storage medium
US12719814B2
