Service transmission method and device, computer equipment, medium and product
By acquiring and adjusting the path nodes in the service transmission path and determining the optimal transmission path, the service transmission delay problem caused by unreasonable transmission paths in the prior art is solved, and more efficient service transmission is achieved.
Patent Information
- Application Number
- CN202311808911.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-12-26
- Publication Date
- 2025-06-27
AI Technical Summary
The transmission path selected in the prior art is unreasonable, resulting in a large delay in service transmission.
By obtaining the optional transmission path of the target service and adjusting the path nodes according to the preset node selection strategy, the optimal target transmission path is determined, thereby reducing the service transmission delay.
This method can effectively reduce service transmission delay, save service transmission costs, simplify the path selection process, and improve transmission speed.
Smart Images

Figure CN120223618A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of computers, and in particular, to a service transmission method, apparatus, computer device, medium, and product. Background Art
[0002] With the development of computer technology, the amount of data generated by computer systems is increasing. Cross-node read and write technology is usually adopted to relieve the data read and write pressure of computer systems and is widely used.
[0003] Among them, as an essential link in cross-node read and write technology, cross-node transmission needs to select a transmission path for cross-node read and write services during actual application.
[0004] However, in the related art, the selected transmission path is unreasonable, and there will be a problem of large service transmission delay. Summary of the Invention
[0005] Based on this, it is necessary to provide a service transmission method, apparatus, computer device, medium, and product for the above technical problems, which can reduce service transmission delay.
[0006] In a first aspect, an embodiment of the present application provides a service transmission method, which includes:
[0007] Obtain an optional transmission path for a target service; the optional transmission path includes multiple path nodes for the target service to be transmitted from a remote node to a target disk;
[0008] According to a preset node selection strategy, adjust the path nodes in the optional transmission path to determine a target transmission path for the target service;
[0009] Transmit the target service to the target disk according to the target transmission path.
[0010] In the technical solution of the embodiment of the present application, an optional transmission path of a target service is obtained, the path nodes in the optional transmission path are adjusted according to a preset node selection strategy, a target transmission path of the target service is determined, and the target service is transmitted to a target disk according to the target transmission path; the above method can quickly determine the optional transmission path of the service to be transmitted through a path selection relationship table, simplifying the process of determining the optional transmission path of the service to be transmitted; at the same time, the above method can adjust the optional transmission path of the service to be transmitted through a node selection strategy to effectively and evenly utilize the performance of the network card and the disk, determine the optimal target transmission path, and further transmit the service to be transmitted to the target location according to the optimal target transmission path, which can reduce the service transmission delay and thus save the service transmission cost; at the same time, the above method can determine the optimal target transmission path without complex algorithms, thus simplifying the method for reducing the service transmission delay and further improving the service transmission speed.
[0011] In one embodiment, obtaining an optional transmission path of a target service includes:
[0012] Obtaining the traffic volume of the target service;
[0013] Obtaining a plurality of pressure ratios corresponding to the traffic volume from a path selection relationship table; the path selection relationship table includes the correspondence between different transmission paths, the pressure ratios of different transmission paths, and different traffic volumes;
[0014] Determining an optional transmission path according to each pressure ratio and the transmission path corresponding to each pressure ratio.
[0015] In the technical solution of the embodiment of the present application, the traffic volume of the target service is obtained, a plurality of pressure ratios corresponding to the traffic volume are obtained from a path selection relationship table, and an optional transmission path is determined according to each pressure ratio and the transmission path corresponding to each pressure ratio; the above method obtains each pressure ratio corresponding to the traffic volume of the service to be transmitted, and then determines the optional transmission path of the service to be transmitted through each pressure ratio and the transmission path corresponding to each pressure ratio. This processing process can be realized without complex algorithms, thereby reducing the complexity of determining the optional transmission path, reducing the amount of data processed during the process of determining the optional transmission path, and further improving the speed and efficiency of determining the optional transmission path.
[0016] In one embodiment, determining an optional transmission path according to each pressure ratio and the transmission path corresponding to each pressure ratio includes:
[0017] Determining the minimum pressure ratio from each pressure ratio;
[0018] Determining the transmission path corresponding to the minimum pressure ratio as the optional transmission path.
[0019] In the technical solution of the embodiment of the present application, the minimum pressure ratio is determined from each pressure ratio, and the transmission path corresponding to the minimum pressure ratio is determined as the optional transmission path; the above method can determine the transmission path with the minimum pressure ratio among the multiple transmission paths corresponding to the service to be transmitted as the optional transmission path for the service to be transmitted, so as to provide a reference basis for selecting the optimal transmission path to reduce the transmission delay of the service to be transmitted, so that it is further possible to speed up the adjustment of the optimal transmission path on the basis of the initial transmission delay with the minimum transmission delay among the multiple transmission paths corresponding to the service to be transmitted.
[0020] In one embodiment, the construction process of the path selection relationship table includes:
[0021] Obtain the historical traffic volume and reference traffic volume of different historical services;
[0022] For any historical traffic volume, according to the historical traffic volume, reference traffic volume, and the range of the number of unit transmissions when different transmission paths are selected for the historical service, determine the pressure ratio of the historical traffic volume relative to the reference traffic volume under each transmission path;
[0023] Construct a path selection relationship table according to each historical traffic volume, the corresponding transmission paths, and the corresponding pressure ratios.
[0024] In the technical solution of the embodiment of the present application, the historical traffic volume and reference traffic volume of different historical services are obtained. For any historical traffic volume, according to the historical traffic volume, reference traffic volume, and the range of the number of unit transmissions when different transmission paths are selected for the historical service, determine the pressure ratio of the historical traffic volume relative to the reference traffic volume under each transmission path, and construct a path selection relationship table according to each historical traffic volume, the corresponding transmission paths, and the corresponding pressure ratios; the above method can construct a path selection relationship table to provide a reference basis for quickly obtaining the optional transmission path of the service to be transmitted through this relationship table during the subsequent service transmission process.
[0025] In one embodiment, according to the preset node selection strategy, adjust the path nodes in the optional transmission path to determine the target transmission path of the target service, including:
[0026] According to the adjustment priority of each path node and the node selection strategy, adjust at least one path node in the optional transmission path to obtain multiple candidate transmission paths;
[0027] Select the target transmission path of the target service from the multiple candidate transmission paths.
[0028] In the technical solution of the embodiment of the present application, at least one path node in the optional transmission path is adjusted according to the adjustment priority and node selection strategy of each path node to obtain multiple candidate transmission paths, and the target transmission path of the target service is selected from the multiple candidate transmission paths; the above method can adjust the obtained optional transmission path so that each path node on the optional transmission path can fully exert its own hardware resource capabilities during the transmission process. When the transmission pressure is low, the optimal target transmission path with a smaller transmission pressure can be determined. When the transmission pressure is high, the performance of each path node can be balanced to determine the optimal target transmission path. Based on this, it provides an effective basis for reducing the service transmission delay in the subsequent actual transmission process; at the same time, the above method can adjust the optional transmission path according to the pre-constructed node selection strategy, thereby reducing the complexity of the adjustment process and further improving the transmission path adjustment speed.
[0029] In one embodiment, selecting the target transmission path of the target service from multiple candidate transmission paths includes:
[0030] Obtain the pressure ratio of each candidate transmission path;
[0031] Determine the candidate transmission path corresponding to the smallest pressure ratio as the target transmission path.
[0032] In the technical solution of the embodiment of the present application, the pressure ratio of each candidate transmission path is obtained, and the candidate transmission path corresponding to the smallest pressure ratio is determined as the target transmission path; the above method can select the optimal transmission path corresponding to the service to be transmitted from the pressure ratios of each candidate transmission path, which can not only improve the determination speed of the optimal transmission path, but also enable the service to be transmitted further according to the optimal transmission path, thereby reducing the service transmission delay.
[0033] In one embodiment, the node selection strategy includes the selection strategy of each path node; according to the adjustment priority and node selection strategy of each path node, adjusting at least one path node in the optional transmission path to obtain multiple candidate transmission paths includes:
[0034] Determine multiple groups of target path nodes in the optional transmission path according to the adjustment priority of each path node; each group of target path nodes includes at least one path node;
[0035] For any group of target path nodes, adjust the target path nodes in the optional transmission path according to the selection strategy of each path node to obtain candidate transmission paths.
[0036] In the technical solution of the embodiment of the present application, multiple groups of target path nodes in the optional transmission paths can be determined according to the adjustment priorities of each path node. For any group of target path nodes, the target path nodes in the optional transmission paths are adjusted according to the selection strategy of each path node to obtain candidate transmission paths. This process can obtain multiple corresponding candidate transmission paths based on the same optional transmission path, so as to expand the optional range for further obtaining the target transmission path that can reduce the service transmission delay, and improve the success rate and accuracy of obtaining the target transmission path.
[0037] In one embodiment, the selection strategy of each path node is determined according to at least one of the service type of the target service, the operation cost and resource attributes of each path node, and the pressure ratio of the optional transmission path.
[0038] In the technical solution of the embodiment of the present application, the selection strategy of each path node is determined according to at least one of the service type of the target service, the operation cost and resource attributes of each path node, and the pressure ratio of the optional transmission path; the selection strategies of each path node in the above method are all determined by multi-dimensional factors, so as to improve the reliability of the selection strategy of each path node obtained, and provide reference information for further accurately adjusting the optional transmission path to obtain the target transmission path that can reduce the service transmission delay.
[0039] In a second aspect, an embodiment of the present application provides a service transmission device, which includes:
[0040] A transmission path acquisition module, configured to acquire an optional transmission path of a target service; the optional transmission path includes multiple path nodes for the target service to be transmitted from a remote node to a target disk;
[0041] A path adjustment module, configured to adjust the path nodes in the optional transmission path according to a preset node selection strategy to determine the target transmission path of the target service;
[0042] A service transmission module, configured to transmit the target service to the target disk according to the target transmission path.
[0043] In a third aspect, an embodiment of the present application further provides a computer device, which includes a memory and a processor. The memory stores a computer program, and when the processor executes the computer program, it implements the steps of the method in any one of the embodiments in the first aspect.
[0044] In a fourth aspect, an embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, it implements the steps of the method in any one of the embodiments in the first aspect.
[0045] Fifthly, the embodiment of the present application further provides a computer program product, which includes a computer program. When the computer program is executed by a processor, it implements the steps of the method in any one of the above-mentioned first aspects.
[0046] The above description is only an overview of the technical solution of the present application. In order to be able to understand the technical means of the present application more clearly, it can be implemented according to the content of the specification. And in order to make the above and other purposes, features and advantages of the present application more obvious and understandable, the following specifically illustrates the specific implementation manners of the present application. BRIEF DESCRIPTION OF THE DRAWINGS
[0047] Figure 1 It is an application environment diagram of the service transmission method in an embodiment;
[0048] Figure 2 It is a schematic flowchart of the service transmission method in an embodiment;
[0049] Figure 3 It is a schematic flowchart of the service transmission method in another embodiment;
[0050] Figure 4 It is a framework structure diagram of the network card on the proximal node and multiple transmission paths on the distal node in an embodiment;
[0051] Figure 5 It is a schematic flowchart of the service transmission method in another embodiment;
[0052] Figure 6 It is a schematic flowchart of the service transmission method in another embodiment;
[0053] Figure 7 It is a schematic flowchart of the service transmission method in another embodiment;
[0054] Figure 8 It is a schematic flowchart of the service transmission method in another embodiment;
[0055] Figure 9 It is a schematic flowchart of the service transmission method in another embodiment;
[0056] Figure 10 It is a structural block diagram of the service transmission device in another embodiment;
[0057] Figure 11 It is an internal structure diagram of a computer device in an embodiment. DETAILED DESCRIPTION OF THE EMBODIMENTS
[0058] In order to make the objectives, technical solutions and advantages of the present application more clear and understandable, the present application will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.
[0059] In the field of big data, the amount of data generated by computer systems is increasing. Cross-node read and write technology is usually adopted to relieve the data read and write pressure of computer systems and is widely used. Among them, cross-node transmission, as an essential link in cross-node read and write technology, first selects the transmission path for cross-node read and write services during actual application, and then based on the selected transmission path, transmits the cross-node read and write services from the proximal disk to the target disk for response. However, in the related technology, the selected transmission path is unreasonable, resulting in a problem of relatively large service transmission delay. Based on this, the embodiments of the present application provide a service transmission method that can reduce the service transmission delay.
[0060] The service transmission method provided by the embodiments of the present application can be applied to Figure 1 the application environment diagram shown. The service transmission system in this application environment includes a proximal node and a distal node, and both the proximal node and the distal node have data read and write functions. Optionally, the proximal node and the distal node can be communicatively connected, and this communication method can be Wi-Fi, a mobile network, or a Bluetooth connection, etc. Both the proximal node and the distal node can be, but are not limited to, implemented by a computer device, an independent server, or a server cluster composed of multiple servers. The above computer device can be a personal computer, a tablet computer, a laptop computer, a smart phone, a smart watch, etc. The specific forms of the proximal node and the distal node are not limited in this embodiment. Figure 1 Taking both the proximal node and the distal node as servers as an example to illustrate the service transmission system.
[0061] It should be noted here that the embodiments of the present application are applicable to the scenario where the traffic volume on the transmission path from the service receiving node in the distal node to the target disk is relatively large; when the traffic volume on the transmission path from the service receiving node in the distal node to the target disk is 0, it is feasible to transmit the service to be transmitted through any transmission path between the service receiving node and the target disk. In this case, the problem of relatively large service transmission delay will not be involved. The following embodiments take the processor in the proximal node (i.e., the proximal processor) as the execution subject of the service transmission method to introduce the specific process of the service transmission method.
[0062] As Figure 2 shown, it is a schematic flowchart of the service transmission method provided by the embodiments of the present application, and this method can be implemented through the following steps:
[0063] S100. Obtain the optional transmission paths for the target service. Among them, the optional transmission paths include multiple path nodes for the target service to be transmitted from the remote node to the target disk.
[0064] In practical applications, the above-mentioned target service can be a write service or a read service. Among them, if the target service is a write service, the target service can carry the data to be written to the target disk on the remote node; if the target service is a read service, the target service can carry the identifier of the data to be read from the target disk, and this identifier can represent information such as data type, storage area, storage time, etc.
[0065] It should be noted here that transmitting the target service from the remote node to the target disk refers to the multiple path nodes through which the target service is transmitted from the service receiving node on the remote node to the target disk; each path node is a hardware resource, and the multiple path nodes can include the service receiving node and the target disk. Optionally, the service receiving node on the remote node corresponds to the service occurrence node on the proximal node, and both can be network cards. In practical applications, the network card can support the Remote Direct Memory Access (RDMA) protocol.
[0066] Specifically, the proximal processor can obtain multiple transmission paths from the service receiving node on the remote node to the target disk, and then select any one of the multiple transmission paths as the optional transmission path for the target service.
[0067] In addition, the proximal processor can also obtain multiple transmission paths from the service receiving node on the remote node to the target disk. For any one of the transmission paths, obtain the performance parameters of each path node on the transmission path, and then evaluate the performance metric value of this transmission path according to the performance parameters of each path node. After that, select the transmission path corresponding to the maximum or minimum performance metric value among the performance metric values of each transmission path as the optional transmission path for the target service.
[0068] Of course, it is also possible to select the transmission path corresponding to the performance metric value that meets the preset performance metric condition from the performance metric values of each transmission path as the optional transmission path for the target service.
[0069] S200. According to the preset node selection strategy, adjust the path nodes in the optional transmission path to determine the target transmission path of the target service.
[0070] Among them, the above-mentioned node selection strategy can include the selection strategy of at least one path node. It should be noted here that the above-mentioned adjustment refers to the process of selecting one of the multiple identical path nodes.
[0071] In one implementation, the proximal processor can pre-train a path adjustment model, and then input both the optional transmission path and the preset node selection policy into the path adjustment model, so as to adjust at least one path node in the optional transmission path through the path adjustment model and output the target transmission path of the target service.
[0072] Optionally, the above path adjustment model can be composed of at least one of a convolutional neural network model, a fully connected neural network model, a recurrent neural network model, a long short-term memory neural network model, a graph convolutional neural network model, etc.
[0073] In another implementation, the proximal processor can adjust the corresponding path nodes in the optional transmission path according to the selection policies of the respective path nodes in the node selection policy to obtain the target transmission path of the target service.
[0074] S300. Transmit the target service to the target disk according to the target transmission path.
[0075] Specifically, based on the target transmission path obtained in the previous steps, the proximal processor can control the target service to be transmitted to the target disk along each path node on the target transmission path.
[0076] It should be noted here that the remote node can include multiple disks, and any disk can be used as the target disk. In practical applications, the target location (i.e., the target disk) to which the target service is to be transmitted is known, that is, pre-determined.
[0077] In the technical solution of the embodiment of the present application, an optional transmission path of the target service is obtained, the path nodes in the optional transmission path are adjusted according to the preset node selection policy, the target transmission path of the target service is determined, and the target service is transmitted to the target disk according to the target transmission path; the above method can adjust the optional transmission path of the service to be transmitted through the node selection policy to effectively and evenly utilize the performance of the network card and the disk, determine the optimal target transmission path, and further transmit the service to be transmitted to the target location according to the optimal target transmission path, which can reduce the service transmission delay, thereby saving the service transmission cost; at the same time, the above method can determine the optimal target transmission path without complex algorithms, thus simplifying the method for reducing the service transmission delay and further improving the service transmission speed.
[0078] The process of obtaining the optional transmission path of the target service will be described below. In one embodiment, as Figure 3 shown, the steps in S100 above can be implemented in the following manner:
[0079] S110. Obtain the traffic volume of the target service.
[0080] Specifically, the target service can be analyzed to determine the volume of the target service. Among them, when the target service is a write service, the volume of the target service can be the size of the data to be written carried in the write service; when the target service is a read service, the volume of the target service can be the size of the read-write service.
[0081] S120. Obtain multiple pressure ratios corresponding to the service volume from a pre-constructed path selection relationship table; wherein, the path selection relationship table includes the corresponding relationships between different transmission paths, the pressure ratios of different transmission paths, and different service volumes.
[0082] Among them, the services corresponding to different service volumes in the path selection relationship table can be the same or different, and the embodiments of the present application do not make any limitations in this regard.
[0083] In the embodiments of the present application, the above path selection relationship table may include the corresponding relationships between different service volumes, different transmission paths, and the pressure ratios of different transmission paths. Optionally, the pressure ratio can be understood as the transmission pressure of the transmission path when the transmission path transmits the corresponding service.
[0084] Based on the search results in the previous steps, multiple pressure ratios corresponding to the found service volume can be obtained from the path selection relationship table.
[0085] S130. Determine the optional transmission paths according to each pressure ratio and the transmission path corresponding to each pressure ratio.
[0086] Among them, any transmission path corresponding to a pressure ratio can be selected from the transmission paths corresponding to each pressure ratio and determined as the optional transmission path of the target service.
[0087] In addition, transmission paths corresponding to pressure ratios within a preset ratio range can also be selected from the transmission paths corresponding to each pressure ratio and determined as the optional transmission paths of the target service.
[0088] In the embodiments of the present application, the above optional transmission paths may sequentially include 5 path nodes: a network card, a memory, a numa (i.e., a CPU execution unit), a disk port, and a target disk, as Figure 4 shown in the framework structure diagram of the network card on the proximal node and multiple transmission paths on the distal node. Among them, network card a and network card b are both network cards in the proximal node. In actual applications, the target service can be transmitted to the corresponding network card c or network card on the distal node through network card a or network card b.
[0089] Taking the example of the target service being transmitted through network card c, after passing through network card c, it is possible to select the memory close to the network card and NUMA a (path 1) or the memory close to the disk and NUMA b (path 2) to transmit to disk port a, and then the target service falls into the target disk. Here, it should be noted that the memory close to the network card refers to the memory set close to the network card, and the memory close to the disk refers to the memory set close to the target disk.
[0090] Taking the example of the target service being transmitted through network card d, after passing through network card d, it is possible to select the memory close to the network card and NUMA c (path 3) or the memory close to the disk and NUMA d (path 4) to transmit to disk port b, and then the target service falls into the target disk. Among them, the memory close to the network card refers to the memory set close to the network card, and the memory close to the disk refers to the memory set close to the target disk.
[0091] In the embodiment of the present application, the optional transmission path of the target service can be any one of the two paths for the target service to be transmitted through network card c and the two paths for the target service to be transmitted through network card d.
[0092] The technical solution in the embodiment of the present application obtains multiple pressure ratios corresponding to the traffic volume from a pre-constructed path selection relationship table, and determines the optional transmission path according to each pressure ratio and the transmission path corresponding to each pressure ratio; the above method can quickly determine the optional transmission path of the service to be transmitted through the path selection relationship table, making the determination process of the optional transmission path of the service to be transmitted simpler; at the same time, the above method obtains each pressure ratio corresponding to the traffic volume of the service to be transmitted, and then determines the optional transmission path of the service to be transmitted through each pressure ratio and the transmission path corresponding to each pressure ratio. This processing process can be realized without complex algorithms, thereby being able to reduce the complexity of determining the optional transmission path, reduce the amount of data processed in the process of determining the optional transmission path, and further improve the speed and efficiency of determining the optional transmission path.
[0093] The following describes the process of determining the optional transmission path according to each pressure ratio and the transmission path corresponding to each pressure ratio. In one embodiment, as Figure 5 shown, the steps in S122 above can be implemented in the following manner:
[0094] S1221. Determine the minimum pressure ratio from each pressure ratio.
[0095] Specifically, each pressure ratio can be sorted in ascending or descending order, and then the minimum pressure ratio is determined according to the sorting result.
[0096] In addition, the minimum value can be taken for each pressure ratio to obtain the minimum pressure ratio, or each pressure ratio can be compared pairwise to obtain the minimum pressure ratio.
[0097] S1222. Determine the transmission path corresponding to the minimum pressure ratio as the optional transmission path.
[0098] In the embodiment of the present application, the transmission path corresponding to the minimum pressure ratio can be obtained from the path selection relationship table, and the transmission path corresponding to the minimum pressure ratio is determined as the optional transmission path for the target service.
[0099] The technical solution in the embodiment of the present application determines the minimum pressure ratio from each pressure ratio, and determines the transmission path with the minimum pressure ratio as the optional transmission path; the above method can determine the transmission path with the minimum pressure ratio among the multiple transmission paths corresponding to the service to be transmitted as the optional transmission path for the service to be transmitted, so as to provide a reference basis for selecting the optimal transmission path to reduce the transmission delay of the service to be transmitted, so that further, based on the initial transmission delay with the minimum transmission delay among the multiple transmission paths corresponding to the service to be transmitted, the speed of adjusting the optimal transmission path can be accelerated.
[0100] The construction process of the above path selection relationship table will be described below. In one embodiment, as Figure 6 shown, the construction process of the above path selection relationship table can be implemented through the following steps:
[0101] S130. Obtain the historical traffic volume and reference traffic volume of different historical services.
[0102] Among them, the service types of the above different historical services can be the same or different. Optionally, the above different historical traffic volumes can be but are not limited to 8KB, 16KB, 24KB, 32KB, 128KB, etc.; the above reference traffic volume can be a fixed number of bytes, such as 8KB, 16KB, 24KB or 32KB, etc.
[0103] Optionally, the remote processor (i.e., the CPU execution unit of the remote node) can use the polling method to write information into each memory slot in each memory on the remote node in real time. Among them, the information for a period of time can be written into each memory slot, and the information can be the transmission duration, transmission volume, traffic volume of the historical service (i.e., IO size), number of read and write operations per second (i.e., IOPS), and transmission path, etc. from the proximal node to the target disk for the historical service that has been transmitted to the target disk. In the embodiment of the present application, using the polling method to write information into the memory slot can reduce the information writing overhead.
[0104] In practical applications, based on all the information written in each memory on the remote node before the current moment, the remote processor can obtain different historical traffic volumes corresponding to different historical services, and send the different historical traffic volumes to the proximal processor. Correspondingly, the proximal processor can receive the different historical traffic volumes.
[0105] In addition, the above reference traffic volume can be user-defined or determined based on historical experience values, and the embodiments of this application do not limit the size thereof.
[0106] S140. For any historical traffic volume, determine the pressure ratio of the historical traffic volume relative to the reference traffic volume under each transmission path according to the historical traffic volume, the reference traffic volume, and the range of the number of unit transmissions when different transmission paths are selected for the historical traffic.
[0107] Specifically, the proximal processor can obtain the range of the number of unit transmissions when different transmission paths are selected for the historical traffic from the distal processor, and then determine the pressure ratio of the historical traffic volume relative to the reference traffic volume under each transmission path according to the historical traffic volume, the reference traffic volume, and the range of the number of unit transmissions when different transmission paths are selected for the historical traffic.
[0108] Among them, the range of the number of unit transmissions when different transmission paths are selected for the historical traffic can be the number of read / write times per second corresponding to different historical traffic volumes of different historical traffic written into each memory slot in the memory on the distal node by polling the CPU execution unit of the distal node (i.e., the distal node) from before the current moment, and then for any historical traffic volume, respectively select the maximum number max and the minimum number min corresponding to the historical traffic volume when the same transmission path is used from all the number of read / write times per second, and determine the interval range corresponding to the maximum number max and the minimum number min of the same transmission path as the range of the number of unit transmissions [max, min] of this transmission path.
[0109] That is to say, finally, the range of the number of unit transmissions [max, min] corresponding to any historical traffic volume when transmitted on different transmission paths can be obtained.
[0110] In practical applications, the distal processor can write information into each memory slot in different memories on the distal node in a polling manner through different read / write threads, and different read / write threads can write information into the same memory slot or different memory slots; at the same time, the distal processor can also count the pressure of each memory on the distal node through the management thread to provide a reference basis for the next adjustment of the optimal transmission path.
[0111] Optionally, the management thread can periodically count or read the information written by different read / write threads into each memory slot in each distal memory, and then determine the pressure of each distal memory according to the amount of information. Multiple memory slots can be set in a single memory, and as time increases, the amount of information written into each memory slot increases.
[0112] In the embodiments of the present application, the remote processor isolates the write and statistics operations through the read-write thread and the management thread, so as to improve the speed of obtaining the memory pressure, that is, the speed of statistics of the memory pressure.
[0113] It should be noted here that the working mode of the above read-write thread writing information to the memory slot can be a slow mode or a fast mode, which can be specifically understood as the speed of information writing. In practical applications, the working mode of the read-write thread can be adjusted according to the pressure of each memory statistically by the management thread; among them, for any memory, when the memory pressure is large, the working mode of the memory can be adjusted to the fast mode; when the memory pressure is small, the working mode of the memory can be adjusted to the slow mode.
[0114] Taking the multiple historical traffic volumes of 16KB, 64KB, 128KB, and 512KB respectively, the reference traffic volume of 8KB, and the unit transmission times range corresponding to a specific transmission path of [0W, 11W] as an example, in practical applications, the unit transmission times range can be evenly segmented to obtain the maximum read-write times per second for each interval. If the maximum read-write times per second for 11 intervals are 1W, 2W, 3W,..., 10W, and 11W respectively.
[0115] First, taking 1W IOPS and the historical traffic volume of 16KB as an example, in the process of pressure ratio conversion, in the first step, first obtain the 8KB transmission delay distribution of the reference traffic volume of 8KB at 1W read-write times per second (i.e., 8KB + 1W IOPS), and use it as the pressure conversion benchmark. In the second step, 16KB can be added on the basis of 8KB for comparison to obtain the 8KB transmission delay distribution under (16KB + A1 IOPS) + (8KB + A2 IOPS), where A1 + A2 can be less than or equal to 1W and greater than 0. Here, taking both A1 and A2 as 5K as an example, in the third step, the 8KB transmission delay distributions obtained in the first step and the second step can be compared. Among them, since the bandwidth of 16KB (the bandwidth is equal to the product of the traffic volume and IOPS) increases, the corresponding 8KB transmission delay will increase. For the purpose of comparison, it is necessary to make the 8KB transmission delay distributions obtained in the first step and the second step basically equal or similar. Naturally, in the fourth step, the IOPS of 16KB can be reduced. Taking the IOPS of 16KB reduced from 5K to 4W as an example, the 8KB transmission delay distribution corresponding to (16KB + A3 IOPS) + (8KB + A2 IOPS) (A3 is equal to 4K) is basically equal or similar to the 8KB transmission delay distribution under 8KB + 1W IOPS. At this time, the conversion result that can be obtained is that 16KB is less than or equal to 1.25 (i.e., A2 / A3) 8KBs, where 1.25 represents the pressure ratio of 16KB relative to the reference traffic volume of 8KB under the corresponding transmission path.
[0116] Correspondingly, under the above specific transmission path, it can be determined that the conversion results of 64KB, 128KB, and 512KB are that 64KB is less than or equal to 2 8KBs, 128KB is less than or equal to 3 8KBs, and 512KB is less than or equal to 6 8KBs respectively.
[0117] After that, taking 2W, 3W, ..., 10W, and 11W IOPS respectively, and taking the historical traffic volumes of 64KB, 128KB, and 512KB as examples, the pressure ratio conversion process is carried out in the above manner to obtain the pressure ratios corresponding to 64KB, 128KB, and 512KB when they are transmitted in different IOPS interval segments on the specific transmission path.
[0118] In addition, taking the historical traffic volumes of 16KB, 64KB, 128KB, and 512KB, and the reference traffic volume of 8KB, and taking the range of the number of unit transmissions [0W, 11W] corresponding to the transmission on other transmission paths respectively as examples, the pressure ratios of each historical traffic volume relative to the reference traffic volume under different transmission paths are obtained.
[0119] S150. Construct a path selection relationship table according to each historical traffic volume, corresponding transmission path, and corresponding pressure ratio.
[0120] Based on the different historical traffic volumes, corresponding transmission paths of different historical traffic volumes, and corresponding pressure ratios of different historical traffic volumes when transmitted on different transmission paths obtained in the previous steps, the corresponding relationships among the three can be established, and a path selection relationship table can be generated according to these corresponding relationships.
[0121] It should be noted here that the above path selection relationship table is dynamically updated. After each business transmission is completed, the path selection relationship table can be updated to prepare for accurately obtaining the optional transmission paths of the business to be transmitted in the subsequent business transmission process.
[0122] In the technical solution of this application embodiment, the historical traffic volumes and reference traffic volumes of different historical services are obtained. For any historical traffic volume, according to the historical traffic volume, reference traffic volume, and the range of the number of unit transmissions when different transmission paths are selected for the historical service transmission, the pressure ratio of the historical traffic volume relative to the reference traffic volume under each transmission path is determined, and a path selection relationship table is constructed according to each historical traffic volume, corresponding transmission path, and corresponding pressure ratio; the above method can construct a path selection relationship table to provide a reference basis for quickly obtaining the optional transmission paths of the business to be transmitted through this relationship table in the subsequent business transmission process.
[0123] The process of adjusting the path nodes in the optional transmission paths according to the preset node selection strategy to determine the target transmission path of the target service is described below. In one embodiment, such as Figure 7As shown, the steps in S220 can be implemented in the following manner:
[0124] S221. Adjust at least one path node in the optional transmission paths according to the adjustment priorities and node selection strategies of each path node to obtain multiple candidate transmission paths.
[0125] In the embodiments of the present application, the above node selection strategy may include the selection strategies of each path node in the optional transmission paths, where the adjustment priorities of different path nodes are different.
[0126] Among them, the proximal processor may pre-train a path node adjustment model, and then input both the adjustment priorities and node selection strategies of each path node into the path node adjustment model, so that the path node adjustment model adjusts at least one path node in the optional transmission paths and outputs multiple candidate transmission paths.
[0127] Optionally, the above path node adjustment model may be composed of at least one combination of a convolutional neural network model, a fully connected neural network model, a recurrent neural network model, a long short-term memory neural network model, and a graph convolutional neural network model.
[0128] In addition, the proximal processor may adjust at least one path node in the optional transmission paths respectively according to the corresponding node selection strategy in the order from high to low of the adjustment priorities of each path node to obtain multiple candidate transmission paths. In this case, the above node selection strategy may include the method of synchronously adjusting at least one path node.
[0129] S222. Select the target transmission path of the target service from the multiple candidate transmission paths.
[0130] Specifically, the proximal processor may select one of the multiple candidate transmission paths as the optimal target transmission path of the target service according to the pre-established selection method.
[0131] Meanwhile, the proximal processor may also perform performance evaluation on each candidate transmission path, and then select the optimal target transmission path of the target service from the multiple candidate transmission paths according to the performance evaluation results.
[0132] In the technical solution of the embodiment of the present application, at least one path node in the optional transmission path is adjusted according to the adjustment priority and node selection strategy of each path node to obtain multiple candidate transmission paths, and the target transmission path of the target service is selected from the multiple candidate transmission paths; the above method can adjust the obtained optional transmission path to enable each path node on the optional transmission path to fully exert its hardware resource capabilities during the transmission process. When the transmission pressure is low, the optimal target transmission path with a smaller transmission pressure can be determined. When the transmission pressure is high, the performance of each path node can be balanced to determine the optimal target transmission path. Based on this, it provides an effective basis for reducing the service transmission delay in the subsequent actual transmission process; at the same time, the above method can adjust the optional transmission path according to the pre-constructed node selection strategy, thereby reducing the complexity of the adjustment process and further improving the transmission path adjustment speed.
[0133] The process of adjusting at least one path node in the optional transmission path according to the adjustment priority and node selection strategy of each path node to obtain multiple candidate transmission paths will be described below. In one embodiment, the node selection strategy includes the selection strategy of each path node; as Figure 8 shown, the steps in S221 above can be implemented in the following manner:
[0134] S2211. Determine multiple groups of target path nodes in the optional transmission path according to the adjustment priority of each path node. Each group of target path nodes includes at least one path node.
[0135] Specifically, the proximal processor can determine multiple groups of target path nodes in the optional transmission path according to the order of the adjustment priorities of each path node in the optional transmission path from high to low.
[0136] In the embodiment of the present application, an example is given where the optional transmission path sequentially includes 5 path nodes: a network card, a memory, a numa, a disk port, and a target disk; the adjustment priorities of each path node in the order from high to low can be a network card, a memory, a numa, a disk port, a target disk, or a memory, a network card, a disk port, a numa, a target disk. The embodiment of the present application does not make a limitation on this.
[0137] Taking the adjustment priorities of the 5 path nodes on the optional transmission path in the order from high to low as a network card, a memory, a numa, a disk port, and a target disk as an example, in actual applications, 1, 2, 3, 4, and 5 path nodes in the optional transmission path can be respectively determined as each group of target path nodes according to the order of the adjustment priorities of each path node from high to low.
[0138] Among them, in the order of decreasing adjustment priority of each path node, if one path node in the optional transmission path is adjusted, the corresponding target path node may include a network card; if two path nodes in the optional transmission path are adjusted, the corresponding target path node may include a network card and memory; if three path nodes in the optional transmission path are adjusted, the corresponding target path node may include a network card, memory, and NUMA; if four path nodes in the optional transmission path are adjusted, the corresponding target path node may include a network card, memory, NUMA, and a disk port; if five path nodes in the optional transmission path are adjusted, the corresponding target path node may include a network card, memory, NUMA, a disk port, and a target disk.
[0139] S2212. For any group of target path nodes, according to the selection strategy of each path node, adjust the target path nodes in the optional transmission path to obtain a candidate transmission path.
[0140] In practical applications, for any group of target path nodes, the proximal processor can adjust each path node in the target path nodes of the optional transmission path respectively according to the selection strategy of each path node to obtain a candidate transmission path.
[0141] Among them, the selection strategies of different path nodes can all be determined according to the service type of the target service, the operation cost of different path nodes, the resource attributes of different path nodes, or the pressure ratio of the optional transmission path. The embodiments of the present application do not make limitations in this regard.
[0142] In one embodiment, the selection strategy of each path node is determined according to at least one of the service type of the target service, the operation cost and resource attributes of each path node, and the pressure ratio of the optional transmission path.
[0143] In practical applications, the selection strategies of different path nodes are different. However, the selection strategies of different path nodes can all be determined according to at least one of the service type of the target service, the operation cost and resource attributes of each path node, and the pressure ratio of the optional transmission path.
[0144] Optionally, the resource attributes of the above path node may include the resource size, resource upper limit value, or lower limit value, etc. of the path node.
[0145] It should be noted here that the above path nodes can be network cards, memory, NUMA, disk ports, or target disks. Among them, the selection strategy of the network card can be determined according to at least one of the service type of the target service, the operation cost and resource attributes of the network card, and the pressure ratio of the optional transmission path; the selection strategy of the memory can be determined according to at least one of the service type of the target service, the operation cost and resource attributes of the memory, and the pressure ratio of the optional transmission path; the selection strategy of NUMA can be determined according to at least one of the service type of the target service, the operation cost and resource attributes of NUMA, and the pressure ratio of the optional transmission path; the selection strategy of the disk port can be determined according to at least one of the service type of the target service, the operation cost and resource attributes of the disk port, and the pressure ratio of the optional transmission path; the selection strategy of the target disk can be determined according to at least one of the service type of the target service, the operation cost and resource attributes of the target disk, and the pressure ratio of the optional transmission path.
[0146] In the embodiment of the present application, the selection strategy of the above network card may include: a. The network cards in the remote node are independent hardware resources and are more inclined to be balanced; b. When the transmission pressure ratio of the transmission path corresponding to the network card selected in the current transmission path is relatively large, the current network card is adjusted to a network card with a smaller pressure ratio.
[0147] At the same time, the selection strategy of the above memory may include: a. When the target disk resources are limited, the memory selected in the current transmission path is adjusted to the memory close to the target disk; b. When the pressure ratio of the network card selected in the current transmission path is relatively small and the pressure ratio of the target disk is relatively large, the NUMA selected in the current transmission path is adjusted to the memory close to the target disk; c. When the pressure ratio of the network card selected in the current transmission path is relatively large and the pressure ratio of the target disk is relatively small, the memory selected in the current transmission path is adjusted to the memory close to the network card.
[0148] Moreover, the selection strategy of the above NUMA may include: a. When the target disk resources are limited, the NUMA selected in the current transmission path is adjusted to the NUMA close to the target disk; b. When the pressure ratio of the network card selected in the current transmission path is relatively small and the pressure ratio of the target disk is relatively large, the NUMA selected in the current transmission path is adjusted to the NUMA close to the target disk; c. When the pressure ratio of the network card selected in the current transmission path is relatively large and the pressure ratio of the target disk is relatively small, the NUMA selected in the current transmission path is adjusted to the NUMA close to the network card.
[0149] In addition, the above disk port selection strategy may include: a. When the disk port selected in the current transmission path is close to the bandwidth upper limit for a dual-port disk, adjust the current disk port to another disk port; b. According to the current pressure ratio of each disk port in the target disk, adjust the disk port selected in the current transmission path to the disk port with a smaller pressure ratio.
[0150] In this embodiment, the selection strategy of each path node is determined according to at least one of the service type of the target service, the operation cost and resource attributes of each path node, and the pressure ratio of the optional transmission paths. The selection strategy of each path node in this embodiment is determined by multi-dimensional factors, so as to improve the reliability of the selection strategy of each obtained path node, and provide reference information for further accurately adjusting the optional transmission path to obtain a target transmission path that can reduce the service transmission delay.
[0151] The technical solution in the embodiment of the present application can determine multiple groups of target path nodes in the optional transmission path according to the adjustment priority of each path node, and for any group of target path nodes, adjust the target path nodes in the optional transmission path according to the selection strategy of each path node to obtain a candidate transmission path. This process can obtain multiple corresponding candidate transmission paths based on the same optional transmission path, so as to expand the optional range for further obtaining a target transmission path that can reduce the service transmission delay, and improve the success rate and accuracy of obtaining the target transmission path.
[0152] The process of selecting the target transmission path of the target service from the above multiple candidate transmission paths will be described below. In one embodiment, as Figure 9 shown, the steps in S222 above can be implemented in the following manner:
[0153] S2221. Obtain the pressure ratio of each candidate transmission path.
[0154] Specifically, multiple candidate transmission paths corresponding to the traffic volume of the target service can be found in the path selection relationship table, and then the pressure ratios corresponding to the multiple candidate transmission paths can be obtained from the path selection relationship table.
[0155] S2222. Determine the candidate transmission path corresponding to the smallest pressure ratio as the target transmission path.
[0156] Specifically, the pressure ratios of each candidate transmission path can be sorted in ascending or descending order, and then the smallest pressure ratio can be determined according to the sorting result.
[0157] In addition, the minimum value of the pressure ratios of each candidate transmission path can also be taken to obtain the smallest pressure ratio, or the pressure ratios of each candidate transmission path can be compared pairwise to obtain the smallest pressure ratio.
[0158] Further, the candidate transmission path corresponding to the minimum pressure ratio can be determined as the target transmission path that is optimal for the target service.
[0159] In the technical solution of the embodiment of the present application, the pressure ratios of each candidate transmission path are obtained, and the candidate transmission path corresponding to the minimum pressure ratio is determined as the target transmission path; the above method can select the optimal transmission path corresponding to the service to be transmitted from the pressure ratios of each candidate transmission path, which can not only improve the determination speed of the optimal transmission path, but also make the service to be transmitted further transmitted according to the optimal transmission path, and can reduce the service transmission delay.
[0160] In one embodiment, the embodiment of the present application further provides a service transmission method, and the method includes the following processes:
[0161] (1) Obtain the traffic volume of the target service;
[0162] (2) Obtain a plurality of pressure ratios corresponding to the traffic volume from a pre-constructed path selection relationship table; the path selection relationship table includes the corresponding relationships between different transmission paths, the pressure ratios of different transmission paths, and different traffic volumes;
[0163] Among them, the construction process of the path selection relationship table in the above step (2) includes:
[0164] (21) Obtain the historical traffic volume and reference traffic volume of different historical services;
[0165] (22) For any historical traffic volume, determine the pressure ratio of the historical traffic volume relative to the reference traffic volume under each transmission path according to the historical traffic volume, the reference traffic volume, and the range of the unit transmission times when different transmission paths are selected for the historical service;
[0166] (23) Construct a path selection relationship table according to each historical traffic volume, the corresponding transmission paths, and the corresponding pressure ratios.
[0167] (3) Determine the minimum pressure ratio from each pressure ratio;
[0168] (4) Determine the transmission path corresponding to the minimum pressure ratio as the optional transmission path; the optional transmission path includes multiple path nodes for the target service to be transmitted from the remote node to the target disk;
[0169] (5) According to a preset node selection strategy, adjust the path nodes in the optional transmission path to determine the target transmission path of the target service, including:
[0170] (6) Determine multiple groups of target path nodes in the optional transmission paths according to the adjustment priorities of each path node; each group of target path nodes includes at least one path node;
[0171] (7) For any group of target path nodes, adjust the target path nodes in the optional transmission paths according to the selection strategy of each path node to obtain candidate transmission paths; wherein, the selection strategy of each path node is determined according to at least one of the service type of the target service, the operation cost and resource attributes of each path node, and the pressure ratio of the optional transmission paths;
[0172] (8) Obtain the pressure ratios of each candidate transmission path;
[0173] (9) Determine the candidate transmission path corresponding to the minimum pressure ratio as the target transmission path;
[0174] (10) Transmit the target service to the target disk according to the target transmission path.
[0175] The execution processes of the above (1) to (10) can specifically refer to the descriptions of the above embodiments. Their implementation principles and technical effects are similar, and will not be elaborated here.
[0176] It should be understood that although each step in the flowcharts involved in the above embodiments is displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless there is a clear description in this article, the execution of these steps has no strict order limit, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above embodiments may include multiple steps or multiple stages. These steps or stages are not necessarily executed at the same moment, but can be executed at different moments. The execution order of these steps or stages is not necessarily sequential, but can be executed alternately or in turn with at least a part of other steps or steps or stages in other steps.
[0177] Based on the same inventive concept, the embodiments of the present application also provide a service transmission device for implementing the service transmission method involved above. The implementation solutions provided by this device to solve problems are similar to the implementation solutions recorded in the above method. Therefore, the specific limitations in one or more embodiments of the service transmission device provided below can refer to the limitations on the service transmission method in the above text, and will not be elaborated here.
[0178] In one embodiment, Figure 10 is a schematic structural diagram of the service transmission device in an embodiment of the present application. The service transmission device provided by the embodiment of the present application can be applied to a proximal processor. As Figure 10As shown in the figure, the service transmission device according to the embodiment of the present application may include: a transmission path acquisition module 11, a path adjustment module 12, and a service transmission module 13, where:
[0179] The transmission path acquisition module 11 is configured to acquire optional transmission paths for the target service; the optional transmission paths include multiple path nodes for the target service to be transmitted from a remote node to the target disk;
[0180] The path adjustment module 12 is configured to adjust the path nodes in the optional transmission paths according to a preset node selection strategy to determine the target transmission path for the target service;
[0181] The service transmission module 13 is configured to transmit the target service to the target disk according to the target transmission path.
[0182] The service transmission device provided by the embodiment of the present application can be used to execute the technical solutions in the above-mentioned service transmission method embodiments of the present application. The implementation principles and technical effects are similar and will not be elaborated here.
[0183] In one embodiment, the transmission path acquisition module 11 includes: a traffic acquisition unit and an initial path determination unit, where:
[0184] The traffic acquisition unit is configured to acquire the traffic of the target service;
[0185] The pressure ratio acquisition subunit is configured to acquire multiple pressure ratios corresponding to the traffic from a pre-constructed path selection relationship table; the path selection relationship table includes the corresponding relationships between different transmission paths, the pressure ratios of different transmission paths, and different traffic volumes;
[0186] The initial path determination subunit is configured to determine the optional transmission paths according to each pressure ratio and the transmission path corresponding to each pressure ratio.
[0187] The service transmission device provided by the embodiment of the present application can be used to execute the technical solutions in the above-mentioned service transmission method embodiments of the present application. The implementation principles and technical effects are similar and will not be elaborated here.
[0188] In one embodiment, the initial path determination subunit is specifically configured to:
[0189] Determine the minimum pressure ratio from each pressure ratio;
[0190] Determine the transmission path corresponding to the minimum pressure ratio as the optional transmission path.
[0191] The service transmission device provided by the embodiment of the present application can be used to execute the technical solutions in the above-mentioned service transmission method embodiments of the present application. The implementation principles and technical effects are similar and will not be elaborated here.
[0192] In one embodiment, the transmission path acquisition module 11 further includes: a relationship table creation unit, where the relationship table creation unit is specifically configured to:
[0193] Obtain the historical traffic volume and reference traffic volume of different historical services;
[0194] For any historical traffic volume, determine the pressure ratio of the historical traffic volume relative to the reference traffic volume under each transmission path according to the range of the unit transmission times when different transmission paths are selected based on the historical traffic volume, the reference traffic volume, and the historical service;
[0195] Construct a path selection relationship table according to each historical traffic volume, the corresponding transmission paths, and the corresponding pressure ratios.
[0196] The service transmission device provided by the embodiment of the present application can be used to execute the technical solutions in the above-mentioned service transmission method embodiments of the present application. The implementation principles and technical effects are similar and will not be elaborated here.
[0197] In one embodiment, the path adjustment module 12 includes: a path adjustment unit and a path selection unit, where:
[0198] The path adjustment unit is configured to adjust at least one path node in the optional transmission paths according to the adjustment priority of each path node and the node selection strategy to obtain multiple candidate transmission paths;
[0199] The path selection unit is configured to select the target transmission path of the target service from the multiple candidate transmission paths.
[0200] The service transmission device provided by the embodiment of the present application can be used to execute the technical solutions in the above-mentioned service transmission method embodiments of the present application. The implementation principles and technical effects are similar and will not be elaborated here.
[0201] In one embodiment, the node selection strategy includes the selection strategies of each path node; the path adjustment unit is specifically configured to:
[0202] Determine multiple groups of target path nodes in the optional transmission paths according to the adjustment priority of each path node; each group of target path nodes includes at least one path node;
[0203] For any group of target path nodes, adjust the target path nodes in the optional transmission paths according to the selection strategies of each path node to obtain candidate transmission paths; where the selection strategy of each path node is determined according to at least one of the service type of the target service, the operation cost and resource attributes of each path node, and the pressure ratio of the optional transmission paths;
[0204] The service transmission device provided by the embodiment of the present application can be used to execute the technical solutions in the above-mentioned service transmission method embodiments of the present application. The implementation principles and technical effects are similar, and will not be elaborated here.
[0205] In one embodiment, the path selection unit is specifically configured to:
[0206] Obtain the pressure ratios of each candidate transmission path;
[0207] Determine the candidate transmission path corresponding to the minimum pressure ratio as the target transmission path.
[0208] The service transmission device provided by the embodiment of the present application can be used to execute the technical solutions in the above-mentioned service transmission method embodiments of the present application. The implementation principles and technical effects are similar, and will not be elaborated here.
[0209] For the specific limitations of the service transmission device, reference can be made to the limitations on the service transmission method in the above text, which will not be elaborated here. Each module in the above service transmission device can be implemented in whole or in part by software, hardware, and their combination. The above-mentioned modules can be embedded in the processor of the computer device in hardware form or be independent of it, or can be stored in the memory of the computer device in software form, so that the processor can call and execute the operations corresponding to the above-mentioned modules.
[0210] In one embodiment, a computer device is provided. The computer device can be a server, and its internal structure diagram can be as Figure 11 shown. The computer device includes a processor, a memory, and a network interface connected through a system bus. Among them, the processor of the computer device is used to provide processing capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store the target service and path selection relationship table. The network interface of the computer device is used to communicate with an external endpoint through a network connection. When the computer program is executed by the processor, a service transmission method is implemented.
[0211] Those skilled in the art can understand that Figure 11 the structure shown in
[0212] In one embodiment, a computer device is further provided, which includes a memory and a processor. A computer program is stored in the memory. When the processor executes the computer program, the technical solutions in the above-mentioned embodiments of the service transmission method of the present application are implemented. The implementation principle and technical effects are similar, and will not be described in detail here.
[0213] In one embodiment, a computer-readable storage medium is further provided, on which a computer program is stored. When the computer program is executed by a processor, the technical solutions of the above-mentioned service transmission method of the present application are implemented. The implementation principle and technical effects are similar, and will not be described in detail here.
[0214] In one embodiment, a computer program product is further provided, which includes a computer program. When the computer program is executed by a processor, the technical solutions of the above-mentioned service transmission method of the present application are implemented. The implementation principle and technical effects are similar, and will not be described in detail here.
[0215] Those of ordinary skill in the art can understand that all or part of the processes of implementing the methods in the above embodiments can be completed by instructing relevant hardware through a computer program. The computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it may include the processes of the above embodiments of the respective methods. Among them, any reference to a memory, storage, database, or other medium used in the various embodiments provided by the present application may include at least one of non-volatile and volatile memories. Non-volatile memory may include read-only memory (ROM), magnetic tape, floppy disk, flash memory, or optical memory, etc. Volatile memory may include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM), etc.
[0216] The technical features of the above embodiments can be combined arbitrarily. For the sake of brevity of description, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, it should be considered as the scope recorded in this specification.
[0217] The above-described embodiments merely represent several implementation manners of the present application. The description thereof is relatively specific and detailed, but it should not be construed as a limitation on the scope of the invention patent. It should be noted that for those of ordinary skill in the art, without departing from the concept of the present application, several modifications and improvements can still be made, and these all fall within the protection scope of the present application. Therefore, the protection scope of the patent of the present application shall be subject to the appended claims.
Claims
1. A service transmission method, characterized in that, The method includes: Obtaining optional transmission paths for a target service; the optional transmission paths include multiple path nodes for the target service to be transmitted from a node to a target disk; Adjusting the path nodes in the optional transmission paths according to a preset node selection policy to determine a target transmission path for the target service; Transmitting the target service to the target disk according to the target transmission path.
2. The method according to claim 1, wherein The obtaining of the optional transmission paths for the target service includes: Obtaining the traffic volume of the target service; Obtaining multiple pressure ratios corresponding to the traffic volume from a pre-constructed path selection relationship table; the path selection relationship table includes the correspondence between different transmission paths, the pressure ratios of different transmission paths, and different traffic volumes; Determining the optional transmission paths according to each of the pressure ratios and the transmission paths corresponding to each of the pressure ratios.
3. The method according to claim 2, wherein The determining of the optional transmission paths according to each of the pressure ratios and the transmission paths corresponding to each of the pressure ratios includes: Determining the minimum pressure ratio from each of the pressure ratios; Determining the transmission path corresponding to the minimum pressure ratio as the optional transmission path; Correspondingly, the construction process of the above path selection relationship table includes: Obtaining the historical traffic volume and reference traffic volume of different historical services; For any historical traffic volume, determining the pressure ratio of the historical traffic volume relative to the reference traffic volume under each of the transmission paths according to the historical traffic volume, the reference traffic volume, and the range of the unit transmission times when the historical service selects different transmission paths for transmission; Constructing the path selection relationship table according to each of the historical traffic volumes, the corresponding transmission paths, and the corresponding pressure ratios.
4. The method according to any one of claims 1 to 3, characterized in that, The adjusting of the path nodes in the optional transmission paths according to a preset node selection policy to determine a target transmission path for the target service includes: Adjusting at least one path node in the optional transmission paths according to the adjustment priority of each of the path nodes and the node selection policy to obtain multiple candidate transmission paths; Selecting a target transmission path for the target service from the multiple candidate transmission paths.
5. The method according to claim 4, characterized in that, The node selection policy includes the selection policy for each of the path nodes; the adjusting of at least one path node in the optional transmission paths according to the adjustment priority of each of the path nodes and the node selection policy to obtain multiple candidate transmission paths includes: Determining multiple groups of target path nodes in the optional transmission paths according to the adjustment priority of each of the path nodes; each group of the target path nodes includes at least one path node; For any group of target path nodes, adjusting the target path nodes in the optional transmission paths according to the selection policy of each of the path nodes to obtain the candidate transmission paths.
6. The method according to claim 5, characterized in that The selection policy for each of the path nodes is determined according to at least one of the service type of the target service, the operation cost and resource attributes of each of the path nodes, and the pressure ratio of the optional transmission path.
7. The method according to claim 4, wherein The selecting of a target transmission path for the target service from the multiple candidate transmission paths includes: Obtain the pressure ratio of each of the candidate transmission paths; Determine the candidate transmission path corresponding to the minimum pressure ratio as the target transmission path.
8. A service transmission device, characterized in that, The device includes: A transmission path acquisition module, configured to acquire alternative transmission paths for a target service; the alternative transmission paths include a plurality of path nodes for the target service to be transmitted from a remote node to a target disk; A path adjustment module, configured to adjust the path nodes in the alternative transmission paths according to a preset node selection policy to determine the target transmission path of the target service; A service transmission module, configured to transmit the target service to the target disk according to the target transmission path.
9. A computer device, comprising a memory and a processor, the memory storing a computer program, characterized in that, When the processor executes the computer program, it implements the steps of the method according to any one of claims 1-7.
10. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1-7.
11. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1-7.