Transmission test method and device, electronic equipment and storage medium
By installing a transmission test module that supports the visual network protocol in the computing power center equipment, the visual network server realizes data transmission between different computing power center equipment, and by monitoring the read and write status and network traffic, the problem of lack of effective testing methods in the existing technology is solved, and the efficiency of massive data transmission efficiency is achieved.
Patent Information
- Application Number
- CN202411610490.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-12
- Publication Date
- 2025-03-11
AI Technical Summary
In current computing power applications, there is a problem of transferring massive amounts of data from users to computing power centers. The existing technology lacks effective testing methods to verify whether the data transmission between computing power centers in different regions can meet the needs of fast transmission through visual networking.
Install a transmission test module that supports the visual network protocol in the computing power center equipment, and realize data transmission between the devices of different computing power centers through the visual network server. During the data transmission process, the transmission test module monitors the read and write status of the device and network traffic to achieve testing of data transmission efficiency.
This method can effectively test whether the data transmission between off-site computing power centers can be met when visual networking is realized, and a suitable testing solution can be provided.
Smart Images

Figure CN119603204A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of communication technology, and in particular to a transmission test method, device, electronic equipment and storage medium. Background Art
[0002] In recent years, with the vigorous development of artificial intelligence (AI) models, the era of intelligent computing has arrived. The impact of computing power on the digital economy has become increasingly critical. Among them, East-West computing is an important means to promote computing power and data circulation and activate the vitality of the digital economy.
[0003] At present, the "East Data West Computing" project has proposed the idea of connecting computing power to the network and realizing the coordinated work of computing power in different places and the network. However, the current computing power application encounters the problem of transmitting massive data from users to the computing power center. For example, because the dedicated line is too expensive and the public Internet is too slow, express hard disk becomes the best solution, but users have to endure the low data transmission timeliness.
[0004] In order to solve the above-mentioned problem of transmitting massive data between remote computing centers, it is currently proposed to realize data transmission between remote computing centers through visual networking. However, whether this solution can meet the demand of quickly transmitting massive data to the computing center, there is currently no suitable test method. Summary of the invention
[0005] The embodiments of the present application provide a transmission test method, device, electronic device and storage medium to implement transmission testing when data is transmitted between computing centers in different locations through a visual network.
[0006] In a first aspect, an embodiment of the present application provides a transmission test method, which is applied to a first device of a first computing center, wherein the first device is communicatively connected to a visual networking server via a first network interface, and the first device is installed with a first transmission test module, and the first transmission test module supports a visual networking protocol;
[0007] The method comprises:
[0008] Receiving a data request from a second device in a second computing center, wherein the data request is used to request to read the first data;
[0009] Reading the first data from a local storage module of the first device, and monitoring the read and write status of the local storage module of the first device through the first transmission test module during the process of reading the first data;
[0010] The first data is sent to the visual network server through the first network interface, so that the visual network server sends the first data to the second device, and in the process of sending the first data, the traffic of the first network interface is monitored through the first transmission test module.
[0011] In a second aspect, an embodiment of the present application provides a transmission test method, which is applied to a second device of a second computing center, wherein the second device is communicatively connected to a visual networking server via a second network interface, and the second device is installed with a second transmission test module, and the second transmission test module supports a visual networking protocol;
[0012] The method comprises:
[0013] Sending a data request, wherein the data request is used to request to read first data of a first device in a first computing center;
[0014] Receiving the first data sent by the visual network server through the second network interface, and in the process of receiving the first data, monitoring the traffic of the second network interface through the second transmission test module;
[0015] The received first data is stored in a local storage module of the second device, and during the process of storing the first data, the read and write status of the local storage module of the second device is monitored through the second transmission test module.
[0016] In a third aspect, an embodiment of the present application provides a transmission test device, which is applied to a first device of a first computing center, the first device is communicatively connected to a visual networking server through a first network interface, the first device is installed with a first transmission test module, and the first transmission test module supports a visual networking protocol;
[0017] The device comprises:
[0018] A first receiving module, configured to receive a data request from a second device in a second computing center, wherein the data request is used to request to read the first data;
[0019] A first processing module is used to read the first data from the local storage module of the first device, and monitor the read and write status of the local storage module of the first device through the first transmission test module during the process of reading the first data;
[0020] The second processing module is used to send the first data to the visual network server through the first network interface, so that the visual network server sends the first data to the second device, and in the process of sending the first data, monitors the traffic of the first network interface through the first transmission test module.
[0021] In a fourth aspect, an embodiment of the present application provides a transmission test device, which is applied to a second device of a second computing center, the second device is communicatively connected to a visual networking server via a second network interface, the second device is installed with a second transmission test module, and the second transmission test module supports a visual networking protocol;
[0022] The device comprises:
[0023] A first sending module, used to send a data request, wherein the data request is used to request to read first data of a first device in a first computing center;
[0024] A third processing module is used to receive the first data sent by the visual network server through the second network interface, and monitor the traffic of the second network interface through the second transmission test module during the process of receiving the first data;
[0025] The fourth processing module is used to store the received first data into the local storage module of the second device, and during the process of storing the first data, monitor the read and write status of the local storage module of the second device through the second transmission test module.
[0026] In a fifth aspect, an embodiment of the present application provides an electronic device, including:
[0027] one or more processors; and
[0028] One or more machine-readable media having instructions stored thereon, when executed by the one or more processors, enable the electronic device to execute the transmission test method described in the first aspect above, or execute the transmission test method described in the second aspect above.
[0029] In a sixth aspect, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program that enables a processor to execute the transmission test method described in the first aspect above, or execute the transmission test method described in the second aspect above.
[0030] In some embodiments of the present application, a first device of a first computing power center is communicatively connected to a visual network server via a first network interface, and the first device is installed with a first transmission test module, which supports a visual network protocol; wherein the first device is capable of receiving a data request from a second device of a second computing power center, and the data request is used to request to read the first data, thereby reading the first data from a local storage module of the first device, and in the process of reading the first data, monitoring the read and write status of the local storage module of the first device through the first transmission test module; and then sending the first data to the visual network server through the first network interface, so that the visual network server sends the first data to the second device, and in the process of sending the first data, monitoring the traffic of the first network interface through the first transmission test module.
[0031] It can be seen that in some embodiments of the present application, a transmission test module supporting the visual networking protocol can be installed in the equipment of the computing power center, and the equipment of the computing power center can be connected to the visual network, so that data transmission between devices in different computing power centers can be realized through the visual network server, and during the data transmission process, the read-write status and traffic can be monitored through the transmission test module supporting the visual network protocol to realize the transmission test when the data transmission between remote computing power centers is realized through the visual network. Among them, the above-mentioned read-write status and traffic monitored can indicate whether the demand for rapid transmission of massive data to the computing power center can be met when the data transmission between remote computing power centers is realized through the visual network. Therefore, an embodiment of the present application provides a transmission test solution when the data transmission between remote computing power centers is realized through the visual network. BRIEF DESCRIPTION OF THE DRAWINGS
[0032] Figure 1 is a flow chart of the steps of a transmission test method of the present application;
[0033] Figure 2 is a flow chart of steps of another transmission test method of the present application;
[0034] Figure 3 It is one of the schematic diagrams of a specific implementation of the transmission test method of an embodiment of the present application;
[0035] Figure 4 This is a second schematic diagram of a specific implementation of the transmission test method of an embodiment of the present application;
[0036] Figure 5 is a schematic diagram of the results of a transmission test on the test computer 1 in an embodiment of the present application;
[0037] Figure 6 is a schematic diagram of the result of the transmission test on the test computer 3 in the embodiment of the present application;
[0038] Figure 7 is a structural block diagram of a transmission test device of the present application;
[0039] Figure 8 It is a structural block diagram of another transmission test device of the present application. DETAILED DESCRIPTION
[0040] In order to make the above-mentioned objects, features and advantages of the present application more obvious and easy to understand, the present application is further described in detail below in conjunction with the accompanying drawings and specific implementation methods.
[0041] In the prior art, it is proposed to realize data transmission between remote computing centers through visual networking. However, whether this solution can meet the demand of quickly transmitting massive data to the computing center has not been given a suitable test method.
[0042] In some embodiments of the present application, a transmission test module that supports the visual networking protocol can be installed in the equipment of the computing power center, and the equipment of the computing power center can be connected to the visual network, so that data transmission between devices in different computing power centers can be achieved through the visual network server, and during the data transmission process, the read and write status and traffic can be monitored through the transmission test module that supports the visual network protocol to achieve transmission testing when data transmission between remote computing power centers is achieved through the visual network. Among them, the above-mentioned read and write status and traffic monitored can indicate whether the demand for rapid transmission of massive data to the computing power center can be met when data transmission between remote computing power centers is achieved through the visual network. Therefore, an embodiment of the present application provides a transmission test solution when data transmission between remote computing power centers is achieved through the visual network.
[0043] The transmission test method of the embodiment of the present application is described in detail below.
[0044] First, as Figure 1 As shown, an embodiment of the present application provides a transmission test method, which is applied to a first device of a first computing center, wherein the first device is connected to a visual network server through a first network interface, and the first device is installed with a first transmission test module, and the first transmission test module supports a visual network protocol; the method may include the following steps 101 to 103:
[0045] Step 101: Receive a data request from a second device in a second computing center.
[0046] The data request is used to request to read the first data.
[0047] In addition, in some embodiments of the present application, the second device of the second computing center is connected to the visual network server through the second network interface. It can be understood that the visual network server connected to the first device and the visual network server connected to the second device can be the same visual network server; or, they can also be different visual network servers. In this case, there can be other visual network servers between the two. For example, the visual network server connected to the first device is visual network server-A, and the visual network server connected to the second device is visual network server-B. There can also be a visual network server-C between visual network server-A and visual network server-B.
[0048] That is, in some embodiments of the present application, data transmission is achieved between the devices of the first computing center and the devices of the second computing center through a visual network server.
[0049] Optionally, the first network interface of the first device is configured with at least one first network card, and the first device can be communicatively connected to the visual network server through the first network card (ie, access the visual network).
[0050] Similarly, optionally, the second network interface of the second device is configured with at least one second network card, and the second device can be communicatively connected to the visual network server through the second network card (ie, access the visual network).
[0051] Among them, at least part of the first network card can support hundreds of Gigabyte (GB) data volume, and at least part of the second network card can support hundreds of G data volume, so that the visual network can realize the transmission of hundreds of G data volume between the first device and the second device.
[0052] Then in step 101, the first device may receive the above data request sent by the second device of the second computing center through the visual network server to which it is connected.
[0053] In addition, it can be seen from the above that in some embodiments of the present application, the visual network is used as the underlying link load medium for transmitting massive data. However, the current file transfer test tools (for example: File Transfer Protocol (FTP), Trivial File Transfer Protocol (TFTP), Network File System (NFS)) are all based on Transmission Control Protocol (TCP) / Internet Protocol (IP), and cannot be used for file transfer testing in visual networks.
[0054] In some embodiments of the present application, a transmission test module supporting the visual networking protocol is installed in the equipment of the computing center, so that the transmission test in the visual networking can be realized. For example, the transmission test module can be a V-NC module. Among them, the V-NC module is a network file transmission test tool built based on the visual networking (v2v) protocol stack.
[0055] It can be understood that the above-mentioned data request can carry the address information of the first data, wherein the address information is used to indicate the address information of the device that stores or can provide the first data. In this way, after the second device of the second computing center requesting the first data sends the data request to the visual network server to which the second device is communicatively connected, the visual network server can know which device to forward the data request to.
[0056] Step 102: Read the first data from the local storage module of the first device, and in the process of reading the first data, monitor the read and write status of the local storage module of the first device through the first transmission test module.
[0057] Among them, the read and write status of the local storage module of the first device can reflect the read and write capability. In the embodiment of the present application, the read and write capability of the local read and write module of the first device can be learned by monitoring the read and write status of the local storage module of the first device through the first transmission test module, so as to detect whether the transmission requirements of the user can be met when the data transmission between the remote computing centers is realized through the visual network. For example, it can be known whether the read and write capability of the local storage module can reach 12GiB / s.
[0058] In addition, optionally, the local storage module of the first device supports a PCI interface and uses a solid-state hard disk array, thereby improving the read and write capabilities of the local storage module.
[0059] Step 103: Send the first data to the visual network server through the first network interface, so that the visual network server sends the first data to the second device, and in the process of sending the first data, monitor the traffic of the first network interface through the first transmission test module.
[0060] Among them, traffic is a unit for measuring the amount of data transmission, usually expressed in bytes. In network communication, traffic is used to indicate the speed of data transmission or the amount of data transmission. In some embodiments of the present application, by monitoring the traffic of the first network interface through the first transmission test module, it can be known whether the traffic of the first network interface can meet the transmission needs of the user.
[0061] It can be seen from the above steps 101 to 103 that in some embodiments of the present application, the first device of the first computing power center is communicatively connected to the visual network server through the first network interface, and the first device is installed with a first transmission test module, and the first transmission test module supports the visual network protocol; wherein the first device is capable of receiving a data request from the second device of the second computing power center, and the data request is used to request to read the first data, thereby reading the first data from the local storage module of the first device, and in the process of reading the first data, monitoring the read and write status of the local storage module of the first device through the first transmission test module; and then sending the first data to the visual network server through the first network interface, so that the visual network server sends the first data to the second device, and in the process of sending the first data, monitoring the traffic of the first network interface through the first transmission test module.
[0062] It can be seen that in some embodiments of the present application, a transmission test module supporting the visual networking protocol can be installed in the equipment of the computing power center, and the equipment of the computing power center can be connected to the visual network, so that data transmission between devices in different computing power centers can be realized through the visual network server, and during the data transmission process, the read-write status and traffic can be monitored through the transmission test module supporting the visual network protocol to realize the transmission test when the data transmission between remote computing power centers is realized through the visual network. Among them, the above-mentioned read-write status and traffic monitored can indicate whether the demand for rapid transmission of massive data to the computing power center can be met when the data transmission between remote computing power centers is realized through the visual network. Therefore, an embodiment of the present application provides a transmission test solution when the data transmission between remote computing power centers is realized through the visual network.
[0063] Optionally, the method further comprises:
[0064] The transmission time of the first data and the data volume of the first data are acquired through the first transmission test module.
[0065] It can be seen from this that the first transmission test module can also obtain the transmission time and data volume of the first data, so that the transmission performance of the first data can be learned from the transmission time and data volume of the first data.
[0066] Optionally, a first VPN module and at least one first network card corresponding to the first network interface are installed on the first device, a second VPN module and at least one second network card are installed on the second device, and VPN represents a virtual private network;
[0067] In the above step 103, sending the first data to the visual network server through the first network interface so that the visual network server sends the first data to the second device includes the following steps D-1 to D-2:
[0068] Step D-1: Bind the first VPN module to the third network card to establish a first VPN channel, wherein the first VPN channel is a channel between the first VPN module, the third network card, the visual network server, the fourth network card, and the second VPN module, the third network card is a network card among the at least one first network card that supports the data volume of the first data, and the fourth network card is a network card among the at least one second network card that supports the data volume of the first data;
[0069] Step D-2: Send the first data to the first VPN channel, so that the first data is transmitted to the second VPN module of the second device.
[0070] It should be noted that the VPN module is used to establish a virtual video network VPN channel between devices. The video network VPN channel refers to: the video network VPN transmission channel established by the video network fusion router based on the video network transmission technology.
[0071] The at least one first network card corresponding to the first network interface can be understood as: the first network interface of the first device is communicated with the visual network server through the first network card; or, it can also be understood as: a first network card can serve as a first network interface of the first device.
[0072] It can be seen that in some embodiments of the present application, a VPN module can also be installed on the equipment of the computing power center, and at least one network card can be configured on the network interface, so that the visual network can be accessed through the at least one network card. In this way, VPN channels can be established between devices in different computing power centers through VPN modules, network cards, and visual networks.
[0073] Among them, it can be known from the above steps D-1 to D-2 that when the second device requests the first data from the first device, the first device can bind the third network card of at least one first network card corresponding to the first network interface that supports the data volume of the first data to the first VPN module installed thereon, and the second device can bind the fourth network card of at least one second network card corresponding to the second network interface that supports the data volume of the first data to the second VPN module installed thereon; and, as mentioned above, the first device is connected to the visual network server through the first network interface, and the second device is connected to the visual network server through the second network interface, so after the above binding process, the above first VPN channel (i.e., the channel between the first VPN module, the third network card, the visual network server, the fourth network card, and the second VPN module) can be established. In this way, the data between the first device and the second device can be transmitted through the first VPN channel.
[0074] It can be seen from this that in some embodiments of the present application, a VPN module for establishing a VPN channel and a network card for accessing the visual network can be installed on the equipment in the computing power center, so that data between devices in different computing power centers can be transmitted through the visual network.
[0075] In addition, after establishing the above-mentioned first VPN channel, the first VPN module of the first device can read the first data stored in the local storage module of the first device, and then send the read data to the third network card on the first VPN channel, so that the third network card sends it to the visual network server, and then the visual network server sends it to the fourth network card of the second device, and then the fourth network card sends it to the second VPN module. In this way, the second VPN module can store the received data in the local storage module of the second device.
[0076] Optionally, a first visual networking protocol module is also installed on the first device. Before the above step 101 receives a data request from a second device in a second computing center, the method further includes the following steps E-1 to E-3:
[0077] Step E-1: Generate a first visual networking protocol address of the first VPN module through the first visual networking protocol module;
[0078] Step E-2: registering the first visual network protocol address in the visual network server;
[0079] Step E-3: receiving the video network number of the first VPN module sent by the video network server;
[0080] In the above step D-1, binding the first VPN module to the third network card includes:
[0081] Bind the visual network number of the first VPN module to the third network card.
[0082] It can be seen that the visual networking protocol module (i.e., the v2v protocol module) supports the visual networking protocol and is used to generate a visual networking address for the VPN module, so as to register it in the visual networking server, so that the visual networking server generates a visual networking number for the VPN module to identify the VPN module. In this way, when the VPN module is bound to the corresponding network card, the visual networking number of the VPN module can be bound to the corresponding network card, so that when the first device sends data to the second device, it can be determined based on the binding relationship to which network card the first VPN module transmits the data so that the data can be transmitted to the second device.
[0083] Optionally, the first VPN module and the second VPN module are in an enabled state by default, so that if a breakpoint occurs during data transmission between the first device and the second device through the first VPN channel, the transmission can be resumed.
[0084] Optionally, the first transmission test module can start at least one thread, one of which is bound to a transmission process on the first VPN channel, that is, one thread is used to monitor a transmission process on the first VPN channel; it should be noted that the transmission process described here can be understood as a data transmission process between an application on the first device and an application on the second device. For example, client-1 and client-2 are installed on the first device, server-1 and server-2 are installed on the second device, the data transmission between client-1 and server-1 is a transmission process, the data transmission between client-2 and server-2 is a transmission process, and the data transmission between them can use the first VPN channel, and each transmission process is monitored by one thread.
[0085] It can be seen that in some embodiments of the present application, parallel transmission can be achieved on a VPN channel, so that large files can be processed efficiently; and in a parallel transmission scenario, multiple threads of the transmission test module can be used for parallel monitoring.
[0086] Second, as Figure 2 As shown, an embodiment of the present application provides a transmission test method, which is applied to a second device of a second computing center, the second device is connected to a visual networking server through a second network interface, and the second device is installed with a second transmission test module, and the second transmission test module supports a visual networking protocol;
[0087] Step 201: Send a data request.
[0088] The data request is used to request to read the first data of the first device of the first computing center.
[0089] In addition, in some embodiments of the present application, the first device of the first computing center is connected to the visual network server through the first network interface. It can be understood that the visual network server connected to the first device and the visual network server connected to the second device can be the same visual network server; or, they can also be different visual network servers. In this case, there can be other visual network servers between the two. For example, the visual network server connected to the first device is visual network server-A, and the visual network server connected to the second device is visual network server-B. There can also be a visual network server-C between visual network server-A and visual network server-B.
[0090] That is, in some embodiments of the present application, data transmission is achieved between the devices of the first computing center and the devices of the second computing center through a visual network server.
[0091] Optionally, the second network interface of the second device is configured with at least one second network card, and the second device can be communicatively connected to the visual network server through the second network card (ie, access the visual network).
[0092] Similarly, optionally, the first network interface of the first device is configured with at least one first network card, and the first device can be communicatively connected to the visual network server through the first network card (ie, access the visual network).
[0093] Among them, at least part of the first network card can support hundreds of G data volume, and at least part of the second network card can support hundreds of G data volume, so that the visual network can realize the transmission of hundreds of G data volume between the first device and the second device.
[0094] Then in step 201, the second device may send the above data request through the visual network server to which it is connected.
[0095] In addition, it can be seen from the above that in some embodiments of the present application, the visual network is used as the underlying link load medium for transmitting massive data. However, the current file transfer test tools (such as FTP, TFTP, NFS) are all TCP / IP and cannot be used for file transfer testing in the visual network.
[0096] In some embodiments of the present application, a transmission test module supporting the visual networking protocol is installed in the equipment of the computing center, so that the transmission test in the visual networking can be realized. For example, the transmission test module can be a V-NC module. Among them, the V-NC module is a network file transmission test tool built on the v2v protocol stack.
[0097] It can be understood that the above-mentioned data request can carry the address information of the first data, wherein the address information is used to indicate the address information of the device that stores or can provide the first data. In this way, after the second device of the second computing center requesting the first data sends the data request to the visual network server to which the second device is communicatively connected, the visual network server can know which device to forward the data request to.
[0098] Step 202: Receive the first data sent by the visual network server through the second network interface, and monitor the traffic of the second network interface through the second transmission test module during the process of receiving the first data.
[0099] Among them, flow is a unit for measuring the amount of data transmission, usually expressed in bytes. In network communication, flow is used to indicate the speed of data transmission or the amount of data transmission. In some embodiments of the present application, by monitoring the flow of the second network interface through the second transmission test module, it can be known whether the flow of the second network interface can meet the transmission needs of the user.
[0100] Step 203: Store the received first data in the local storage module of the second device, and monitor the read and write status of the local storage module of the second device through the second transmission test module during the process of storing the first data.
[0101] Among them, the read and write status of the local storage module of the second device can reflect the read and write capability. In the embodiment of the present application, the read and write capability of the local read and write module of the second device can be learned by monitoring the read and write status of the local storage module of the second device through the second transmission test module, so as to detect whether the transmission requirements of the user can be met when the data transmission between the remote computing centers is realized through the visual network. For example, it can be known whether the read and write capability of the local storage module can reach 12GiB / s.
[0102] In addition, optionally, the local storage module of the second device supports a PCI interface and uses a solid-state hard disk array, thereby improving the read and write capabilities of the local storage module.
[0103] It can be seen from the above steps 201 to 203 that in some embodiments of the present application, the second device of the second computing power center is communicatively connected to the visual network server through a second network interface, and the second device is installed with a second transmission test module, and the second transmission test module supports the visual network protocol; wherein the second device is capable of sending a data request for requesting the first data to the first device of the first computing power center, thereby receiving the first data forwarded by the visual network server to the first device through the second network interface, and in the process of receiving the first data, monitoring the traffic of the second network interface through the second transmission test module; and then storing the received data in the local storage module of the second device, and in the process of storing the first data, monitoring the read and write status of the local storage module of the second device through the second transmission test module.
[0104] It can be seen that in some embodiments of the present application, a transmission test module supporting the visual networking protocol can be installed in the equipment of the computing power center, and the equipment of the computing power center can be connected to the visual network, so that data transmission between devices in different computing power centers can be realized through the visual network server, and during the data transmission process, the read-write status and traffic can be monitored through the transmission test module supporting the visual network protocol to realize the transmission test when the data transmission between remote computing power centers is realized through the visual network. Among them, the above-mentioned read-write status and traffic monitored can indicate whether the demand for rapid transmission of massive data to the computing power center can be met when the data transmission between remote computing power centers is realized through the visual network. Therefore, an embodiment of the present application provides a transmission test solution when the data transmission between remote computing power centers is realized through the visual network.
[0105] Optionally, the method further comprises:
[0106] The transmission time of the first data and the data volume of the first data are obtained through the second transmission test module.
[0107] It can be seen from this that the second transmission test module can also obtain the transmission time and data volume of the first data, so that the transmission performance of the first data can be learned from the transmission time and data volume of the first data.
[0108] Optionally, a second VPN module and at least one second network card corresponding to the second network interface are installed on the second device, a first VPN module and at least one first network card are installed on the first device, and VPN represents a virtual private network;
[0109] In the above step 202, receiving the first data sent by the visual network server through the second network interface includes the following steps F-1 to F-2:
[0110] Step F-1: Bind the second VPN module to the fourth network card to establish a first VPN channel, wherein the first VPN channel is a channel between the first VPN module, the third network card, the visual network server, the fourth network card, and the second VPN module, the third network card is a network card among the at least one first network card that supports the data volume of the first data, and the fourth network card is a network card among the at least one second network card that supports the data volume of the first data;
[0111] Step F-2: Receive the first data sent by the visual network server through the first VPN channel.
[0112] It should be noted that the VPN module is used to establish a virtual visual network VPN channel between devices. The at least one second network card corresponding to the second network interface can be understood as: the second network interface of the second device is connected to the visual network server through the second network card; or, it can also be understood as: a second network card can be used as a second network interface of the second device.
[0113] It can be seen that in some embodiments of the present application, a VPN module can also be installed on the equipment of the computing power center, and at least one network card can be configured on the network interface, so that the visual network can be accessed through the at least one network card. In this way, VPN channels can be established between devices in different computing power centers through VPN modules, network cards, and visual networks.
[0114] Among them, it can be known from the above steps F-1 to F-2 that when the second device requests the first data from the first device, the first device can bind the third network card of at least one first network card corresponding to the first network interface that supports the data volume of the first data to the first VPN module installed thereon, and the second device can bind the fourth network card of at least one second network card corresponding to the second network interface that supports the data volume of the first data to the second VPN module installed thereon; and, as mentioned above, the first device is connected to the visual network server through the first network interface, and the second device is connected to the visual network server through the second network interface, so after the above binding process, the above first VPN channel (i.e., the channel between the first VPN module, the third network card, the visual network server, the fourth network card, and the second VPN module) can be established. In this way, the data between the first device and the second device can be transmitted through the first VPN channel.
[0115] It can be seen from this that in some embodiments of the present application, a VPN module for establishing a VPN channel and a network card for accessing the visual network can be installed on the equipment in the computing power center, so that data between devices in different computing power centers can be transmitted through the visual network.
[0116] In addition, after establishing the above-mentioned first VPN channel, the first VPN module of the first device can read the first data stored in the local storage module of the first device, and then send the read data to the third network card on the first VPN channel, so that the third network card sends it to the visual network server, and then the visual network server sends it to the fourth network card of the second device, and then the fourth network card sends it to the second VPN module. In this way, the second VPN module can store the received data in the local storage module of the second device.
[0117] Optionally, a second visual networking protocol module is also installed on the second device. Before sending the data request, the method further includes the following steps H-1 to H-3:
[0118] Step H-1: Generate a second visual networking protocol address of the second VPN module through the second visual networking protocol module;
[0119] Step H-2: registering the second visual network protocol address in the visual network server;
[0120] Step H-3: receiving the video network number of the second VPN module sent by the video network server;
[0121] In the above step F-1, the step of binding the second VPN module to the fourth network card includes:
[0122] Bind the visual network number of the second VPN module to the fourth network card.
[0123] It can be seen that the visual networking protocol module (i.e., v2v protocol module) supports the visual networking protocol and is used to generate a visual networking address for the VPN module, so as to register it in the visual networking server, so that the visual networking server can generate a visual networking number for the VPN module to identify the VPN module. In this way, when the VPN module is bound to the corresponding network card, the visual networking number of the VPN module can be bound to the corresponding network card, so that when the second device receives the data sent by the first device, it can be determined based on the binding relationship from which network card the second VPN module can receive the data from the first device.
[0124] Optionally, the first VPN module and the second VPN module are in an enabled state by default, so that if a breakpoint occurs during data transmission between the first device and the second device through the first VPN channel, the transmission can be resumed.
[0125] Optionally, the second transmission test module can start at least one thread, one of which is bound to a transmission process on the first VPN channel, that is, one thread is used to monitor a transmission process on the first VPN channel; it should be noted that the transmission process described here can be understood as a data transmission process between an application on the first device and an application on the second device. For example, client-1 and client-2 are installed on the first device, server-1 and server-2 are installed on the second device, the data transmission between client-1 and server-1 is a transmission process, the data transmission between client-2 and server-2 is a transmission process, and the data transmission between them can use the first VPN channel, and each transmission process is monitored by one thread.
[0126] It can be seen that in some embodiments of the present application, parallel transmission can be achieved on a VPN channel, so that large files can be processed efficiently; and in a parallel transmission scenario, multiple threads of the transmission test module can be used for parallel monitoring.
[0127] In summary, the specific implementation of the transmission test method of the embodiment of the present application can be described as follows:
[0128] 1.1 In the 100G computing power network project, in order to verify whether the v2v visual networking product can meet the user's ability to quickly transmit massive data to the computing power center, it is necessary to determine whether the following conditions are met:
[0129] (1) The network interface of the equipment in the computing center supports 100G;
[0130] (2) The local storage read and write of the computing center's equipment reaches 12GiB / s;
[0131] (3) There are physical links in the visual Internet with a bandwidth of 100G.
[0132] (4) There are file transfer testing tools that support the v2v protocol.
[0133] 1.2 In order to meet the conditions mentioned in 1.1 above, Figure 3 The following configuration is required:
[0134] (1) Hardware configuration:
[0135] Hardware configuration 01): 100G network cards are configured on the test computers in computing center 1 and computing center 2 (i.e., test computers 1, 2, 3, and 4), and are connected to the 100G visual networking environment respectively.
[0136] Hardware configuration 02): The storage medium of the test computer uses a solid-state hard disk that supports the PCI interface and is arranged in an array.
[0137] Hardware configuration 03): A set of 100G visual networking core servers are deployed in each region where the two computing centers are located to build a 100G visual networking network.
[0138] (2) Software Configuration:
[0139] Software configuration 01): Test computers 1, 2, 3, and 4 are respectively installed with V-NC file transfer test modules that support the visual networking protocol; the V-NC module is in the service-on status by default;
[0140] Software configuration 02): Install v2v protocol modules on test computers 1, 2, 3, and 4 respectively;
[0141] Software configuration 03): Test computers 1, 2, 3, and 4 are respectively installed with VPN modules, and the visual network address of the VPN module is generated through the v2v protocol module, so that the visual network address is registered in the visual network core server, and then the visual network server assigns the corresponding visual network number to the VPN module, for example, test computer 3 is assigned to visual network number 00001, and test computer 1 is assigned to visual network number 00002.
[0142] (3) Service configuration:
[0143] Service configuration 01): At the transmission level, the VPN module of each test computer is bound to its own 100G network card; at the application level, one thread of the V-NC module is bound to one transmission process.
[0144] It should be noted that the test computer may have been configured with multiple network cards, but the VPN channel used for 100G transmission requires the use of a 100G network card. Therefore, the above VPN module needs to be bound to the 100G network card.
[0145] Service configuration 02): The test computer requesting data actively establishes a visual network VPN channel with the test computer providing data;
[0146] For example, if test computer 3 requests data from test computer 1, Figure 4 As shown, a visual network VPN channel is established between test computer 3 and test computer 1: VPN module of test computer 1 - 100G network card of test computer 1 - 100G core server of visual network - 100G network card of test computer 3 - VPN module of test computer 3. When test computer 3 downloads files from test computer 1, the V-NC module of test computer 1 will actively monitor the read and write status of the device local storage and the device network card traffic; the V-NC module of test computer 3 will actively monitor the read and write status of the device local storage and the device network card traffic. In addition, the V-NC module can also monitor the data transmission time and data forwarding volume.
[0147] That is, if test computer 3 requests a 2-terabyte (T) file on test computer 1, the data flow is: the VPN module of test computer 3 initiates hard disk reading and writing, network card forwarding, the data flow passes through the physical link, and then is forwarded to the other end's physical link through the visual network 100G core and transmitted to the local hard disk of test computer 1; among them, this data forwarding process is monitored by the V-NC module from the beginning to the end and written into the test record.
[0148] Exemplarily, the test record of the test computer 1 may be as follows: Figure 5 As shown; the test record of the test computer 3 can be as follows Figure 6 shown.
[0149] It should be noted that when the V-NC module performs monitoring tests, it will collect the following Figure 5 or the data shown in 6, wherein, Figure 5 , 6 The circled data in the figure can represent the performance of the data transmission process.
[0150] To summarize, in the 100G computing power network project, this specific implementation of the present application can help to test the performance of massive file transmission in the 100G computing power system of the visual network by installing the V-NC detection device on the computing power server.
[0151] It should be noted that, for the method embodiments, for the sake of simplicity, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the embodiments of the present application are not limited by the described order of actions, because according to the embodiments of the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present application.
[0152] In a third aspect, an embodiment of the present application provides a transmission test device, which is applied to a first device of a first computing center, the first device is communicatively connected to a visual networking server through a first network interface, the first device is installed with a first transmission test module, and the first transmission test module supports a visual networking protocol;
[0153] like Figure 7 As shown, the device may include the following modules:
[0154] A first receiving module 701 is used to receive a data request from a second device in a second computing center, wherein the data request is used to request to read the first data;
[0155] A first processing module 702 is configured to read the first data from a local storage module of the first device, and monitor the read and write status of the local storage module of the first device through the first transmission test module during the process of reading the first data;
[0156] The second processing module 703 is used to send the first data to the visual network server through the first network interface, so that the visual network server sends the first data to the second device, and in the process of sending the first data, monitors the traffic of the first network interface through the first transmission test module.
[0157] Optionally, a first VPN module and at least one first network card corresponding to the first network interface are installed on the first device, a second VPN module and at least one second network card are installed on the second device, and VPN represents a virtual private network;
[0158] The second processing module 703 is specifically used for:
[0159] Binding the first VPN module to the third network card to establish a first VPN channel, wherein the first VPN channel is a channel between the first VPN module, the third network card, the visual network server, the fourth network card, and the second VPN module, the third network card is a network card among the at least one first network card that supports the data volume of the first data, and the fourth network card is a network card among the at least one second network card that supports the data volume of the first data;
[0160] The first data is sent to the first VPN channel, so that the first data is transmitted to the second VPN module of the second device.
[0161] Optionally, a first visual networking protocol module is further installed on the first device, and the apparatus further includes a fifth processing module, which is used to:
[0162] Generate a first visual networking protocol address of the first VPN module through the first visual networking protocol module;
[0163] Registering the first visual networking protocol address in the visual networking server;
[0164] Receiving the video network number of the first VPN module sent by the video network server;
[0165] The second processing module 703 binds the first VPN module to the third network card, specifically for:
[0166] Bind the visual network number of the first VPN module to the third network card.
[0167] In a fourth aspect, an embodiment of the present application provides a transmission test device, which is applied to a second device of a second computing center, the second device is communicatively connected to a visual networking server via a second network interface, the second device is installed with a second transmission test module, and the second transmission test module supports a visual networking protocol;
[0168] like Figure 8 As shown, the device comprises:
[0169] A first sending module 801 is used to send a data request, wherein the data request is used to request to read first data of a first device in a first computing center;
[0170] A third processing module 802 is used to receive the first data sent by the visual network server through the second network interface, and monitor the traffic of the second network interface through the second transmission test module during the process of receiving the first data;
[0171] The fourth processing module 803 is used to store the received first data into the local storage module of the second device, and monitor the read and write status of the local storage module of the second device through the second transmission test module during the process of storing the first data.
[0172] Optionally, a second VPN module and at least one second network card corresponding to the second network interface are installed on the second device, a first VPN module and at least one first network card are installed on the first device, and VPN represents a virtual private network;
[0173] The fourth processing module 803 is specifically used for:
[0174] Bind the second VPN module to the fourth network card to establish a first VPN channel, wherein the first VPN channel is a channel between the first VPN module, the third network card, the visual network server, the fourth network card, and the second VPN module, the third network card is a network card among the at least one first network card that supports the data volume of the first data, and the fourth network card is a network card among the at least one second network card that supports the data volume of the first data;
[0175] The first data sent by the visual network server is received through the first VPN channel.
[0176] Optionally, a second visual networking protocol module is further installed on the second device, and the apparatus further includes: a sixth processing module, which is used to:
[0177] Generate a second visual networking protocol address of the second VPN module through the second visual networking protocol module;
[0178] Registering the second visual networking protocol address in the visual networking server;
[0179] Receiving the video network number of the second VPN module sent by the video network server;
[0180] The fourth processing module 803 binds the second VPN module to the fourth network card, specifically for:
[0181] Bind the visual network number of the second VPN module to the fourth network card.
[0182] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.
[0183] In a fifth aspect, an embodiment of the present application further provides a transmission test system, comprising a first device of a first computing power center and a second device of a second computing power center;
[0184] The first device is connected to the visual networking server through a first network interface, and the first device is installed with a first transmission test module, and the first transmission test module supports the visual networking protocol;
[0185] The second device is connected to the visual networking server through a second network interface, and the second device is installed with a second transmission test module, and the second transmission test module supports the visual networking protocol;
[0186] The first device is used to execute the transmission test method described in the first aspect, and the second device is used to execute the transmission test method described in the second aspect.
[0187] In a sixth aspect, an embodiment of the present application further provides an electronic device, including:
[0188] one or more processors; and
[0189] One or more machine-readable media having instructions stored thereon, when executed by the one or more processors, enable the electronic device to execute the transmission test method described in the first aspect above, or execute the transmission test method described in the second aspect above.
[0190] In a seventh aspect, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program that enables a processor to execute the transmission test method described in the first aspect above, or execute the transmission test method described in the second aspect above.
[0191] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.
[0192] Those skilled in the art will appreciate that the embodiments of the present application can be provided as methods, devices, or computer program products. Therefore, the present application can adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application can adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
[0193] The embodiments of the present application are described with reference to the flowcharts and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing terminal device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0194] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing terminal device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device, which implements the process Figure 1A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0195] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device so that a series of operating steps are executed on the computer or other programmable terminal device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable terminal device to implement the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.
[0196] Although the preferred embodiments of the present application have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present application.
[0197] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements.
[0198] The above is a detailed introduction to a transmission test method, device, electronic device and storage medium provided by the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea; at the same time, for general technical personnel in this field, according to the idea of the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.
Claims
1. A transmission test method, characterized in that: A first device applied to a first computing center, the first device being communicatively connected to a visual networking server via a first network interface, the first device being installed with a first transmission test module, and the first transmission test module supporting a visual networking protocol; The method comprises: Receiving a data request from a second device in a second computing center, wherein the data request is used to request to read the first data; Reading the first data from a local storage module of the first device, and monitoring the read and write status of the local storage module of the first device through the first transmission test module during the process of reading the first data; The first data is sent to the visual network server through the first network interface, so that the visual network server sends the first data to the second device, and in the process of sending the first data, the traffic of the first network interface is monitored through the first transmission test module.
2. The method according to claim 1, characterized in that A first VPN module and at least one first network card corresponding to the first network interface are installed on the first device, and a second VPN module and at least one second network card are installed on the second device; The step of sending the first data to the visual network server through the first network interface so that the visual network server sends the first data to the second device includes: Binding the first VPN module to the third network card to establish a first VPN channel, wherein the first VPN channel is a channel between the first VPN module, the third network card, the visual network server, the fourth network card, and the second VPN module, the third network card is a network card among the at least one first network card that supports the data volume of the first data, and the fourth network card is a network card among the at least one second network card that supports the data volume of the first data; The first data is sent to the first VPN channel, so that the first data is transmitted to the second VPN module of the second device.
3. The method according to claim 2, characterized in that A first visual networking protocol module is also installed on the first device. Before receiving the data request from the second device of the second computing center, the method further includes: Generate a first visual networking protocol address of the first VPN module through the first visual networking protocol module; Registering the first visual networking protocol address in the visual networking server; Receiving the video network number of the first VPN module sent by the video network server; The step of binding the first VPN module to the third network card includes: Bind the visual network number of the first VPN module to the third network card.
4. A transmission test method, characterized in that: A second device applied to a second computing center, the second device being communicatively connected to a visual networking server via a second network interface, the second device being installed with a second transmission test module, and the second transmission test module supporting a visual networking protocol; The method comprises: Sending a data request, wherein the data request is used to request to read first data of a first device in a first computing center; Receiving the first data sent by the visual network server through the second network interface, and in the process of receiving the first data, monitoring the traffic of the second network interface through the second transmission test module; The received first data is stored in the local storage module of the second device, and during the process of storing the first data, the read and write status of the local storage module of the second device is monitored through the second transmission test module.
5. The method according to claim 4, characterized in that A second VPN module and at least one second network card corresponding to the second network interface are installed on the second device, and a first VPN module and at least one first network card are installed on the first device; The step of receiving, through the second network interface, the first data sent by the visual network server comprises: Bind the second VPN module to the fourth network card to establish a first VPN channel, wherein the first VPN channel is a channel between the first VPN module, the third network card, the visual network server, the fourth network card, and the second VPN module, the third network card is a network card among the at least one first network card that supports the data volume of the first data, and the fourth network card is a network card among the at least one second network card that supports the data volume of the first data; The first data sent by the visual network server is received through the first VPN channel.
6. The method according to claim 5, characterized in that A second visual networking protocol module is also installed on the second device. Before sending the data request, the method further includes: Generate a second visual networking protocol address of the second VPN module through the second visual networking protocol module; Registering the second visual networking protocol address in the visual networking server; Receiving the video network number of the second VPN module sent by the video network server; The step of binding the second VPN module to the fourth network card includes: Bind the visual network number of the second VPN module to the fourth network card.
7. A transmission test device, characterized in that: A first device applied to a first computing center, the first device being communicatively connected to a visual networking server via a first network interface, the first device being installed with a first transmission test module, and the first transmission test module supporting a visual networking protocol; The device comprises: A first receiving module, configured to receive a data request from a second device in a second computing center, wherein the data request is used to request to read the first data; A first processing module is used to read the first data from the local storage module of the first device, and monitor the read and write status of the local storage module of the first device through the first transmission test module during the process of reading the first data; The second processing module is used to send the first data to the visual network server through the first network interface, so that the visual network server sends the first data to the second device, and in the process of sending the first data, monitor the traffic of the first network interface through the first transmission test module.
8. A transmission test device, characterized in that: A second device applied to a second computing center, the second device being communicatively connected to a visual networking server via a second network interface, the second device being installed with a second transmission test module, and the second transmission test module supporting a visual networking protocol; The device comprises: A first sending module, used to send a data request, wherein the data request is used to request to read first data of a first device in a first computing center; A third processing module is used to receive the first data sent by the visual network server through the second network interface, and monitor the traffic of the second network interface through the second transmission test module during the process of receiving the first data; The fourth processing module is used to store the received first data into the local storage module of the second device, and during the process of storing the first data, monitor the read and write status of the local storage module of the second device through the second transmission test module.
9. An electronic device, characterized in that: include: one or more processors; and One or more machine-readable media having instructions stored thereon, when executed by the one or more processors, enable the electronic device to execute the transmission test method as described in any one of claims 1 to 3, or execute the transmission test method as described in any one of claims 4 to 6.
10. A computer-readable storage medium, characterized in that: The computer program stored therein enables the processor to execute the transmission test method according to any one of claims 1 to 3, or to execute the transmission test method according to any one of claims 4 to 6.