Lossless Ethernet test system for micro-service big data mixed traffic

Abstract

The invention relates to a lossless Ethernet test system for micro-service big data mixed traffic, the lossless Ethernet test system comprises a switching module, a to-be-tested module, a traffic excitation module and a gating module, the to-be-tested module is connected with the switching module and the traffic excitation module through the gating module, the to-be-tested module and the traffic excitation module are used for generating traffic, and the to-be-tested module is connected with the switching module through the gating module. According to the method, the specific network flow is generated and injected to simulate various flow modes possibly occurring in an actual application scene, so that the performance of a tested network is comprehensively evaluated, and the gating module is used for testing personnel to dynamically select different paths in the network in real time according to requirements, so that the testing of each network link and node is realized, and the testing efficiency is improved. The performance of the network under various load and flow conditions is evaluated, and the switching module is responsible for realizing data circulation and forwarding among modules in the network, supports multi-port access and flexibly adapts to test requirements. According to the invention, the stability and reliability of network transmission can be improved, and efficient and stable operation of micro-services and big data applications can be ensured.

Description

Technical Field

[0001] The present invention belongs to the field of communication equipment, and specifically relates to a lossless Ethernet network testing system for microservice and big data mixed traffic. The present invention is oriented to the mixed traffic evaluation of microservices and big data, and can perform multi-dimensional tests on the real-time performance and lossless functions of Ethernet cards. Background Art

[0002] With the rapid development of information technology, especially its widespread application in cloud computing, the Internet of Things, artificial intelligence, and big data, the demand for data transmission and processing has exploded. To meet these needs, microservice architecture has become the main model for modern application development, while big data processing and analysis have put forward higher requirements for the speed, stability, and reliability of data transmission. In this context, traditional network architecture and transmission protocols have gradually exposed performance bottlenecks, especially when dealing with large-scale, real-time, and complex mixed traffic, they often encounter problems such as network congestion, excessive latency, and insufficient throughput.

[0003] Microservice architecture relies on high-speed, low-latency communication between multiple distributed services to achieve flexible business functions. These services are usually deployed in cloud environments, and due to the characteristics of load balancing, elastic scaling, etc., the traffic pattern is extremely complex, showing the characteristics of mixed traffic, including but not limited to synchronous / asynchronous requests, a mixture of transactional and streaming data, and data streams of different protocols. Therefore, how to effectively manage and optimize large-scale data transmission in a microservice environment has become a major challenge in today's network architecture design.

[0004] On the other hand, big data analysis platforms and real-time data processing systems also need to use efficient network architectures to ensure real-time data transmission and calculation. Big data applications not only need to process massive amounts of data, but also need to quickly store, process, and query data under low-latency, high-throughput network conditions. This places stringent requirements on network performance, especially in mixed traffic scenarios. How to avoid network bottlenecks, reduce data packet loss, and ensure high availability and lossless data transmission has become an urgent problem to be solved.

[0005] Traditional Ethernet and data center networks usually rely on IP-based protocol stacks for data transmission. These networks usually optimize the performance of a certain type of data flow, but it is difficult to meet the requirements of big data and microservice mixed traffic. Especially in the case of high concurrency and large-scale traffic, data transmission performance indicators such as latency, packet loss rate, and bandwidth have become key bottlenecks. To this end, more and more research and technical solutions have begun to explore how to build low-latency, high-reliability Ethernet networks that can efficiently support lossless transmission of microservice big data mixed traffic.

[0006] At present, although there are some technical solutions for traffic optimization and network performance tuning, these solutions often target a single type of traffic, or only focus on the optimization of a certain level, and lack comprehensive evaluation and testing in complex network environments. In response to this, the present invention proposes a test method that can comprehensively evaluate and optimize network performance under microservice big data mixed traffic, and can evaluate the real-time and lossless basic performance indicators of network transmission, thereby providing a scientific basis for the design of large-scale network architecture in modern data centers and cloud computing environments. Summary of the invention

[0007] The purpose of the present invention is to provide a lossless Ethernet network testing system for microservice and big data mixed traffic, aiming to solve the problem that traditional network testing solutions cannot comprehensively evaluate and optimize network performance when dealing with complex and dynamically changing mixed traffic. The present invention comprehensively considers key performance indicators such as network bandwidth, latency, throughput, and packet loss rate by accurately testing the transmission of microservices and big data traffic, ensuring that data transmission in high-concurrency and large-scale traffic scenarios can remain lossless and efficient. The present invention provides an effective technical means for the design and optimization of big data platforms, cloud computing environments, and data center networks, which can improve the stability and reliability of network transmission and ensure that microservices and big data applications can run efficiently and stably.

[0008] The technical solution of the present invention is: the present invention is a lossless Ethernet network test system for microservice big data mixed traffic, and its special feature is: the lossless Ethernet network test system for microservice big data mixed traffic includes a switching module, a module to be tested, a traffic excitation module and a gating module. The module to be tested is connected to the switching module and the traffic excitation module respectively through the gating module. The module to be tested and the traffic excitation module are used to generate traffic, generate and inject specific network traffic to simulate various traffic modes that may appear in actual application scenarios, so as to comprehensively evaluate the performance of the tested network. The gating module is used for testers to select different paths in the network in real time and dynamically according to needs, so as to realize the test of each network link and node, and evaluate the performance of the network under various load and traffic conditions. The switching module is responsible for realizing data flow and forwarding between modules in the network, supports multi-port access, and flexibly adapts to test needs.

[0009] Furthermore, the module to be tested has the ability to simulate real application traffic, and can generate and inject traffic that meets specific requirements based on the application scenarios in the actual network environment. The traffic stimulation module can simulate multiple network protocols and different traffic load modes; the traffic stimulation module can accurately control the size, rate, size of data packets, and sending time interval of the traffic, simulate the real network environment, and help testers simulate different loads, network congestion or attack scenarios.

[0010] A test method for realizing the above-mentioned lossless Ethernet network test system for microservice big data mixed traffic, the special feature of which is that the method comprises the following steps:

[0011] 1) In the test environment, deploy the switching module, the module to be tested, the traffic stimulus module and the gating module, and connect each device through a fiber optic link.

[0012] 2) Test path selection:

[0013] By precisely controlling the gating module, testers can select different paths in the network in real time and dynamically according to their needs, thereby testing each network link and node and evaluating the performance of the network under various load and traffic conditions.

[0014] 3) Traffic generation:

[0015] Traffic is generated by the traffic stimulus module and the module under test. Its core function is to generate and inject specific network traffic to simulate various traffic patterns that may appear in actual application scenarios, so as to comprehensively evaluate the performance of the network under test.

[0016] 4) Test result output: After the traffic is generated, the system will output detailed test results based on the preset test objectives and indicators.

[0017] Furthermore, in step 3), the traffic excitation module can simulate a variety of network protocols and different traffic load modes. The traffic excitation module can accurately control the size, rate, size of data packets, sending time interval, etc. of the traffic, simulate the real network environment, and help testers simulate different loads, network congestion or attack scenarios. In this way, the traffic excitation module can generate load traffic and inject it into the module under test to verify the performance of the network under different conditions. The module under test has the ability to simulate real application traffic and can generate and inject traffic that meets specific requirements according to the application scenarios in the actual network environment. For communication between multiple hosts in the node under test, the load traffic of the traffic excitation module cannot be injected into the data communication path, and can only be injected into the interaction by generating different loads through the module under test itself.

[0018] Further, the test results in step 4) include:

[0019] Network throughput: The amount of data transmitted by the test device per unit time, usually expressed in Mbps or Gbps, helps evaluate the bandwidth utilization and data transmission capacity of the network;

[0020] Latency: The delay in data transmission from the source device to the destination device over the network;

[0021] Packet loss rate: The proportion of data packets lost during transmission, usually expressed as a percentage (%), is a key indicator for measuring the network's lossless transmission function;

[0022] Jitter: The variation in the time it takes for a packet to arrive, i.e., the fluctuation in network delay;

[0023] Network utilization: network resource usage, including CPU, memory, bandwidth and other resource usage, provides resource usage of each device or link, and helps identify network bottlenecks or resource overloads;

[0024] Protocol compliance analysis: Analyze the performance of network transmission protocols in test traffic transmission and check the efficiency and correctness of protocol processing.

[0025] The present invention provides a lossless Ethernet network test system for microservice big data mixed traffic, which can effectively simulate and evaluate various traffic characteristics, perform efficient and accurate performance testing in complex network environments such as big data and cloud computing, optimize network design and operation, and improve network reliability and stability, thereby better supporting the needs of modern information technology applications. The present invention has the following beneficial effects:

[0026] 1) Traffic simulation in real scenarios;

[0027] The present invention can simulate the mixed traffic of microservices and big data, including the joint processing of real-time traffic and batch traffic. Through the simulation of such mixed traffic, the carrying capacity and stability of the network in actual applications can be more accurately evaluated, rather than just the performance in a single traffic mode.

[0028] 2) High-precision performance evaluation;

[0029] Traditional unified evaluation methods often fail to reflect the true status of network performance. The present invention can provide more accurate and comprehensive performance data by evaluating and optimizing different traffic types separately, including multiple key indicators such as throughput, delay, packet loss, and jitter.

[0030] 3) Optimize network resource scheduling;

[0031] The present invention can adjust network resources according to the characteristics and requirements of different traffic flows, optimize bandwidth allocation and traffic priority, ensure that high-priority traffic can be transmitted preferentially in the context of mixed traffic, reduce the impact of low-priority traffic, and thus improve the overall efficiency and response speed of the network. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] Figure 1 It is a system block diagram of the present invention. DETAILED DESCRIPTION

[0033] The present invention is further described in detail below with reference to the accompanying drawings and specific embodiments.

[0034] See also Figure 1 The structure of the specific embodiment of the lossless Ethernet network test system for microservice big data mixed traffic of the present invention includes a switching module, a module to be tested, a traffic excitation module and a gating module. The module to be tested is connected to the switching module and the traffic excitation module respectively through the gating module. The module to be tested and the traffic excitation module are used to generate traffic, generate and inject specific network traffic to simulate various traffic patterns that may appear in actual application scenarios, so as to comprehensively evaluate the performance of the tested network. The gating module is used for testers to select different paths in the network in real time and dynamically according to needs, so as to realize the test of each network link and node, and evaluate the performance of the network under various load and traffic conditions. The switching module is responsible for realizing the data flow and forwarding between modules in the network, supports multi-port access, and flexibly adapts to test needs.

[0035] Among them, the module to be tested has the ability to simulate real application traffic, and can generate and inject traffic that meets specific needs according to the application scenarios in the actual network environment. The traffic stimulation module can simulate a variety of network protocols and different traffic load modes; the traffic stimulation module can accurately control the size, rate, size of the data packet, and sending time interval of the traffic, simulate the real network environment, and help testers simulate different loads, network congestion or attack scenarios.

[0036] The present invention also provides a lossless Ethernet network testing method for microservice big data mixed traffic, and the specific steps are as follows:

[0037] 1) In the test environment, deploy the switching module, the module to be tested, the traffic excitation module and the gating module, and connect each device through an optical fiber link. The main invention contents are described in detail as follows:

[0038] 2) Test path selection

[0039] By precisely controlling the gating module, testers can dynamically select different paths in the network in real time according to their needs, thereby testing each network link and node and evaluating the performance of the network under various load and traffic conditions.

[0040] 3) Traffic generation

[0041] Traffic generation is a key component of network evaluation. In the present invention, traffic is generated by the traffic stimulation module and the module under test itself. Its core function is to generate and inject specific network traffic to simulate various traffic patterns that may occur in actual application scenarios, thereby comprehensively evaluating the performance of the network under test.

[0042] Traffic stimulus modules are usually able to simulate multiple network protocols (such as TCP / IP, UDP, RDMA, etc.) and different traffic load modes (such as stable traffic, burst traffic, high concurrent connections, microservice big data mixed traffic, etc.). Traffic stimulus modules can accurately control the size, rate, size of data packets, sending time interval, etc. of traffic, simulate the real network environment, and help testers simulate different loads, network congestion or attack scenarios. In this way, the traffic stimulus module can generate load traffic and inject it into the module to be tested to verify the performance of the network under different conditions.

[0043] The module under test has the ability to simulate real application traffic, and can generate and inject traffic that meets specific requirements according to the application scenarios in the actual network environment. This capability enables the module under test to not only process theoretical data packets or standardized test traffic, but also accurately simulate actual user behavior and network load, providing more realistic and representative performance test results. In addition, for the communication between multiple hosts in the node under test, the load traffic of the traffic stimulus module cannot be injected into the data communication path, and can only be injected into the interaction by generating different loads through the module under test itself.

[0044] 4) Test result output

[0045] After the traffic is generated, the system will output detailed test results based on the preset test objectives and indicators. The test results usually include the following aspects:

[0046] Network throughput: The amount of data transmitted by the test device per unit time, usually expressed in Mbps or Gbps, helps evaluate the bandwidth utilization and data transmission capacity of the network;

[0047] Latency: The delay in data transmission from the source device to the destination device over the network;

[0048] Packet loss rate: The proportion of data packets lost during transmission, usually expressed as a percentage (%), is a key indicator for measuring the network's lossless transmission function;

[0049] Jitter: The variation in the time it takes for a packet to arrive, i.e., the fluctuation in network delay;

[0050] Network utilization: Network resource usage, including CPU, memory, bandwidth, etc. It provides the resource usage of each device or link to help identify network bottlenecks or resource overloads.

[0051] Protocol compliance analysis: Analyze the performance of network transmission protocols in test traffic transmission and check the efficiency and correctness of protocol processing.

[0052] The above are only specific embodiments disclosed in the present invention, but the protection scope of the present invention is not limited thereto. The protection scope of the present invention shall be based on the protection scope of the claims.

[0053] The content of the present invention and the technical content not specifically described in the above embodiments are the same as the prior art.

[0054] The present invention is not limited to the above embodiments, and all of the contents of the present invention can be implemented and have the above good effects.

Claims

1. A lossless Ethernet network testing system for microservice big data mixed traffic, characterized by: The lossless Ethernet network test system for microservice big data mixed traffic includes a switching module, a module to be tested, a traffic excitation module and a gating module. The module to be tested is connected to the switching module and the traffic excitation module respectively through the gating module. The module to be tested and the traffic excitation module are used to generate traffic, generate and inject specific network traffic to simulate various traffic patterns that may appear in actual application scenarios, so as to comprehensively evaluate the performance of the tested network. The gating module is used for testers to select different paths in the network in real time and dynamically according to needs, so as to realize the test of each network link and node, and evaluate the performance of the network under various load and traffic conditions. The switching module is responsible for realizing data flow and forwarding between modules in the network, supports multi-port access, and flexibly adapts to test needs.

2. The lossless Ethernet network testing system for microservice big data mixed traffic according to claim 1 is characterized in that: The module to be tested has the ability to simulate real application traffic, and can generate and inject traffic that meets specific requirements according to the application scenarios in the actual network environment. The traffic stimulation module can simulate multiple network protocols and different traffic load modes; the traffic stimulation module can accurately control the size, rate, size of the data packet, and the sending time interval of the traffic, simulate the real network environment, and help testers simulate different loads, network congestion or attack scenarios.

3. A test method for implementing the lossless Ethernet network test system of microservice big data mixed traffic as claimed in claim 1, characterized in that: The method comprises the following steps: 1) In the test environment, deploy the switching module, the module to be tested, the traffic stimulus module and the gating module, and connect each device through a fiber optic link. 2) Test path selection: By precisely controlling the gating module, testers can select different paths in the network in real time and dynamically according to their needs, thereby testing each network link and node and evaluating the performance of the network under various load and traffic conditions. 3) Traffic generation: Traffic is generated by the traffic stimulus module and the module under test. Its core function is to generate and inject specific network traffic to simulate various traffic patterns that may appear in actual application scenarios, so as to comprehensively evaluate the performance of the network under test. 4) Test result output: After the traffic is generated, the system will output detailed test results based on the preset test objectives and indicators.

4. The lossless Ethernet network testing method for microservice big data mixed traffic according to claim 3 is characterized in that: In the step 3), the traffic excitation module can simulate a variety of network protocols and different traffic load modes. The traffic excitation module can accurately control the size, rate, size of data packets, sending time interval, etc. of the traffic, simulate the real network environment, and help testers simulate different loads, network congestion or attack scenarios; in this way, the traffic excitation module can generate load traffic and inject it into the module to be tested to verify the performance of the network under different conditions; The module under test has the ability to simulate real application traffic and can generate and inject traffic that meets specific requirements based on the application scenarios in the actual network environment. For communication between multiple hosts within the node under test, the load traffic of the traffic stimulation module cannot be injected into the data communication path and can only be injected into the interaction by generating different loads through the module under test itself.

5. The lossless Ethernet network testing method for microservice big data mixed traffic according to claim 4 is characterized in that: The test results in step 4) include: Network throughput: The amount of data transmitted by the test device per unit time, usually expressed in Mbps or Gbps, helps evaluate the bandwidth utilization and data transmission capacity of the network; Latency: The delay in data transmission from the source device to the destination device over the network; Packet loss rate: The proportion of data packets lost during transmission, usually expressed as a percentage (%), is a key indicator for measuring the network's lossless transmission function; Jitter: The variation in the time it takes for a packet to arrive, i.e., the fluctuation in network delay; Network utilization: network resource usage, including CPU, memory, bandwidth and other resource usage, provides resource usage of each device or link, and helps identify network bottlenecks or resource overloads; Protocol compliance analysis: Analyze the performance of network transmission protocols in test traffic transmission and check the efficiency and correctness of protocol processing.

Images