Network traffic simulation system for network transmission process based on Spark computing framework

Abstract

The invention discloses a network simulation system based on a Spark computing framework network transmission process. The network simulation system comprises a load generation module (1), a network topology configuration module (2), a visualization module (3), a scheduling module (4) and a data tracking module (5). And the scheduling module (4) and the data tracking module (5) are respectively arranged on the working simulation node and the driving simulation node. The network transmission process of the Spark computing framework is simulated on the basis of the Spark computing framework in combination with a container virtualization technology and a message driving mechanism. A Spark computing cluster simulation node is established by adopting a container virtualization technology, and areal network data packet is transmitted in a simulation process, so that the effect of an experimental scheme in a real environment can be better reflected.

Description

technical field [0001] The present invention relates to the network traffic simulation of the Spark computing framework, more specifically, to a network traffic simulation for the network transmission process of the Spark computing framework. Background technique [0002] Network simulation technology is a simulation technology that simulates network transmission traffic by establishing statistical models of network devices and network links, so as to obtain network performance data required for network design or optimization. It has a new simulation experiment mechanism and the ability to obtain highly reliable results in a highly complex network environment. Through network simulation, quantitative analysis data can be provided for optimizing and expanding the existing network. [0003] Apache Spark is a fast and general computing engine designed for large-scale data processing. Spark is a Hadoop MapReduce-like general parallel framework open sourced by UCBerkeley AMP la...

AI Technical Summary

Problems solved by technology

[0005] In the field of network simulation technology for the network transmission process of the Spark computing framework, the existing simulation technology is often simply replayed according to the input load (load), without considering the data transfer flow (data transfer) in the network traffic (network traffic) flow) and control message flow (control message flow), so the simulation effect cannot reflect the application layer (application layer) characteristics of the data transmission process of the Spark computing framework

Images