Simulation method and simulation system for network attack and defense under asymmetric game condition
By generating relevant parameters and controlling the actions of the agent in the network attack and defense simulation system, simulating asymmetric game scenarios, the problem of lack of dynamic simulation environment in the existing technology is solved, network defense strategies are optimized, and dynamic feedback of system performance is provided.
Patent Information
- Application Number
- CN202411099412.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-12
- Publication Date
- 2024-12-06
- Estimated Expiration
- 2044-08-12
AI Technical Summary
The existing technology lacks an effective and dynamic simulation environment to simulate the network offensive and defense game process, and it is difficult to optimize network defense strategies and network environments with complex and uncertain responses.
Provide a network attack and defense simulation method and simulation system in asymmetric game situations. By generating relevant parameters such as the lag time of defense decisions and the step of the agent's action, asymmetric network attack and defense scenarios are constructed, and the attack is controlled using preset function functions. The agent and the defense agent are simulated, including remote account login, remote vulnerability attack, local system authority promotion and trace cleaning.
The network defense strategy in the game confrontation scenario is optimized, dynamic feedback on system performance is provided, the limitations of multi-time step actions in the original platform are improved, and the actual situation in network intrusion prevention is reflected.
Smart Images

Figure CN119089771A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of machine learning, and in particular to a simulation method and system for network attack and defense in an asymmetric game situation. Background Art
[0002] Network security is a new battlefield concerning national security and the basic guarantee for the normal development and operation of the information society. With the rapid development of network information technology and the increasing complexity of the network environment, network security has become one of the key issues facing the global information society. In the process of protecting information network systems, studying the laws and strategies of attack and defense behaviors is of great significance for improving network security and enabling decision makers to respond to targeted threats in a timely manner. An effective method is to use a network attack and defense game model to simulate the attack and defense game process of network security issues in the real world.
[0003] Game theory, as a theory of studying the interaction between two or more people, has been widely used in the analysis of competition, cooperation and other behaviors in various fields since it was proposed in the 1930s. In the study of network attack and defense games, by simulating the interaction between attackers and defenders, studying the strategy choices of both parties and the behavioral motivations behind them, it is helpful to understand and predict the behavior of both parties and optimize network defense measures. Partially observable random games, as a game theory method that does not limit the interaction order and observation ability of intelligent agents, can effectively reflect the asymmetry of the action types, observation ability and time and space constraints of both parties in the process of network attack and defense.
[0004] Compared with the traditional network attack and defense game description tools that tend to be static utility analysis, there is a lack of practical, operational, and dynamic simulation environments. The network attack and defense game platform based on partially observable random games is committed to combining game theory and dynamic models as an experimental platform to deal with the complexity, randomness, and uncertainty in the attack and defense decision-making process. It can design attack and defense game mechanisms and modeling elements more specifically, reflecting the dynamic and complex interactive characteristics of network attack and defense, and fully simulating the real-time dynamic network attack and defense interactive state, which is of great help in improving the empirical research of theory and the intuitiveness in practice.
[0005] By capturing and simulating the interaction between attackers and defenders, we can optimize network defense strategies in game confrontation scenarios, apply theoretical knowledge to real-world scenarios, and provide dynamic feedback for system performance optimization. Summary of the invention
[0006] The main purpose of the embodiments of the present invention is to provide a simulation method and simulation system for network attack and defense in an asymmetric game situation. By capturing and simulating the interaction between attackers and defenders, it is possible to optimize the network defense strategy in the game confrontation scenario, apply theoretical knowledge to real-life scenarios, and provide dynamic feedback for system performance optimization.
[0007] In a first aspect, a simulation method for network attack and defense in an asymmetric game is provided, the simulation method comprising:
[0008] Generate relevant parameters for attack and defense according to the attack and defense requirements of the network to be simulated, including the lag time of defense decision, the step length of the attack and defense agent action, the size of the network, and other parameters to build an asymmetric network attack and defense game scenario;
[0009] Generate a corresponding attack and defense scenario according to the relevant parameters;
[0010] In the attack and defense scenario, the attacking agent and the defending agent are controlled by a preset function to perform attack and defense simulation.
[0011] In a possible implementation, the relevant parameters include: game mechanism, network environment model parameters, and system configuration file.
[0012] In another possible implementation, the functional functions include: a begin function, a proceed function and a success function.
[0013] In another possible implementation, the action types of the intelligent agent include: remote account login action, remote vulnerability attack action, system local privilege escalation action, trace cleaning action, and host search action.
[0014] In a second aspect, a simulation system for network attack and defense in an asymmetric game is provided, the simulation system comprising:
[0015] A related parameter generation module is used to generate related parameters for attack and defense according to the attack and defense requirements of the network attack and defense to be simulated. The related parameters include the lag time of the defense decision, the step length of the attack and defense agent action, the size of the network scale and other parameters, and construct an asymmetric network attack and defense game scenario;
[0016] An attack and defense scenario generation module, used to generate a corresponding attack and defense scenario according to the relevant parameters;
[0017] The attack and defense simulation module is used to control the attacking intelligent agent and the defending intelligent agent to perform attack and defense simulation through preset functional functions in the attack and defense scenario.
[0018] In a possible implementation, the relevant parameters include: game mechanism, network environment model parameters, and system configuration file.
[0019] In another possible implementation, the functional functions include: a begin function, a proceed function and a success function.
[0020] In another possible implementation, the action types of the intelligent agent include: remote account login action, remote vulnerability attack action, system local privilege escalation action, trace cleaning action, and host search action.
[0021] In a third aspect, an electronic device is provided, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, a simulation method for network attack and defense in an asymmetric game situation as provided in the first aspect is implemented.
[0022] In a fourth aspect, a non-transitory computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, a simulation method for network attack and defense in an asymmetric game situation as provided in the first aspect is implemented. BRIEF DESCRIPTION OF THE DRAWINGS
[0023] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in describing the embodiments of the present application.
[0024] Figure 1 A flowchart of a simulation method for network attack and defense in an asymmetric game situation provided by the first embodiment of the present invention;
[0025] Figure 2 A structural diagram of a simulation system for network attack and defense in an asymmetric game situation provided by a second embodiment of the present invention;
[0026] Figure 3 A schematic diagram of the physical structure of an electronic device provided by the present invention.
[0027] Specific implementation method
[0028] The technical solutions in the embodiments of the present disclosure will be described clearly and completely below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only part of the embodiments of the present disclosure, not all of the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present disclosure.
[0029] The embodiments of the present disclosure provide a simulation method and a simulation system for network attack and defense under asymmetric game conditions. Specifically, a simulation method for network attack and defense under asymmetric game conditions of an embodiment of the present disclosure can be performed by a computer device, wherein the computer device can be a terminal or a server. The terminal can be a terminal device such as a smart phone, a tablet computer, a laptop computer, a touch screen, a game console, a personal computer (PC, Personal Computer), a personal digital assistant (Personal Digital Assistant, PDA), etc. The terminal can also include a client, which can be an application client, a browser client carrying an application program, or an instant messaging client, etc. The server can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms.
[0030] For example, when the simulation method of network attack and defense in the asymmetric game situation is run on the terminal, the terminal device stores an application and is used to present the operation interface or application page provided by the application. The terminal device is used to interact with the user through a graphical user interface, a merchant page, or an associated page in other applications, such as downloading and installing the application through the terminal device and running it. The terminal device may provide the graphical user interface, the merchant page, or the associated page in other applications to the user in a variety of ways, for example, it can be rendered and displayed on the display screen of the terminal device, or the graphical user interface can be presented through holographic projection. For example, the terminal device may include a touch display screen and a processor, the touch display screen is used to present the graphical user interface and receive the operation instructions generated by the user acting on the graphical user interface, and the processor is used to run the application, generate the graphical user interface, respond to the operation instructions, and control the display of the graphical user interface on the touch display screen.
[0031] The embodiment of the present disclosure provides a simulation method and system for network attack and defense in an asymmetric game situation, and the simulation method can be executed by a terminal or a server. The embodiment of the present disclosure takes the simulation method of network attack and defense in an asymmetric game situation executed by a terminal as an example for explanation. Among them, the terminal may include a touch display screen and a processor (of course, the terminal may also use peripherals such as a mouse and a keyboard as input devices, and only the touch display screen is used as an example for explanation here), and the touch display screen is used to present a graphical user interface and receive operation instructions generated by the user acting on the graphical user interface. When the user operates the graphical user interface through the touch display screen, the graphical user interface can control the local content of the terminal by responding to the received operation instructions, and can also control the content of the opposite server by responding to the received operation instructions. For example, the operation instructions generated by the user acting on the graphical user interface include instructions for starting an application, and the processor is configured to start the application after receiving the instructions for starting the application provided by the user. In addition, the processor is configured to render and draw a graphical user interface associated with the application on the touch display screen. The touch display screen is a multi-touch sensitive screen that can sense touch or sliding operations performed simultaneously on multiple points on the screen. The user uses a finger to perform a touch operation on the graphical user interface, and when the graphical user interface detects the touch operation, the graphical user interface is controlled to perform and display an action corresponding to the touch operation.
[0032] like Figure 1 FIG. 1 is a flow chart of a simulation method for network attack and defense in an asymmetric game situation provided by an embodiment of the present invention. The simulation method includes:
[0033] Step 101, generating relevant parameters for attack and defense according to the attack and defense requirements of the network attack and defense to be simulated;
[0034] Step 102, generating a corresponding attack and defense scenario according to the relevant parameters;
[0035] Step 103, in the attack and defense scenario, the attacking agent and the defending agent are controlled by a preset function to perform attack and defense simulation.
[0036] In step 101, the scenario parameters related to the attack and defense simulation can be generated more flexibly by separating the parameters from the model, wherein the relevant parameters include but are not limited to: game mechanism, network environment model parameters, system configuration file. The system configuration file is used to control the entire attack and defense simulation, which includes: the number of simulation training rounds, the number of simulation training steps, the number of simulation test rounds, the number of simulation test steps, the agent action, and the hyperparameters related to the strategy. The relevant parameters directly affect the parameter configuration of each sub-simulation as global variables, thereby more conveniently controlling the simulation process.
[0037] In step 102, after receiving the generated relevant parameters, the relevant parameters are loaded into a preset model to generate a corresponding attack and defense scenario.
[0038] In step 103, the function functions for controlling the attacking agent and the defending agent include: begin function, proceed function and success function. The operation of the above function functions is specifically as follows: whether the steps to be implemented by the agent meet the preconditions in the current state is obtained through the begin function, and if so, the steps to be implemented are passed to the proceed function. The proceed function determines the reliability of the actions to be implemented and the possibility of being recorded. The success function is used to update the status of the attack and defense scenario. Through this control method, the limitation of the original OpenAI gym platform that does not support multi-time step actions can be effectively improved, thereby reflecting the actual situation of observation delay in network intrusion defense problems.
[0039] This application also judges the return results of the agent's actions through a decision function. By combining the decision function, the reliability of the attack action of the attacking agent, and the defense detection rate of the defending agent, the state transition of the attack and defense scenario, the execution results of the agent's actions, and the observable results can be obtained.
[0040] Among them, the action types of the agent include:
[0041] lateralAndScan(X,Y,A): Remote account login action. Initiate a remote account login action from source host X to target host Y, using credential A. If the exploit is successful, the permissions of account A are obtained on host Y, and further scans can be performed to obtain the connectable hosts of host Y and the vulnerabilities on these connectable hosts. Once the action is initiated, regardless of whether it is successful or not, the number of times nodes X and Y have been attacked will increase by 1. When the action is executed successfully, the attacking agent can see the hosts it can connect to later.
[0042] exploitAndScan(X,Y,E): remote vulnerability attack action. Initiate a vulnerability exploit action from source host X to target host Y, using vulnerability E. If the exploit is successful, the privilege of vulnerability E is obtained on host Y. If the exploit is successful, the privilege of account A is obtained on host Y, and further scans can be performed to obtain the connectable hosts of host Y and the vulnerabilities on these connectable hosts. Once the action is initiated, regardless of whether it is successful or not, the number of times nodes X and Y are attacked will increase by 1. When the action is executed successfully, the attacking agent can see the hosts it can connect to later.
[0043] escalateAndScan(X,E): Local privilege escalation action. Initiate privilege escalation action on node X, using vulnerability E. If the exploit is successful, the privilege of vulnerability E is obtained on host X, and further scans can be performed to obtain the connectable hosts of host Y and the vulnerabilities on these connectable hosts. Once the action is initiated, the number of attacks on node X will increase by 1 regardless of whether it is successful or not. When the action is executed successfully, the attacking agent can see the hosts it can connect to later.
[0044] cleanup(X): cleanup trace action. When the attacking agent performs this action, the number of attacks of host X decreases by 1.
[0045] search(X): Search host action. Search for node X in the target network and return the result of whether the detection is successful.
[0046] Among them, the observation factors that the attacking agent can obtain include: the authority of the attacking agent on the host, the account of the attacking agent on the host and whether the vulnerability can be exploited.
[0047] The observation factors that the defense agent can obtain include: the number of attacks on the attacked node. The defense agent can observe the number of alarms for each host. Since the defense cannot observe the local privilege escalation and trace cleaning actions of the attacking agent, the number of alarms is not equal to the actual number of attacks.
[0048] As an optional embodiment of the present invention, the simulation method further includes:
[0049] The attack and defense data of the attack and defense simulation are recorded.
[0050] The attack and defense data includes action information, reward information, game information, process status information and observation information, and the attack and defense data can be used for subsequent simulation analysis.
[0051] like Figure 2 FIG. 1 is a structural diagram of a simulation system for network attack and defense in an asymmetric game situation provided by an embodiment of the present invention. The simulation system includes:
[0052] A related parameter generation module 201, used to generate related parameters for attack and defense according to the attack and defense requirements of the network attack and defense to be simulated;
[0053] An attack and defense scenario generating module 202, configured to generate a corresponding attack and defense scenario according to the relevant parameters;
[0054] The attack and defense simulation module 203 is used to control the attacking agent and the defending agent to perform attack and defense simulation in the attack and defense scenario through a preset function.
[0055] By separating parameters from models, scenario parameters related to attack and defense simulation can be generated more flexibly, where relevant parameters include but are not limited to: game mechanism, network environment model parameters, and system configuration files. The system configuration file is used to control the entire attack and defense simulation, which includes: the number of simulation training rounds, the number of simulation training steps, the number of simulation test rounds, the number of simulation test steps, agent actions, and hyperparameters related to the strategy. The relevant parameters directly affect the parameter configuration of each sub-simulation as global variables, thereby making it easier to control the simulation process.
[0056] After receiving the generated relevant parameters, the relevant parameters are loaded into the preset model to generate the corresponding attack and defense scenario.
[0057] The function functions used to control the attacking agent and the defensive agent include: begin function, proceed function and success function. The operation of the above function functions is specifically as follows: obtain whether the steps to be implemented by the agent meet the preconditions in the current state through the begin function, and if so, pass the steps to be implemented to the proceed function. The proceed function determines the reliability of the actions to be implemented and the possibility of being recorded. The success function is used to update the status of the attack and defense scenario. Through this control method, the limitation of the original OpenAI gym platform that does not support multi-time step actions can be effectively improved, thereby reflecting the actual situation of observation delay in network intrusion defense problems.
[0058] This application also judges the return results of the agent's actions through a decision function. By combining the decision function, the reliability of the attack action of the attacking agent, and the defense detection rate of the defending agent, the state transition of the attack and defense scenario, the execution results of the agent's actions, and the observable results can be obtained.
[0059] Among them, the action types of the agent include:
[0060] lateralAndScan(X,Y,A): Remote account login action. Initiate a remote account login action from source host X to target host Y, using credential A. If the exploit is successful, the permissions of account A are obtained on host Y, and further scans can be performed to obtain the connectable hosts of host Y and the vulnerabilities on these connectable hosts. Once the action is initiated, regardless of whether it is successful or not, the number of times nodes X and Y have been attacked will increase by 1. When the action is executed successfully, the attacking agent can see the hosts it can connect to later.
[0061] exploitAndScan(X,Y,E): remote vulnerability attack action. Initiate a vulnerability exploit action from source host X to target host Y, using vulnerability E. If the exploit is successful, the privilege of vulnerability E is obtained on host Y. If the exploit is successful, the privilege of account A is obtained on host Y, and further scans can be performed to obtain the connectable hosts of host Y and the vulnerabilities on these connectable hosts. Once the action is initiated, regardless of whether it is successful or not, the number of times nodes X and Y are attacked will increase by 1. When the action is executed successfully, the attacking agent can see the hosts it can connect to later.
[0062] escalateAndScan(X,E): Local privilege escalation action. Initiate privilege escalation action on node X, using vulnerability E. If the exploit is successful, the privilege of vulnerability E is obtained on host X, and further scans can be performed to obtain the connectable hosts of host Y and the vulnerabilities on these connectable hosts. Once the action is initiated, the number of attacks on node X will increase by 1 regardless of whether it is successful or not. When the action is executed successfully, the attacking agent can see the hosts it can connect to later.
[0063] cleanup(X): cleanup trace action. When the attacking agent performs this action, the number of attacks of host X decreases by 1.
[0064] search(X): Search host action. Search for node X in the target network and return the result of whether the detection is successful.
[0065] Among them, the observation factors that the attacking agent can obtain include: the authority of the attacking agent on the host, the account of the attacking agent on the host and whether the vulnerability can be exploited.
[0066] The observation factors that the defense agent can obtain include: the number of attacks on the attacked node. The defense agent can observe the number of alarms for each host. Since the defense cannot observe the local privilege escalation and trace cleaning actions of the attacking agent, the number of alarms is not equal to the actual number of attacks.
[0067] As an optional embodiment of the present invention, the simulation system further includes:
[0068] Recording module, used to record the attack and defense data of the attack and defense simulation
[0069] Figure 3 An example of a physical structure diagram of an electronic device is shown in FIG. Figure 3As shown, the electronic device may include: a processor 301, a communication interface 302, a memory 303 and a communication bus 304, wherein the processor, the communication interface and the memory communicate with each other through the communication bus. The processor may call the logic instructions in the memory to execute a simulation method of network attack and defense under an asymmetric game, the method comprising: generating relevant parameters for attack and defense according to the attack and defense requirements of the network attack and defense to be simulated; generating corresponding attack and defense scenarios according to the relevant parameters; and controlling the attacking intelligent agent and the defending intelligent agent to perform attack and defense simulation in the attack and defense scenarios through preset function functions.
[0070] In addition, the logic instructions in the above-mentioned memory can be implemented in the form of software functional units and can be stored in a computer-readable storage medium when sold or used as an independent product. Based on such an understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.
[0071] On the other hand, an embodiment of the present invention further provides a computer program product, which includes a computer program stored on a non-transitory computer-readable storage medium, and the computer program includes program instructions. When the program instructions are executed by a computer, the computer can execute a simulation method for network attack and defense under an asymmetric game situation provided by the above-mentioned method embodiments, the method including: generating relevant parameters for attack and defense according to the attack and defense requirements of the network attack and defense to be simulated; generating corresponding attack and defense scenarios according to the relevant parameters; and controlling the attacking intelligent agent and the defending intelligent agent to perform attack and defense simulation in the attack and defense scenario through preset functional functions.
[0072] On the other hand, an embodiment of the present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, it is implemented to execute a simulation method for network attack and defense in an asymmetric game situation provided by the above-mentioned embodiments. The method includes: generating relevant parameters for attack and defense according to the attack and defense requirements of the network attack and defense to be simulated; generating a corresponding attack and defense scenario according to the relevant parameters; and controlling the attacking intelligent agent and the defending intelligent agent to perform attack and defense simulation in the attack and defense scenario through preset functional functions.
[0073] It should be understood that, although the steps in the flowchart of the accompanying drawings are displayed in sequence as indicated by the arrows, these steps are not necessarily executed in sequence in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least a part of the steps in the flowchart of the accompanying drawings may include multiple sub-steps or multiple stages, and these sub-steps or stages are not necessarily executed at the same time, but can be executed at different times, and their execution order is not necessarily sequential, but can be executed in turn or alternately with other steps or at least a part of the sub-steps or stages of other steps.
[0074] The above is only a partial implementation of the present invention. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present invention. These improvements and modifications should also be regarded as the scope of protection of the present invention.
Claims
1. A simulation method for network attack and defense in an asymmetric game, characterized in that: The simulation method comprises: Generate relevant parameters for attack and defense according to the attack and defense requirements of the network to be simulated, including the lag time of defense decision, the step length of the attack and defense agent action, the size of the network, and other parameters to build an asymmetric network attack and defense game scenario; Generate a corresponding attack and defense scenario according to the relevant parameters; In the attack and defense scenario, the attacking agent and the defending agent are controlled by a preset function to perform attack and defense simulation.
2. The simulation method according to claim 1, characterized in that: The relevant parameters include: game mechanism, network environment model parameters, and system configuration files.
3. The simulation method according to claim 1, characterized in that: The functional functions include: begin function, proceed function and success function.
4. The simulation method according to claim 1, characterized in that: The action types of the intelligent agent include: remote account login action, remote vulnerability attack action, system local privilege escalation action, trace cleaning action, and host search action.
5. A simulation system for network attack and defense in an asymmetric game, characterized in that: The simulation system comprises: A related parameter generation module is used to generate related parameters for attack and defense according to the attack and defense requirements of the network attack and defense to be simulated. The related parameters include the lag time of the defense decision, the step length of the attack and defense agent action, the size of the network scale and other parameters, and construct an asymmetric network attack and defense game scenario; An attack and defense scenario generation module, used to generate a corresponding attack and defense scenario according to the relevant parameters; The attack and defense simulation module is used to control the attacking intelligent agent and the defending intelligent agent to perform attack and defense simulation through preset functional functions in the attack and defense scenario.
6. The simulation system according to claim 5, characterized in that: The relevant parameters include: game mechanism, network environment model parameters, and system configuration files.
7. The simulation system according to claim 5, characterized in that: The functional functions include: begin function, proceed function and success function.
8. The simulation system according to claim 5, characterized in that: The action types of the intelligent agent include: remote account login action, remote vulnerability attack action, system local privilege escalation action, trace cleaning action, and host search action.
9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the program, the simulation method for network attack and defense in an asymmetric game situation as described in any one of claims 1-4 is implemented.
10. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the simulation method for network attack and defense in an asymmetric game situation as described in any one of claims 1 to 4 is implemented.
Citation Information
Patent Citations
Multi-view network attack and defense simulation system
CN112104514A
Network attack and defense deduction platform based on simulation experiment design
CN112118272A
Network spoofing defense decision-making method and system based on Flipit intelligent game
CN116962050A
Network space intelligent game decision-making method and system
CN117196040A
Efficiency evaluation method based on mass adversarial simulation deduction data modeling and analysis
WO2023093397A1
