Self-improved recovery strategy for complex network local destruction based on improved reinforcement learning

Abstract

The invention discloses a self-improved recovery strategy method for complex network local destruction based on improved reinforcement learning, so as to solve the problem of recovery strategy generation when a complex network is subjected to cluster maintenance. The method comprises the following steps: 1, according to local destruction information, a complex network cluster maintenance state matrix is built; 2, based on an initial cluster maintenance state, a complex network adjacency matrix is generated; 3, based on a neural network model, a cluster prior maintenance state transition probability and a maintenance strategy value are predicted; 4, based on a Monte Carlo tree search algorithm, cluster maintenance strategy solution space is traversed, and the global best maintenance actionat present time is selected; 5, based on changes of the cluster maintenance state, the complex network adjacency matrix is updated; 6, based on the cluster maintenance state and the adjacency matrix,the recovery degree of the complex network is calculated and checked; 7, based on reinforcement learning experiment parameters, neural network parameters are trained; and 8, based on a series of bestmaintenance actions during a recovery strategy self improvement process, a complete maintenance recovery scheme is generated.

Description

Technical field [0001] The present invention provides a self-improvement recovery strategy (Self-improvement Recovery Strategy, SIRS) method based on improved reinforcement learning in a partially damaged complex network state, and in particular relates to an improved reinforcement learning algorithm that considers the characteristics of network node constituent units, The invention relates to a recovery strategy method for self-improvement solving complex network multi-node cluster maintenance, which belongs to the field of maintainability engineering. Background technique [0002] Self-improving recovery strategy (SIRS) means that after a complex network is partially damaged, multiple nodes are centralized and unavailable at the damaged location, and the cluster maintenance method is used to quickly repair the system to an overall available state. However, the research on cluster maintenance at home and abroad generally does not consider timing. With more and more attenti...

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present invention is to provide a novel self-improving recovery strategy (SIRS) method for a complex network in a partially damaged state, aiming to solve the problem that the traditional cluster maintenance strategy method does not fully consider the timing and income uncertainty characteristics of cluster maintenance Overall NP-hard features and other issues

Images