Accelerator beam track control method and system based on depth reinforcement learning

Abstract

An accelerator beam track control method and system based on depth reinforcement learning aim to control the accelerator beam track at a target state; the method comprises the following steps: using adepth reinforcement learning method and the training data to pre-train a depth nerve network, and storing weight parameters of the trained depth nerve network and experience data of a track control strategy; using a beam position monitor to obtain the state data of the beam track online, returning the state data into the depth nerve network, and coupling the output of the depth nerve network to abeam track corrector; loading the weight parameters of the trained depth nerve network and the experience data of the track control strategy, and allowing the depth nerve network to adjust the control parameters through prediction control and on-line reinforcement learning, thus adaptively stably controlling the beam track at the target state.

Description

technical field [0001] The present invention relates to the technical field of accelerator beam current diagnosis and control, in particular to a method and system for controlling accelerator beam current trajectory based on deep reinforcement learning. Background technique [0002] In the field of accelerator beam diagnosis and control technology, the beam trajectory feedback control technology is usually used to correct the beam trajectory so that the beam moves along the optimized trajectory or the target trajectory to ensure the quality and stability of the beam. The traditional beam trajectory feedback control technology uses the singular value decomposition algorithm combined with the PID (proportional, integral, differential) control algorithm to solve the large-scale multivariable input and output control problem of the beam trajectory control of the accelerator system, but with the modern accelerator With the development of engineering, the scale of the accelerator ...

AI Technical Summary

Problems solved by technology

The traditional beam trajectory feedback control technology uses the singular value decomposition algorithm combined with the PID (proportional, integral, differential) control algorithm to solve the large-scale multivariable input and output control problem of the beam trajectory control of the accelerator system, but with the modern accelerator With the development of engineering, the scale of the accelerator system has become larger and larger, the number of control parameters of the beam trajectory has been increasing, and the related problems of beam trajectory control have become more and more complicated. Although the traditional control algorithm is relatively simple in principle and implementation, However, there are great limitations in practical applications

In addition, the traditional beam trajectory control method needs to manually measure the response matrix between the beam position monitor (hereinafter referred to as BPM) and the trajectory corrector, which is difficult for large-scale systems with hundreds or even thousands of BPMs and trajectory correctors. The implementation on the accelerator requires a lot of work, and the measurement accuracy of the response matrix will directly affect the orbit control accuracy. In modern accelerator systems, due to the influence of nonlinear response, there is a nonlinear mapping between the beam orbit state and the correction action. Therefore, the response matrix is ​​often difficult to measure accurately

At the same time, due to the PID co

Images