The application provides a
reinforcement learning method suitable for inhibiting performance fluctuation, a
reinforcement learning intelligent agent containing an online policy network and a target policy network
queue is constructed, a main experience
pool and an evaluation experience
pool are combined, and stable evolution and efficient convergence of a policy are realized. In an environment interaction process, the online policy network and the optimal policy in the target policy network
queue are alternately sampled and obtain environment interaction information, and the environment interaction information is stored in the main experience
pool. In a preset
evaluation period, a parallel multi-environment rolling evaluation mechanism is used to obtain policy evaluation rewards, and the target policy network
queue is dynamically updated or a policy
rollback is performed based on the evaluation results. A double evaluation network is introduced, and an adversarial evaluation training
mechanism based on double Q mean value and small double Q random sampling is used to inhibit value function overestimation and policy over-conservatism. Interaction data generated in the evaluation stage is stored in the evaluation experience pool, and the interaction data is used in combination with main experience pool data in the training process, so that the stability, robustness and convergence performance of the
reinforcement learning training are improved.