Neural network reinforcement learning method and system based on a fitness track

Abstract

The invention discloses a neural network reinforcement learning method and system based on a fitness track. The neural network reinforcement learning method comprises the following steps: initializinga neural network weight, reinforcement learning parameters and a fitness track; Obtaining a current environment state and an immediate return value; Calculating a Q value function of reinforcement learning; Acquiring a fitness track and updating a neural network weight; Detecting a new environment state and an immediate return value; When the new environment state and the immediate return value meet the end condition, reinforcement learning is finished, the end condition is not met,obtaining the current environment state and the immediate return value through return re-detection. The method has the advantages that the function approximation problem of reinforcement learning for continuous state space is solved, meanwhile, a fitness track is introduced to effectively store an access path with correct experienced state actions, the generalization performance of the neural network is improved, and finally the convergence speed of the algorithm is increased.

Description

technical field [0001] The present invention relates to the technical field of machine learning, and more specifically, to a neural network reinforcement learning method and system based on a fitness trajectory. Background technique [0002] Reinforcement learning is used more and more in the field of artificial intelligence, including industrial production, elevator scheduling, and path planning. It can be used to solve decision-making problems such as stochastic or uncertain dynamic system optimization. With the development of reinforcement learning and various aspects The expansion of applications requires more and more combined technologies and algorithms. At this time, the classic look-up table method cannot meet the needs. Because the traditional reinforcement learning algorithm needs to save the value function corresponding to the state-action in the table for query, but the storage of the computer is limited, and the value table method cannot store such a large numbe...

AI Technical Summary

Problems solved by technology

[0002] Reinforcement learning is used more and more in the field of artificial intelligence, including industrial production, elevator scheduling, and path planning. It can be used to solve decision-making problems such as stochastic or uncertain dynamic system optimization. With the development of reinforcement learning and various aspects The expansion of applications requires more and more combined technologies and algorithms. At this time, the classic look-up table method cannot meet the needs.

Because the traditional reinforcement learning algorithm needs to save the value function corresponding to the state-action in the table for query, but the storage of the computer is limited, and the value table method cannot store such a large number of problems in the face of continuous state space. value function

[0003] Faced with the above problems, the more common way is to

Images