The invention belongs to the field of workshop scheduling, and particularly discloses a product process planning and workshop collaborative online scheduling method and
system considering random arrival of workpieces, and the method comprises the steps: converting a dynamic integrated process planning and workshop scheduling problem into a Markov
decision process, and converting workpiece
process information into an OR description matrix; performing
reinforcement learning training on the deep neural network of the
intelligent agent based on a Markov
decision process; during training, at each decision point, if there is a random arrival workpiece, the
process information of the workpiece is converted into an OR description matrix and workshop information is updated; secondly, determining a workshop
feature vector according to the workshop information, making a scheduling decision by an
intelligent agent according to the workshop
feature vector, optimizing deep neural network parameters according to a reward function, and updating the workshop information; and realizing product process planning and workshop collaborative online scheduling based on the trained
intelligent agent. Real-time and efficient operation of the production
scheduling system can be guaranteed, so that the
production line keeps continuous and stable operation, and the production efficiency is improved.