Reinforced learning method for dynamically optimizing logistics scheduling and path planning in machining process

A processing and reinforcement learning technology, applied in neural learning methods, logistics, biological neural network models, etc., can solve problems such as the inability to automatically adjust real-time dynamic logistics scheduling schemes, and ignoring dynamic characteristics.

Active Publication Date: 2019-11-12
HUAZHONG UNIV OF SCI & TECH
View PDF9 Cites 21 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In view of the above defects or improvement needs of the prior art, the present invention provides a reinforcement learning method for dynamic optimization of logistics scheduling and path planning in the process of processing. structure and dynamic characteristics, build and train the reinforcement learning decision-making model, and realize the au...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Reinforced learning method for dynamically optimizing logistics scheduling and path planning in machining process
  • Reinforced learning method for dynamically optimizing logistics scheduling and path planning in machining process
  • Reinforced learning method for dynamically optimizing logistics scheduling and path planning in machining process

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0079] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention. In addition, the technical features involved in the various embodiments of the present invention described below can be combined with each other as long as they do not constitute a conflict with each other.

[0080] Such as figure 1 , figure 2 As shown, a kind of reinforcement learning method for logistics scheduling and path planning in a dynamic optimization process of a preferred embodiment of the present invention includes the following steps:

[0081] Step 1: build a reinforcement learning decision model, the decision model accepts the total state matrix at any time as input;

[0082] The re...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a reinforcement learning method for dynamically optimizing logistics scheduling and path planning in a machining process, and belongs to the field of intelligent manufacturing.The method comprises the following steps: constructing a total state matrix of logistics scheduling at a certain moment as the input of the neural network; constructing a reward and punishment valueaccording to the total time length of all operation units waiting for materials in the primary processing process and the total number of conflict times of the AGVs, establishing a loss function of aneural network according to the reward and punishment value, training the neural network to maximize the reward and punishment value obtained in the final primary processing process, and obtaining a reinforcement learning decision model; and then for a new processing task, establishing a total state matrix at the current moment in real time, and inputting the total state matrix into the reinforcement learning decision model to obtain an action needing to be executed by the AGV at the current moment. According to the method, autonomous optimal path planning of the AGV in the machining process can be realized, and the technical problem that the logistics scheduling scheme cannot be dynamically and automatically adjusted in real time in the machining process in the prior art is solved.

Description

technical field [0001] The invention belongs to the field of intelligent manufacturing, and more specifically relates to a reinforcement learning method for logistics scheduling and path planning in a dynamically optimized processing process. Background technique [0002] In processing-intensive and discrete manufacturing fields such as molds and lithium battery equipment, the manufacturing process includes a series of complex, multi-process, and coupled processing technologies, which are customized, small-batch, large-scale, and multi-variety manufacturing. During its processing, resources such as materials, components, and equipment are diversified and have a wide range of dynamic characteristics. Therefore, the management and supply efficiency of material resources in the processing process directly affect the efficiency of the manufacturing process, which cannot be ignored. [0003] In the logistics scheduling process, the AGV trolley performs the transportation task of...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06Q10/04G06Q10/08G06Q50/04G06N3/08
CPCG06N3/08G06Q10/047G06Q10/08355G06Q50/04Y02P90/30
Inventor 张云郭飞周华民黄志高李德群
Owner HUAZHONG UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products