Logistics scheduling planning method based on graph neural network and reinforcement learning

A neural network and reinforcement learning technology, applied in the field of graph neural network and reinforcement learning, can solve problems such as only training, inapplicable supervised learning, and inability to obtain labels, so as to reduce production costs, eliminate collection costs, and achieve strong practical value. Effect

Pending Publication Date: 2021-12-28
TIANJIN UNIV
View PDF3 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] While most successful machine learning techniques fall into the domain of supervised learning, i.e. learning a mapping from training inputs to outputs, supervised learning is not suitable for most combinatorial optimization problems because

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Logistics scheduling planning method based on graph neural network and reinforcement learning
  • Logistics scheduling planning method based on graph neural network and reinforcement learning
  • Logistics scheduling planning method based on graph neural network and reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0049]The technical solution of the present invention will be further described below in conjunction with the accompanying drawings and embodiments.

[0050] Such as figure 1 As shown, it is a schematic diagram of the overall flow of the logistics scheduling planning method based on graph neural network and reinforcement learning technology of the present invention. Overall process of the present invention is described in detail as follows:

[0051] Step 1: Sort the remaining unvisited nodes in ascending order according to the distance from the last added vehicle node. If the distances are equal, then sort them in ascending order according to the node's requirements; choose the node that is sorted first, and add the node that results in the least increase in distance And for the node with the smallest demand, use the greedy algorithm to generate a solution for the vehicle route planning problem instance, and add it to the current feasible solution set; iterate the above proce...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a logistics scheduling planning method based on a graph neural network and reinforcement learning. The method comprises the following steps: step 1, constructing a complete solution of a vehicle path planning problem instance; step 2, selecting a disturbance controller or a lifting controller by the element controller; after the lifting controller is selected, the lifting operator set forms an action space of the lifting controller; training the graph neural network in the action space; step 3, carrying out de-lifting; step 4, if the meta controller selects a disturbance controller, the disturbance controller randomly selects a disturbance operator to disrupt and reconstruct a feasible solution, and then iterative lifting is carried out to find an optimal solution; and step 5, selecting a solution with the minimum total path length in all visited feasible solutions in the lifting and disturbance process as an optimal solution and a final output solution of the whole algorithm. Compared with the prior art, the optimal solution of the given problem can be efficiently searched, and the method has practical significance for planning problems such as logistics and order distribution.

Description

technical field [0001] The invention relates to a graph neural network and reinforcement learning technology, in particular to a method for controlling the selection of a heuristic operator by combining a graph neural network and a strategy gradient algorithm in reinforcement learning. Background technique [0002] NP-hard combinatorial optimization problems are a class of integer-constrained optimization problems that are difficult to solve in large-scale optimization. Robust approximation algorithms for NP-hard combinatorial optimization problems have many practical applications, such as transportation, supply chain, energy, finance and The backbone of modern industries such as scheduling. A typical example is the Traveling Salesman Problem algorithm (Traveling SalesmanProblem, TSP), in this algorithm, given a graph, the goal is to search the permutation space, and find the minimum total edge weight and (tour length) optimal node sequence. TSP and its variants have count...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06Q10/04G06Q10/06G06N3/04G06N3/08
CPCG06Q10/047G06Q10/0631G06N3/08G06N3/045Y02T10/40
Inventor 马亿李峙钢郝建业
Owner TIANJIN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products