Check patentability & draft patents in minutes with Patsnap Eureka AI!

AGV path planning based on deep reinforcement learning

A technology of reinforcement learning and path planning, applied in two-dimensional position/channel control, etc., can solve problems such as failure to plan feasible paths and traditional algorithms falling into local minimum

Pending Publication Date: 2022-04-15
HANGZHOU DIANZI UNIV
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in more complex dynamic path planning problems, AGV needs to face more uncertainties in the environment. Traditional algorithms are easily trapped in local minimums, and may even fail to plan a feasible path.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • AGV path planning based on deep reinforcement learning
  • AGV path planning based on deep reinforcement learning
  • AGV path planning based on deep reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0034] The present invention will be further analyzed below in conjunction with the accompanying drawings and specific embodiments. The following embodiments or drawings are used to illustrate the present invention, but not to limit the scope of the present invention.

[0035] The present invention proposes an AGV path planning based on deep reinforcement learning, which specifically includes the following steps:

[0036]S1; build a simulation environment based on the ros operating system, and build an AGV model.

[0037] The ros operating system is a set of computer operating system architecture specially designed for robot software development. It is an open source meta-level operating system that provides services similar to the operating system, including hardware abstract description, low-level driver management, execution of shared functions, inter-program message passing, and program distribution package management. It also provides some tools and libraries. Programs ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses AGV path planning based on deep reinforcement learning. According to the AGV path planning based on deep reinforcement learning, a simulation environment and an AGV model are built according to a ros operating system; designing the state, action and reward of reinforcement learning, and building an algorithm framework of deep reinforcement learning; training the network, and enabling the AGV to learn a strategy from the environment; and the trained network is used to realize AGV path planning. According to the method, the optimal action is acquired from the original image acquired from the AGV camera, and the features are automatically extracted; the problem that a traditional algorithm is prone to falling into a local minimum value is solved. No priori knowledge of the environment is needed, the environment is explored by itself, and feasible strategies are learned. When the environment is changed in real time or the environment condition is complex, dynamic changes can be made to avoid dynamic obstacles, and a target point is reached.

Description

technical field [0001] The invention belongs to the field of artificial intelligence and relates to AGV path planning based on deep reinforcement learning. Background technique [0002] Since the 21st century, with the rapid development of science and technology, artificial intelligence technology has become the cutting-edge of science and technology. It is one of the important research topics of scientific research institutions, technology companies and major universities in various countries, and it also represents an important direction of future scientific and technological development. AGV (Automated Guided Vehicle) is called an automatic guided vehicle. In the field of industrial manufacturing, industrial AGV has become an important productivity. In addition to the field of industrial manufacturing, AGV also appears in all aspects of people's lives, from large shopping malls to parks to large hospitals, you can find the shadow of AGV. During the epidemic, the non-con...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G05D1/02
Inventor 王浩栋江爱朋吴文浩刘富春林雅媚
Owner HANGZHOU DIANZI UNIV
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More