Multi-sensor robot navigation method based on virtual environment and reinforcement learning

A reinforcement learning, multi-sensor technology, applied in the field of robotics, can solve the problems of long time-consuming learning network and complex algorithms

Active Publication Date: 2019-06-07
UNIV OF ELECTRONICS SCI & TECH OF CHINA
View PDF9 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In order to solve the problem that the algorithm in the robot navigation process is too complex and the training of the learning network takes too long in the prior art, a multi-sensor robot navigation method based on virtual environment and reinforcement learning is proposed.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-sensor robot navigation method based on virtual environment and reinforcement learning
  • Multi-sensor robot navigation method based on virtual environment and reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0036] The embodiments of the present invention will be further described below with reference to the accompanying drawings.

[0037] A multi-sensor robot navigation method based on virtual environment and reinforcement learning proposed by the present invention is realized by the following steps:

[0038] S1. Build a virtual environment. The virtual environment includes a multi-sensor robot and obstacles. The multi-sensor robot includes at least four sensors: radar, camera, compass and speed-measuring code wheel.

[0039] In this embodiment, the present invention constructs a virtual environment and performs algorithm training in it. The virtual environment is a simulation environment built for robots, which mainly includes two parts: simulated obstacles and simulated robots. Based on ROS and Gazebo to build a virtual environment, the multi-sensor robot is equipped with at least four types of sensors: lidar, compass, camera, and speed encoder. The parameters of various senso...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a multi-sensor robot navigation method based on virtual environment and reinforcement learning and belongs to the technical field of robots. According to the method of the invention, environmental information obtained by a radar, a camera, a compass and a speed measuring code disc sensor is adopted as input, and dimensionality reduction is performed on the image data captured by the camera through a convolution technique; a navigation strategy is pre-trained in a virtual environment, so that problems such as time-consuming and labor-consuming performance and insecurity during a robot physical training process can be avoided; and the navigation strategy which enables a robot to autonomously navigate, smoothly avoid obstacles, and efficiently reach a target position inthe virtual environment is obtained.

Description

technical field [0001] The invention belongs to the field of robot technology, in particular to a multi-sensor robot navigation method based on virtual environment and reinforcement learning. Background technique [0002] With the continuous progress of science and technology and the continuous development of intelligence, robots have been used more and more, and they have been more involved in daily production and life to assist or replace manpower. In the field of robotics, robot autonomous navigation technology is particularly indispensable and is one of the core technologies of mobile robots. Its purpose is to efficiently reach the target point without collision, human participation and other guidance. [0003] At present, autonomous navigation robots mostly rely on map creation and map planning, or traditional navigation based on sensor fusion. SUMMARY OF THE INVENTION [0004] In order to solve the problems that the algorithm is too complex in the robot navigation p...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G01C21/00G01C21/20G01S17/02G06N20/00
Inventor 俸东升叶茂徐培
Owner UNIV OF ELECTRONICS SCI & TECH OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products