Deep-reinforcement-learning-based indoor robot scene active recognition method

An indoor robot and reinforcement learning technology, applied in the field of active recognition of indoor robot scenes, can solve the problems of large amount of image information, slow computing speed, expensive devices, etc., and achieve the effect of improving computing efficiency, ensuring accuracy, and reducing sensor requirements

Active Publication Date: 2018-02-13
TSINGHUA UNIV
View PDF2 Cites 13 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The disadvantage of this device is that the device is relatively expensive, the structure is relatively complicated, and the amount of image information collected by the camera is huge, resulting in slow calculation speed.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Deep-reinforcement-learning-based indoor robot scene active recognition method
  • Deep-reinforcement-learning-based indoor robot scene active recognition method
  • Deep-reinforcement-learning-based indoor robot scene active recognition method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0017] A method for active recognition of indoor robots based on deep reinforcement learning proposed by the present invention is described in detail in conjunction with the accompanying drawings as follows:

[0018] The present invention proposes a method and embodiment of active recognition of indoor mobile robots based on deep reinforcement learning. The robot used in the method is a mobile robot, which is suitable for indoor scene recognition. The method includes reinforcement learning neural network N Q Training stage and indoor scene active recognition execution stage;

[0019] The reinforcement learning neural network N Q The training process is as follows figure 1 shown, including the following steps:

[0020] (1) Collect sonar ranging information and process it into a binary contour map to construct a classification neural network training sample set. The specific implementation steps are as follows:

[0021] (1-1) Constructing different types of indoor scenes. In ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a deep-reinforcement-learning-based indoor robot scene active recognition method, and belongs to field of machine learning and the technical field of robots. The method comprises the steps that a classification neural network NL capable of recognizing sonar information binaryzation contour figure ring projecting vectors is trained; a reinforcement learning training phase isentered, wherein scene recognition testing is conducted on a robot in a scene multiple times, and in the testing process, a reinforcement learning neural network NQ is trained and subjected to fittingto obtain a function approximator; when reinforcement learning neural network NQ finishes training, an execution phase is entered, wherein the robot indoor scene active recognition function is testedaccording to scene contour information collected by a sonar sensor. According to the method, on the basis of an extreme learning machine algorithm, the calculation efficiency is improved; on the basis of a reinforcement learning algorithm, the scene recognition accuracy rate is increased. The method can adapt to different scene recognition tasks, people does not need to be involved, the robot learns actively, and the scene recognition accuracy rate is increased automatically.

Description

technical field [0001] The invention relates to an active recognition method for an indoor robot scene based on deep reinforcement learning, which belongs to the field of machine learning and the field of robot technology. Background technique [0002] In recent years, robots have been more and more used in production and life, such as risk elimination, military detection, medical care, etc.; while the positioning and navigation of robots play a key role in realizing the above functions, quickly and accurately identify robots The environment is the prerequisite for accurate positioning of the robot. In the current scene recognition application, the robot trains the classification neural network through the sample data set collected by the sensor, which can only realize the passive recognition of the current scene; due to the limitation of the robot's orientation and the data limitation of the low-cost sensor, the accuracy of scene recognition is low. low. [0003] In a pri...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06N3/08
CPCG06N3/08
Inventor 刘华平柳杨王博文孙富春
Owner TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products