Method of designing household sweeping robot based on deep reinforcement learning

A sweeping robot, enhanced learning technology, applied in the direction of instruments, two-dimensional position/channel control, vehicle position/route/altitude control, etc. The effect of versatility and task mobility, saving manpower engineering, and reducing the amount of engineering

Inactive Publication Date: 2017-08-25
BEIHANG UNIV
View PDF4 Cites 36 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Among them, the method of traversing the room is often that the sweeping robot keeps walking against a wall, forming a closed loop, and then gradually fills the blank space in the middle. This method takes a long di...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method of designing household sweeping robot based on deep reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0026] The technical solutions of the present invention will be further described below in conjunction with the accompanying drawings and embodiments.

[0027] The present invention is a design method of a household sweeping robot based on deep reinforcement learning. The working process of the sweeping robot is as follows:

[0028] figure 1 As shown, it specifically includes the following steps:

[0029] Step 1. The sweeping robot collects the original image data through the laser radar. The data refers to the distance from the laser radar to the obstacle at each coordinate angle on the polar coordinate system established with the laser radar as the origin and the horizontal plane as the plane. After the sweeping robot decodes the data, it sends the original data back to the PC through the wireless serial port;

[0030] Step 2. Through the BREEZYSLAM algorithm library, the system performs feature extraction on the original data obtained in step 1, calculates the transformat...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

A method of designing a household sweeping robot based on deep reinforcement learning comprises the following steps: (1) collecting an original image of the horizontal section of a room around a sweeping robot through a laser radar, and transmitting original data back to a computer via a wireless serial port; (2) carrying out SLAM (Simultaneous Localization and Mapping) on the original data, and after real-time localization of the sweeping robot and room mapping, processing the data and generating a 168*168 two-dimensional array; (3) building a CNN+LSTM neural network; and (4) training the sweeping robot, and giving corresponding return to the neural network according to whether the motion of the sweeping robot meets the expected requirement, in order to change the parameters of the neural network, wherein the sweeping robot can make independent decisions after training. Through the steps, the sweeping robot can find a target object in a strange scene in a relatively short period of time, and can avoid obstacles and plan a path automatically. A sweeping robot designed using the method is of certain versatility and task mobility.

Description

technical field [0001] The invention provides a design method of a household sweeping robot based on deep reinforcement learning, which belongs to the field of smart home. Background technique [0002] At present, more and more families use sweeping robots. When the sweeping robot on the market now enters a new environment to work, it must first traverse the entire room according to the algorithm to complete the mapping and positioning. Then build a semantic map, and finally do path planning, and then start cleaning the room. Among them, the method of traversing the room is often that the sweeping robot keeps walking against a wall, forming a closed loop, and then gradually fills in the blank space in the middle. This method takes a long distance and takes a lot of time. Likewise, path planning algorithms are not only complex and require a lot of computation and human engineering, but they are also not perfect enough to make a robot vacuum work on an optimal path. [0003...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G05D1/02
CPCG05D1/0214G05D1/0221G05D1/024
Inventor 王昊臣孔祥龙宋宇航张玉玺刘旭辉张子璇
Owner BEIHANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products