Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A behavior control method of yellow peach core-digging robot based on deep reinforcement learning

A technology of reinforcement learning and robotics, applied in the direction of program control manipulators, instruments, manipulators, etc., can solve problems such as inability to fully guarantee the quality of digging cores, difficult behavior strategy control, and difficulty in recruiting people in canning factories

Active Publication Date: 2019-06-21
DALIAN UNIV OF TECH
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Because food production has high hygienic requirements, workers must wear work clothes, work boots, hats and masks that cover the whole body. The production season of canned yellow peaches is concentrated in July and August, and the weather is extremely hot, which makes the workers suffer from psychological and physical stress. The test made it very difficult for the cannery to recruit people
In addition, the quality of manual core digging has advantages and disadvantages depending on individual differences, and the quality of core digging cannot be fully guaranteed
For the robot used for core digging, due to the different shapes of the peach cores of yellow peaches, it is difficult to use the traditional mechanical control method to control the behavior strategy of core digging

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A behavior control method of yellow peach core-digging robot based on deep reinforcement learning
  • A behavior control method of yellow peach core-digging robot based on deep reinforcement learning
  • A behavior control method of yellow peach core-digging robot based on deep reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0039] The specific embodiments discussed are merely illustrative of implementations of the invention, and do not limit the scope of the invention. Embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings.

[0040] The overall process of the algorithm is as follows figure 1 shown. The details will be described below.

[0041] 1. Feature extraction.

[0042] Create a training set and a test set. Among them, 10,000 yellow peach profiles are used as the training set, which are divided into 360 categories (each category has a 1° rotation angle), and the test set contains 500 yellow peach profiles. The images in the training and test sets are labeled. The walnut state is obtained using a convolutional neural network (CNN) with 5 layers. In order to train the CNN model under the caffe platform, the yellow peach profiles are encoded continuously through a unified naming method, and the original data is converted into t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention belongs to the technical field of computer application and artificial intelligence, and relates to a behavior control strategy of a yellow peach core digging robot based on deep reinforcement learning. Aiming at the problem that the traditional mechanical control method is difficult to effectively control the behavior of the yellow peach core digging robot, this invention proposes a method based on deep reinforcement learning to control the behavior of the yellow peach core digging robot with visual functions, in order to improve its work performance. This patent utilizes the perception ability of deep learning and the decision-making ability of intensive learning, so that the robot can use deep learning to identify the state of the peach pit, and then guide the single-chip microcomputer to control the motor to dig out the peach pit through the method of intensive learning, so as to finally complete the task of digging the pit. The present invention has advantages for the core digging task that utilizes machines instead of human labor.

Description

technical field [0001] The invention belongs to the technical field of computer application and artificial intelligence, and relates to a behavior control method of a yellow peach core digging robot based on deep reinforcement learning. Background technique [0002] With the development of society and technological progress, the emergence of social problems such as labor shortage and rising labor prices have greatly promoted the research, application and popularization of industrial robots. In recent years, the research and application of industrial robots has been one of the hot spots of scientific research and social concern. However, due to technical factors such as high dexterity, high stability, and high environmental tolerance required by industrial robots, the development and application of industrial robots have been plagued. The early industrial robots were the product of mechatronics, and as the market's requirements for the performance of industrial robots contin...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/62G06N3/04G06F17/50B25J9/16
CPCB25J9/1679G06F30/20G06N3/045G06F18/24G06F18/214
Inventor 葛宏伟林娇娇孙亮赵明德
Owner DALIAN UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products