Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Deep reinforcement learning-based behavior control method of yellow-peach stone digging robot

A technology of reinforcement learning and robotics, applied in the direction of program control manipulators, instruments, manipulators, etc., can solve problems such as difficult behavior policy control, difficulty in recruiting people in canning factories, and inability to fully guarantee the quality of digging cores, etc.

Active Publication Date: 2018-04-20
DALIAN UNIV OF TECH
View PDF6 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Due to the high hygiene requirements of food production, workers must wear work clothes, work boots, hats and masks that cover the whole body. The production season of canned yellow peaches is concentrated in July and August, and the weather is extremely hot, which makes the workers suffer from psychological and physical stress. The test made it very difficult for the cannery to recruit people
In addition, the quality of manual core digging has advantages and disadvantages depending on individual differences, and the quality of core digging cannot be fully guaranteed.
For the robot used for core digging, due to the different shapes of the peach cores of yellow peaches, it is difficult to use traditional mechanical control methods to control the behavior strategy of core digging.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Deep reinforcement learning-based behavior control method of yellow-peach stone digging robot
  • Deep reinforcement learning-based behavior control method of yellow-peach stone digging robot
  • Deep reinforcement learning-based behavior control method of yellow-peach stone digging robot

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0039] The specific embodiments discussed are merely illustrative of implementations of the invention, and do not limit the scope of the invention. Embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings.

[0040] The overall process of the algorithm is as follows figure 1 shown. The details will be described below.

[0041] 1. Feature extraction.

[0042] Create a training set and a test set. Among them, 10,000 yellow peach profiles are used as the training set, which are divided into 360 categories (each category has a 1° rotation angle), and the test set contains 500 yellow peach profiles. The images in the training set and test set are labeled. Walnut states were acquired using a convolutional neural network (CNN) with 5 layers. In order to train the CNN model under the caffe platform, the yellow peach profiles are continuously encoded through a unified naming method, and the original data is converted into...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention belongs to the technical fields of computer application and artificial intelligence, and relates to a deep reinforcement learning-based behavior control strategy of a yellow-peach stonedigging robot. For the problem that in traditional mechanical control methods, behavior control on yellow-peach stone digging robots is difficult to effectively carry out, the invention provides a deep reinforcement learning-based method carrying out behavior control on the yellow-peach stone digging robot with a visual function, and aims to improve working performance thereof. According to the method, perception ability of deep learning and decision-making ability of reinforcement learning are exerted, the robot is enabled to utilize deep learning to identify peach stone status, and then a single chip microcomputer is guided through a method of reinforcement learning to control motors to dig out a peach stone to finally complete a stone digging task. The method has advantages for utilizing machinery to replace manpower labor of stone digging tasks.

Description

technical field [0001] The invention belongs to the technical field of computer application and artificial intelligence, and relates to a behavior control method of a yellow peach core digging robot based on deep reinforcement learning. Background technique [0002] With the development of society and technological progress, the emergence of social problems such as labor shortage and rising labor prices have greatly promoted the research, application and popularization of industrial robots. In recent years, the research and application of industrial robots has always been one of the hot spots of scientific research and social concern. However, due to technical factors such as high dexterity, high stability, and high environmental tolerance required by industrial robots, the development and application of industrial robots have been plagued. The early industrial robots were the product of mechatronics, and as the market's requirements for the performance of industrial robots...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/62G06N3/04G06F17/50B25J9/16
CPCB25J9/1679G06F30/20G06N3/045G06F18/24G06F18/214
Inventor 葛宏伟林娇娇孙亮赵明德
Owner DALIAN UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products