Robot grabbing data set establishing device and method based on teaching and deep learning

A deep learning and building method technology, applied in the field of robotics, can solve the problems of network performance degradation, high time cost and time cost, poor simulation data migration, etc., and achieve the effect of low hardware equipment cost

Pending Publication Date: 2022-01-28
SHANGHAI JIAO TONG UNIV
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0010] In view of the above-mentioned defects of the prior art, the technical problem to be solved by the present invention is that the time cost and time

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Robot grabbing data set establishing device and method based on teaching and deep learning
  • Robot grabbing data set establishing device and method based on teaching and deep learning
  • Robot grabbing data set establishing device and method based on teaching and deep learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0046] The following describes several preferred embodiments of the present invention with reference to the accompanying drawings, so as to make the technical content clearer and easier to understand. The present invention can be embodied in many different forms of embodiments, and the protection scope of the present invention is not limited to the embodiments mentioned herein.

[0047] In the drawings, components with the same structure are denoted by the same numerals, and components with similar structures or functions are denoted by similar numerals. The size and thickness of each component shown in the drawings are shown arbitrarily, and the present invention does not limit the size and thickness of each component. In order to make the illustration clearer, the thickness of parts is appropriately exaggerated in some places in the drawings.

[0048] The invention provides a complete set of technical solutions for quickly establishing a capture data set based on manual tea...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a robot grabbing data set establishing device and method based on teaching and deep learning, and relates to the field of robots. The method comprises the steps: 1, adopting a demonstrator for demonstrating grabbing poses on a target object, extracting grabbing part point clouds from a scene according to grabbing space, and carrying out manual scoring and label data labeling while data are collected; 2, rapidly training a six-degree-of-freedom grabbing pose evaluation network by using the collected label data; 3, quickly collecting point cloud data of the actually captured scene by adopting a continuous frame shooting mode; and 4, sampling six-degree-of-freedom grabbing poses on the actually grabbed scene point cloud, and evaluating and scoring each sampling pose by using the trained six-degree-of-freedom grabbing pose evaluation network so as to complete automatic generation of a label of the scene point cloud. According to the method, the technical difficulty that the hardware cost and the time cost for generating and establishing the six-degree-of-freedom grabbed data set in the past are relatively high is solved.

Description

technical field [0001] The present invention relates to the field of robots, in particular to a device and method for establishing a robot grasping data set based on teaching and deep learning. Background technique [0002] The disorderly grasping of arbitrary objects by robots is a classic research problem in the field of robotics. According to the input of visual sensors, robots predict the grasping pose of six degrees of freedom in the action space. Robots generally use two-finger grippers to grasp objects. action. Most of the prediction methods of the six-degree-of-freedom grasping pose are data-driven. Through the end-to-end neural network model, the sensor information in the form of point cloud is input, and the prediction of the grasping pose is output. [0003] The pose estimation algorithm for grasping any object based on machine learning is often data-driven and requires a large amount of labeled data to train the network model. Building a data set that can be us...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T7/73G06T7/00G06V10/774G06V10/82G06V10/44G06K9/62
CPCG06T7/73G06T7/0004G06T2207/10028G06T2207/20081G06T2207/20084G06F18/214
Inventor 吴建华田林睿熊振华朱向阳盛鑫军
Owner SHANGHAI JIAO TONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap