Workpiece pose estimation method based on component model expression

A component model and pose estimation technology, which is applied in the field of computer vision, can solve the problems of inability to handle weakly textured objects and low adaptability

Active Publication Date: 2019-08-06
UNIV OF ELECTRONIC SCI & TECH OF CHINA
View PDF4 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The technical problem to be solved by the present invention is to provide a workpiece pose estimation method based on component model expression, which solves the proble

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Workpiece pose estimation method based on component model expression
  • Workpiece pose estimation method based on component model expression
  • Workpiece pose estimation method based on component model expression

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0043] The present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments. The present invention can be realized on Windows and Linux platforms, and the programming language can also be selected, and can be realized by using Python.

[0044] Such as figure 1 Shown, the present invention a kind of workpiece pose estimation method based on component model expression, comprises the following steps:

[0045] Step 1: Perform data enhancement on the data to be detected, perform random cropping, scaling, and rotation operations on the image, and then reset the image size to keep the same size and resolution as the original image;

[0046] Step 2: Extract the features of the image through the convolutional neural network to obtain feature maps of 3 scales;

[0047] Step 3: Express each feature map through the component model to express the network structure, and obtain the corresponding scores and model response map...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a workpiece pose estimation method based on component model expression, and the method comprises the following steps: carrying out the data enhancement of to-be-detected data,and obtaining a processed image; carrying out feature extraction on the image through a convolutional neural network to obtain feature maps of three scales; expressing a network structure of each feature map through a component model to obtain corresponding scores and model response maps of the whole and the components; performing parameter optimization on all the model response graphs to obtain acomprehensive response graph and key points; calculating n 3D points in the space through an EPnP algorithm to be matched with 2D points in the image, and then obtaining the corresponding pose of thecamera. According to the method, information marking only needs to be carried out on the whole workpiece, component information of the workpiece serves as recessive features, effective components areautomatically found through the neural network to carry out component marking, and the method has the advantages of being rapid and efficient in performance and capable of accurately calculating the6D pose of weak-texture objects such as the workpiece in real time.

Description

technical field [0001] The invention relates to the field of computer vision, in particular to a workpiece pose estimation method based on component model expression. Background technique [0002] In practical applications, it is very critical to obtain the 3D information of the target object. For example, in the task of manipulator grasping manipulation, recognizing the 6D pose (3D positioning and 3D orientation) of an object provides useful information for grasping and motion planning. The difficulty of estimating the pose of a workpiece is that the workpiece is a weakly textured object, which is easily affected by light and reflection, so that the texture reflected from the 2D image may not be the real texture of the 3D object surface. Moreover, when the resolution of the image changes, the calculated texture may have a large deviation, and the feature extraction algorithm is not easy to identify. In the actual process of pose estimation, there are still objective facto...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T7/73G06N3/04G06N3/08
CPCG06T7/75G06N3/08G06T2207/30164G06T2207/10012G06N3/044G06N3/045
Inventor 杨路涂文哲康甲
Owner UNIV OF ELECTRONIC SCI & TECH OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products