Weak-texture workpiece, and method and system for recognizing and detecting three-dimensional pose

A detection method and a technology of three-dimensional pose, which is applied in character and pattern recognition, image data processing, computer parts, etc., can solve the problems of complex data acquisition and processing, inability to obtain accurately, high application scenarios, etc., and achieve the improvement of three-dimensional pose Estimation accuracy, interference avoidance, and simple system construction

Inactive Publication Date: 2016-12-21
SHANGHAI JIAO TONG UNIV
View PDF5 Cites 35 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The existing weak-textured workpiece recognition and 3D pose estimation methods have the following technical problems: 1) The workpiece recognition based on 2D images is highly suitable for application scenarios, and it can only be used in factories to capture and analyze workpieces on the assembly line. At the same time, it is also required that the background of the conveyor belt and the workpiece have a certain contrast, otherwise it is difficult to meet the requirements
The three-dimensional pose information of the workpiece required for robot grinding or assembling parts cannot be accurately obtained; 2) Realizing workpiece recognition based on a 3D camera, data acquisition and processing are more complicated, and the amount of calculation is large, and most of them are only applicable to bin-picking scenarios 3D pose acquisition of a single workpiece

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Weak-texture workpiece, and method and system for recognizing and detecting three-dimensional pose
  • Weak-texture workpiece, and method and system for recognizing and detecting three-dimensional pose
  • Weak-texture workpiece, and method and system for recognizing and detecting three-dimensional pose

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] This embodiment relates to a recognition and detection system for a weak texture workpiece and its three-dimensional pose, including: a vision sensor module, a recognition module, and a control module. The vision sensor module outputs the color image of the target workpiece and the corresponding depth image to the transmission To the recognition module, the recognition module generates a series of templates according to the built-in 3D model of the target workpiece, and transmits the detected 3D pose information of the target workpiece to the control module. The control module converts the 3D pose information of the target workpiece into absolute and / or relative Coordinate system and generate operation instructions to achieve precise operation.

[0026] Such as figure 1 As shown, the method for recognizing a weakly textured workpiece and estimating a three-dimensional pose provided by this embodiment includes four steps: target workpiece template creation, two-dimensional t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a weak-texture workpiece, and a method and a system for recognizing and detecting the three-dimensional pose. After a color image of a target workpiece acquired by an RGB-D sensor and a gradient pattern template library are subjected to image pyramid search based on a similarity evaluation function, a three-dimensional point cloud is built on a depth image according to a matching result, and finally, through filtering and iterative closest point computation on the three-dimensional point cloud, the precise three-dimensional pose of the target workpiece is obtained. An industrial robot can accurately and intelligently recognize the weak-texture workpiece and acquire the three-dimensional pose information, and tasks such as grinding and assembling on the workpiece can be completed.

Description

Technical field [0001] The invention relates to a technology in the field of graphics processing, in particular to a method and system for identifying and detecting weak-textured workpieces and their three-dimensional poses. Background technique [0002] With the continuous development of machine vision technology, industrial robots can rely on intelligent vision systems to automatically and accurately complete tasks such as workpiece grasping, processing, polishing, and assembly. In the past, these tasks often required workers to teach and assist the robot. To be completed well, the introduction of machine vision technology will greatly improve product quality and production efficiency. The purpose of workpiece recognition and 3D pose estimation is to recognize workpieces of different types and structures and obtain their 3D position and pose information relative to the visual sensor, which is used to guide industrial robots to automatically complete the grasping, processing, gr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/00G06K9/62
CPCG06T2207/10024G06T2207/30164G06F18/22
Inventor 张昊若曹其新邱强王力宇
Owner SHANGHAI JIAO TONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products