Three-dimensional object pose estimation method based on PVFH characteristics

A pose estimation, three-dimensional object technology, applied in computing, image data processing, instruments, etc., can solve problems such as low recognition accuracy, inability to recognize rotationally symmetric or mirror-symmetric objects, and difficulty in widely applying the Bin-picking system.

Active Publication Date: 2019-08-06
JINAN UNIVERSITY
View PDF10 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although these descriptors are used for 3D point cloud object recognition, although the recognition speed is fast, there are the following defects: cannot recognize rotationally symmetrical or mirror symmetrical objects
Therefore, the existing object recognition method based on global feature matching has low recognition accuracy and low robustness for such objects, and it is difficult to be widely used in Bin-picking systems.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Three-dimensional object pose estimation method based on PVFH characteristics
  • Three-dimensional object pose estimation method based on PVFH characteristics
  • Three-dimensional object pose estimation method based on PVFH characteristics

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0034] see figure 1 , which is a flow chart of the three-dimensional object pose recognition method of the present invention, the method includes an offline training stage and an online recognition stage. The online recognition phase is performed after the offline training phase is completed. Combine below Figure 2-7 , to describe each step of the two stages in detail.

[0035] 1. Offline training phase

[0036] The main purpose of this stage is to build a feature model library for feature matching in the subsequent online recognition stage. Include the following steps:

[0037] S1: Render the CAD model in different viewing directions, and obtain point clouds of multiple viewing angles of the CAD model. Obtaining steps:

[0038] S11: In three-dimensional space, construct a regular icosahedron containing the entire CAD model.

[0039] S12: Set up a virtual camera at the center or vertex of each face of the icosahedron, and each camera represents a viewing angle.

[004...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a three-dimensional object pose estimation method based on PVFH characteristics, and relates to a three-dimensional point cloud object pose estimation method. The invention provides an improved global feature descriptor PVFH. The descriptor is used for achieving three-dimensional point cloud object pose estimation. The method comprises the steps of in an offline stage, rendering from the CAD model to obtain point clouds of a plurality of visual angles, and extracting PVFH features of a part of the point clouds to establish a model library, segmenting a point cloud object from a scene in an online identification stage, then extracting PVFH features of the identified object, carrying out feature matching with a model library to obtain a roughly matched pose, and finally carrying out optimization by using an ICP algorithm to obtain an accurate pose. According to the method, the defect that a traditional global feature descriptor cannot identify a rotationally symmetrical or mirrored symmetrical object is overcome, and the robustness is high.

Description

technical field [0001] The invention belongs to the field of three-dimensional point cloud object recognition, in particular to a three-dimensional object pose estimation method based on global feature matching, which can be applied to a Bin-picking system. Background technique [0002] In the Bin-picking system, the pose recognition method of the object is required to have the characteristics of high recognition accuracy and fast recognition speed, so as to meet the working requirements of the fast and real-time grasping of the robot arm. Although in the field of 3D point cloud object recognition, there are many methods for object pose recognition (based on local feature matching, based on template matching), but the recognition accuracy and recognition speed of most of these methods cannot meet the fast real-time grasping of the robot arm. demand. [0003] The global feature is a descriptor that characterizes the overall characteristics of a point cloud object, which can ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/73G06T7/10
CPCG06T2207/10028G06T7/10G06T7/75
Inventor 柳宁王高李德平徐进
Owner JINAN UNIVERSITY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products