Method, device and apparatus for estimating point cloud object attitude based on deep learning

A pose estimation and deep learning technology, applied in the field of computer vision, can solve the problems of low accuracy of object pose, affecting accuracy, and complicated process.

Active Publication Date: 2018-12-07
深圳辰视智能科技有限公司
View PDF3 Cites 19 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] At present, in the research of deep learning methods for 3D point clouds, 3D point clouds are often projected onto 2D planes or converted into 3D voxels to adapt to the highly regularized input data format of convolutional neural networks, but in the data Artificial noise is often introduced during the conversion operation, and the calculation amount is often increased in order to remove the artificial noise. The process is more complicated, and the introduction of artificial noise will seriously affect the accuracy of the object pose assessment, which leads to the existing evaluation of the object pose. The accuracy rate is not high, which seriously affects the effect of the technology in the application field

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method, device and apparatus for estimating point cloud object attitude based on deep learning
  • Method, device and apparatus for estimating point cloud object attitude based on deep learning
  • Method, device and apparatus for estimating point cloud object attitude based on deep learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0091] The present invention provides a point cloud object pose estimation method based on deep learning, please refer to figure 1 , Which is a model diagram of a point cloud object pose evaluation method based on deep learning proposed by an embodiment of the present invention. See Figure 2 to Figure 7 , The method described in the embodiment of the present invention specifically includes the following steps:

[0092] S1: Obtain the data that needs to be learned, including the following steps:

[0093] S11. Select point cloud object files from the data set;

[0094] Specifically, a point cloud object file is selected from the public data set ModelNet40 (http: / / modelnet.cs.princeton.edu).

[0095] S12. Convert the selected point cloud object file .off file type to .obj file type;

[0096] Specifically, the point cloud object file .off file type selected in S11 is converted to the interface (off2obj command) provided by the Antiprism (www.antiprism.com group of programs used to create...

Embodiment 2

[0178] The application of the method for estimating the posture of a point cloud object based on deep learning described in the foregoing embodiment will be described in detail below with reference to specific cases.

[0179] S201. Select an original point cloud object file ending with .off from ModelNet40, and convert the .off file type into an .obj file type through the Antiprism code.

[0180] S202. Import the .obj file data through the blender software, and use the code to rotate the imported data at an interval of -25 degrees to 25 degrees by 1 degree, taking into account the independence of the X axis, Y axis, and Z axis to produce 51*51* 51 (51 is the number of categories that the network model needs to predict and classify for each axis rotation angle) a total of 130,000 data files with different rotation angles.

[0181] In this embodiment, the sparse point cloud and the dense point cloud, the rotation data generation scheme of the symmetric object and the asymmetric object ...

Embodiment 3

[0200] The embodiment of the present invention also provides a point cloud object pose estimation device based on deep learning, please refer to Figure 8 The device includes a data acquisition module 10 for mutual data interaction, a network model design module 20, a model training module 30, and a model prediction module 40.

[0201] The data acquisition module 10 is used to acquire data that needs to be learned.

[0202] The data acquisition module 10 includes a data selection unit 101, a file type conversion unit 102, an angle rotation saving unit 103, a file sorting unit 104, and a file dividing unit 105.

[0203] The data selection unit 101 is configured to select point cloud object files from a data set;

[0204] Specifically, a point cloud object file is selected from the public data set ModelNet40 (http: / / modelnet.cs.princeton.edu) through the data selection unit 101.

[0205] The file type conversion unit 102 is used to convert the selected point cloud object file .off file ty...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a method, device and apparatus for estimating the point cloud object attitude based on deep learning. The method comprises the steps of obtaining data requiredto be learnt; designing a network model; and performing model training and prediction. The design of the network model comprises the steps of modeling a point cloud object attitude estimation probleminto a non-distinctive multi-classification problem; designing a residual block structure to extract features; obtaining global feature through a maximum pooling layer according to extracted features; respectively sending the global features to three parallel multi-layer perceptrons to perform predicted category scoring on coordinate axes; performing final category prediction on features after predicted category scoring on the coordinate axes by using a classifier; carrying out equal-weight summation on loss values obtained after processing of the classifier, and enabling the sum to serve asan overall multi-classification loss function; and optimizing the multi-classification loss function by using adaptive moment estimation. The method provided by the embodiment of the invention can accurate estimate the point cloud object attitude so as to improve the accuracy of object attitude positioning and prediction.

Description

Technical field [0001] The present invention relates to the field of computer vision, in particular to a method, device and equipment for estimating the posture of a point cloud object based on deep learning. Background technique [0002] At present, in the research of deep learning methods for 3D point clouds, 3D point clouds are often projected onto 2D planes or converted into 3D voxels to adapt to the highly regular input data format of convolutional neural networks. Man-made noise is often introduced in the process of conversion operation. In order to remove man-made noise, the amount of calculation is often increased. The process is more complicated, and the introduction of man-made noise will seriously affect the accuracy of the object attitude evaluation, resulting in the existing evaluation of the object attitude The accuracy rate is not high, which seriously affects the effect of the technology in the application field. Summary of the invention [0003] In view of this, ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/73G06N3/04
CPCG06T7/75G06T2207/10028G06N3/045
Inventor 徐楷冯良炳陈先开
Owner 深圳辰视智能科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products