Unlock instant, AI-driven research and patent intelligence for your innovation.

Non-cooperative target pose measurement method, system and terminal equipment based on deep neural network

A deep neural network and non-cooperative target technology, applied in the field of close-range non-cooperative target pose measurement, to meet real-time requirements, improve algorithm speed and matching accuracy, and achieve high-precision effects

Active Publication Date: 2021-06-29
SHENZHEN GRADUATE SCHOOL TSINGHUA UNIV
View PDF10 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In order to solve the problems of the point cloud data processing method in the prior art, the present invention provides a method, system and terminal equipment for measuring the pose of a short-distance non-cooperative target based on a deep neural network

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Non-cooperative target pose measurement method, system and terminal equipment based on deep neural network
  • Non-cooperative target pose measurement method, system and terminal equipment based on deep neural network
  • Non-cooperative target pose measurement method, system and terminal equipment based on deep neural network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0028] The PointNet network is aimed at point cloud classification and segmentation tasks in the field of stereo vision, and has achieved good results in various mainstream databases. The starting point of the algorithm design is to solve the disorder problem of point cloud data. In the initial stage, each point is treated identically and independently, and in the basic setup, each point consists of its three coordinates. The key to this method is to use max pooling as a symmetric function, so that the extracted feature vector can ignore the disorder of point cloud data.

[0029]Due to the out-of-order problem of point cloud data, it is difficult for the network to learn a consistent mapping from input to output. In order to make the neural network model not be affected by the sorting of input data, there are three solutions: the first is to sort the input data in a canonical order, which sounds simple, but in high-dimensional space, there is actually no one Stable point per...

Embodiment 2

[0054] Such as figure 2 As shown, the present invention also provides a non-cooperative target pose measurement system based on a deep neural network, including:

[0055] The first unit: down-sampling the data point cloud P and the model point cloud Q of different angles of the non-cooperative target to obtain the point cloud P', Q';

[0056] The second unit: use the trained PointNet network model to perform feature extraction on the point cloud P', Q' to obtain the feature matrix A containing the feature vector of each point n×1024 and the global eigenvector B 1×1024 ;

[0057] The third unit: filter the feature points of the point cloud P', Q' according to the preset feature point detection and screening threshold, and according to the global feature vector B 1×1024With the point cloud P', Q' the eigenmatrix A containing the eigenvectors of each point n×1024 Perform feature point matching to obtain feature point sets P", Q";

[0058] The fourth unit: perform point clou...

Embodiment 3

[0068] This embodiment is a simulation verification of a non-cooperative target pose measurement method based on a deep neural network. The performance of the above algorithm is evaluated by using the Bunny 3D point cloud data in the Stanford University Graphic Laboratory dataset. In the experiment, the results of feature point detection are visualized first, and then the algorithm is compared with the traditional geometric feature descriptor FPFH to verify the real-time performance and accuracy of the algorithm.

[0069] Such as image 3 Shown is a schematic diagram of the original data before pose estimation in this embodiment. by right image 3 The original data in is down-sampled to get a new point cloud.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention provides a non-cooperative target pose measurement method, system and terminal equipment based on a deep neural network. The method includes: down-sampling data point clouds and model point clouds of different angles of non-cooperative targets to obtain point clouds; A good PointNet network model extracts the feature matrix containing the feature vector of each point and the global feature vector; according to the preset feature point detection and screening threshold, the feature points of the downsampled point cloud are screened, and the feature points are matched to obtain Feature point set; perform point cloud registration on the feature point set to obtain a pose transformation matrix; apply the pose transformation matrix to the downsampled data point cloud to obtain a new point cloud, and combine the new point cloud with the downsampled Point cloud registration of the model point cloud to obtain a new pose transformation matrix. The method of the invention satisfies the real-time requirements of the pose measurement based on the space non-cooperative target on the basis of ensuring relatively high precision.

Description

technical field [0001] The present invention relates to the technical field of short-range non-cooperative target pose measurement, in particular to a method, system and terminal equipment for short-range non-cooperative target pose measurement based on a deep neural network. Background technique [0002] Deep learning is based on the training of complex deep neural networks based on a large amount of data training samples, so it has a strong feature extraction function and surpasses traditional computer vision algorithms in many fields, especially computer vision, such as the ImageNet visual recognition challenge. Tasks such as object classification, recognition and detection. One of the reasons for the success of deep learning in processing two-dimensional images is that the regular convolution kernel sharing mechanism can be used in the two-dimensional image matrix arranged in an array, which greatly reduces the number of parameters of the neural network. However, due to...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/00G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06V40/10G06N3/045G06F18/241
Inventor 刘厚德刘兵高学海王学谦梁斌
Owner SHENZHEN GRADUATE SCHOOL TSINGHUA UNIV