Laser point cloud super-resolution reconstruction method based on self-attention generative adversarial network

A technology of super-resolution reconstruction and laser point cloud, which is applied in the field of super-resolution of laser point cloud data, can solve problems such as uneasy self-adaptation, unstructured and irregular point cloud data, and improve feature extraction efficiency and reduce Network runtime, beneficial effect of light weight

Pending Publication Date: 2021-03-26
XIDIAN UNIV
View PDF0 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, this is a challenge for 3D point clouds because, unlike images, point cloud data is unstructured and irregular, and point clouds are usually the result of customer-grade scanning devices, which are often sparse, noisy and incomplete
Therefore, upsampling technology is particularly important, but the adaptation of image space technology to point sets is not simple

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Laser point cloud super-resolution reconstruction method based on self-attention generative adversarial network
  • Laser point cloud super-resolution reconstruction method based on self-attention generative adversarial network
  • Laser point cloud super-resolution reconstruction method based on self-attention generative adversarial network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] The present invention will be described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0029] An embodiment of the present invention provides a laser point cloud super-resolution reconstruction method based on a self-attention generative confrontation network, such as figure 1 As shown, the method is specifically implemented through the following steps:

[0030] Step 101: Use the feature extraction module of the generator network to perform point cloud deep feature extraction on the input unordered sparse point cloud set containing N points.

[0031] Specifically, the laser point cloud feature F(N×C) is extracted from the sparse point cloud input P of size N×d, where d is the dimension of the point cloud, that is, the spatial coordinates, distance, reflection intensity, etc., d= 3 That is, only consider the spatial three-dimensional coordinate information, and input the sparse point cloud of N×d into the feature extraction uni...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a laser point cloud super-resolution reconstruction method based on a self-attention generative adversarial network, and the method comprises the steps of carrying out the feature extraction of a laser point cloud image in a generator network, and obtaining the laser point cloud features; carrying out feature expansion on the laser point cloud features, and then carrying out coordinate reconstruction to obtain dense point cloud data; identifying the dense point cloud data to determine a corresponding confidence coefficient; pre-judging the corresponding dense point cloud data according to the confidence coefficient of the dense point cloud data, if the confidence coefficient value is close to 1, predicting that the input is possibly from target distribution with high confidence coefficient by the discriminator, otherwise, performing feature integration on the dense point cloud data by a generator to obtain an output feature; and training the adversarial networkthrough the output features to obtain final dense point cloud data. According to the invention, feature information sharing among different feature extraction units can be realized, the size of the model is reduced while the reconstruction precision is improved, and lightweight of the network model is facilitated.

Description

technical field [0001] The invention belongs to the field of laser point cloud data super-resolution, and in particular relates to a laser point cloud super-resolution reconstruction method based on self-attention generation confrontation network. Background technique [0002] With the continuous development of unmanned driving technology, algorithms such as 3D data display, 3D effect rendering, 3D target segmentation, detection and recognition based on laser 3D point cloud data have received more and more attention in recent years. However, the original 3D point cloud data collected by general lidar has shortcomings such as sparse distribution, poor uniformity, and obvious noise. The above shortcomings are also reflected in widely used public benchmark datasets such as KITTI and ScanNet. Therefore, before the subsequent processing and analysis of the original 3D point cloud data, it is necessary to preprocess it to improve the quality of the original point cloud data and pr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T3/40G06T5/50
CPCG06T3/4053G06T5/50G06T2207/10028G06T2207/20081G06T2207/20084
Inventor 秦翰林李莹延翔马琳林凯东杨硕闻乐阳张嘉伟姚迪
Owner XIDIAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products