Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Three-dimensional point cloud processing method, device and equipment

A three-dimensional point cloud and processing method technology, applied in image data processing, 3D image processing, instruments, etc., can solve the problems of easy loss of spatial local detail geometric information, large memory footprint, and multiple computer resources, etc., to alleviate data loss. and the effect of redundancy problems

Active Publication Date: 2020-04-17
SHENZHEN INST OF ADVANCED TECH
View PDF4 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, when processing point cloud data, because 3D point cloud data is different from images, 3D point cloud data is non-normalized, multi-view projection technology projects the non-normalized 3D point cloud into a 2D image, and then 2D Image processing. At present, the point cloud data needs to be converted into other data formats, such as projecting the 3D point cloud to a 2D image, as the input of the convolutional neural network; but this process has the following disadvantages: (1) Due to occlusion, the projection process itself will cause some data loss
(2) The calculation amount of the data conversion process is relatively large;
[0005] The voxel representation will cause data redundancy, which will cause a large memory footprint and consume more computer resources, and it is easy to lose the geometric information of spatial local details.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Three-dimensional point cloud processing method, device and equipment
  • Three-dimensional point cloud processing method, device and equipment
  • Three-dimensional point cloud processing method, device and equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0055] Embodiment 1 of the present invention discloses a processing method of a three-dimensional point cloud, such as figure 1 shown, including the following steps:

[0056] Step 101, obtaining point cloud data including multiple points;

[0057]Specifically, the collection of the point cloud data may be collected by a laser device, a stereo camera or a time-of-flight camera. The point cloud data collection of three-dimensional objects can be carried out by adopting the data collection method based on point cloud automatic splicing. The method of optimizing coordinate transformation parameters achieves precise registration of point clouds from different angles.

[0058] In a specific embodiment, the method further includes: by rotating the points in the point cloud data, and / or making the point coordinates of the points in the point source data perturb within a predetermined range around the point, to Enhance the point cloud data;

[0059] And / or, randomly delete the poin...

Embodiment 2

[0099] The embodiment of the present invention also proposes a processing device for a three-dimensional point cloud, such as Figure 5 shown, including:

[0100] An acquisition module 201, configured to acquire point cloud data comprising a plurality of points;

[0101] The input module 202 is used to input the point cloud data into a pre-trained convolutional neural network; the convolutional neural network includes: a convolutional module for sharing geometric feature information;

[0102] The processing module 203 is used to obtain, for each point in the point cloud data, the neighbor points of the point in Euclidean space based on the convolution module, and determine the feature value of the point based on the neighbor points of the point in Euclidean space Neighbors in space;

[0103] The aggregation module 204 is used to aggregate the adjacent points of the point in the Euclidean space and the adjacent points of the point in the eigenvalue space to obtain the aggrega...

Embodiment 3

[0107] The embodiment of the present invention also proposes a three-dimensional point cloud processing device, including a memory, a processor, and a computer program stored in the memory and operable on the processor, and the processor executes the computer program Realize the steps of the processing method of the three-dimensional point cloud in embodiment 1 at the same time.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a three-dimensional point cloud processing method, device and equipment. The method comprises the following steps: acquiring point cloud data comprising a plurality of points; inputting the point cloud data into a pre-trained convolutional neural network; the convolutional neural network comprises a convolution module for geometric feature information sharing; for each pointin the point cloud data, obtaining a neighbor point of the point in the Euclidean space based on the convolution module, and determining a neighbor point of the point in the feature value space basedon the neighbor point of the point in the Euclidean space; aggregating the neighbor points of the points in the Euclidean space and the neighbor points of the points in the feature value space to obtain aggregated features; and performing feature learning on the aggregated features by using a multi-layer perceptron, and performing maximum pooling operation on the dimensions of the neighbor pointsto obtain output features. A convolution structure is directly constructed to process three-dimensional point cloud data, so that the problems of data missing and data redundancy are effectively relieved.

Description

technical field [0001] The invention relates to the field of three-dimensional data processing, in particular to a processing method, device and equipment for a three-dimensional point cloud. Background technique [0002] Point cloud (full name in English is Point Cloud) is a collection of point data on the product appearance surface obtained by measuring instruments in reverse engineering. In addition to geometric positions, point cloud data also has color information. The color information is usually obtained through the camera to obtain the color image, and then the color information (RGB) of the pixel at the corresponding position is assigned to the corresponding point in the point cloud. The acquisition of intensity information is the echo intensity collected by the receiving device of the laser scanner. This intensity information is related to the surface material, roughness, incident angle and direction of the target, as well as the emission energy of the instrument a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T15/00G06N3/04
CPCG06T15/005G06N3/045
Inventor 乔宇徐名业周志鹏
Owner SHENZHEN INST OF ADVANCED TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products