Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Incomplete point cloud completion method based on hidden space topological structure constraint

A topology and latent space technology, applied in the field of computer vision, can solve the problems of difficulty in perception, understanding and action planning of 3D models, inability to describe and represent complete geometric shapes, and incomplete 3D information. The effect of strong generalization and robustness

Pending Publication Date: 2021-08-03
NANJING UNIV OF AERONAUTICS & ASTRONAUTICS
View PDF0 Cites 18 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in the actual information collection process, due to the influence of factors such as occlusion, environmental noise, and equipment errors, the 3D information obtained directly (the present invention uses 3D point cloud as the representation form of 3D information) is often incomplete, and there is information loss, so It is impossible to describe and characterize the complete geometric shape of the object, which brings certain difficulties to the perception understanding and action planning based on the complete 3D model of the object in subsequent tasks

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Incomplete point cloud completion method based on hidden space topological structure constraint
  • Incomplete point cloud completion method based on hidden space topological structure constraint
  • Incomplete point cloud completion method based on hidden space topological structure constraint

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0042] In order to clearly illustrate the technical characteristics of this patent, the following describes this patent in detail through specific implementation methods and in conjunction with the accompanying drawings.

[0043] The present invention will firstly standardize the attitude of the input original incomplete 3D point cloud based on the cascaded deep neural network and massive artificially constructed 3D point cloud data sets, and then predict its corresponding potential sparse key points according to the normalized residual point cloud Skeleton, and finally based on the sparse key point skeleton through upsampling and recovery to obtain a complete dense 3D point cloud.

[0044] The three-dimensional point cloud data has high complexity, and has the characteristics of disordered arrangement and rotation invariance. It is difficult to complete the objects with unknown structures well by the completion method based on geometric relationship optimization. Therefore, th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an incomplete point cloud completion method based on hidden space topological structure constraints, and belongs to the technical field of computer vision. On the basis of a three-dimensional shape complementing technology of the single-view incomplete point cloud, complementing the single-view incomplete point cloud obtained by converting the depth map to obtain a complete three-dimensional point cloud shape of the object, and realizing rapid reconstruction of geometric information of the perceived object. S1, collecting three-dimensional space coordinates of a target object; S2, performing point cloud attitude normalization on the original incomplete point cloud input by the system; S3, predicting a corresponding complete key point skeleton based on the attitude normalized incomplete point cloud; S4, based on the predicted complete key point skeleton, recovering a dense complete point cloud corresponding to the predicted complete key point skeleton; and S5, carrying out optimization of robot sensing task based on the complete three-dimensional point cloud. According to the method, shape completion can be carried out on the real three-dimensional point cloud of any pose, the generalization and robustness are higher, the application range is wide, the speed is high, and the anti-noise capability is high.

Description

technical field [0001] The invention relates to a cloud completion method for residual defects based on hidden space topological structure constraints, and belongs to the technical field of computer vision. Background technique [0002] As an application complex of modern computer, automatic control, mechanical manufacturing and other technologies, robots have extremely high autonomous decision-making and execution capabilities, and can replace humans to complete many complex tasks. The perception link in robot technology is an important interface for robots to realize environmental interaction. The robot interacts with the environment through perception means, and obtains various environmental object information to assist the operator in making decisions. With the development of computer vision technology in recent years, robot perception technology based on computer vision has been widely used. Robots collect three-dimensional information of objects through visual sensors ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T5/00G06T7/73G06T17/00G06N3/08
CPCG06T7/73G06T17/00G06N3/08G06T2207/10028G06T2207/20081G06T2207/20084G06T5/77
Inventor 彭聪朱一凡王雁刚
Owner NANJING UNIV OF AERONAUTICS & ASTRONAUTICS
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products