Three-dimensional reconstruction method, point cloud fusion method, device, equipment and storage medium

A fusion method and point cloud technology, applied in the field of data fusion, can solve the problems of low fusion efficiency, no technical solutions, low precision, etc., and achieve the effect of improving the efficiency of point cloud fusion and simplifying the process of point cloud fusion

Active Publication Date: 2022-04-22
JIHUA LAB
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] 3D reconstruction can be carried out based on the fusion of point cloud data collected in various ways. The existing point cloud fusion method needs to pre-process the point cloud information when merging the point cloud data collected by unmanned vehicles and the point cloud data collected by drones. Labeling, there are problems of low fusion efficiency and low accuracy
[0006] For the above problems, there is no effective technical solution

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Three-dimensional reconstruction method, point cloud fusion method, device, equipment and storage medium
  • Three-dimensional reconstruction method, point cloud fusion method, device, equipment and storage medium
  • Three-dimensional reconstruction method, point cloud fusion method, device, equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0157] This embodiment takes a complete 3D reconstruction process as an example to illustrate the 3D reconstruction method provided in the second aspect of the application, and the specific reconstruction process is as follows:

[0158] S301. Obtain the orthophotographic, OSGB and oblique photographic models through the drone, obtain the original image and POS data of the drone for the orthophotographic, OSGB (oblique photographic data) and oblique photographic models, and perform aerotriangulation processing, using The SFM (structure-from-motion) algorithm performs multi-element and multi-angle image matching to generate a dense matching point cloud, which is used as the first point cloud information;

[0159] S302. Obtain the scene point cloud through the on-board RGBD camera or Lidar of the unmanned vehicle, and obtain the precise pose information of the driving track of the unmanned vehicle based on the RTK ground station, so as to analyze and obtain the point cloud sequenc...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention relates to the field of data fusion technology, and specifically discloses a three-dimensional reconstruction method, point cloud fusion method, device, equipment and storage medium, wherein the fusion method includes the following steps: obtaining the first point cloud information and point cloud sequence information; The self-attention mechanism converts the point cloud sequence information into the second point cloud information set by the fusion parameters; according to the confrontational self-supervised learning algorithm, the comparison loss function about the first point cloud information and the second point cloud information is designed; based on the reverse The propagation algorithm uses gradient descent to update the fusion parameters until the contrast loss function converges to determine the best fusion parameters; according to the best fusion parameters, the first point cloud information and point cloud sequence information are fused to obtain the fusion point cloud information; the fusion The fusion process of the method does not need to pre-label the point cloud information, realizes the fusion of data collected by drones and unmanned vehicles, simplifies the process of point cloud fusion, and improves the efficiency and accuracy of point cloud fusion.

Description

technical field [0001] The present application relates to the technical field of data fusion, in particular, to a three-dimensional reconstruction method, a point cloud fusion method, a device, a device, and a storage medium. Background technique [0002] 3D reconstruction is a research hotspot in the field of computer vision and computer graphics, which aims to recover the given reality-based data into a geometric model. [0003] One of the key points of 3D reconstruction technology is how to obtain the depth information of the target scene or object. Under the condition that the depth information of the scene is known, the three-dimensional reconstruction of the scene can be realized through the registration and fusion of point cloud data. [0004] In the 21st century, with the emergence of various depth cameras for ordinary consumers, 3D scanning and reconstruction technology based on depth data has developed rapidly. [0005] 3D reconstruction can be carried out based ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06T7/50G06V10/80G06K9/62G06N3/04G06N3/08
CPCG06T7/50G06N3/08G06T2207/10028G06T2207/20081G06T2207/20084G06N3/048G06N3/045G06F18/25
Inventor 张晟东王济宇焦家辉张立华邓涛李志建古家威蔡维嘉
Owner JIHUA LAB
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products