Supercharge Your Innovation With Domain-Expert AI Agents!

Complex large-scale scene-oriented three-dimensional reconstruction method based on GMS feature matching

A feature matching and three-dimensional reconstruction technology, applied in the field of three-dimensional reconstruction, can solve the problems of increasing error accumulation, difficult to eliminate errors, low efficiency of cluster adjustment algorithm, etc., and achieve the effect of solving serious drift.

Pending Publication Date: 2019-07-12
司岚光电科技(苏州)有限公司
View PDF7 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the efficiency of the bundle adjustment algorithm of this method is not high, and the algorithm takes too long
However, as the reconstruction scene continues to expand, the accumulation of errors will gradually increase, and the bundle adjustment will easily fall into a local optimal solution, and the errors will be difficult to eliminate

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Complex large-scale scene-oriented three-dimensional reconstruction method based on GMS feature matching
  • Complex large-scale scene-oriented three-dimensional reconstruction method based on GMS feature matching
  • Complex large-scale scene-oriented three-dimensional reconstruction method based on GMS feature matching

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0037] see Figure 24 As shown, a 3D reconstruction method for complex large-scale scenes based on GMS feature matching includes the following steps:

[0038] Step 1. The SLAM method combined with GMS feature matching is used to acquire the image and obtain the initial value of the camera pose.

[0039] In order to ensure the efficiency and accuracy of feature matching in the SLAM process. The present invention adopts a grid-based motion estimation (Grid-based Motion Statistics, GMS for short) feature matching. The core issue of feature matching is how to use the constraint of neighborhood consistency. Consistency is a strong constraint, but cannot have well-defined neighborhoods when features are sparse. This results in a large amount of calculation for consistency-based feature matching, which is difficult to implement. And GMS can effectively solve this problem. If the motion is smooth, then adjacent pixels will move with the feature. The smoothness of motion results ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a complex large-scale scene-oriented three-dimensional reconstruction method based on GMS feature matching. The method comprises the following steps of 1, obtaining an image byadopting an SLAM method fused with GMS feature matching, and obtaining an initial value of a camera pose; step 2, optimizing an initial value of a camera pose by adopting a two-three-dimensional feature point combined cluster adjustment method; and step 3, by using the optimized camera pose, carrying out back projection on pixels of each image to a world coordinate system to obtain point cloud data, and carrying out point cloud fusion by using a surfel deformation graph construction method to obtain a three-dimensional reconstruction model. According to the method, more complex large-scale scenes can be well coped with during three-dimensional reconstruction, good camera pose estimation can be achieved in a texture sparse area, and large rotation and translation of the camera can be wellachieved.

Description

technical field [0001] The invention belongs to the technical field of three-dimensional reconstruction, and in particular relates to a complex large-scale scene-oriented three-dimensional reconstruction method based on GMS feature matching. Background technique [0002] At present, the 3D reconstruction of scenes and objects has a wide range of applications in many fields such as human-computer interaction, virtual reality, games and movies. There is also an increasing demand for more complex and realistic 3D models. However, most of the current 3D reconstruction systems are based on the method of laser scanning. Although this method can obtain a relatively ideal 3D model, the cost of the system is very expensive. If more complex and realistic 3D models can be obtained as easily as photos and videos, then 3D models will be used in more fields, such as drones and unmanned vehicles to perceive their own orientation in real time when they are in motion, and carry out plannin...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T17/00G06T7/33
CPCG06T17/00G06T7/33G06T2207/10024G06T2207/10028Y02T10/40
Inventor 徐浩楠李长頔付晓凡
Owner 司岚光电科技(苏州)有限公司
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More