Lsd-slam-based real-scene three-dimensional reconstruction method

A 3D reconstruction and real scene technology, applied in the field of computer vision, can solve the problems of 3D model texture distortion, difficulty in popularization, and low efficiency

Active Publication Date: 2016-12-21
广州市绯影信息科技有限公司
View PDF6 Cites 44 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The usual 3D reconstruction method is to calibrate the camera first, that is, to calculate the relationship between the camera’s image coordinate system and the world coordinate system. Then use the information in multiple 2D images to reconstruct 3D information, and the 3D reconstruction based on photogrammetry Method In the beam adjustment process of photos, due to the distribution of residuals, the light is distorted, which makes the texture of the 3D model distorted and deformed, and the intuitive display effect is not as good as that of the panoramic image.
[0003] In order to ensure that the effect of 3D reconstruction meets the display requirements, panoramic images are usually used for 3D reconstruction at present. However, the 3D reconstruction of panoramic images requires the use of depth information. At present, the acquisition of depth information

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Lsd-slam-based real-scene three-dimensional reconstruction method
  • Lsd-slam-based real-scene three-dimensional reconstruction method
  • Lsd-slam-based real-scene three-dimensional reconstruction method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0019] like figure 1 As shown, a real-scene 3D reconstruction method based on lsd-slam includes the following steps: S1, record the scene to be modeled, and collect video data covering the modeled scene; S2, use lsd-slam modeling technology to solve Calculate the key frame pose to obtain the image of restored 3D information, and generate a 3D space point cloud; S3, select an image that can be stitched into a panorama from the image of the restored 3D information according to the spatial position relationship, and generate a panorama image; S4, convert the panorama The image and the 3D space point cloud are included in the same spatial reference system, and the 3D data is singly processed. Acquire and analyze video data to get key frames, analyze key frames to generate 3D space point cloud and panoramic image, realize 3D reconstruction through 3D space point cloud and panoramic image, do not calibrate the equipment, do not rely on special hardware equipment, and simultaneously ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an lsd-slam-based real-scene three-dimensional reconstruction method. The method comprises the steps of S1, recording a to-be-modeled scene, and collecting video data that covers the to-be-modeled scene; S2, resolving a key frame gesture from a key frame to obtain the restored images of the three-dimensional information based on the lsd-slam modeling technology, and generating a three-dimensional space point cloud; S3, selecting images for being spliced into a panoramic image out of all the restored images of the three-dimensional information according to the space location relationship, and generating the panoramic image; S4, putting the panoramic image and the three-dimensional space point cloud into the same spatial reference system, and subjecting three-dimensional data to the monomer treatment process. In this way, the key frame can be obtained through acquiring and analyzing video data. After that, the three-dimensional space point cloud and the panoramic image are generated through analyzing the key frame. The three-dimensional reconstruction is achieved based on the three-dimensional space point cloud and the panoramic image. Therefore, the calibration of equipment is not required and the method can be implemented without any hardware equipment. Meanwhile, panoramic data and model data are collected, so that the problems during the existing three-dimensional reconstruction process are solved.

Description

technical field [0001] The invention relates to a three-dimensional reconstruction method in the field of computer vision, in particular to a real scene three-dimensional reconstruction method based on lsd-slam. Background technique [0002] Three-dimensional reconstruction refers to the establishment of mathematical models suitable for computer representation and processing of three-dimensional objects. The usual 3D reconstruction method is to calibrate the camera first, that is, to calculate the relationship between the camera’s image coordinate system and the world coordinate system. Then use the information in multiple 2D images to reconstruct 3D information, and the 3D reconstruction based on photogrammetry Method In the beam adjustment process of photos, the distribution of the residuals leads to the distortion of the light, which makes the texture of the 3D model distorted and deformed, and the intuitive display effect is not as good as that of the panoramic image. ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T17/00
CPCG06T17/00G06T2200/08
Inventor 陆子龙
Owner 广州市绯影信息科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products