Three-dimensional reconstruction method of single object, based on color depth camera

A technology of color depth and 3D reconstruction, applied in 3D modeling, image data processing, instruments, etc., can solve problems such as wrong local optimal solution, easy convergence, small total number of features, etc.

Active Publication Date: 2018-03-27
ZHEJIANG UNIV
View PDF5 Cites 31 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, due to the small proportion of a single object under ordinary camera settings, the total amount of its features is small, and the corresponding proportion of the total energy in the came

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Three-dimensional reconstruction method of single object, based on color depth camera
  • Three-dimensional reconstruction method of single object, based on color depth camera
  • Three-dimensional reconstruction method of single object, based on color depth camera

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0054] Such as figure 1 As shown, the method of using a color depth camera for 3D reconstruction and texture mapping of a single object includes the following three steps, 1. Extracting the scanned object area during the scanning process; 2. Carrying out camera tracking and depth mapping based on the color depth data Local fusion of data, global non-rigid body registration of locally fused data, and the iterative optimization method to gradually build an overall 3D model and accurate camera position; 3. According to the key frame camera position and key frame color pictures obtained earlier , to calculate the texture map of the 3D mesh model.

[0055] The following examples and attached Figure 2-4 The present invention will be described in detail.

[0056] The three steps of this method are described in detail:

[0057] 1) Extract the scanned object area during the scanning process, such as figure 2 As shown, specifically: the object frame obtained by manual labeling, ob...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a three-dimensional reconstruction method of single object, based on a color depth camera. The three-dimensional reconstruction method of single object, based on a color depthcamera includes the three steps: 1) during the scanning process, extracting the scanned object area; 2) according to the color depth data, performing camera tracking and local fusion of the depth data, and performing global non rigid body registration on the locally fused data, and gradually constructing an overall three-dimensional model and the accurate key frame camera position; and 3) performing grid extraction on the fusion model, according to the obtained key frame camera position and the key frame color image, calculating the texture map of the three-dimensional grid model. The method framework of the three-dimensional reconstruction method of single object, based on the color depth camera can guarantee that even if the proportion of the object in the image is relatively smaller, geometrical reconstruction and texture mapping with high quality can still be performed when single object is reconstructed. The three-dimensional reconstruction method of single object, based on a color depth camera has the advantages of being clear, being high in speed, being robust in the result, and being able to be applied to the virtual reality scene construction field and the like.

Description

technical field [0001] The invention relates to the field of computer vision, in particular to a method in the field of three-dimensional reconstruction and texture mapping of a single object using a color depth camera. Background technique [0002] 3D reconstruction technology is a method of reconstructing 3D objects based on 2D input. Traditional 3D reconstruction methods include StructureFromMotion (SfM), which mainly reconstructs 3D objects from a large number of color images. In recent years, with the development and commercialization of depth cameras such as Kinect, 3D reconstruction techniques based on color depth images have been extensively studied. The 3D reconstruction technology based on color depth images can be used to reconstruct dense and fine object models for the construction of virtual reality environments, combining current virtual reality and augmented reality hardware and software to provide a 3D interactive experience. [0003] 3D reconstruction algo...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T17/00G06T7/13G06T7/187G06T7/292
CPCG06T17/00G06T2207/10016G06T2207/10028G06T7/13G06T7/187G06T7/292
Inventor 许威威许佳敏鲍虎军
Owner ZHEJIANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products