360-degree real-time three-dimensional reconstruction method for an object based on a consumption-level color depth camera

A color depth, real-time 3D technology, applied in 3D modeling, image analysis, instrumentation, etc., can solve the problems of small object proportion, small total amount of features, interference of scene features, etc., to improve quality and improve robustness Effect

Active Publication Date: 2019-01-18
ZHEJIANG UNIV
View PDF6 Cites 24 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The existing algorithm process cannot be directly used for 360-degree object reconstruction, mainly because the static object is blocked by the support surface. If the object is flipped, the positional relationship between the object and the support plane will change.
Furthermore, in the process of reconstructing a single object, the proportion of the object in the scene is small, the total amount of features is small, and it is easily disturbed by scene features, making it easy for camera tracking and global optimization algorithms to converge to a local optimal solution, and it is difficult to obtain a global Consistent 360-degree 3D model

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • 360-degree real-time three-dimensional reconstruction method for an object based on a consumption-level color depth camera
  • 360-degree real-time three-dimensional reconstruction method for an object based on a consumption-level color depth camera
  • 360-degree real-time three-dimensional reconstruction method for an object based on a consumption-level color depth camera

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0048] The present invention will be further described below in conjunction with accompanying drawing:

[0049] Such as figure 1 As shown, this embodiment provides a method for 360-degree real-time three-dimensional reconstruction of an object based on a consumer-grade color depth camera, which is divided into the following main steps:

[0050] (1) Automatically segment the target object and use it as the initial object frame to start the scanning and reconstruction process of the target object;

[0051] (2) Track the object frame frame by frame and extract the object depth data;

[0052] (3) Perform local fusion of fixed-frame object depth data, and perform global non-rigid body registration on all locally fused model segments at intervals of fixed frames to build a consistent global 3D model;

[0053] (4) After partial scanning is completed, flip the object and continue scanning, and estimate the camera pose transformation before and after flipping; (5) Repeat steps (1)-st...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a 360-degree real-time three-dimensional reconstruction method for an object based on a consumption-level color depth camera, belonging to the three-dimensional reconstructionfield, comprising the following steps: (1) automatically segmenting a target object as an initial object frame to start a scanning and reconstruction process of the target object; (2) tracking the object frame frame by frame to extract the depth data of the object; 3) carrying out local fusion on that depth data of a fixed frame object, registering all the partially fuse model segments into a global non-rigid body at intervals of fixed frames, and constructing a consistent global three-dimensional model; 4) after that partial scanning is completed, continuously scanning the flipped object, andestimating the camera posture change before and after the flip; 5) After 360-degree reconstruction, aligning all the color images of key frames with the model, and calculating texture mapping for themodel. The invention has the characteristics of fast reconstruction of a 360-degree model, robust results and high texture mapping quality.

Description

technical field [0001] The invention relates to the field of three-dimensional reconstruction, in particular to a method in the field of three-dimensional reconstruction and texture mapping of a single object using a color depth camera. Background technique [0002] 3D reconstruction technology is a method of reconstructing 3D objects based on 2D input. Including the StructureFromMotion (SfM) technique (Agarwal S, Snavely N, Simon I, et al. Building rome in a day Computer Vision, International Conference on. IEEE, 2009 using a series of 2D color images to reconstruct a sparse 3D point cloud or a dense 3D model) : 72-79.; Furukawa Y, Ponce J.Accurate, dense, and robust multiview stereopsis, IEEE Transactions on Pattern Analysis and Machine Intelligence, 2010, 32(8): 1362-1376.), Reconstruction of dense 3D based on 2D color depth images Modeling techniques (Newcombe R A, Izadi S, Hilliges O, et al. KinectFusion: Real-time dense surfacemapping and tracking, Mixed and Augmented...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & AuthorityApplications(China)
IPC IPC(8): G06T7/13G06T7/33G06T7/40G06T7/50G06T7/80G06T17/00
CPCG06T7/13G06T7/33G06T7/40G06T7/50G06T7/85G06T17/00
Inventor许威威许佳敏鲍虎军
OwnerZHEJIANG UNIV