Dynamic model three-dimensional rebuilding method, apparatus and device, and storage medium

A 3D reconstruction and dynamic model technology, applied in 3D modeling, image data processing, instruments, etc., can solve the problem of poor 3D reconstruction experience of the dynamic model of the target object, and achieve a good interactive experience of the 3D reconstruction of the dynamic model of the target object. Effect

Active Publication Date: 2018-11-13
SHENZHEN GRADUATE SCHOOL TSINGHUA UNIV
View PDF4 Cites 13 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The dynamic 3D model of the target object reconstructed by the above 3D reconstruction method generally only contains the structural information of the ...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Dynamic model three-dimensional rebuilding method, apparatus and device, and storage medium
  • Dynamic model three-dimensional rebuilding method, apparatus and device, and storage medium
  • Dynamic model three-dimensional rebuilding method, apparatus and device, and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0032] figure 1 It is a flow chart of a dynamic model 3D reconstruction method provided by Embodiment 1 of the present invention. This embodiment is applicable to situations where a dynamic 3D model of a target object with color information needs to be reconstructed. This method can be implemented by a dynamic model 3D reconstruction device. Execution, wherein the means may be implemented by software and / or hardware. Such as figure 1 As shown, the method specifically includes:

[0033] S110. Acquire the current frame depth image of the target object and the current frame color image corresponding to the current frame depth image.

[0034] Among them, the depth image is a three-dimensional grayscale image, the horizontal and vertical coordinates of the depth image correspond to the position of each pixel, and the gray value of each pixel represents the distance between the pixel and the camera, that is, each pixel in the depth image can represent a point in space with three-...

Embodiment 2

[0046] figure 2 It is a flow chart of a method for three-dimensional reconstruction of a dynamic model provided by Embodiment 2 of the present invention. In this embodiment, on the basis of the above-mentioned embodiments, the color information of each vertex in the reconstruction model of the second target object will be determined according to the key frames in the current frame color image and the preceding color image, and further optimized as : According to whether the current frame color image satisfies the preset condition, determine the current color image key frame corresponding to the depth image of the current frame; use the current color image key frame and each preceding color image key frame to determine the second The color information of each vertex in the reconstruction model of the target object; wherein, each preceding color image key frame is each key frame determined before the current color image key frame. Such as figure 2 As shown, the method specif...

Embodiment 3

[0058] image 3 It is a flow chart of a method for three-dimensional reconstruction of a dynamic model provided by Embodiment 3 of the present invention. This embodiment is further optimized on the basis of the foregoing embodiments. Such as image 3 As shown, the method specifically includes:

[0059] S310. Acquire the current frame depth image of the target object and the current frame color image corresponding to the current frame depth image.

[0060] S320. Obtain a second target object reconstruction model by using the current frame depth image and the first target object reconstruction model.

[0061] S330. Calculate a first ratio of the number of vertices of the model corresponding to the fusion of the current frame color image and the front color image to the number of vertices of the complete target object model.

[0062] Wherein, the number of vertices of the complete target object model is definitely known, and there are differences according to different target...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

Embodiments of the invention disclose a dynamic model three-dimensional rebuilding method, apparatus and device, and a storage medium. The dynamic model three-dimensional rebuilding method comprises the steps of acquiring a current frame depth image of a target object and a current frame color image corresponding to the current frame depth image; obtaining a second target object reconstruction model by utilizing the current frame depth image and a first target object reconstruction model; and according to the current frame color image and a key frame in a front color image, determining color information of each vertex in the second target object reconstruction model, wherein the first target object reconstruction model is a target object reconstruction model corresponding to a previous frame depth image, the second target object reconstruction model is a target object reconstruction model corresponding to the current frame depth image, and the front color image is each frame color image obtained before the current frame color image. According to the rebuilding method, apparatus and device, good interactive target object dynamic model three-dimensional rebuilding experience is provided for a user.

Description

technical field [0001] Embodiments of the present invention relate to the technical fields of computer graphics and computer vision, and in particular, to a method, device, device and storage medium for three-dimensional reconstruction of a dynamic model. Background technique [0002] 3D object dynamic models are widely used in many fields such as virtual reality and 3D games. Therefore, 3D reconstruction of object dynamic models is an important issue in the field of image data processing. [0003] There are mainly three kinds of existing 3D reconstruction methods for dynamic models of objects, namely laser scanning-based 3D reconstruction methods, slice-based 3D reconstruction methods, and image-based 3D reconstruction methods. The dynamic 3D model of the target object reconstructed by the above 3D reconstruction method generally only contains the structural information of the target object without combining other image information, resulting in poor user experience in 3D r...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T17/00
CPCG06T17/00G06T2207/10016G06T2207/10024
Inventor 方璐刘烨斌许岚戴琼海
Owner SHENZHEN GRADUATE SCHOOL TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap