Supercharge Your Innovation With Domain-Expert AI Agents!

A method, device, equipment and storage medium for three-dimensional reconstruction of a dynamic model

A technology of 3D reconstruction and dynamic model, which is applied in the fields of equipment, storage media, devices, and dynamic model 3D reconstruction methods, can solve problems such as poor experience in 3D reconstruction of dynamic models of target objects, and achieve good interactive 3D reconstruction of dynamic models of target objects The effect of experience

Active Publication Date: 2021-06-29
SHENZHEN GRADUATE SCHOOL TSINGHUA UNIV
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The dynamic 3D model of the target object reconstructed by the above 3D reconstruction method generally only contains the structural information of the target object without combining other image information, resulting in poor user experience for the 3D reconstruction of the dynamic model of the target object

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method, device, equipment and storage medium for three-dimensional reconstruction of a dynamic model
  • A method, device, equipment and storage medium for three-dimensional reconstruction of a dynamic model
  • A method, device, equipment and storage medium for three-dimensional reconstruction of a dynamic model

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0032] figure 1 It is a flow chart of a dynamic model 3D reconstruction method provided by Embodiment 1 of the present invention. This embodiment is applicable to situations where a dynamic 3D model of a target object with color information needs to be reconstructed. This method can be implemented by a dynamic model 3D reconstruction device. Execution, wherein the means may be implemented by software and / or hardware. Such as figure 1 As shown, the method specifically includes:

[0033] S110. Acquire the current frame depth image of the target object and the current frame color image corresponding to the current frame depth image.

[0034] Among them, the depth image is a three-dimensional grayscale image, the horizontal and vertical coordinates of the depth image correspond to the position of each pixel, and the gray value of each pixel represents the distance between the pixel and the camera, that is, each pixel in the depth image can represent a point in space with three-...

Embodiment 2

[0046] figure 2 It is a flow chart of a method for three-dimensional reconstruction of a dynamic model provided by Embodiment 2 of the present invention. In this embodiment, on the basis of the above-mentioned embodiments, the color information of each vertex in the reconstruction model of the second target object will be determined according to the key frames in the current frame color image and the preceding color image, and further optimized as : According to whether the current frame color image satisfies the preset condition, determine the current color image key frame corresponding to the depth image of the current frame; use the current color image key frame and each preceding color image key frame to determine the second The color information of each vertex in the reconstruction model of the target object; wherein, each preceding color image key frame is each key frame determined before the current color image key frame. Such as figure 2 As shown, the method specif...

Embodiment 3

[0058] image 3 It is a flow chart of a method for three-dimensional reconstruction of a dynamic model provided by Embodiment 3 of the present invention. This embodiment is further optimized on the basis of the foregoing embodiments. Such as image 3 As shown, the method specifically includes:

[0059] S310. Acquire the current frame depth image of the target object and the current frame color image corresponding to the current frame depth image.

[0060] S320. Obtain a second target object reconstruction model by using the current frame depth image and the first target object reconstruction model.

[0061] S330. Calculate a first ratio of the number of vertices of the model corresponding to the fusion of the current frame color image and the front color image to the number of vertices of the complete target object model.

[0062] Wherein, the number of vertices of the complete target object model is definitely known, and there are differences according to different target...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the present invention discloses a dynamic model three-dimensional reconstruction method, device, equipment and storage medium, wherein the dynamic model three-dimensional reconstruction method includes: acquiring the current frame depth image of the target object and the current frame color image corresponding to the current frame depth image image; using the current frame depth image and the first target object reconstruction model to obtain the second target object reconstruction model; according to the current frame color image and the key frame in the front color image, determine the vertex in the second target object reconstruction model Color information; wherein, the first target object reconstruction model is the target object reconstruction model corresponding to the previous frame depth image, the second target object reconstruction model is the target object reconstruction model corresponding to the current frame depth image, and the front color image Each frame of color image obtained before the current frame of color image. The embodiments of the present invention provide users with a good experience of interactive three-dimensional reconstruction of a dynamic model of a target object.

Description

technical field [0001] Embodiments of the present invention relate to the technical fields of computer graphics and computer vision, and in particular, to a method, device, device and storage medium for three-dimensional reconstruction of a dynamic model. Background technique [0002] 3D object dynamic models are widely used in many fields such as virtual reality and 3D games. Therefore, 3D reconstruction of object dynamic models is an important issue in the field of image data processing. [0003] There are mainly three kinds of existing 3D reconstruction methods for dynamic models of objects, namely laser scanning-based 3D reconstruction methods, slice-based 3D reconstruction methods, and image-based 3D reconstruction methods. The dynamic 3D model of the target object reconstructed by the above 3D reconstruction method generally only contains the structural information of the target object without combining other image information, resulting in poor user experience in 3D r...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06T17/00
CPCG06T17/00G06T2207/10016G06T2207/10024
Inventor 方璐刘烨斌许岚戴琼海
Owner SHENZHEN GRADUATE SCHOOL TSINGHUA UNIV
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More