Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method and system for reconstructing three-dimensional model of product

A three-dimensional model and product technology, applied in the field of three-dimensional modeling, can solve the problems of poor modeling effect and high robustness

Active Publication Date: 2017-11-17
SHANGHAI JIAO TONG UNIV
View PDF17 Cites 14 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The present invention aims at the defect that the existing technology does not have depth information optimization processing, and does not process smooth items and occlusion items, resulting in poor modeling effect, and proposes a product 3D model reconstruction method and system without calibration objects , high robustness, reducing the influence of imaging distortion, the 3D model has high reliability and robustness

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for reconstructing three-dimensional model of product

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] This embodiment relates to a product 3D model reconstruction system that implements the above method, including: a camera calibration module, a depth information acquisition module, and a model building module, wherein: the camera calibration module collects product images to obtain image pixels and coordinate points of the actual scene The mapping matrix between them; the depth information acquisition module obtains the depth information of the product; the model building module receives the mapping matrix and depth information, and obtains the three-dimensional model of the product through rendering and projection.

[0025] Such as figure 1 As shown, the product three-dimensional model reconstruction method for the above system includes the following steps:

[0026] Implementation settings: For the show car, control the camera to do a translation movement and 2 arbitrary movements, and take 4 photos (the photo pixel is 1200w);

[0027] Software and hardware requireme...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

A method and system for reconstructing a three-dimensional model of a product are provided. The method includes the steps of after acquiring a product image and calculating a homography matrix of a plane at infinity corresponding to the product image, obtaining a mapping matrix between pixel points of the product image and coordinate points of an actual scene by a Cholesky decomposition method; then establishing a network flow corresponding to the product, and calculating an optimal value of an energy function to obtain depth information of the product surface; and finally, according to the depth information and the mapping matrix, establishing a cube, dividing the cube into voxels, then updating the TSDF of each cube voxel, and performing rendering and projection to realize the reconstruction of a three-dimensional model. According to the invention, no calibration object is required, the robustness is high, the influence of imaging distortion is reduced, and the three-dimensional model has a high reliability and robustness.

Description

technical field [0001] The present invention relates to a technology in the field of three-dimensional modeling, in particular to a method and system for reconstructing a three-dimensional model of a product based on two-dimensional images. Background technique [0002] 3D reconstruction refers to 3D modeling of objects to display products more realistically and intuitively. Image-based 3D reconstruction can break through the real-time bottleneck and has been well developed. The existing 3D reconstruction requires high equipment precision and many restrictions in the camera calibration process. The modeling process in the 3D reconstruction process is complicated, the speed is slow, and the reconstruction accuracy cannot meet the requirements, so it cannot be applied to the 3D reconstruction of the actual product display model. Contents of the invention [0003] The present invention aims at the defect that the existing technology does not have depth information optimizat...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T17/00
CPCG06T17/00
Inventor 路丽菲蔡鸿明孙秉义孙晏
Owner SHANGHAI JIAO TONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products