Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Real-time three-dimensional modeling method and system based on depth image acquisition equipment

A technology for collecting equipment and depth images, which is applied in the field of 3D modeling, can solve the problems of complex and expensive equipment, low modeling accuracy, and high cost, and achieve the effect of reducing cost, reducing complexity, and simple equipment structure

Active Publication Date: 2018-06-19
北京物语科技有限公司
View PDF5 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The 3D modeling method based on binocular stereo vision technology needs to perform complex calculations such as distortion correction and stereo matching on two images with parallax. The modeling speed is slow, the real-time performance is poor, and the modeling accuracy is low.
The modeling method based on the 3D laser scanner is complicated and expensive, and the cost is high, so it cannot be widely used

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Real-time three-dimensional modeling method and system based on depth image acquisition equipment
  • Real-time three-dimensional modeling method and system based on depth image acquisition equipment
  • Real-time three-dimensional modeling method and system based on depth image acquisition equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0024] Such as figure 1 As shown, a real-time three-dimensional modeling method based on a depth image acquisition device provided in this embodiment includes:

[0025] In step S1, image data and depth data of an object to be reconstructed are acquired from multiple angles through multiple depth image acquisition devices.

[0026] Wherein, the depth image collection device is a device that can collect images and the depth corresponding to the images, and an rgb-d camera (such as Kinect) can be selected, and the rgb-d camera can directly output image data and depth data. Depth image acquisition equipment can also use a combination of camera and distance measuring device. Through calibration, the relationship between the image data output by the camera and the depth data output by the distance measuring device can be obtained, but it must be ensured that the image data collected by the camera is consistent with The depth data output by the ranging device are in the same proport...

Embodiment 2

[0044] Based on the same inventive concept as the above-mentioned real-time 3D modeling method, this embodiment provides a real-time 3D modeling system based on depth image acquisition equipment, including: multiple depth image acquisition equipment and processing units that have been calibrated in advance; Multiple depth image acquisition devices are connected to the processing unit;

[0045] The depth image acquisition device is used to acquire image data and depth data from different angles of the object to be reconstructed, and output them to the processing unit;

[0046] The processing unit is used to integrate all the depth data according to the calibration order to obtain the first ordered lattice; extract the points belonging to the foreground image in the first ordered lattice; Position information and the spatial geometric relationship obtained through calibration, calculate the coordinates of the points belonging to the foreground image in the first ordered lattice ...

Embodiment 3

[0049] When shooting an object, at least 3 cameras are needed to obtain a complete image of the object, and the 3 cameras need to be arranged in an equilateral triangle. Therefore, on the basis of Embodiment 2, in order to simplify the system, reduce costs, and ensure the accuracy of modeling, this embodiment provides another real-time 3D modeling system based on depth image acquisition equipment, including pre-calibrated 3N depth image acquisition devices and processing units. 3N depth image acquisition devices are all connected to the processing unit. N is a natural number greater than 0. The positions of every three depth image acquisition devices form an equilateral triangle. N groups of depth image acquisition devices shoot the object to be reconstructed from different angles. The shooting directions of the 3N depth image acquisition devices all point to the object to be reconstructed. Each depth image acquisition device acquires data at an angle of 60 degrees. The obje...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention belongs to the technical field of three-dimensional modeling and particularly relates to a real-time three-dimensional modeling method and system based on depth image acquisition equipment. Image data and depth data of an object are obtained from multiple angles through multiple depth image acquisition equipment, the three-dimensional space coordinates of a three-dimensional model are determined through a space geometry relationship, the surface of the model is quickly reconstructed through three adjacent points in a space, the surface of the model is mapped through the image data, and the true color and texture of the surface of the object are restored. The invention provides the real-time three-dimensional modeling method and system based on depth image acquisition equipment, the modeling process is efficient and simple, three-dimensional modeling can be completed in real time, the high-precision modeling can be realized through the depth image acquisition equipment, atthe same time, the color and texture of the surface of the object can be truly restored, the structure of implementation equipment is simple, and the cost of the three-dimensional modeling is greatlyreduced.

Description

technical field [0001] The invention relates to the technical field of three-dimensional modeling, in particular to a real-time three-dimensional modeling method and system based on a depth image acquisition device. Background technique [0002] The 3D model of an object is used in a wide range of fields, such as design simulation, virtual reality, 3D movies and other fields. Existing 3D modeling methods include binocular stereo vision technology, 3D laser scanner modeling, etc. The 3D modeling method based on binocular stereo vision technology needs to perform complex calculations such as distortion correction and stereo matching on two images with parallax. The modeling speed is slow, the real-time performance is poor, and the modeling accuracy is low. The modeling method based on the three-dimensional laser scanner is complicated and expensive, and the cost is high, so it cannot be widely used. Contents of the invention [0003] Aiming at the defects in the prior art,...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/529G06T7/50G06T17/10
CPCG06T17/10G06T2207/10004
Inventor 胡伟
Owner 北京物语科技有限公司
Features
  • Generate Ideas
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More