Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A 3D reconstruction method of highly reflective surface structured light field based on point cloud adaptive restoration

An adaptive repair and 3D reconstruction technology, which is applied in the field of 3D reconstruction of objects with high reflective areas, can solve the problems of 3D model data holes, inability to have large areas of high reflectivity areas, limited reflectivity, etc., to achieve improved Reconstruction effect and precision, effects that improve accuracy and believability

Active Publication Date: 2022-06-07
HUBEI UNIV OF TECH
View PDF9 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The traditional optical three-dimensional measurement technology is limited to a certain extent by the reflectivity of the surface of the measured object, and it is required that there should be no large areas of high reflectivity on the surface of the measured object.
However, in the industrial application process, the surface of the part will become very bright after processing. When using traditional optical three-dimensional measurement technology to measure the part, it is necessary to collect the part image through the camera. Due to the high reflectivity of the part surface, it will cause There are large areas of overexposure in the collected images, which leads to large data holes in the reconstructed 3D model of the part

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A 3D reconstruction method of highly reflective surface structured light field based on point cloud adaptive restoration
  • A 3D reconstruction method of highly reflective surface structured light field based on point cloud adaptive restoration
  • A 3D reconstruction method of highly reflective surface structured light field based on point cloud adaptive restoration

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0058] The technical solutions of the present invention will be further described below with reference to the accompanying drawings and embodiments.

[0059] The invention discloses a three-dimensional reconstruction method of a highly reflective surface structured light field based on point cloud self-adaptive repair and a corresponding reconstruction system evaluation method; and proposes a sub-aperture image extraction method based on image stitching for a focusing light field camera . Light field imaging technology can simultaneously record the position information and direction information of light. Therefore, compared with traditional cameras, light field cameras can capture four-dimensional light field information. By extracting the four-dimensional light field information, a multi-view image of the scene can be obtained. Aperture images, and due to different viewing angles, there is a certain complementarity in the stored information between the sub-aperture images. L...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method for three-dimensional reconstruction of light field of highly reflective surface structure based on point cloud self-adaptive restoration. Firstly, a structured light field 3D reconstruction system is built to extract multi-view light field sub-aperture images; then, the reconstruction system is calibrated, the sinusoidal fringe sequence is projected onto the reference plane, and the reference plane is moved and recorded by a focusing light field camera at each moving distance. The phase change on the reference plane, and the phase value of each pixel point at the initial position, can get the phase difference-depth of field (moving distance) mapping relationship, and the multi-view 3D point can be reconstructed through the sub-aperture image extraction algorithm and the mapping relationship cloud. Finally, there is a certain complementarity between the reconstructed multi-view point cloud data. The data holes in the target point cloud can be iteratively repaired by the same position of other view point clouds, so as to realize the complete 3D reconstruction of highly reflective surface objects. Besides, for the reconstruction result, the present invention proposes a corresponding evaluation method.

Description

technical field [0001] The invention relates to a three-dimensional reconstruction method, in particular to a three-dimensional reconstruction method of an object with a highly reflective area. Background technique [0002] Optical 3D measurement methods have the advantages of full-field acquisition, non-contact, low cost, high precision, and fast processing, and are now widely used in academic research and industry. The traditional optical three-dimensional measurement technology is limited to a certain extent by the reflectivity of the surface of the object to be measured, and it is required that there should not be a large area of ​​high reflectivity on the surface of the object to be measured. However, in the process of industrial application, after the parts are processed, the surface will become very bright. When using the traditional optical 3D measurement technology to measure the parts in 3D, it is necessary to collect the images of the parts through the camera. Th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06T17/00G06T7/80G06T7/62G06T7/30G06T7/00G06T3/40
CPCG06T17/00G06T7/85G06T7/62G06T7/30G06T7/0004G06T3/4038G06T2207/10028G06T2207/30164
Inventor 冯维曲通高俊辉程雄昊周世奇祝振敏张福民赵大兴
Owner HUBEI UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products