Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A mobile three-dimensional reconstruction method based on multi-view photometric stereo

A photometric stereoscopic and three-dimensional reconstruction technology, applied in 3D modeling, image data processing, instruments, etc., can solve problems such as inability to apply mobile reconstruction

Active Publication Date: 2019-06-21
OCEAN UNIV OF CHINA
View PDF3 Cites 14 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] This method aims at the limitation that the current photometric stereo mostly adopts multi-light source time-sharing shooting and cannot be applied to mobile reconstruction, and proposes a mobile 3D reconstruction method based on multi-view photometric stereo

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A mobile three-dimensional reconstruction method based on multi-view photometric stereo
  • A mobile three-dimensional reconstruction method based on multi-view photometric stereo
  • A mobile three-dimensional reconstruction method based on multi-view photometric stereo

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0055] A mobile three-dimensional reconstruction method based on multi-view photometric stereo proposed by the present invention, the camera device used has various forms, as shown in Figure 4, it is a non-integrated form, using a combination of equipment form light source 1 and camera 2, as another example Figure 5 For the integrated form, the combination of the light source 1 and the camera 2 in the form of modules is used, and the images taken in this method are taken by the inventor with a personal mobile phone.

[0056] Such as Figure 1-3 , the method includes the following steps:

[0057] S1. Calibration of camera 2 parameters and light source 1 calibration: first set the parameters of camera 2 so that they remain unchanged during the shooting process; calibrate the internal parameters of camera 2; The included angle of the light path of light source 1, which remains unchanged during the shooting process;

[0058] S2. Image acquisition: turn on the light source 1, ke...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a mobile three-dimensional reconstruction method based on multi-view photometric stereo. The method comprises the steps of camera parameter calibration and light source calibration; Collecting images, recording the first frame as a reference frame, and shooting a plurality of images around the reference frame; Obtaining the camera pose of each frame and the sparse three-dimensional point cloud of the target object; Performing single-frame normal estimation; And carrying out three-dimensional reconstruction on the target object, and completing the three-dimensional reconstruction under the reference frame visual angle through the above steps. According to the invention, high-precision three-dimensional reconstruction of the target object is completed in the moving state of the camera. According to the method, the requirement of the photometric stereo technology on equipment is simplified, only one camera and one light source are needed, and then the portability of the equipment in actual use is improved; Meanwhile, the method makes full use of the acquired camera pose and point cloud information, optimizes the calculation methods of key parts such as matching, improves the overall calculation speed of the method, enhances the practicability of the multi-view photometric stereo method, and can be further applied to real-time three-dimensional reconstruction application.

Description

technical field [0001] The invention belongs to the technical field of computer vision three-dimensional reconstruction, and relates to a mobile three-dimensional reconstruction method based on multi-view photometric stereo. Background technique [0002] Three-dimensional reconstruction is a research hotspot in computer vision. It refers to the process of obtaining data images of scene objects through cameras and auxiliary equipment, and reconstructing the three-dimensional information of objects in the real environment based on single-view or multi-view images. 3D reconstruction has a wide range of applications, including object 3D model building, 3D printing, stereoscopic display, 3D ranging, UAV obstacle avoidance navigation, augmented reality, etc. Equipment based on visual three-dimensional reconstruction methods such as laser line scanning, binocular stereo vision, and motion recovery structures have been applied to the market. [0003] Photometric stereo is a techniq...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T7/00G06T7/514G06T7/73G06T7/80G06T17/00
Inventor 范浩董军宇亓琳于慧王楠高洁
Owner OCEAN UNIV OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com