Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Three-dimensional reconstruction system and method for electronic microscopic scene

A technology of three-dimensional reconstruction and electron microscopy, applied in the field of microscopic vision, can solve the problems of inability to obtain object texture information, inability to obtain texture information, and not suitable for microscopic scenes, and achieve the effect of rich texture information.

Active Publication Date: 2018-03-27
UNIV OF ELECTRONIC SCI & TECH OF CHINA
View PDF12 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Traditional 3D reconstruction, such as binocular 3D reconstruction, reconstructs the 3D information of the scene based on the geometric relationship between the two 3D images captured by the camera, but the defocused image of the microscopic scene cannot obtain a complete texture information; laser scanning 3D reconstruction can only obtain 3D data, but cannot obtain the texture information of the object itself, that is, the restoration information is incomplete, and it is not suitable for common microscopic scenarios such as biological research, material analysis, and quality inspection; feature-based The statistical learning method is based on a large target database. Through the learning method, each target in the database is extracted, and then a probability function is established for the features of the reconstructed target. Finally, the reconstructed target and the similar target in the database are combined. The degree of similarity is expressed as the size of the probability, and the depth of the target with the highest probability is taken as the depth of the reconstruction target, and combined with texture mapping or interpolation methods for 3D reconstruction, it is possible to perform 3D reconstruction with only one picture, but the biggest difficulty lies in Obtain a complete database of large objects, also less suitable for microscopic scenarios

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Three-dimensional reconstruction system and method for electronic microscopic scene
  • Three-dimensional reconstruction system and method for electronic microscopic scene
  • Three-dimensional reconstruction system and method for electronic microscopic scene

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0053] figure 1 It is a flowchart of a three-dimensional reconstruction method in an electron microscope scene of the present invention.

[0054] In this example, if figure 1 As shown, the present invention provides a three-dimensional reconstruction method under an electron microscope scene, comprising the following steps:

[0055] S1. Using an electron microscope to obtain images to be fused with different focal lengths

[0056] Use a pair of Milon KTF position sensors to locate the upper limit position and lower limit position required for 3D reconstruction, and the DSP device sends out control instructions, which are converted into pulse signals by a digital-to-analog converter to control the rotation of the servo motor to drive the object distance screw alignment of the lens barrel. The focus is rotated at a fixed angle for multiple times, and the control command is transmitted to the industrial camera through the USB control line, and the image of the microscope is sho...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a three-dimensional reconstruction system and method for an electronic microscopic scene. The method comprises the steps: collecting an image sequence of corresponding frames at a certain step through an electronic microscope, carrying out the segmentation processing of the images, carrying out the compiling of the images into a dictionary, solving a sparse coefficient, carrying out the fusion, and carrying out the recovery of the images to generate a clear image. In the specific embodiments, the focusing motion adjustment is completed through the combination of a stepping motor and a screw. The approximate object distance difference of all frames is calculated through a control signal and a positioning height, thereby achieving the three-dimensional reconstruction,and solving a problem of insufficient three-dimensional information caused by a small field depth in a microscopic scene.

Description

technical field [0001] The invention belongs to the field of microscopic vision technology, and more specifically, relates to a three-dimensional reconstruction system and method in an electron microscopic scene. Background technique [0002] With the development of computer vision technology, 3D modeling technology has provided strong technical support in the fields of industrial inspection, quality control, archaeology and biological research, and its wide application has also made great progress in computer vision. Such as binocular stereo vision, texture method, contour method, motion method and statistical learning method. [0003] At present, due to the short depth of field of optical microscopes, rich three-dimensional information cannot be seen when observing objects, especially when the surface of the object is of different heights, no clear image can be obtained at any focal length. Therefore, the 3D reconstruction method in the microscopic scene requires multi-fo...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T19/20G06T7/33G06K9/46
CPCG06T7/33G06T19/20G06T2207/20221G06V10/462
Inventor 刘珊杨波郑文锋武鹏
Owner UNIV OF ELECTRONIC SCI & TECH OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products