Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

FIB-SEM super-resolution algorithm based on generative adversarial network

A FIB-SEM and super-resolution technology, which is applied in the field of FIB-SEM super-resolution algorithm, can solve problems such as artifacts, image dotted lines, singleness, etc., and achieve the effect of obvious texture, good effect, and simple and intuitive algorithm

Pending Publication Date: 2022-06-28
SOUTHWEST PETROLEUM UNIV
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] With the expansion of data sets and the continuous deepening of training model depth, the super-resolution technology of a single image has been developed rapidly, but at present, many super-resolution algorithms applied to FIB-SEM technology scanning images do not perform well
Many training sets are trained only with a single, fixed low-resolution and corresponding high-resolution images. This level of degradation cannot satisfy the real image scene evolution scanned by FIB-SEM technology.
On the other hand, the degradation model is more of an image model based on linear interpolation, but only after nonlinear processing such as tone correction and lossy compression, will the image reconstructed by the model appear dashed lines and artifacts
The application of high-resolution graph convolutional neural network and self-attention module in image super-resolution tasks has been successful, but most of the research is only based on the Euclidean distance between image pixels after imaging as a measure of image imaging effect. The cost function, this cost function does not intuitively reflect the human visual perception

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • FIB-SEM super-resolution algorithm based on generative adversarial network
  • FIB-SEM super-resolution algorithm based on generative adversarial network
  • FIB-SEM super-resolution algorithm based on generative adversarial network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0047] The discriminator module of the present invention is mainly used to convert a low-resolution image into a high-resolution image with two different feature vectors through a sampling interpolation algorithm, and use the vector feature as a criterion to judge the authenticity of the image resolution. This module is mainly divided into 6 steps. The low-resolution and high-resolution features are used as the division criteria, and the low-resolution and corresponding real high-resolution images are used as a set of training sets. According to the training set: test set: validation set = 7:2:1, and divide the image into two groups of high-resolution and low-resolution image data, calculate and optimize the training loss of the obtained image, and use the sigmoid activation function to activate the feature vector and send it to the discrimination module. Different index values ​​are used to judge the authenticity of the image resolution.

Embodiment 2

[0049] The generator module of the present invention is mainly used for converting a low-resolution image into a predetermined high-resolution image. This module is completed in 3 steps.

[0050] Specific steps are as follows:

[0051] Step1: Generate high-resolution images: Read in the low-resolution image data input by the discriminator, process the image data to generate 3*3 convolutional neural network + BN + PRelu modules and 8 residual modules, each residual The module consists of a 3*3 convolution kernel conv+BN+Relu+conv module, and assigns different channel numbers to it, and then uses a 3*3 convolutional neural network+BN+Relu module to control the output channel to 64 , with a step size of 1. After that, the shallow features obtained by the first convolution are combined with the corresponding convolution semantic features here, and then the super-resolution magnification is performed by convolution + PixelShuffle + PreLU, and the magnification size is N*W, N* H....

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to the technical field of image resolution processing, and discloses an FIB-SEM super-resolution algorithm based on a generative adversarial network, and the algorithm comprises a discriminator module which carries out the training of a low-resolution image, and obtains a high-resolution image with a corresponding multiplying power, and carries out the discrimination of the high-resolution image; the generator module is used for converting the low-resolution image into a preset high-resolution image; according to the method, an FIB-SEM high-resolution image generating an adversarial network is reconstructed by using a low-resolution image based on a deep learning algorithm, and the authenticity of the resolution of the reconstructed image is judged through a discriminator module; meanwhile, a loss function combination is introduced in the training process of the low-resolution image and the original image to serve as an optimization target, so that the converted high-resolution image is more real, and the method has remarkable advantages in the aspects of solving the ill-conditioned inversion problem caused by information loss of the low-resolution image, anti-noise performance and the like; furthermore, the reconstructed high-resolution image shows more microstructures such as pores, throats and cracks, and the precision of a traditional experiment is effectively expanded.

Description

technical field [0001] The invention belongs to the field of image resolution processing, and in particular relates to a FIB-SEM super-resolution algorithm based on a generative confrontation network. Background technique [0002] In recent years, China is vigorously developing cleaner unconventional oil and gas, mainly shale oil and gas, with low pollution and low carbon emissions, which not only ensures national energy security, but also contributes to the realization of the dual-carbon goal. Compared with conventional oil and gas reservoirs, unconventional oil and gas reservoirs such as shale oil and gas have very tight reservoir rock formations, and the accurate analysis of their microscopic pore structure characteristics in the process of exploration and development is extremely demanding. Most of the pores in tight reservoirs such as shale are nano-scale. At present, focused ion beam scanning (FIB-SEM) is often used for 3D imaging to extract pores. One-time imaging by...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T3/40G06N3/04G06N3/08
CPCG06T3/4076G06T3/4046G06N3/08G06T2207/20081G06T2207/20084G06N3/048G06N3/045
Inventor 吴苹闵超蔡光银牟磊陈伟峰刘鑫刘仕鑫黄鑫杜雪梅刘芳张杰桢刘素利
Owner SOUTHWEST PETROLEUM UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products