Method, system and storage medium for recovering transmission function and incident wave of object in high-resolution imaging

The iterative algorithm restores the object transmission function and incident wave function from a single high-resolution image, which solves the problem that the incident waves of different shapes cannot be effectively restored in the prior art, and achieves fast and accurate recovery of high-resolution imaging.

CN117974454BActive Publication Date: 2024-11-26CHONGQING ZHANWEI MICRO TECH SERVICE CO LTD
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
CN202211354377.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-10-30
Publication Date
2024-11-26
Estimated Expiration
2042-10-30

AI Technical Summary

Technical Problem

The existing high-resolution electron microscopy imaging technology is difficult to quickly and effectively restore incident waves of different shapes, and can only reconstruct the sample exit wave function, but cannot reconstruct the incident wave.

Method used

The object transmission function and incident wave function are restored from a single high-resolution image through an iterative algorithm, and iteratively optimized using error function and gradient formula, taking into account the coherence of multimodal incident waves and eliminating the influence of lens contrast transfer function.

Benefits of technology

It realizes rapid recovery of object transmission function and incident waves, and can recover incident waves of different shapes, improving the accuracy and efficiency of high-resolution imaging.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117974454B_ABST
    Figure CN117974454B_ABST
Patent Text Reader

Abstract

The present invention provides a method, system and storage medium for recovering the transmission function and incident wave of an object in high-resolution imaging. The method comprises: obtaining a single experimental high-resolution image of the object to be measured; recovering the transmission function of the object from the experimental high-resolution image through multiple iterative operations: determining the transmission function of the object to be measured in the current iteration and estimating the incident wave function; obtaining a simulated high-resolution image by using an imaging formula based on the determined transmission wave function of the object to be measured, the estimated incident wave function and the contrast transfer function of the lens calculated based on known conditions; calculating an error function based on the difference between the simulated high-resolution image and the experimental high-resolution image; calculating the gradient of the transmission function based on the error function and calculating the correction amount of the object transmission function, and calculating the gradient of the incident wave function based on the error function and calculating the correction amount of the incident wave function; correcting the object transmission function and the incident wave function based on the obtained correction amount to obtain the simulated high-resolution image after the current iteration.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of electron microscope imaging, and in particular to a method, system and storage medium for recovering a transmission function and an incident wave of an object in high-resolution imaging. Background Art

[0002] High Resolution Transmission Electron Microscope (HRTEM) is a high-resolution imaging method that uses a transmission electron microscope to study the atomic-scale structure of materials. However, high-resolution imaging is affected by imaging factors such as astigmatism during the magnification process, and only the intensity of the final magnified image is retained during recording. Therefore, in order to improve the resolution of the image, an algorithm can be used to restore the image.

[0003] For high-resolution electron microscopy images, the wave function of the sample's exit surface can be reconstructed (restored) from a series of defocused high-resolution images. The phase information of the wave function is directly related to the structure, and the influence of factors such as aberrations introduced during the lens magnification process is removed. The current HRTEM image reconstruction algorithm based on a series of defocused high-resolution images (which can be referred to as a series of defocused image reconstruction algorithms) uses gradient descent or maximum likelihood methods to restore the exit wave function of the sample's rear surface from a series of defocused HRTEM images. The algorithm is characterized in that after the incident light irradiates the sample, a series of images with different defocus conditions are recorded on the image plane; the wave function of the sample's rear surface is restored through an iterative algorithm. The algorithm calculates the gradient of the error function with respect to the exit wave function, and uses the calculated gradient formula to calculate the correction amount of the exit wave function. Through iteration, the exit wave function is continuously optimized. However, the HRTEM image reconstruction algorithm based on a series of defocused high-resolution images requires several images with different defocus conditions to reconstruct the output wave function. Moreover, the series of defocused image reconstruction algorithm can only reconstruct the output wave function when the incident wave is a plane wave, but cannot reconstruct the output wave function for incident waves of other shapes such as converging waves. During reconstruction, only the sample output wave function can be reconstructed, but not the incident wave.

[0004] How to achieve simple and efficient recovery of the object's transmission function and incident wave for incident waves of different shapes is a problem to be solved. Summary of the invention

[0005] In view of this, an embodiment of the present invention provides a method and device for recovering the object transmission function and incident wave based on high-resolution electron imaging, which realizes the rapid recovery of the object projection function and incident wave obtained by high-resolution electron imaging, and can also realize the rapid recovery of the phase and amplitude of the object transmission function.

[0006] One aspect of the present invention provides a method for recovering a transmission function and an incident wave of an object in high-resolution imaging, the method comprising the following steps:

[0007] Obtain a single experimental high-resolution image of the object being measured;

[0008] The transmission function and incident wave function of the object are restored from the experimental high-resolution image through multiple iterative operations. Each iterative operation includes the following steps:

[0009] Determine the transmission function of the object under test in the current iteration and estimate the incident wave function;

[0010] Based on the determined transmission wave function of the measured object, the estimated incident wave function and the contrast transfer function of the lens calculated from known conditions, a simulated high-resolution image is obtained using an imaging formula;

[0011] Calculate the error function of the high-resolution image based on the difference between the simulated high-resolution image and the experimental high-resolution image;

[0012] The gradient of the transmission function is obtained based on the error function of the high-resolution image, and the correction amount of the transmission function of the object is calculated using the obtained gradient formula, and the gradient of the incident wave function is obtained based on the error function of the high-resolution image, and the correction amount of the incident wave function is calculated using the obtained gradient formula; and

[0013] The object transmission function and the incident wave function are corrected based on the obtained correction amount of the object transmission function and the correction amount of the incident wave function, so as to obtain a simulated high-resolution image after the current iteration.

[0014] In some embodiments of the present invention, the incident wave function estimated in the first iteration is expressed as:

[0015]

[0016] Where R is the vector of the spatial domain space, Φ 0,c (R) represents the incident wave function of the cth mode in the spatial domain, C is the number of modes, and f(c) represents the proportion of the cth mode in the incident wave function, that is, the incident wave function is composed of incident waves of C modes, and the wave functions of different modes are incoherent (orthogonal);

[0017] The incident wave function passes through the object, and the transmission function of the object is written as O(R). The wave function of the c-th mode incident wave after passing through the object is Φ N,c It is expressed as:

[0018] Φ N,c (R)=Φ 0,c (R)O(R);

[0019] After the contrast transfer function T(R) of the electron microscope, the CCD records the intensity of the image. The formula for this process is written as:

[0020]

[0021] Among them, I N (R) is a high-resolution image simulated in the spatial domain and is a matrix in the form of real numbers; * indicates conjugation; R, R′ and R″ represent position vectors in the spatial domain; T(R) represents the modulation function contrast transfer function of the lens.

[0022] In some embodiments of the present invention, the transmission function of the measured object conforms to the following formula: O(R)=A(R)exp[iV(R)];

[0023] Here, A(R) and V(R) are the amplitude and phase parts of the transmission function, respectively, so O(R) is a complex function.

[0024] In some embodiments of the present invention, the object transmission function is corrected based on the obtained correction amount, based on the following formula:

[0025] O j+1 (R)=O j (R)+α j ΔO j (R);

[0026] The correction of the estimated incident wave function based on the calculated correction amount of the incident wave function is based on the following formula:

[0027]

[0028] Among them, O j+1 (R) and O j (R) represents the transmission function of the object in the j+1th iteration and the jth iteration respectively; ΔO j (R) represents the correction amount of the object transmission function at the jth iteration; and denote the incident wave functions in the j+1th and jth iterations respectively; represents the correction of the incident wave function at the jth iteration; α j and β j are the constant correction terms of the object transmission function and the incident wave function in the j-th iteration, respectively, and are constants.

[0029] In some embodiments of the present invention, the correction amount of the transmission function satisfies the following formula:

[0030]

[0031] The correction amount of the incident wave function satisfies the following formula:

[0032]

[0033]

[0034] in, is the spatial domain wave function of the incident wave of the cth mode after passing through the sample and being affected by the lens contrast transfer function; * indicates conjugation; I E (R) represents the image recorded by the experiment; T(R) and T * (R) represent the contrast transfer function of the lens and its conjugate, respectively.

[0035] The contrast transfer function of the lens conforms to the following formula in the frequency domain:

[0036]

[0037] Wherein, χ(k, Δf, A1, A2, B2, ...) is an aberration function, which can be determined by experimental conditions. The lens aberration influencing factors included in the brackets of the aberration function include defocus condition Δf, second-order aberration A1, second-order aberration A2 and coma B2, etc.; It represents the partial derivative of the aberration function with respect to the space vector k, α is the divergence angle of the electron beam, and λ is the wavelength of the incident electrons. The exponential term in the first part indicates that the phase of the wave function changes after passing through the lens, and the exponential term in the second part indicates that the amplitude of the wave function is attenuated after passing through the lens.

[0038] The Fourier transform relationship can be used to obtain the contrast transfer function T(R) in the spatial domain from the contrast transfer function T(k) in the frequency domain, that is,

[0039] In another aspect of the present invention, a system for recovering the transmission function and incident wave of an object in high-resolution imaging is provided, comprising a processor and a memory, wherein the memory stores computer instructions, and the processor is used to execute the computer instructions stored in the memory. When the computer instructions are executed by the processor, the system implements the steps of the method described above.

[0040] Another aspect of the present invention provides a computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, the steps of the recovery method described above are implemented.

[0041] The method and system for recovering the transmission function and incident wave of an object in high-resolution imaging of the present invention fully considers the coherence during imaging by taking partial derivatives of the transmission function of the measured object and performing iterative operations, and can quickly recover the transmission function of the sample and provide correction for the incident beam. The present invention greatly improves the practicality and efficiency of high-resolution imaging technology.

[0042] Additional advantages, purposes, and features of the present invention will be described in part in the following description, and will become apparent to those skilled in the art after studying the following, or may be learned from the practice of the present invention. The purposes and other advantages of the present invention may be achieved and obtained by the structures specifically indicated in the specification and the accompanying drawings.

[0043] Those skilled in the art will appreciate that the objectives and advantages that can be achieved with the present invention are not limited to the above specific description, and the above and other objectives that can be achieved by the present invention will be more clearly understood from the following detailed description. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] The drawings described herein are used to provide a further understanding of the present invention, constitute a part of this application, and do not constitute a limitation of the present invention.

[0045] Figure 1 Schematic diagram of an iterative restoration method based on the difference between a simulated high-resolution image and an experimental high-resolution image in an embodiment of the present invention.

[0046] Figure 2 The figure is a flow chart of a method for recovering the transmission function and incident wave of an object in high-resolution imaging according to an embodiment of the present invention.

[0047] Figure 3 The figure is a flow chart of a method for recovering the transmission function and incident wave of an object in high-resolution imaging according to another embodiment of the present invention. DETAILED DESCRIPTION

[0048] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the embodiments and the accompanying drawings. Here, the illustrative embodiments of the present invention and their descriptions are used to explain the present invention, but are not intended to limit the present invention.

[0049] It should also be noted that, in order to avoid obscuring the present invention due to unnecessary details, only structures and / or processing steps closely related to the solutions according to the present invention are shown in the accompanying drawings, while other details that are not closely related to the present invention are omitted.

[0050] It should be emphasized that the term “include / comprises” when used herein refers to the presence of features, elements, steps or components, but does not exclude the presence or addition of one or more other features, elements, steps or components.

[0051] In view of the existing problems in the recovery of the transmission function and incident wave of an object in high-resolution imaging, the present invention proposes a new method for recovering the transmission function and incident wave of an object in high-resolution imaging. In the recovery method, the transmission function of the object is obtained by taking partial derivatives of the transmission function (complex function) of the measured object and performing iterative optimization. The algorithm of the present invention is simpler and more efficient than the existing HRTEM image reconstruction method. The present invention can recover the transmission function of the object from the experimental image obtained from the incident wave of any shape, and can also eliminate the influence of the contrast transfer function of the lens at the same time; the present invention can also correct the waveform of the incident wave function. In addition, the current wave function reconstruction algorithm for high-resolution electron microscopy images does not consider the different forms of the incident wave from the modal aspect, and the method of the present invention can further improve the accuracy of the recovery of the transmission function and the incident wave function after considering the reconstruction from the multi-modal perspective.

[0052] The following is a detailed description of the method for recovering the transmission function of an object and the incident wave in HRTEM imaging of the present invention.

[0053] Figure 1 FIG. 1 is a schematic diagram of an iterative restoration method based on the difference between a simulated high-resolution image and an experimental high-resolution image in an embodiment of the present invention. Figure 1 As shown, in the embodiment of the present invention, the initial values ​​of the target function of the object (such as the object transmission function O(R)) and the target function of the incident light (the incident wave function Φ0(R)) are first set in the corresponding space domain R space, and then the simulated high-resolution image I is obtained by using the known imaging formula. N (R), and compare it with the collected experimental high-resolution image, so as to obtain the difference ΔI(R) between the simulated high-resolution image and the experimental high-resolution image. Further, in one embodiment of the present invention, based on the difference between the simulated high-resolution image and the experimental high-resolution image, the error function of the high-resolution image is calculated. Then, based on the error function of the high-resolution image, the gradient formula of the amplitude and phase of the object transmission function are respectively calculated, and the correction amount of the amplitude and phase of the object transmission function is calculated by using the obtained gradient formula to calculate the object wave function correction amount ΔO(R) and the incident wave correction amount ΔΦ0(R), so as to correct the object transmission function and the incident wave, and to correct the amplitude and phase of the object transmission function based on the obtained correction amount, so as to obtain the simulated high-resolution image after the current iteration.

[0054] Figure 2 FIG. 1 is a flow chart of a method for recovering a transmission function wave and an incident wave in HRTEM imaging according to an embodiment of the present invention. Figure 2 As shown, the method comprises the following steps:

[0055] Step S110, obtaining a single experimental high-resolution image of the object (sample) under test, and recording necessary imaging conditions, such as astigmatism, spherical aberration, focal length and other parameters.

[0056] These parameters are usually measured using amorphous rings, and electron microscopy can provide reference values ​​during experiments.

[0057] In this step, existing methods can be used to obtain experimental high-resolution images, which will not be described in detail here.

[0058] Step S120, restoring the object transmission function from the experimental high-resolution image through multiple iterative operations, each iterative operation includes the following steps:

[0059] Step S121, determining the transmission function to be corrected of the object under test in the current iteration, and estimating the incident wave function.

[0060] When initially executing this step, the amplitude and phase of the transmission function of the object to be measured can be set first, that is, an estimated initial value is assumed for the sample transmission wave function. As an example, the initial value of the amplitude of the transmission function of the object to be measured is assumed to be 1, and the phase is assumed to be 0 or a random matrix, written as:

[0061] O(R) = 1 or O(R) = exp(-iq(R));

[0062] Among them, q(R) is a random matrix.

[0063] Based on the initial assumption of the object transmission function and the known contrast transfer function of the lens, the simulated high-resolution image I N (R). The contrast transfer function can be obtained from a set of parameters related to electron microscope imaging, including the defocus condition Δf, the second-order aberration A1, the second-order aberration A2 and the coma B2.

[0064] In subsequent iterations, the error function calculated based on the simulated high-resolution image and the experimentally recorded high-resolution image will be used to find the gradient of the object's transmission function and the incident wave, thereby obtaining the correction amount of the transmission function and the incident wave.

[0065] In the embodiment of the present invention, the incident wave function Φ0(R) can be estimated according to the experimental conditions. The incident wave function Φ0(R) is a complex function. If it is a plane wave in the first iteration, it is a matrix of all 1s. The size of the matrix is ​​the same as the experimental high-resolution image. It can also include multiple modes:

[0066]

[0067] Where R is the vector of the spatial domain space, Φ 0,c (R) represents the incident wave function of the cth mode in the spatial domain, C is the number of modes, and f(c) represents the proportion of the cth mode in the incident wave function, that is, the incident wave function is composed of the incident wave functions of C modes, and the incident wave functions of different modes are independent of each other (orthogonal).

[0068] Since the algorithm of the present invention can restore the transmission function of the object under test, the influence of the light source shape is considered separately in the calculation and its influence is eliminated. Therefore, the present invention can use incident waves of any shape, such as a focused electron beam, an inclined incident electron beam, and an incident wave after plane light passes through a light hole of a specific shape.

[0069] Step S122, based on the determined transmission wave function of the measured object, the estimated incident wave function and the contrast transfer function of the lens calculated based on known conditions, a simulated high-resolution image is obtained using an imaging formula.

[0070] The incident wave function passes through the object, and the transmission function of the object is written as O(R). The wave function of the c-th mode incident wave after passing through the object is Φ N,c writing:

[0071] Φ N,c (R)=Φ 0,c (R)O(R);

[0072] After the contrast transfer function T(R) of the electron microscope is applied (where R represents the position vector in the spatial domain), the CCD records the intensity of the image. The formula for this process is written as:

[0073]

[0074] Among them, I N (R) is the simulated high-resolution image in the image domain (spatial domain), which is a real number matrix; * indicates conjugation; R′ and R″ represent the position vectors in the spatial domain; T(R′) and T(R″) represent the contrast transfer functions of the object in the spatial domain, respectively. This formula shows the coherent imaging process after the multi-modal waves pass through the sample.

[0075] The contrast transfer function of the lens conforms to the following formula in the frequency domain:

[0076]

[0077] Wherein, χ(k, Δf, A1, A2, B2, ...) is an aberration function, which can be determined by experimental conditions. The lens aberration influencing factors included in the aberration function brackets include defocus condition Δf, second-order aberration A1, second-order aberration A2 and coma B2, etc.; It represents the partial derivative of the aberration function with respect to the space vector k, α is the divergence angle of the electron beam, and λ is the wavelength of the incident electron; the exponential term in the first part indicates that the phase of the wave function will change after passing through the lens, and the exponential term in the second part indicates that the amplitude of the wave function will be attenuated after passing through the lens. The contrast transfer function T(R) in the spatial domain can be obtained from the contrast transfer function T(k) in the frequency domain by the Fourier relationship:

[0078] Since the contrast transfer function T(R) is considered as a separate item in the imaging process during the iterative calculation, the present invention eliminates its influence in the restored transmission function of the object through iterative calculation when restoring the transmission function of the object under test.

[0079] Step S123, calculating the error function of the high-resolution image based on the difference between the simulated high-resolution image and the experimental high-resolution image.

[0080] In the embodiment of the present invention, the error function S of the high-resolution image can be calculated based on the following formula:

[0081] S=∫|I N (R)-I E (R)| 2 dR;

[0082] Among them, I N (R) is the high-resolution image of spatial simulation in the spatial domain, R represents the integral variable representing the position in the spatial domain, I E (R) is the experimental high-resolution image recorded in the spatial domain.

[0083] ΔI(R)=I N (R)-I E (R);

[0084] Among them, ΔI(R) represents the difference of the image in the spatial domain, that is, the error of the high-resolution image.

[0085] In step S124, the transmission function and the incident wave function of the object are derived based on the error function of the high-resolution image to calculate the correction amount of the transmission function of the object and the correction amount of the incident wave function.

[0086] As an example, according to the calculated error function, by solving the error function for the conjugate object transmission function O * The partial derivative of (R) can be used to calculate the correction of the sample transmission function.

[0087] The present invention can also solve the error function to the incident wave function according to the error function. The partial derivatives of are used to calculate the correction to the incident wave function.

[0088] In the embodiment of the present invention, the transmission function and the incident wave function of the object are optimized in the direction of gradient descent in iterative optimization. The correction formulas of the transmission function and the incident wave function of the object can be expressed as follows:

[0089] O j+1 (R)=O j (R)+α j ΔO j (R);

[0090]

[0091] Among them, O j+1 (R) and O j (R) represents the transmission function of the object in the j+1th iteration and the jth iteration respectively; ΔO j (R) represents the correction amount of the object transmission function at the jth iteration; and denote the incident wave functions in the j+1th and jth iterations respectively; represents the correction of the incident wave function at the jth iteration; α j and β j are the constant correction terms of the object transmission function and the incident wave function in the j-th iteration, respectively, and are constants.

[0092] Step S125, correcting the object transmission function and the incident wave function based on the obtained correction amount, so as to obtain an iterative simulated high-resolution image.

[0093] The following will briefly describe how to calculate the correction amount for the transmission function and the incident wave function based on the error function, thereby reflecting the derivation process of the recovery algorithm for the transmission function and the incident wave function of the object of the present invention.

[0094] (I) Basic derivation of the transmission function correction

[0095] The following is a detailed description of the method for recovering the incident wave and the object transmission function in high-resolution imaging of the present invention. Taking the multi-modal incident wave function as an example, the specific derivation process is as follows:

[0096]

[0097] Among them, ΔO(R) represents the correction amount of the object transmission function, which is the conjugate form O of the error function S to the object transmission function. * (R) After partial derivative, we obtain; is the spatial domain wave function of the incident wave of the cth mode after passing through the sample and being affected by the lens contrast transfer function; ΔI(R) = I N (R)-I E (R) is the image deviation, that is, the difference between the simulated high-resolution image and the experimental high-resolution image, I E (R) represents the image recorded by the experiment, I N (R) represents the simulated high-resolution image; T * (R) is the conjugate form of the contrast transfer function in the spatial domain, which can be obtained from T(k) in the frequency domain by inverse Fourier transform, that is, And T(k) is directly obtained according to the electron microscope imaging conditions and its calculation formula; It is the conjugate form of the incident wave function of the cth mode in the spatial domain; f(c) is the proportion of different modes.

[0098] (II) Basic derivation of the incident wave function correction

[0099] Taking the multi-modal incident wave function as an example, the specific derivation process of the incident wave function correction is as follows:

[0100]

[0101] Furthermore, the correction of the incident wave function of each mode will contribute to the multi-modal wave function:

[0102]

[0103] in, represents the correction of the incident wave function at the jth iteration; ΔΦ 0,c (R) represents the incident wave function correction of the cth mode.

[0104] Electron microscopy imaging relies on the high coherence of the incident light. If it is completely coherent, the light can be described by a single pure mode. However, due to the inherent partial coherence of the electron beam, proper consideration of the partial coherence of the electron beam is a prerequisite for high-quality structure reconstruction. The wave function can be composed of multiple modes and written as:

[0105]

[0106] Referring to the mode decomposition in lasers, the Laguerre-Gaussian decomposition method can be used to decompose the incident light into a set of orthogonal waves that are independent of each other and have the minimum rank. Each mode is then iteratively restored and then orthogonalized to complete the mode decomposition process. Compared with the traditional electron wave imaging method that does not consider (or only considers) one mode, mode decomposition electron wave imaging has the advantages of providing a cleaner probe and better imaging effect for studying more complex systems. This method originally came from the mode decomposition of lasers, including Laguerre-Gaussian modes (LG modes for short), Hermite-Gaussian modes, etc., among which Laguerre-Gaussian modes are one of the best theories for calculating modes. In the theory of LG modes, the wave function components of multiple modes are orthogonal, and a set of components must be normalized. Experiments have proven that the restoration technology in ptychography can improve the resolution of the object to be measured by considering the mixed incident wave state compared with the traditional ptychography technology. Therefore, the present invention also borrows the mixed state technology in ptychography and applies it to the algorithm of high-resolution image reconstruction and restoration to improve the resolution of the object to be measured. (III) Method for correcting the amplitude and phase of the transmission function

[0107] The method of the present invention can not only iteratively recover the incident light and the object transmission function, but also recover the amplitude and phase parts of the transmission function respectively. In the case of multi-mode, ΔV(R) and ΔA(R) can be respectively expressed as:

[0108]

[0109]

[0110] Here, ΔV(R) represents the correction amount of the phase of the object transmission function, and Im{} represents the imaginary part of the function for the part in the brackets.

[0111]

[0112] Here, ΔA(R) represents the correction amount of the amplitude of the object transmission function, and Re{} represents taking the real part of the function for the part in the brackets.

[0113] In the HRTEM imaging process, the incident wave function passes through the object, is magnified by a series of lenses, and the final image is recorded. Figure 3 The entire sample transmission function and incident wave function can be restored by following the process shown in the figure. Figure 3As shown, the specific process of recovering the transmission function and incident wave function of the entire sample is described as follows:

[0114] Step S1, obtaining a single experimental high-resolution image of the object.

[0115] Step S2, determining the transmission function of the object under test, and estimating the incident wave function according to experimental conditions.

[0116] During the first iteration, it can be assumed that the amplitude of the wave function of the object to be measured is 1, and the phase is 0 or a random number, and the incident wave function Φ0(R) is estimated based on the actual experimental conditions.

[0117] In an exemplary embodiment, the initial amplitude values ​​of the wave function of the object to be measured are all assumed to be a matrix of all 1s, the matrix size is the same as the recorded image, and the initial phase values ​​of the wave function of the object to be measured are all 0s, but the present invention is not limited to this.

[0118] In an exemplary embodiment of the present invention, the incident wave function Φ0(R) can be written in the form of a matrix with all values ​​1, whose size is consistent with the size of the experimental high-resolution image; it can also be written in the form of multi-modal initial values, using the LG mode theory to calculate a set of mutually orthogonal wave functions:

[0119]

[0120] Where R is the vector of the spatial domain space, Φ 0,c (R) represents the incident wave function of the cth mode in the spatial domain, C is the number of modes, and f(c) represents the proportion of the cth mode in the incident wave function, that is, the incident wave function is composed of incident waves of C modes, and the wave functions of different modes are independent of each other.

[0121] Step S3, based on the determined transmission wave function of the object under test, the estimated incident wave function and the contrast transfer function of the lens calculated based on known conditions, a simulated high-resolution image I is obtained using an imaging formula. N (R).

[0122] The wave function Φ of the incident wave of the cth mode after passing through the object N,c It is expressed as:

[0123] Φ N,c (R)=Φ 0,c (R)O(R);

[0124] After being magnified by the lens, the wave function is coherently imaged, and the simulated high-resolution image is expressed as:

[0125]

[0126] Among them, I N(R) is the simulated high-resolution image in the image domain (spatial domain), which is a real number matrix; * indicates conjugation; R′ and R″ represent the position vectors in the spatial domain; T(R′) and T(R″) represent the contrast transfer function of the object in the spatial domain. This formula shows the coherent imaging process after the multi-modal wave passes through the sample. The contrast modulation function T(R) of the lens in the spatial domain can be obtained from the contrast modulation function T(k) in the frequency domain by the Fourier relationship: T(k) is the contrast modulation function of the lens in the frequency domain, specifically written as:

[0127]

[0128] Among them, χ(k,Δf,A1,A2,B2,…) is the aberration function, which can be determined by experimental conditions, including the factors affecting lens aberrations such as defocus condition Δf, second-order aberration A1, second-order aberration A2, coma B2, etc.; It represents the partial derivative of the aberration function with respect to the space vector k, α is the divergence angle of the electron beam, and λ is the wavelength of the incident electrons. The exponential term in the first part indicates that the phase of the wave function will change after passing through the lens, and the exponential term in the second part indicates that the amplitude of the wave function will attenuate after passing through the lens.

[0129] Step S4: record the experimental high-resolution image I E (R) and simulated high-resolution image I N (R) is subtracted to obtain the error function of the high-resolution image S = ∫ | I N (R)-I E (R)| 2 dR.

[0130] Step S5, based on the error function of the high-resolution image, partial derivatives of the object wave function and the incident wave function are respectively obtained to calculate the correction amount ΔO(R) of the transmission function and the correction amount ΔΦ0(R) of the incident wave function.

[0131] Step S6, using the obtained correction values ​​ΔO(R) and ΔΦ0(R) to update the object transmission function O(R) and the incident wave function Φ0(R).

[0132] Thus, an iterative process of the image of the selected position is completed.

[0133] Repeat steps S2 to S6 to loop this iterative process, continuously reduce the error, and thus obtain the final result, and output the object transmission function and the incident wave function (step S7).

[0134] From the above, it can be seen that the method for recovering the transmission function and incident wave of an object in high-resolution imaging of the present invention has the following advantages:

[0135] (1) The algorithm of the present invention includes the recovery of the transmission function of the object, and also provides the recovery of the incident wave. In the process of recovering the incident wave, the present invention fully considers the multimodal situation, so it can recover the multimodal incident wave. Moreover, the incident wave of the present invention is not limited to the plane incident wave, but can also be other types (shapes) of incident waves, such as the wave function of a focused electron beam, the wave function of an oblique incident wave, the incident wave after a plane light passes through a light hole of a specific shape, etc.

[0136] (2) Compared with the existing wave function reconstruction algorithm, the method of the present invention is simpler and more efficient to implement. Only a single image is needed to remove the influence of the contrast transfer function of the lens and restore the transmission function of the object to be measured. In addition, the algorithm can be directly extended to multiple high-resolution electron microscope images, and the transmission functions of the object to be measured in different high-resolution images can be linearly superimposed, thereby improving the resolution of the object to be measured and reducing noise interference.

[0137] (3) The restoration method of the present invention can be applied to the fields of X-ray and electron microscopy imaging and has a wide range of applications.

[0138] Based on the above advantages, it can be seen that the existing HRTEM image reconstruction algorithm based on a series of defocused high-resolution images must require several images with different defocus conditions to reconstruct the output wave function, while the present invention can use one image or multiple images to achieve the recovery of the transmission wave function and the incident wave function; the existing HRTEM image reconstruction based on a series of defocused high-resolution images is only for the case where the incident wave is a plane wave, while the present invention can recover different types of incident waves, including plane waves, converging waves, and incident waves after plane light passes through a specific shape of light hole, etc.; in addition, the existing HRTEM image reconstruction method based on a series of defocused high-resolution images only corrects the sample's output wave function and cannot correct the incident wave, while the present invention can correct the incident wave and its various modes.

[0139] As can be seen from the above, the present invention is mainly aimed at experimental high-resolution images recorded in high-resolution imaging technology. The algorithm can restore the transmission function of the sample and provide correction for the incident beam. Since the present invention records images in the spatial domain, the contrast transfer function of the lens will cause distortion to the image. While the present invention aims to restore the transmission function and incident wave function of the object, due to the influence of the contrast transfer function of the lens, the distortion effect of the lens contrast transfer function on the image can be removed through iterative calculation. The present invention can correct different types of incident wave functions, which can further improve the quality of image restoration.

[0140] Corresponding to the aforementioned method, the present invention also provides a system for recovering the transmission function and incident wave of an object in high-resolution imaging, the device comprising a computer device, the computer device comprising a processor and a memory, the memory storing computer instructions, the processor being used to execute the computer instructions stored in the memory, and when the computer instructions are executed by the processor, the system implements the steps of the aforementioned method.

[0141] The embodiment of the present invention also provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the steps of the aforementioned edge computing server deployment method are implemented. The computer-readable storage medium can be a tangible storage medium, such as a random access memory (RAM), a memory, a read-only memory (ROM), an electrically programmable ROM, an electrically erasable programmable ROM, a register, a floppy disk, a hard disk, a removable storage disk, a CD-ROM, or any other form of storage medium known in the technical field.

[0142] It should be understood by those skilled in the art that the exemplary components, systems and methods described in conjunction with the embodiments disclosed herein can be implemented in hardware, software or a combination of the two. Whether it is performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention. When implemented in hardware, it can be, for example, an electronic circuit, an application specific integrated circuit (ASIC), appropriate firmware, a plug-in, a function card, etc. When implemented in software, the elements of the present invention are programs or code segments used to perform the required tasks. The program or code segment can be stored in a machine-readable medium, or transmitted on a transmission medium or a communication link via a data signal carried in a carrier.

[0143] It should be clear that the present invention is not limited to the specific configuration and processing described above and shown in the figures. For the sake of simplicity, a detailed description of the known method is omitted here. In the above embodiments, several specific steps are described and shown as examples. However, the method process of the present invention is not limited to the specific steps described and shown, and those skilled in the art can make various changes, modifications and additions, or change the order between the steps after understanding the spirit of the present invention.

[0144] In the present invention, features described and / or illustrated for one embodiment may be used in the same or similar manner in one or more other embodiments, and / or combined with features of other embodiments or replace features of other embodiments.

[0145] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the embodiments of the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A method for high-resolution imaging of an object transmission function and an incident wave, characterized in that: The method comprises the following steps: Obtain a single experimental high-resolution image of the object being measured; The transmission function and incident wave function of the object are restored from the experimental high-resolution image through multiple iterative operations. Each iterative operation includes the following steps: Determine the transmission function of the object under test in the current iteration and estimate the incident wave function; Based on the determined transmission wave function of the measured object, the estimated incident wave function and the contrast transfer function of the lens calculated from known conditions, a simulated high-resolution image is obtained using an imaging formula; Calculate the error function of the high-resolution image based on the difference between the simulated high-resolution image and the experimental high-resolution image; The gradient of the transmission function is obtained based on the error function of the high-resolution image, and the correction amount of the transmission function of the object is calculated using the obtained gradient formula, and the gradient of the incident wave function is obtained based on the error function of the high-resolution image, and the correction amount of the incident wave function is calculated using the obtained gradient formula; and The object transmission function and the incident wave function are corrected based on the obtained correction amount of the object transmission function and the correction amount of the incident wave function, so as to obtain a simulated high-resolution image after the current iteration.

2. The method according to claim 1, characterized in that The incident wave function estimated in the first iteration is expressed as: Where R is the vector of the spatial domain space, Φ 0,c (R) represents the incident wave function of the cth mode in the spatial domain, C is the number of modes, and f(c) represents the proportion of the cth mode in the incident wave function, that is, the incident wave function is composed of incident waves of C modes, and the wave functions of different modes are independent of each other; The wave function Φ of the incident wave of the cth mode after passing through the object N,c It is expressed as: F N,c (R)=Φ 1,c (R)O(R); The simulated high-resolution image is expressed based on coherent imaging as: Among them, I N (R) is a simulated high-resolution image in the spatial domain, which is a matrix in the form of real numbers; * indicates conjugation; R, R′ and R″ represent position vectors in the spatial domain; T(R) represents the contrast transfer function of the lens; O(R) represents the transmission function of the object being measured.

3. The method according to claim 2, characterized in that The transmission function of the object under test conforms to the following formula: O(R) = A(R)exp[iV(R)]; Where A(R) and V(R) are the amplitude and phase parts of the transmission function, respectively, and O(R) is a complex function.

4. The method according to claim 1, characterized in that: Correcting the object transmission function based on the obtained correction amount is based on the following formula: O j+1 (R)=O j (R)+α j ΔO j (R); The estimated incident wave function is corrected based on the correction amount of the calculated incident wave function, based on the following formula: Among them, O j+1 (R) and O j (R) represents the transmission function of the object in the j+1th iteration and the jth iteration respectively; ΔO j (R) represents the correction amount of the object transmission function at the jth iteration; and denote the incident wave functions in the j+1th and jth iterations respectively; represents the correction of the incident wave function at the jth iteration; α j and β j are the constant correction terms of the object transmission function and the incident wave function in the j-th iteration, respectively, and are constants.

5. The method according to claim 4, characterized in that The correction amount of the transmission function satisfies the following formula: The correction amount of the incident wave function satisfies the following formula: in, is the spatial domain wave function of the incident wave of the cth mode after passing through the sample and being affected by the lens contrast transfer function, C is the number of modes; T(k) represents the contrast modulation function in the frequency domain, k represents the vector in the frequency domain space; represents the conjugate form of the incident wave function of the cth mode in the spatial domain; f(c) represents the proportion of the cth mode in the incident wave function; * represents taking the conjugate; I N (R) represents the simulated high-resolution image in the spatial domain; I E (R) represents the image recorded by the experiment; T(R) and T * (R) represents the contrast transfer function of the lens and its conjugate, respectively; represents the correction of the incident wave function at the jth iteration; represents the correction of the incident wave function of the cth mode in the spatial domain at the jth iteration.

6. The method according to claim 1, characterized in that The contrast transfer function of the lens conforms to the following formula in the frequency domain: Among them, χ(k,Δf,A1,A2,B2,…) is the aberration function determined by the experimental conditions, including the factors affecting the lens aberrations such as the defocus condition Δf, the second-order aberration A1, the second-order aberration A2, and the coma B2; It represents the partial derivative of the aberration function with respect to the space vector k, α is the divergence angle of the electron beam, and λ is the wavelength of the incident electron; the exponential term in the first part represents the change in the phase of the wave function after passing through the lens, and the exponential term in the second part represents the attenuation of the amplitude of the wave function after passing through the lens; the contrast transfer function T(R) in the spatial domain can be obtained from the contrast transfer function T(k) in the frequency domain by the Fourier transform relationship:

7. A system for recovering the transmission function and incident wave of an object in high-resolution imaging, comprising a processor and a memory, characterized in that: The memory stores computer instructions, and the processor is used to execute the computer instructions stored in the memory. When the computer instructions are executed by the processor, the system implements the steps of the method as claimed in any one of claims 1 to 6.

8. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

Citation Information

Patent Citations

  • Improved under-focus series iterative wave function reconstruction method

    CN110120068A

  • Phase recovery method for extended target imaging in Poisson noise model

    CN110146258A

  • Multi-angle illumination lensless imaging method, system and device

    CN112697751A

  • Dynamic charge observation method based on series of out-of-focus images

    CN114972189A

  • High resolution imaging

    CN1985188A