Digital aberration correction method and device for meta-imaging optical imaging

Abstract

This application relates to the field of adaptive optics technology, and in particular to a digital aberration correction method and apparatus for meta-imaging optical imaging. The method includes: acquiring multi-view images collected by a meta-imaging optical system; calculating the two-dimensional offset relationship between images from different viewpoints in the multi-view images, and obtaining an offset matrix based on the two-dimensional offset relationship; obtaining an aberration matrix based on the offset matrix through two-dimensional integration; generating a new offset matrix using the aberration matrix, and performing digital offset correction on the multi-view images using the new offset matrix; and obtaining a high-resolution two-dimensional image after aberration removal using an aperture synthesis algorithm. This solves the technical problems in related technologies, such as the need for supplementary hardware support for deflection correction, resulting in a large optical system size and slow imaging speed, causing system calibration errors, significantly reducing imaging performance, and making it unsuitable for faster and more complex imaging environments.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of adaptive optics, and particularly relates to a digital aberration correction method and device for meta-imaging optical imaging. BACKGROUND

[0002] In the related art, the offset of different sub-apertures is calculated, and a digital deformable mirror is deflected for correction. Hardware support such as a spatial light modulator or a deformable mirror array is supplemented, and an aberration-corrected image is obtained through multiple measurements, which is slow.

[0003] However, the deflection correction in the related art needs to be implemented by supplementing hardware support, which leads to a large volume of the optical system and slow imaging speed, causes system calibration errors, greatly reduces the imaging performance, and cannot be applied to faster and more complex imaging environments, which needs to be solved urgently. SUMMARY

[0004] The present application is based on the following problems and realizations of the inventors:

[0005] Adaptive optics is one of the important branches of optical research. This technology is used in optical imaging systems and can effectively compensate for various interference factors in the imaging process. These interference factors, including macroscopic atmospheric turbulence, microscopic biological tissue strong scattering, and errors of the optical imaging system itself, can cause wavefront distortion in the imaging process. Adaptive optics based on a deformable mirror array hardware device can effectively alleviate wavefront distortion and improve imaging quality, and is a very promising optical technology. Currently, adaptive optics has been widely used in astronomy observation, biological microscopic imaging and many other fields, and has made significant progress.

[0006] On the other hand, the meta-imaging-based light field imaging system is also a hot spot in optical research in recent years. The meta-imaging information has both spatial information and angle information, belonging to four-dimensional space. The four-dimensional meta-imaging imaging can obtain more information than the traditional two-dimensional imaging, and can be used in sub-aperture fusion reconstruction, which is the main method of high-resolution fusion imaging at present. However, due to the scattering of the object, the error in the design and construction of the imaging system, the meta-imaging-based optical imaging system is particularly affected by optical aberration, especially in complex imaging fields such as microscopic imaging. The meta-imaging microscope aims to image the three-dimensional volume of the microscopic sample, but due to the inhomogeneity of the refractive index and the strong scattering of the deep layer of the microscopic sample, it often brings great wavefront distortion to the imaging. For example, in long-distance imaging, the inhomogeneity of the refractive index caused by atmospheric turbulence, haze and other factors causes distortion and cannot be focused on the same plane. The traditional adaptive optical scheme has poor effect due to geometric modeling, especially in high-speed observation. The traditional adaptive correction method needs to add additional hardware support for multiple measurements, and the correction speed is slow, which limits the practical application scenarios.

[0007] The present application provides a kind of meta-imaging optical imaging digital aberration correction method and device, to solve the technical problems such as the need to supplement hardware support to realize deflection correction, cause optical system volume is larger and imaging speed is slower, cause system calibration error, greatly reduce imaging performance, cannot be applied to more rapid and complex imaging environment.

[0008] The first aspect of the present application provides a kind of meta-imaging optical imaging digital aberration correction method, comprising the following steps: obtaining the multi-view image collected by meta-imaging optical system;Calculate the two-dimensional displacement relationship of different view images in multi-view image, and obtain the displacement matrix according to the two-dimensional displacement relationship;Based on the displacement matrix, the aberration matrix is obtained by two-dimensional integration;The new displacement matrix is generated using the aberration matrix, and the multi-view image is digitally offset corrected using the new displacement matrix, and the high-resolution two-dimensional image after removing aberration is obtained using aperture synthesis algorithm.

[0009] Optionally, in one embodiment of the present application, after obtaining the multi-view image collected by the meta-imaging optical system, it further comprises: segmenting the multi-view image using a preset content adaptive region segmentation strategy.

[0010] Optionally, in one embodiment of the present application, before segmenting the multi-view image using the preset content adaptive region segmentation strategy, it further comprises: obtaining the actual attribute of the sample;According to the actual attribute, the preset content adaptive region segmentation strategy is matched.

[0011] Optionally, in one embodiment of this application, before segmenting the multi-view image, the method further includes: detecting whether the in-field aberration of the multi-view image satisfies the global uniformity condition; and when the global uniformity condition is detected, not segmenting the multi-view image.

[0012] Optionally, in one embodiment of this application, generating a new offset matrix using the aberration matrix includes: fitting the aberration matrix with a Zernike polynomial and removing the Zernike defocus term to obtain a new aberration matrix; and obtaining the new offset matrix based on the new aberration matrix through two-dimensional difference.

[0013] A second aspect of this application provides a digital aberration correction device for meta-imaging optical imaging, comprising: a first acquisition module for acquiring multi-view images collected by a meta-imaging optical system; a first calculation module for calculating the two-dimensional offset relationship between images at different viewpoints in the multi-view images and obtaining an offset matrix based on the two-dimensional offset relationship; a second calculation module for obtaining an aberration matrix based on the offset matrix through two-dimensional integration; and a correction module for generating a new offset matrix using the aberration matrix and performing digital offset correction on the multi-view images using the new offset matrix, and obtaining a high-resolution two-dimensional image after aberration removal using an aperture synthesis algorithm.

[0014] Optionally, in one embodiment of this application, the apparatus further includes a segmentation module, configured to segment the multi-view images acquired by the meta-imaging optical system using a preset content adaptive region segmentation strategy.

[0015] Optionally, in one embodiment of this application, the apparatus further includes: a second acquisition module, configured to acquire the actual attributes of a sample before segmenting the multi-view image using the preset content adaptive region segmentation strategy; and a matching module, configured to match the preset content adaptive region segmentation strategy according to the actual attributes before segmenting the multi-view image using the preset content adaptive region segmentation strategy.

[0016] Optionally, in one embodiment of this application, the apparatus further includes: a detection module, configured to detect whether the in-field aberration of the multi-view image satisfies the global uniformity condition before segmenting the multi-view image; and a processing module, configured to not segment the multi-view image when the global uniformity condition is detected before segmenting the multi-view image.

[0017] Optionally, in one embodiment of this application, the correction module includes: a fitting unit, configured to perform Zernike polynomial fitting on the aberration matrix and remove the Zernike defocus term to obtain a new aberration matrix; and a correction unit, configured to obtain the new offset matrix based on the new aberration matrix through two-dimensional difference.

[0018] A third aspect of this application provides an electronic device, including: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the digital aberration correction method for meta-imaging optical imaging as described in the above embodiments.

[0019] A fourth aspect of this application provides a computer-readable storage medium storing computer instructions for causing the computer to perform the digital aberration correction method for meta-imaging optical imaging as described in the above embodiments.

[0020] This application's embodiments calculate the two-dimensional offset relationship between images from different viewpoints in a multi-view image to obtain an offset matrix. The offset matrix is ​​then integrated in two dimensions by fitting the aberration phase to the offset, yielding an aberration matrix. This generates a new offset matrix, which is then used to perform digital offset correction on the multi-view image. No hardware changes are required, and the imaging speed is not affected. Therefore, it is less susceptible to system calibration errors, resulting in a high-resolution two-dimensional image after aberration correction. This allows for rapid correction in high-aberration scenes with high accuracy, effectively improving the imaging performance of the meta-imaging optical system. This solves the technical problems in related technologies, such as the need for additional hardware support for deflection correction, leading to a larger optical system size, slower imaging speed, system calibration errors, significantly reduced imaging performance, and inapplicability to faster and more complex imaging environments.

[0021] Additional aspects and advantages of this application will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of this application. Attached Figure Description

[0022] The above and / or additional aspects and advantages of this application will become apparent and readily understood from the following description of the embodiments taken in conjunction with the accompanying drawings, wherein:

[0023] Figure 1 This is a flowchart of a digital aberration correction method for meta-imaging optical imaging according to an embodiment of this application;

[0024] Figure 2 A flowchart of a digital aberration correction method for meta-imaging optical imaging according to a specific embodiment of this application;

[0025] Figure 3This is a schematic diagram of the structure of a digital aberration correction device for meta-imaging optical imaging according to an embodiment of this application;

[0026] Figure 4 This is a schematic diagram of the structure of an electronic device provided according to an embodiment of this application. Detailed Implementation

[0027] The embodiments of this application are described in detail below. Examples of these embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and intended to explain this application, and should not be construed as limiting this application.

[0028] The following description, with reference to the accompanying drawings, illustrates a digital aberration correction method and apparatus for meta-imaging optical imaging according to embodiments of this application. Addressing the issues mentioned in the background section regarding the need for supplementary hardware support for deflection correction, which leads to a larger optical system size and slower imaging speed, causing system calibration errors, significantly reducing imaging performance, and making it unsuitable for faster and more complex imaging environments, this application provides a digital aberration correction method for meta-imaging optical imaging. In this method, embodiments of this application calculate the two-dimensional offset relationship between images from different viewpoints in a multi-view image to obtain an offset matrix. The offset matrix is ​​then integrated in two dimensions by fitting the aberration phase to the offset, yielding an aberration matrix, and a new offset matrix is ​​generated. This new offset matrix is ​​then used to perform digital offset correction on the multi-view image without requiring hardware changes, without affecting imaging speed, and thus is less susceptible to system calibration errors. This results in a high-resolution two-dimensional image after aberration correction, enabling rapid correction in high-aberration scenarios with high accuracy, effectively improving the imaging performance of the meta-imaging optical system. This solves the technical problems in related technologies, such as the need for additional hardware support to achieve deflection correction, which leads to a large optical system size and slow imaging speed, causing system calibration errors, greatly reducing imaging performance, and making it unsuitable for faster and more complex imaging environments.

[0029] Specifically, Figure 1 This is a schematic flowchart of a digital aberration correction method for meta-imaging optical imaging provided in an embodiment of this application.

[0030] like Figure 1 As shown, the digital aberration correction method for this type of optical imaging includes the following steps:

[0031] In step S101, multi-view images acquired by the meta-imaging optical system are obtained.

[0032] It is understood that the embodiments of this application can be based on, but are not limited to, a meta-imaging optical system with four-dimensional acquisition capabilities, such as a light field imaging system based on a camera array, and modulate a microlens array placed near the image plane to convert optical signals carrying object information into four-dimensional information in phase space, while recording spatial images of the three-dimensional scene in various view directions, thereby acquiring multi-view images. The acquisition of multi-view images by the meta-imaging optical system can fully explore the intrinsic relationship between multiple viewpoints.

[0033] Optionally, in one embodiment of this application, after acquiring the multi-view images collected by the meta-imaging optical system, the method further includes: segmenting the multi-view images using a preset content adaptive region segmentation strategy.

[0034] Specifically, the embodiments of this application can acquire multi-view images collected by a meta-imaging optical system, and segment the multi-view images using a preset content adaptive region segmentation strategy, thereby performing different processing on different regions of the field of view. By digitally segmenting the image into blocks, better imaging effects can be achieved in the meta-imaging optical system.

[0035] Furthermore, in one embodiment of this application, before segmenting multi-view images using a preset content adaptive region segmentation strategy, the method further includes: obtaining the actual attributes of the samples; and matching the preset content adaptive region segmentation strategy according to the actual attributes.

[0036] It is understood that the embodiments of this application can acquire multi-view images collected by the meta-imaging optical system and obtain the actual attributes of the sample, such as whether the aberration within the field of view is globally uniform or globally non-uniform. Based on the actual attributes of the sample, a preset content adaptive region segmentation strategy is matched, thereby enabling digital correction of optical aberrations on multi-view images and improving imaging speed.

[0037] Furthermore, in one embodiment of this application, before segmenting the multi-view image, the method further includes: detecting whether the in-field aberration of the multi-view image satisfies the global uniformity condition; and when the global uniformity condition is detected, not segmenting the multi-view image.

[0038] It is understood that, before segmenting multi-view images, the embodiments of this application can detect whether the aberrations within the field of view of the multi-view images meet the global uniformity condition. If the global uniformity condition is met, the multi-view images do not need to be segmented, thereby improving correction efficiency and targeting, and reducing redundant operations. If the aberrations within the field of view do not meet the global uniformity condition, a preset content adaptive region segmentation strategy is used to segment the multi-view images, thereby exhibiting better imaging effects in scenes with non-uniform aberrations.

[0039] In step S102, the two-dimensional offset relationship between images from different perspectives in the multi-view image is calculated, and the offset matrix is ​​obtained based on the two-dimensional offset relationship.

[0040] As one possible implementation, embodiments of this application estimate the offset of multiple viewpoints using correlation or optical flow methods, and calculate the two-dimensional offset relationship between images from different viewpoints to obtain an offset matrix M, wherein the numerical size of the offset matrix M is Nnum×Nnum×2, where Nnum represents the number of angles in one dimension, and 2 represents the horizontal and vertical dimensions.

[0041] In step S103, the aberration matrix is ​​obtained by two-dimensional integration based on the offset matrix.

[0042] In some embodiments, the present application embodiments can perform aberration fitting on the aperture offset, and obtain the aberration matrix by two-dimensional integration of the offset matrix using wave optics theory, such as using a wave optics model, and use the aberration matrix to generate a new offset matrix in the following steps, thereby improving the accuracy of aberration modeling and effectively improving the imaging performance of the meta-imaging optical system.

[0043] In step S104, a new offset matrix is ​​generated using the aberration matrix, and the new offset matrix is ​​used to perform digital offset correction on the multi-view image. The aperture synthesis algorithm is then used to obtain a high-resolution two-dimensional image after aberration removal.

[0044] In actual implementation, the embodiments of this application perform aberration fitting on the aperture offset. By using wave optics theory, the aberration matrix is ​​obtained by two-dimensional integration of the offset matrix. For example, a wave optics model is used, and a new offset matrix is ​​generated using the aberration matrix. The new offset matrix is ​​then used to perform digital offset correction on multi-view images, accurately modeling the aberrations into the frequency plane of the imaging system and removing the influence of the defocus term. This improves the accuracy of aberration modeling and digitally corrects optical aberrations on multi-angle images without hardware changes. As a result, the optical system is compact and simple, less susceptible to the influence of system calibration errors, and more suitable for long-term imaging.

[0045] In summary, the embodiments of this application fit the aberration phase by offset, use a wave optics model, perform two-dimensional integration on the offset matrix M to obtain the aberration matrix P, and use the aberration matrix P to generate a new aberration matrix P', thereby obtaining a new offset matrix M', wherein the digital size of the new offset matrix M' is Nnum×Nnum×2. The new offset matrix M' is used to perform digital offset correction on multi-view images, thereby obtaining a high-resolution two-dimensional image after aberration correction, effectively improving the imaging performance of the meta-imaging optical system.

[0046] In one embodiment of this application, generating a new offset matrix using the aberration matrix includes: fitting the aberration matrix with a Zernike polynomial and removing the Zernike defocus term to obtain a new aberration matrix; and obtaining a new offset matrix based on the new aberration matrix through two-dimensional difference.

[0047] In some embodiments, this application uses a wave optics model, fits the aberration phase by offset, performs two-dimensional integration on the offset matrix M to obtain the aberration matrix P, further performs Zernike polynomial fitting on the aberration matrix P, removes the Zernike defocus term, and obtains a new aberration matrix P' that does not contain focusing effect, and performs two-dimensional difference on the new aberration matrix P' to obtain a new offset matrix M', wherein the numerical size of the new offset matrix M' is Nnum×Nnum×2.

[0048] like Figure 2 As shown, the working principle of the embodiments of this application will be described in detail with reference to a specific example.

[0049] Step S201: Establish a meta-imaging optical device with four-dimensional acquisition capability to simultaneously acquire multi-view images.

[0050] Step S202: Perform content-adaptive region segmentation on the multi-view images acquired by the meta-imaging optical system, and then perform subsequent processing on each segment.

[0051] The segmentation process depends on the properties of the sample itself. If the aberrations are uniform globally within the field of view, segmentation may not be necessary.

[0052] Step S203: Estimate the offset of multiple viewpoints using the correlation method or optical flow method, calculate the two-dimensional offset relationship between images from different viewpoints, and obtain the offset matrix M.

[0053] The numerical size of the offset matrix M is Nnum×Nnum×2, where Nnum represents the number of angles in one dimension and 2 represents the two dimensions of horizontal and vertical.

[0054] Step S204: Using the wave optics model, fit the aberration phase through the offset, and perform two-dimensional integration on the offset matrix M to obtain the aberration matrix P.

[0055] Furthermore, the aberration matrix P is fitted with Zernike polynomials to remove the Zernike defocus term, resulting in an aberration matrix P' that does not contain focusing effects.

[0056] Then, the aberration matrix P' is subjected to two-dimensional difference to obtain a new offset matrix M', where the numerical size of the new offset matrix M' is Nnum×Nnum×2.

[0057] Step S205: Use the new offset matrix M' to perform digital offset correction on the image to obtain an aberration-corrected multi-view image.

[0058] Step S206: Use the aperture synthesis algorithm to obtain a high-resolution two-dimensional fused image.

[0059] Step S207: Perform subsequent reconstruction processing or computational analysis on the high-resolution two-dimensional image.

[0060] The digital aberration correction method for meta-imaging optical imaging proposed in this application calculates the two-dimensional offset relationship between images from different viewpoints in a multi-view image to obtain an offset matrix. The offset matrix is ​​then integrated in two dimensions by fitting the aberration phase to the offset to obtain an aberration matrix, thereby generating a new offset matrix. The new offset matrix is ​​then used to perform digital offset correction on the multi-view image without requiring hardware changes, without affecting the imaging speed, and thus is less susceptible to the influence of system calibration errors. This results in a high-resolution two-dimensional image after aberration correction, which can be quickly corrected in high aberration scenes with high correction accuracy, effectively improving the imaging performance of the meta-imaging optical system.

[0061] Next, with reference to the accompanying drawings, a digital aberration correction apparatus for meta-imaging optical imaging according to an embodiment of this application is described.

[0062] Figure 3 This is a block diagram of a digital aberration correction device for meta-imaging optical imaging according to an embodiment of this application.

[0063] like Figure 3 As shown, the digital aberration correction device 10 for atomic imaging optical imaging includes: a first acquisition module 100, a first calculation module 200, a second calculation module 300, and a correction module 400.

[0064] Specifically, the first acquisition module 100 is used to acquire multi-view images collected by the meta-imaging optical system.

[0065] The first calculation module 200 is used to calculate the two-dimensional offset relationship between images from different perspectives in a multi-view image, and to obtain the offset matrix based on the two-dimensional offset relationship.

[0066] The second calculation module 300 is used to obtain the aberration matrix based on the offset matrix through two-dimensional integration.

[0067] The correction module 400 uses the aberration matrix to generate a new offset matrix, and uses the new offset matrix to perform digital offset correction on the multi-view image, and uses the aperture synthesis algorithm to obtain a high-resolution two-dimensional image after removing aberrations.

[0068] Optionally, in one embodiment of this application, the apparatus 10 of this application embodiment further includes: a segmentation module.

[0069] The segmentation module is used to segment the multi-view images after acquiring them from the meta-imaging optical system using a preset content-adaptive region segmentation strategy.

[0070] Optionally, in one embodiment of this application, the apparatus 10 of this application embodiment further includes: a second acquisition module and a matching module.

[0071] The second acquisition module is used to acquire the actual attributes of the sample before segmenting the multi-view image using a preset content adaptive region segmentation strategy.

[0072] The matching module is used to match the preset content adaptive region segmentation strategy according to the actual attributes before segmenting multi-view images using the preset content adaptive region segmentation strategy.

[0073] Optionally, in one embodiment of this application, the apparatus 10 of this application embodiment further includes a detection module and a processing module.

[0074] The detection module is used to detect whether the aberrations within the field of view of the multi-view image satisfy the global uniformity condition before segmenting the multi-view image.

[0075] The processing module is used to prevent multi-view images from being segmented before the global uniformity condition is detected.

[0076] Optionally, in one embodiment of this application, the correction module 300 includes a fitting unit and a correction unit.

[0077] The fitting unit is used to fit the aberration matrix using Zernike polynomials and remove the Zernike defocus term to obtain a new aberration matrix.

[0078] The correction unit is used to obtain a new offset matrix based on the new aberration matrix through two-dimensional difference.

[0079] It should be noted that the foregoing explanation of the digital aberration correction method embodiment for meta-imaging optical imaging also applies to the digital aberration correction device for meta-imaging optical imaging in this embodiment, and will not be repeated here.

[0080] The digital aberration correction device for meta-imaging optical imaging proposed in this application calculates the two-dimensional offset relationship between images from different viewpoints in a multi-view image to obtain an offset matrix. The offset matrix is ​​then integrated in two dimensions by fitting the aberration phase to the offset to obtain an aberration matrix, thereby generating a new offset matrix. The new offset matrix is ​​then used to perform digital offset correction on the multi-view image without any hardware changes, without affecting the imaging speed, and thus is not easily affected by system calibration errors. This results in a high-resolution two-dimensional image after aberration correction, which can quickly complete correction in high aberration scenes with high correction accuracy, effectively improving the imaging performance of the meta-imaging optical system.

[0081] Figure 4 A schematic diagram of the structure of an electronic device provided in an embodiment of this application. The electronic device may include:

[0082] The memory 401, the processor 402, and the computer program stored on the memory 401 and capable of running on the processor 402.

[0083] When the processor 402 executes the program, it implements the digital aberration correction method for meta-imaging optical imaging provided in the above embodiments.

[0084] Furthermore, electronic devices also include:

[0085] Communication interface 403 is used for communication between memory 401 and processor 402.

[0086] The memory 401 is used to store computer programs that can run on the processor 402.

[0087] The memory 401 may include high-speed RAM memory, and may also include non-volatile memory, such as at least one disk storage device.

[0088] If the memory 401, processor 402, and communication interface 403 are implemented independently, then the communication interface 403, memory 401, and processor 402 can be interconnected via a bus to complete communication between them. The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. Buses can be divided into address buses, data buses, control buses, etc. For ease of representation, Figure 4 The bus is represented by a single thick line, but this does not mean that there is only one bus or one type of bus.

[0089] Optionally, in a specific implementation, if the memory 401, processor 402, and communication interface 403 are integrated on a single chip, then the memory 401, processor 402, and communication interface 403 can communicate with each other through an internal interface.

[0090] Processor 402 may be a central processing unit (CPU), an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of this application.

[0091] This embodiment also provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the above-described digital aberration correction method for meta-imaging optical imaging.

[0092] In the description of this specification, the references to terms such as "one embodiment," "some embodiments," "example," "specific example," or "some examples," etc., indicate that a specific feature, structure, material, or characteristic described in connection with that embodiment or example is included in at least one embodiment or example of this application. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples. Moreover, without contradiction, those skilled in the art can combine and integrate the different embodiments or examples described in this specification, as well as the features of different embodiments or examples.

[0093] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of that feature. In the description of this application, "N" means at least two, such as two, three, etc., unless otherwise explicitly specified.

[0094] Any process or method described in the flowchart or otherwise herein can be understood as representing a module, segment, or portion of code comprising one or more N executable instructions for implementing custom logic functions or processes, and the scope of the preferred embodiments of this application includes additional implementations in which functions may be performed not in the order shown or discussed, including substantially simultaneously or in reverse order depending on the functions involved, as should be understood by those skilled in the art to which embodiments of this application pertain.

[0095] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a sequenced list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by, or in conjunction with, an instruction execution system, apparatus, or device (such as a computer-based system, a processor-included system, or other system that can fetch and execute instructions from, an instruction execution system, apparatus, or device). For the purposes of this specification, "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transmit programs for use by, or in conjunction with, an instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of computer-readable media include: an electrical connection having one or more wires (electronic device), a portable computer disk drive (magnetic device), random access memory (RAM), read-only memory (ROM), erasable and editable read-only memory (EPROM or flash memory), fiber optic devices, and portable optical disc read-only memory (CDROM). Alternatively, the computer-readable medium may be paper or other suitable media on which the program can be printed, since the program can be obtained electronically, for example, by optically scanning the paper or other medium, followed by editing, interpreting, or otherwise processing as necessary, and then stored in a computer memory.

[0096] It should be understood that the various parts of this application can be implemented using hardware, software, firmware, or a combination thereof. In the above embodiments, the N steps or methods can be implemented using software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware as in another embodiment, it can be implemented using any one or a combination of the following techniques known in the art: discrete logic circuits having logic gates for implementing logical functions on data signals, application-specific integrated circuits (ASICs) having suitable combinational logic gates, programmable gate arrays (PGAs), field-programmable gate arrays (FPGAs), etc.

[0097] Those skilled in the art will understand that all or part of the steps of the methods in the above embodiments can be implemented by a program instructing related hardware. The program can be stored in a computer-readable storage medium, and when executed, the program includes one or a combination of the steps of the method embodiments.

[0098] Furthermore, the functional units in the various embodiments of this application can be integrated into a processing module, or each unit can exist physically separately, or two or more units can be integrated into a module. The integrated module can be implemented in hardware or as a software functional module. If the integrated module is implemented as a software functional module and sold or used as an independent product, it can also be stored in a computer-readable storage medium.

[0099] The storage medium mentioned above can be a read-only memory, a disk, or an optical disk, etc. Although embodiments of this application have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting this application. Those skilled in the art can make changes, modifications, substitutions, and variations to the above embodiments within the scope of this application.

Claims

1. A method of digital aberration correction for meta-imaging optical imaging, characterized in that, The method comprises the following steps: acquiring multi-view images collected by a meta-imaging optical system; calculating a two-dimensional offset relationship of different view images in the multi-view images, and obtaining an offset matrix according to the two-dimensional offset relationship; and generating a new offset matrix by two-dimensional integration based on the offset matrix; generating a new offset matrix by two-dimensional integration based on the offset matrix; 2. The method of claim 1, wherein, generating a new offset matrix by two-dimensional integration based on the offset matrix; generating a new offset matrix by two-dimensional integration based on the offset matrix.

3. The method of claim 2, wherein, After acquiring the multi-view images collected by the meta-imaging optical system, the method further comprises: segmenting the multi-view images by using a preset content-adaptive region segmentation strategy. Before segmenting the multi-view images by using the preset content-adaptive region segmentation strategy, the method further comprises:

4. The method of claim 2, wherein, acquiring actual attributes of a sample; matching the preset content-adaptive region segmentation strategy according to the actual attributes. Before segmenting the multi-view images, the method further comprises:

5. The method according to any one of claims 1 to 4, characterized in that, detecting whether an in-field aberration of the multi-view images satisfies a global uniform condition; when it is detected that the global uniform condition is satisfied, not segmenting the multi-view images. The generating of the new offset matrix by using the aberration matrix comprises:

6. A digital aberration correction device for meta-imaging optical imaging, characterized in that, performing Zernike polynomial fitting on the aberration matrix, and removing Zernike defocus terms to obtain a new aberration matrix; generating the new offset matrix by two-dimensional difference based on the new aberration matrix. The method comprises: a first acquiring module configured to acquire multi-view images collected by a meta-imaging optical system; a first calculating module configured to calculate a two-dimensional offset relationship of different view images in the multi-view images, and obtain an offset matrix according to the two-dimensional offset relationship; and 7. The apparatus of claim 6, wherein, a second calculating module configured to generate an aberration matrix by two-dimensional integration based on the offset matrix. a correction module configured to generate a new offset matrix by using the aberration matrix, and perform digital offset correction on the multi-view images by using the new offset matrix, and obtain a high-resolution two-dimensional image after removing aberration by using an aperture synthesis algorithm.

8. The apparatus of claim 7, wherein, The method further comprises: a segmentation module configured to segment the multi-view images by using a preset content-adaptive region segmentation strategy after acquiring the multi-view images collected by the meta-imaging optical system. The method further comprises:

9. The apparatus of claim 7, wherein, a second acquiring module configured to acquire actual attributes of a sample before segmenting the multi-view images by using the preset content-adaptive region segmentation strategy; a matching module configured to match the preset content-adaptive region segmentation strategy according to the actual attributes before segmenting the multi-view images by using the preset content-adaptive region segmentation strategy. The method further comprises:

10. The device according to any of claims 6-9, characterized in that a detection module configured to detect whether an in-field aberration of the multi-view images satisfies a global uniform condition before segmenting the multi-view images; a processing module configured to not segment the multi-view images when it is detected that the global uniform condition is satisfied before segmenting the multi-view images. The correction module comprises:

11. An electronic device, comprising: a fitting unit configured to perform Zernike polynomial fitting on the aberration matrix, and remove Zernike defocus terms to obtain a new aberration matrix; a correction unit configured to generate the new offset matrix by two-dimensional difference based on the new aberration matrix. The method comprises: - a memory, a processor and a computer program stored on the memory and runable on the processor, the processor executing the program to implement the method of digital aberration correction for meta-imaging optical imaging according to any one of claims 1 to 5.

12. A computer readable storage medium having stored thereon a computer program, characterized in that, The program is executed by a processor for implementing the method of digital aberration correction for meta-imaging optical imaging according to any one of claims 1 to 5.

Images