Microlens array, imaging system and image reconstruction method based on interferometer arm group

By improving the lens array structure and image reconstruction method of the segmented planar imaging system and adopting a rotating interferometer arm group and complementary baseline pairing, the problem of low frequency sampling coverage is solved and high-resolution and high-precision imaging effects are achieved.

CN116500710BActive Publication Date: 2025-09-09UNIV OF ELECTRONICS SCI & TECH OF CHINA
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202310474333.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-04-28
Publication Date
2025-09-09
Estimated Expiration
2043-04-28

AI Technical Summary

Technical Problem

Due to the limitations of the lens array structure, the existing segmented planar imaging system has a short baseline length, resulting in low frequency sampling coverage and affecting the imaging quality.

Method used

A microlens array based on a rotating interferometer arm group is used. By improving the lens array structure, increasing the number of sampling points, and adopting a complementary baseline pairing method, the spectrum synthesis method is optimized, and combined with photonic integrated circuits and data acquisition and processing modules, more comprehensive frequency domain information acquisition is achieved.

Benefits of technology

The imaging quality, especially the imaging accuracy and robustness of dynamic targets, is improved. It can collect more spatial frequency information and zero-frequency and low-frequency information, and improve the accuracy and resolution of image reconstruction.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116500710B_ABST
    Figure CN116500710B_ABST
Patent Text Reader

Abstract

The microlens array based on an interference arm group includes P interference arm groups, each of which includes a first lens column and a second lens column. The first lens column includes M microlenses arranged continuously and closely in a straight line; the second lens column includes N microlenses arranged continuously and closely in a straight line. The microlens array also includes a single lens. The multiple interference arm groups are arranged in a circular radial pattern around the center of the microlens array. The central angles between the interference arm groups are equal, and the second lens column of each interference arm group is located in the radial direction of the circular ring. The single lens is located at the center of the microlens array. The present invention optimizes the existing segmented planar imaging system's problems of insufficient baseline and low frequency sampling coverage, optimizes the spectrum synthesis method for dynamic targets, improves the accuracy and robustness of dynamic target reconstruction, and further enhances the imaging quality of the segmented planar imaging system. It is suitable for aviation, aerospace, and other image acquisition fields.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of photoelectric detection, and in particular to a microlens array based on an interference arm group, an imaging system and an image reconstruction method. Background Art

[0002] Traditional optical imaging detection systems face the challenges of large size, heavy weight and high power consumption due to structural limitations, which forces people to seek new development directions to adapt to the demand for continuous improvement in the resolution of space optical detection systems.

[0003] In 2012, Lockheed Martin Corporation in the United States proposed a new computational imaging system—the Segmented Planar Imaging System. This system combines optical aperture synthesis with photonic integrated circuit technology. It acquires the spatial frequency information of the observed target and performs an inverse Fourier transform to obtain the target's light intensity distribution. This system uses a microlens array instead of traditional large-aperture optical lenses, significantly reducing system size and providing insights into miniaturized, lightweight, and low-power high-resolution space optical detection systems.

[0004] The resolution of a segmented planar imaging system is determined by the baseline length of the paired lenses. However, due to limitations in the lens array structure, existing segmented planar imaging systems have a short maximum baseline length. Furthermore, the short baseline segments are redundant along the same circumference, resulting in low frequency sampling coverage, which significantly impacts the image quality of the target. Consequently, a method that can effectively improve the frequency domain information of acquired images is currently lacking. Summary of the Invention

[0005] This paper proposes a segmented planar imaging system and image reconstruction method based on a rotating interferometer arm set, which can be applied to target detection and imaging. By improving the microlens array's planar structure, the number of sampling points is increased, effectively avoiding the problem of frequency domain sampling point duplication. It also optimizes the spectrum synthesis method for dynamic targets, thereby improving the target's imaging quality.

[0006] The technical solutions proposed by the present invention are as follows:

[0007] Microlens array based on interferometer arm group, including:

[0008] P interference arm groups, each interference arm group includes a first lens column and a second lens column, the first lens column includes M microlenses continuously and closely arranged in a straight line; the second lens column includes N microlenses continuously and closely arranged in a straight line; P ≥ 2, M is less than or equal to N and both M and N are even numbers, M ≥ 4, and the diameters of the microlenses of the first lens column and the second lens column are equal;

[0009] The microlens array further includes a single lens, wherein the single lens is a lens or a lens group having a diameter larger than that of the microlens;

[0010] The plurality of interference arm groups are arranged in a circular radial pattern around the center of the microlens array, the central angles between the interference arm groups are equal, and the second lens array of each interference arm group is located in the radial direction of the circular pattern, and the single lens is located in the center of the microlens array;

[0011] The microlenses in the two lens columns are paired in pairs to form a baseline, where forming a baseline means that the light rays of the two microlenses interfere to form a group of interference light.

[0012] Preferably, the specific method of forming the baseline is:

[0013] The first lens column of the interference arm group uses the center line of the lens column as the symmetry axis, and the microlenses symmetrically distributed on both sides are paired to form a baseline; the second lens column of the interference arm group uses the central microlens of the lens column as the symmetry axis, and the microlenses symmetrically distributed on both sides are paired to form a baseline, and the central microlens is paired with the outermost unpaired microlens of the column to form a baseline, and the central microlens is any one of the two central microlenses.

[0014] Preferably, the microlenses of the first lens column and the second lens column are arranged in a staggered and close relationship.

[0015] Preferably, NM=2.

[0016] A segmented planar imaging system based on an interferometer arm group, comprising a microlens array as described in any one of the above items, characterized in that it also includes a camera, P photonic integrated circuits and a data acquisition and processing module;

[0017] The camera is located behind a single lens at the center of the microlens array and can collect optical signals from the single lens;

[0018] Each interferometer arm group is connected to a photonic integrated circuit, each of the photonic integrated circuits comprising M+N waveguide transmission lines, M+N arrayed waveguide gratings, and Q balanced four-orthogonal detectors; the M+N lenses within the interferometer arm group are connected one-to-one to the M+N waveguide transmission lines; the M+N waveguide transmission lines are connected one-to-one to the M+N arrayed waveguide gratings; the positions of the balanced four-orthogonal detectors and the arrayed waveguide gratings are arranged so that the arrayed waveguide grating output light can be collected by the Q balanced four-orthogonal detectors;

[0019] The number Q of the balanced four orthogonal detectors is greater than or equal to the total number of baselines in a single interferometer arm group;

[0020] The output end of each of the balanced four-orthogonal detectors is connected to the data acquisition and processing module for signal connection.

[0021] The image reconstruction method comprises the following steps:

[0022] S1. Rotate the microlens array around the center of the microlens array by the same angle each time, repeatedly performing imaging acquisition and image reconstruction;

[0023] S2. Divide each reconstructed image into multiple square image blocks and sort the image blocks. Perform similarity determination on image blocks with the same sequence number in each reconstructed image. For similar image blocks, merge the spectral information of the images in which they are located and then perform an inverse Fourier transform. Select the image blocks with the same sequence number as the merged image blocks.

[0024] S3. Combine the merged image blocks to form a final image.

[0025] Preferably, the specific method of image reconstruction in S1 is:

[0026] S11. The microlenses of the interferometer arm group receive incident light from the scene through the waveguide transmission line and the arrayed waveguide grating. Light from the two microlenses of each group forming the baseline enters the same balanced four-orthogonal detector to obtain intensity information of the complex coherent light. The data acquisition and processing module stores the amplitude and phase information corresponding to the intensity information of the complex coherent light obtained by each of the balanced four-orthogonal detectors to obtain a first sub-spectrum matrix.

[0027] S12. The single lens at the center of the interferometer arm group uses a camera to collect zero-frequency and partial low-frequency information of the scene to obtain a second sub-spectrum matrix, which is then combined with the first sub-spectrum matrix to form a spectrum matrix.

[0028] S13. Perform inverse Fourier transform on the spectrum matrix to complete a single image reconstruction.

[0029] Preferably, the merging method in step S12 is specifically as follows:

[0030] If there is spectrum information at a certain element in the first sub-spectral matrix and at the element at the corresponding position in the second sub-spectral matrix, the average of the spectrum information of the elements at that position in the two sub-spectral matrices is taken as the value of the element at that position in the spectrum matrix;

[0031] If there is only one sub-spectrum matrix with spectrum information at a certain element in the first sub-spectrum matrix and an element at a position corresponding to the second sub-spectrum matrix, then the value of the element at that position is the spectrum information of the sub-spectrum matrix with value;

[0032] Otherwise, the value of the element at that position in the spectrum matrix is ​​taken as zero.

[0033] Preferably, the specific method for performing similarity determination in step S2 is:

[0034] The similarity judgment formula is used to judge the similarity of the same sequence number blocks in different reconstructed images to determine whether the image blocks are considered similar in n single-shot reconstructed images;

[0035] If they are considered similar, the spectrum information of n times is merged and inverse Fourier transform is performed to obtain the merged image block;

[0036] If they are considered not similar, all possible situations of reducing one image are traversed, and it is determined whether the image blocks in the n-1 single reconstructed images are considered similar. If they are similar, the spectrum information of the image is merged and then the inverse Fourier transform is performed. Otherwise, one image is continuously reduced until n = 1.

[0037] Preferably, the calculation formula of the discrimination result S of the similarity discrimination is:

[0038] S={x∈X:d(Z x1 ,Z x2 ...Z xn )≤τ}

[0039] Where xi represents the image block to be compared, X represents the set of image blocks that have been divided, and d(Z x1 ,Z x2 ...Z xn ) represents the method for determining the similarity between image blocks, τ is the similarity determination threshold, and if it is lower than τ, they are considered similar.

[0040] Compared with the prior art, the segmented planar imaging system of the present invention has the following advantages and beneficial effects:

[0041] 1. The present invention proposes a segmented planar imaging system based on a rotating interferometer arm group. The two columns of interferometer arms in the interferometer arm group adopt a complementary baseline pairing method, which can increase the collection of spatial frequency information missing in traditional systems. In addition, by adding a single lens in the middle of the system, the collection of zero-frequency and partial low-frequency information is further improved, thereby enhancing the imaging quality of the system.

[0042] 2. The image reconstruction method of the present invention can not only improve the accuracy and robustness of dynamic target reconstruction, but also has broad application prospects and can be applied to various fields and different types of images, such as natural scenes, medical images, etc. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] The drawings described herein are used to provide a further understanding of the embodiments of the present invention, constitute a part of this application, and do not constitute a limitation of the embodiments of the present invention. In the drawings:

[0044] Figure 1 1 is a schematic structural diagram of a segmented planar imaging system provided by an embodiment of the present invention;

[0045] Figure 2 It is a schematic diagram of the structure of an existing segmented planar imaging system;

[0046] Figure 3 1 is a schematic structural diagram of an interferometer arm group of a segmented planar imaging system provided by one embodiment of the present invention;

[0047] Figure 4 This is a schematic diagram of a specific implementation of a baseline formed by lens pairing within an interferometer arm group in a segmented planar imaging system simulation provided by one embodiment of the present invention;

[0048] Figure 5 This is a schematic diagram of the system structure of a specific implementation of a segmented planar imaging system provided by an embodiment of the present invention;

[0049] Figure 6 1 is a schematic diagram of a specific implementation of a segmented planar imaging system provided by an embodiment of the present invention;

[0050] Figure 7 This is a comparison diagram of dynamic target image reconstruction simulated by an existing segmented planar imaging system and an embodiment of the present invention;

[0051] Figure 8 This is a comparison diagram of static target image reconstruction simulated by an existing segmented planar imaging system and an embodiment of the present invention;

[0052] 1-Interferometer arm group, 2-Single lens, 3-Microlens, 4-Balanced four-orthogonal detector, 5-Arrayed waveguide grating. DETAILED DESCRIPTION

[0053] In order to make the objectives, technical solutions and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with examples and drawings. The exemplary embodiments of the present invention and their descriptions are only used to explain the present invention and are not intended to limit the present invention.

[0054] Embodiment: A segmented planar imaging system and image reconstruction method based on a rotating interferometer arm set.

[0055] The lens array of the present invention is modified and designed based on the lens array of the existing segmented planar imaging system. Figure 2 As shown, the baseline pairing method on a single interferometer arm is single, and the baseline pairing method of adjacent arms is the same, which limits the number of baselines and the frequency domain sampling rate, making the frequency domain information redundant in the same circle and the frequency domain information distribution on the same interferometer arm missing.

[0056] The present invention proposes a specific implementation scheme of a segmented planar imaging system based on a rotating interferometer arm set, such as Figure 1 As shown, the solution consists of a microlens array and a camera, and includes a photonic integrated circuit and a data acquisition and processing module.

[0057] The microlens array based on the interferometer arm group includes:

[0058] P interference arm groups, each interference arm group includes a first lens column and a second lens column, the first lens column includes M microlenses continuously and closely arranged in a straight line; the second lens column includes N microlenses continuously and closely arranged in a straight line; M is less than or equal to N and both M and N are even numbers, M ≥ 4, P ≥ 2;

[0059] The micro lenses of the first lens column and the second lens column are arranged in a staggered and close relationship;

[0060] The microlens array further includes a single lens, wherein the single lens is a lens or a lens group having a diameter larger than that of the microlens;

[0061] The multiple interference arm groups are arranged in a circular radial shape around the center of the microlens array, the central angles between the interference arm groups are equal, and the second lens column of each interference arm group is located in the radial direction of the circular ring, and the single lens is located at the center of the microlens array.

[0062] The first lens array of the interference arm group takes the center line of the lens array as the symmetry axis, and the microlenses on both sides are paired to form a baseline; the second lens array of the interference arm group takes the central microlens of the lens array as the symmetry axis, and the microlenses on both sides are paired to form a baseline, and the central microlens is paired with the outermost unpaired microlens of the array to form a baseline, and the central microlens is any one of the two central microlenses.

[0063] The baseline composition refers to the interference of light from two microlenses as a set of interference light. Each set of interference light can be subsequently detected by a balanced four-orthogonal detector to output spectrum information.

[0064] The microlens of each interferometer arm group is connected to the arrayed waveguide grating, balanced four-orthogonal detector and data acquisition and processing module in the photonic integrated circuit through a waveguide transmission line.

[0065] The signals output by the balanced four-orthogonal detector are I signal (In phase single, in-phase signal) and Q signal (Quadrature phase signal, orthogonal signal), from which the amplitude and phase information of the baseline corresponding to the spatial frequency can be extracted. The light emitted by the arrayed waveguide grating is collected and processed into digital signals and then passed to the data acquisition and processing module for calculation.

[0066] The two lens arrays of the interference arm group preferably employ a complementary baseline pairing method. Specifically, the M microlenses of the first lens array of the interference arm group are symmetrically spaced about the center line of the lens array, with the microlenses symmetrically spaced on either side of the lens array being paired to form baselines, thereby forming baseline lengths of 1, 3, 5, ..., M-1 times the diameter of the microlenses. The N microlenses of the second lens array of the interference arm group are symmetrically spaced about the center microlens of the lens array being paired to form baselines, with the center microlens being paired with either of the two centermost microlenses to form baselines, thereby forming baseline lengths of 2, 4, 6, ..., N-2 times the diameter of the microlenses. Since M is less than or equal to N, the baseline length distribution obtained by combining the two microlens arrays is 1, 2, 3 ..., M-1 ..., N-2, forming a continuous distribution over the first M-1 baseline lengths. N is greater than M, and the difference between the two baseline lengths is generally no greater than 4. When NM = 2, the baseline lengths form a continuous distribution of 1, 2, 3 ..., M.

[0067] Interferometric imaging systems use microlenses to interfere with light emitted from an incoherent target source, then extract the amplitude and phase information of the complex coherence factor from the interference fringes. The baseline vector is the position vector between two microlenses within the exit pupil plane, and the baseline length is the length of the baseline vector. The segmented planar imaging system provided by the present invention can capture spectral information with continuously distributed baseline lengths of 1, 2, 3…M. Existing segmented planar imaging systems can only capture spectral information with baseline lengths of 1, 3, 5…. By comparison, the segmented planar imaging system provided by the present invention can capture more spectral information.

[0068] like Figure 3 As shown, the two rows of lenses are staggered and closely arranged, and because the inner circumference of the circle is short, N and M are set to N greater than or equal to M. The purpose is to make the inner microlenses of the interference arm group close to the circumference appear separately, which can reduce the occupied space. By configuring more interference arm groups and microlenses, more low-frequency and high-frequency information in the detection area can be effectively collected.

[0069] Based on the above-mentioned microlens array, the present invention can adopt such a segmented planar imaging system based on an interferometer arm group, including at least one microlens array, a camera, P photonic integrated circuits and a data acquisition and processing module;

[0070] The camera is located at the center of the segmented planar imaging system, specifically at the position of a single lens, to collect optical information from that lens. The lens can be a single lens or a lens assembly composed of multiple lenses. The interferometer arms are evenly distributed along the radius of the camera, with the center of rotation being the center of the camera. The camera receives zero-frequency and some low-frequency information from the detection area and is connected to the data acquisition and processing module.

[0071] The photonic integrated circuit includes M+N waveguide transmission lines, M+N arrayed waveguide gratings (AWGs), and multiple balanced four-orthogonal detectors. The M+N lenses are connected to the M+N waveguide transmission lines in a one-to-one correspondence, i.e., one lens is connected to one waveguide transmission line. The waveguide transmission lines are connected to arrayed waveguide gratings (AWGs), which are connected to multiple balanced four-orthogonal detectors. The balanced four-orthogonal detectors are connected to a data acquisition and processing module.

[0072] Using the aforementioned segmented planar imaging system, the microlens array is rotated multiple times by the same angle θ around the center of the microlens array (i.e., the camera's central axis) to capture images. Each acquisition captures frequency information in a fixed direction, enabling the acquisition of frequency information from a wider range of interferometer arm groups.

[0073] This embodiment further provides an image reconstruction method for a segmented planar imaging system based on a rotating interferometer arm set, the image reconstruction method comprising the following steps:

[0074] S1. Rotate the microlens array around the center of the microlens array by the same angle each time, repeatedly performing imaging acquisition and image reconstruction;

[0075] S2. Divide each reconstructed image into multiple square image blocks and sort the image blocks. Perform similarity determination on image blocks with the same sequence number in each reconstructed image. Merge the spectrum information of the similar image blocks and then perform inverse Fourier transform to obtain the merged image blocks.

[0076] S3. Combine the merged image blocks to form a final image.

[0077] The specific method of image reconstruction may be:

[0078] S11. The microlenses of the interferometer arm group receive incident light from the scene through the waveguide transmission line and the arrayed waveguide grating. Light from the two microlenses of each group forming the baseline enters the same balanced four-orthogonal detector to obtain intensity information of the complex coherent light. The data acquisition and processing module stores the amplitude and phase information corresponding to the intensity information of the complex coherent light obtained by each of the balanced four-orthogonal detectors to obtain a first sub-spectrum matrix.

[0079] S12. The single lens at the center of the interferometer arm group collects the zero-frequency and partial low-frequency information of the scene through the camera to obtain the second sub-spectrum matrix, which is then combined with the first sub-spectrum matrix to form a spectrum matrix. A specific schematic diagram of the combined spectrum matrix is ​​shown below. Figure 5 As shown;

[0080] S13. Perform inverse Fourier transform on the spectrum matrix to complete a single image reconstruction.

[0081] The specific merging method in step S12 is:

[0082] If there is spectrum information at a certain element in the first sub-spectrum matrix and at the element at the corresponding position in the second sub-spectrum matrix, the average of the spectrum information of the elements at that position in the two sub-spectrum matrices is taken as the value of the element at that position in the spectrum matrix;

[0083] If there is only one sub-spectrum matrix with spectrum information at a certain element in the first sub-spectrum matrix and an element at a position corresponding to the second sub-spectrum matrix, then the value of the element at that position is the spectrum information of the sub-spectrum matrix with value;

[0084] Otherwise, the value of the element at that position in the spectrum matrix is ​​taken as zero.

[0085] The data acquisition and processing module receives the intensity information of the complex coherent light collected by the interferometer arm set. The camera captures the zero-frequency and partial low-frequency information of the scene, and then merges the two spectral information. The merging method is as follows: if a certain element in the interferometer arm set's spectrum matrix has spectrum information at the same position as the corresponding element in the spectrum matrix acquired by the camera, the spectrum information of all corresponding interferometer arms is combined to form the value of the element in the combined spectrum matrix. If there is no spectrum information, the value of the element in the combined spectrum matrix is ​​set to zero. The combined spectrum matrix is ​​then inverse Fourier transformed to complete a single image reconstruction. By rotating the interferometer arm set around the camera center n times and repeating the acquisition, the spectrum information and scene image acquired multiple times can be obtained.

[0086] By rotating the interferometer arm n times around the center of the microlens array and repeating steps S11-S13, the data acquisition and processing module stores the spectrum information and reconstructed image from these multiple rotations. The resulting spectrum information and image reconstruction results are then combined to create the final image reconstruction. The number of rotations n depends on a combination of time and accuracy. A larger number of n requires more time but increases accuracy.

[0087] To obtain accurate image merging results, it is necessary to perform an inverse Fourier transform on the spectrum information of a single image reconstruction to obtain a reconstructed image. After the reconstructed image is divided into blocks, the image blocks with the same sequence number are compared according to the similarity judgment formula. If an image block is considered similar in n single-reconstructed images, the spectrum information of these n times can be merged and inverse Fourier transformed. If not similar, the similarity is determined in n-1 single-reconstructed images, and so on until n = 1.

[0088] The specific method of similarity determination is:

[0089] The reconstructed image obtained by inverse Fourier transforming the spectrum information obtained each time is divided into m×m image blocks. The similarity judgment formula is used to judge the similarity of the blocks with the same sequence number in the reconstructed image. The calculation formula of the judgment result S of the similarity judgment is:

[0090] S={xi∈X:d(Z x1 ,Z x2 ...Z xn )≤τ}

[0091] Where xi represents the image block to be compared, X represents the set of image blocks that have been divided, and d(Z x1 ,Z x2 ...Z xn ) represents a method for determining the similarity between image blocks, including but not limited to the Euclidean distance between pixels of two image blocks, etc., τ is a similarity determination threshold, and if the threshold is lower than the threshold, the blocks are considered similar;

[0092] Based on the similarity determination results, a determination is made as to whether the image block is considered similar in all n single-shot reconstructed images. If so, the spectrum information from these n images is merged and an inverse Fourier transform is performed to obtain a single reconstructed image. If dissimilarities are found, all possible scenarios for reducing one image are repeated, and a determination is made as to whether the image block is considered similar in all n-1 single-shot reconstructed images. If so, the spectrum information of the image in which it is located is merged and an inverse Fourier transform is performed. Otherwise, the number of images reduced continues until n = 1.

[0093] The reconstructed image is divided into m×m square blocks, where m is the side length of the block, typically representing the number of pixels. Blocks with identical locations are used as the final result for that region. By traversing all blocks, similar blocks are found and, based on their source, their spectra are merged to produce the complete final image reconstruction.

[0094] The specific embodiment of the present invention provides a high-precision, high-resolution image acquisition method with a small system size and weight, and can be widely used in aviation, aerospace and other fields of high-precision image acquisition.

[0095] In this embodiment, the first lens array of the interferometer arm group contains 30 microlenses, and the second lens array contains 32 microlenses. All interferometer arm groups use the same microlenses with a clear aperture of 1 mm. The microlenses are tightly staggered. In this embodiment, there are 35 interferometer arm groups, and each interferometer arm group has a single lens uniformly distributed in a radial pattern around the center of the microlens array. The two lens arrays of a single interferometer arm group can form a baseline with a length of 1, 2, 3, ... 31, a total of 31 lens diameters. The radius of the single lens is 4.5 mm, which can collect zero-frequency and some low-frequency information in the detection area.

[0096] The effects of the present invention can be further illustrated by simulation. Table 1 is a simulation parameter table of a segmented planar imaging system based on a rotating interferometer arm set.

[0097] Table 1

[0098]

[0099]

[0100] The simulation parameters of the existing segmented planar imaging system and the present invention are shown in Table 1. The simulation results of the dynamic target are shown in Table 1. Figure 7 The simulation results for the static target are shown in Figure 8 As shown, Figure 7 and Figure 8 The left side is a schematic diagram of imaging using the prior art, and the right side is a schematic diagram of imaging using the present invention. Figure 7 and Figure 8 Comparing the left and right files, the imaged object contours of the present invention are clearer and the details are more obvious; the comparison of imaging quality evaluation is shown in Table 2.

[0101] Table 2

[0102]

[0103] In summary, it can be seen that since the present invention can collect more frequencies corresponding to the baseline length and add zero-frequency information and part of the low-frequency information, the peak signal-to-noise ratio (PSNR) and the structural similarity index (SSIM) are significantly improved compared with the existing segmented planar imaging system, and the image reconstruction effect is better.

[0104] The specific implementation methods described above further illustrate the objectives, technical solutions and beneficial effects of the present invention in detail. It should be understood that the above description is only a specific implementation method of the present invention and is not intended to limit the scope of protection of the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the scope of protection of the present invention.

Claims

1. A microlens array based on an interferometer arm group, characterized in that: include: P interference arm groups, each interference arm group includes a first lens column and a second lens column, the first lens column includes M microlenses continuously and closely arranged in a straight line; the second lens column includes N microlenses continuously and closely arranged in a straight line; P ≥ 2, M is less than or equal to N and both M and N are even numbers, M ≥ 4, and the diameters of the microlenses of the first lens column and the second lens column are equal; The microlens array further includes a single lens, wherein the single lens is a lens or a lens group having a diameter larger than that of the microlens; The plurality of interference arm groups are arranged in a circular radial pattern around the center of the microlens array, the central angles between the interference arm groups are equal, and the second lens array of each interference arm group is located in the radial direction of the circular pattern, and the single lens is located in the center of the microlens array; The microlenses in the two lens columns are paired in pairs to form a baseline, where forming a baseline means that the light rays of the two microlenses interfere to form a group of interference light.

2. The segmented planar imaging system based on the interferometer arm set according to claim 1, characterized in that: The specific way to form a baseline is as follows: The first lens column of the interference arm group uses the center line of the lens column as the symmetry axis, and the microlenses symmetrically distributed on both sides are paired to form a baseline; the second lens column of the interference arm group uses the central microlens of the lens column as the symmetry axis, and the microlenses symmetrically distributed on both sides are paired to form a baseline, and the central microlens is paired with the outermost unpaired microlens of the column to form a baseline, and the central microlens is any one of the two central microlenses.

3. The segmented planar imaging system based on the interferometer arm set according to claim 1, characterized in that: The micro lenses of the first lens column and the second lens column are arranged in a staggered and close relationship.

4. The segmented planar imaging system based on the interferometer arm set according to claim 1, characterized in that: NM=2.

5. A segmented planar imaging system based on an interferometer arm set, comprising a microlens array according to any one of claims 1 to 4, characterized in that: It also includes 1 camera, P photonic integrated circuits and 1 data acquisition and processing module; The camera is located behind a single lens at the center of the microlens array and can collect optical signals from the single lens; Each interferometer arm group is connected to a photonic integrated circuit, each of the photonic integrated circuits comprising M+N waveguide transmission lines, M+N arrayed waveguide gratings, and Q balanced four-orthogonal detectors; the M+N lenses within the interferometer arm group are connected one-to-one to the M+N waveguide transmission lines; the M+N waveguide transmission lines are connected one-to-one to the M+N arrayed waveguide gratings; the positions of the balanced four-orthogonal detectors and the arrayed waveguide gratings are arranged so that the arrayed waveguide grating output light can be collected by the Q balanced four-orthogonal detectors; The number Q of the balanced four orthogonal detectors is greater than or equal to the total number of baselines in a single interferometer arm group; The output end of each of the balanced four-orthogonal detectors is connected to the data acquisition and processing module for signal connection.

6. An image reconstruction method, using the imaging system of claim 4, comprising the following steps: S1. Rotate the microlens array around the center of the microlens array by the same angle each time, repeatedly performing imaging acquisition and image reconstruction; S2. Divide each reconstructed image into multiple square image blocks and sort the image blocks. Perform similarity determination on image blocks with the same sequence number in each reconstructed image. For similar image blocks, merge the spectral information of the images in which they are located and then perform an inverse Fourier transform. Select the image blocks with the same sequence number as the merged image blocks. S3. Combine the merged image blocks to form a final image.

7. The image reconstruction method according to claim 6, wherein: The specific method of image reconstruction in S1 is: S11. The microlenses of the interferometer arm group receive the incident light of the scene through the waveguide transmission line and the arrayed waveguide grating. The light from the two microlenses of each group forming the baseline enters the same balanced four-quadruple detector to obtain the intensity information of the complex coherent light; The data acquisition and processing module stores the amplitude and phase information corresponding to the intensity information of the complex coherent light obtained by each of the four balanced orthogonal detectors to obtain a first sub-spectrum matrix; S12. The single lens at the center of the interferometer arm group uses a camera to collect zero-frequency and partial low-frequency information of the scene to obtain a second sub-spectrum matrix, which is then combined with the first sub-spectrum matrix to form a spectrum matrix. S13. Perform inverse Fourier transform on the spectrum matrix to complete a single image reconstruction.

8. The image reconstruction method according to claim 7, wherein: The specific merging method in step S12 is: If there is spectrum information at a certain element in the first sub-spectral matrix and at the element at the corresponding position in the second sub-spectral matrix, the average of the spectrum information of the elements at that position in the two sub-spectral matrices is taken as the value of the element at that position in the spectrum matrix; If there is only one sub-spectrum matrix with spectrum information at a certain element in the first sub-spectrum matrix and an element at a position corresponding to the second sub-spectrum matrix, then the value of the element at that position is the spectrum information of the sub-spectrum matrix with value; Otherwise, the value of the element at that position in the spectrum matrix is ​​taken as zero.

9. The image reconstruction method according to claim 6, wherein: The specific method for similarity determination in step S2 is: The similarity judgment formula is used to judge the similarity of the same sequence number blocks in different reconstructed images to determine whether the image blocks are considered similar in n single-shot reconstructed images; If they are considered similar, the spectrum information of n times is merged and inverse Fourier transform is performed to obtain the merged image block; If they are considered not similar, all possible situations of reducing one image are traversed, and it is determined whether the image blocks in the n-1 single reconstructed images are considered similar. If they are similar, the spectrum information of the image is merged and then the inverse Fourier transform is performed. Otherwise, one image is continuously reduced until n = 1.

10. The image reconstruction method according to claim 9, wherein: The calculation formula of the discrimination result S of the similarity discrimination is: S={x∈X:d(Z x1 ,Z x2 ……Z xn )≤τ} Where xi represents the image block to be compared, X represents the set of image blocks that have been divided, and d(Z x1 ,Z x2 ...Z xn ) represents the method for determining the similarity between image blocks, τ is the similarity determination threshold, and if it is lower than τ, they are considered similar.

Citation Information

Patent Citations

  • Segmented planar imaging system and method based on optical switch

    CN113126205A

  • Interference imaging method and system based on microlens array and photonic integrated chip

    CN113433688A