Multi-aperture imaging optical system and common phase correction method thereof

Abstract

The present invention relates to the field of multi-aperture imaging technology, and in particular to a multi-aperture imaging optical system and a common phase correction method, the common phase correction method comprising: establishing a simulation model, performing vibration simulation analysis to obtain a first simulation relationship, performing a vibration experiment to obtain a first experimental relationship, optimizing the first simulation relationship using the first experimental relationship to obtain a first target relationship; experimentally obtaining a second experimental relationship between a common phase error and an image degradation value, simulating to obtain a second simulation relationship between a common phase error and an image degradation value, optimizing the second simulation relationship using the second experimental relationship to obtain a second target relationship; obtaining actual vibration parameters according to image degradation values ​​under actual vibration conditions, and controlling the common phase error according to the actual vibration parameters, so that the common phase error of the multi-aperture imaging optical system is less than a preset value. The present invention is at least conducive to reducing the impact of vibration on the imaging of the multi-aperture imaging optical system.

Description

Technical Field

[0001] The invention belongs to the technical field of multi-aperture imaging, and in particular relates to a multi-aperture imaging optical system and a common phase correction method thereof. Background Art

[0002] An optical system that uses multiple small, light, and low-cost sub-apertures through a specific arrangement and combination is generally called a multi-aperture imaging optical system. The multi-aperture imaging optical system is a high-resolution optical system. Under the same detection capability, the multi-aperture imaging optical system has a lighter weight, more flexible distribution capability, and smaller structural size. Therefore, it is widely used in the aerospace field.

[0003] Whether it is a rocket launch or an in-orbit operation in space, there will be strong vibration shocks. For multi-aperture imaging optical systems, vibration not only damages the mechanical structure or reduces the life of the mechanical structure, but also causes changes in the adjustment position of the optical elements in the optical system, such as displacement along the optical axis, radial movement, or tilting in various directions, which in turn affects the phase relationship between the various sub-apertures. Specifically, when the vibration frequency and amplitude are large, the multi-aperture imaging optical system is affected by vibration, causing the optical elements included to rotate, tilt or shift, and even deform the optical elements, and ultimately produce common phase errors. This will cause serious degradation of the imaging quality for multi-aperture imaging optical systems that require precise common phase as a condition for image quality assurance.

[0004] In order to reduce the impact of vibration on the imaging of optical systems, a large number of studies have been carried out both at home and abroad on vibration-related characteristics and suppression methods. However, at present, there is still a lack of a method to compensate for the image degradation of multi-aperture imaging optical systems caused by vibration in the aerospace working environment. Summary of the invention

[0005] In view of this, the present invention aims to provide a multi-aperture imaging optical system and a common phase correction method thereof, which at least helps to reduce the impact of vibration on imaging of the multi-aperture imaging optical system.

[0006] To achieve the above object, the technical solution created by the present invention is implemented as follows:

[0007] The invention provides a common phase correction method, comprising: providing a multi-aperture imaging optical system; establishing a simulation model according to the multi-aperture imaging optical system, performing vibration simulation analysis on the simulation model to obtain a first simulation relationship between vibration parameters and common phase error, performing a vibration experiment on the multi-aperture imaging optical system to obtain a first experimental relationship between vibration parameters and common phase error, optimizing the first simulation relationship based on a first optimization algorithm using the first experimental relationship to obtain a first target relationship; experimentally obtaining an image degradation condition when the multi-aperture imaging optical system has a common phase error to obtain a second experimental relationship between the common phase error and the image degradation value, simulating obtaining an image degradation condition when the simulation model has a common phase error to obtain a second simulation relationship between the common phase error and the image degradation value, optimizing the second simulation relationship based on a second optimization algorithm using a second experimental relationship to obtain a second target relationship; obtaining actual vibration parameters according to the image degradation value under actual vibration conditions, the second target relationship and the first target relationship, and correcting the common phase error of the multi-aperture imaging optical system according to the actual vibration parameters to make the common phase error of the multi-aperture imaging optical system less than a preset value.

[0008] Furthermore, the multi-aperture imaging optical system includes multiple sub-aperture components, phase delay modulation components, beam combining components and detectors, the sub-aperture components are used to receive light beams, the phase delay modulation components are used to receive light beams output by each sub-aperture component and regulate the phase of the light beam output by each sub-aperture component, the beam combining component is used to combine the light beams emitted from the phase delay modulation components, and the detector receives the light beams output by the beam combining component and forms an image; the delay modulation component includes: a high-speed phase control unit, which corrects the common-phase error of the multi-aperture imaging optical system according to actual vibration parameters so that the common-phase error of the aperture imaging optical system is less than a preset value.

[0009] Furthermore, establishing a simulation model based on the multi-aperture imaging optical system includes: using optical design software to establish an optical system model of the multi-aperture imaging optical system, exporting the optical system model, using three-dimensional modeling design software to establish a structural model corresponding to the mechanical support and shell of the multi-aperture imaging optical system, and assembling the structural model with the optical system model to obtain a simulation model.

[0010] Furthermore, the optical design software includes Zemax or Code-V; the 3D modeling design software includes Unigraphics NX, SolidWorks or Inventor.

[0011] Furthermore, performing vibration simulation analysis on the simulation model includes: importing the simulation model into finite element software to perform finite element simulation modal analysis.

[0012] Furthermore, the first target relationship is expressed as a Zernike polynomial, which is as follows:

[0013] ;

[0014] in, represents the fitting formula of the i-th term of the Zernike polynomial, represents the coefficient of the i-th term of the Zernike polynomial, n represents the total number of Zernike fits, and m represents the number of simulation variables of different frequencies. f m A three-dimensional matrix function representing the common phase error value and light amplitude change related to the vibration parameters, represents the vibration parameter, represents the vibration vector, The modulus value represents the vibration amplitude, the direction of the vibration vector represents the vibration direction, and v represents the vibration frequency corresponding to the vibration vector.

[0015] Furthermore, the first optimization algorithm and / or the second optimization algorithm includes a gradient descent algorithm, a stochastic gradient optimization algorithm, a simulated annealing optimization algorithm, a swarm intelligence algorithm, an evolutionary algorithm or a neural network algorithm.

[0016] Furthermore, the loss function of the second target relationship is:

[0017] ;

[0018] Among them, f represents the parameter relationship function of the multi-aperture imaging optical system corresponding to the ideal imaging effect, h represents the image degradation convolution kernel, A represents the first optimization iterative tensor fitting formula, B represents the second optimization iterative tensor fitting formula, N represents the noise dynamic estimation fitting value, and g represents the parameter relationship function of the multi-aperture imaging optical system corresponding to the actual imaging effect.

[0019] Furthermore, the common phase error of the multi-aperture imaging optical system is corrected according to the actual vibration parameters based on a dynamic compensation correction algorithm, and the dynamic compensation correction algorithm includes: a PID control algorithm, a neural network control algorithm, an LQR control algorithm or a sliding film control algorithm.

[0020] Another aspect of the present invention provides a multi-aperture imaging optical system, including: the multi-aperture imaging optical system is used to implement the above-mentioned common phase correction method.

[0021] Compared with the prior art, the invention can achieve the following beneficial effects: the common-phase correction method provided in the embodiment of the invention adopts a method combining vibration simulation and experiment on the simulation model to obtain the common-phase error of the multi-aperture imaging optical system caused by vibration, and obtain a first target relationship representing the relationship between the vibration parameter and the common-phase error, and then perform simulation analysis and experimental analysis on the relationship between the common-phase error and the image degradation, and obtain a second target relationship representing the relationship between the common-phase error and the image degradation value. When the vibration causes the multi-aperture imaging optical system to produce image degradation, the corresponding vibration parameters can be obtained based on the image degradation value, based on the first target relationship and the second target relationship. The multi-aperture imaging optical system can be corrected in real time based on the vibration parameters. In the case of vibration, dynamic compensation is performed to alleviate the image degradation, effectively reducing the influence of the phase change of the multi-aperture imaging optical system on the imaging of the whole machine, thereby achieving stable imaging in a vibration environment. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] The drawings constituting part of the present invention are used to provide a further understanding of the present invention. The exemplary embodiments and descriptions of the present invention are used to explain the present invention and do not constitute an improper limitation on the present invention. In the drawings:

[0023] Figure 1 A schematic diagram of the optical structure of the multi-aperture imaging optical system according to an embodiment of the present invention;

[0024] Figure 2 A schematic diagram of the optical structure of the phase delay modulation component described in an embodiment of the present invention.

[0025] Explanation of the accompanying drawings: 1. Sub-aperture component; 2. Phase delay modulation component; 3. Beam combining component; 4. Detector; 10. Phase modulation unit; 20. Phase sensing unit; 30. Light field control unit; 40. Light field decoding unit; 50. Phase detection unit; 60. Wavefront modulation unit. DETAILED DESCRIPTION

[0026] After analysis, it was found that the current multi-aperture imaging optical system has high requirements for the phase consistency of each sub-aperture. Therefore, the multi-aperture imaging optical system is required to work on a highly stable carrier and in a highly stable environment. This greatly limits the development of multi-aperture imaging optical technology and the application areas of multi-aperture imaging optical systems.

[0027] To solve the above problems, an embodiment of the present invention provides a common-phase correction method. The method aims at the problem that each sub-aperture of a multi-aperture imaging optical system has a large common-phase error due to the influence of vibration, which further affects the imaging effect of the optical system and causes image degradation. By utilizing the relationship between the common-phase error and image degradation, as well as the relationship between the common-phase error and vibration, the common-phase of the multi-aperture imaging optical system is adjusted according to the image degradation, so as to achieve real-time common-phase correction of the multi-aperture imaging optical system in a vibration environment, thereby ensuring that the multi-aperture imaging optical system has a small common-phase error under vibration conditions, thereby ensuring the imaging quality of the multi-aperture imaging optical system.

[0028] In order to make the purpose, technical solution and advantages of the invention more clear, the invention is further described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described here are only used to explain the invention and do not constitute a limitation of the invention.

[0029] It should be noted that, in the absence of conflict, the embodiments of the present invention and the features in the embodiments may be combined with each other.

[0030] In the description of the invention, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", "clockwise", "counterclockwise", etc., indicating the orientation or position relationship, are based on the orientation or position relationship shown in the drawings, and are only for the convenience of describing the invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation on the invention. In addition, the terms "first", "second", etc. are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as "first", "second", etc. may explicitly or implicitly include one or more of the features. In the description of the invention, unless otherwise specified, the meaning of "multiple" is two or more.

[0031] In the description of the invention, it should be noted that, unless otherwise clearly specified and limited, the terms "installation", "connection" and "connection" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in the invention can be understood according to specific circumstances.

[0032] The present invention will be described in detail below with reference to the accompanying drawings and in combination with embodiments.

[0033] The invention provides a common phase correction method, comprising: providing a multi-aperture imaging optical system; establishing a simulation model according to the multi-aperture imaging optical system, performing vibration simulation analysis on the simulation model to obtain a first simulation relationship between vibration parameters and common phase error, performing a vibration experiment on the multi-aperture imaging optical system to obtain a first experimental relationship between vibration parameters and common phase error, optimizing the first simulation relationship based on a first optimization algorithm using the first experimental relationship to obtain a first target relationship; experimentally obtaining an image degradation condition when the multi-aperture imaging optical system has a common phase error to obtain a second experimental relationship between the common phase error and the image degradation value, simulating obtaining an image degradation condition when the simulation model has a common phase error to obtain a second simulation relationship between the common phase error and the image degradation value, optimizing the second simulation relationship based on a second optimization algorithm using a second experimental relationship to obtain a second target relationship; obtaining actual vibration parameters according to the image degradation value under actual vibration conditions, the second target relationship and the first target relationship, and correcting the common phase error of the multi-aperture imaging optical system according to the actual vibration parameters to make the common phase error of the multi-aperture imaging optical system less than a preset value.

[0034] It should be noted that the process of correcting the common phase error of the multi-aperture imaging optical system according to the actual vibration parameters is a real-time dynamic control process.

[0035] For further reference, Figure 1 The multi-aperture imaging optical system includes multiple sub-aperture components 1, a phase delay modulation component 2, a beam combining component 3 and a detector 4. The sub-aperture component 1 is used to receive a light beam. The phase delay modulation component 2 is used to receive a light beam output by each sub-aperture component 1 and to adjust the phase of the light beam output by each sub-aperture component 1. The beam combining component 3 is used to combine the light beams emitted from the phase delay modulation component 2. The detector 4 receives the light beams output by the beam combining component 3 and forms an image. The phase delay modulation component 2 includes: a high-speed phase control unit. The high-speed phase control unit corrects the common phase error of the multi-aperture imaging optical system according to actual vibration parameters so that the common phase error of the multi-aperture imaging optical system is less than a preset value.

[0036] It should be noted that the sub-aperture component 1 generally has a longer baseline length, and the embodiment of the present invention does not limit the number, size and arrangement of the multiple sub-aperture components 1; the phase delay modulation component 2 is used to ensure strict common phase between the sub-aperture components 1, and the common phase refers to the consistency of the phase of the light beams output by each sub-aperture component 1. The strict common phase between the sub-aperture components 1 is ensured to meet the common phase condition of the multi-aperture imaging optical system and realize high-resolution imaging of the multi-aperture imaging optical system.

[0037] In some embodiments of the present invention, each sub-aperture component 1 corresponds to one or more phase delay modulation components 2 .

[0038] In some embodiments of the present invention, the optical system structure of the sub-aperture component 1 includes but is not limited to a micro-nano optical metasurface, a microlens array, a refractive system, a reflective system, a catadioptric system, a diffractive system or an interference system.

[0039] In some embodiments of the present invention, the phase delay modulation component 2 includes a set of optical elements or mechanical elements that can modulate the phase of each sub-aperture component 1, so as to achieve precise adjustment of the common phase of the multi-aperture imaging optical system.

[0040] In some embodiments of the present invention, the phase delay modulation component 2 includes but is not limited to performing optical phase modulation using a retroreflective mirror, performing optical phase modulation using a phase modulator, and performing optical phase modulation using an optical delay device.

[0041] In some embodiments of the present invention, the beam combining component 3 may be a refractive system, a reflective system, or a catadioptric system.

[0042] In some embodiments of the present invention, the beam combining component 3 may be an optical system using diffraction or interference as a working principle.

[0043] In some embodiments of the present invention, the multi-aperture imaging optical system may include a plurality of detectors, and each detector may correspond to one or more sub-aperture components 1 .

[0044] In some embodiments of the present invention, reference Figure 2The phase delay modulation component 2 is mainly composed of a phase modulation unit 10, a phase sensing unit 20, a light field control unit 30, a light field decoding unit 40, a phase detection unit 50 and a wavefront modulation unit 60. The phase modulation unit 10 is used as a high-speed phase control unit. The main function of the phase modulation unit 10 is to perform real-time and high-precision modulation of the common phase of the multi-aperture imaging optical system by using a high-precision fast phase modulation mirror group. The main function of the phase sensing unit 20 is to use a phase real-time sensor device to monitor the optical phase of each sub-aperture component 1 in real time; the main function of the light field control unit 30 is to use a light field control element to perform light field compression on the incident image and the reference light field of the image, and input the compressed light field information into the phase modulation unit 10; the main function of the light field decoding unit 40 is to use a light field control element to perform reference light separation on the compressed light field information containing the phase information of the sub-aperture component 1, and input the separated light field information into the wavefront modulation unit 60 for wavefront modulation, which is beneficial to reducing the phase measurement sensitivity and improving the imaging resolution of the multi-aperture imaging optical system. The remaining light field information is injected into the phase detection unit 50 for real-time phase solution, and the phase modulation unit 10 is dynamically adjusted according to the real-time solution result.

[0045] In some embodiments of the present invention, the elements in the high-precision fast phase modulation mirror group include but are not limited to optical elements such as fast reflection mirrors, phase modulation plates, folding mirrors, rotating mirrors, rotating parallel plates, etc.

[0046] In some embodiments of the present invention, the elements in the light field control unit 30 include but are not limited to a wavefront phase plate, a metasurface element, a traditional transmissive reflective optical element, a diffraction element, and the like.

[0047] In some embodiments of the present invention, the elements in the light field decoding unit 40 include but are not limited to optical encoders and decoders, wavefront phase plates, metasurface elements, traditional transflective optical elements, diffractive surface elements, etc.

[0048] Furthermore, establishing a simulation model based on the multi-aperture imaging optical system includes: using optical design software to establish an optical system model of the multi-aperture imaging optical system, exporting the optical system model, using three-dimensional modeling design software to establish a structural model corresponding to the mechanical support and shell of the multi-aperture imaging optical system, and assembling the structural model with the optical system model to obtain a simulation model.

[0049] Furthermore, optical design software includes but is not limited to software with optical design capabilities such as Zemax or Code-V; 3D modeling design software includes Unigraphics NX, solidworks or Inventor.

[0050] In some embodiments of the present invention, the specific steps of establishing a simulation model according to a multi-aperture imaging optical system can be as follows: first, an optical system model is established using optical design software, and each optical element in the multi-aperture imaging optical system can be modeled using the non-sequential mode of the optical design software. Generally, the optical design software has an evaluation function for realizing the optimization function, and parameter targets, weights, optimization types, and optimization reference points are set in the evaluation function editor, wherein the parameter targets include setting the curvature, thickness, glass material, quadratic surface, parameter data, and corresponding additional data of the lens, and the weights can be comprehensively considered according to the contribution ratio of each parameter target required to participate in the optimization process, and the optimization types include RMS (Root Mean Square Radius) point array diagram and wavefront, etc. There are three options for optimization reference points, namely, center as reference point, light as reference point, and no reference point. After setting the parameter targets, weights, optimization types, and optimization reference points in the evaluation function editor, the optical design software will use the effective damping least squares method to optimize the evaluation function composed of the parameter targets and weights to optimize each element in the optical system model, and finally derive the optimized optical system model. A structural model corresponding to the mechanical support and shell of the multi-aperture imaging optical system is established in the three-dimensional modeling design software, and the structural model is assembled and combined with the optical system model to obtain a simulation model.

[0051] Furthermore, performing vibration simulation analysis on the simulation model includes: importing the simulation model into finite element software to perform finite element simulation modal analysis.

[0052] The vibration analysis (vibration simulation analysis and vibration experiment) specifically includes: performing vibration simulation analysis on the simulation model according to the actual working conditions; performing a vibration experiment on the actual multi-aperture imaging optical system, using the experimental results (first experimental relationship) to verify the credibility of the simulation results (first simulation relationship), and finally fitting to obtain the relationship between the vibration parameters and the common phase error value, that is, the first target relationship.

[0053] In some embodiments of the present invention, the finite element software includes but is not limited to software such as Comsol or Ansys that has multi-physics field model analysis capabilities.

[0054] Furthermore, the first target relationship is expressed as a Zernike polynomial, which is: ;in represents the fitting formula of the i-th term of the Zernike polynomial, represents the coefficient of the i-th term of the Zernike polynomial, n represents the total number of Zernike fits, and m represents the number of simulation variables of different frequencies. f m A three-dimensional matrix function representing the common phase error value and light amplitude change related to the vibration parameters, represents the vibration vector, The modulus value represents the vibration amplitude, the direction of the vibration vector represents the vibration direction, and v represents the vibration frequency corresponding to the vibration vector. Represents vibration parameters.

[0055] The first target relationship covers specific parameters such as vibration direction, vibration frequency, vibration amplitude, common phase error value (light phase change), light amplitude change, etc. The first target relationship is a three-dimensional matrix equation.

[0056] In some embodiments of the present invention, the specific process of obtaining the second target relationship through simulation and experiment can be as follows:

[0057] For the step of experimentally obtaining the image degradation when the multi-aperture imaging optical system has a common phase error, it is necessary to use an actually existing multi-aperture imaging optical system that has met the common phase condition, and use the phase delay modulation component 2 to make the multi-aperture imaging optical system leave the common phase state, thereby generating image degradation, and collect the degraded image and the phase delay adjustment amount of the phase delay modulation component 2, and organize them into a first database of phase delay adjustment amounts and image degradation values, wherein the phase delay adjustment amount is the common phase error; then, for the actually existing multi-aperture imaging optical system that has met the common phase condition, adjust the position of each sub-aperture component 1 separately, so that the multi-aperture imaging optical system produces different degrees of optical tilt, and collect the image degradation at different optical tilts, which is also reflected as a common phase error. According to the image degradation at different optical tilts, a second database of common phase errors and image degradation values ​​is organized, and the first database and the second database are combined to obtain an experimental database, and the experimental database contains a second experimental relationship;

[0058] For simulating and obtaining image degradation when the simulation model has a common phase error, finite element software can be used to perform phase delay adjustment and optical tilt adjustment on the simulation model to obtain image degradation corresponding to different phase delay adjustments and image degradation corresponding to different optical tilts, and finally organize them into a simulation database of common phase errors and image degradation values, wherein the simulation database includes a second simulation relationship;

[0059] The data information in the simulation database and the experimental database are matched one by one, and the second simulation relationship is optimized by using the second experimental relationship based on the second optimization algorithm to obtain the second target relationship.

[0060] Furthermore, the first optimization algorithm and / or the second optimization algorithm include a gradient descent algorithm, a stochastic gradient optimization algorithm, a simulated annealing optimization algorithm, a swarm intelligence algorithm, an evolutionary algorithm, a neural network algorithm or other fitting algorithms that do not use gradient quantities for calculation.

[0061] Furthermore, the second target relationship is a complex multi-dimensional matrix tensor fitting formula, and its loss function can be expressed as , where f represents the parameter relationship function of the multi-aperture imaging optical system corresponding to the ideal imaging effect, m represents the total number of data columns of the parameter relationship function f, h represents the image degradation convolution kernel obtained by cross-correlation calculation for the first target relationship, A represents the first optimization iterative tensor fitting formula, B represents the second optimization iterative tensor fitting formula, N represents the noise dynamic estimation fitting value, and g represents the parameter relationship function of the multi-aperture imaging optical system corresponding to the actual imaging effect.

[0062] In some embodiments of the present invention, the steps of optimizing the second simulation relationship using the second experimental relationship based on the second optimization algorithm to obtain the second target relationship are specifically as follows:

[0063] For the simulation database, the relationship between multiple different common phase errors and image degradation values ​​is combined to obtain a second simulation relationship. The uniqueness of the second simulation relationship is verified by using random common phase errors, and the fitting coefficient and the number of uniqueness judgment condition function terms are continuously increased. The second simulation relationship with uniqueness is obtained through repeated iterations. For the experimental database, the relationship between multiple different common phase errors and image degradation values ​​is combined to obtain a second experimental relationship. The uniqueness of the second experimental relationship is verified by using random common phase errors, and the fitting coefficient and the number of uniqueness judgment condition function terms are continuously increased. The second experimental relationship with uniqueness is obtained through repeated iterations.

[0064] Comparing the difference between the second experimental relationship and the second simulation relationship, and adding compensation polynomials (A and B) to the second simulation relationship according to the difference to obtain an optimized second simulation relationship, so as to enhance the fitting degree between the experimental results and the simulation results;

[0065] The common-phase error of the simulation model is randomly changed. Specifically, the common-phase error can be generated by phase delay adjustment and optical tilt adjustment. The image degradation value, i.e., the fitting value, is calculated according to the common-phase error using the optimized second simulation relationship. The image degradation value (simulation value) is compared with the simulated image degradation value, and the mean square error between the fitting value and the simulation value is analyzed. The simulation value is iterated multiple times in combination with the fitting value to reduce the difference between the fitting value and the simulation value, and the error function value is updated to the local minimum to obtain the second target relationship.

[0066] Furthermore, the common phase error of the multi-aperture imaging optical system is corrected according to the vibration parameters based on the dynamic compensation correction algorithm, and the dynamic compensation correction algorithm includes: PID (Proportion Integral Differential) control algorithm, neural network control algorithm, LQR (Linaer Quadratic Regulator) control algorithm, sliding film control algorithm or other optimization control algorithms. The dynamic compensation correction algorithm is used to dynamically correct the imaging effect of the multi-aperture imaging optical system. The response speed of the dynamic compensation correction algorithm should be faster than the frame rate of the detector 4, and the phase modulation unit 10 should have the ability of fast phase adjustment to optimize the image quality through dynamic compensation.

[0067] In some embodiments of the present invention, based on the dynamic compensation correction algorithm, the step of correcting the common phase error of the multi-aperture imaging optical system according to the actual vibration parameters specifically includes: after obtaining the second target relationship, calculating the common phase error value of the current multi-aperture imaging optical system according to the image degradation value under the actual vibration condition, it is necessary to obtain the image degradation value change curve under the vibration state through single-frame and multi-frame image calculations, obtain the common phase error change curve through the second target relationship, and use the dynamic compensation correction algorithm according to the common phase error change curve to perform real-time regulation on the phase delay of the multi-aperture imaging optical system to dynamically compensate for the common phase error of the multi-aperture imaging optical system, so that the common phase error of the multi-aperture imaging optical system is zero or less than a preset value. The common phase error less than the preset value means that the common phase error is close to zero. In some examples, the preset value can be one tenth of the maximum wavelength in the spectral range of the multi-aperture imaging optical system.

[0068] In some embodiments of the present invention, the phase delay of the multi-aperture imaging optical system is controlled in real time by using a dynamic compensation correction algorithm according to the common phase error change curve, specifically including: according to the common phase error change curve, repeatedly iteratively updating the loss function of the second target relationship until the multi-aperture imaging optical system meets the common phase condition (the common phase error of the multi-aperture imaging optical system is zero or less than a preset value), using a deconvolution method to process image data for the image degradation convolution kernel h, so that the multi-aperture imaging optical system starts to output the corrected dynamic imaging effect, and completes the dynamic compensation correction imaging for vibration. That is, it is equivalent to analyzing the image degradation effect, and then inputting the common phase error adjustment value through the high-speed phase control unit at the back end, the common phase error adjustment value is obtained based on the second target relationship, and the common phase error is continuously fine-tuned. After a certain period of matching, dynamic compensation correction of the image is realized, so that the multi-aperture imaging optical system that does not meet the common phase condition is close to the common phase condition, thereby improving the imaging effect.

[0069] The common-phase correction method provided in an embodiment of the present invention provides a common-phase correction scheme with high feasibility in a vibration environment, and obtains a common-phase restoration image through real-time iteration of the second target relationship. It is suitable for real-time correction of the phase of a multi-aperture imaging optical system, and realizes stable imaging of the optical system in a working environment with certain vibrations, thereby expanding the application scenarios of multi-aperture imaging optical systems.

[0070] Another aspect of the present invention is to provide a multi-aperture imaging optical system, which is used to implement the above-mentioned common phase correction method.

[0071] In some embodiments of the present invention, reference Figure 1 The multi-aperture imaging optical system includes: multiple sub-aperture components 1, a phase delay modulation component 2, a beam combining component 3 and a detector 4, the sub-aperture component 1 is used to receive a light beam, the phase delay modulation component 2 is used to receive the light beam output by each sub-aperture component and adjust the phase of the light beam output by each sub-aperture component, the beam combining component 3 is used to combine the light beam emitted from the phase delay modulation component 2, and the detector 4 receives the light beam output by the beam combining component 3 and forms an image; the phase delay modulation component 2 includes: a high-speed phase control unit, which corrects the common phase error of the multi-aperture imaging optical system according to actual vibration parameters so that the image degradation value is less than a preset value.

[0072] In some embodiments of the present invention, the phase delay modulation component 2 includes but is not limited to performing optical phase modulation using a retroreflective mirror, performing optical phase modulation using a phase modulator, and performing optical phase modulation using an optical delay device.

[0073] In some embodiments of the present invention, the beam combining component 3 may be a refractive system, a reflective system, or a catadioptric system.

[0074] In some embodiments of the present invention, reference Figure 2The phase delay modulation component 2 is mainly composed of a phase modulation unit 10, a phase sensing unit 20, a light field control unit 30, a light field decoding unit 40, a phase detection unit 50 and a wavefront modulation unit 60. The phase modulation unit 10 is used as a high-speed phase control unit. The main function of the phase modulation unit 10 is to perform real-time and high-precision modulation of the common phase of the multi-aperture imaging optical system by using a high-precision fast phase modulation mirror group. The main function of the phase sensing unit 20 is to use a phase real-time sensor device to monitor the optical phase of each sub-aperture component 1 in real time; the main function of the light field control unit 30 is to use a light field control element to perform light field compression on the incident image and the reference light field of the image, and input the compressed light field information into the phase modulation unit 10; the main function of the light field decoding unit 40 is to use a light field control element to perform reference light separation on the compressed light field information containing the phase information of the sub-aperture component 1, and input the separated light field information into the wavefront modulation unit 60 for wavefront modulation, which is beneficial to reducing the phase measurement sensitivity and improving the imaging resolution of the multi-aperture imaging optical system. The light field information after wavefront modulation is injected into the phase detection unit 50 for real-time phase solution, and the phase modulation unit 10 is dynamically adjusted according to the real-time solution result.

[0075] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in the disclosure of the present invention can be performed in parallel, sequentially or in different orders, as long as the desired results of the technical solution disclosed in the present invention can be achieved, and this document does not limit this.

[0076] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A common phase correction method, characterized in that: include: Providing a multi-aperture imaging optical system; A simulation model is established according to the multi-aperture imaging optical system, and a vibration simulation analysis is performed on the simulation model to obtain a first simulation relationship between a vibration parameter and a common phase error. A vibration experiment is performed on the multi-aperture imaging optical system to obtain a first experimental relationship between a vibration parameter and a common phase error. The first simulation relationship is optimized using the first experimental relationship based on a first optimization algorithm to obtain a first target relationship, wherein the first target relationship is expressed as a Zernike polynomial, and the Zernike polynomial is as follows: ； in, represents the fitting formula of the i-th term of the Zernike polynomial, represents the coefficient of the i-th term of the Zernike polynomial, n represents the total number of Zernike fits, and m represents the number of simulation variables of different frequencies. f m A three-dimensional matrix function representing the common phase error value and light amplitude change related to the vibration parameters, represents the vibration parameter, represents the vibration vector, The modulus value represents the vibration amplitude, the direction of the vibration vector represents the vibration direction, and v represents the vibration frequency corresponding to the vibration vector; The image degradation condition when the multi-aperture imaging optical system has a common phase error is experimentally obtained to obtain a second experimental relationship between the common phase error and the image degradation value. The image degradation condition when the simulation model has a common phase error is simulated to obtain a second simulation relationship between the common phase error and the image degradation value. The second simulation relationship is optimized using the second experimental relationship based on a second optimization algorithm to obtain a second target relationship. The loss function of the second target relationship is: ； Wherein, f represents the parameter relationship function of the multi-aperture imaging optical system corresponding to the ideal imaging effect, h represents the image degradation convolution kernel, A represents the first optimization iterative tensor fitting formula, B represents the second optimization iterative tensor fitting formula, N represents the noise dynamic estimation fitting value, and g represents the parameter relationship function of the multi-aperture imaging optical system corresponding to the actual imaging effect; According to the image degradation value under actual vibration conditions, the second target relationship and the first target relationship, actual vibration parameters are obtained, and the common phase error of the multi-aperture imaging optical system is corrected according to the actual vibration parameters so that the common phase error of the multi-aperture imaging optical system is less than a preset value.

2. The common phase correction method according to claim 1, characterized in that: The multi-aperture imaging optical system comprises a plurality of sub-aperture components, a phase delay modulation component, a beam combining component and a detector, wherein the sub-aperture components are used to receive light beams, the phase delay modulation component is used to receive light beams output by each of the sub-aperture components and to adjust the phase of the light beams output by each of the sub-aperture components, the beam combining component is used to combine light beams emitted from the phase delay modulation component, and the detector receives the light beams output by the beam combining component and forms an image; The phase delay modulation component includes: a high-speed phase control unit, which corrects the common phase error of the multi-aperture imaging optical system according to the actual vibration parameters so that the common phase error of the multi-aperture imaging optical system is less than the preset value.

3. The common phase correction method according to claim 1, characterized in that: Establishing a simulation model based on the multi-aperture imaging optical system includes: using optical design software to establish an optical system model of the multi-aperture imaging optical system, exporting the optical system model, using three-dimensional modeling design software to establish a structural model corresponding to the mechanical support and shell of the multi-aperture imaging optical system, and assembling and combining the structural model with the optical system model to obtain the simulation model.

4. The common phase correction method according to claim 3, characterized in that: The optical design software is Zemax or Code-V; the three-dimensional modeling design software is Unigraphics NX, SolidWorks or Inventor.

5. The common phase correction method according to claim 1, characterized in that: Performing vibration simulation analysis on the simulation model includes: importing the simulation model into finite element software to perform finite element simulation modal analysis.

6. The common phase correction method according to claim 1, characterized in that: The first optimization algorithm and / or the second optimization algorithm is a gradient descent algorithm, a stochastic gradient optimization algorithm, a simulated annealing optimization algorithm, a swarm intelligence algorithm, an evolutionary algorithm or a neural network algorithm.

7. The common phase correction method according to claim 1, characterized in that: The common phase error of the multi-aperture imaging optical system is corrected according to the actual vibration parameters based on a dynamic compensation correction algorithm, and the dynamic compensation correction algorithm is: a PID control algorithm, a neural network control algorithm, an LQR control algorithm or a sliding film control algorithm.

8. A multi-aperture imaging optical system, characterized in that: include: The multi-aperture imaging optical system is used to implement the common phase correction method according to any one of claims 1 to 7.

Images