High-resolution standardized microarray fly's-eye lens module and light field regulation and control system

Abstract

The invention discloses a high-resolution standardized microarray compound eye lens module and a light field regulation and control system, particularly relates to the technical field of light field regulation and control, and realizes high-precision standardized definition of key parameters of a microlens unit and optical axis micro-angle deviation calibration through a microlens array standardized module. A standardized micro-lens array is used for completing efficient acquisition of multi-view and multi-focus high-resolution light field data of a target three-dimensional scene, and non-consistent temperature control focus drift information and visual axis offset accumulation out-of-control information between micro-arrays are synchronously captured in real time; a light field reconstruction imbalance risk assessment model is cooperatively constructed based on a non-uniform temperature control focus drift coefficient and a visual axis offset accumulation out-of-control coefficient between microarrays, a light field reconstruction imbalance risk assessment index is output in real time, quantitative assessment and dynamic early warning of the imbalance risk degree in the light field reconstruction process are achieved, and an intelligent decision basis is provided for reconstruction regulation and control.

Description

Technical Field

[0001] The present invention relates to the technical field of light field control, and more particularly to a high-resolution standardized micro-array compound eye lens module and a light field control system. Background Art

[0002] With the deep integration of micro-nano optics and artificial intelligence perception technologies, micro-array compound eye lens modules, due to their ultra-miniaturization, high frame rate, wide viewing angle, and multi-focal sensing capabilities, have become a core component in the next generation of high-resolution vision systems (such as augmented reality displays, intelligent sensing terminals, robotic visual navigation, and unmanned system light field perception). To achieve high-quality reconstruction of complex three-dimensional scenes, such systems typically integrate high-density standardized microlens arrays and use collaborative light field control modules to achieve dynamic depth of focus adjustment, wavefront reconstruction, and multi-channel image stitching.

[0003] However, in high-resolution operating environments, such systems face the coupled challenges of multiple internal nonlinear mismatches, particularly focus drift under non-uniform temperature control and the cumulative loss of control over inter-microarray line-of-sight offsets. Localized thermal field inhomogeneities can easily lead to inconsistent thermal expansion of the lens material, resulting in slight variations in the microlens focal length and slight deviations in the optical axis. These line-of-sight offsets can accumulate in multi-array stitching. This results in optical axis inconsistencies at the image edges, further triggering phenomena such as multi-focal layer reconstruction failure, sub-array image stitching seams, and spatial alignment imbalance, severely impairing the stability and accuracy of light field reconstruction. Further complicating matters, a typical thermal-structural-optical feedback-enhanced coupling mechanism exists between these two defects: temperature control drift induces focus shift, further line-of-sight misalignment, imaging stitching errors, increased heat dissipation differences between the image center and edges, and further temperature control deviations, forming a closed-loop imbalance chain. This can lead to system failure symptoms such as degraded dynamic stability, image jumps, and depth-field distortion after long-term operation. Therefore, how to construct a light field control method and microarray structure optimization mechanism with high stability, high thermal balance and strong coupling error tolerance has become a key scientific issue and engineering difficulty in the reliability design of current high-resolution microarray compound eye lens systems. Summary of the Invention

[0004] In order to overcome the above-mentioned defects of the prior art, embodiments of the present invention provide a high-resolution standardized micro-array compound eye lens module and a light field control system to solve the problems raised in the above-mentioned background technology.

[0005] To achieve the above object, the present invention provides the following technical solutions: High-resolution standardized micro-array compound eye lens module and light field control system, including micro-lens array standardization module, data acquisition module, light field reconstruction imbalance risk assessment module, and reconstruction control module; Microlens array standardization module, used to build a standardized microlens array design library, define microlens unit parameters, and perform optical axis micro-angle deviation calibration on lens modules; The data acquisition module uses a standardized microlens array to complete multi-view, multi-focus, high-resolution light field data acquisition in the target three-dimensional scene; it also acquires real-time synchronous information on non-uniform temperature-controlled focus drift and the cumulative loss of control of the visual axis offset between microarrays; The light field reconstruction imbalance risk assessment module builds a light field reconstruction imbalance risk assessment model based on the information of non-uniform temperature-controlled focus drift and the cumulative loss of control of the visual axis offset between microarrays. It outputs a light field reconstruction imbalance risk assessment index to evaluate the imbalance risk level of the current light field reconstruction. The reconstruction control module activates the focal length control and cone registration optimization mechanism if the imbalance risk level of the current light field reconstruction is at a high imbalance risk level, and at the same time constrains the image phase continuity to reconstruct and output a high-resolution light field image after control.

[0006] In a preferred embodiment, the non-uniform temperature-controlled focus drift information includes a non-uniform temperature-controlled focus drift coefficient, and the inter-microarray visual axis offset cumulative out-of-control information includes an inter-microarray visual axis offset cumulative out-of-control coefficient.

[0007] In a preferred embodiment, the acquisition logic of the non-uniform temperature-controlled focus drift coefficient is as follows: Real-time acquisition of the position temperature of each lens unit in the microlens array; calculation of the local temperature gradient based on the position temperature of each lens unit; calculation of the thermally induced radial deformation rate of each lens unit under temperature control based on the local temperature gradient ; Compare the thermally induced radial deformation rate with a preset thermally induced radial deformation rate threshold. If the thermally induced radial deformation rate is greater than the thermally induced radial deformation rate threshold, obtain the small optical axis deviation angle caused by the local deformation according to the local temperature gradient; The focal length change of each microlens is obtained by performing disturbance analysis based on the thermally induced radial deformation rate. ; The non-uniformity deviation is obtained by weighted aggregation of the focal length change of each microlens and the small optical axis deviation angle ; Perform focus drift analysis on all lens units based on non-uniform deviation to calculate non-uniform temperature-controlled focus drift coefficients : ,in is the mean of the non-uniformity deviations, , n is the number of lens units.

[0008] In a preferred embodiment, the logic for obtaining the cumulative out-of-control coefficient of the visual axis offset between microarrays is as follows: Treat each microlens array submodule as a graph node , the relationship between adjacent arrays is represented by the edge of the graph , construct a microarray graph, where each edge is attached with the current frame optical axis offset angle and node space topological distance to obtain the optical axis coupling offset propagation factor between different nodes ; The propagation matrix is ​​constructed based on the microlens array diagram and combined with the optical axis coupling offset propagation factor. ; Raise the propagation matrix to the power of p to calculate the indirect cumulative propagation impact of the offset; The response weight of the microlens array submodule node is introduced by combining the local temperature gradient mean and image stitching error response. ; Calculate the total amount of overall deviation out-of-control response based on the response weight : ,in To propagate the elements in the matrix after raising them to the power of p; The cumulative out-of-control coefficient of the visual axis deviation between microarrays is calculated based on the total amount of overall out-of-control deviation responses: ,in is the total number of microlens array sub-module nodes.

[0009] In a preferred embodiment, a light field reconstruction imbalance risk assessment model is constructed based on the non-uniform temperature control focus drift information and the cumulative out-of-control information of the visual axis offset between microarrays, and a light field reconstruction imbalance risk assessment index is output. The light field reconstruction imbalance risk assessment model is based on the following formula: , where Reconstructing the imbalance risk assessment index for the light field, is the non-uniform temperature-controlled focus drift coefficient, is the cumulative out-of-control coefficient of the visual axis offset between microarrays, They represent the preset proportional coefficients of the non-uniform temperature-controlled focus drift coefficient and the cumulative out-of-control coefficient of the visual axis offset between microarrays, respectively, and Both are greater than 0.

[0010] In a preferred embodiment, the light field reconstruction imbalance risk assessment index is compared with a preset light field reconstruction imbalance risk assessment index threshold to identify the imbalance risk level of the current light field reconstruction, as follows: If the light field reconstruction imbalance risk assessment index is greater than the light field reconstruction imbalance risk assessment index threshold, the imbalance risk level of the current light field reconstruction is marked as a high imbalance risk level; If the light field reconstruction imbalance risk assessment index is less than or equal to the light field reconstruction imbalance risk assessment index threshold, the imbalance risk level of the current light field reconstruction is marked as a low imbalance risk level.

[0011] In a preferred embodiment, based on the currently detected focus shift trend, the focus of the lens unit is fine-tuned to achieve focal plane realignment, and a control compensation amount is defined; a micro-electronically controlled focal length modulator is activated to perform the control compensation; Calculate the registration correction angle based on the cumulative out-of-control coefficient of the visual axis offset between microarrays; call the micro optical axis adjustment component to fine-tune the optical axis direction of the microlens array in real time; After focal length adjustment and view cone alignment, a phase continuity loss function is constructed. The phase of boundary pixels is iteratively adjusted using a gradient descent algorithm to optimize the phase consistency of the light field image data, eliminate phase jumps at the stitching boundaries, complete constrained reconstruction of the image phase continuity, and finally output the adjusted high-resolution light field image.

[0012] Technical effects and advantages of the present invention: 1. The present invention uses a microlens array standardization module to achieve high-precision standardized definition and optical axis micro-angle deviation calibration of key parameters such as size, focal length, aperture, edge cone angle, and arrangement matrix of microlens units. By utilizing a standardized microlens array, efficient acquisition of multi-view, multi-focus, high-resolution light field data of the target three-dimensional scene is achieved, and real-time synchronous capture of non-uniform temperature-controlled focus drift information and cumulative out-of-control information of visual axis offset between microarrays is achieved to support subsequent refined regulation. Based on the non-uniform temperature-controlled focus drift coefficient and the cumulative out-of-control coefficient of visual axis offset between microarrays, a light field reconstruction imbalance risk assessment model is collaboratively constructed, and a light field reconstruction imbalance risk assessment index is output in real time to achieve quantitative assessment and dynamic early warning of the imbalance risk degree of the light field reconstruction process. , providing an intelligent decision-making basis for reconstruction control. When the system determines that the imbalance risk level of the current light field reconstruction reaches a high imbalance risk state, the reconstruction control module can immediately trigger the focal length control and cone alignment optimization mechanism, and introduce image phase continuity constraints in the reconstruction process, effectively suppressing stitching errors, phase discontinuities, and image faults caused by the coupling of temperature control drift and optical axis offset, and outputting high-quality, high-consistency, and high-precision light field reconstructed images. It effectively suppresses the focal length micro-change, optical axis deflection and its cumulative out-of-control effects caused by inconsistent temperature control and structural stress, and improves the thermal stability and long-term operation stability of light field reconstruction; improves the sub-array stitching consistency and optical axis alignment accuracy, and reduces the risk of distortion such as image edge faults and depth distortion. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] In order to facilitate understanding by those skilled in the art, the present invention will be further described below with reference to the accompanying drawings; Figure 1 Flowchart of the system according to an embodiment of the present invention. DETAILED DESCRIPTION

[0014] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of the present invention.

[0015] Embodiment: The present invention provides Figure 1 The high-resolution standardized micro-array compound eye lens module and light field control system shown include a micro-lens array standardization module, a data acquisition module, a light field reconstruction imbalance risk assessment module, and a reconstruction control module; Microlens array standardization module, used to build a standardized microlens array design library, define microlens unit parameters, and perform optical axis micro-angle deviation calibration on lens modules; The data acquisition module uses a standardized microlens array to complete multi-view, multi-focus, high-resolution light field data acquisition in the target three-dimensional scene; it also acquires real-time synchronous information on non-uniform temperature-controlled focus drift and the cumulative loss of control of the visual axis offset between microarrays; The light field reconstruction imbalance risk assessment module builds a light field reconstruction imbalance risk assessment model based on the information of non-uniform temperature-controlled focus drift and the cumulative loss of control of the visual axis offset between microarrays. It outputs a light field reconstruction imbalance risk assessment index to evaluate the imbalance risk level of the current light field reconstruction. The reconstruction control module activates the focal length control and cone registration optimization mechanism if the imbalance risk level of the current light field reconstruction is high, and at the same time constrains the image phase continuity to reconstruct and output a high-resolution light field image after control; The microlens array standardization module is used to build a standardized microlens array design library, define microlens unit parameters (such as aperture D, focal length F, edge cone angle α, arrangement matrix P, etc.), and perform optical axis micro-angle deviation calibration on the lens module. The details are as follows: Under the condition of no thermal disturbance, obtain the reference output optical axis direction of each microlens unit, use the collimated laser array to illuminate the incident light, and record the position of each output light spot. , according to the deviation from the center point Calculate the current optical axis angle offset : ,in is the distance between the microlens and the imaging surface; all small optical axis angle offsets are reconstructed into the array offset field: ; For each microarray lens module, define a unique calibration matrix: ,in The azimuth angle represents the directional deviation. The calibration matrix is ​​written into the structure description file. The calibration file supports embedded EEPROM / Flash storage. The control end automatically reads the calibration matrix in the light field reconstruction algorithm and performs sub-pixel level alignment pre-compensation for each cone angle. A data acquisition module utilizes a standardized microlens array to complete multi-view, multi-focus, high-resolution light field data acquisition in a target three-dimensional scene; and synchronously acquires non-uniform temperature-controlled focus drift information and inter-microarray visual axis offset cumulative loss of control information in real time, wherein the non-uniform temperature-controlled focus drift information includes a non-uniform temperature-controlled focus drift coefficient, and the inter-microarray visual axis offset cumulative loss of control information includes an inter-microarray visual axis offset cumulative loss of control coefficient. The non-uniform temperature-controlled focus drift coefficient, as used in the present invention, is a key indicator for quantifying the overall degree of micro-focus drift caused by localized temperature non-uniformity in a high-resolution standardized micro-array compound-eye lens module operating under high-resolution conditions. This coefficient, measured by the relative average deviation of focal length variations between each microlens unit within the microlens array under operating and reference temperature conditions, comprehensively reflects the integration level of focus position variations caused by inconsistent temperature control within the micro-array compound-eye system. A larger value for the non-uniform temperature-controlled focus drift coefficient indicates a greater degree of non-uniformity in focus drift among the microlenses within the micro-array compound-eye lens module. This indicates a more severe focal length variation and optical performance mismatch caused by localized temperature control, leading to poorer system imaging consistency and light field reconstruction stability. In this case, when spatially stitching and depth field reconstruction are performed on the sub-images output by multiple microlenses, inconsistent focus positions can easily lead to problems such as increased image stitching gaps, inconsistent optical axis directions between sub-images, and accumulated depth information reconstruction errors, significantly reducing the overall uniformity and accuracy of light field reconstruction. On the contrary, the smaller the value of the non-uniform temperature-controlled focus drift coefficient, the more consistent the focus drift of each microlens of the microarray compound eye lens module under different local temperature control conditions, the weaker the impact of the overall thermal field on the optical performance, and the better the coordination of the focus positions of the sub-images output by each microlens, which helps to achieve higher-precision fusion and reconstruction of light field data in the stitching and deep reconstruction stages. The assessment of the risk level of current light field reconstruction imbalance based on the non-uniform temperature-controlled focus drift coefficient has significant beneficial effects in the present invention. First, this coefficient serves as a direct quantitative indicator of the impact of thermal field-driven focus drift on light field reconstruction, enabling the system to perceive in real time whether there is a high-risk imbalance trend caused by local temperature control mismatch in the current light field reconstruction process. This mechanism can effectively replace the traditional method of passively detecting imbalance based on light field reconstruction results, and realize pre-perception and early warning of light field reconstruction imbalance risks, thereby providing sufficient reaction time and adjustment space for subsequent reconstruction control. Secondly, this coefficient, combined with the cumulative uncontrolled coefficient of inter-microarray visual axis drift in the evaluation model, effectively captures the chain reaction pattern of light field imbalance caused by thermal-structural-optical coupling, for example: temperature control imbalance → focus drift → visual axis misalignment → splicing mismatch → further uneven heat dissipation distribution → increased imbalance risk. By integrating the imbalance risk index output of the non-uniform temperature-controlled focus drift coefficient, this invention enables dynamic monitoring and real-time control of the entire light field reconstruction process, significantly enhancing the stability and robustness of the light field control system in complex environments.

[0016] The logic for obtaining the non-uniform temperature-controlled focus drift coefficient is as follows: Real-time acquisition of the position temperature of each lens unit in the microlens array: ,in is the position temperature of the i-th lens unit, n is the number of lens units; the local temperature gradient is calculated based on the position temperature of each lens unit : ,in is the position coordinate of the lens unit; the thermally induced radial deformation rate of each lens unit under temperature control is calculated according to the local temperature gradient : ,in is the linear thermal expansion coefficient of the material, is the reference temperature of the lens unit, is the stress amplification factor caused by the local temperature gradient; the thermally induced radial deformation rate is compared with the preset thermally induced radial deformation rate threshold. If the thermally induced radial deformation rate is greater than the thermally induced radial deformation rate threshold, the small optical axis deviation angle caused by the local deformation is obtained according to the local temperature gradient. : ,in is the optical axis deviation sensitivity coefficient; It should be noted that the linear thermal expansion coefficient (CTE) refers to the expansion rate per unit length of the microlens material per unit temperature change. It is typically expressed in μm / (m / cdotp°C) or 1 / °C and reflects the material's sensitivity to thermal expansion. This coefficient can be obtained from factory inspection reports, standard material performance databases, or thermomechanical analysis (TMA) tests on samples. The stress magnification factor (SMF) refers to the proportionality of the local stress relative to the stress under ideal uniform heating conditions under local temperature gradients, due to factors such as the microlens geometry, boundary constraints, and material anisotropy. This factor is used to correct the thermal expansion model's ability to respond to local non-uniform heating effects. The SMF can be obtained through high-precision finite element thermal-structural coupling simulation analysis, optical interferometry, or digital speckle strain analysis experiments. The optical axis deviation sensitivity coefficient (ODS) refers to the proportionality of the response of the microlens unit's optical axis to small changes in the optical axis deviation angle caused by local temperature gradient perturbations. Its physical meaning is the incremental change in the deviation angle (usually measured in microradians or radians) of the microlens optical axis under the action of unit temperature gradient intensity. It reflects the sensitivity of the lens structure and material to the stability of the optical axis in a non-uniform temperature control environment. It can be obtained by performing thermal-structural-optical multi-field coupling simulation based on micro-nano optical finite element modeling, statistically analyzing the trend of the optical axis micro-deviation under different temperature gradient conditions, and fitting to obtain the sensitivity coefficient. It will not be elaborated here. The focal length change of each microlens is obtained by performing disturbance analysis based on the thermally induced radial deformation rate. : ,in is the initial microlens focal length; The non-uniformity deviation is obtained by weighted aggregation of the focal length change of each microlens and the small optical axis deviation angle : ,in 、 represent the preset proportional coefficients of the microlens focal length change and the small optical axis deviation angle, respectively, and 、 All greater than 0; It should be noted that 、 Set it according to the actual situation. For example, adopt the expert empowerment method, that is, invite experts in related fields to determine the preset proportion coefficients of various indicators through professional opinion surveys and comprehensive evaluations, for example, 、 It can be 0.5, 0.5; Perform focus drift analysis on all lens units based on non-uniform deviation to calculate non-uniform temperature-controlled focus drift coefficients : ,in is the mean of the non-uniformity deviations, ; It should be noted that the above formulas are all dimensionless and numerical calculations. Common dimensionless methods include Min-Max normalization and Z-Score normalization, which will not be described here. The cumulative out-of-control coefficient of visual axis offset between microarrays in the present invention is a characterizing parameter used to measure the degree of cumulative superposition out-of-control due to slight optical axis offset between microlens arrays in the multi-stage splicing process of the high-resolution microarray compound eye lens module under long-term operation or complex temperature control and mechanical disturbance conditions. This coefficient reflects the ability of the microarray compound eye system to maintain optical axis consistency between arrays during multi-view light field reconstruction, and is an important indicator for evaluating light field splicing accuracy, spatial alignment stability and overall image continuity. A larger cumulative out-of-control coefficient of visual axis offset between microarrays indicates that the optical axis offset between microarray submodules has had a significant cumulative effect in spatial splicing, resulting in obvious optical axis misalignment, sub-field of view seam staggering or image distortion in adjacent splicing intervals, further causing problems such as failure of multi-focal layer reconstruction and distortion of image depth field, seriously threatening the stability, spatial consistency and real-time performance of light field reconstruction. The smaller cumulative runaway coefficient of inter-microarray optical axis offset indicates that the optical axes of each microarray submodule remain highly consistent during the multi-dimensional stitching process. This accumulated offset can be effectively eliminated or corrected by the system's control algorithm, thereby ensuring high precision, stability, and continuity in the light field stitching. Assessing the imbalance risk of the current light field reconstruction based on the cumulative runaway coefficient of inter-microarray optical axis offset significantly enhances the intelligent monitoring and adaptive control capabilities of the light field reconstruction process, achieving technological breakthroughs in real-time self-perception, self-correction, and dynamic image stabilization.

[0017] The logic for obtaining the cumulative out-of-control coefficient of the visual axis offset between microarrays is as follows: Treat each microlens array submodule as a graph node , the relationship between adjacent arrays is represented by the edge of the graph , construct microarray maps , where each edge is attached with the current frame optical axis offset angle and node space topological distance to obtain the optical axis coupling offset propagation factor between different nodes : ,in is the optical axis offset angle of the current frame, is the node space topological distance; The calculation formula of the current frame optical axis offset angle is as follows: ,in is the initial calibration optical axis direction of the microlens array submodule node j, is the initial calibration optical axis direction of the microlens array submodule node k; The calculation formula of the node space topological distance is as follows: ,in is the array center position coordinate vector of the microlens array submodule node j, is the array center position coordinate vector of the microlens array submodule node k, is the maximum distance between nodes; The propagation matrix is ​​constructed based on the microlens array diagram and combined with the optical axis coupling offset propagation factor. , where the propagation matrix Each element of is represented as follows: ; Raise the propagation matrix to the power of p to calculate the indirect cumulative propagation effect of the offset: ; The response weight of the microlens array submodule node is introduced by combining the local temperature gradient mean and image stitching error response. : ,in is the local mean temperature gradient, is the image stitching error response; The calculation formula of the local temperature gradient mean is as follows: ,in is the local temperature gradient; The calculation formula of the image stitching error response is as follows: ,in is the change in the focal length of the microlens, is the set of sub-arrays adjacent to the microlens array sub-module node j, is the time series cumulative weight factor, ( is the time index); Calculate the total amount of overall deviation out-of-control response based on the response weight : ,in To propagate the elements in the matrix after raising them to the power of p; Calculate the cumulative out-of-control coefficient of the visual axis deviation between microarrays based on the total amount of overall out-of-control deviation responses : ,in is the total number of microlens array submodule nodes, is a minimum constant to prevent division by zero (usually ); It should be noted that the above formulas are all dimensionless and numerical calculations. Common dimensionless methods include Min-Max normalization and Z-Score normalization, which will not be described here. The light field reconstruction imbalance risk assessment module builds a light field reconstruction imbalance risk assessment model based on the information of non-uniform temperature-controlled focus drift and the cumulative loss of control of the visual axis offset between microarrays. It outputs a light field reconstruction imbalance risk assessment index to evaluate the imbalance risk level of the current light field reconstruction. A light field reconstruction imbalance risk assessment model is constructed based on the non-uniform temperature-controlled focus drift information and the cumulative out-of-control information of the visual axis offset between microarrays, and a light field reconstruction imbalance risk assessment index is output. The light field reconstruction imbalance risk assessment model is based on the following formula: , where Reconstructing the imbalance risk assessment index for the light field, is the non-uniform temperature-controlled focus drift coefficient, is the cumulative out-of-control coefficient of the visual axis offset between microarrays, They represent the preset proportional coefficients of the non-uniform temperature-controlled focus drift coefficient and the cumulative out-of-control coefficient of the visual axis offset between microarrays, respectively, and All greater than 0; It should be noted that the above formulas are all dimensionless and numerical calculations. Common dimensionless methods include Min-Max normalization and Z-Score normalization, which will not be described here. Set it according to the actual situation. For example, adopt the expert empowerment method, that is, invite experts in related fields to determine the preset proportion coefficients of various indicators through professional opinion surveys and comprehensive evaluations, for example, It can be 0.5, 0.5; The above calculation expression shows that the larger the non-uniform temperature-controlled focus drift coefficient and the larger the cumulative runaway coefficient of line-of-sight offset between microarrays, the larger the light field reconstruction imbalance risk assessment index, indicating a higher degree of imbalance risk during the light field reconstruction process. This will have a more significant negative impact on the stability of the system's light field imaging, stitching consistency, and 3D reconstruction accuracy. Specifically, as the non-uniform temperature-controlled focus drift coefficient and the cumulative runaway coefficient of line-of-sight offset between microarrays increase, this means that the thermal-optical coupling mismatch effect and optical axis geometric error within the system are gradually amplified in space and time, leading to the destruction of the spatial consistency of multi-view light field data and the appearance of misalignment, overlap, or faults in the stitching area. This ultimately leads to distorted 3D depth maps, blurred target edges, and increased real-time imaging latency. Conversely, the smaller the non-uniform temperature-controlled focus drift coefficient and the smaller the cumulative runaway coefficient of line-of-sight offset between microarrays, the smaller the light field reconstruction imbalance risk assessment index, indicating a lower degree of imbalance risk during the light field reconstruction process. The system can maintain high light field reconstruction stability and imaging consistency under the current operating environment. The smaller the non-uniform temperature-controlled focus drift coefficient, the more uniform the temperature distribution across the microlens array elements at different locations. Thermally induced focal length changes and optical axis micro-deviations are effectively suppressed, and the interference of local thermal fields on optical performance is minimal. The smaller the cumulative uncontrolled coefficient of inter-microarray line-of-sight offset, the smaller the line-of-sight geometric error of each microlens array submodule, the higher the degree of optical axis alignment, and the better the spatial perspective consistency when multiple arrays are spliced, making it less likely to cause problems such as optical axis mismatch or splicing faults. The light field reconstruction imbalance risk assessment index is compared with the preset light field reconstruction imbalance risk assessment index threshold to identify the imbalance risk level of the current light field reconstruction, as follows: If the light field reconstruction imbalance risk assessment index is greater than the light field reconstruction imbalance risk assessment index threshold, it means that the combined impact of the non-uniform temperature-controlled focus drift and the cumulative loss of control of the visual axis offset between microarrays in the current light field reconstruction process has reached or exceeded the safety tolerance range set by the system, indicating that there are major hidden dangers in the stability and consistency of key links such as optical stitching, wavefront reconstruction, and image fusion, which is very likely to cause imaging error amplification, depth map distortion, stitching faults, spatial reconstruction discontinuity and other problems. The current light field reconstruction imbalance risk level is marked as high imbalance risk level; If the light field reconstruction imbalance risk assessment index is less than or equal to the light field reconstruction imbalance risk assessment index threshold, it means that the current system light field reconstruction state is within the controllable range, and the impact of non-uniform temperature control focus drift and the cumulative out-of-control of the visual axis offset between microarrays has not yet caused significant interference to the overall imaging quality and light field consistency. The key performance of the system, such as spatial stitching, depth reconstruction, and image fusion, remains stable, and the imaging effect is good. There is no need to trigger large-scale compensatory control measures, and the current light field reconstruction imbalance risk level is marked as low imbalance risk level; It should be noted that the threshold for the light field reconstruction imbalance risk assessment index can be set based on specific application needs and the system's requirements for imaging stability and accuracy, combined with historical operational statistics and expert experience. For example, in applications requiring high real-time performance and high precision (such as autonomous driving visual perception, high-precision robotic navigation, and augmented reality spatial alignment), the threshold can be set to a relatively low value to enhance the system's sensitivity to early imbalance risks and ensure timely triggering of regulatory mechanisms at the earliest possible stage of imbalance risk. In scenarios where real-time requirements are general but power consumption or computing resource optimization is prioritized (such as static high-resolution three-dimensional modeling and large-scale scene light field recording), the threshold can be appropriately relaxed to avoid overly frequent regulatory interventions and ensure overall efficiency and resource utilization. The threshold can be obtained in the following ways: First, it is based on the experimental calibration method, that is, under laboratory conditions, simulating different temperature control and visual axis offset states, analyzing the corresponding light field reconstruction errors (such as stitching error, depth distortion rate, etc.), and determining the acceptable boundary of the imbalance risk; second, it is based on the expert empowerment and statistical analysis method, integrating the subjective evaluation of experts in the application field with the objective statistics of a large amount of operating data, and using weighted average or interval analysis to determine the reasonable threshold range; third, it is based on the adaptive learning method, continuously accumulating data during the operation of the system, using machine learning methods (such as clustering and discriminant analysis) to classify the imbalance state, and dynamically correcting the threshold to adapt to changes in different environments and task conditions. I will not go into details here; The reconstruction control module activates the focal length control and cone registration optimization mechanism if the imbalance risk level of the current light field reconstruction is high, and at the same time constrains the image phase continuity to reconstruct and output a high-resolution light field image after control; Based on the focus shift trend currently detected, fine-tune the lens unit focal length to realign the focal plane and define the control compensation amount. : ,in To obtain an ideal focal length; start a micro-electric focus modulator (such as a thermoelectric focus or a liquid crystal focus device) to perform control compensation; Calculate the registration correction angle based on the cumulative out-of-control coefficient of the visual axis offset between microarrays: ,in is the cosine vector of the microlens array optical axis direction; call the micro optical axis adjustment component (MEMS or liquid crystal adaptive optical element) to fine-tune the microlens array optical axis direction in real time: ,in is the cosine vector of the optical axis direction after adjustment; After focal length control and cone registration, a phase continuity loss function is constructed. : , is the pixel phase information of the sub-image on the left side of the light field stitching boundary at the coordinate (x, y) (the phase information can be obtained by the light field complex amplitude data through inverse Fourier transform or phase reconstruction algorithm), The pixel phase information of the sub-image on the right side of the light field stitching boundary at the coordinate (x, y) is obtained; the boundary pixel phase is iteratively adjusted using a gradient descent algorithm: ,in is the phase distribution of boundary pixels at the tth iteration, is the updated boundary pixel phase distribution at the t+1th iteration, is the learning rate (step factor), which controls the amplitude of each phase adjustment; Optimize the phase consistency of light field image data, eliminate phase jumps at the splicing boundaries, complete constrained reconstruction of image phase continuity, and ultimately output a regulated high-resolution light field image; The present invention proposes a high-resolution standardized micro-array compound eye lens module and light field control system. Through modular design and a highly integrated light field control mechanism, the light field reconstruction stability, thermal balance and coupling error tolerance of the micro-array compound eye vision system in complex three-dimensional scenes are significantly improved, fully meeting the practical application requirements of high-resolution vision systems such as augmented reality display, intelligent perception terminals, robot visual navigation, and unmanned system light field perception. The system uses a microlens array standardization module to achieve high-precision standardized definition and optical axis micro-angle deviation calibration of key parameters such as size, focal length, aperture, edge cone angle, and arrangement matrix of the microlens unit, effectively reducing the initial optical axis inconsistency introduced by process errors in the manufacturing process, and providing a basic guarantee for structural symmetry and optical homogeneity for subsequent light field data acquisition and reconstruction. At the same time, through the data acquisition module, the standardized microlens array is used to complete the efficient acquisition of multi-perspective, multi-focus high-resolution light field data of the target three-dimensional scene, and to capture the non-uniform temperature-controlled focus drift information and the cumulative out-of-control information of the visual axis offset between microarrays in real time to support subsequent fine-grained regulation. Based on the non-uniform temperature-controlled focus drift coefficient and the cumulative out-of-control coefficient of the visual axis offset between microarrays, a light field reconstruction imbalance risk assessment model is collaboratively constructed, and the light field reconstruction imbalance is output in real time. The risk assessment index realizes the quantitative assessment and dynamic early warning of the imbalance risk degree of the light field reconstruction process, and provides an intelligent decision-making basis for reconstruction control. When the system determines that the imbalance risk degree of the current light field reconstruction reaches a high imbalance risk state, the reconstruction control module can immediately trigger the focal length control and cone alignment optimization mechanism, and introduce image phase continuity constraints in the reconstruction process, effectively suppressing the stitching error, phase discontinuity and image fault caused by the coupling of temperature control drift and optical axis offset, and outputting high-quality, high-consistency and high-precision light field reconstructed images, effectively suppressing the focal length micro-change, optical axis deflection and its cumulative out-of-control effects caused by inconsistent temperature control and structural stress, and improving the thermal stability and long-term operation stability of light field reconstruction; improving the sub-array stitching consistency and optical axis alignment accuracy, and reducing the distortion risks such as image edge fault and depth distortion.

[0018] The above formulas are all dimensionless and numerical calculations. The formulas are obtained by collecting a large amount of data and performing software simulation to obtain the most recent real situation. The preset parameters in the formulas are set by technicians in this field according to actual conditions.

[0019] The above embodiments can be implemented in whole or in part by software, hardware, firmware or any other combination. When implemented using software, the above embodiments can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions or computer programs. When the computer instructions or computer program are loaded or executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one website, computer, server or data center to another website, computer, server or data center via wired or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or data center that contains one or more available media sets. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium. The semiconductor medium can be a solid-state drive.

[0020] It should be understood that in the various embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0021] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0022] The above description is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. High-resolution standardized micro-array compound eye lens module and light field control system, characterized by: It includes microlens array standardization module, data acquisition module, light field reconstruction imbalance risk assessment module, and reconstruction control module; Microlens array standardization module, used to build a standardized microlens array design library, define microlens unit parameters, and perform optical axis micro-angle deviation calibration on lens modules; The data acquisition module uses a standardized microlens array to complete multi-view, multi-focus, high-resolution light field data acquisition in the target three-dimensional scene; it also acquires real-time synchronous information on non-uniform temperature-controlled focus drift and the cumulative loss of control of the visual axis offset between microarrays; The light field reconstruction imbalance risk assessment module builds a light field reconstruction imbalance risk assessment model based on the information of non-uniform temperature-controlled focus drift and the cumulative loss of control of the visual axis offset between microarrays. It outputs a light field reconstruction imbalance risk assessment index to evaluate the imbalance risk level of the current light field reconstruction. The reconstruction control module activates the focal length control and cone registration optimization mechanism if the imbalance risk level of the current light field reconstruction is at a high imbalance risk level, and at the same time constrains the image phase continuity to reconstruct and output a high-resolution light field image after control.

2. The high-resolution standardized micro-array compound eye lens module and light field control system according to claim 1, characterized in that: The non-uniform temperature-controlled focus drift information includes a non-uniform temperature-controlled focus drift coefficient, and the inter-microarray visual axis offset cumulative out-of-control information includes an inter-microarray visual axis offset cumulative out-of-control coefficient.

3. The high-resolution standardized micro-array compound eye lens module and light field control system according to claim 2, characterized in that: The logic for obtaining the non-uniform temperature-controlled focus drift coefficient is as follows: Real-time acquisition of the position temperature of each lens unit in the microlens array; calculation of the local temperature gradient based on the position temperature of each lens unit; calculation of the thermally induced radial deformation rate of each lens unit under temperature control based on the local temperature gradient ; Compare the thermally induced radial deformation rate with a preset thermally induced radial deformation rate threshold. If the thermally induced radial deformation rate is greater than the thermally induced radial deformation rate threshold, obtain the small optical axis deviation angle caused by the local deformation according to the local temperature gradient; The focal length change of each microlens is obtained by performing disturbance analysis based on the thermally induced radial deformation rate. ; The non-uniformity deviation is obtained by weighted aggregation of the focal length change of each microlens and the small optical axis deviation angle ; Perform focus drift analysis on all lens units based on non-uniform deviation to calculate non-uniform temperature-controlled focus drift coefficients : ,in is the mean of the non-uniformity deviations, , n is the number of lens units.

4. The high-resolution standardized micro-array compound eye lens module and light field control system according to claim 2, characterized in that: The logic for obtaining the cumulative out-of-control coefficient of the visual axis offset between microarrays is as follows: Treat each microlens array submodule as a graph node , the relationship between adjacent arrays is represented by the edge of the graph , construct a microarray graph, where each edge is attached with the current frame optical axis offset angle and node space topological distance to obtain the optical axis coupling offset propagation factor between different nodes ; The propagation matrix is ​​constructed based on the microlens array diagram and combined with the optical axis coupling offset propagation factor. ; Raise the propagation matrix to the power of p to calculate the indirect cumulative propagation impact of the offset; The response weight of the microlens array submodule node is introduced by combining the local temperature gradient mean and image stitching error response. ; Calculate the total amount of overall deviation out-of-control response based on the response weight : ,in To propagate the elements in the matrix after raising them to the power of p; Calculate the cumulative out-of-control coefficient of the visual axis deviation between microarrays based on the total amount of overall out-of-control deviation responses : ,in is the total number of microlens array sub-module nodes.

5. The high-resolution standardized micro-array compound eye lens module and light field control system according to claim 2, characterized in that: A light field reconstruction imbalance risk assessment model is constructed based on the non-uniform temperature-controlled focus drift information and the cumulative out-of-control information of the visual axis offset between microarrays, and a light field reconstruction imbalance risk assessment index is output. The light field reconstruction imbalance risk assessment model is based on the following formula: , where Reconstructing the imbalance risk assessment index for the light field, is the non-uniform temperature-controlled focus drift coefficient, is the cumulative out-of-control coefficient of the visual axis offset between microarrays, They represent the preset proportional coefficients of the non-uniform temperature-controlled focus drift coefficient and the cumulative out-of-control coefficient of the visual axis offset between microarrays, respectively, and Both are greater than 0.

6. The high-resolution standardized micro-array compound eye lens module and light field control system according to claim 5, characterized in that: The light field reconstruction imbalance risk assessment index is compared with the preset light field reconstruction imbalance risk assessment index threshold to identify the imbalance risk level of the current light field reconstruction, as follows: If the light field reconstruction imbalance risk assessment index is greater than the light field reconstruction imbalance risk assessment index threshold, the imbalance risk level of the current light field reconstruction is marked as a high imbalance risk level; If the light field reconstruction imbalance risk assessment index is less than or equal to the light field reconstruction imbalance risk assessment index threshold, the imbalance risk level of the current light field reconstruction is marked as a low imbalance risk level.

7. The high-resolution standardized micro-array compound eye lens module and light field control system according to claim 6, characterized in that: Based on the currently detected focus shift trend, fine-tune the lens unit focal length to realign the focal plane and define the control compensation amount; Start the micro-electronically controlled focal length modulator to perform control compensation; The registration correction angle is calculated based on the cumulative out-of-control coefficient of the visual axis offset between microarrays; Calling the micro optical axis adjustment component to fine-tune the optical axis direction of the micro lens array in real time; After focal length adjustment and view cone alignment, a phase continuity loss function is constructed. The phase of boundary pixels is iteratively adjusted using a gradient descent algorithm to optimize the phase consistency of the light field image data, eliminate phase jumps at the stitching boundaries, complete constrained reconstruction of the image phase continuity, and finally output the adjusted high-resolution light field image.

Images