High-resolution standardized microarray compound eye lens module and light field regulation system

Abstract

The application discloses a high-resolution standardized microarray compound eye lens module and a light field regulation system, and particularly relates to the technical field of light field regulation, and realizes high-precision standardized definition of key parameters of a microlens unit and calibration of a micro-angle deviation of an optical axis through a microlens array standardized module, efficiently acquires multi-view, multi-focus high-resolution light field data of a target three-dimensional scene by using the standardized microlens array, and synchronously captures non-uniform temperature control focal point drift information and microarray inter-visual axis offset accumulation loss of control information in real time, cooperatively constructs a light field reconstruction imbalance risk evaluation model based on non-uniform temperature control focal point drift coefficients and microarray inter-visual axis offset accumulation loss of control coefficients, and outputs a light field reconstruction imbalance risk evaluation index in real time, so that quantitative evaluation and dynamic early warning of the imbalance risk degree of the light field reconstruction process are realized, and an intelligent decision basis is provided for reconstruction regulation.

Description

Technical Field

[0001] This invention relates to the field of light field modulation technology, and more specifically, to a high-resolution standardized microarray compound eyeglass lens module and a light field modulation system. Background Technology

[0002] With the deep integration of micro-nano optics and artificial intelligence sensing technologies, microarray compound lens modules, due to their ultra-miniaturization, high frame rate, wide field of view, and multifocal sensing capabilities, have become core components in next-generation high-resolution vision systems (such as augmented reality displays, intelligent sensing terminals, robot visual navigation, and light field sensing for unmanned systems). To achieve high-quality reconstruction of complex 3D scenes, these systems typically integrate high-density standardized microlens arrays and use a collaborative light field modulation module to achieve dynamic depth-of-focus adjustment, wavefront reconstruction, and multi-channel image stitching.

[0003] However, in high-resolution operating environments, such systems face the challenge of multiple coupled internal nonlinear mismatch problems, among which "focus drift under inconsistent temperature control" and "cumulative uncontrolled visual axis misalignment between microarrays" are the most pressing. Local thermal inhomogeneity easily leads to inconsistent thermal expansion of lens materials, resulting in slight changes in the focal length of microlenses and slight deviations in their optical axes. This visual axis misalignment has a cumulative effect in multi-array stitching. The result is optical axis inconsistency in the image edge region, further triggering phenomena such as "multi-focal layer reconstruction failure," "subarray image stitching seam discontinuity," and "spatial alignment imbalance," severely weakening the stability and accuracy of light field reconstruction. More complexly, there is a typical thermal-structural-optical feedback-enhanced coupling mechanism between the two defects: temperature control drift causes focus shift → further visual axis misalignment → imaging stitching error → increased difference in heat dissipation distribution between the image center and edges → triggering new temperature control deviations, forming a closed-loop imbalance chain. This leads to failure symptoms such as deteriorated dynamic stability, image skipping, and depth field distortion after long-term system operation. Therefore, how to construct a light field modulation method and microarray structure optimization mechanism with high stability, high thermal uniformity and strong coupling error tolerance has become a key scientific problem and engineering challenge in the reliability design of current high-resolution microarray complex lens systems. Summary of the Invention

[0004] To overcome the aforementioned deficiencies of the prior art, embodiments of the present invention provide a high-resolution standardized microarray compound eyepiece lens module and an optical field modulation system to solve the problems mentioned in the background art.

[0005] To achieve the above objectives, the present invention provides the following technical solution:

[0006] The high-resolution standardized microarray compound eyepiece lens module and light field control system include a microlens array standardization module, a data acquisition module, a light field reconstruction imbalance risk assessment module, and a reconstruction control module;

[0007] The microlens array standardization module is used to build a standardized microlens array design library, define microlens unit parameters, and perform optical axis micro-angle deviation calibration on the lens module.

[0008] The data acquisition module utilizes a standardized microlens array to acquire high-resolution light field data from multiple perspectives and focal points in the target 3D scene; it also acquires non-uniform temperature-controlled focal drift information and cumulative runaway information of line-of-sight offset between microarrays in real time.

[0009] The light field reconstruction imbalance risk assessment module constructs a light field reconstruction imbalance risk assessment model based on non-uniform temperature control focus drift information and cumulative uncontrolled information of line-of-sight offset between microarrays, and outputs a light field reconstruction imbalance risk assessment index to assess the degree of imbalance risk in the current light field reconstruction.

[0010] The reconstruction and control module activates the focal length control and frustum registration optimization mechanism when the current light field reconstruction imbalance risk level is high. At the same time, it constrains the image phase continuity and reconstructs and outputs a high-resolution light field image after control.

[0011] In a preferred embodiment, the non-uniform temperature control focus drift information includes a non-uniform temperature control focus drift coefficient, and the inter-microarray line-of-sight offset cumulative runaway information includes an inter-microarray line-of-sight offset cumulative runaway coefficient.

[0012] In a preferred embodiment, the logic for obtaining the non-uniform temperature control focus drift coefficient is as follows:

[0013] Real-time acquisition of the position temperature of each lens unit in the microlens array; calculation of the local temperature gradient based on the position temperature of each lens unit; and calculation of the thermally induced radial deformation rate of each lens unit under temperature control based on the local temperature gradient. The thermally induced radial deformation rate is compared with a preset thermally induced radial deformation rate threshold. If the thermally induced radial deformation rate is greater than the thermally induced radial deformation rate threshold, the small optical axis deviation angle caused by local deformation is obtained based on the local temperature gradient.

[0014] The focal length change of each microlens is obtained by perturbation analysis based on the thermally induced radial deformation rate. ;

[0015] The non-consistency deviation is obtained by weighted aggregation of the focal length change and minute optical axis deviation of each microlens. ;

[0016] Based on the non-uniformity deviation, a micro-focus drift analysis was performed on all lens units to calculate the non-uniform temperature-controlled focus drift coefficient. : ,in This represents the mean of the inconsistency deviation. , where n is the number of lens units.

[0017] In a preferred embodiment, the logic for obtaining the cumulative runaway coefficient of the line-of-sight offset between microarrays is as follows:

[0018] Each microlens array sub-module is considered as a graph node. The adjacent array relationships are represented by graph edges. A microarray graph is constructed, in which the optical axis offset angle of the current frame and the spatial topological distance between nodes are appended to each edge to obtain the optical axis coupling offset propagation factor between different nodes. ;

[0019] Based on the microlens array diagram and combined with the optical axis coupling offset propagation factor, a propagation matrix is ​​constructed. ;

[0020] The indirect cumulative propagation effect of the offset is calculated by raising the propagation matrix to the power of p.

[0021] The response weights of the microlens array sub-module nodes are introduced by combining the mean of the local temperature gradient and the response of the image stitching error. ;

[0022] Calculate the total offset runaway response based on the response weights. : ,in The elements in the propagation matrix after exponentiation to the power of p;

[0023] Calculate the cumulative runaway coefficient of line-of-sight offset between microarrays based on the total total runaway response of the overall offset: ,in This represents the total number of nodes in the microlens array sub-module.

[0024] In a preferred embodiment, an optical field reconstruction imbalance risk assessment model is constructed based on non-uniform temperature-controlled focus drift information and cumulative runaway information of line-of-sight offset between microarrays, and an optical field reconstruction imbalance risk assessment index is output. The formula based on the optical field reconstruction imbalance risk assessment model is as follows: In the formula As an index for assessing the risk of imbalance in light field reconstruction, The non-uniform temperature control focus drift coefficient, This represents the cumulative runaway coefficient of the line-of-sight offset between microarrays. These represent the preset proportional coefficients for the non-uniform temperature control focus drift coefficient and the cumulative runaway coefficient of the inter-microarray line-of-sight offset, respectively. All are greater than 0.

[0025] In a preferred embodiment, the light field reconstruction imbalance risk assessment index is compared with a preset light field reconstruction imbalance risk assessment index threshold to identify the degree of imbalance risk in the current light field reconstruction, as follows:

[0026] If the light field reconstruction imbalance risk assessment index is greater than the light field reconstruction imbalance risk assessment index threshold, then the current light field reconstruction imbalance risk level is marked as a high imbalance risk level.

[0027] If the light field reconstruction imbalance risk assessment index is less than or equal to the light field reconstruction imbalance risk assessment index threshold, then the current light field reconstruction imbalance risk level is marked as low imbalance risk level.

[0028] In a preferred embodiment, based on the currently detected focus shift trend, the focal length of the lens unit is finely adjusted to re-align the focal plane, and the adjustment compensation amount is defined; the micro-electronic focal length modulator is activated to perform the adjustment compensation.

[0029] The registration correction angle is calculated based on the cumulative runaway coefficient of the inter-array visual axis offset; the micro-optical axis adjustment component is invoked to finely adjust the optical axis direction of the microlens array in real time;

[0030] After focal length adjustment and frustum registration, a phase continuity loss function is constructed. The phase of the boundary pixels is iteratively adjusted using a gradient descent algorithm to optimize the phase consistency of the light field image data, eliminate phase jumps at the stitching boundaries, complete the constrained reconstruction of the image phase continuity, and finally output the adjusted high-resolution light field image.

[0031] The technical effects and advantages of this invention are as follows:

[0032] 1. This invention utilizes a standardized microlens array module to achieve high-precision standardized definition and optical axis micro-angle deviation calibration of key parameters such as size, focal length, aperture, edge cone angle, and arrangement matrix of microlens units. By leveraging the standardized microlens array, it efficiently acquires high-resolution light field data of the target 3D scene from multiple perspectives and focal points, and simultaneously captures non-uniform temperature-controlled focus drift information and cumulative uncontrolled line-of-sight offset information between microlenses in real time to support subsequent fine-tuning. Based on the non-uniform temperature-controlled focus drift coefficient and the cumulative uncontrolled line-of-sight offset coefficient between microlenses, a light field reconstruction imbalance risk assessment model is collaboratively constructed, outputting a real-time light field reconstruction imbalance risk assessment index to achieve quantitative assessment and dynamic early warning of the degree of imbalance risk during the light field reconstruction process. This provides intelligent decision-making basis for reconstruction control. When the system determines that the current light field reconstruction imbalance risk level reaches a high imbalance risk state, the reconstruction control module can immediately trigger the focal length control and view frustum registration optimization mechanism. In the reconstruction process, image phase continuity constraints are introduced to effectively suppress splicing errors, phase discontinuities, and image tortuosity caused by temperature control drift and optical axis offset coupling. This results in the output of high-quality, high-consistency, and high-precision light field reconstruction images. It effectively suppresses focal length micro-changes, optical axis skew and their cumulative runaway effects caused by inconsistent temperature control and structural stress, improving the thermal stability and long-term operational stability of light field reconstruction. It also improves the splicing consistency of subarrays and the optical axis alignment accuracy, reducing the risk of distortion such as image edge tortuosity and depth distortion. Attached Figure Description

[0033] To facilitate understanding by those skilled in the art, the present invention will be further described below with reference to the accompanying drawings;

[0034] Figure 1 This is a flowchart of the system according to an embodiment of the present invention. Detailed Implementation

[0035] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0036] Example: The present invention provides, as follows Figure 1 The high-resolution standardized microarray compound eyepiece lens module and light field control system shown include a microlens array standardization module, a data acquisition module, a light field reconstruction imbalance risk assessment module, and a reconstruction control module;

[0037] The microlens array standardization module is used to build a standardized microlens array design library, define microlens unit parameters, and perform optical axis micro-angle deviation calibration on the lens module.

[0038] The data acquisition module utilizes a standardized microlens array to acquire high-resolution light field data from multiple perspectives and focal points in the target 3D scene; it also acquires non-uniform temperature-controlled focal drift information and cumulative runaway information of line-of-sight offset between microarrays in real time.

[0039] The light field reconstruction imbalance risk assessment module constructs a light field reconstruction imbalance risk assessment model based on non-uniform temperature control focus drift information and cumulative uncontrolled information of line-of-sight offset between microarrays, and outputs a light field reconstruction imbalance risk assessment index to assess the degree of imbalance risk in the current light field reconstruction.

[0040] The reconstruction and control module activates the focus control and frustum registration optimization mechanism when the current light field reconstruction imbalance risk level is high, and at the same time constrains the image phase continuity to reconstruct and output the high-resolution light field image after control.

[0041] The microlens array standardization module is used to build a standardized microlens array design library, define microlens unit parameters (e.g., aperture D, focal length F, edge cone angle α, arrangement matrix P, etc.), and perform optical axis micro-angle deviation calibration on the lens module, as detailed below:

[0042] Under conditions of no thermal disturbance, the reference output optical axis direction of each microlens unit is obtained, and the incident light is illuminated using a collimated laser array to record the position of each output spot. According to the deviation from the center point Calculate the current optical axis offset. : ,in The distance between the microlens and the imaging plane; reconstruct the array offset field from all the minute optical axis offsets: For each microarray lens module, a unique calibration matrix is ​​defined: ,in The azimuth angle represents the direction deviation; the calibration matrix is ​​written into the structure description file, which supports embedded EEPROM / Flash storage. The control end automatically reads the calibration matrix in the light field reconstruction algorithm and performs sub-pixel level alignment pre-compensation for each view frustum angle.

[0043] The data acquisition module uses a standardized microlens array to complete high-resolution light field data acquisition from multiple perspectives and multiple focal points in the target 3D scene; it synchronously acquires non-uniform temperature-controlled focus drift information and microarray inter-view axis offset cumulative runaway information in real time. The non-uniform temperature-controlled focus drift information includes the non-uniform temperature-controlled focus drift coefficient, and the microarray inter-view axis offset cumulative runaway information includes the microarray inter-view axis offset cumulative runaway coefficient.

[0044] In this invention, the non-uniform temperature-controlled focus drift coefficient is a key indicator used to quantify the overall degree of minute focus drift caused by localized temperature inconsistencies in the operating temperature of a high-resolution standardized microarray compound eye lens module under high-resolution operating conditions. This coefficient uses the relative average deviation of focal length changes of each microlens unit within the microlens array under operating and reference temperature conditions as a metric, reflecting the overall integration level of focus position changes caused by inconsistent temperature control within the microarray compound eye system. A larger non-uniform temperature-controlled focus drift coefficient indicates a higher degree of inconsistency in focus drift among the microlenses within the microarray compound eye lens module, meaning a more severe focal length change and optical performance mismatch caused by localized temperature control, resulting in poorer system imaging consistency and light field reconstruction stability. Consequently, when spatially stitching and depth field reconstruction are performed on the sub-images output by multiple microlenses, inconsistencies in focus positions can easily lead to problems such as increased image stitching gaps, inconsistent optical axis directions between sub-images, and accumulation of depth information reconstruction errors, significantly reducing the overall balance and accuracy of the light field reconstruction. Conversely, the smaller the non-uniform temperature-controlled focus drift coefficient, the more consistent the focus drift of each microlens in the microarray compound lens module is under different local temperature control conditions. This indicates a weaker overall thermal field impact on optical performance, better coordination of the focus positions of the sub-images output by each microlens, and facilitates higher-precision fusion and reconstruction of the light field data during the stitching and depth reconstruction stages. Assessing the risk level of current light field reconstruction imbalance based on the non-uniform temperature-controlled focus drift coefficient has significant advantages in this invention. First, this coefficient serves as a direct quantitative indicator of the impact of thermal field-driven focus drift on light field reconstruction, enabling the system to perceive in real time whether there is a high-risk imbalance trend caused by local temperature control mismatch during the current light field reconstruction process. This mechanism can effectively replace the traditional method of passively detecting imbalance based on light field reconstruction results, achieving proactive perception and early warning of light field reconstruction imbalance risks, thereby providing sufficient reaction time and adjustment space for subsequent reconstruction control. Secondly, this coefficient, working in conjunction with the cumulative runaway coefficient of line-of-sight misalignment between microarrays in the evaluation model, can effectively capture the chain reaction mode of optical field imbalance caused by thermal-structural-optical coupling, such as: temperature control imbalance → focus drift → line-of-sight misalignment → splicing mismatch → further uneven heat dissipation distribution → increased imbalance risk. This invention, by integrating the imbalance risk index output of the non-uniform temperature control focus drift coefficient, achieves dynamic monitoring and real-time control of the entire optical field reconstruction process, significantly enhancing the stability and robustness of the optical field control system in complex environments.

[0045] The logic for obtaining the drift coefficient of the non-uniform temperature control focus is as follows:

[0046] Real-time acquisition of the position and temperature of each lens unit in the microlens array: ,in Let n be the position temperature of the i-th lens unit, and n be the number of lens units; calculate the local temperature gradient based on the position temperature of each lens unit. : ,in The coordinates of the lens unit are given; the thermally induced radial deformation rate of each lens unit under temperature control is calculated based on the local temperature gradient. : ,in The linear thermal expansion coefficient of the material. This is the reference temperature for the lens unit. This is the stress amplification factor caused by the local temperature gradient; the thermally induced radial deformation rate is compared with a preset thermally induced radial deformation rate threshold. If the thermally induced radial deformation rate is greater than the threshold, the minute optical axis deviation angle caused by local deformation is obtained based on the local temperature gradient. : ,in This is the sensitivity coefficient for optical axis deviation;

[0047] It should be noted that the linear thermal expansion coefficient of a material refers to the rate of expansion per unit length of the microlens material under a unit temperature change, usually expressed in μm / (m·°C) or 1 / °C, and is used to reflect the sensitivity of the material to thermal expansion. This coefficient can be obtained from the material's factory inspection report, standard material property databases, or by performing thermo-mechanical analysis (TMA) tests on the sample. The stress amplification factor refers to the amplification ratio of local stress to stress under ideal uniform heating conditions due to factors such as microlens geometry, boundary constraints, and material anisotropy under local temperature gradients. This factor is used to correct the response capability of the thermal expansion model to local non-uniform heating effects. The stress amplification factor can be obtained through high-precision finite element thermo-structure coupling simulation analysis, optical interferometry, or digital speckle strain analysis experiments. The optical axis deviation sensitivity coefficient refers to the response ratio of the optical axis direction of the microlens unit to the small deviation angle change of the optical axis caused by local temperature gradient disturbances. Its physical meaning is the incremental change in the angle (usually measured in microradians or radians) of the optical axis of a microlens under the action of a unit temperature gradient intensity. It reflects the sensitivity of the lens structure and material to the stability of the optical axis under non-uniform temperature control environment. It can be obtained by performing thermal-structure-optical multi-field coupling simulation based on micro-nano optics finite element modeling, statistically analyzing the trend of optical axis micro-offset under different temperature gradient conditions, and fitting the sensitivity coefficient. This will not be elaborated here.

[0048] The focal length change of each microlens is obtained by perturbation analysis based on the thermally induced radial deformation rate. : ,in This is the initial microlens focal length;

[0049] The non-consistency deviation is obtained by weighted aggregation of the focal length change and minute optical axis deviation of each microlens. : ,in , These represent preset proportionality coefficients for the change in the focal length of the microlens and the slight optical axis deviation angle, respectively. , All are greater than 0;

[0050] It should be noted that, , The settings should be tailored to the specific circumstances. For example, an expert-empowered approach could be adopted, where experts in relevant fields are invited to determine the pre-defined proportions for each indicator through professional opinion surveys and comprehensive evaluations. , It can be 0.5 or 0.5;

[0051] Based on the non-uniformity deviation, a micro-focus drift analysis was performed on all lens units to calculate the non-uniform temperature-controlled focus drift coefficient. : ,in This represents the mean of the inconsistency deviation. ;

[0052] It should be noted that the above formulas are all dimensionless calculations. Commonly used methods for removing dimensions include Min-Max normalization and Z-Score standardization, which will not be elaborated here.

[0053] In this invention, the cumulative runaway coefficient of inter-microarray visual axis offset is a characterizing parameter used to measure the degree of cumulative runaway due to minute optical axis offsets between microlens arrays during multi-level stitching under long-term operation or complex temperature control and mechanical disturbance conditions in a high-resolution microarray compound eye lens module. This coefficient reflects the strength of the ability of the microarray compound eye system to maintain the consistency of optical axes between arrays during multi-view light field reconstruction, and is an important indicator for evaluating light field stitching accuracy, spatial alignment stability, and overall image continuity. A large cumulative runaway coefficient of inter-microarray visual axis offset indicates that the optical axis offset between microarray sub-modules has undergone a significant cumulative effect during spatial stitching, resulting in obvious optical axis misalignment, sub-view stitching seam misalignment, or image distortion in adjacent stitching intervals, further leading to problems such as multi-focal layer reconstruction failure and image depth field distortion, seriously threatening the stability, spatial consistency, and real-time performance of light field reconstruction. The relatively small cumulative runaway coefficient of the line-of-sight offset between microarrays indicates that the optical axes of each microarray sub-module maintain high consistency during multi-dimensional stitching. The cumulative offset can be effectively resolved or corrected by the system's control algorithm, thereby ensuring high precision, high stability, and high continuity of the light field stitching. Assessing the degree of imbalance risk in the current light field reconstruction based on the cumulative runaway coefficient of the line-of-sight offset between microarrays can significantly improve the intelligent monitoring and adaptive control capabilities of the light field reconstruction process, achieving a technological breakthrough in real-time self-sensing, self-correction, and dynamic image stabilization.

[0054] The logic for obtaining the cumulative runaway coefficient of line-of-sight offset between microarrays is as follows:

[0055] Each microlens array sub-module is considered as a graph node. The adjacent array relationships are represented by graph edges. Constructing a microarray diagram The optical axis coupling offset propagation factor between different nodes is obtained by appending the current frame's optical axis offset angle and the node spatial topological distance to each edge. : ,in This represents the optical axis offset angle for the current frame. The topological distance between nodes;

[0056] The formula for calculating the optical axis offset angle of the current frame is as follows: ,in The initial calibration optical axis direction for node j of the microlens array sub-module is given. The initial calibration optical axis direction for node k of the microlens array sub-module;

[0057] The formula for calculating the spatial topological distance between nodes is as follows: ,in Let be the array center position coordinate vector of node j in the microlens array sub-module. Let be the array center position coordinate vector of node k in the microlens array sub-module. This represents the maximum distance between nodes;

[0058] Based on the microlens array diagram and combined with the optical axis coupling offset propagation factor, a propagation matrix is ​​constructed. The propagation matrix Each element is represented as follows: ;

[0059] Calculate the indirect cumulative propagation effect of the offset by raising the propagation matrix to the p-th power: ;

[0060] The response weights of the microlens array sub-module nodes are introduced by combining the mean of the local temperature gradient and the response of the image stitching error. : ,in This represents the mean of the local temperature gradient. Image stitching error response;

[0061] The formula for calculating the mean local temperature gradient is as follows: ,in For local temperature gradients;

[0062] The formula for calculating the image stitching error response is as follows: ,in This represents the change in the focal length of the microlens. It is the set of subarrays adjacent to node j of the microlens array submodule. For time-series cumulative weighting factors, ( (For time indexing)

[0063] Calculate the total offset runaway response based on the response weights. : ,in The elements in the propagation matrix after exponentiation to the power of p;

[0064] Calculate the cumulative runaway coefficient of the inter-array line-of-sight offset based on the total amount of overall offset runaway response. : ,in This represents the total number of nodes in the microlens array sub-module. This is to prevent division by zero by a very small constant (generally taken as...). );

[0065] It should be noted that the above formulas are all dimensionless calculations. Commonly used methods for removing dimensions include Min-Max normalization and Z-Score standardization, which will not be elaborated here.

[0066] The light field reconstruction imbalance risk assessment module constructs a light field reconstruction imbalance risk assessment model based on non-uniform temperature control focus drift information and cumulative uncontrolled information of line-of-sight offset between microarrays, and outputs a light field reconstruction imbalance risk assessment index to assess the degree of imbalance risk in the current light field reconstruction.

[0067] Based on the non-uniform temperature-controlled focus drift information and the cumulative runaway information of line-of-sight offset between microarrays, a risk assessment model for optical field reconstruction imbalance is constructed, outputting an optical field reconstruction imbalance risk assessment index. The formula used in the optical field reconstruction imbalance risk assessment model is as follows: In the formula As an index for assessing the risk of imbalance in light field reconstruction, The non-uniform temperature control focus drift coefficient, This represents the cumulative runaway coefficient of the line-of-sight offset between microarrays. These represent the preset proportional coefficients for the non-uniform temperature control focus drift coefficient and the cumulative runaway coefficient of the inter-microarray line-of-sight offset, respectively. All are greater than 0;

[0068] It should be noted that the above formulas are all dimensionless calculations. Commonly used methods for removing dimensions include Min-Max normalization and Z-Score standardization, which will not be elaborated here. The settings should be tailored to the specific circumstances. For example, an expert-empowered approach could be adopted, where experts in relevant fields are invited to determine the pre-defined proportions for each indicator through professional opinion surveys and comprehensive evaluations. It can be 0.5 or 0.5;

[0069] As shown in the above calculations, the larger the non-uniform temperature-controlled focus drift coefficient and the larger the cumulative runaway coefficient of the inter-microarray line-of-sight offset, the larger the light field reconstruction imbalance risk assessment index. This indicates a higher degree of imbalance risk during light field reconstruction, and the stability, stitching consistency, and 3D reconstruction accuracy of the system's light field imaging will be negatively affected more significantly. Specifically, as the non-uniform temperature-controlled focus drift coefficient and the cumulative runaway coefficient of the inter-microarray line-of-sight offset increase, it means that the thermal-optical coupling mismatch effect and optical axis geometric error within the system are gradually amplified in space and time. This leads to the destruction of the spatial consistency of multi-view light field data, resulting in misalignment, overlap, or discontinuity in the stitching area, and ultimately causing problems such as 3D depth map distortion, blurred target edges, and increased real-time imaging delay. Conversely, the smaller the non-uniform temperature-controlled focus drift coefficient and the smaller the cumulative runaway coefficient of the inter-microarray line-of-sight offset, the smaller the light field reconstruction imbalance risk assessment index, indicating a lower degree of imbalance risk during light field reconstruction. The system can maintain high light field reconstruction stability and imaging consistency under the current operating environment. The smaller the non-uniform temperature-controlled focal drift coefficient, the more uniform the temperature distribution of each unit in the microlens array at different locations. This effectively suppresses thermally induced focal length changes and micro-optical axis deviation effects, and reduces the interference of local thermal fields on optical performance. The smaller the cumulative runaway coefficient of the visual axis offset between microarrays, the smaller the visual axis geometric error of each microlens array submodule, the higher the degree of optical axis alignment, and the better the spatial viewing angle consistency when splicing multiple arrays. This also makes it less likely to cause problems such as optical axis mismatch or splicing discontinuity.

[0070] The light field reconstruction imbalance risk assessment index is compared with the preset light field reconstruction imbalance risk assessment index threshold to identify the current degree of imbalance risk in the light field reconstruction, as follows:

[0071] If the light field reconstruction imbalance risk assessment index is greater than the light field reconstruction imbalance risk assessment index threshold, it indicates that the combined effect of the non-uniform temperature control focus drift and the cumulative uncontrolled loss of line offset between microarrays in the current light field reconstruction process has reached or exceeded the safety tolerance range set by the system. This indicates that there are significant hidden dangers in the stability and consistency of key links such as optical stitching, wavefront reconstruction, and image fusion, which can easily lead to problems such as amplified imaging errors, depth map distortion, stitching seam breaks, and spatial reconstruction discontinuities. The current imbalance risk level of the light field reconstruction is marked as a high imbalance risk level.

[0072] If the light field reconstruction imbalance risk assessment index is less than or equal to the threshold of the light field reconstruction imbalance risk assessment index, it means that the current light field reconstruction state of the system is within a controllable range. The effects of non-uniform temperature control focus drift and the cumulative uncontrolled loss of line offset between microarrays have not yet significantly interfered with the overall imaging quality and light field consistency. The key performance of the system, such as spatial stitching, depth reconstruction, and image fusion, remains stable and the imaging effect is good. There is no need to trigger large-scale compensation and control measures. The current light field reconstruction imbalance risk level is marked as low imbalance risk level.

[0073] It should be noted that the threshold for the light field reconstruction imbalance risk assessment index can be set based on specific application requirements and the system's different requirements for imaging stability and accuracy, combined with historical operation statistics and expert experience. For example, in application scenarios with high requirements for real-time performance and high accuracy (such as autonomous driving visual perception, high-precision robot navigation, augmented reality spatial alignment, etc.), this threshold can be set to a relatively low value to enhance the system's sensitivity to early imbalance risks and ensure that the control mechanism can be triggered in a timely manner at the initial stage of imbalance risk. In scenarios where real-time requirements are generally low but power consumption or computational resource optimization is prioritized (such as static high-resolution 3D modeling and large-scale scene light field recording), this threshold can be appropriately relaxed to avoid excessively frequent control interventions and ensure overall efficiency and resource utilization. The threshold can be obtained in the following ways: First, based on experimental calibration, that is, under laboratory conditions, simulating different temperature control and line-of-sight offset states, analyzing the corresponding light field reconstruction errors (such as stitching errors, depth distortion rate, etc.), and determining the acceptable boundary of imbalance risk; Second, based on expert weighting and statistical analysis, comprehensively applying the subjective evaluation of domain experts and the objective statistics of a large amount of operational data, and using weighted average or interval analysis to determine a reasonable threshold range; Third, based on adaptive learning, continuously accumulating data during system operation, using machine learning methods (such as clustering and discriminant analysis) to classify imbalance states and dynamically adjust the threshold to adapt to changes in different environments and task conditions, which will not be elaborated here;

[0074] The reconstruction and control module activates the focus control and frustum registration optimization mechanism when the current light field reconstruction imbalance risk level is high, and at the same time constrains the image phase continuity to reconstruct and output the high-resolution light field image after control.

[0075] Based on the current detected focus shift trend, the focal length of the lens unit is finely adjusted to re-align the focal plane, and the adjustment compensation amount is defined. : ,in To achieve the ideal focal length, activate the micro-electronic focus modulator (such as a thermoelectric focus or liquid crystal focus device) to perform adjustment compensation.

[0076] Calculation of registration correction angle based on cumulative runaway coefficient of line-of-sight offset between microarrays: ,in The cosine vector of the optical axis direction of the microlens array is used; the micro-optical axis adjustment component (MEMS or liquid crystal adaptive optics element) is invoked to finely adjust the optical axis direction of the microlens array in real time: ,in The cosine vector of the optical axis direction after adjustment;

[0077] After focal length adjustment and cone registration, a phase continuity loss function is constructed. : , The pixel phase information of the left sub-image of the light field stitching boundary at coordinates (x, y) (the phase information can be obtained from the complex amplitude data of the light field through inverse Fourier transform or phase reconstruction algorithm). The pixel phase information at coordinates (x, y) is obtained for the right sub-image of the light field stitching boundary; the boundary pixel phase is iteratively adjusted using a gradient descent-based algorithm. ,in Let be the boundary pixel phase distribution at the t-th iteration. This represents the updated boundary pixel phase distribution at the (t+1)th iteration. The learning rate (step size factor) controls the magnitude of each phase adjustment;

[0078] Phase consistency optimization is performed on the light field image data to eliminate phase jumps at the stitching boundary, complete the constrained reconstruction of the image phase continuity, and finally output the high-resolution light field image after adjustment.

[0079] This invention proposes a high-resolution standardized microarray compound eye lens module and light field control system. Through modular design and a highly integrated light field control mechanism, it significantly improves the stability of light field reconstruction, thermal uniformity, and coupling error tolerance of the microarray compound eye vision system in complex 3D scenes, fully meeting the practical application needs of high-resolution vision systems such as augmented reality display, intelligent sensing terminals, robot visual navigation, and light field perception of unmanned systems. This system utilizes a standardized microlens array module to achieve high-precision standardized definition and optical axis micro-angle deviation calibration of key parameters such as size, focal length, aperture, edge cone angle, and arrangement matrix of microlens units. This effectively reduces initial optical axis inconsistencies introduced by manufacturing errors, providing a fundamental guarantee of structural symmetry and optical homogeneity for subsequent light field data acquisition and reconstruction. Simultaneously, through the data acquisition module, the standardized microlens array efficiently acquires high-resolution light field data of the target 3D scene from multiple perspectives and focal points. It also captures non-uniform temperature-controlled focus drift information and cumulative uncontrolled line-of-sight offset information between microlenses in real time to support subsequent fine-tuning. Based on the non-uniform temperature-controlled focus drift coefficient and the cumulative uncontrolled line-of-sight offset coefficient between microlenses, a risk assessment model for light field reconstruction imbalance is constructed, and the light field reconstruction imbalance is output in real time. The risk assessment index enables quantitative assessment and dynamic early warning of the degree of imbalance risk in the light field reconstruction process, providing intelligent decision-making basis for reconstruction control. When the system determines that the current imbalance risk level of the light field reconstruction has reached a high imbalance risk state, the reconstruction control module can immediately trigger the focal length control and view frustum registration optimization mechanism, and introduce image phase continuity constraints during the reconstruction process. This effectively suppresses phenomena such as stitching errors, phase discontinuities, and image tortuosity caused by temperature control drift and optical axis offset coupling, outputting high-quality, high-consistency, and high-precision light field reconstruction images. It effectively suppresses focal length micro-changes, optical axis skew, and their cumulative runaway effects caused by inconsistent temperature control and structural stress, improving the thermal stability and long-term operational stability of the light field reconstruction; enhancing the stitching consistency of subarrays and the alignment accuracy of the optical axis, and reducing the risk of distortion such as image edge tortuosity and depth distortion.

[0080] The above formulas are all dimensionless calculations. The formulas are derived from software simulations based on a large amount of collected data to obtain the most recent real-world results. The preset parameters in the formulas are set by those skilled in the art according to the actual situation.

[0081] The above embodiments can be implemented, in whole or in part, by software, hardware, firmware, or any other combination thereof. When implemented using software, the above embodiments can be implemented, in whole or in part, as a computer program product. The computer program product includes one or more computer instructions or computer programs. When the computer instructions or computer programs are loaded or executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more sets of available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium. A semiconductor medium can be a solid-state drive.

[0082] It should be understood that in the various embodiments of this application, the order of the above-mentioned processes does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0083] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0084] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A high-resolution standardized microarray compound eyeglass lens module and light field modulation system, characterized in that: It includes a microlens array standardization module, a data acquisition module, an optical field reconstruction imbalance risk assessment module, and a reconstruction control module; The microlens array standardization module is used to build a standardized microlens array design library, define microlens unit parameters, and perform optical axis micro-angle deviation calibration on the lens module. The data acquisition module utilizes a standardized microlens array to acquire high-resolution light field data from multiple perspectives and focal points in the target 3D scene; it also acquires non-uniform temperature-controlled focal drift information and cumulative runaway information of line-of-sight offset between microarrays in real time. The light field reconstruction imbalance risk assessment module constructs a light field reconstruction imbalance risk assessment model based on non-uniform temperature control focus drift information and cumulative uncontrolled information of line-of-sight offset between microarrays, and outputs a light field reconstruction imbalance risk assessment index to assess the degree of imbalance risk in the current light field reconstruction. The reconstruction and control module activates the focus control and frustum registration optimization mechanism when the current light field reconstruction imbalance risk level is high, and at the same time constrains the image phase continuity to reconstruct and output the high-resolution light field image after control. The non-uniform temperature control focus drift information includes the non-uniform temperature control focus drift coefficient, and the inter-microarray line offset cumulative runaway information includes the inter-microarray line offset cumulative runaway coefficient. The logic for obtaining the drift coefficient of the non-uniform temperature control focus is as follows: Real-time acquisition of the position and temperature of each lens unit in the microlens array: ,in Let n be the position temperature of the i-th lens unit, and n be the number of lens units; calculate the local temperature gradient based on the position temperature of each lens unit. : ,in The coordinates of the lens unit are given; the thermally induced radial deformation rate of each lens unit under temperature control is calculated based on the local temperature gradient. : ,in The linear thermal expansion coefficient of the material. This is the reference temperature for the lens unit. This is the stress amplification factor caused by the local temperature gradient; the thermally induced radial deformation rate is compared with a preset thermally induced radial deformation rate threshold. If the thermally induced radial deformation rate is greater than the threshold, the minute optical axis deviation angle caused by local deformation is obtained based on the local temperature gradient. : ,in This is the sensitivity coefficient for optical axis deviation; The focal length change of each microlens is obtained by perturbation analysis based on the thermally induced radial deformation rate. : ,in This is the initial microlens focal length; The non-consistency deviation is obtained by weighted aggregation of the focal length change and minute optical axis deviation of each microlens. : ,in , These represent preset proportionality coefficients for the change in the focal length of the microlens and the slight optical axis deviation angle, respectively. , All are greater than 0; Based on the non-uniformity deviation, a micro-focus drift analysis was performed on all lens units to calculate the non-uniform temperature-controlled focus drift coefficient. : ,in This represents the mean of the inconsistency deviation. ; The logic for obtaining the cumulative runaway coefficient of line-of-sight offset between microarrays is as follows: Each microlens array sub-module is considered as a graph node. The adjacent array relationships are represented by graph edges. Constructing a microarray diagram The optical axis coupling offset propagation factor between different nodes is obtained by appending the current frame's optical axis offset angle and the node spatial topological distance to each edge. : ,in This represents the optical axis offset angle for the current frame. The topological distance between nodes; The formula for calculating the optical axis offset angle of the current frame is as follows: ,in The initial calibration optical axis direction is set for node j of the microlens array sub-module. The initial calibration optical axis direction for node k of the microlens array sub-module; The formula for calculating the spatial topological distance between nodes is as follows: ,in Let be the array center position coordinate vector of node j in the microlens array sub-module. Let be the coordinate vector of the array center position of node k in the microlens array sub-module. This represents the maximum distance between nodes; Based on the microlens array diagram and combined with the optical axis coupling offset propagation factor, a propagation matrix is ​​constructed. The propagation matrix Each element is represented as follows: ; Calculate the indirect cumulative propagation effect of the offset by raising the propagation matrix to the p-th power: ; The response weights of the microlens array sub-module nodes are introduced by combining the mean of the local temperature gradient and the response of the image stitching error. : ,in This represents the mean of the local temperature gradient. Image stitching error response; The formula for calculating the mean local temperature gradient is as follows: ,in For local temperature gradients; The formula for calculating the image stitching error response is as follows: ,in This represents the change in the focal length of the microlens. It is the set of subarrays adjacent to node j of the microlens array submodule. For time-series cumulative weighting factors, ; Calculate the total offset runaway response based on the response weights. : ,in The elements in the propagation matrix after exponentiation to the power of p; Calculate the cumulative runaway coefficient of the inter-array line-of-sight offset based on the total total runaway response. : ,in This represents the total number of nodes in the microlens array sub-module. This is a very small constant to prevent division by zero; The process of activating the focal length adjustment and frustum registration optimization mechanism, and simultaneously constraining the image phase continuity to reconstruct and output the adjusted high-resolution light field image is as follows: Calculation of registration correction angle based on cumulative runaway coefficient of line-of-sight offset between microarrays: ,in This represents the cosine vector of the optical axis direction of the microlens array; the micro-optical axis adjustment component is invoked to fine-tune the optical axis direction of the microlens array in real time. ,in The cosine vector of the optical axis direction after adjustment; After focal length adjustment and cone registration, a phase continuity loss function is constructed. : , This represents the pixel phase information at coordinates (x, y) of the sub-image on the left side of the light field stitching boundary. The pixel phase information at coordinates (x, y) is obtained for the right sub-image of the light field stitching boundary; the boundary pixel phase is iteratively adjusted using a gradient descent-based algorithm. ,in Let be the boundary pixel phase distribution at the t-th iteration. This represents the updated boundary pixel phase distribution at the (t+1)th iteration. The learning rate; Phase consistency optimization is performed on the light field image data to eliminate phase jumps at the stitching boundary, complete the constrained reconstruction of the image phase continuity, and finally output the adjusted high-resolution light field image.

2. The high-resolution standardized microarray compound eyeglass lens module and light field modulation system according to claim 1, characterized in that: Based on the non-uniform temperature-controlled focus drift information and the cumulative runaway information of line-of-sight offset between microarrays, a risk assessment model for optical field reconstruction imbalance is constructed, outputting an optical field reconstruction imbalance risk assessment index. The formula used in the optical field reconstruction imbalance risk assessment model is as follows: In the formula As an index for assessing the risk of imbalance in light field reconstruction, The non-uniform temperature control focus drift coefficient, This represents the cumulative runaway coefficient of the line-of-sight offset between microarrays. These represent the preset proportional coefficients for the non-uniform temperature control focus drift coefficient and the cumulative runaway coefficient of the inter-microarray line-of-sight offset, respectively. All are greater than 0.

3. The high-resolution standardized microarray compound eyeglass lens module and light field modulation system according to claim 2, characterized in that: The light field reconstruction imbalance risk assessment index is compared with the preset light field reconstruction imbalance risk assessment index threshold to identify the current degree of imbalance risk in the light field reconstruction, as follows: If the light field reconstruction imbalance risk assessment index is greater than the light field reconstruction imbalance risk assessment index threshold, then the current light field reconstruction imbalance risk level is marked as a high imbalance risk level. If the light field reconstruction imbalance risk assessment index is less than or equal to the light field reconstruction imbalance risk assessment index threshold, then the current light field reconstruction imbalance risk level is marked as low imbalance risk level.

Images