Area-array camera exposure and light source linkage control method and device

Abstract

The invention relates to the technical field of light source control, and provides an area-array camera exposure and light source linkage control method and device, and the method comprises the steps: obtaining an initial image, carrying out the image analysis, obtaining an image brightness parameter and a contrast parameter, and inputting the image brightness parameter and the contrast parameter into a preset exposure and light source control model; obtaining the adjusted light source parameter and the adjusted camera exposure parameter, carrying out correlation analysis, generating a light source balance condition and a camera exposure balance condition based on an analysis result, collecting an initial image again, and carrying out image analysis to obtain an adjusted image brightness parameter and a contrast parameter; and if the adjusted image brightness parameter and contrast parameter do not meet the preset image quality requirement, circulating the above steps until the image brightness parameter and contrast parameter meet the preset image quality requirement. According to the scheme, the problem that the light source and the camera exposure cannot be accurately balanced in real time due to the complexity of the illumination environment in practical application is solved.

Description

Technical Field

[0001] The present application relates to the technical field of light source control, and in particular to a method and device for controlling the linkage between exposure and light source of an area array camera. Background Art

[0002] With the rapid development of science and technology, image processing technology is increasingly being used in various fields. As an important image acquisition tool, area array cameras are used in many fields, including industrial inspection, medical imaging, and intelligent transportation. For these application scenarios, how to improve image quality, especially the balance of brightness and contrast, has become an important direction for technological development.

[0003] In related technical means, the exposure control and light source control of the area array camera are usually performed independently. The exposure control of the area array camera is mainly achieved by adjusting the exposure time and gain parameters, while the control of the light source is achieved by adjusting the brightness and illumination angle of the light source. The effect of this is that the brightness and contrast of the image can be improved to a certain extent, but due to the lack of linkage control between the two, it is easy to cause unstable image quality, especially when the lighting conditions change, the image effect is easily affected.

[0004] Regarding the above technical solution, although the image quality can be optimized to a certain extent by independently adjusting the camera exposure parameters and the light source brightness parameters, in actual applications, due to the complexity of the lighting environment, there is a problem that the light source and camera exposure cannot be accurately balanced in real time. Summary of the invention

[0005] In order to improve the problem that the light source and camera exposure cannot be accurately balanced in real time due to the complexity of the lighting environment in practical applications, the present application provides a method and device for controlling the exposure and light source of an area array camera in linkage, which achieves a dynamic balance between image brightness and contrast by adjusting the camera and light source parameters in linkage, thereby improving the stability and consistency of image quality.

[0006] The present invention provides a method for controlling exposure and light source linkage of an area array camera, comprising: step S1: acquiring an initial image collected by an area array camera based on light source illumination under initial conditions, performing image analysis on the initial image, and obtaining image brightness parameters and contrast parameters; wherein the initial conditions include light source parameter configuration and area array camera parameter configuration; step S2: inputting the image brightness parameters and the contrast parameters into a preset exposure and light source control model, and obtaining a light source adjustment instruction and a camera exposure adjustment instruction; step S3: adjusting the output intensity and irradiation time of the light source based on the light source adjustment instruction, and obtaining adjusted light source parameters; and adjusting the exposure time and exposure time of the area array camera based on the camera exposure adjustment instruction. gain, and obtain the adjusted camera exposure parameters; step S4: perform correlation analysis on the adjusted light source parameters and the adjusted camera exposure parameters, and generate light source balance conditions and camera exposure balance conditions based on the analysis results; step S5: after replacing the initial conditions with the light source balance conditions and the camera exposure balance conditions, collect the initial image again, and perform image analysis to obtain adjusted image brightness parameters and adjusted contrast parameters; step S6: if the adjusted image brightness parameters and the adjusted contrast parameters do not meet the preset image quality requirements, loop steps S2 to S5 until the image brightness parameters and the contrast parameters meet the preset image quality requirements.

[0007] As a preferred solution, the specific steps of step S1 are: step S11, using preset initial conditions to collect the initial image, preprocessing the initial image to obtain grayscale distribution data and edge feature data; step S12, fusing the grayscale distribution data and the edge feature data to obtain an image quality evaluation index; step S13, extracting image brightness information and contrast information based on the image quality evaluation index, generating a brightness histogram according to the image brightness information, and generating a contrast curve according to the contrast information; step S14, performing statistical analysis on the brightness histogram and the contrast curve to obtain image brightness parameters and contrast parameters.

[0008] As a preferred solution, the specific steps of step S12 are: step S121, performing Fourier transform on the grayscale distribution data to obtain grayscale spectrum characteristics and grayscale energy distribution, and using the grayscale spectrum characteristics and the grayscale energy distribution to extract the average brightness and contrast characteristic parameters of the image; step S122, performing directional statistical analysis on the edge feature data to obtain an edge direction histogram and an edge density distribution, and using the edge direction histogram and the edge density distribution to extract the clarity parameter and texture complexity parameter of the image; step S123, fusing the average brightness, contrast characteristic parameters, clarity parameters and texture complexity parameters to construct an image quality feature vector; step S124, evaluating the image quality feature vector through a preset image quality evaluation model, and calculating an image quality evaluation index based on the evaluation result.

[0009] As a preferred solution, the specific steps of step S2 are: step S21, inputting the image brightness parameter and the contrast parameter into a preset exposure and light source control model, in which a feedforward neural network algorithm is used to perform weight analysis on the image brightness parameter and the contrast parameter to obtain a brightness sensitivity weight and a contrast sensitivity weight; step S22, calculating a light source adjustment factor and a camera exposure adjustment factor according to the brightness sensitivity weight and the contrast sensitivity weight, parsing the light source adjustment factor to obtain a light source output intensity adjustment parameter and an irradiation time adjustment parameter, and adjusting the light source output intensity based on the light source output intensity adjustment factor. The parameters and the irradiation time adjustment parameters generate a preliminary light source adjustment instruction; step S23, the camera exposure adjustment factor is analyzed to obtain exposure time adjustment parameters and gain adjustment parameters, and a preliminary camera exposure adjustment instruction is generated based on the exposure time adjustment parameters and the gain adjustment parameters; step S24, the preliminary light source adjustment instruction and the preliminary camera exposure adjustment instruction are coordinated and analyzed to obtain adjustment coordination parameters and optimization factors; step S25, the preliminary light source adjustment instruction and the preliminary camera exposure adjustment instruction are optimized using the adjustment coordination parameters and optimization factors, and the light source adjustment instruction and the camera exposure adjustment instruction are output.

[0010] As a preferred solution, the specific steps of step S3 are: step S31, inputting the light source adjustment instruction into a preset light source instruction parsing module to obtain an intensity adjustment value and an irradiation time adjustment value, adjusting the driving current of the light source according to the intensity adjustment value to obtain a new output intensity parameter, adjusting the pulse width of the light source according to the irradiation time adjustment value to obtain a new irradiation time parameter; step S32, combining the new output intensity parameter and the new irradiation time parameter to obtain an adjusted light source parameter; step S33, inputting the camera exposure adjustment instruction into a preset exposure instruction parsing module to obtain an exposure time adjustment value and a gain adjustment value, adjusting the exposure setting of the area array camera according to the exposure time adjustment value to obtain a new exposure time parameter, adjusting the gain setting of the area array camera according to the gain adjustment value to obtain a new gain parameter; step S34, combining the new exposure time parameter and the new gain parameter to obtain an adjusted camera exposure parameter.

[0011] As a preferred solution, the specific steps of step S4 are: step S41, using a principal component analysis algorithm to perform dimensionality reduction processing on the adjusted light source parameters and the adjusted camera exposure parameters to obtain a light source principal component parameter set and a camera exposure principal component parameter set, and using a data fusion method to perform fusion operation on the light source principal component parameter set and the camera exposure principal component parameter set to obtain parameter set data; step S42, using a multivariate association analysis method to analyze the parameter set data to obtain a correlation coefficient matrix between parameters; step S43, based on factor analysis, decomposing the correlation coefficient matrix to obtain common factors, unique factors and error terms, performing cluster analysis on the common factors to obtain a first factor subset and a second factor subset, and clustering the first factor A subset is linearly combined with the unique factor to obtain a first combination factor, and the second factor subset is linearly combined with the error term to obtain a second combination factor. Based on the first combination factor and the second combination factor, a strongly correlated parameter pair between the light source parameter and the camera exposure parameter is identified; step S44, regression analysis is performed on the strongly correlated parameter pair through a multivariate linear regression algorithm to obtain a regression coefficient and a regression constant, and a parameter association model is established based on the regression coefficient and the regression constant. In the parameter association model, the influence of the light source parameter and the camera exposure parameter on the image quality is calculated based on the regression algorithm, and the influence ranking is output; step S45, a weight analysis method is applied to select key parameters based on the influence ranking to generate a light source balance condition and a camera exposure balance condition.

[0012] As a preferred solution, the specific steps of step S5 are: step S51, inputting the light source balance condition and the camera exposure balance condition into a preset control module to replace the initial conditions, and obtaining an updated light source parameter configuration and an updated area array camera parameter configuration; step S52, controlling the light source based on the updated light source parameter configuration and the area array camera based on the updated area array camera parameter configuration, and then capturing the initial image again; step S53, performing image analysis on the initial image captured again through an image processing algorithm to obtain an adjusted image brightness parameter and an adjusted contrast parameter.

[0013] The present application also provides an exposure and light source linkage control device for an area array camera, comprising: an acquisition module, used to acquire an initial image collected by the area array camera based on light source illumination under initial conditions, perform image analysis on the initial image, and obtain image brightness parameters and contrast parameters; wherein the initial conditions include light source parameter configuration and area array camera parameter configuration; an input module, used to input the image brightness parameters and the contrast parameters into a preset exposure and light source control model, and obtain light source adjustment instructions and camera exposure adjustment instructions; an adjustment module, used to adjust the output intensity and irradiation time of the light source based on the light source adjustment instructions, and obtain adjusted light source parameters; and adjust the exposure time and gain of the area array camera based on the camera exposure adjustment instructions, and obtain adjusted phase. an analysis module for performing correlation analysis on the adjusted light source parameters and the adjusted camera exposure parameters, and generating a light source balance condition and a camera exposure balance condition based on the analysis result; a replacement module for replacing the initial conditions with the light source balance condition and the camera exposure balance condition, acquiring the initial image again, and performing image analysis to obtain an adjusted image brightness parameter and an adjusted contrast parameter; and a loop module for looping the steps of the acquisition module, the input module, the adjustment module, the analysis module, and the replacement module if the adjusted image brightness parameter and the adjusted contrast parameter do not meet the preset image quality requirements, until the image brightness parameter and the contrast parameter meet the preset image quality requirements.

[0014] Compared with the prior art, the present application has the following beneficial effects: good control effect and high adaptability. By acquiring the image brightness parameter and contrast parameter of the initial image and inputting them into the preset exposure and light source control model, a light source adjustment instruction and a camera exposure adjustment instruction are generated; based on these instructions, the output intensity and irradiation time of the light source, as well as the exposure time and gain of the array camera are adjusted respectively to obtain the adjusted light source parameters and camera exposure parameters; correlation analysis is performed on these adjusted parameters to generate light source balance conditions and camera exposure balance conditions, and images are collected and analyzed again, and the adjustment is repeated in this way until the image brightness parameter and contrast parameter meet the preset image quality requirements. By controlling the parameters of the light source and the array camera in linkage, a dynamic balance of image brightness and contrast is achieved, the image quality and stability are improved, and the problem of being unable to accurately balance the light source and camera exposure in real time in practical applications due to the complexity of the lighting environment exists. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0016] The structures, proportions, sizes, etc. illustrated in the drawings of this specification are only used to match the contents disclosed in the specification so as to facilitate understanding and reading by persons familiar with this technology. They are not used to limit the conditions under which the present invention can be implemented, and therefore have no substantive technical significance. Any structural modification, change in proportion or adjustment of size, without affecting the effects and purposes that can be achieved by the present invention, should still fall within the scope of the technical contents disclosed by the present invention.

[0017] Figure 1 It is a flow chart of a method for controlling the linkage between exposure and light source of an area array camera provided by an embodiment of the present invention; Figure 2 It is a schematic block diagram of the structure of the area array camera exposure and light source linkage control device provided by an embodiment of the present invention.

[0018] Description of reference numerals: 10. Area array camera exposure and light source linkage control device; 11. Acquisition module; 12. Input module; 13. Adjustment module; 14. Analysis module; 15. Replacement module; 16. Circulation module. DETAILED DESCRIPTION

[0019] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0020] The flowcharts shown in the accompanying drawings are only examples and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps may also be decomposed, combined or partially merged, so the actual execution order may change according to actual conditions.

[0021] It should also be understood that the terms used in this application specification are only for the purpose of describing specific embodiments and are not intended to limit the application. As used in this application specification and the appended claims, unless the context clearly indicates otherwise, the singular forms "a", "an" and "the" are intended to include plural forms.

[0022] It should be further understood that the term “and / or” used in the specification and appended claims refers to any combination and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0023] The technical solution of the present invention is further described below with reference to the accompanying drawings and through specific implementation methods.

[0024] Embodiment 1: like Figure 1 As shown, the method for controlling the linkage between exposure and light source of an area array camera provided in an embodiment of the present application includes steps S1 to S6.

[0025] Step S1: obtaining an initial image captured by the area array camera based on light source illumination under initial conditions, performing image analysis on the initial image, and obtaining image brightness parameters and contrast parameters; wherein the initial conditions include light source parameter configuration and area array camera parameter configuration.

[0026] In this step, the area array camera will take the first shot according to the preset light source parameters and camera parameters to obtain the initial image under these conditions. Specifically, by adjusting the brightness and illumination angle of the light source and the exposure time, gain and other parameters of the area array camera, the brightness and contrast information of the initial image is obtained.

[0027] For example, when the brightness of the light source is set to 1000 lumens, the illumination angle is 45 degrees, the exposure time of the area array camera is 50 milliseconds, and the gain is 200, the brightness parameter of the acquired initial image is 180, and the contrast parameter is 120.

[0028] Step S2: inputting the image brightness parameter and contrast parameter into a preset exposure and light source control model to obtain a light source adjustment instruction and a camera exposure adjustment instruction.

[0029] In this step, the preset exposure and light source control model will calculate the light source brightness, irradiation time, and exposure time and gain of the area array camera that need to be adjusted based on the input image brightness parameters and contrast parameters. Specifically, through the calculation of the model, the corresponding adjustment instructions are generated to optimize the image quality.

[0030] For example, the model may instruct to increase the light source brightness to 1200 lumens and adjust the camera exposure time to 60 milliseconds.

[0031] Step S3: Based on the light source adjustment instruction, adjust the output intensity and irradiation time of the light source to obtain adjusted light source parameters; based on the camera exposure adjustment instruction, adjust the exposure time and gain of the area array camera to obtain adjusted camera exposure parameters.

[0032] In this step, the light source and the area array camera will adjust parameters according to the received adjustment instructions and reconfigure the parameters of the light source and the camera. Specifically, by adjusting the brightness of the light source to 1200 lumens, increasing the illumination time to 60 milliseconds, and adjusting the camera exposure time to 60 milliseconds and the gain to 250, the optimized shooting conditions are obtained.

[0033] For example, the adjusted light source parameters are 1200 lumens and 60 milliseconds, and the adjusted camera exposure parameters are 60 milliseconds and 250 gain.

[0034] Step S4: performing correlation analysis on the adjusted light source parameters and the adjusted camera exposure parameters, and generating light source balance conditions and camera exposure balance conditions based on the analysis results.

[0035] In this step, the optimal configuration combination is determined by analyzing the relationship between the adjusted light source parameters and the camera exposure parameters. Specifically, according to the change trend of the image brightness parameter and the contrast parameter, the light source and camera parameter conditions that can ensure stable image quality are generated.

[0036] For example, the analysis results show that when the light source brightness is 1200 lumens, the illumination time is 60 milliseconds, the camera exposure time is 60 milliseconds, and the gain is 250, the image brightness parameter is 200 and the contrast parameter is 150, achieving the ideal effect.

[0037] Step S5: After replacing the initial conditions with the light source balance conditions and the camera exposure balance conditions, the initial image is collected again, and image analysis is performed to obtain adjusted image brightness parameters and adjusted contrast parameters.

[0038] In this step, the area array camera re-shoots the image using the new light source balance condition and camera exposure balance condition, and analyzes the image. Specifically, through the new parameter configuration, the new image brightness parameter and contrast parameter are obtained by shooting and analyzing.

[0039] For example, an image captured under the new balanced conditions has a brightness parameter of 200 and a contrast parameter of 150.

[0040] Step S6: If the adjusted image brightness parameter and the adjusted contrast parameter do not meet the preset image quality requirement, loop steps S2 to S5 until the image brightness parameter and the contrast parameter meet the preset image quality requirement.

[0041] In this step, if the image brightness parameter and contrast parameter do not meet the requirements, continue to adjust the parameters according to the adjustment instructions of the model, and repeat the above steps until the image quality that meets the requirements is obtained. Specifically, through cyclic adjustment, ensure that the final image brightness parameter and contrast parameter meet the preset standards.

[0042] For example, after multiple adjustments, the final image brightness parameter reaches 220 and the contrast parameter reaches 160, meeting the quality standard.

[0043] In this embodiment, the image brightness parameter and contrast parameter of the initial image are obtained. Then, these parameters are input into the preset exposure and light source control model to obtain the light source adjustment instruction and the camera exposure adjustment instruction. Then, based on these instructions, the output intensity and irradiation time of the light source, as well as the exposure time and gain of the array camera are adjusted to obtain the adjusted light source parameters and camera exposure parameters. Next, correlation analysis is performed and the light source balance condition and camera exposure balance condition are generated, and the image is collected again and analyzed, and the process is repeated until the image brightness parameter and the contrast parameter meet the preset image quality requirements. The linkage control of the light source and the array camera exposure is realized, so that the image brightness parameter and the contrast parameter are dynamically adjusted under various lighting conditions, which not only improves the image quality and stability, but also overcomes the problem of unstable image effect caused by changes in the lighting environment in the prior art, ensures that high-quality images can be obtained in different environments, and improves the problem that in actual applications, due to the complexity of the lighting environment, the light source and the camera exposure cannot be accurately balanced in real time.

[0044] Embodiment 2: In step S1, the specific steps are: Step S11: collect an initial image using a preset initial condition, pre-process the initial image, and obtain grayscale distribution data and edge feature data.

[0045] The initial image is preprocessed by mean filtering and Gaussian filtering to remove noise and enhance image details; specifically, mean filtering is used to smooth the image to reduce noise, and Gaussian filtering is used to retain edge details.

[0046] For example, when a 3x3 mean filter and a 5x5 Gaussian filter are used to preprocess an image, the smoothness and edge clarity of the image can be significantly improved.

[0047] Step S12: fusing the grayscale distribution data and the edge feature data to obtain an image quality evaluation index.

[0048] The grayscale distribution data and edge feature data are weightedly fused by using the weighted average method to calculate the comprehensive image quality evaluation index; specifically, different weights are assigned for fusion according to the uniformity of the image grayscale value and the number of edge features.

[0049] For example, a weight of 0.6 is assigned to the grayscale distribution data and a weight of 0.4 is assigned to the edge feature data. The resulting image quality evaluation index can reflect the overall quality level of the image.

[0050] Step S13: extracting image brightness information and contrast information based on the image quality evaluation index, generating a brightness histogram according to the image brightness information, and generating a contrast curve according to the contrast information.

[0051] By processing the brightness information and contrast information in the image quality evaluation index, a brightness histogram and a contrast curve are generated; specifically, a histogram equalization technique is used to equalize the brightness distribution, and a contrast stretching technique is used to enhance the contrast.

[0052] For example, through histogram equalization, a more evenly distributed brightness histogram can be obtained, and through contrast stretching, a clearer contrast curve can be obtained.

[0053] Step S14: Perform statistical analysis on the brightness histogram and the contrast curve to obtain image brightness parameters and contrast parameters.

[0054] The generated brightness histogram and contrast curve are analyzed by statistical analysis tools to extract the brightness parameters and contrast parameters of the image; specifically, the mean and variance of the brightness histogram are calculated, and the difference between the maximum and minimum values ​​of the contrast curve is calculated.

[0055] For example, when the mean of the brightness histogram is 150, the variance is 20, and the maximum difference of the contrast curve is 100, the obtained image brightness parameter is 150 and the contrast parameter is 100.

[0056] Wherein, in step S12, the specific steps are: Step S121, perform Fourier transform on the grayscale distribution data to obtain grayscale spectrum characteristics and grayscale energy distribution, and use the grayscale spectrum characteristics and grayscale energy distribution to extract the average brightness and contrast characteristic parameters of the image.

[0057] By applying Fast Fourier Transform (FFT) to the grayscale distribution data, its frequency domain characteristics are analyzed and the spectral characteristics and energy distribution of the image are extracted. Specifically, FFT is used to convert the image from the spatial domain to the frequency domain, and the average brightness and contrast characteristic parameters of the image are calculated through the frequency domain data.

[0058] For example, the grayscale spectrum characteristics obtained by FFT transformation can be used to calculate the average brightness of the image as 180 and the contrast characteristic parameter as 60.

[0059] Step S122: Perform directional statistical analysis on the edge feature data to obtain an edge direction histogram and an edge density distribution, and extract image clarity parameters and texture complexity parameters using the edge direction histogram and the edge density distribution.

[0060] By performing directional analysis on edge feature data, the number of edges in different directions is counted, and an edge direction histogram and an edge density distribution map are generated; specifically, by performing Hough transform on the edge image, edge direction features are extracted and edge density is calculated.

[0061] For example, in the edge direction histogram, the number of edges in different directions is: 50 in the horizontal direction, 30 in the vertical direction, 20 in the oblique direction, and 100 in total; in the edge density distribution map, the edge density is 0.5.

[0062] Step S123: The average brightness, contrast characteristic parameters, clarity parameters and texture complexity parameters are fused to construct an image quality feature vector.

[0063] The image quality feature vector is obtained by standardizing the above-extracted parameters and then weighted fusion; specifically, the average brightness, contrast feature parameters, clarity parameters and texture complexity parameters are respectively assigned appropriate weights for calculation.

[0064] For example, the average brightness is assigned a weight of 0.25, the contrast feature parameter is assigned a weight of 0.25, the clarity parameter is assigned a weight of 0.25, and the texture complexity parameter is assigned a weight of 0.25. The constructed image quality feature vector is [45, 15, 12.5, 7.5].

[0065] Step S124: Evaluate the image quality feature vector using a preset image quality evaluation model, and calculate an image quality evaluation index based on the evaluation result.

[0066] The image quality feature vector is comprehensively scored through the image quality evaluation model, and the image quality evaluation index is calculated; specifically, a model based on support vector machine (SVM) is used to classify and evaluate the feature vector and output a comprehensive score.

[0067] For example, after evaluation by the SVM model, the comprehensive score of the image quality feature vector is 85, and the image quality evaluation index is 85.

[0068] In step S2, the specific steps are: Step S21, input the image brightness parameter and contrast parameter into a preset exposure and light source control model, and in the exposure and light source control model, use a feedforward neural network algorithm to perform weight analysis on the image brightness parameter and contrast parameter to obtain a brightness sensitivity weight and a contrast sensitivity weight.

[0069] By using a feedforward neural network (FFNN) to perform weight analysis on image brightness parameters and contrast parameters, the sensitivity weight of each parameter is calculated; specifically, the image brightness parameters and contrast parameters are used as input, and training and weight calculation are performed through a multilayer perceptron model.

[0070] For example, the trained FFNN model outputs a brightness sensitivity weight of 0.7 and a contrast sensitivity weight of 0.3.

[0071] Step S22: Calculate the light source adjustment factor and the camera exposure adjustment factor according to the brightness sensitivity weight and the contrast sensitivity weight, analyze the light source adjustment factor, obtain the light source output intensity adjustment parameter and the irradiation time adjustment parameter, and generate a preliminary light source adjustment instruction based on the light source output intensity adjustment parameter and the irradiation time adjustment parameter.

[0072] By applying the brightness sensitivity weight and the contrast sensitivity weight to the calculation of the light source adjustment factor, the specific adjustment parameters are analyzed and obtained; specifically, the output intensity and the irradiation time of the light source are adjusted according to the sensitivity weight to generate a light source adjustment instruction.

[0073] For example, according to the brightness sensitivity weight of 0.7 and the contrast sensitivity weight of 0.3, the calculated light source output intensity adjustment parameter is 1500 lumens, and the irradiation time adjustment parameter is 70 milliseconds.

[0074] Step S23: parse the camera exposure adjustment factor to obtain exposure time adjustment parameters and gain adjustment parameters, and generate a preliminary camera exposure adjustment instruction based on the exposure time adjustment parameters and gain adjustment parameters.

[0075] By analyzing the camera exposure adjustment factor, the specific adjustment parameters of the camera are obtained; specifically, the exposure time adjustment factor and the gain adjustment factor are analyzed to generate a camera exposure adjustment instruction.

[0076] For example, the camera exposure time adjustment parameter obtained through analysis is 80 milliseconds, and the gain adjustment parameter is 300, and a camera exposure adjustment instruction is generated.

[0077] Step S24: coordinate and analyze the preliminary light source adjustment instruction and the preliminary camera exposure adjustment instruction to obtain adjustment coordination parameters and optimization factors.

[0078] The adjustment coordination parameters and optimization factors are calculated by coordinating and analyzing the preliminary adjustment instructions of the light source and the camera. Specifically, a multi-objective optimization algorithm is used to perform coordination analysis to obtain the optimal adjustment plan.

[0079] For example, through the multi-objective optimization algorithm, the adjustment coordination parameter obtained is 0.85 and the optimization factor is 1.2.

[0080] Step S25: Optimize the preliminary light source adjustment instruction and the preliminary camera exposure adjustment instruction by using the adjustment coordination parameters and the optimization factor, and output the light source adjustment instruction and the camera exposure adjustment instruction.

[0081] By applying the adjustment coordination parameters and the optimization factors, the preliminary adjustment instructions are optimized for a second time to obtain the final adjustment instructions; specifically, the adjustment coordination parameters and the optimization factors are substituted into the adjustment model to generate the optimal light source and camera adjustment instructions.

[0082] For example, after applying the adjustment coordination parameter of 0.85 and the optimization factor of 1.2, the generated light source adjustment instructions are 1700 lumens and 75 milliseconds, and the generated camera exposure adjustment instructions are 90 milliseconds and 320 gains.

[0083] In step S3, the specific steps are: Step S31, input the light source adjustment instruction into the preset light source instruction parsing module to obtain the intensity adjustment value and the irradiation time adjustment value, adjust the driving current of the light source according to the intensity adjustment value to obtain a new output intensity parameter, and adjust the pulse width of the light source according to the irradiation time adjustment value to obtain a new irradiation time parameter.

[0084] The light source adjustment instruction is parsed by the light source instruction parsing module to obtain specific intensity adjustment values ​​and irradiation time adjustment values, and the driving current and pulse width of the light source are adjusted accordingly; specifically, the light source instruction parsing module converts the adjustment instruction into the variation of the driving current and pulse width to achieve precise control of the light source.

[0085] For example, the intensity adjustment value obtained by analysis is 1.5 A, the irradiation time adjustment value is 75 microseconds, the light source driving current is adjusted to 1.5 A, and the pulse width is adjusted to 75 microseconds, thereby obtaining new output intensity parameters and irradiation time parameters.

[0086] Step S32: Combine the new output intensity parameter and the new irradiation time parameter to obtain adjusted light source parameters.

[0087] By combining the new output intensity parameter and the irradiation time parameter, a new light source parameter configuration is formed for the next step of image acquisition; specifically, the combined light source parameters can better adapt to environmental changes and provide stable light source output.

[0088] For example, the new output intensity parameter is 1.5A, and the irradiation time parameter is 75 microseconds. The combined light source parameters can effectively improve image brightness and contrast.

[0089] Step S33, input the camera exposure adjustment instruction into a preset exposure instruction parsing module to obtain an exposure time adjustment value and a gain adjustment value, adjust the exposure setting of the area array camera according to the exposure time adjustment value to obtain a new exposure time parameter, and adjust the gain setting of the area array camera according to the gain adjustment value to obtain a new gain parameter.

[0090] The camera exposure adjustment instruction is parsed by the exposure instruction parsing module to obtain specific exposure time adjustment values ​​and gain adjustment values, and the exposure time and gain of the area array camera are adjusted accordingly; specifically, the exposure instruction parsing module converts the adjustment instruction into a change in the camera setting to achieve precise control of the camera exposure parameters.

[0091] For example, the exposure time adjustment value obtained by analysis is 80 milliseconds, and the gain adjustment value is 320. The camera exposure time is adjusted to 80 milliseconds, and the gain is adjusted to 320, thereby obtaining new exposure time parameters and gain parameters.

[0092] Step S34: Combine the new exposure time parameter and the new gain parameter to obtain an adjusted camera exposure parameter.

[0093] By combining the new exposure time parameter and the gain parameter, a new camera exposure parameter configuration is formed for the next step of image acquisition; specifically, the combined camera exposure parameters can better adapt to the shooting requirements under different lighting conditions and provide stable image quality.

[0094] For example, the new exposure time parameter is 80 milliseconds, and the new gain parameter is 320. The combined camera exposure parameters can effectively improve the brightness and clarity of the image.

[0095] In step S4, the specific steps are: Step S41, perform dimensionality reduction processing on the adjusted light source parameters and the adjusted camera exposure parameters through the principal component analysis algorithm to obtain a light source principal component parameter set and a camera exposure principal component parameter set, and use a data fusion method to fuse the light source principal component parameter set and the camera exposure principal component parameter set to obtain parameter set data.

[0096] By applying the principal component analysis (PCA) algorithm, the adjusted light source parameters and camera exposure parameters are reduced in dimension to extract the main component parameters, reduce the data dimension, and improve the calculation efficiency. Specifically, the main components of the light source and camera parameters are extracted through PCA to perform data fusion.

[0097] For example, after PCA processing, the light source principal component parameter set includes two main parameters: brightness and irradiation time, and the camera exposure principal component parameter set includes two main parameters: exposure time and gain. The fused parameter set data is [brightness, irradiation time, exposure time, gain].

[0098] Step S42: Analyze the parameter set data using a multivariate correlation analysis method to obtain a correlation coefficient matrix between the parameters.

[0099] The fused parameter set data is analyzed in detail by multivariate correlation analysis, the correlation between the parameters is calculated, and the correlation coefficient matrix is ​​obtained; specifically, the correlation coefficient matrix is ​​generated by analyzing the linear relationship between the parameters.

[0100] For example, the correlation coefficient matrix shows that the correlation coefficient between brightness and exposure time is 0.85, and the correlation coefficient between exposure time and gain is 0.7, indicating that there is a significant linear relationship between these parameters.

[0101] Step S43, decomposing the correlation coefficient matrix based on factor analysis to obtain common factors, unique factors and error terms, performing cluster analysis on the common factors to obtain a first factor subset and a second factor subset, linearly combining the first factor subset with the unique factors to obtain a first combination factor, linearly combining the second factor subset with the error term to obtain a second combination factor, and identifying strongly correlated parameter pairs between light source parameters and camera exposure parameters based on the first combination factor and the second combination factor.

[0102] Through the factor analysis method, the correlation coefficient matrix is ​​decomposed to extract common factors and unique factors. The relationship between these factors and error terms is analyzed and cluster analysis is performed. Specifically, the factors are linearly combined to identify the strong correlation pairs between light source and camera exposure parameters.

[0103] For example, the common factors analyzed include brightness and exposure time, the unique factors include illumination time and gain, the error term is mainly composed of noise, and the strongly correlated parameter pairs identified through cluster analysis are brightness-exposure time and illumination time-gain.

[0104] Step S44, perform regression analysis on strongly correlated parameter pairs through a multivariate linear regression algorithm to obtain regression coefficients and regression constants, establish a parameter association model based on the regression coefficients and regression constants, and in the parameter association model, calculate the degree of influence of light source parameters and camera exposure parameters on image quality based on the regression algorithm, and output the influence ranking.

[0105] By applying the multivariate linear regression algorithm, regression analysis is performed on the identified strongly correlated parameter pairs, the regression coefficients and regression constants are calculated, and a parameter association model is established to evaluate the influence of each parameter on the image quality. Specifically, through regression analysis, the influence of each parameter on the image quality is quantified and an influence ranking is generated.

[0106] For example, the regression analysis results show that the influence coefficient of brightness on image quality is 0.6, the influence coefficient of exposure time is 0.4, the influence coefficient of irradiation time is 0.3, and the influence coefficient of gain is 0.2. The influence degree is ranked as brightness>exposure time>irradiation time>gain.

[0107] Step S45: Apply a weight analysis method to select key parameters based on the influence ranking, and generate light source balance conditions and camera exposure balance conditions.

[0108] By performing weight analysis on the impact ranking results, the key parameters that have the most significant impact on image quality are selected to generate light source balance conditions and camera exposure balance conditions; specifically, high weights are given to key parameters to generate optimized light source and balance conditions.

[0109] For example, by selecting brightness and exposure time as key parameters, the generated light source balance condition is 1500 lumens and 75 microseconds, and the generated camera exposure balance condition is 90 milliseconds and 320 gain.

[0110] In step S5, the specific steps are: Step S51: inputting the light source balance condition and the camera exposure balance condition into a preset control module to replace the initial conditions, thereby obtaining an updated light source parameter configuration and an updated area array camera parameter configuration.

[0111] The generated light source balance condition and camera exposure balance condition are input into the control module to replace the initial conditions and update the parameter configuration of the light source and the camera. Specifically, the control module adjusts the configuration of the light source and the camera according to the balance conditions to ensure stable image quality.

[0112] For example, the updated light source parameter configuration is 1500 lumens and 75 microseconds, and the updated area array camera parameter configuration is 90 milliseconds and 320 gain.

[0113] Step S52: After controlling the light source based on the updated light source parameter configuration and the area array camera based on the updated area array camera parameter configuration, the initial image is captured again.

[0114] The light source and the camera are controlled through the updated parameter configuration, and the initial image is recaptured to ensure that the new parameter configuration can effectively improve the image quality; specifically, based on the new configuration, images are captured to verify the validity of the balance condition.

[0115] For example, an image captured again using the updated configuration with a brightness parameter of 200 and a contrast parameter of 150 shows a significant improvement in image quality.

[0116] Step S53: performing image analysis on the recaptured initial image by using an image processing algorithm to obtain an adjusted image brightness parameter and an adjusted contrast parameter.

[0117] By applying an image processing algorithm, the new initial image is analyzed to extract adjusted image brightness parameters and contrast parameters; specifically, the quality of the new image is evaluated through brightness analysis and contrast analysis.

[0118] For example, the adjusted image brightness parameter is 200 and the contrast parameter is 150, indicating that the new parameter configuration significantly improves the image brightness and contrast.

[0119] In this embodiment, the initial image is preprocessed, and the mean filter and Gaussian filter are used to remove noise and enhance image details to obtain grayscale distribution data and edge feature data. These data are processed by weighted fusion to generate image quality evaluation indicators, and then the image brightness information and contrast information are extracted to generate a brightness histogram and a contrast curve. By performing statistical analysis on the brightness histogram and the contrast curve, the image brightness parameters and contrast parameters are obtained, and the linkage control of the light source and the area array camera exposure is realized. The image brightness parameters and contrast parameters are dynamically adjusted under various lighting conditions, which greatly improves the quality and stability of the image and solves the problem of unstable image effects caused by changes in the lighting environment in the prior art.

[0120] Embodiment 3: like Figure 2 As shown, the present application also provides an area array camera exposure and light source linkage control device 10, including an acquisition module 11, an input module 12, an adjustment module 13, an analysis module 14, a replacement module 15 and a circulation module 16.

[0121] The acquisition module 11 is mainly used to acquire an initial image captured by the area array camera based on light source illumination under initial conditions, perform image analysis on the initial image, and obtain image brightness parameters and contrast parameters; wherein the initial conditions include light source parameter configuration and area array camera parameter configuration.

[0122] The input module 12 is mainly used to input the image brightness parameter and contrast parameter into the preset exposure and light source control model to obtain the light source adjustment instruction and the camera exposure adjustment instruction.

[0123] The adjustment module 13 is mainly used to adjust the output intensity and irradiation time of the light source based on the light source adjustment instruction to obtain adjusted light source parameters, and to adjust the exposure time and gain of the area array camera based on the camera exposure adjustment instruction to obtain adjusted camera exposure parameters.

[0124] The analysis module 14 is mainly used to perform correlation analysis on the adjusted light source parameters and the adjusted camera exposure parameters, and generate light source balance conditions and camera exposure balance conditions based on the analysis results.

[0125] The replacement module 15 is mainly used to replace the initial conditions with the light source balance conditions and the camera exposure balance conditions, and then collect the initial image again and perform image analysis to obtain the adjusted image brightness parameters and the adjusted contrast parameters.

[0126] The loop module 16 is mainly used to loop the steps in the acquisition module 11, the input module 12, the adjustment module 13, the analysis module 14 and the replacement module 15 if the adjusted image brightness parameter and the adjusted contrast parameter do not meet the preset image quality requirements until the image brightness parameter and the contrast parameter meet the preset image quality requirements.

[0127] In this embodiment, the acquisition module 11 first acquires the initial image under the initial conditions, and performs image analysis to obtain image brightness parameters and contrast parameters; then, the input module 12 inputs these parameters into the preset exposure and light source control model to generate light source adjustment instructions and camera exposure adjustment instructions. The adjustment module 13 adjusts the output intensity and irradiation time of the light source, as well as the exposure time and gain of the array camera according to these instructions, to obtain the adjusted light source parameters and camera exposure parameters. Then, the analysis module 14 performs correlation analysis on the adjusted parameters to generate light source balance conditions and camera exposure balance conditions. The replacement module 15 replaces the initial conditions with these balance conditions, acquires and analyzes the image again, and obtains new image brightness parameters and contrast parameters. The loop module 16 ensures that when the adjusted parameters do not meet the preset requirements, the above process can be repeated until the image quality meets expectations. This integrated control device achieves a dynamic balance of image brightness and contrast by continuously optimizing the configuration of light source and camera parameters, effectively improves the stability and consistency of image quality, and overcomes the problem of unstable image effects caused by changes in the lighting environment in the prior art. By using this device, image acquisition parameters can be automatically adjusted under various complex lighting conditions to ensure that high-quality image output is always obtained.

[0128] It should be noted that, those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the above-described device and each module can refer to the corresponding process in the aforementioned embodiment of the area array camera exposure and light source linkage control method, and will not be repeated here.

[0129] As described above, the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features thereof may be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for controlling exposure and light source linkage of an area array camera, characterized in that: include: Step S1: obtaining an initial image captured by the area array camera based on light source illumination under initial conditions, performing image analysis on the initial image, and obtaining image brightness parameters and contrast parameters; wherein the initial conditions include light source parameter configuration and area array camera parameter configuration; Step S2: inputting the image brightness parameter and the contrast parameter into a preset exposure and light source control model to obtain a light source adjustment instruction and a camera exposure adjustment instruction; Step S3: Based on the light source adjustment instruction, the output intensity and irradiation time of the light source are adjusted to obtain adjusted light source parameters; based on the camera exposure adjustment instruction, the exposure time and gain of the area array camera are adjusted to obtain adjusted camera exposure parameters; Step S4: performing correlation analysis on the adjusted light source parameters and the adjusted camera exposure parameters, and generating a light source balance condition and a camera exposure balance condition based on the analysis result; Step S5: After replacing the initial condition with the light source balance condition and the camera exposure balance condition, the initial image is captured again, and image analysis is performed to obtain an adjusted image brightness parameter and an adjusted contrast parameter; Step S6: If the adjusted image brightness parameter and the adjusted contrast parameter do not meet the preset image quality requirement, loop steps S2 to S5 until the image brightness parameter and the contrast parameter meet the preset image quality requirement.

2. The method for controlling the linkage between exposure and light source of an area array camera according to claim 1, characterized in that: The specific steps of step S1 are: Step S11, collecting an initial image using a preset initial condition, preprocessing the initial image, and obtaining grayscale distribution data and edge feature data; Step S12, fusing the grayscale distribution data and the edge feature data to obtain an image quality evaluation index; Step S13, extracting image brightness information and contrast information based on the image quality evaluation index, generating a brightness histogram according to the image brightness information, and generating a contrast curve according to the contrast information; Step S14: Statistically analyze the brightness histogram and contrast curve to obtain image brightness parameters and contrast parameters.

3. The method for controlling the exposure and light source linkage of an area array camera according to claim 2, characterized in that: The specific steps of step S12 are: Step S121, performing Fourier transform on the grayscale distribution data to obtain grayscale spectrum characteristics and grayscale energy distribution, and extracting average brightness and contrast characteristic parameters of the image using the grayscale spectrum characteristics and the grayscale energy distribution; Step S122, performing directional statistical analysis on the edge feature data to obtain an edge direction histogram and an edge density distribution, and extracting a clarity parameter and a texture complexity parameter of the image using the edge direction histogram and the edge density distribution; Step S123, fusing the average brightness, contrast characteristic parameters, clarity parameters and texture complexity parameters to construct an image quality feature vector; Step S124: Evaluate the image quality feature vector using a preset image quality evaluation model, and calculate an image quality evaluation index based on the evaluation result.

4. The method for controlling the linkage between exposure and light source of an area array camera according to claim 1, characterized in that: The specific steps of step S2 are: Step S21, inputting the image brightness parameter and the contrast parameter into a preset exposure and light source control model, and in the exposure and light source control model, performing weight analysis on the image brightness parameter and the contrast parameter using a feedforward neural network algorithm to obtain a brightness sensitivity weight and a contrast sensitivity weight; Step S22: Calculate a light source adjustment factor and a camera exposure adjustment factor according to the brightness sensitivity weight and the contrast sensitivity weight, analyze the light source adjustment factor to obtain a light source output intensity adjustment parameter and an irradiation time adjustment parameter, and generate a preliminary light source adjustment instruction based on the light source output intensity adjustment parameter and the irradiation time adjustment parameter; Step S23, parsing the camera exposure adjustment factor to obtain an exposure time adjustment parameter and a gain adjustment parameter, and generating a camera preliminary exposure adjustment instruction based on the exposure time adjustment parameter and the gain adjustment parameter; Step S24, performing coordination analysis on the preliminary light source adjustment instruction and the preliminary camera exposure adjustment instruction to obtain adjustment coordination parameters and optimization factors; Step S25: Utilizing the adjustment coordination parameters and the optimization factor, the preliminary light source adjustment instruction and the preliminary camera exposure adjustment instruction are optimized, and the light source adjustment instruction and the camera exposure adjustment instruction are output.

5. The method for controlling the linkage between exposure and light source of an area array camera according to claim 1, characterized in that: The specific steps of step S3 are: Step S31, inputting the light source adjustment instruction into a preset light source instruction parsing module to obtain an intensity adjustment value and an irradiation time adjustment value, adjusting the driving current of the light source according to the intensity adjustment value to obtain a new output intensity parameter, and adjusting the pulse width of the light source according to the irradiation time adjustment value to obtain a new irradiation time parameter; Step S32, combining the new output intensity parameter and the new irradiation time parameter to obtain an adjusted light source parameter; Step S33, inputting the camera exposure adjustment instruction into a preset exposure instruction parsing module to obtain an exposure time adjustment value and a gain adjustment value, adjusting the exposure setting of the area array camera according to the exposure time adjustment value to obtain a new exposure time parameter, and adjusting the gain setting of the area array camera according to the gain adjustment value to obtain a new gain parameter; Step S34: Combine the new exposure time parameter and the new gain parameter to obtain an adjusted camera exposure parameter.

6. The method for controlling the linkage between exposure and light source of an area array camera according to claim 1, characterized in that: The specific steps of step S4 are: Step S41, performing dimensionality reduction processing on the adjusted light source parameters and the adjusted camera exposure parameters by using a principal component analysis algorithm to obtain a light source principal component parameter set and a camera exposure principal component parameter set, and performing a fusion operation on the light source principal component parameter set and the camera exposure principal component parameter set by using a data fusion method to obtain parameter set data; Step S42: Analyze the parameter set data using a multivariate correlation analysis method to obtain a correlation coefficient matrix between parameters; Step S43, decomposing the correlation coefficient matrix based on factor analysis to obtain common factors, unique factors and error terms, performing cluster analysis on the common factors to obtain a first factor subset and a second factor subset, linearly combining the first factor subset with the unique factors to obtain a first combination factor, linearly combining the second factor subset with the error term to obtain a second combination factor, and identifying a strongly correlated parameter pair between a light source parameter and a camera exposure parameter based on the first combination factor and the second combination factor; Step S44: performing regression analysis on the strongly correlated parameter pairs by a multiple linear regression algorithm to obtain regression coefficients and regression constants, establishing a parameter association model based on the regression coefficients and the regression constants, and in the parameter association model, calculating the influence of the light source parameters and the camera exposure parameters on the image quality based on the regression algorithm, and outputting the influence ranking; Step S45: Apply a weight analysis method to select key parameters based on the influence ranking, and generate light source balance conditions and camera exposure balance conditions.

7. The method for controlling the linkage between exposure and light source of an area array camera according to claim 1, characterized in that: The specific steps of step S5 are: Step S51, inputting the light source balance condition and the camera exposure balance condition into a preset control module to replace the initial conditions, so as to obtain an updated light source parameter configuration and an updated area array camera parameter configuration; Step S52, after controlling the light source based on the updated light source parameter configuration and the area array camera based on the updated area array camera parameter configuration, the initial image is captured again; Step S53: performing image analysis on the recaptured initial image by using an image processing algorithm to obtain an adjusted image brightness parameter and an adjusted contrast parameter.

8. A device for controlling exposure and light source linkage of an area array camera, characterized in that: include: An acquisition module is used to acquire an initial image captured by the area array camera based on light source illumination under initial conditions, and perform image analysis on the initial image to obtain image brightness parameters and contrast parameters; wherein the initial conditions include light source parameter configuration and area array camera parameter configuration; An input module, used for inputting the image brightness parameter and the contrast parameter into a preset exposure and light source control model to obtain a light source adjustment instruction and a camera exposure adjustment instruction; An adjustment module, configured to adjust the output intensity and irradiation time of the light source based on the light source adjustment instruction to obtain adjusted light source parameters, and to adjust the exposure time and gain of the area array camera based on the camera exposure adjustment instruction to obtain adjusted camera exposure parameters; An analysis module, configured to perform correlation analysis on the adjusted light source parameters and the adjusted camera exposure parameters, and generate a light source balance condition and a camera exposure balance condition based on the analysis result; A replacement module, configured to replace the initial condition with the light source balance condition and the camera exposure balance condition, collect the initial image again, and perform image analysis to obtain an adjusted image brightness parameter and an adjusted contrast parameter; A loop module is used to loop the steps in the acquisition module, input module, adjustment module, analysis module and replacement module if the adjusted image brightness parameter and the adjusted contrast parameter do not meet the preset image quality requirements until the image brightness parameter and the contrast parameter meet the preset image quality requirements.

Images