Control method and system of multispectral infrared focal plane heterogeneous integrated system

Abstract

The invention discloses a control method of a multispectral infrared focal plane heterogeneous integrated system and the multispectral infrared focal plane heterogeneous integrated system. The control method of the multispectral infrared focal plane heterogeneous integrated system comprises the following steps: selecting a target working mode from different working modes of the multispectral infrared focal plane heterogeneous integrated system; and controlling one corresponding infrared light detection unit to work according to the target working mode, so that the multispectral infrared focal plane heterogeneous integrated system works in the target working mode. Because a plurality of infrared light detection units are designed separately, infrared light detectors corresponding to different spectrums can be designed separately. When the multispectral infrared focal plane heterogeneous integrated system is in different working modes, only one infrared light detection unit needs to be switched to work, the spectrum overlapping phenomenon (crosstalk phenomenon) existing among a plurality of spectrum bands is reduced, the detection sensitivity of infrared detector chip imaging is improved, and the detection cost is reduced. And the imaging resolution of the multispectral infrared focal plane heterogeneous integrated system is ensured.

Description

Technical Field

[0001] This invention relates to the field of multispectral infrared imaging technology, and more specifically, to a control method for a multispectral infrared focal plane heterogeneous integrated system and the multispectral infrared focal plane heterogeneous integrated system. Background Technology

[0002] Since its discovery, infrared light has been gradually applied to various industries and sectors, including industry, agriculture, medicine, and transportation. Multispectral imaging (MSI) refers to the simultaneous imaging of electromagnetic waves reflected or radiated from a target scene into multiple specific wavelength ranges (bands) using spectral splitting technology. Each band corresponds to a grayscale image, and the images are combined to form a set of images containing rich spectral information. Multispectral images have high spatial resolution and are widely used in remote sensing, environmental monitoring, agriculture, geological exploration, and other fields.

[0003] In practical applications, if there is spectral overlap between multiple spectral bands, it will reduce the detection sensitivity of infrared detector chip imaging. Summary of the Invention

[0004] The present invention provides a control method and a multispectral infrared focal plane heterogeneous integrated system, which reduces the spectral overlap (crosstalk) phenomenon between multiple spectral bands, improves the detection sensitivity of infrared detector chip imaging, and ensures the imaging resolution of the multispectral infrared focal plane heterogeneous integrated system.

[0005] The control method for a multispectral infrared focal plane heterogeneous integrated system provided in this invention includes:

[0006] Select the target operating mode from the different operating modes of the multispectral infrared focal plane heterogeneous integrated system;

[0007] The infrared light detection unit is controlled to operate according to the target operating mode, so that the multispectral infrared focal plane heterogeneous integrated system operates in the target operating mode.

[0008] In some embodiments, selecting the target operating mode from different operating modes of the multispectral infrared focal plane heterogeneous integrated system includes:

[0009] Obtain the infrared light prediction data at the current moment;

[0010] Based on the infrared light prediction data at the current moment, a target operating mode is selected from the different operating modes of the multispectral infrared focal plane heterogeneous integrated system.

[0011] In some embodiments, the infrared light prediction data corresponding to different time periods in a day are different, and the infrared light prediction data of the current time comprises:

[0012] The infrared light prediction data of the current time is determined according to the time period in a day of the current time.

[0013] In some embodiments, the infrared light prediction data of the current time comprises:

[0014] The infrared light prediction data of the current time is determined according to the date of the day, the time period in a day of the current time, and a target prediction model, the target prediction model being obtained by training based on historical infrared light detection data, the historical infrared light detection data comprising infrared light data detected on different dates in history and infrared light data detected in different time periods in each date.

[0015] In some embodiments, the step of training the target prediction model comprises:

[0016] The infrared light data detected on different dates in history is taken as a first training sample to train a first prediction model in the target prediction model.

[0017] The infrared light data detected in different time periods in each date is taken as a second training sample to train a second prediction model in the target prediction model.

[0018] In some embodiments, the controlling the corresponding one of the infrared light detection units according to the target working mode to make the multi-spectral infrared focal plane heterojunction integrated system work in the target working mode comprises:

[0019] Determining target working parameters from a plurality of working parameters according to the target working mode, wherein each set of the working parameters is used to compensate for imaging characteristic differences caused by different infrared light wave bands corresponding to the infrared light detection units;

[0020] Controlling the corresponding one of the infrared light detection units according to the target working parameters to make the multi-spectral infrared focal plane heterojunction integrated system work in the target working mode.

[0021] In some embodiments, the controlling the corresponding one of the infrared light detection units according to the target working mode to make the multi-spectral infrared focal plane heterojunction integrated system work in the target working mode comprises:

[0022] Determining target working parameters from a plurality of working parameters according to the target working mode, wherein each set of the working parameters is used to compensate for imaging characteristic differences caused by different positions of the infrared light detection units;

[0023] According to the target working parameter, the corresponding one of the infrared light detection units is controlled to work, so that the multi-spectrum infrared focal plane hetero-junction integrated system works in the target working mode.

[0024] In some embodiments, the different infrared light detection units correspond to different field angles of view, and the controlling of the corresponding one of the infrared light detection units according to the target working mode to work, so that the multi-spectrum infrared focal plane hetero-junction integrated system works in the target working mode, includes:

[0025] The target working parameter is determined from a plurality of working parameters according to the target working mode, wherein each set of the working parameters is used to compensate for the imaging characteristic difference caused by the different field angles of view of the infrared light detection units;

[0026] According to the target working parameter, the corresponding one of the infrared light detection units is controlled to work, so that the multi-spectrum infrared focal plane hetero-junction integrated system works in the target working mode.

[0027] In some embodiments, each set of the working parameters includes at least one of a sampling timing parameter, a bias current parameter, a correction parameter, and a display parameter.

[0028] The multi-spectrum infrared focal plane hetero-junction integrated system provided by the embodiments of the present application can be configured to work in different working modes, and the multi-spectrum infrared focal plane hetero-junction integrated system includes:

[0029] A plurality of separately designed infrared light detection units, different infrared light detection units correspond to different infrared light wave bands;

[0030] A controller configured to select a target working mode from different working modes of the multi-spectrum infrared focal plane hetero-junction integrated system, and control the corresponding one of the infrared light detection units according to the target working mode to work, so that the multi-spectrum infrared focal plane hetero-junction integrated system works in the target working mode.

[0031] In the multispectral infrared focal plane heterojunction integration system provided by the embodiments of the present application, the multispectral infrared focal plane heterojunction integration system has a plurality of infrared light detection units, each infrared light detection unit corresponds to one working mode (for example, daytime imaging or night imaging) of the multispectral infrared focal plane heterojunction integration system, and the chip can automatically realize switching of different working modes and switching of different infrared light detection units. Each working mode controls one infrared light detection unit. It can be understood that, due to the separate design of the plurality of infrared light detection units, the infrared light detectors corresponding to different spectrums can be designed separately. In different working modes, the multispectral infrared focal plane heterojunction integration system only needs to switch one infrared light detection unit to work, reduces the spectral overlap phenomenon (cross-talk phenomenon) between a plurality of spectral bands, improves the detection sensitivity of the infrared detector chip imaging, and also ensures the imaging resolution of the multispectral infrared focal plane heterojunction integration system.

[0032] Additional aspects and advantages of the present application will be in part apparent and in part pointed out hereinafter. BRIEF DESCRIPTION OF DRAWINGS

[0033] The above and / or additional aspects and advantages of the present application will become apparent and be readily appreciated from the following description, including the appended drawings.

[0034] Figure 1 is a flowchart of a control method of the multispectral infrared focal plane heterojunction integration system provided by some embodiments of the present application;

[0035] Figure 2 is a structural schematic diagram of the multispectral infrared focal plane heterojunction integration system provided by some embodiments of the present application;

[0036] Figure 3 is a functional architecture schematic diagram of the multispectral infrared focal plane heterojunction integration system provided by some embodiments of the present application;

[0037] Figure 4 is a training flowchart of the target prediction model provided by some embodiments of the present application;

[0038] Figure 5 is a functional architecture schematic diagram of the multispectral infrared focal plane heterojunction integration system provided by some embodiments of the present application. DETAILED DESCRIPTION

[0039] Embodiments of the present invention are described in detail below. Examples of these embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are optional and are only used to explain the embodiments of the present invention, and should not be construed as limiting the embodiments of the present invention.

[0040] Since its discovery, infrared light has been gradually applied to various industries and sectors, including industry, agriculture, medicine, and transportation. Multispectral imaging (MSI) refers to the simultaneous imaging of electromagnetic waves reflected or radiated from a target scene into multiple specific wavelength ranges (bands) using spectral splitting technology. Each band corresponds to a grayscale image, and the images are combined to form a set of images containing rich spectral information. Multispectral images have high spatial resolution and are widely used in remote sensing, environmental monitoring, agriculture, geological exploration, and other fields.

[0041] In practical applications, if there is spectral overlap between multiple spectral bands, it will reduce the detection sensitivity of infrared detector chip imaging.

[0042] To address the aforementioned technical problems, this invention provides a control method and a multispectral infrared focal plane heterogeneous integrated system, which reduces spectral overlap (crosstalk) between multiple spectral bands, improves the detection sensitivity of infrared detector chip imaging, and ensures the imaging resolution of the multispectral infrared focal plane heterogeneous integrated system.

[0043] In the multispectral infrared focal plane heterogeneous integrated system provided in this embodiment of the invention, the multispectral infrared focal plane heterogeneous integrated system has multiple infrared light detection units. Each infrared light detection unit corresponds to a working mode of the multispectral infrared focal plane heterogeneous integrated system (e.g., daytime imaging or nighttime imaging). The chip can automatically switch between different working modes, switching the multiple infrared light detection units to work. Each working mode control corresponds to one infrared light detection unit.

[0044] Understandably, the separate design of multiple infrared light detection units allows for the separate design of infrared light detectors corresponding to different spectra. In different operating modes, the multispectral infrared focal plane heterogeneous integrated system only needs to switch one infrared light detection unit, reducing spectral overlap (crosstalk) between multiple spectral bands, improving the detection sensitivity of the infrared detector chip, and ensuring the imaging resolution of the multispectral infrared focal plane heterogeneous integrated system.

[0045] Reference Figure 1 The control method for a multispectral infrared focal plane heterogeneous integrated system provided in this invention includes:

[0046] Step 01: Select the target operating mode from the different operating modes of the multispectral infrared focal plane heterogeneous integrated system;

[0047] Step 02: Control one infrared light detection unit to work according to the target working mode, so that the multispectral infrared focal plane heterogeneous integrated system works in the target working mode.

[0048] The control method for the multispectral infrared focal plane heterogeneous integrated system provided in the embodiments of the present invention can be used in the multispectral infrared focal plane heterogeneous integrated system provided in the embodiments of the present invention.

[0049] Reference Figure 2 The multispectral infrared focal plane heterogeneous integrated system 100 provided in this embodiment of the invention may include multiple separately designed infrared light detection units 110 and a controller 120. Different infrared light detection units 110 correspond to different infrared light bands. The controller 120 is configured to select a target operating mode from different operating modes of the multispectral infrared focal plane heterogeneous integrated system, and control one corresponding infrared light detection unit 110 to operate according to the target operating mode, so that the multispectral infrared focal plane heterogeneous integrated system 100 operates in the target operating mode.

[0050] In some embodiments, the controller 120 includes a memory and a processor, the memory being configured to store a computer program, and the processor, when executing the computer program, implementing the control method provided in the embodiments of the present invention.

[0051] The control method provided in this embodiment of the invention can be implemented by the controller 120, that is, the controller 120 is used to implement the control method. Of course, in other embodiments, the control method can also be implemented by other devices or equipment, and is not limited to being implemented by the controller 120. The controller 120 may not be exclusively used to implement the control method of this embodiment of the invention, but may implement other functions or methods.

[0052] Specifically, the multispectral infrared focal plane heterogeneous integrated system can select the target working mode from different predetermined working modes according to the actual working conditions, and control the corresponding infrared light detection unit 110 to work according to the target working mode.

[0053] In some embodiments, the multispectral infrared focal plane array heterogeneous integrated system can select and switch different operating modes and control the operation of different detection units based on external control commands. The external control commands can originate from the external controller 120 or be manually triggered.

[0054] In some embodiments, the multispectral infrared focal plane array heterogeneous integrated system can also select and switch between different control methods for different detection units based on its own operating conditions. External control commands can originate from the external controller 120 or be manually triggered.

[0055] It should be noted that the multispectral infrared focal plane heterogeneous integrated system can switch between any operating mode. Each operating mode controls a corresponding infrared light detection unit 110. Therefore, each time the operating mode is switched, only one infrared light detection unit 110 needs to be switched to work, which reduces the spectral overlap phenomenon (crosstalk phenomenon) between multiple spectral bands, improves the detection sensitivity of the infrared detector chip imaging, and also ensures the imaging resolution of the multispectral infrared focal plane heterogeneous integrated system 100.

[0056] In some implementations, a target operating mode is selected from different operating modes of the multispectral infrared focal plane heterogeneous integrated system, including:

[0057] Obtain the infrared light prediction data at the current moment;

[0058] Based on the infrared light prediction data at the current moment, the target operating mode is selected from the different operating modes of the multispectral infrared focal plane heterogeneous integrated system.

[0059] Specifically, refer to Figure 3 The multispectral infrared focal plane heterogeneous integrated system can select a specific target operating mode based on the infrared light prediction data at the current moment. For example, by accurately collecting target radiation data (spectrum / intensity), environmental parameters (atmosphere / temperature), and background noise, the detector band, sensitivity, and processing algorithm can be set to achieve strong environmental adaptability, high target recognition rate, and all-time monitoring for the multispectral infrared focal plane heterogeneous integrated system 100.

[0060] In some implementations, the infrared light prediction data differs for different times of day. Obtaining the infrared light prediction data for the current moment includes:

[0061] Determine the infrared light prediction data for the current time based on the time of day in which the current time is located.

[0062] Specifically, the characteristics of infrared light differ significantly at different times of the day.

[0063] During the day, infrared light is primarily characterized by reflected radiation. While the solar radiation peak is located in the visible light band (approximately 500 nm), 45% of the energy is distributed in the short-wave infrared (SWIR). Therefore, the infrared light detection unit 110 can be equipped with a SWIR quantum dot detector (response band 1–1.7 μm) during the day, utilizing the reflected radiation of sunlight for imaging. The imaging principle is similar to that of a visible light camera, resulting in high spatial resolution.

[0064] At night, infrared light is primarily characterized by thermal radiation, and in the absence of sunlight, long-wave infrared (LWIR) becomes the dominant signal source. Therefore, the infrared light detection unit 110 can be equipped with an LWIR microbolometer (response band 8-14μm) to directly receive the thermal radiation of the object itself, without the need for an external light source. It has high sensitivity and can penetrate darkness and dense fog.

[0065] The multispectral infrared focal plane heterogeneous integrated system 100 can determine whether the current time is daytime or nighttime based on the acquired time, and freely switch the operation of the corresponding infrared light detection unit 110.

[0066] In some embodiments, multiple separately designed infrared light detection units 110 may include a short-wave infrared (SWIR) quantum dot detector and a long-wave infrared (LWIR) microbolometer. The SWIR quantum dot detector and the LWIR microbolometer are stacked using 3D integration technology, with the top SWIR layer used for daytime imaging and the bottom LWIR layer used for nighttime thermal imaging. Different operating modes of the multispectral infrared focal plane heterogeneous integrated system may include a daytime mode and a nighttime mode. If the current time is determined to be daytime, the daytime mode is selected as the target operating mode, and the corresponding SWIR quantum dot detector is controlled to operate. If the current time is determined to be nighttime, the nighttime mode is selected as the target operating mode, and the corresponding LWIR microbolometer is controlled to operate.

[0067] In some embodiments, the operating modes of the multispectral infrared focal plane heterogeneous integrated system may also include dusk and dawn operating modes. When the current time is determined to be dusk or dawn, a hybrid mode is selected as the target operating mode. This allows for time-division control of the short-wave infrared (SWIR) quantum dot detector and long-wave infrared (LWIR) microbolometer, with multispectral infrared light fusion achieved based on the controller 120. It should be noted that in the hybrid mode, controlling one corresponding infrared light detection unit 110 to operate simultaneously reduces spectral overlap (crosstalk) between multiple spectral bands, improves the detection sensitivity of the infrared detector chip, and ensures the imaging resolution of the multispectral infrared focal plane heterogeneous integrated system 100.

[0068] In some implementations, acquiring infrared light prediction data at the current moment includes:

[0069] Based on the date, the time of day, and the target prediction model, the infrared light prediction data for the current moment is determined. The target prediction model is trained based on historical infrared light detection data, which includes infrared light data detected on different dates in history and infrared light data detected at different times within each date.

[0070] Specifically, the distinction between day and night may vary depending on the date. For example, in winter, the night may be longer than the day. In summer, the day may be longer than the night.

[0071] The target prediction model is trained based on historical infrared light detection data, which includes infrared light data detected on different dates throughout history, as well as infrared light data detected at different times within each date. The target prediction model can determine the daytime and nighttime periods based on the current date, and then switch between daytime and nighttime modes for target operation based on the current time.

[0072] For example, if the date is A1 month B1, the target prediction model determines that A1 month B1, time period T1 is the daytime period, and time period T2 is the nighttime period. If the current time is in time period T1, the daytime mode is set to the target working mode; if the current time is in time period T2, the nighttime mode is set to the target working mode.

[0073] Reference Figure 4 In some implementations, the step of training the target prediction model includes:

[0074] Infrared light data detected on different dates in history are used as the first training samples to train the first prediction model in the target prediction model;

[0075] Infrared light data detected at different times during each date are used as the second training samples to train the second prediction model in the target prediction model.

[0076] Specifically, the changes in infrared wavelength detected on different dates throughout history can be used as the first training sample. The first prediction model trained can preliminarily predict the impact of different dates on infrared wavelength. For example, it can predict the turning point of infrared wavelength change on different dates, so as to distinguish between day and night on different dates.

[0077] The infrared wavelengths detected at different times on each date in history can be used as the second training sample. The trained second prediction model can accurately predict the impact of different times on the infrared wavelength on each date, and thus accurately predict the infrared wavelength at the current time on the current date.

[0078] In some embodiments, both the first and second prediction models in the target prediction model can be time series models.

[0079] Time series models are statistical or machine learning methods used to analyze and predict data points arranged chronologically. Their core objective is to identify trends, periodicity, and correlations from historical data to infer future changes. They support forecasting, anomaly detection, and decision optimization by capturing time dependencies (such as seasonal fluctuations and long-term trends) and potential influencing factors (such as external variables). Time series models can include: Autoregressive (AR) models, Moving Average (MA) models, and ARIMA (Differential Integration) models.

[0080] Time series models are mathematical models established based on observed time series data through curve fitting and parameter estimation. They have a good ability to characterize the steady-state periodicity of historical series.

[0081] In some embodiments, data is collected using an uncooled infrared sensor (operating wavelength: 8-14 μm), recording the following dimensions: date tag (season / month), timestamp (accurate to the minute), infrared wavelength (peak wavelength or average wavelength), and ambient temperature (a key parameter affecting wavelength distribution), as historical infrared light data collected by the uncooled infrared sensor. The historical infrared light data is divided into a first training sample set D1 = {λd | d ∈ date set} and a second training sample set D2 = {λd, t | d ∈ date set, t ∈ time period set}.

[0082] In some embodiments, the acquired first training samples and second training samples can be preprocessed. The preprocessing steps include noise reduction filtering and normalization processing. Noise reduction filtering eliminates circuit noise through a lock-in amplifier, and normalization processing eliminates the dimensional differences between data features, mapping features with different value ranges to the same interval.

[0083] In some embodiments, the first prediction model is used for date-level inflection point prediction. Therefore, the training objective of the first prediction model is to predict day-night inflection points (such as sunrise / sunset) and seasonal wavelength change trends. The original training model of the first prediction model can be an LSTM (Long Short-Term Memory) time series model.

[0084] During the training of the first prediction model, the input features are historical date sequences X = [λd_30, λd_29, ..., λd], and the hidden layer state updates of the model are as follows:

[0085]

[0086] Where ft is the forget gate, it is the input gate, Ct is the cell state, ot is the output gate, ht is the hidden state, σ is the sigmoid function, ⊙ is the Hadamard product, W is the weight matrix, and b is the bias.

[0087] The output feature is the probability of the date turning point, Pd = softmax(Wy*ht + by). Based on the output feature, the weighted cross-entropy loss function of the first prediction model is determined as follows:

[0088]

[0089] Where yd represents the transition label of date d, and α represents the positive sample weight coefficient.

[0090] In some embodiments, the second prediction model is used for time-period wavelength prediction. Therefore, the training objective of the second prediction model is to predict the wavelength value at a precise time within the same day. The original training model for the second prediction model can be an ARIMA (Autoregressive Integral Moving Average) model, with the following formula:

[0091]

[0092] Where λt is the predicted wavelength at time t, c is a constant term, p is the autoregression order (p=5 is recommended, covering the first hour), q is the moving average order (q=3 is recommended), ф is the autoregression coefficient 0, and the moving average coefficient Et is the white noise error.

[0093] During training, the AIC criterion is used to select the optimal (p, q) combination: AIC = 2k - 2ln(L), where k is the number of model parameters (i.e., p + q + including constant terms), and L is the maximum likelihood function value of the model.

[0094] In a grid search, try all combinations of p and q within a certain range (e.g., p = [0, 1, 2, 3, 4, 5], q = [0, 1, 2, 3]). For each (p, q) combination:

[0095] a. Establish the ARIMA(p, d, q) model

[0096] b. Calculate the AIC value of the model.

[0097] Choose the set (p, q) with the smallest AIC as the optimal model parameters.

[0098] Model parameter estimation: After determining (p, d, q), the model parameters need to be estimated (i.e., the autoregressive coefficient φ and the moving average coefficient θ). Taking the ARIMA(p, d, q) model as an example (assuming d = 1), the model equation is:

[0099] (1-φ1B-…-φpBp)(1-B) d xt=(1+θ1B+…+θqBq)∈t

[0100] Where B is the lag operator, after expansion:

[0101] △xt=φ1△xt-1+…+φpΔxt-p+∈t+θ1∈t-1+…+θq∈tq

[0102] Where ∈t represents white noise, the parameters φ1~φp and θ1~θp are estimated using maximum likelihood estimation (MLE) or least squares estimation (OLS). The ARIMA model parameters (p, d, q) and the estimated coefficients (φ, θ) for each time point are saved.

[0103] Model diagnosis: Check whether the residual sequence satisfies the white noise characteristic (using the Ljung-Box test). If the residual is not white noise, it means that the model still has room for improvement. It may be necessary to reselect the parameters and repeat the above steps until the residual is determined to be white noise.

[0104] Given white noise ∈ t, the autocorrelation coefficient (ACF) of the residual sequence is calculated. For a given residual sequence {∈t} (t=1,2,...,T), the autocorrelation coefficient of lag k is defined as:

[0105]

[0106] For a pre-defined maximum lag order m (usually around the square root of T, but not exceeding T / 4), the Ljung-Box statistic for white noise testing is:

[0107]

[0108] Where T is the sample size and r_k is the autocorrelation coefficient with lag k. Under the null hypothesis (i.e., the residuals are white noise), Q(m) asymptotically follows a chi-square distribution with m degrees of freedom (χ²). 2 _(m)).

[0109] If the calculated Q(m) ≤ χ 2 If _{1-α}(df), then the null hypothesis cannot be rejected, meaning the residuals are white noise. If Q(m)>χ 2 If _{1-α}(df), then we reject the null hypothesis, indicating that there is autocorrelation in the residuals, meaning it is not white noise.

[0110] In some embodiments, step 02: controlling one infrared light detection unit 110 to operate according to the target operating mode, so that the multispectral infrared focal plane heterogeneous integrated system 100 operates in the target operating mode, includes:

[0111] The target operating parameters are determined from a variety of operating parameters according to the target operating mode. Each set of operating parameters is used to compensate for the differences in imaging characteristics caused by different infrared light bands corresponding to the infrared light detection unit 110.

[0112] The infrared light detection unit 110 is controlled to work according to the target working parameters so that the multispectral infrared focal plane heterogeneous integrated system 100 works in the target working mode.

[0113] Specifically, when switching operating modes, the multispectral infrared focal plane heterogeneous integrated system 100 can read the corresponding operating parameters according to the required operating mode, and drive the multispectral infrared focal plane heterogeneous integrated system 100 to work in the corresponding operating mode according to the operating parameters. Matching the operating parameters and operating modes can improve the working performance of the multispectral infrared focal plane heterogeneous integrated system 100.

[0114] The multispectral infrared focal plane heterogeneous integrated system 100 is configured to operate in multiple operating modes, each with its own set of operating parameters. When the operating parameters correspond to the operating mode, the multispectral infrared focal plane heterogeneous integrated system 100 exhibits optimal performance in that operating mode.

[0115] For example, the multispectral infrared focal plane array heterogeneous integrated system 100 is configured to operate in n operating modes, where n is a positive integer greater than or equal to 2. These n operating modes can be denoted as operating mode A1 to operating mode An. There are n sets of operating parameters corresponding to the n operating modes, which can be denoted as operating parameters B1 to operating parameters Bn. Each operating mode corresponds to one set of operating parameters; operating mode A1 corresponds to operating parameter B1, and operating mode An corresponds to operating parameter Bn. When controlling the corresponding detection unit according to operating parameter B1, the multispectral infrared focal plane array heterogeneous integrated system 100 exhibits optimal performance in operating mode A1.

[0116] The target operating mode can be any one of operating modes A1 to An. The mode selection signal can determine the target operating mode from operating modes A1 to An, and thus determine the target operating parameters corresponding to the target operating mode from operating parameters B1 to Bn.

[0117] When the multispectral infrared focal plane heterogeneous integrated system 100 switches between different operating modes, the operating mode that the multispectral infrared focal plane heterogeneous integrated system 100 needs to switch to is the target operating mode. The target operating mode is determined from operating mode A1 to operating mode An according to the mode selection signal, and the target operating parameters are read from operating parameters B1 to operating parameters Bn according to the determined target operating mode.

[0118] The n infrared light detection units 110 can be denoted as detection units C1 to Cn. Each operating mode corresponds to one infrared light detection unit 110, with operating mode A1 corresponding to detection unit C1 and operating mode An corresponding to detection unit Cn. When the OLED display panel 10 is operating in operating mode A1, the driving device 20 drives the detection unit C1 to display.

[0119] Reference Figure 5 The memory in controller 120 can be flash memory, including Flash1-FlashN. The driving parameters stored in Flash1-FlashN correspond one-to-one with n operating modes. The main control module in controller 120 can selectively connect to any one of Flash1-FlashN via a single-pole multi-throw switch, so that the main control module can read the operating parameters stored in any one of Flash1-FlashN as the target operating parameters.

[0120] Specifically, in an infrared multispectral infrared focal plane heterogeneous integrated system, the different bands corresponding to the infrared light detection unit 110 will lead to differences in imaging characteristics. The operating parameters can be used to compensate for the differences in imaging characteristics caused by the different bands corresponding to the infrared light detection unit 110. The memory of the controller 120 can store the band-specific independent correction parameter matrix and band responsivity mapping model for each band. The differences in imaging characteristics caused by the different bands corresponding to the infrared light detection unit 110 are compensated for by using the band-specific independent correction parameter matrix and band responsivity mapping model for each band.

[0121] In some embodiments, step 02: controlling one infrared light detection unit 110 to operate according to the target operating mode, so that the multispectral infrared focal plane heterogeneous integrated system 100 operates in the target operating mode, includes:

[0122] The target operating parameters are determined from a variety of operating parameters according to the target operating mode. Each set of operating parameters is used to compensate for the differences in imaging characteristics caused by the different positions of the infrared light detection unit 110.

[0123] The infrared light detection unit 110 is controlled to work according to the target working parameters so that the multispectral infrared focal plane heterogeneous integrated system 100 works in the target working mode.

[0124] Specifically, in an infrared multispectral infrared focal plane heterogeneous integrated system, the different positions of the infrared light detection unit 110 will lead to differences in imaging characteristics. The operating parameters can be used to compensate for the differences in imaging characteristics caused by the different positions of the infrared light detection unit 110. The memory of the controller 120 can store the correction coefficients and position-related gain / offset matrix for each pixel position. Based on the position set by the infrared light detection unit 110, the position difference is converted into quantifiable compensation coefficients (stored in the gain / offset matrix) through pixel-level position parameter mapping, which is combined with real-time sensor feedback to achieve the desired result.

[0125] In some embodiments, different infrared light detection units 110 correspond to different field of view angles. Step 02: Control the operation of one infrared light detection unit 110 according to the target operating mode, so that the multispectral infrared focal plane heterogeneous integrated system 100 operates in the target operating mode, including:

[0126] The target working parameters are determined from a variety of working parameters according to the target working mode. Each set of working parameters is used to compensate for the differences in imaging characteristics caused by the different field of view of the infrared light detection unit 110.

[0127] The infrared light detection unit 110 is controlled to work according to the target working parameters so that the multispectral infrared focal plane heterogeneous integrated system 100 works in the target working mode.

[0128] Specifically, in an infrared multispectral infrared focal plane heterogeneous integrated system, different field-of-view angles of the infrared light detection unit 110 will lead to differences in imaging characteristics. The operating parameters can be used to compensate for these differences. The controller 120's memory can store the correction parameters and angle-illuminance response model corresponding to the field-of-view angle, transforming the physical limitations of the optical system into mathematically modelable spatial variables. Through preset parameter tables and real-time calculations, consistent imaging performance across the entire field of view is achieved.

[0129] In some implementations, each set of operating parameters includes at least one of sampling timing parameters, bias current parameters, correction parameters, and display parameters.

[0130] Among them, the sampling timing parameters include clock frequency and timing parameters. The clock frequency is used to drive the base frequency of core modules such as ADC and DSP, which affects the system throughput (e.g., 200MHz). The timing parameters can be the reset / signal sampling point interval in correlated double sampling (CDS), which needs to be combined with the capacitor leakage resistance RC time constant to maximize the suppression of KTC noise.

[0131] The bias electrical parameter can be the bias current of the microbolometer, which affects the response speed.

[0132] The correction parameters may include the parameters used to compensate for differences in imaging characteristics in the above embodiments, which will not be described in detail here.

[0133] Display parameters can include the spectral and resolution configuration of an infrared multispectral infrared focal plane heterogeneous integrated system.

[0134] In the description of this specification, the references to terms such as "some embodiments," "in one example," and "exemplarily" indicate that a specific feature, structure, material, or characteristic described in connection with an embodiment or example is included in at least one embodiment or example of the invention. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples. Moreover, without contradiction, those skilled in the art can combine and integrate the different embodiments or examples described in this specification, as well as the features of different embodiments or examples.

[0135] Any process or method description in the flowchart or otherwise herein can be understood as representing a module, segment, or portion of code comprising one or more executable instructions for implementing a particular logical function or process, and the scope of the preferred embodiments of the invention includes additional implementations in which functions may be performed not in the order shown or discussed, including substantially simultaneously or in reverse order depending on the functions involved, as will be understood by those skilled in the art to which embodiments of the invention pertain.

[0136] Although embodiments of the present invention have been shown and described above, it is understood that the above embodiments are optional and should not be construed as limiting the present invention. Those skilled in the art can make changes, modifications, substitutions and variations to the above embodiments within the scope of the present invention.

Claims

1. A control method for a multispectral infrared focal plane heterogeneous integrated system, characterized in that, The multispectral infrared focal plane heterogeneous integrated system can be configured to operate in different modes, with multiple separately designed infrared light detection units, each corresponding to a different infrared light band. The method includes: Select the target operating mode from the different operating modes of the multispectral infrared focal plane heterogeneous integrated system; The infrared light detection unit is controlled to operate according to the target operating mode, so that the multispectral infrared focal plane heterogeneous integrated system operates in the target operating mode.

2. The control method for the multispectral infrared focal plane heterogeneous integrated system according to claim 1, characterized in that, The selection of the target operating mode from different operating modes of the multispectral infrared focal plane heterogeneous integrated system includes: Obtain the infrared light prediction data at the current moment; Based on the infrared light prediction data at the current moment, a target operating mode is selected from the different operating modes of the multispectral infrared focal plane heterogeneous integrated system.

3. The control method for the multispectral infrared focal plane heterogeneous integrated system according to claim 2, characterized in that, Infrared light prediction data varies at different times of the day. Obtaining the infrared light prediction data for the current moment includes: Determine the infrared light prediction data for the current time based on the time of day in which the current time is located.

4. The control method for the multispectral infrared focal plane heterogeneous integrated system according to claim 2, characterized in that, The acquisition of infrared light prediction data at the current moment includes: Based on the date, the time of day, and the target prediction model, the infrared light prediction data for the current moment is determined. The target prediction model is trained based on the historical infrared light detection data, which includes infrared light data detected on different dates in history and infrared light data detected at different times within each date.

5. The control method for the multispectral infrared focal plane heterogeneous integrated system according to claim 4, characterized in that, The steps for training the target prediction model include: Infrared light data detected on different dates in history are used as the first training samples to train the first prediction model in the target prediction model; Infrared light data detected at different times during each date are used as second training samples to train the second prediction model in the target prediction model.

6. The control method for the multispectral infrared focal plane heterogeneous integrated system according to claim 1, characterized in that, The step of controlling one of the infrared light detection units to operate according to the target operating mode, so that the multispectral infrared focal plane heterogeneous integrated system operates in the target operating mode, includes: The target operating parameters are determined from a variety of operating parameters according to the target operating mode. Each set of operating parameters is used to compensate for the differences in imaging characteristics caused by different infrared light bands corresponding to the infrared light detection unit. The infrared light detection unit is controlled to operate according to the target operating parameters, so that the multispectral infrared focal plane heterogeneous integrated system operates in the target operating mode.

7. The control method for the multispectral infrared focal plane heterogeneous integrated system according to claim 1, characterized in that, The step of controlling one of the infrared light detection units to operate according to the target operating mode, so that the multispectral infrared focal plane heterogeneous integrated system operates in the target operating mode, includes: The target operating parameters are determined from a variety of operating parameters according to the target operating mode, wherein each set of operating parameters is used to compensate for the differences in imaging characteristics caused by the different positions of the infrared light detection unit; The infrared light detection unit is controlled to operate according to the target operating parameters, so that the multispectral infrared focal plane heterogeneous integrated system operates in the target operating mode.

8. The control method for the multispectral infrared focal plane heterogeneous integrated system according to claim 1, characterized in that, Different infrared light detection units correspond to different field of view angles. Controlling one infrared light detection unit to operate according to the target operating mode, so that the multispectral infrared focal plane heterogeneous integrated system operates in the target operating mode, includes: The target operating parameters are determined from a variety of operating parameters according to the target operating mode, wherein each set of operating parameters is used to compensate for the differences in imaging characteristics caused by the different field of view of the infrared light detection unit; The infrared light detection unit is controlled to operate according to the target operating parameters, so that the multispectral infrared focal plane heterogeneous integrated system operates in the target operating mode.

9. The control method for a multispectral infrared focal plane heterogeneous integrated system according to any one of claims 6-8, characterized in that, Each set of operating parameters includes at least one of sampling timing parameters, bias current parameters, correction parameters, and display parameters.

10. A multispectral infrared focal plane heterogeneous integrated system, characterized in that, The multispectral infrared focal plane heterogeneous integrated system can be configured to operate in different operating modes, and the multispectral infrared focal plane heterogeneous integrated system includes: Multiple separately designed infrared light detection units, each corresponding to a different infrared light band; The controller is configured to select a target operating mode from different operating modes of the multispectral infrared focal plane heterogeneous integrated system, and control one of the corresponding infrared light detection units to operate according to the target operating mode, so that the multispectral infrared focal plane heterogeneous integrated system operates in the target operating mode.

Images