Space infrared camera parameter matching and reconstruction method, system, device and application
By adjusting the parameters of the plane array detector, the compatibility of infrared cameras with high signal-to-noise ratio and high sensitivity in large field of viewing is solved, and the problem of poor resource allocation in the existing technology is reduced, the camera weight and power consumption are suitable for Multimodal observation.
Patent Information
- Application Number
- CN202110942770.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-08-17
- Publication Date
- 2024-11-19
- Estimated Expiration
- 2041-08-17
AI Technical Summary
There is a contradiction between time resolution and signal-to-noise ratio in large field of viewing, which leads to poor camera resource allocation and increases the pressure on aircraft load resources. Especially for launch vehicles, it affects the satellite configuration and rocket. Suitability.
By adjusting the integrated capacitance, TDI series and scanning mode of the plane array detector, the accumulation and average of TDI data in the data field is realized, and the stepwise gaze mode is transferred to the stepwise gaze mode, and the camera parameters are optimized to achieve large field of view and high sensitivity observation, so as to realize two cameras Compatibility of working mode.
After optimizing the system performance and working mode, the resource pressure on the satellite platform is reduced, the high sensitivity observation integration of infrared cameras is realized, weight and power consumption are reduced, and the ability to independently optimize configuration parameters and working modes is achieved.
Smart Images

Figure CN113660434B_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the technical field of information acquisition and space infrared remote sensing, and in particular relates to a space infrared camera parameter matching and reconstruction method, system, equipment and application. Background Art
[0002] At present, the core component of modern infrared imaging systems is the focal plane array (FPA), which commonly includes linear array infrared detectors and planar array infrared detectors. The camera is installed on an aircraft or satellite to obtain ground remote sensing infrared data through push-broom imaging, swing-broom imaging or staring imaging. The way to obtain information is usually to image the target through a photoelectric detector. With the development of remote sensing technology, the pursuit of high temporal resolution, high spatial resolution, and high radiation resolution is the development trend of remote sensing instruments and is also a current research hotspot.
[0003] The observation field of view, frame rate, signal-to-noise ratio, and dynamic range are the main indicators of infrared imaging systems. The larger the observation field of view and the higher the frame rate, the shorter the imaging time of a large area of a space infrared camera. The higher the signal-to-noise ratio means that the infrared camera has a higher recognition rate for target observations. The larger the dynamic range means that the infrared camera can see more details in the same scene. In order to increase the observation field of view, modern infrared imaging systems generally use infrared long-line detector components to achieve a one-dimensional field of view, and perform large-range scanning through a turntable or scanning mechanism to achieve another one-dimensional search field of view. In order to improve the temporal resolution and shorten the imaging time, it is necessary to increase the scanning frame rate. The higher the scanning frame rate, the shorter the scanning integration time of the infrared camera's line detector, which directly leads to a decrease in the signal-to-noise ratio. The signal-to-noise ratio is the core performance indicator of infrared cameras and directly affects the imaging effect.
[0004] In order to solve the contradiction between time resolution and signal-to-noise ratio, two cameras are generally used to work together, using a line scan camera for large field of view imaging observations and an array staring camera for regional high-sensitivity observations. Line scan cameras often use linear array detectors, while staring cameras use array detectors, and there are essential differences in their working modes.
[0005] In the application environment of large field observation, in order to solve the contradiction between time resolution and signal-to-noise ratio, two cameras are generally used to work together, using a line scan camera for large field imaging observation and an array staring camera for regional high-sensitivity observation. This results in suboptimal camera resource allocation during imaging observation, and one camera can only work in one mode, which puts great pressure on the limited aircraft payload resources, especially for launch vehicles. The size and weight of the payload directly restricts the configuration of the satellite and also directly affects whether the rocket is suitable.
[0006] Through the above analysis, the problems and defects of the existing technology are as follows: in the application environment of large field of view observation, in order to solve the contradiction between time resolution and signal-to-noise ratio, two cameras are used to work together, resulting in suboptimal camera resource configuration during imaging observation. One camera can only work in one mode, which puts great pressure on the limited aircraft load resources: in order to meet the mission requirements, more than two large-aperture cameras may be configured, which may require more than 500Kg of weight resources, and the maximum size may exceed 2 meters in a certain installation direction; especially for launch vehicles, the size and weight of the payload directly restricts the configuration of the satellite and also directly affects whether the rocket is suitable.
[0007] The difficulty in solving the above problems and defects is that different space cameras have different detector systems, which leads to the fact that when designing a camera, it is generally designed according to different interfaces and performance index constraints, making it difficult to optimize compatibility in terms of tasks and modes. If it is designed as two cameras, or designed as a camera with a common main optical path and a rear optical path design corresponding to two modes, it will cause a huge waste of resources and affect the platform, and the plan cannot be continued.
[0008] The significance of solving the above problems and defects is that after the design parameters of the front-end optical-mechanical system are determined, the system performance and working mode are further optimized, breaking through the relatively independent working modes of traditional line-scan infrared cameras and array staring cameras. Through reconstruction technology, the two working modes can be organically combined, which can not only meet the needs of large field of view observation, but also meet the performance requirements of high sensitivity and large dynamic range, and the optimal design can be achieved through parameter matching in each mode. After adopting this technical solution, the traditional solution of multi-camera configuration is abandoned, the contradiction between the difficult design and matching of large array infrared detectors and large-aperture optical-mechanical systems is solved, and two different working modes are realized with one camera. Summary of the invention
[0009] In view of the problems existing in the prior art, the present invention provides a method, system, device and application for parameter matching and reconstruction of a space infrared camera.
[0010] The present invention is implemented as follows: a method for matching and reconstructing parameters of a space infrared camera, the method comprising:
[0011] An infrared camera using an array detector configures camera parameters by adjusting the integral capacitor, TDI (time delay integration) level, and scanning mode to achieve observation of a large field of view. Data domain TDI is performed to achieve the output of one scanning line after accumulating and averaging N lines of data, with the observation field of view and signal-to-noise ratio as evaluation indicators. After observing the preset target, the camera reconstruction is started through the information processing unit, the camera parameters are reconfigured, the camera scanning mode is switched to the stepping staring mode, and the scanning mirror is in the stepping working state. The signal-to-noise ratio and dynamic range are used as evaluation indicators to make the camera configuration optimal in this working mode, thereby realizing two working modes for one camera.
[0012] Furthermore, when the camera is in scanning mode, the dwell time of a scanning line is defined as a line scanning cycle; the camera parameters include scanning mirror working mode, scanning mirror movement step angle, scanning mirror movement speed, detector integration time, detector integration capacitance, TDI level, frame time and data transmission format.
[0013] Furthermore, the space infrared camera parameter matching and reconstruction method comprises the following steps:
[0014] Step 1: using a large field of view infrared camera with multiple large array detectors, when the camera is powered on, the information processing module calls the first program in the first memory, i.e., the program memory, and performs optical-mechanical reciprocating scanning through a one-dimensional scanning mirror, and the scanning mirror working mode is set to scanning mode by default;
[0015] Step 2: The currently set scanning frame time T frm The scanning speed V determines the scanning period T. line ; Integration time T intg The default setting is the current row period T line The maximum value under
[0016] Step 3: The array infrared detector stays in one line scan for a time T line The full-frame signal is output internally or the windowed readout, i.e., the M-line signal, is not accumulated at the analog end of the detector; after the signal is converted by A / D, it is processed by TDI in the digital domain;
[0017] Step 4: Set the TDI level to N, N≤M, M is the maximum output line number of the detector in full-frame working mode or windowed readout, cache and accumulate N lines of data in N line cycles according to the scanning direction Dscan, shift the register after accumulation to complete signal averaging, and output only one line of data in one line scan dwell time; when the scanning direction Dscan is reversed, the detector line for data cache and accumulation is also reversed;
[0018] Step 5: through the parameter group pre-calibrated during ground calibration, the parameters in the second memory, i.e., the parameter memory, are automatically called to set the detector integration capacitance C and the TDI level I to match the best dynamic range and SNR;
[0019] Step 6: Perform matching filtering on the image and identify the target through the difference of structure element and gray value;
[0020] Step 7: The image coordinates of the target are converted into an optical-mechanical scanning angle. If the autonomous reconstruction function is turned on, the infrared camera information processing automatically starts the reconstruction, calls the second program in the program memory, and turns the one-dimensional scanning mirror of the large-field infrared camera to the angle where the target is located, and no longer scans;
[0021] Step 8: The infrared camera switches to the stepping and staring working mode, changes the integration time and integration capacitance of the infrared detector, does not perform cumulative averaging on the output data, and transmits the full frame in a preset data format;
[0022] Step nine, through the parameter group pre-calibrated during ground calibration, the parameters in the second memory, i.e., the parameter memory, are automatically called to set the detector integration capacitance C and the TDI level I to match the best dynamic range and SNR;
[0023] Step ten, storing the configured parameters into the camera's third memory, i.e., the data memory, which is automatically called when the infrared camera is working. At the same time, the autonomous reconstruction function is turned on or off, and the array staring working mode is exited or entered through manual intervention.
[0024] Further, in step 5, the matching principle is:
[0025] When the grayscale saturated pixels in the whole image exceed 10%, adaptive adjustment is performed to reduce the TDI level I and increase the integral capacitor C until the saturated pixel point is less than 10%;
[0026] When the maximum grayscale in the entire image does not exceed 50% of the saturated grayscale value, the integral capacitor C is reduced and the TDI level is increased until the maximum grayscale value exceeds 50% of the saturated grayscale value.
[0027] Further, in step nine, the matching principle is:
[0028] When the grayscale saturated pixels in the whole image exceed 10%, adaptive adjustment is performed to reduce the integration time and increase the integration capacitor C until the saturated pixel point is less than 10%;
[0029] When the maximum grayscale in the whole image does not exceed 50% of the saturated grayscale value, increase the integration time. If the integration time still cannot meet the requirements after increasing to the maximum frame period, reduce the integration capacitor C until the maximum grayscale value exceeds 50% of the saturated grayscale value.
[0030] Another object of the present invention is to provide a space infrared camera parameter matching and reconstruction system using the space infrared camera parameter matching and reconstruction method, the space infrared camera parameter matching and reconstruction system comprising a 2048×2048 infrared surface array detector array 1, a 2048×2048 infrared surface array detector array 2, a scanning mode, an infrared camera information processing unit, a reconstructed surface array imaging mode, a first memory, a second memory, a third memory, and a surface array staring module.
[0031] Another object of the present invention is to provide a computer device, the computer device comprising a memory and a processor, the memory storing a computer program, and when the computer program is executed by the processor, the processor performs the following steps:
[0032] An infrared camera using an array detector configures camera parameters by adjusting the integral capacitor, TDI level, and scanning mode to achieve observation of a large field of view. Data domain TDI is performed to achieve the output of one scanning line after accumulating and averaging N lines of data, with the observation field of view and signal-to-noise ratio as evaluation indicators. After observing the preset target, the camera reconstruction is started through the information processing unit, the camera parameters are reconfigured, the camera scanning mode is switched to the stepping staring mode, and the scanning mirror is in the stepping working state. The signal-to-noise ratio and dynamic range are used as evaluation indicators to make the camera configuration optimal in this working mode, thereby realizing two working modes for one camera.
[0033] Another object of the present invention is to provide a computer-readable storage medium storing a computer program, wherein when the computer program is executed by a processor, the processor executes the following steps:
[0034] An infrared camera using an array detector configures camera parameters by adjusting the integral capacitor, TDI level, and scanning mode to achieve observation of a large field of view. Data domain TDI is performed to achieve the output of one scanning line after accumulating and averaging N lines of data, with the observation field of view and signal-to-noise ratio as evaluation indicators. After observing the preset target, the camera reconstruction is started through the information processing unit, the camera parameters are reconfigured, the camera scanning mode is switched to the stepping staring mode, and the scanning mirror is in the stepping working state. The signal-to-noise ratio and dynamic range are used as evaluation indicators to make the camera configuration optimal in this working mode, thereby realizing two working modes for one camera.
[0035] Another object of the present invention is to provide an information data processing terminal, which is used to implement the spatial infrared camera parameter matching and reconstruction system.
[0036] Another object of the present invention is to provide an application of the spatial infrared camera parameter matching and reconstruction system in an infrared camera of an array detector.
[0037] In combination with all the above technical solutions, the advantages and positive effects of the present invention are as follows: the spatial infrared camera parameter matching and reconstruction method provided by the present invention is applied to an infrared camera using an array detector, and the camera parameters are configured by adjusting the integral capacitor, TDI level, and scanning mode to achieve observation of a large field of view, wherein data domain TDI is performed to achieve N lines of data cumulative averaging and then output 1 scanning line, thereby improving the camera signal-to-noise ratio, and achieving the optimal camera configuration in this working mode; after observing the preset target, the camera reconstruction is started through the information processing unit, the camera parameters are reconfigured, the camera scanning mode is switched to the stepping staring mode, the scanning mirror is in a stepping working state, the number of framing lines is shortened, or the windowing technology is used to increase the frame rate, increase the detector integral capacitor, and increase the integration time to perform large dynamic range and high sensitivity observation of the target, so that the camera configuration is optimal in this working mode, thereby realizing two working modes for one camera.
[0038] After the design parameters of the front-end optical-mechanical system are determined, the present invention further optimizes the system performance and working mode, breaking through the relatively independent working modes of traditional line-scan infrared cameras and array staring cameras. Through autonomous reconstruction technology, the two working modes can be organically combined, which can not only meet the needs of large-field observation, but also meet the performance requirements of high sensitivity and large dynamic range, and the optimal design can be achieved through parameter matching in each mode. After adopting this technical solution, the traditional solution of multi-camera configuration is abandoned, the contradiction between the difficulty in designing and matching large-array infrared detectors and large-aperture optical machines is solved, and two different working modes are realized with one camera, which greatly reduces the resource pressure of the satellite platform.
[0039] After adopting the present invention, the integration of infrared camera search and high-sensitivity observation is realized. Experiments show that the infrared camera using this method is 45% lighter and 40% more powerful than the traditional design, and has the ability to autonomously optimize configuration parameters and autonomously switch working modes. BRIEF DESCRIPTION OF THE DRAWINGS
[0040] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following briefly introduces the drawings required for use in the embodiments of the present invention. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.
[0041] Figure 1 It is a flow chart of a method for spatial infrared camera parameter matching and reconstruction provided by an embodiment of the present invention.
[0042] Figure 2 It is a schematic diagram of a spatial infrared camera parameter matching and reconstruction method provided by an embodiment of the present invention.
[0043] Figure 3 It is a schematic diagram of the structure of a spatial infrared camera parameter matching and reconstruction system provided by an embodiment of the present invention. DETAILED DESCRIPTION
[0044] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.
[0045] In view of the problems existing in the prior art, the present invention provides a method, system, device and application for parameter matching and reconstruction of a space infrared camera. The present invention is described in detail below in conjunction with the accompanying drawings.
[0046] like Figure 1 As shown, the spatial infrared camera parameter matching and reconstruction method provided by the embodiment of the present invention includes the following steps:
[0047] S101, using a large field of view infrared camera with multiple large array detectors, when the camera is powered on, the information processing module calls the first program in the first memory, i.e., the program memory, and performs optical-mechanical reciprocating scanning through a one-dimensional scanning mirror, and the scanning mirror working mode is set to scanning mode by default;
[0048] S102, currently set scanning frame time T frm The scanning speed V determines the scanning period T. line ; Integration time T intg The default setting is the current row period T line The maximum value under
[0049] S103, the array infrared detector is in a row scanning dwell time T line The full-frame signal is output internally or the windowed readout, i.e., the M-line signal, is not accumulated at the analog end of the detector; after the signal is converted by A / D, it is processed by TDI in the digital domain;
[0050] S104, setting the TDI level to N, N≤M, M is the maximum output line number of the detector in the full-frame working mode or windowed readout, and caching and accumulating N lines of data in N line cycles according to the scanning direction Dscan, shifting in the register after accumulation to complete signal averaging, and outputting only one line of data in one line scanning dwell time; when the scanning direction Dscan is reversed, the detector line for data caching and accumulation is also reversed;
[0051] S105, through the parameter group pre-calibrated during ground calibration, the parameters in the second memory, i.e., the parameter memory, are automatically called to set the detector integration capacitance C and the TDI level I to match the optimal dynamic range and SNR;
[0052] S106, performing matched filtering on the image, and identifying the predetermined target through the structure element and gray value difference;
[0053] S107, the image coordinates of the target are converted into an optical-mechanical scanning angle. If the autonomous reconstruction function is turned on, the infrared camera information processing automatically starts reconstruction, calls the second program in the program memory, turns the one-dimensional scanning mirror of the large-field infrared camera to the angle where the target is located, and no longer scans;
[0054] S108, the infrared camera switches to the stepping staring working mode, changes the integration time and integration capacitance of the infrared detector, outputs data without accumulating and averaging, and transmits the full frame in a preset data format;
[0055] S109, through the parameter group pre-calibrated during ground calibration, the parameters in the second memory, i.e., the parameter memory, are automatically called to set the detector integration capacitance C and the TDI level I to match the optimal dynamic range and SNR;
[0056] S110, storing the configured parameters into the camera's third memory, i.e., the data memory, which is automatically called when the infrared camera is working. At the same time, the autonomous reconstruction function is turned on or off, and the array staring working mode is exited or entered through manual intervention.
[0057] The principle diagram of the spatial infrared camera parameter matching and reconstruction method provided by the embodiment of the present invention is as follows: Figure 2 shown.
[0058] like Figure 3 As shown, the spatial infrared camera parameter matching and reconstruction system provided by an embodiment of the present invention includes a 2048×2048 infrared surface array detector array 1, a 2048×2048 infrared surface array detector array 2, a scanning mode, an infrared camera information processing unit, a reconstructed surface array imaging mode, a first memory, a second memory, a third memory, and a surface array staring module.
[0059] The technical solution of the present invention is further described below in conjunction with embodiments.
[0060] Example 1
[0061] In view of the problems existing in the prior art, the present invention provides a spatial infrared camera parameter matching and reconstruction method, which is applied to an infrared camera using a planar array detector. The camera parameters are configured by adjusting the integral capacitance, the TDI level, and the scanning mode to achieve observation of a large field of view. The data domain TDI is performed to achieve N lines of data cumulative averaging and then output one scanning line, thereby improving the camera signal-to-noise ratio. The observation field of view and the signal-to-noise ratio are used as evaluation indicators, so that the camera configuration can be optimal in this working mode. After observing a preset target, the camera reconstruction is started through an information processing unit, the camera parameters are reconfigured, the camera scanning mode is switched to a stepping staring mode, the scanning mirror is in a stepping working state, the number of framing lines is shortened, or the windowing technology is used to increase the frame rate, the detector integral capacitance is increased, and the integration time is increased to perform large dynamic range and high sensitivity observation of the target. The signal-to-noise ratio and the dynamic range are used as evaluation indicators, so that the camera configuration can be optimal in this working mode, thereby realizing two working modes for one camera.
[0062] When the camera is in scanning mode, the dwell time of a scanning line is defined as the line scanning cycle. The parameters that need to be configured include: scanning mirror working mode, scanning mirror movement step angle, scanning mirror movement speed, detector integration time, detector integration capacitance, TDI level, frame time, and data transmission format. The specific steps include:
[0063] S1, a large-field-of-view infrared camera using multiple large-array detectors, when powered on, the information processing module calls the first program in the first memory, i.e., the program memory, and performs optical-mechanical reciprocating scanning through a one-dimensional scanning mirror, and the scanning mirror working mode is set to scanning mode by default;
[0064] S2, currently set scanning frame time T frm The scanning speed V determines the scanning period T. line ; Integration time T intg The default setting is the current row period T line The maximum value under
[0065] S3, the array infrared detector stays in one line scan time T line The full-frame signal is output internally or the windowed readout, i.e., the M-line signal, is not accumulated at the analog end of the detector; after the signal is converted by A / D, it is processed by TDI in the digital domain;
[0066] S4. Set the TDI level to N, N≤M, M is the maximum output line number of the detector in full-frame working mode or windowed readout. According to the scanning direction Dscan, N lines of data are cached and accumulated in N line cycles. After accumulation, the register is shifted to complete signal averaging. Only one line of data is output during the dwell time of one line scan. When the scanning direction Dscan is reversed, the detector line for data cache and accumulation is also reversed.
[0067] S5. The parameters in the second memory, i.e., the parameter memory, are automatically called through the parameter group pre-calibrated during ground calibration to set the detector integration capacitance C and TDI level I to match the best dynamic range and SNR. The matching principle is:
[0068] When the grayscale saturated pixels in the whole image exceed 10%, adaptive adjustment is performed to reduce the TDI level I and increase the integral capacitor C until the saturated pixel point is less than 10%;
[0069] When the maximum grayscale in the whole image does not exceed 50% of the saturated grayscale value, reduce the integral capacitor C and increase the TDI level until the maximum grayscale value exceeds 50% of the saturated grayscale value;
[0070] S6, performing matched filtering on the image, and identifying the predetermined target through the difference of structure element and gray value;
[0071] S7, the image coordinates of the target are converted into an optical machine scanning angle. If the autonomous reconstruction function is turned on, the infrared camera information processing automatically starts the reconstruction, calls the second program in the program memory, turns the one-dimensional scanning mirror of the large-field infrared camera to the angle where the target is located, and no longer scans;
[0072] S8, the infrared camera switches to the stepping staring working mode, changes the integration time and integration capacitance of the infrared detector, does not perform cumulative averaging on the output data, and transmits the full frame in the preset data format to increase the frame rate;
[0073] S9, through the parameter group pre-calibrated during ground calibration, automatically call the parameters in the second memory, i.e. the parameter memory, and set the detector integration capacitance C and TDI level I to match the best dynamic range and SNR; the matching principle is:
[0074] 1) When the grayscale saturated pixels in the whole image exceed 10%, adaptive adjustment is performed to reduce the integration time and increase the integration capacitor C until the saturated pixel point is less than 10%;
[0075] 2) When the maximum grayscale in the whole image does not exceed 50% of the saturated grayscale value, increase the integration time. If the integration time still cannot meet the requirements after increasing to the maximum frame period, reduce the integration capacitor C until the maximum grayscale value exceeds 50% of the saturated grayscale value;
[0076] S10. The configuration parameters of the above steps are stored in the camera's third memory, i.e., the data memory, which is automatically called when the infrared camera is working. The autonomous reconstruction function can be turned on or off, or the array staring working mode can be exited or entered through manual intervention.
[0077] Combined with all the above technical solutions, the advantages and positive effects of the present invention are as follows: after the design parameters of the front-end optical-mechanical system are determined, the method further optimizes the system performance and working mode, breaking through the relatively independent working modes of the traditional line-scan infrared camera and the array staring camera. Through the autonomous reconstruction technology, the two working modes can be organically combined, which can not only meet the needs of large field of view observation, but also meet the performance requirements of high sensitivity and large dynamic range, and can achieve the optimal design through parameter matching in each mode. After adopting this technical solution, the traditional solution of multi-camera configuration is abandoned, and the contradiction between the difficulty of designing and matching large array infrared detectors and large-aperture optical machines is solved. Two different working modes are realized with one camera, which greatly reduces the resource pressure of the satellite platform.
[0078] After adopting the present invention, the integration of infrared camera search and high-sensitivity observation is realized. Experiments show that the infrared camera using this method is 45% lighter and 40% more powerful than the traditional design, and has the ability to autonomously optimize configuration parameters and autonomously switch working modes.
[0079] Example 2
[0080] When the camera of the present invention is in scanning mode, the dwell time of a scanning line is defined as the line scanning cycle. The parameters that need to be configured include: scanning mirror working mode, scanning mirror movement step angle, scanning mirror movement speed, detector integration time, detector integration capacitance, TDI level, frame time, and data transmission format.
[0081] The specific steps include:
[0082] S1, a large field of view infrared camera using three 2048×2048 element large array detectors spliced in a "one" shape, when powered on, the information processing module calls the first program in the program memory, and performs optical reciprocating scanning through a one-dimensional scanning mirror, and the scanning mirror working mode is set to scanning mode by default;
[0083] S2, currently set scanning frame time T frm The observation range W is 10°, which determines the scanning speed V to be 0.5° / second. The optical system has determined that the instantaneous field of view FOV is 60urad, so it can be calculated that one frame of image is about 2910 lines, and the line scanning period T line About 6.90ms; detector integration time T intg The maximum value is subject to the current row period T line Constraint: not more than 6.8ms after deducting the reset time;
[0084] S3, the array infrared detector stays in one line scan time T lineOutputting 2048 lines of full-frame signals will result in a high subsequent data rate, so a 1024-line signal is read out through a window, and no accumulation is performed at the analog end of the detector. After the signal is converted by A / D, TDI processing is performed in the digital domain. The number of output taps of each array detector is 16, and the IWR mode (integrate while reading) is adopted. The readout time of each line is 6.6us. When the response of 2048-element detectors is read out, the frequency of the pixel readout clock is 20MHz, and the number of quantization bits is 14bit.
[0085] S4. Set the TDI level N to 32 levels, satisfying N≤M. According to the scanning direction Dscan, 32 lines of data are cached and accumulated in N line cycles. After accumulation, the register is shifted to complete signal averaging. During the residence time of 1 line scan, only 1 line of data is output; in the positive scanning direction, the 32 lines of data before the detector are used for accumulation, and in the reverse scanning direction, the 32 lines of data after the detector are used for accumulation;
[0086] S5. Use the parameter group pre-calibrated during ground calibration to call the parameters in the second memory, i.e., the parameter memory, and set the detector integration capacitance C and TDI level I to match the best dynamic range and SNR. The capacitance is divided into four gears: 0.03pF / 0.3pF / 3pF / 8pF. The matching principle is:
[0087] 1) When the grayscale saturated pixels in the whole image exceed 10%, adaptive adjustment is performed to reduce the TDI level I, the value range of I is 1 to 32, and the integral capacitor C is increased until the saturated pixel point is less than 10%;
[0088] 2) When the maximum grayscale in the whole image does not exceed 50% of the saturated grayscale value, reduce the integral capacitor C and increase the TDI level, and the value range of I is 1 to 32, until the maximum grayscale value exceeds 50% of the saturated grayscale value;
[0089] S6. Build a database of prior radiation information of major natural disasters and structural information of infrared spectrum imaging, perform matched filtering on the images, and identify the intended wildfire targets through structural elements and gray value differences;
[0090] S7, the image coordinates of the target are converted into an optical machine scanning angle. If the autonomous reconstruction function is turned on, the infrared camera information processing automatically starts the reconstruction, calls the second program in the program memory, turns the one-dimensional scanning mirror of the large-field infrared camera to the angle where the target is located, and no longer scans;
[0091] S8, the infrared camera switches to the stepping staring working mode, and changes the integration time T of the infrared detector intg, integrating capacitor C, the output data is no longer accumulated and averaged, but directly output, and the full frame is transmitted according to the preset data format of 2040 (rows) × 4096 (columns), and the frame rate is set to 25 frames / second; the number of output taps of each array detector is 16, and the IWR mode (integration and readout) is adopted. The readout time of each frame is 40ms, and the pixel-by-pixel response of two 2048×2048-element detectors is read out. The frequency of the pixel readout clock is 6.6MHz, and the quantization bit is 14bit;
[0092] S9, through the parameter group pre-calibrated during ground calibration, automatically call the parameters in the second memory, i.e. the parameter memory, and set the detector integration capacitance C, integration time T intg , to match the best dynamic range and SNR; the matching principle is:
[0093] 1) When the grayscale saturated pixels in the whole image exceed 10%, adaptive adjustment is performed to reduce the integration time T intg , increase the integral capacitor C until the saturated pixel point is less than 10%;
[0094] 2) When the maximum grayscale in the whole image does not exceed 50% of the saturated grayscale value, increase the integration time T intg If the integration time still cannot meet the requirement after increasing to the maximum frame period, the integration capacitor C is reduced until the maximum grayscale value exceeds 50% of the saturated grayscale value;
[0095] S10. After the optimization is completed, the configuration parameters of the above steps can be stored in the camera's third memory, i.e., the data memory, and the infrared camera can automatically call it when working. The autonomous reconstruction function can be turned on or off, and the array staring working mode can be exited or entered through manual intervention.
[0096] Proof part ( / experiments / simulations / positive experimental data that can prove the inventiveness of the invention, etc.)
[0097] Experiments show that the infrared camera using this method has achieved multi-mode in one device. A single camera can meet the mission requirements. The weight is about 55% lighter than the traditional design, the power consumption is reduced by about 40%, the peak data rate is reduced by 35%, and it has the ability to autonomously optimize configuration parameters and switch working modes.
[0098] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When the use is implemented in whole or in part in the form of a computer program product, the computer program product includes one or more computer instructions. When the computer program instructions are loaded or executed on a computer, the process or function described in the embodiment of the present invention is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from one website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL) or wireless (e.g., infrared, wireless, microwave, etc.) mode) to another website site, computer, server or data center. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk SolidState Disk (SSD)), etc.
[0099] The above description is only a specific implementation mode of the present invention, but the protection scope of the present invention is not limited thereto. Any modifications, equivalent substitutions and improvements made by any technician familiar with the technical field within the technical scope disclosed by the present invention and within the spirit and principle of the present invention should be covered by the protection scope of the present invention.
Claims
1. A method for matching and reconstructing parameters of a space infrared camera. It is characterized in that The spatial infrared camera parameter matching and reconstruction method configures the camera parameters by adjusting the integral capacitor, TDI level, and scanning mode to achieve observation of a large field of view; wherein the data domain TDI is performed to achieve N lines of data cumulative averaging and then output one scanning line, with the observation field of view and signal-to-noise ratio as evaluation indicators; after observing the preset target, the camera reconstruction is started through the information processing unit, the camera parameters are reconfigured, and the camera scanning mode is switched to the stepping staring mode; the scanning mirror is in a stepping working state, with the signal-to-noise ratio and dynamic range as evaluation indicators, to achieve two working modes for one camera; The space infrared camera parameter matching and reconstruction method comprises the following steps: Step 1: using a large field of view infrared camera with multiple large array detectors, when the camera is powered on, the information processing module calls the first program in the first memory, i.e., the program memory, and performs optical-mechanical reciprocating scanning through a one-dimensional scanning mirror, and the scanning mirror working mode is set to scanning mode by default; Step 2: The currently set scanning frame time T frm The scanning speed V determines the scanning period T. line ; Integration time T intg The default setting is the current row period T line The maximum value under Step 3: The array infrared detector stays in one line scan for a time T line The full-frame signal is output internally or the windowed readout, i.e., the M-line signal, is not accumulated at the analog end of the detector; after the signal is converted by A / D, it is processed by TDI in the digital domain; Step 4: Set the TDI level to N, N≤M, M is the maximum output line number of the detector in full-frame working mode or windowed readout, cache and accumulate N lines of data in N line cycles according to the scanning direction Dscan, shift the register after accumulation to complete signal averaging, and output only one line of data in one line scan dwell time; when the scanning direction Dscan is reversed, the detector line for data cache and accumulation is also reversed; Step 5: through the parameter group pre-calibrated during ground calibration, the parameters in the second memory, i.e., the parameter memory, are automatically called to set the detector integration capacitance C and the TDI level I to match the best dynamic range and SNR; Step 6: Perform matching filtering on the image and identify the target through the difference of structure element and gray value; Step 7: The image coordinates of the target are converted into an optical-mechanical scanning angle. If the autonomous reconstruction function is turned on, the infrared camera information processing automatically starts the reconstruction, calls the second program in the program memory, and turns the one-dimensional scanning mirror of the large-field infrared camera to the angle where the target is located, and no longer scans; Step 8: The infrared camera switches to the stepping and staring working mode, changes the integration time and integration capacitance of the infrared detector, does not perform cumulative averaging on the output data, and transmits the full frame in a preset data format; Step nine, through the parameter group pre-calibrated during ground calibration, the parameters in the second memory, i.e., the parameter memory, are automatically called to set the detector integration capacitance C and the TDI level I to match the best dynamic range and SNR; Step 10, storing the configured parameters into the camera's third memory, i.e., the data memory, which is automatically called when the infrared camera is working, and at the same time, turning on or off the autonomous reconstruction function, exiting or entering the array staring working mode through manual intervention; In step 5, the matching principle is: When the grayscale saturated pixels in the whole image exceed 10%, adaptive adjustment is performed to reduce the TDI level I and increase the integral capacitor C until the saturated pixel point is less than 10%; When the maximum grayscale in the whole image does not exceed 50% of the saturated grayscale value, reduce the integral capacitor C and increase the TDI level until the maximum grayscale value exceeds 50% of the saturated grayscale value; In step nine, the matching principle is: When the grayscale saturated pixels in the whole image exceed 10%, adaptive adjustment is performed to reduce the integration time and increase the integration capacitor C until the saturated pixel point is less than 10%; When the maximum grayscale in the whole image does not exceed 50% of the saturated grayscale value, increase the integration time. If the integration time still cannot meet the requirements after increasing to the maximum frame period, reduce the integration capacitor C until the maximum grayscale value exceeds 50% of the saturated grayscale value.
2. The spatial infrared camera parameter matching and reconstruction method as claimed in claim 1, It is characterized in that When the camera is in scanning mode, the dwell time of a scanning line is defined as the line scanning cycle; the camera parameters include the scanning mirror working mode, the scanning mirror movement step angle, the scanning mirror movement speed, the detector integration time, the detector integration capacitance, the TDI level, the frame time and the data transmission format.
3. A spatial infrared camera parameter matching and reconstruction system for implementing the spatial infrared camera parameter matching and reconstruction method according to any one of claims 1 to 2, It is characterized in that The spatial infrared camera parameter matching and reconstruction system comprises an infrared surface array detector array 1, an infrared surface array detector array 2, a scanning mode, an infrared camera information processing unit, a reconstructed surface array imaging mode, a first memory, a second memory, a third memory, and a surface array staring module.
4. A computer device, It is characterized in that The computer device includes a memory and a processor, the memory stores a computer program, and when the computer program is executed by the processor, the processor executes the steps of the spatial infrared camera parameter matching and reconstruction method according to any one of claims 1 to 2.
5. A computer-readable storage medium storing a computer program, wherein when the computer program is executed by a processor, the processor executes the steps of the spatial infrared camera parameter matching and reconstruction method according to any one of claims 1 to 2.
6. An information data processing terminal, It is characterized in that The information data processing terminal is used to implement the spatial infrared camera parameter matching and reconstruction system as described in claim 3.
