Low-latency dual-band infrared image resolution real-time switching method and system

Abstract

Embodiments of the present application relate to the technical field of image processing, and disclose a low-delay dual-band infrared image resolution real-time switching method and system, which are suitable for a signal processing module and include the following steps: acquiring an infrared image state command sent by an upper computer; analyzing the infrared image state command to determine an integration time corresponding to the infrared image state command; sending the infrared image state command and the corresponding integration time to a receiving module of a detector; acquiring infrared image data output by the receiving module of the detector, the infrared image data carrying infrared image state information corresponding to the infrared image state command at the front end, determining a corresponding non-uniformity correction coefficient according to the infrared image state information, and using the non-uniformity correction coefficient to perform real-time non-uniformity correction on the infrared image data to obtain corrected infrared image, thereby preventing invalid infrared image from being generated when resolution switching and band switching are performed, reducing the false alarm rate, and effectively improving the detection and identification capability of photoelectric detection equipment.

Description

Technical Field

[0001] This application relates to the field of image processing technology, and in particular to a method and system for real-time switching of resolution in low-latency dual-band infrared images. Background Technology

[0002] In recent years, infrared thermal imaging technology has received considerable attention due to its widespread application in both military and civilian fields. Simultaneously, infrared thermal imager products have developed rapidly, with trends towards integration, high resolution, miniaturization, and multicolor capabilities. Due to the inherent characteristics of infrared radiation, single-band infrared detectors have their limitations. Therefore, exploring photoelectric detection equipment and processing methods for dual-band detectors is essential to overcome the limitations of single-band detection.

[0003] During the use of dual-band detectors, there are resolution switching and band switching. When switching resolution and band, invalid infrared images may be generated because the non-uniformity correction coefficient does not correspond to the infrared image state, which seriously affects the detection and recognition performance of photoelectric detection equipment. Summary of the Invention

[0004] The purpose of this application is to provide a low-latency dual-band infrared image resolution real-time switching method and system, which can prevent invalid infrared images from being generated during resolution switching and band switching, reduce false alarm rate, and effectively improve the detection and identification capabilities of photoelectric detection equipment.

[0005] To address the aforementioned technical problems, embodiments of this application provide a low-latency dual-band infrared image resolution real-time switching method, applicable to signal processing modules, comprising the following steps: acquiring an infrared image status command sent by a host computer to characterize resolution and band information; parsing the infrared image status command through the internal processor of the FPGA (Field Programmable Gate Array) in the signal processing module, and determining the integration time corresponding to the infrared image status command; sending the infrared image status command and its corresponding integration time to the receiving module of the detector through the programmable logic of the FPGA, for the receiving module of the detector to configure, integrate, and output the detector; acquiring infrared image data output by the receiving module of the detector, wherein the infrared image data front-end carries infrared image status information corresponding to the infrared image status command; determining the corresponding non-uniformity correction coefficient based on the infrared image status information through the programmable logic, and using the non-uniformity correction coefficient to perform real-time non-uniformity correction on the infrared image data to obtain a corrected infrared image.

[0006] This application also provides a low-latency dual-band infrared image resolution real-time switching system, including a host computer, a signal processing module, and a detector. The signal processing module is equipped with an FPGA, which contains an internal processor and programmable logic. The detector is equipped with a receiving module. The host computer is at least used to send infrared image status commands representing resolution and band information to the signal processing module. The internal processor is used to parse the infrared image status commands and determine the integration time corresponding to the infrared image status commands. The programmable logic is used to send the infrared image status commands and their corresponding integration time to the receiving module of the detector. The receiving module of the detector is used to configure, integrate, and output the current frame of the detector according to the infrared image status commands and their corresponding integration time, and when outputting infrared image data to the signal processing module, to add infrared image status information corresponding to the infrared image status commands to the front end of the infrared image data. The programmable logic is also used to determine the corresponding non-uniformity correction coefficients according to the infrared image status information, and to use the non-uniformity correction coefficients to perform real-time non-uniformity correction on the infrared image data to obtain a corrected infrared image.

[0007] The low-latency dual-band infrared image resolution real-time switching method and system provided in this application involves an infrared image status command issued by a host computer, a signal processing module determining the corresponding integration time, and configuring the detector frame by frame using the infrared image status command and its corresponding integration time. Under this configuration, the detector captures infrared image data and adds infrared image status information corresponding to the infrared image status command to the front end of the infrared image data. The signal processing module selects a non-uniformity correction coefficient based on the infrared image status information and performs real-time non-uniformity correction on the infrared image data. This ensures that the infrared image data is consistent with the infrared image status and the non-uniformity correction coefficient, preventing invalid infrared images from being generated during resolution and band switching, reducing the false alarm rate, and effectively improving the detection and identification capabilities of photoelectric detection equipment. When determining the non-uniformity correction coefficient, the programmable logic in the FPGA is used instead of the internal processor in the FPGA, avoiding data delays caused by internal processor configuration and effectively achieving low-latency dual-band infrared image resolution real-time switching.

[0008] In some optional embodiments, determining the corresponding non-uniformity correction coefficient based on the infrared image state information includes: setting the resolution and band parameters of the data stream according to the infrared image state information; configuring the frame encoding and readout size of VDMA (Video Direct Memory Access) according to the resolution and band parameters of the data stream; and selecting the non-uniformity correction coefficient corresponding to the infrared image state information based on the frame encoding and readout size. Since the non-uniformity correction coefficient is determined based on the infrared image state information, which in turn corresponds to the infrared image state command, the resolution and band information are consistent throughout the entire image processing process. Therefore, the non-uniformity correction coefficient determined in this way can effectively correct the infrared image and output a clear infrared image.

[0009] In some optional embodiments, when outputting the infrared image data, the detector's receiving module uses CameraLink format in LVDS (Low-Voltage Differential Signaling) mode to output infrared image data with added infrared image status information. Using CameraLink format in LVDS mode to output data can improve the anti-interference capability during data transmission.

[0010] In some optional embodiments, the programmable logic receives the infrared image status command sent by the host computer and the integration time corresponding to the infrared image status command determined by the internal processor via an AXI (Advanced eXtensible Interface) bus, and uses an SPI (Serial Peripheral Interface) encoding unit to send the infrared image status command and its corresponding integration time to the detector's receiving module via the SPI protocol. Transmitting data via the SPI protocol reduces the number of transmission lines.

[0011] In some optional embodiments, the resolution information includes full frame and windowed, the band information includes mid-wave and long-wave, and the infrared image status command includes: full-frame mid-wave infrared image status command, full-frame long-wave infrared image status command, windowed mid-wave infrared image status command, and windowed long-wave infrared image status command. Attached Figure Description

[0012] One or more embodiments are illustrated by way of example with reference to the accompanying drawings, and these illustrative descriptions do not constitute a limitation on the embodiments.

[0013] Figure 1This is a flowchart of a low-latency dual-band infrared image resolution real-time switching method provided in one embodiment of this application;

[0014] Figure 2 This is a flowchart provided in one embodiment of the present application for determining the corresponding non-uniformity correction coefficient based on infrared image state information;

[0015] Figure 3 This is a schematic diagram of a low-latency dual-band infrared image resolution real-time switching system provided in another embodiment of this application. Figure 1 ;

[0016] Figure 4 This is a schematic diagram of a low-latency dual-band infrared image resolution real-time switching system provided in another embodiment of this application. Figure 2 . Detailed Implementation

[0017] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the various embodiments of this application will be described in detail below with reference to the accompanying drawings. However, those skilled in the art will understand that many technical details have been provided in the various embodiments of this application to help readers better understand this application. However, the technical solutions claimed in this application can be implemented even without these technical details and various changes and modifications based on the following embodiments. The division of the various embodiments below is for the convenience of description and should not constitute any limitation on the specific implementation of this application. The various embodiments can be combined with and referenced by each other without contradiction.

[0018] One embodiment of this application relates to a low-latency dual-band infrared image resolution real-time switching method, applicable to a signal processing module. The implementation details of the low-latency dual-band infrared image resolution real-time switching method of this embodiment are described in detail below. The following implementation details are provided for ease of understanding and are not necessary for implementing this solution.

[0019] The specific process of the low-latency dual-band infrared image resolution real-time switching method in this embodiment can be described as follows: Figure 1 As shown, it includes:

[0020] Step 101: Obtain the infrared image status command sent by the host computer to represent the resolution information and band information.

[0021] In the actual implementation, for each frame of the detector, the host computer sends an infrared image status command to the signal processing module to represent the resolution information and band information. The signal processing module receives the infrared image status command sent by the host computer in real time, performs subsequent processing, and then transmits it to the detector.

[0022] In some examples, the resolution information includes full frame and windowed, and the band information includes mid-wave and long-wave. Accordingly, the infrared image status commands include four types: full-frame mid-wave infrared image status command, full-frame long-wave infrared image status command, windowed mid-wave infrared image status command, and windowed long-wave infrared image status command.

[0023] In some examples, the resolution size corresponding to the full frame is 640px × 512px, and the resolution size corresponding to the windowed resolution is 200px × 200px. Those skilled in the art can also set the resolution size corresponding to the full frame and the resolution size corresponding to the windowed resolution according to actual needs.

[0024] Step 102: The infrared image status command is parsed by the internal processor of the FPGA in the signal processing module, and the integration time corresponding to the infrared image status command is determined.

[0025] In the specific implementation, after the signal processing module receives the infrared image status command sent by the host computer, it is processed by the internal processor of the FPGA within the signal processing module. The internal processor parses the infrared image status command and determines the integration time corresponding to the command. Different infrared image status commands correspond to different integration times.

[0026] In some examples, the infrared image status commands include four types: full-frame mid-wave infrared image status command, full-frame long-wave infrared image status command, windowed mid-wave infrared image status command, and windowed long-wave infrared image status command. The integration time for the full-frame mid-wave infrared image status command is 2.5 ms, for the full-frame long-wave infrared image status command it is 0.26 ms, for the windowed mid-wave infrared image status command it is 3 ms, and for the windowed long-wave infrared image status command it is 0.3 ms. Those skilled in the art can also set the integration time values ​​for each infrared image status command according to actual needs.

[0027] In some cases, the infrared image status command sent by the host computer to the signal processing module is received by the internal processor, which parses the infrared image status command and determines the integration time corresponding to the infrared image status command.

[0028] Step 103: Through the programmable logic of the FPGA, the infrared image status command and its corresponding integration time are sent to the receiving module of the detector, so that the receiving module of the detector can configure, integrate and output the current frame of the detector.

[0029] In the specific implementation, after the internal processor of the FPGA determines the integration time corresponding to the infrared image status command, it is not responsible for transmitting it to the detector. Instead, the programmable logic of the FPGA sends the infrared image status command and its corresponding integration time to the receiving module of the detector. After receiving the infrared image status command and its corresponding integration time, the receiving module of the detector can configure, integrate and output the current frame of the detector according to the infrared image status command and its corresponding integration time.

[0030] It is worth noting that the configuration, integration, and output of the detector in the new frame can only be carried out after the configuration, integration, and output of the detector in the previous frame are completed.

[0031] In some examples, the signal processing module includes an AXI bus. The programmable logic receives infrared image status commands and their corresponding integration times via the AXI bus, and then uses an SPI encoding unit to transmit the infrared image status commands and their corresponding integration times to the detector's receiving module via the SPI protocol. Correspondingly, the detector's receiving module also uses an SPI decoding unit when receiving the infrared image status commands and their corresponding integration times. Transmitting data via the SPI protocol reduces the number of transmission lines.

[0032] Step 104: Obtain the infrared image data output by the receiving module of the detector. The front end of the infrared image data carries infrared image status information corresponding to the infrared image status command. The corresponding non-uniformity correction coefficient is determined by the programmable logic based on the infrared image status information, and the non-uniformity correction coefficient is used to perform real-time non-uniformity correction on the infrared image data to obtain the corrected infrared image.

[0033] In the specific implementation, after configuring, integrating, and outputting the current frame, the detector's receiving module can output infrared image data. When outputting infrared image data, the receiving module needs to add infrared image status information corresponding to the infrared image status command to the front end of the infrared image data to represent resolution and band information. After receiving the infrared image data, the signal processing module determines the corresponding non-uniformity correction coefficient based on the infrared image status information using programmable logic. This non-uniformity correction coefficient is then used to perform real-time non-uniformity correction on the infrared image data, resulting in the corrected infrared image. The determination of the non-uniformity correction coefficient is executed by the programmable logic in the FPGA, rather than by the internal processor within the FPGA, avoiding data latency caused by internal processor configuration.

[0034] In some examples, when outputting infrared image data, the detector's receiving module uses CameraLink format in LVDS mode to output infrared image data with added infrared image status information. That is, the infrared image data with added infrared image status information is output through the CameraLink encoding unit. Correspondingly, the signal processing module also receives the infrared image data through the CameraLink decoding unit. Using CameraLink format in LVDS to output data can improve the anti-interference capability of the data transmission process.

[0035] In this embodiment, the host computer issues an infrared image status command, and the signal processing module determines the corresponding integration time. The detector is configured frame-by-frame using the infrared image status command and its corresponding integration time. Under this configuration, the detector outputs infrared image data, and infrared image status information corresponding to the infrared image status command is added to the front end of the infrared image data. The signal processing module selects a non-uniformity correction coefficient based on the infrared image status information and performs real-time non-uniformity correction on the infrared image data. This ensures that the infrared image data is consistent with the infrared image status and the non-uniformity correction coefficient, preventing invalid infrared images from being generated during resolution and band switching, reducing the false alarm rate, and effectively improving the detection and identification capabilities of the photoelectric detection equipment. When determining the non-uniformity correction coefficient, the programmable logic in the FPGA is used instead of the internal processor in the FPGA, avoiding data delays caused by internal processor configuration and effectively achieving low-latency real-time switching of dual-band infrared image resolution.

[0036] In one embodiment, the signal processing module determines the corresponding non-uniformity correction coefficient based on the infrared image state information, which can be achieved through methods such as... Figure 2 The steps shown are implemented as follows:

[0037] Step 201: Set the resolution and band parameters of the data stream according to the infrared image status information.

[0038] In practical implementation, infrared image status commands can represent resolution information and band information. The infrared image status information corresponds to the infrared image status commands and can also represent the same resolution information and band information. Based on the infrared image status information, the resolution size and band parameters of the data stream can be set. The resolution size and band parameters of the set data stream correspond to the resolution information and band information represented by the infrared image status commands.

[0039] Step 202: Configure the frame encoding and readout size of VDMA according to the resolution size and band parameters of the data stream.

[0040] Step 203: Based on frame encoding and readout size, select the non-uniformity correction coefficient corresponding to the infrared image state information.

[0041] In the specific implementation, after setting the resolution and band parameters of the data stream, the frame encoding and readout size of the VDMA can be configured according to these parameters. Then, based on the VDMA frame encoding and readout size, a non-uniformity correction coefficient corresponding to the infrared image state information is selected. The non-uniformity correction coefficient is determined based on the infrared image state information, which in turn corresponds to the infrared image state command. Thus, throughout the entire image processing process, the resolution and band information are consistent. Based on this, the determined non-uniformity correction coefficient can effectively correct the infrared image, outputting a clear infrared image.

[0042] In one example, the host computer sends a full-frame mid-wave infrared image status command. The FPGA's internal processor in the signal processing module parses this command and determines the integration time to be 2.5ms. The programmable logic receives the command and its corresponding integration time via the AXI bus and sends it to the detector's receiving module using the SPI encoding unit and the SPI protocol. The detector receiving module decodes the command and the 2.5ms integration time using the SPI decoding unit, configures the detector's resolution to 640px × 512px, the band to mid-wave, and the integration time to 2.5ms. The dual-band detector then performs configuration, integration, and output. The receiving module outputs infrared image data with a resolution of 640px × 512px in CameraLink format and adds infrared image status information (referred to as frame header information) corresponding to the command to the front of the data. The signal processing module, through the CameraLink decoding unit and the FPGA's programmable logic, analyzes the infrared image data output by the detector's receiving module, sets the data stream resolution to 640px × 512px, and the band to medium wave, thereby determining the VDMA frame encoding and readout size to obtain the appropriate non-uniformity correction coefficients. After reading the non-uniformity correction coefficients, the programmable logic performs real-time non-uniformity correction on the original 640px × 512px infrared image data and outputs the corrected infrared image.

[0043] The steps of the various methods described above are only for clarity. In practice, they can be combined into one step or some steps can be split into multiple steps. As long as they include the same logical relationship, they are all within the scope of protection of this patent. Adding insignificant modifications or introducing insignificant designs to the algorithm or process, but without changing the core design of the algorithm and process, are also within the scope of protection of this patent.

[0044] Another embodiment of this application relates to a low-latency dual-band infrared image resolution real-time switching system. The implementation details of this embodiment's low-latency dual-band infrared image resolution real-time switching system are described below. The following implementation details are provided for ease of understanding and are not essential for implementing this solution. A schematic diagram of this embodiment's low-latency dual-band infrared image resolution real-time switching system can be seen as follows: Figure 3 As shown, it includes a host computer 31, a signal processing module 32 and a detector 33. The signal processing module 32 is equipped with an FPGA 321, which is equipped with an internal processor 3211 and a programmable logic 3212. The detector 33 is equipped with a receiving module 331.

[0045] The host computer 31 is at least used to send infrared image status commands that characterize resolution information and band information to the signal processing module 32.

[0046] The internal processor 3211 is used to parse the infrared image status command and determine the integration time corresponding to the infrared image status command.

[0047] Programmable logic 3212 is used to send infrared image status commands and their corresponding integration times to the receiving module 331 of detector 33.

[0048] The receiving module 331 of the detector 33 is used to configure, integrate and output the detector 33 for the current frame according to the infrared image status command and its corresponding integration time, and when outputting infrared image data to the signal processing module 32, it adds infrared image status information corresponding to the infrared image status command to the front end of the infrared image data.

[0049] The programmable logic 3212 is also used to determine the corresponding non-uniformity correction coefficient based on the infrared image status information, and to use the non-uniformity correction coefficient to perform real-time non-uniformity correction on the infrared image data to obtain the corrected infrared image.

[0050] In some examples, low-latency dual-band infrared image resolution real-time switching systems, such as Figure 4As shown, the signal processing module 321 is further equipped with an SPI encoding unit 3213 and a CameraLink decoding unit 3214, while the receiving module 331 of the detector 33 is equipped with an SPI decoding unit 3311 and a CameraLink encoding unit 3312. The programmable logic 3212 sends the infrared image status command and its corresponding integration time to the receiving module 331 of the detector 33 via the SPI encoding unit using the SPI protocol. The receiving module 331 of the detector 33 then obtains the infrared image status command and its corresponding integration time via the SPI decoding unit 3311. When outputting infrared image data, the receiving module 331 of the detector 33 outputs infrared image data with added infrared image status information to the signal processing module 32 via the CameraLink encoding unit 3312, using the CameraLink format and LVDS method. The signal processing module 32 then parses the infrared image data output by the receiving module 331 of the detector 33 via the CameraLink decoding unit 3214 and the programmable logic 3212.

[0051] Those skilled in the art will understand that the above embodiments are specific embodiments for implementing this application, and in practical applications, various changes can be made to them in form and detail without departing from the spirit and scope of this application.

Claims

1. A method for real-time switching of resolution in low-latency dual-band infrared images, characterized in that, Applicable to a signal processing module, the method includes: Obtain the infrared image status command sent by the host computer, which represents the resolution and band information; The infrared image status command is parsed by the internal processor of the FPGA in the signal processing module, and the integration time corresponding to the infrared image status command is determined. The infrared image status command and its corresponding integration time are sent to the detector's receiving module through the programmable logic of the FPGA, so that the detector's receiving module can configure, integrate and output the current frame for the detector. The infrared image data output by the receiving module of the detector is acquired. The infrared image data front end carries infrared image status information corresponding to the infrared image status command. The programmable logic determines the corresponding non-uniformity correction coefficient according to the infrared image status information, and uses the non-uniformity correction coefficient to perform real-time non-uniformity correction on the infrared image data to obtain the corrected infrared image.

2. The low-latency dual-band infrared image resolution real-time switching method according to claim 1, characterized in that, The step of determining the corresponding non-uniformity correction coefficient based on the infrared image state information includes: The resolution and band parameters of the data stream are set according to the infrared image status information; Configure the frame encoding and readout size of VDMA according to the resolution and band parameters of the data stream; Based on the frame encoding and readout size, a non-uniformity correction coefficient corresponding to the infrared image state information is selected.

3. The low-latency dual-band infrared image resolution real-time switching method according to claim 1, characterized in that, When the receiving module of the detector outputs the infrared image data, it uses CameraLink format and LVDS to output the infrared image data with added infrared image status information.

4. The low-latency dual-band infrared image resolution real-time switching method according to any one of claims 1 to 3, characterized in that, The programmable logic receives the infrared image status command sent by the host computer and the integration time corresponding to the infrared image status command determined by the internal processor via the AXI bus, and uses an SPI encoding unit to send the infrared image status command and its corresponding integration time to the receiving module of the detector in the SPI protocol.

5. The low-latency dual-band infrared image resolution real-time switching method according to any one of claims 1 to 3, characterized in that, The resolution information includes full frame and windowed, the band information includes mid-wave and long-wave, and the infrared image status commands include: full-frame mid-wave infrared image status command, full-frame long-wave infrared image status command, windowed mid-wave infrared image status command, and windowed long-wave infrared image status command.

6. A low-latency dual-band infrared image resolution real-time switching system, characterized in that, It includes a host computer, a signal processing module, and a detector. The signal processing module is equipped with an FPGA, which contains an internal processor and programmable logic. The detector is equipped with a receiving module. The host computer is at least used to send infrared image status commands that characterize resolution information and band information to the signal processing module; The internal processor is used to parse the infrared image status command and determine the integration time corresponding to the infrared image status command; The programmable logic is used to send the infrared image status command and its corresponding integration time to the receiving module of the detector; The receiving module of the detector is used to configure, integrate and output the current frame of the detector according to the infrared image status command and its corresponding integration time, and when outputting infrared image data to the signal processing module, to add infrared image status information corresponding to the infrared image status command to the front end of the infrared image data. The programmable logic is further configured to determine the corresponding non-uniformity correction coefficient based on the infrared image state information, and use the non-uniformity correction coefficient to perform real-time non-uniformity correction on the infrared image data to obtain the corrected infrared image.

Images