Real-time image processing method for scanning imaging system of double-sided array infrared detector

Abstract

The invention relates to a real-time image processing method of a double-sided array infrared detector scanning imaging system, which comprises a double-sided array infrared detector and two signal processing boards, and realizes the real-time image processing of the double-sided array infrared detector based on a multi-core DSP (Digital Signal Processor). According to the invention, the resources of the two multi-core DSPs are fully utilized, and stable and reliable real-time target detection and alarm of the two area array infrared detectors are realized in a double-board multi-core pipeline parallel processing mode.

Description

Technical Field

[0001] The present invention relates to the technical field of signal processing, and relates to a real-time image processing method for a dual-sided array infrared detector scanning imaging system. Background Art

[0002] Compared with line array detectors, area array infrared detectors have the advantages of long integration time and high scanning efficiency. The resolution of currently widely used area array infrared detectors is 1280*1024. To increase the detection distance, area array infrared detectors are applied to scanning imaging systems; when dual-sided array detectors are placed vertically, the vertical field of view can be increased, and the detection probability can be further improved. For a large-resolution, high-frame-rate imaging system, while improving the system resolution, the pressure of real-time image data processing increases, which is particularly obvious in a dual-sided array scanning imaging system. The emergence of digital signal processors (DSPs) has solved problems such as large amounts of digital image processing data and slow processing speeds. 8-core DSPs are favored by high-speed real-time signal processing systems because of their high main frequencies and the advantages of multi-core parallel processing. Summary of the Invention

[0003] The object of the present invention is to provide a real-time image processing method for a dual-sided array infrared detector scanning imaging system, which solves the problems of slow digital image processing speed in the prior art when dealing with large amounts of data.

[0004] To achieve the above object, the technical solution of the present invention is as follows:

[0005] A real-time image processing method for a dual-sided array infrared detector scanning imaging system, the dual-sided array infrared detector scanning imaging system includes two mutually perpendicular first area array infrared detectors and second area array infrared detectors installed on the same azimuth turntable, and a first signal processing board for receiving and processing the image information of the first area array infrared detector and a second signal processing board for receiving and processing the image information of the second area array infrared detector. The first signal processing board and the second signal processing board each contain their own multi-core DSPs, and the first signal processing board and the second signal processing board are signal-connected;

[0006] The steps of real-time image processing are as follows:

[0007] Step 1, the first area array infrared detector and the second area array infrared detector synchronously output a frame of area array image based on the same azimuth code;

[0008] Step 2, the two-way images are synchronously sent to the two signal processing boards. The image of the first area array infrared detector is sent to the first signal processing board, and the image of the second area array infrared detector is sent to the second signal processing board;

[0009] Step 3: The first signal processing board and the second signal processing board respectively send the images to their respective multi-core DSPs, and each performs latent target extraction to form latent target packets; the second signal processing board sends the latent target packets it extracts to the first signal processing board.

[0010] Step 4: The first signal processing board merges the two latent target packets, performs track matching and outputs target information.

[0011] Step 5: Repeat Steps 1 to 4, process the subsequent frame-by-frame area array images, cycle in turn, and perform real-time target detection and warning.

[0012] The multi-core DSP is an eight-core DSP, and the eight cores are core 0, core 1, core 2, core 3, core 4, core 5, core 6, and core 7 respectively.

[0013] In Step 3, the first signal processing board and the second signal processing board respectively send the images to their respective eight-core DSPs. Core 0 in the eight-core DSP receives the first frame of area array image and notifies core 1 to perform latent target extraction. The extracted latent target packets are all sent to core 0 in the eight-core DSP of the first signal processing board.

[0014] In Step 4, after core 0 in the eight-core DSP of the first signal processing board collects the latent target packets of the first signal processing board and the second signal processing board, it merges the two latent target packets, performs track matching and outputs target information.

[0015] Step 5 is that the first signal processing board and the second signal processing board respectively send the next frame of image to their respective eight-core DSPs. After core 0 in the eight-core DSP receives the area array image, it sequentially and circularly distributes it to cores 1 to 7 for latent target extraction. The extracted latent target packets are all sent to core 0 in the eight-core DSP of the first signal processing board, and the cycle repeats.

[0016] The advantages of the present invention are as follows: By using two signal processing boards and making full use of the resources of the 8-core DSP, in the way of dual-board multi-core pipeline parallel processing, stable and reliable real-time target detection and warning of two area array detectors are realized. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 It is a schematic structural diagram of the dual infrared area array detector scanning imaging system of the present invention;

[0018] Figure 2 It is a schematic diagram of the steps of the real-time image processing method of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0019] The present invention will be further described below with reference to the accompanying drawings. The accompanying drawings are only for illustrative purposes and should not be construed as a limitation of this patent.

[0020] To more concisely illustrate this embodiment, some components that are well-known to those skilled in the art but are not relevant to the main content of the present invention will be omitted in the accompanying drawings or description. Additionally, for ease of expression, some components in the accompanying drawings will be omitted, enlarged, or reduced, but this does not represent the size or entire structure of the actual product.

[0021] The present invention discloses a real-time image processing method for a double-sided array infrared detector scanning imaging system. As Figure 1 shown, the double-sided array infrared detector scanning imaging system includes two mutually perpendicular first array infrared detectors and second array infrared detectors mounted on the same azimuth turntable, as well as a first signal processing board for receiving and processing the image information of the first array infrared detector and a second signal processing board for receiving and processing the image information of the second array infrared detector. The first signal processing board and the second signal processing board each contain their own multi-core DSPs, and the first signal processing board and the second signal processing board are signal-connected.

[0022] The multi-core DSP is an eight-core DSP, and the eight cores are core 0, core 1, core 2, core 3, core 4, core 5, core 6, and core 7 respectively.

[0023] As Figure 2 shown, the steps of real-time image processing are as follows:

[0024] Step 1: The first array infrared detector and the second array infrared detector synchronously output a frame of array image based on the same azimuth code.

[0025] Step 2: The two-way images are synchronously sent to the two signal processing boards. The image of the first array infrared detector is sent to the first signal processing board, and the image of the second array infrared detector is sent to the second signal processing board.

[0026] Step 3: The first signal processing board and the second signal processing board respectively send the images to their respective multi-core DSPs and each perform latent target extraction to form latent target packets. The second signal processing board sends the latent target packet it extracts to the first signal processing board.

[0027] In step 3, the first signal processing board and the second signal processing board respectively send the images to their respective eight-core DSPs. Core 0 in the eight-core DSP receives the first frame of array image and notifies core 1 to perform latent target extraction. The extracted latent target packets are all sent to core 0 in the eight-core DSP of the first signal processing board.

[0028] Step 4: The first signal processing board merges the two latent target packets, performs track matching, and outputs target information.

[0029] After core 0 in the eight-core DSP of the first signal processing board collects the latent target packets of the first signal processing board and the second signal processing board, it merges the two latent target packets, performs track matching, and outputs target information.

[0030] Step Five: Repeat Steps One to Four to process subsequent frame-by-frame area array images, and cycle in turn to perform real-time target detection and alarm.

[0031] The first signal processing board and the second signal processing board respectively send the next frame of image to their respective octa-core DSPs. After receiving the area array image, Core 0 in the octa-core DSP sequentially and circularly distributes it to Cores 1 to 7 for latent target extraction. The extracted latent target packets are all sent to Core 0 in the octa-core DSP of the first signal processing board, and cycle in turn.

[0032] That is, the dual infrared area array detectors synchronously output two paths of images; the images are respectively sent to two signal processing boards; after Core 0 of the octa-core DSPs on the signal processing boards receive the images respectively, they are sequentially and circularly sent to their respective Cores 1 to 7 for latent target extraction; the DSP of the first signal processing board collects the latent target packets of the two signal processing boards, performs track matching after merging, obtains the output target, and finally realizes the real-time image processing of the dual infrared area array detectors.

[0033] In summary, the above are only the preferred embodiments of the present invention and are not used to limit the scope of implementation of the present invention. That is, all equivalent changes and modifications made to the content of the scope of the patent application of the present invention shall fall within the technical scope of the present invention.

Claims

1. A real-time image processing method for a double-sided array infrared detector scanning imaging system, characterized in that: The double-sided array infrared detector scanning imaging system includes a first planar array infrared detector and a second planar array infrared detector which are perpendicularly arranged to each other and installed on the same azimuth turntable, as well as a first signal processing board for receiving and processing the image information of the first planar array infrared detector and a second signal processing board for receiving and processing the image information of the second planar array infrared detector. The first signal processing board and the second signal processing board each contain their own multi-core DSPs, and the first signal processing board and the second signal processing board are signal-connected; The steps of real-time image processing are as follows: Step 1, the first planar array infrared detector and the second planar array infrared detector synchronously output a frame of planar array image based on the same azimuth code; Step 2, the two-way images are synchronously sent to two signal processing boards. The image of the first planar array infrared detector is sent to the first signal processing board, and the image of the second planar array infrared detector is sent to the second signal processing board; Step 3, the first signal processing board and the second signal processing board respectively send the images to their own multi-core DSPs, and each performs potential target extraction to form potential target packets; the second signal processing board sends the potential target packet it extracts to the first signal processing board; Step 4, the first signal processing board merges the two potential target packets, performs track matching and outputs target information; Step 5, repeat Step 1 to Step 4, process the subsequent frames of planar array images one by one, and cycle in turn to perform real-time target detection and warning.

2. The real-time image processing method of the double-sided array infrared detector scanning imaging system according to claim 1, characterized in that: The multi-core DSP is an eight-core DSP, and the eight cores are Core 0, Core 1, Core 2, Core 3, Core 4, Core 5, Core 6 and Core 7 respectively.

3. The real-time image processing method of the double-sided array infrared detector scanning imaging system according to claim 2, characterized in that: In Step 3, the first signal processing board and the second signal processing board respectively send the images to their own eight-core DSPs. Core 0 in the eight-core DSP receives the first frame of planar array image and notifies Core 1 to perform potential target extraction. The extracted potential target packets are all sent to Core 0 in the eight-core DSP of the first signal processing board; In Step 4, after Core 0 in the eight-core DSP of the first signal processing board collects the potential target packets of the first signal processing board and the second signal processing board, it merges the two potential target packets, performs track matching and outputs target information.

4. The real-time image processing method of the double-sided array infrared detector scanning imaging system according to claim 3, characterized in that: Step 5 is that the first signal processing board and the second signal processing board respectively send the next frame of image to their own eight-core DSPs. After Core 0 in the eight-core DSP receives the planar array image, it sequentially and circularly distributes it to Core 1 to Core 7 for potential target extraction. The extracted potential target packets are all sent to Core 0 in the eight-core DSP of the first signal processing board, and cycle in turn.

Images