A method and system for ultra-large space infrared real-time detection

Abstract

The embodiment of the specification provides an ultra-large airspace infrared real-time detection method and system, wherein the system comprises a main system module, a slave system module, an information interaction and processing module, a servo driving module and a display and information output module, threat target discrimination is performed through the main system module, and target parameter information of the threat target is solved; the slave system module is used for performing secondary discrimination on the threat target in a specified airspace range; the information interaction and processing module is used for receiving positioning information of the threat target, and the servo driving module is controlled to adjust the slave system module to perform high-resolution imaging, identification and tracking on the threat target; and the display and information output module is used for outputting and displaying the received information in real time.

Description

TECHNICAL FIELD

[0001] The present document relates to the field of infrared detection and monitoring, and in particular to a super large space infrared real-time detection method and system. BACKGROUND

[0002] With the continuous expansion of the application of infrared detection technology in the fields of visual navigation, important place security, national defense and military, people's requirements for the performance of infrared detection systems are also getting higher and higher. In order to pursue the full space domain inclusion and full time domain information acquisition of target detection, great importance has been attached to the research of super wide angle (field of view angle ≥ 80°) photoelectric imaging technology in recent years. At present, there are five main technical means to realize super wide angle imaging, which are small field of view scanning technology, multi-sensor splicing technology, ring imaging technology, bionic compound eye imaging technology and super wide angle staring imaging technology. Compared with the other four, the super wide angle staring imaging technology in the infrared band not only can take into account the continuity of space domain and time domain detection, but also has the advantages of small size, light weight, low power consumption and day and night use, so it has become the focus of research by various countries.

[0003] However, in some important photoelectric detection fields, not only is it required that the infrared detection equipment has the ability of super large space real-time detection, but also it is required that the infrared equipment can provide high-resolution target images to realize accurate orientation. However, at present, it is difficult to simultaneously consider both. SUMMARY

[0004] One or more embodiments of the present specification provide a super large space infrared real-time detection system, comprising: a master system module, a slave system module, an information interaction and processing module, a servo drive module and a display and information output module, the master system module and the slave system module are respectively in communication connection with the information interaction and processing module, the information interaction and processing module is in one-way communication connection with the servo drive module and the information output module, and the servo drive module is in one-way communication connection with the slave system module.

[0005] The master system module is configured to collect super large space scene images in real time through super wide angle staring imaging technology to identify threat targets and solve target parameter information of the threat targets.

[0006] The slave system module is configured to collect high-resolution target images of a specified space range according to the control of the servo drive module, to perform secondary identification on the threat targets in the specified space range, to confirm the positions of the threat targets and to perform follow-up tracking.

[0007] The information interaction and processing module is configured to receive images collected by the master system module and the slave system module, to extract positioning information of the threat targets in the images and to send the positioning information to the servo drive module.

[0008] The servo drive module is configured to control the slave system module to perform high-resolution imaging, identification and tracking on the threat target according to the positioning information.

[0009] The display and information output module is configured to receive information from the information interaction and processing module and output display in real time.

[0010] One or more embodiments of the present specification provide a super large airspace infrared real-time detection method, comprising:

[0011] S1. The main system module adopts a super wide-angle staring imaging technology to collect super large airspace scene images in real time to identify threat targets and calculate target parameter information of the threat targets.

[0012] S2. The information interaction and processing module controls the servo drive module to guide the slave system module to collect high-resolution target images of the threat targets, performs secondary identification on the threat targets according to the high-resolution target images, and tracks the threat targets.

[0013] S3. Receive information from the information interaction and processing module, and output display synchronously through the display and information output module.

[0014] By using the super wide-angle infrared staring imaging system to monitor airspace, the advantages of real-time performance and high resolution and high positioning accuracy of the small field of view infrared imaging system are utilized, the former is used as the main system and the latter is used as the slave system, super wide-angle high-resolution master-slave infrared composite detection is carried out, and real-time staring perception of super large airspace situation, high-resolution imaging of key threat targets and high-precision directional tracking are realized.

[0015] The above description is only a summary of the technical solutions of the present application, in order to more clearly understand the technical means of the present application, the specific embodiments of the present application can be implemented according to the content of the specification, and in order to make the above and other purposes, characteristics and advantages of the present application more obvious and easy to understand, the following will specifically describe the embodiments of the present application. BRIEF DESCRIPTION OF DRAWINGS

[0016] In order to more clearly illustrate the technical solutions in the one or more embodiments of the present specification or the prior art, the drawings needed in the embodiment or prior art description will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments described in the present specification, and those skilled in the art can also obtain other drawings according to these drawings without creating additional labor.

[0017] Figure 1 is a schematic diagram of a super large airspace infrared real-time detection system according to an embodiment of the present application;

[0018] Figure 2is a master-slave system module linkage working structure schematic diagram of the super large airspace infrared real-time detection system of the embodiment of the present application;

[0019] Figure 3 is a flow chart of the super large airspace infrared real-time detection method of the embodiment of the present application;

[0020] Figure 4 is a flow chart of the infrared multi-target detection of the super large airspace infrared real-time detection method of the embodiment of the present application;

[0021] Figure 5 is a flow chart of the information interaction between the master system and the slave system of the super large airspace infrared real-time detection method of the embodiment of the present application. DETAILED DESCRIPTION

[0022] In order for those skilled in the art to better understand the technical solutions in one or more embodiments of the present specification, the technical solutions in one or more embodiments of the present specification will be described clearly and completely in conjunction with the drawings in one or more embodiments of the present specification. Obviously, the described embodiments are only a part of the embodiments of the present specification, not all. Based on one or more embodiments of the present specification, all other embodiments obtained by those skilled in the art without creative labor should belong to the protection scope of the present document.

[0023] System embodiment

[0024] The embodiment of the present application provides a super large airspace infrared real-time detection system, Figure 1 is a composition schematic diagram of the super large airspace infrared real-time detection system of the embodiment of the present application, as Figure 1 shown, the super large airspace infrared real-time detection system according to the embodiment of the present application specifically comprises:

[0025] The master system module 10, the slave system module 20, the information interaction and processing module 30, the servo drive module 40 and the display and information output module 50, the master system module 10 and the slave system module 20 are respectively connected with the information interaction and processing module 30, the information interaction and processing module 30 is connected with the servo drive module 40 and the information output module 50 in one-way communication, the servo drive module 40 is connected with the slave system module 20 in one-way communication.

[0026] The master system module 10 is used for real-time acquisition of super large airspace scene image by super wide angle staring imaging technology to identify threat targets, and solve the target parameter information of the threat target; wherein the target parameter information includes target image plane speed, azimuth angle, pitch angle, gray scale change rate and time domain difference; the master system module 10 adopts an infrared imaging system with a field of view angle of 110° and an instantaneous resolution of 1.9mrad.

[0027] The slave system module 20 is configured to collect high-resolution target images of a specified airspace range according to the control of the servo drive module, to perform secondary screening on threat targets in the specified airspace range, to confirm the positions of the threat targets, and to perform follow-up tracking.

[0028] The information interaction and processing module 30 is configured to receive images collected by the main system module 10 and the slave system module 20, to extract positioning information of the threat targets in the images, and to send the positioning information to the servo drive module 40.

[0029] The information interaction and processing module 30 is specifically configured to:

[0030] The information interaction and processing module 30 is specifically configured to:

[0031] If there is only one threat target, the positioning information of the threat target is sent to the servo drive module, and the servo drive module is controlled to guide the slave system module to perform secondary screening on the threat target.

[0032] If multiple threat targets are detected, the threat targets are sorted according to threat degrees, the positioning information of the threat target with the largest threat degree is sent to the servo drive module, and the servo drive module is controlled to guide the slave system module to perform secondary screening on the threat target.

[0033] The servo drive module 40 is configured to control the slave system module to perform high-resolution imaging, identification, and tracking on the threat target according to the positioning information.

[0034] Figure 2 The main system module and the slave system module are linked and work together, as shown in FIG. 1. Figure 2 The main system module monitors the super-large airspace situation in a gazing manner in real time, and the slave system module is installed on a servo turntable and rotates with the servo turntable in the azimuth and elevation directions under the guidance of the main system module, so as to perform high-resolution imaging on a target and implement tracking.

[0035] The display and information output module 50 is configured to receive information of the information interaction and processing module and output and display the information in real time.

[0036] The display and information output module 50 is specifically configured to:

[0037] The display and information output module 50 is specifically configured to:

[0038] Method embodiment

[0039] The embodiment of the present application provides an ultra-large space infrared real-time detection method, Figure 3 The flow chart of the ultra-large space infrared real-time detection method is shown in the figure, Figure 3 The ultra-large space infrared real-time detection method according to the embodiment of the present application specifically comprises the following steps:

[0040] S1. Real-time collection of an ultra-large space scene image by using an ultra-wide-angle staring imaging technology of a main system module to perform threat target discrimination, and calculation of target parameter information of the threat target;

[0041] The target parameter information comprises an image plane speed, an azimuth angle, a pitch angle, a gray scale change rate and a time domain difference; and the main system module adopts an infrared imaging system with a field of view angle of 110° and an instantaneous resolution of 1.9 mrad to perform image collection.

[0042] S2. Control of a servo driving module by an information interaction and processing module to guide a slave system module to collect a high-resolution target image of the threat target, secondary discrimination of the threat target according to the high-resolution target image, and tracking of the threat target;

[0043] The slave system module adopts an infrared imaging system with a field of view angle of 8° and an instantaneous resolution of 0.14 mrad to perform image collection.

[0044] S3. Information reception of the information interaction and processing module, and synchronous output display by a display and information output module.

[0045] Specifically,

[0046] The ultra-wide-angle infrared imaging system of the main system module monitors an ultra-large space situation in a staring mode in real time, collects an ultra-large space scene image to perform threat target discrimination, and the like, Figure 4 As shown in the figure,

[0047] A detection and tracking algorithm embedded in the main system module is used to find and detect a suspected threat target in a covered scene, an infrared multi-target detection process is performed based on the obtained ultra-wide-angle infrared image as basic data, and a suspected target is extracted;

[0048] A non-uniform Gaussian sampling model is constructed by using a spatial variable resolution mapping theory with each suspected target as a center, a variable resolution bionic mapping image of a local image is generated, and target parameter information such as an image plane speed, an azimuth angle, a pitch angle, a gray scale change rate and a time domain difference of the suspected threat target is calculated;

[0049] The threat degree is evaluated and sequenced according to the information of the suspected target, such as the image plane speed, azimuth, elevation, gray change rate and time domain difference, by using the infrared multi-target threat sequencing theory, and the threat sequencing result is obtained.

[0050] The calculated target parameter information and the threat sequencing result are transmitted to the information interaction and processing module.

[0051] Since the super wide-angle infrared staring imaging system monitors a large space and has a low spatial resolution, the false alarm rate is increased to some extent, and therefore, the high-resolution target image of the threat target is collected by the high-resolution slave system module, the threat sequencing result of the master system module is re-screened, the false target is removed and the true target is reserved, and the information interaction strategy between the master system and the slave system is as shown in Figure 5

[0052] The information interaction and processing module judges the number and the target attributes of the suspected threat target in the covered space according to the received target parameter information, including the target positioning, target size, target gray value, image plane speed and the like.

[0053] If only one threat target is detected in the covered space, the positioning information of the threat target is sent to the servo drive module to control the servo drive module to direct the slave system module to re-screen the threat target.

[0054] If multiple threat targets are detected, the threat degree of the multiple threat targets is sequenced, the azimuth information of the threat target with the highest threat degree is determined according to the multi-target threat sequencing result, and the azimuth information is sent to the servo drive module.

[0055] The deviation between the current servo turntable pointing direction and the azimuth of the threat target is judged, if the deviation is large, the servo turntable is driven to align the slave system module to the threat target, and if the deviation is small, the servo turntable is not driven, and the slave system module directly performs high-resolution imaging on the space currently pointed to and identifies and tracks the target.

[0056] It is detected whether there is a target in the high-resolution imaging space, if there is, the target is re-screened to determine whether it is a true target, if there is a threat target and it is a true target, it is judged whether the azimuth of the current threat target is consistent with the azimuth output by the threat sequencing, if the deviation is too large, it is considered that the current threat target does not match the given threat target, the servo is re-directed to the azimuth output by the threat sequencing, and the new position is pointed to.

[0057] If no threat target is detected at the new position, a negative signal is given to the information interaction network, and then the new target azimuth sent by the information interaction and processing module is continuously waited.

[0058] The obtained super large space scene image, high-resolution target image and target parameter information are synchronously output and displayed by the display and information output module.​

[0059] In addition, in order to prevent the target from being lost in the monitoring process, the embodiment adopts a method of "detecting and interacting", utilizes a method of combining neighborhood expansion, gray prediction and trajectory prediction to solve the problem of possible target loss, and the specific method is as follows:

[0060] Suppose that the target is lost in the K+1 frame, the allowed number of lost frames of the target is N miss , the initial value of the target detection neighborhood is n*n, the target image speed is less than v t pixels / frame, when the target point in the K+1 frame is continuously lost for l frames, the neighborhood expansion is performed on the target point through formula 1:

[0061] n K+l+1 =n+l*v t Formula 1

[0062] Suppose that the peak gray value of the target in the first K frames of images is f(t k )(k=1,2,...,K), the gray value of the lost target is predicted by using a least square approximation method, and the peak gray value prediction value of the target point in the K+1+1 frame is shown in formula 2:

[0063]

[0064] Suppose that the target moves at a constant speed for a short time, when the target is lost in the K+1 frame, according to the coordinate positions (X(t K-1 ),Y K-1 (t K-1 )) and (X(t K ),Y(t K )) of the target in the K-1 frame and the K frame, the coordinate position of the target after losing n miss frames is predicted through formula 3:

[0065]

[0066] In the formula, ΔX(t K ) and ΔY(t K ) are coordinate offsets, ΔX(t K )=X(t K )-X(t K-1 ), and ΔY(t K )=Y(t K )-Y(t K-1 ).

[0067] The beneficial effects of the present application are as follows:

[0068] By using the embodiment of the present application, the performance advantages of the wide-angle infrared staring imaging system and the small field of view infrared imaging system are utilized, the former is used as the "master system" and the latter is used as the "slave system", the wide-angle high-resolution master-slave infrared composite detection is carried out, and the real-time staring perception of the super large airspace situation, the high-resolution imaging of the key threat target and the high-precision directional tracking are realized.

[0069] Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, but not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: it can still modify the technical solutions recorded in the foregoing embodiments, or make equivalent replacement for part or all of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A hyper-spectral infrared real-time detection system, characterized in that, Comprise: The main system module, the slave system module, the information interaction and processing module, the servo drive module and the display and information output module, the main system module and the slave system module are connected with the information interaction and processing module communication respectively, the information interaction and processing module with the servo drive module and the information output module one-way communication connection, the servo drive module with the slave system module one-way communication connection; The main system module is used for collecting the super large airspace scene image by the super wide angle gaze imaging technology in real time and carries out threat target discrimination, and calculates the target parameter information of threat target; The slave system module is used for collecting the high resolution target image of the specified airspace range according to the control of the servo drive module, and carries out secondary discrimination to the threat target in the specified airspace range, confirms the position of the threat target and carries out follow-up tracking; The information interaction and processing module is used for receiving the image collected by the main system module and the slave system module, extracting the positioning information of the threat target in the image, and sending to the servo drive module; The information interaction and processing module is specifically used for: Receiving the image collected by the main system module and the slave system module, judging the target attribute; If there is only one threat target, the positioning information of the threat target is sent to the servo drive module, and the servo drive module is controlled to guide the slave system module to carry out secondary discrimination to the threat target; If multiple threat targets are detected, the threat degree of multiple threat targets is sorted, the positioning information of the threat target with the largest threat degree is sent to the servo drive module, and the servo drive module is controlled to guide the slave system module to carry out secondary discrimination to the threat target; The servo drive module is used for controlling the slave system module to carry out high resolution imaging, identification and tracking of the threat target according to the positioning information; The display and information output module is used for receiving the information of the information interaction and processing module and outputting display in real time; The display and information output module is specifically used for: Synchronously outputting the super large airspace scene image, the high resolution target image and the target parameter information.

2. The system of claim 1, wherein, The target parameter information includes target image plane speed, azimuth angle, pitch angle, gray scale change rate and time domain difference.

3. The system of claim 1, wherein, The main system module adopts the infrared imaging system with the field of view angle of 110° and the instantaneous resolution of 1.9mrad;The slave system module adopts the infrared imaging system with the field of view angle of 8° and the instantaneous resolution of 0.14mrad.

4. A method for ultra-large space infrared real-time detection, characterized in that, Comprise: S1. The main system module is used for collecting the super large airspace scene image by the super wide angle gaze imaging technology in real time and carrying out threat target discrimination, and calculating the target parameter information of threat target; S2. The information interaction and processing module controls the servo drive module to guide the slave system module to collect the high resolution target image of the threat target, carries out secondary discrimination to the threat target according to the high resolution target image, and carries out tracking to the threat target; S2 specifically includes: Receiving the image collected by the main system module and the slave system module, judging the target attribute; If there is only one threat target, the positioning information of the threat target is sent to the servo drive module, and the servo drive module is controlled to guide the secondary screening of the threat target by the slave system module; If multiple threat targets are detected, the threat targets are sorted according to threat degrees, the positioning information of the threat target with the largest threat degree is sent to the servo drive module, and the servo drive module is controlled to guide the secondary screening of the threat target by the slave system module; S3. receiving the information of the information interaction and processing module, and synchronously outputting and displaying through the display and information output module; S3 specifically includes: Synchronously outputting a super-large airspace scene image, a high-resolution target image and target parameter information.

5. The method of claim 4, wherein, The target parameter information includes image plane speed, azimuth angle, elevation angle, gray scale change rate and time domain difference.

6. The method of claim 4, wherein, The main system module adopts an infrared imaging system with a field of view angle of 110° and an instantaneous resolution of 1.9 mrad; and the slave system module adopts an infrared imaging system with a field of view angle of 8° and an instantaneous resolution of 0.14 mrad.

Images