Delay and synchronous measurement device and method of fusion imaging equipment

Abstract

The invention provides a time delay and synchronous measurement device and method for fusion imaging equipment, the device comprises a host, a control system, a detected product and a detection high-speed camera, the host is used for obtaining target images in different environments, a light path through hole is formed in a front side shell of the host, the detected product is located in front of the host, and the detection high-speed camera is located in front of the control system. The light path through hole is used for being aligned with the light path through hole of the host and imaging a target, the detection high-speed camera is located in front of a detected product and used for collecting an image formed on the detected product, and the control system is in communication connection with the host and the detection high-speed camera and used for processing image data collected by the detection high-speed camera and the host. And the time synchronization and delay measurement of the fusion imaging equipment is realized. According to the invention, single-channel time delay and dual-channel time synchronization of the fusion imaging equipment can be measured visually, accurately and quickly, and data support is provided for evaluating the image quality of the fusion imaging equipment and knowing the performance base number of a fusion system.

Description

Technical Field

[0001] The present invention relates to the technical field of photoelectric detection and image signal processing, and in particular to a delay and synchronization measurement device and method for fusion imaging equipment. Background Art

[0002] Imaging systems play an important role in modern high-tech warfare, and fused night vision devices, as an essential instrument in information-based night warfare, can provide combatants with clearer target observation and identification, reconnaissance and surveillance, thereby assisting combat command decisions. However, due to the fact that the working characteristics and working environment of different imaging systems may change at any time, the complexity of image fusion algorithms, the differences in the synchronization of image processing algorithms in different bands, and the impact of photoelectric detector performance and data transmission on system performance, the fusion imaging system will have a delay, resulting in the display of images, especially images with large scene changes, being inconsistent with the actual image, and the display of images in different bands being separated, affecting image fusion and the overall display quality of the system.

[0003] Chinese patent CN110933397A "A high-precision imaging delay test device and method" aims the imaging device to be measured at a cyclically lit LED light source array for imaging output, and the video processing detection module detects the position of the lit LED in the effective output video of the imaging device to obtain the imaging start time, and the imaging delay of the imaging device is obtained by comparing the time difference between the effective video output time and the imaging start time.

[0004] Chinese patent CN109489940A "A method for measuring the precise delay of an optical imaging system" regards the entire optical imaging system as a black box. By establishing a simulated scene, the light source and the camera are started synchronously to obtain the precise input time of the scene signal. Then, by recording the input time of the scene signal and the output time of the final data, the time difference between the two times is recorded with an oscilloscope to obtain the system delay.

[0005] However, the prior art has the following deficiencies:

[0006] (1) It is mainly aimed at the imaging delay measurement of general imaging equipment, and has not studied the delay and synchronization measurement technology based on infrared and visible light fusion imaging equipment;

[0007] (2) It cannot effectively simulate the imaging conditions of dynamic targets and is not comprehensive enough in simulating the real imaging environment;

[0008] (3) The impact of the system error of infrared and visible light fusion imaging equipment on the test cannot be accurately understood;

[0009] (4) The method is not universal and is not flexible when dealing with different types of imaging devices and different imaging conditions.

[0010] Therefore, further experimental research and exploration of accurate measurement technology suitable for the delay index of the fusion imaging system is an important issue that needs to be solved urgently. It will not only help improve the performance of the imaging system, but also have important significance and practical application value for promoting the development of modern high technology. Summary of the invention

[0011] The purpose of the present invention is to propose a delay and synchronization measurement device and method for fusion imaging equipment, which overcomes the defects of the existing technology and can intuitively, accurately and quickly measure the single-channel time delay and dual-channel time synchronization of the fusion imaging equipment, provide data support for evaluating the image quality of the fusion imaging equipment and finding out the basic performance of the fusion system, and further improve the practicality of the fusion system.

[0012] The technical solution to achieve the purpose of the present invention is:

[0013] A delay and synchronization measurement device for fusion imaging equipment includes a host, a control system, a product to be tested, and a high-speed detection camera. The host is used to obtain target images under different environments. An optical path through hole is provided on the front shell of the host. The product to be tested is located in front of the host, and is used to align the optical path through hole of the host and image the target. The high-speed detection camera is located in front of the product to be tested, and is used to collect images formed on the product to be tested. The control system is connected to the host and the high-speed detection camera for communication, and the image data collected by the high-speed detection camera and the host are processed to achieve time synchronization and delay measurement of fusion imaging equipment. The synchronization degree of the image fusion system refers to the time difference between the delay of different channel detectors from receiving images of different bands (low-light images / infrared images) to the image fusion system outputting them to the display screen.

[0014] Furthermore, a partition is provided inside the host, one side of the partition is a test light path compartment, and the other side is a reference light path compartment, the test light path compartment is equipped with a parallel light tube system, a detection chopper and a backlight panel group, the reference light path compartment is equipped with a reference chopper, a visible light / infrared multi-band planar light source module, a speed control module, an illuminance meter probe, a third plane reflector and a reference high-speed camera, the third plane reflector is provided with a plurality of LED lamp beads, the imaging light path on the reference chopper is folded by the third plane reflector, and the image of the reference chopper is reflected to On the imaging surface of the reference high-speed camera, the visible light / infrared multi-band plane light source module is used to control the temperature and illuminance of the environment near the detection chopper blade, the illuminometer probe is used to obtain the illuminance of the ambient light near the detection chopper blade, the detection chopper blade and the reference chopper blade are rigidly connected coaxially and in phase on the left and right sides of the partition, and are driven to rotate by the speed control module, the detection chopper blade is provided with a target hole group and a reference line, and the parallel light tube system projects the light beam of the rotating detection chopper blade target in parallel through the optical path through hole to the detector of the fusion imaging equipment to be tested.

[0015] Furthermore, the parallel light tube system includes an off-axis parabolic mirror, a first plane reflector and a second plane reflector. The off-axis parabolic mirror is installed on the rear side of the test light path warehouse, corresponding to the light path through hole, the first plane reflector is installed on the left side of the test light path warehouse, and the second plane reflector is installed on the front side of the test light path warehouse. The off-axis parabolic mirror, the first plane reflector and the second plane reflector form a folded light path. The light beam on the detection chopper is projected onto the first plane reflector, and then projected onto the off-axis parabolic mirror through the folded light path. The light on the off-axis parabolic mirror is then projected onto the detector of the fusion imaging equipment to be tested through the light path through hole.

[0016] Furthermore, the backlight panel group includes a first backlight panel and a second backlight panel, the first backlight panel is installed at the rear side of the test light path compartment, and the second backlight panel is installed at the left side of the test light path compartment.

[0017] Furthermore, the detection chopper is circular, and is provided with a plurality of target hole groups with the same center, the plurality of target hole groups are evenly distributed on the circumference, and the center of at least one group of target hole groups is in the same straight line with the center of the reference line hole.

[0018] Furthermore, the target hole groups are composed of multiple holes, the hole diameters of the holes gradually increase from the center along the radius, the reference line is composed of multiple holes, and the center of at least one group of target hole groups is on the same line as the center of the reference line holes.

[0019] Furthermore, the visible light / infrared multi-band planar light source module adopts a laminated structure, the inner layer is a controllable surface light source, which is a combination of planar LED lamp beads, and the outer layer is an infrared heating source; the backlight panel of the backlight panel group has a built-in controllable surface light source, which has the same working illumination as the visible light / infrared multi-band planar light source module.

[0020] Furthermore, both the reference high-speed camera and the detection high-speed camera have high-speed imaging capabilities; the reference high-speed camera is equipped with a fixed focal length lens, and the detection high-speed camera is equipped with a variable focal length lens and the focusing range covers from the minimum imaging distance to infinity.

[0021] Furthermore, the image data collected by the high-speed camera and the host are processed to achieve time synchronization and delay measurement of the fusion imaging equipment, including:

[0022] Get the image angle α of the corresponding reference point on the reference chopper film taken by the reference high-speed camera 00 , α 01 , α 02 ...and the corresponding reference point image angle α on the detection chopper film taken by the detection high-speed camera through the fusion imaging equipment 10 , α 11 , α 12...;

[0023] Get the current angular velocity ω of the chopper;

[0024] Calculate the angle difference |α between the reference point and the corresponding frame 10 -α 00 |,|α 11 -α 01 |,|α 12 -α 02 |..., and find the mean value of the angle difference α;

[0025] according to Calculate the delay of fusion signal processing of different channels of the fusion imaging equipment to be tested;

[0026] In fusion mode, the absolute value of the difference in processing delays of fusion signals of different channels is used as time synchronization.

[0027] A time delay and synchronization measurement method for fusion imaging equipment, comprising the steps of:

[0028] The backlight panel group, the visible light / infrared multi-band planar light source module and the speed control module are controlled by the control system, and the detection chopper blade and the reference chopper blade are driven by the speed control module to rotate at a uniform speed;

[0029] The reference high-speed camera images the reference chopper plate under the adjusted illumination, the fusion imaging equipment under test images the detection chopper plate through the parallel light tube system, and the detection high-speed camera takes the image of the detection chopper plate on the fusion imaging equipment under test;

[0030] The image data collected by the high-speed detection camera and the host are processed to achieve time synchronization and delay measurement of the fusion imaging equipment.

[0031] Compared with the prior art, the present invention has the following beneficial effects:

[0032] (1) The measurement method based on time-space projection is adopted, and the spatial phase information of the chopper system is cleverly used to project the target onto the off-axis reflective collimator system of the primary and secondary mirrors, forming a uniformly rotating infinitely far target, which improves the image quality, folds the optical path and reduces the system volume;

[0033] (2) Use background light source illumination tracking to provide the same level of fill light in the entire field of view of the product under test, eliminating the impact of global automatic gain on image detection of the product under test with a large field of view;

[0034] (3) The target holes on the chopper system are designed with different aperture groups, and the same aperture angle is precisely designed to be opened at a uniform angle. The three target holes are distinguished by reference lines. The target holes with the same diameter can be detected three times. The centroid positioning accuracy calculation method is used to improve the system detection accuracy.

[0035] (4) It can simulate real and complex imaging environments and is more comprehensive and efficient in terms of dynamic target simulation, synchronous measurement, software and hardware complexity, system versatility and breadth, result accuracy and real-time performance. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] Figure 1 This is a composition diagram of a delay and synchronization measurement device of a fusion imaging device of the present invention;

[0037] Figure 2 This is a principle diagram of a reference point angle difference measurement method of a delay and synchronization measurement device of a fusion imaging equipment of the present invention;

[0038] Figure 3 A schematic diagram of a detection chopper of a delay and synchronization measurement device of a fusion imaging system of the present invention;

[0039] Figure 4 This is a flow chart of the method for calculating centroid positioning accuracy of the present invention;

[0040] Figure 5 It is a schematic diagram of the connection between the control system of the present invention and other devices.

[0041] Reference numerals:

[0042] 1: host, 2: control system, 1-1: first plane reflector; 1-2: second plane reflector; 1-3: off-axis parabolic mirror; 1-4: chopper system; 1-5: first backlight panel; 1-6: illuminance meter probe; 1-7: reference high-speed camera; 1-9: dust cover; 1-10: front shell; 1-11: rear shell; 1-12: right shell; 1-13: second backlight panel, 1-14: third plane reflector; 14: product under test; 15: detection high-speed camera; 16: communication line. DETAILED DESCRIPTION

[0043] The present invention is further described in detail below in conjunction with the accompanying drawings and embodiments, specifically taking a fusion night vision imaging equipment as the tested product, which is intended to be used to explain the present invention and should not be construed as limiting the present invention.

[0044] The present invention provides a delay and synchronization measurement device for fusion imaging equipment, which realizes the design index time delay test accuracy ≤ 0.65ms, time synchronization test accuracy ≤ 1.3ms, and combines Figure 1The device includes a host 1, a control system 2, a product under test 14 and a high-speed detection camera 15. The host 1 is connected to the control system 2 for communication to obtain target images under different environments; the product under test 14 is located in front of the host 1 and is used to align the optical path through hole of the host and image the target. The high-speed detection camera 15 is located in front of the product under test 14 and is used to collect the image on the display screen of the product under test 14. The high-speed detection camera 15 is connected to the control system 2 for communication. The control system 2 is located on the right side of the host 1 and processes the image data collected by the high-speed detection camera 15 and the host 1. Finally, the time synchronization and delay measurement of the product under test are realized according to the image reference point angle difference measurement method.

[0045] The product under test is a fusion imaging device, such as a fusion night vision device.

[0046] A partition is provided inside the host 1, the left side of the partition is a test light path bin, and the right side is a reference light path bin. Each part in the bin (including the inner surface of the host and the installation parts) is subjected to a matte treatment and uniformly oxidized with aluminum in its original color to form a diffuse reflection cavity. A parallel light tube system, a detection chopper, a first backlight plate 1-5, and a second backlight plate 1-13 are installed in the test light path bin. A reference chopper, a visible light / infrared multi-band planar light source module, a speed control module, an illuminance meter probe 1-6, a third plane reflector 1-14, and a reference high-speed camera 1-7 are installed in the reference light path bin; the detection chopper, the reference chopper, the visible light / infrared multi-band planar light source module, and the speed control module constitute a chopper system 1-4, and the speed control module mainly includes a stepper motor and a motor driver. At the same time, the host combines the dust cover 1-9, the front shell 1-10, the rear shell 1-11, the left shell, the right shell 1-12, the upper shell and the lower shell to form a labyrinth sealed box to prevent stray light from entering the chamber, greatly improving the detection accuracy of the system. The dust cover 1-9 is installed on the optical path through hole of the front shell 1-10, the front shell 1-10, the rear shell 1-11 and the lower shell are integrated, and the left shell, the right shell 1-12 and the upper shell are integrated.

[0047] In order to reduce the volume, the system adopts two folding of the off-axis reflective collimator. The collimator system includes an off-axis parabolic mirror 1-3, a first plane reflector 1-1 and a second plane reflector 1-2. The off-axis parabolic mirror 1-3 is installed on the rear shell of the host, the first plane reflector 1-1 is installed on the left side of the test light path warehouse, the second plane reflector 1-2 is installed on the front shell of the host, the first backlight panel 1-5 is installed on the rear shell of the warehouse body, and the second backlight panel 1-13 is installed on the left shell of the host 1, which is used as a background fill light source to provide brightness adjustment in the test light path warehouse, and perform fill light of the same order of magnitude in the entire field of view of the tested product, eliminating the influence of the global automatic gain of the tested product with a large field of view on the image detection; the off-axis parabolic mirror 1-3, the first plane reflector 1-1 and the second plane reflector 1-2 form a folded light path, projecting the uniformly rotating detection chopper target to infinity, and then the light is projected in parallel to the detector of the tested product 14 aligned with the host light path, to ensure that the image plane of the target on the detector is parallel to the real object.

[0048] The detection chopper and the reference chopper are rigidly connected coaxially and in phase on the left and right sides of the partition, and are driven by a speed control module to simulate targets moving in different environments; the visible light / infrared multi-band plane light source module controls the temperature and illuminance of the environment near the detection chopper, and combines the backlight fill light source to provide the illuminance and temperature of the detection environment, so that the wide-spectrum light source passes through the small holes on the detection chopper to form visible light and infrared targets with contrast with the environment; the illuminance meter probe 1-6 displays and reads the illuminance reading of the current environment in real time; the third plane reflector 1-14 is provided with a plurality of LED lamp beads to provide good light brightness, and the imaging light path on the reference chopper is folded by the third plane reflector, and the image of the reference chopper is reflected onto the imaging surface of the reference high-speed camera 1-7, and the image data of the reference chopper is collected to provide a stable reference image for experimental measurement.

[0049] like Figure 3 As shown, the detection chopper is driven to rotate by a speed control module, and includes different aperture groups and the same aperture angle is precisely designed to be 120° apart. Three target holes of the same diameter are distinguished by reference lines. A dual-wheel synchronous design is adopted, and the reference chopper and the detection chopper adopt a coaxial structure. The two have the same rotation speed, and the hole positions are strictly calibrated to achieve the same frequency and phase. The detection chopper faces the parallel light tube system and is enclosed in the host test light path compartment. It has a wide spectrum light source and adjustable visible light illumination; the reference chopper faces away from the parallel light tube system and is enclosed in the host reference light path compartment with good visible light illumination conditions. As shown Figure 5As shown, the control system 2 realizes the speed control of the chopper blade by sending a control instruction to the speed control module; the control system is connected to the visible light / infrared multi-band planar light source module, the first backlight panel 1-5 and the second backlight panel 1-13 through RS232 communication, and realizes the illumination control of the ambient light and the background light source near the detection chopper blade and the temperature control by sending current or temperature data to the visible light / infrared multi-band planar light source module, the first backlight panel 1-5 and the second backlight panel 1-13, and reads the illumination reading of the illuminance meter probe 1-6 in real time and displays it, so that the wide spectrum light source passes through the small hole to form a visible light and infrared target with contrast with the environment.

[0050] The reference chopper blade may be an existing chopper blade, or may have a structure substantially consistent with that of the detection chopper blade, and is provided with three holes which are 120 degrees to each other.

[0051] The visible light / infrared multi-band planar light source module adopts a laminated structure, with the inner layer being a controllable planar light source and the outer layer being an infrared heating source. The controllable planar light source is a planar LED lamp bead combination arrangement, using PMW (pulse width modulation) technology and constant current source drive control technology. PMW can provide a dynamic adjustment range of 3 orders of magnitude, and the constant current source drive control can provide a dynamic adjustment range of 2 orders of magnitude. The dynamic adjustment range of brightness reaches more than 5 orders of magnitude, and the working illumination range reaches 5×10 -4 lx~50lx; the infrared source provides a higher temperature than the chopper system; the operating temperature of the LED high temperature resistant lamp beads can reach above 85℃, which can withstand the heating requirements of the infrared source; the infrared source temperature is controlled at around 45℃, and can provide radiation with a peak wavelength of 9.1μm, and the radiation range exceeds 0.4μm~12μm.

[0052] like Figure 1 As shown, since the field of view of the chopper is limited and cannot fill the field of view of the large-field fusion imaging system, the first backlight panel 1-5 and the second backlight panel 1-13 use background light source illumination tracking to perform the same order of magnitude surface LED environmental spectrum compensation light source in the field of view of the entire product under test 14, thereby eliminating the influence of the global automatic gain of the large-field product under test 14 on the detection and achieving accurate detection; the first backlight panel 1-5 and the second backlight panel 1-13 have built-in controllable surface light sources, and the controllable surface light sources are planar LED lamp beads. The first backlight panel 1-5 and the second backlight panel 1-13 have the same working illumination as the visible light / infrared multi-band planar light source module, and the illumination range is 5×10 -4 lx~50lx.

[0053] The detection chopper is projected onto the off-axis reflective collimator system of the primary and secondary mirrors, which can convert the light emitted by the light source after passing through the detection chopper into parallel light from infinity, and make the detection chopper equivalent to a target at infinite distance. After that, the light is projected in parallel onto the detector of the product under test, ensuring that the image plane of the detection chopper on the detector is parallel to the real object, and then output to the display screen after being processed by the image fusion system.

[0054] The reference high-speed cameras 1-7 and the detection high-speed camera 15 use the same high-speed camera, which can output 1280×800 pixels at 2500fps, and the spectral response range exceeds 0.4μm~1μm. The reference high-speed camera 1-7 lens uses an 8mm fixed-focus lens, which can clearly image the reference chopper under good illumination; the detection high-speed camera 15 uses an 8mm~50mm zoom lens, and by adjusting the zoom, clear imaging of the display screens of different tested fusion equipment can be achieved. The minimum imaging distance of the detection high-speed camera 15 and the reference high-speed camera 1-7 lens is 0.3m, and the focusing range is 0.3m~∞.

[0055] Control system 2 consists of an industrial computer, a display and a power supply system. The operating system of the industrial computer is installed with a time synchronization and delay measurement software module. In order to facilitate control and improve space utilization, the industrial computer, the display and the power supply system are installed in a cabinet. The CPU model parameter of the industrial computer is i78550U, which is connected to other components through a communication line 16. The control system sends control instructions through the serial port and processes the image data collected by the detection high-speed camera and the reference high-speed camera through the time synchronization and delay measurement software module. Figure 5 The two high-speed cameras are connected to the RS485 interface of the industrial computer for communication and control of synchronous triggering for acquisition; the visible light / infrared multi-band planar light source module is connected to the RS232 interface of the industrial computer for serial communication; the motor is connected to the RS485 interface of the industrial computer for serial communication to control the speed; the light meter probe is connected to the industrial computer via a USB to serial port.

[0056] like Figure 2 As shown, the control system synchronously triggers two high-speed cameras to complete the high-speed synchronous shooting of the detection chopper blade and the reference chopper blade images respectively, and simultaneously outputs two images to the time synchronization and delay measurement software module, which processes the images. Figure 4As shown, the present invention utilizes the centroid positioning accuracy calculation method to first extract the centroid of each target hole, calculate the angle of each centroid relative to the center of the circle, and find the reference line on the detection chopper. Since the angle between the three main lines is 120° when the detection chopper is designed, and the angle between the two main lines outside the same straight line as the reference line and the reference line is 60°, the three corresponding main lines can be determined separately according to this angle constraint, and then the centroids are grouped according to the same diameter screening based on the distance between the centroid and the center of the circle, and the angle difference of the corresponding frame target reference point is calculated. Finally, based on the angle difference measurement method, the imaging delay and synchronous measurement analysis and evaluation of the tested product 14 are realized, and a test report is generated.

[0057] The detailed measurement method steps of the present invention are as follows:

[0058] (1) Install the high-speed detection camera 15 and check to ensure that each module is connected correctly;

[0059] (2) Turn on the product 14 to be tested and set it to the test mode, place it to aim at the target at infinity, i.e., the detection chopper, adjust the image of the product 14 to the target to be clear, and aim the high-speed detection camera 15 at the eyepiece of the product 14;

[0060] (3) Turn on the control power supply, the switch of the high-speed camera 15 and the switch of the illuminometer probes 1-6, and enter the following measurement process:

[0061] 1. Motor, visible light / infrared multi-band plane light source control

[0062] Motor control: Click Start / Stop to control the motor to drive the two coaxial choppers to rotate or stop, and the speed can be changed;

[0063] Light intensity control and reading: input current parameters of the visible light / infrared multi-band plane light source and the background environment fill light source of the detection chopper to control the illumination (pay attention to shielding the box and indoor environment stray light). The time synchronization and delay measurement software module reads and displays the current ambient light illumination reading in real time through the illuminance meter probes 1-6;

[0064] Infrared heating control: Control the heating of the detection chopper and prompt the current on / off heating status.

[0065] 2. Video Collection

[0066] Combined with process 1, the motor, backlight, and visible light / infrared multi-band plane light source are set, and the control system controls the required lighting conditions, temperature environment, and target speed. The reference high-speed camera and the detection high-speed camera are synchronously triggered at a certain moment, and both acquire the chopper blade image at the same time;

[0067] The chopper blade is driven by a motor to rotate at a controlled uniform speed, and a small hole is opened on it as a target reference point; the wide spectrum light source covers the spectrum range from visible light to long-wave infrared to illuminate the small hole;

[0068] The reference high-speed camera images the reference chopper plate through the third plane reflector 1-14 under good illumination, the tested product images the detection chopper plate through the parallel light tube system, and the detection high-speed camera captures the detection chopper plate image on the display screen of the tested product;

[0069] Through the image real-time preview / video switching module in the time synchronization and delay measurement software module, the image states captured by the detection high-speed camera 15 and the reference high-speed cameras 1-7 under the current environmental conditions are observed in real time, and the images of the detection chopper blades passing through the tested product and the images of the reference chopper blades not passing through the tested product are collected respectively;

[0070] Adjust the aperture and focal length of the high-speed camera 15 to make the image of the chopper blade in the real-time preview screen clearest, adjust the ROI (region of interest) range and center through the interface, align with the center of the chopper blade, and make all target holes on the chopper blade included in the ROI area, and update the ROI area;

[0071] The time synchronization and delay measurement software module of the control system synchronously triggers the detection high-speed camera 15 and the reference high-speed camera 1-7 to collect data, respectively taking f0, f0+N, f0+2N...frame images, and calling in the collected data; obtaining the corresponding reference point image angle α on the reference chopper film taken by the reference high-speed camera 1-7 00 , α 01 , α 02 ...and the detection high-speed camera 15 takes the image angle α of the corresponding reference point on the detection chopper plate through the product under test 14 10 , α 11 , α 12 ....

[0072] 3. Delay and synchronization measurement

[0073] Image measurement and analysis: adjust the thresholds of the two current images to the best value (no noise or missing images), perform detection and obtain the current angular velocity ω of the chopper blade;

[0074] Select one of the detection channels for detection, and observe the angle difference detection of the images taken by the reference high-speed cameras 1-7 and the detection high-speed camera 15 in real time on the display interface, and automatically calculate the angle difference |α of the corresponding frame of this set of data reference points 10 -α 00 |,|α 11 -α 01 |,|α 12 -α02 |... and get the angle difference mean α, according to the formula The signal processing delay t of a channel of the current product under test 14 can be calculated. In order to improve the accuracy of the result, ten or more groups of data can be collected and measured continuously to calculate the delay and take the average value;

[0075] In fusion mode, for the synchronization measurement of different channels, taking the low-light and thermal imaging channels as examples, the delay of the low-light single channel is measured according to the above method as t1, and the delay of the thermal imaging single channel is t2. Then the dual-channel time synchronization of the fused night vision imaging equipment is |t1-t2|.

[0076] 4. Data Management

[0077] By entering information including product name, test personnel, test unit and test time in the time synchronization and delay measurement software module, the current relevant information and data results can be saved so that the data can be checked and deleted later and a test report can be generated. Finally, the delay and synchronization measurement of a fusion imaging equipment was completed, and all the above switches and power supplies were turned off.

[0078] Based on the delay and synchronization measurement device of the fusion imaging equipment, the single-channel time delay and dual-channel time synchronization of the tested product are measured (in fusion mode) under the environment of frame rate of 1000fps, illumination of 20lx, rotation speed of 720° / s (2 turns / s), and heating temperature of 45°. The measurement results are shown in Table 1.

[0079] Table 1, Measurement data

[0080]

[0081] As shown in Table 1, the present invention can intuitively, accurately and quickly measure the single-channel time delay and dual-channel time synchronization of the fusion imaging equipment, and provide data support for evaluating the image quality of the fusion imaging equipment and understanding the basic performance of the fusion system.

[0082] Although the preferred embodiments of the present invention have been described, those skilled in the art may make other changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the present invention.

[0083] Obviously, those skilled in the art can make various changes and modifications to the embodiments of the present invention without departing from the spirit and scope of the embodiments of the present invention. Thus, if these modifications and variations of the embodiments of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims

1. A delay and synchronization measurement device for fusion imaging equipment, characterized in that: It includes a host, a control system, a product under test and a high-speed detection camera. The host is used to obtain target images under different environments. An optical path through hole is provided on the front shell of the host. The product under test is located in front of the host and is used to align the optical path through hole of the host and image the target. The high-speed detection camera is located in front of the product under test and is used to collect the image formed on the fusion imaging equipment to be tested. The control system is communicatively connected with the host and the high-speed detection camera, and the image data collected by the high-speed detection camera and the host are processed to realize the time synchronization and delay measurement of the fusion imaging equipment.

2. The delay and synchronization measurement device for fusion imaging equipment according to claim 1, characterized in that: The host is provided with a partition inside, one side of the partition is a test light path compartment, and the other side is a reference light path compartment, the test light path compartment is equipped with a parallel light tube system, a detection chopper and a backlight panel group, the reference light path compartment is equipped with a reference chopper, a visible light / infrared multi-band planar light source module, a speed control module, an illuminance meter probe, a third plane reflector and a reference high-speed camera, the third plane reflector is provided with a plurality of LED lamp beads, the imaging light path on the reference chopper is folded by the third plane reflector, and the image of the reference chopper is reflected to the reference On the imaging surface of the high-speed camera, the visible light / infrared multi-band planar light source module is used to control the temperature and illuminance of the environment near the detection chopper blade, the illuminometer probe is used to obtain the illuminance of the ambient light near the detection chopper blade, the detection chopper blade and the reference chopper blade are rigidly connected coaxially and in phase on the left and right sides of the partition, and are driven to rotate by the speed control module, the detection chopper blade is provided with a target hole group and a reference line, and the parallel light tube system projects the light beam of the rotating detection chopper blade target in parallel through the optical path through hole to the detector of the fusion imaging equipment to be tested.

3. The delay and synchronization measurement device for fusion imaging equipment according to claim 2, characterized in that: The parallel light tube system includes an off-axis parabolic mirror, a first plane reflector and a second plane reflector. The off-axis parabolic mirror is installed on the rear side of the test light path warehouse, corresponding to the light path through hole, the first plane reflector is installed on the left side of the test light path warehouse, and the second plane reflector is installed on the front side of the test light path warehouse. The off-axis parabolic mirror, the first plane reflector and the second plane reflector form a folded light path. The light beam on the detection chopper is projected onto the first plane reflector, and then projected onto the off-axis parabolic mirror through the folded light path. The light on the off-axis parabolic mirror is then projected onto the detector of the fusion imaging equipment to be tested through the light path through hole.

4. The delay and synchronization measurement device for fusion imaging equipment according to claim 2, characterized in that: The backlight panel group comprises a first backlight panel and a second backlight panel, wherein the first backlight panel is installed at the rear side of the test light path compartment, and the second backlight panel is installed at the left side of the test light path compartment.

5. The delay and synchronization measurement device for fusion imaging equipment according to claim 2, characterized in that: The detection chopper is circular and is provided with a plurality of target hole groups with the same center. The plurality of target hole groups are evenly distributed on the circumference, and the center of at least one target hole group is on the same straight line as the center of the reference line hole.

6. The delay and synchronization measurement device for fusion imaging equipment according to claim 5, characterized in that: The target hole groups are composed of a plurality of holes, the hole diameters of the holes gradually increase from the center of the circle along the radius, and the reference line is composed of a plurality of holes.

7. The delay and synchronization measurement device for fusion imaging equipment according to claim 2, characterized in that: The visible light / infrared multi-band planar light source module adopts a laminated structure, the inner layer is a controllable surface light source, which is a planar LED lamp bead combination arrangement, and the outer layer is an infrared heating source; the backlight panel of the backlight panel group has a built-in controllable surface light source, which has the same working illumination as the visible light / infrared multi-band planar light source module.

8. The delay and synchronization measurement device for fusion imaging equipment according to claim 2, characterized in that: The reference high-speed camera and the detection high-speed camera both have high-speed imaging capabilities; the reference high-speed camera is equipped with a fixed-focus lens, and the detection high-speed camera is equipped with a variable-focus lens, and the focusing range covers from the minimum imaging distance to infinity.

9. The delay and synchronization measurement device for fusion imaging equipment according to claim 1, characterized in that: Process the image data collected by the high-speed camera and the host to achieve time synchronization and delay measurement of the fusion imaging equipment, including: Get the image angle α of the corresponding reference point on the reference chopper film taken by the reference high-speed camera 00 , α 01 , α 02 ...and the corresponding reference point image angle α on the detection chopper film taken by the detection high-speed camera through the fusion imaging equipment 10 , α 11 , α 12 ...; Get the current angular velocity ω of the chopper; Calculate the angle difference |α between the reference point and the corresponding frame 10 -α 00 |,|α 11 -α 01 |,|α 12 -α 02 |..., and find the mean value of the angle difference α; according to Calculate the delay of fusion signal processing of different channels of the fusion imaging equipment to be tested; In fusion mode, the absolute value of the difference in processing delays of fusion signals of different channels is used as time synchronization.

10. A time delay and synchronization measurement method for fusion imaging equipment using the time delay and synchronization measurement device according to any one of claims 2 to 9, characterized in that: Includes steps: The backlight panel group, the visible light / infrared multi-band planar light source module and the speed control module are controlled by the control system, and the detection chopper blade and the reference chopper blade are driven by the speed control module to rotate at a uniform speed; The reference high-speed camera images the reference chopper plate under the adjusted illumination, the fusion imaging equipment under test images the detection chopper plate through the parallel light tube system, and the detection high-speed camera takes the image of the detection chopper plate on the fusion imaging equipment under test; The image data collected by the high-speed detection camera and the host are processed to achieve time synchronization and delay measurement of the fusion imaging equipment.

Images