A time delay and synchronization measurement device and method for fusion imaging equipment

Abstract

The application provides a time delay and synchronization measuring device and method for fusion imaging equipment, which comprises a host, a control system, a measured product and a detection high-speed camera, the host is used for acquiring target images in different environments, a light path through hole is arranged on the front side shell of the host, the measured product is located in front of the host and is used for aligning the light path through hole of the host and imaging a target, the detection high-speed camera is located in front of the measured product and is used for collecting images formed on the measured product, the control system is in communication connection with the host and the detection high-speed camera, image data collected by the detection high-speed camera and the host is processed, and time synchronization and delay measurement of the fusion imaging equipment is realized. The application can intuitively, accurately and quickly measure single-channel time delay and double-channel time synchronization of the fusion imaging equipment, and provides data support for evaluating image quality of the fusion imaging equipment and understanding performance data of the fusion system.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of photoelectric detection and image signal processing, in particular to a delay and synchronization measurement device and method for fusion imaging equipment. BACKGROUND

[0002] Imaging systems play an important role in modern high-tech wars, and fusion night vision instruments, as a kind of instrument necessary in information-based night warfare, can provide combat personnel with clearer target observation and identification, detection and surveillance, thereby assisting combat command decision-making. However, due to the working characteristics of different imaging systems and the changes in working environment at any time, the complexity of image fusion algorithms, the differences in synchronization of different waveband image algorithm processing, and the influence of photoelectric detector performance and data transmission on system performance, the fusion imaging system will have a delay, resulting in inconsistency between the displayed image, especially the image with large scene changes, and the real image, and separation of the display of different waveband images, affecting the image fusion and the overall display quality of the system.

[0003] Chinese patent CN110933397A "High-precision imaging delay test device and method", by aligning the imaging device to be measured with a circularly lit LED light source array for imaging output, and detecting the position of the lit LED in the effective output video of the imaging device by a video processing detection module, the imaging start time is obtained, and the imaging delay of the imaging device is obtained by comparing the time difference between the video effective output time and the imaging start time.

[0004] Chinese patent CN109489940A "Method for measuring precise delay of optical imaging system", the entire optical imaging system is regarded as a black box, by establishing a simulated scene, the light source and the camera are started synchronously, the accurate input time of the scene signal is obtained, then by recording the input time of the scene signal and the output time of the final data, the time difference between the two time points is recorded by an oscilloscope to obtain the system delay.

[0005] However, the prior art has the following disadvantages:

[0006] (1) It is mainly for imaging delay measurement of general imaging devices, and the delay and synchronization measurement technology based on infrared and visible light fusion imaging equipment is not studied;

[0007] (2) It cannot effectively simulate the imaging conditions of dynamic targets, and is not comprehensive enough in simulating real imaging environments;

[0008] (3) It cannot accurately grasp the influence of system errors of infrared and visible light fusion imaging equipment on the test;

[0009] (4) The method is not extensive, and the flexibility of generalization is not flexible when dealing with different types of imaging devices and different imaging conditions.

[0010] Therefore, further experimental research and exploration of a precise measurement technique suitable for the time delay index of a fusion imaging system is an important problem to be solved, which is not only helpful to improve the performance of the imaging system, but also has important significance and practical application value for promoting the development of modern high technology. SUMMARY

[0011] The purpose of the present application is to provide a time delay and synchronization measurement device and method for fusion imaging equipment, which overcomes the defects of the prior art and can intuitively, accurately and quickly measure the single-channel time delay and double-channel time synchronization of fusion imaging equipment, providing data support for evaluating the image quality of fusion imaging equipment and understanding the performance of the fusion system, and further improving the practicality of the fusion system.

[0012] The technical solution for achieving the purpose of the present application is as follows:

[0013] A time delay and synchronization measurement device for fusion imaging equipment, comprising a host computer, a control system, a measured product and a detection high-speed camera, the host computer is used to obtain target images in different environments, a light path through hole is provided on the front side shell of the host computer, the measured product is located in front of the host computer and is used to align the light path through hole of the host computer and image the target, the detection high-speed camera is located in front of the measured product and is used to collect the images formed on the measured product, the control system is in communication connection with the host computer and the detection high-speed camera, processes the image data collected by the detection high-speed camera and the host computer, and realizes the measurement of the time synchronization and time delay of the fusion imaging equipment. The synchronization degree of the image fusion system refers to the time difference of the delay from the reception of different waveband images (low-light image / infrared image) by different channel detectors to the output of the image fusion system to the display screen.

[0014] Further, a partition is provided inside the host computer, one side of the partition is a test light path compartment and the other side is a reference light path compartment, a parallel light tube system, a detection chopper and a backlight panel group are installed in the test light path compartment, a reference chopper, a visible light / infrared multi-waveband planar light source module, a rotation speed control module, an illuminance meter probe, a third planar mirror and a reference high-speed camera are installed in the reference light path compartment, a plurality of LED lamp beads are provided on the third planar mirror, the imaging light path of the reference chopper is folded through the third planar mirror, and the image of the reference chopper is reflected to the imaging surface of the reference high-speed camera, the visible light / infrared multi-waveband planar light source module is used to control the temperature and illuminance of the environment near the detection chopper, the illuminance meter probe is used to obtain the ambient illuminance near the detection chopper, the detection chopper and the reference chopper are coaxially and in phase rigidly connected to the left and right sides of the partition and are driven to rotate by the rotation speed control module, a target hole group and a reference line are provided on the detection chopper, and the parallel light tube system projects the light beam of the rotating detection chopper target through the light path through hole to the detector of the fusion imaging equipment to be measured.

[0015] Further, the parallel light pipe system comprises an off-axis parabolic mirror, a first plane mirror and a second plane mirror, the off-axis parabolic mirror is installed at the back side of the test light path chamber corresponding to the light path through hole, the first plane mirror is installed at the left side of the test light path chamber, and the second plane mirror is installed at the front side of the test light path chamber, the off-axis parabolic mirror, the first plane mirror and the second plane mirror form a folded light path, the light beam on the detection chopper is projected onto the first plane mirror, and then projected onto the off-axis parabolic mirror through the folded light path, and the light on the off-axis parabolic mirror is projected onto the detector of the to-be-tested fusion imaging equipment through the light path through hole.

[0016] Further, the backlight panel group comprises a first backlight panel and a second backlight panel, the first backlight panel is installed at the back side of the test light path chamber, and the second backlight panel is installed at the left side of the test light path chamber.

[0017] Further, the detection chopper is circular, and a plurality of target hole groups with the same center are arranged on the detection chopper, the plurality of target hole groups are uniformly distributed on the circumference, and the center of at least one target hole group is on the same straight line as the center of the reference line hole.

[0018] Further, each target hole group is composed of a plurality of holes, the aperture of the hole gradually increases from the center to the radius, the reference line is composed of a plurality of holes, and the center of at least one target hole group is on the same straight line as the center of the reference line hole.

[0019] Further, the visible light / infrared multi-band plane light source module adopts a laminated structure, the inner layer is a controllable surface light source, the plane LED lamp beads are combined and arranged, and the outer layer is an infrared heating source; the backlight panel of the backlight panel group is built-in controllable surface light source, and the working illuminance is the same as that of the visible light / infrared multi-band plane light source module.

[0020] Further, the reference high-speed camera and the detection high-speed camera both have high-speed imaging function; the reference high-speed camera is equipped with a fixed focal length lens, and the detection high-speed camera is equipped with a variable focal length lens and the focusing range covers from the minimum imaging distance to infinity.

[0021] Further, the image data collected by the detection high-speed camera and the host is processed to realize the measurement of time synchronization and delay of the fusion imaging equipment, and the specific steps include:

[0022] obtaining the corresponding reference point image angles α 00 , α 01 , α 02 ... and the corresponding reference point image angles α 10 , α 11 , α 12...;

[0023] acquire the current angular velocity ω of the chopper plate;

[0024] calculate the angular difference |α 10 -α 00 |, |α 11 -α 01 |, |α 12 -α 02 |... and the average angular difference α;

[0025] according to calculate the different channel fusion signal processing delay of the current to-be-measured fusion imaging equipment;

[0026] In the fusion mode, the absolute value of the difference between the different channel fusion signal processing delays is taken as the time synchronization.

[0027] A delay and synchronization measurement method of a fusion imaging equipment, comprising the steps of:

[0028] The backlight panel group, the visible light / infrared multi-waveband plane light source module and the speed control module are controlled by the control system to detect the uniform rotation of the chopper plate and the reference chopper plate under the driving of the speed control module.

[0029] The reference high-speed camera images the reference chopper plate under the adjusted illumination, and the to-be-measured fusion imaging equipment images the detection chopper plate through the parallel light tube system, and the detection high-speed camera shoots the image of the detection chopper plate on the to-be-measured fusion imaging equipment.

[0030] The image data collected by the detection high-speed camera and the host computer are processed to realize the measurement of the time synchronization and the delay of the fusion imaging equipment.

[0031] Compared with the prior art, the beneficial effects of the present application are as follows:

[0032] (1) The measurement method based on space-time projection is adopted, the spatial phase information of the chopper system is ingeniously utilized, the target is projected to the reflection type parallel light tube system of the primary and secondary mirrors off-axis, the infinite target rotating at a constant speed is formed, the image quality is better, and the functions of folding the light path and reducing the system volume are realized.

[0033] (2) The background light source illumination following is adopted, the same order of magnitude light is supplemented in the entire field of view of the measured product, and the influence of the global automatic gain of the measured product on the image detection is eliminated.

[0034] (3) The target holes on the chopper system are designed with different aperture groups, and the same diameter target holes can realize three times of detection, the centroid positioning precision calculation method is adopted, and the system detection precision is improved.

[0035] (4) Can simulate real complex imaging environment, in dynamic target simulation, synchronous measurement, software hardware complexity, system universality and universality, result accuracy and real-time, more comprehensive and efficient. BRIEF DESCRIPTION OF DRAWINGS

[0036] Figure 1 The figure is a time delay and synchronous measurement device of a fusion imaging equipment;

[0037] Figure 2 The figure is a reference point angle difference measurement method principle of a time delay and synchronous measurement device of a fusion imaging equipment;

[0038] Figure 3 The figure is a detection chopper plate of a time delay and synchronous measurement device of a fusion imaging system;

[0039] Figure 4 The figure is a centroid positioning accuracy calculation method flow chart of the application;

[0040] Figure 5 The figure is a control system and other equipment connection diagram.

[0041] Reference signs:

[0042] 1: host, 2: control system, 1-1: first plane mirror; 1-2: second plane mirror; 1-3: off-axis parabolic mirror; 1-4: chopper system; 1-5: first backlight; 1-6: illuminometer probe; 1-7: reference high-speed camera; 1-9: dust cover; 1-10: front shell; 1-11: rear shell; 1-12: right shell; 1-13: second backlight, 1-14: third plane mirror; 14: measured product; 15: detection high-speed camera; 16: communication line. DETAILED DESCRIPTION

[0043] The application will be described in detail below in combination with the drawings and examples, specifically taking a fusion night vision imaging equipment as a measured product, which is intended to explain the application, and cannot be understood as a limitation of the application.

[0044] The application provides a time delay and synchronous measurement device of a fusion imaging equipment, which realizes design index time delay test precision ≤0.65ms, time synchronization test precision ≤1.3ms, combines Figure 1The device comprises a host 1, a control system 2, a measured product 14 and a detection high-speed camera 15, the host 1 is in communication connection with the control system 2 to obtain target images under different environments; the measured product 14 is located in front of the host 1 to align the light path hole of the host and image the target, the detection high-speed camera 15 is located in front of the measured product 14 to collect images on the display screen of the measured product 14, the detection high-speed camera 15 is in communication connection with the control system 2, the control system 2 is located on the right side of the host 1 to process the image data collected by the detection high-speed camera 15 and the host 1, and finally realize the measurement of time synchronization and delay of the measured product according to the image reference point angle difference measurement method.

[0045] The measured product is a fusion imaging equipment, for example, a fusion night vision device.

[0046] The host 1 is internally provided with a partition, the left side of the partition is a test light path bin, the right side is a reference light path bin, each part (including the inner surface of the host, the mounting part) in the bin is subjected to light extinction treatment and uniformly aluminum natural oxidation to form a diffuse reflection cavity, the test light path bin is internally provided with a collimator system, a detection chopper and a first backlight plate 1-5 and a second backlight plate 1-13, the reference light path bin is internally provided with a reference chopper, a visible light / infrared multi-band plane light source module, a rotating speed control module, an illuminometer probe 1-6, a third plane mirror 1-14 and a reference high-speed camera 1-7; the detection chopper, the reference chopper, the visible light / infrared multi-band plane light source module and the rotating speed control module constitute a chopper system 1-4, the rotating speed control module mainly comprises a stepping motor and a motor driver. At the same time, the host combines a dust cover 1-9, a front shell 1-10, a rear shell 1-11, a left shell, a right shell 1-12, an upper shell and a lower shell to form a labyrinth sealing type box body to prevent stray light from entering the bin and greatly improve the system detection precision. The dust cover 1-9 is installed on the light path through hole of the front shell 1-10, the front shell 1-10, the rear shell 1-11 and the lower shell are integrated, and the left shell, the right shell 1-12 and the upper shell are integrated.

[0047] In order to reduce the volume, the system adopts twice folding for off-axis reflection collimator, the collimator system comprises off-axis parabolic mirror 1-3, first plane mirror 1-1 and second plane mirror 1-2, the off-axis parabolic mirror 1-3 is installed on the rear shell of the main machine, the first plane mirror 1-1 is installed on the left side of the test light path warehouse, the second plane mirror 1-2 is installed on the front shell of the main machine, the first backlight plate 1-5 is installed on the rear shell in the warehouse body, the second backlight plate 1-13 is installed on the left shell of the main machine 1, and the background light source is used as a background light source for the test light path warehouse to provide brightness adjustment, and the same order of magnitude is provided for the whole measured product field of view, and the influence of global automatic gain of the measured product on image detection is eliminated; the off-axis parabolic mirror 1-3, the first plane mirror 1-1 and the second plane mirror 1-2 form a folded light path, the detection chopper target rotating at a constant speed is projected to infinity, and then the light is projected to the detector of the measured product 14 in the alignment main machine light path, so that the image plane of the target on the detector is parallel to the real object.

[0048] The detection chopper and the reference chopper are coaxially and in phase rigidly connected on the left and right sides of the partition, and are driven by the rotation speed control module, simulating the target moving in different environments; the visible light / infrared multi-band plane light source module controls the temperature and illuminance of the environment near the detection chopper, and combines the backlight plate light source to give the illuminance and temperature of the detection environment, so that the wide spectrum light source transmits through the small hole on the detection chopper and the environment to form visible light and infrared targets with contrast; the illuminometer probe 1-6 displays and reads the current environmental illuminance reading in real time; a plurality of LED lamp beads are arranged on the third plane mirror 1-14, providing good light brightness, and the imaging light path on the reference chopper is folded through the third plane mirror, reflecting the image of the reference chopper to the imaging surface of the reference high-speed camera 1-7, collecting the image data of the reference chopper, and providing a stable reference image for experimental measurement.

[0049] As shown in Figure 3 The detection chopper is driven to rotate by the rotation speed control module, contains different aperture groups and is accurately designed to open mutually at 120° at the same aperture angle, so as to distinguish three target holes of the same diameter by the reference line, adopts a double-wheel synchronous design, the reference chopper and the detection chopper adopt a coaxial structure, the rotation speeds of the two are the same, the opening positions are strictly calibrated, and the same frequency and phase are achieved. The detection chopper faces the collimator system and is enclosed in the main machine test light path warehouse, has wide spectrum light source illumination, and the visible light illuminance is adjustable; the reference chopper faces away from the collimator system and is enclosed in the main machine reference light path warehouse with good visible light illumination conditions. As shown in Figure 5As shown, the control system 2 realizes the rotation speed control of the chopping blade by sending control instructions to the rotation speed control module; the control system is in communication connection with the visible light / infrared multi-band plane light source module, the first backlight plate 1-5 and the second backlight plate 1-13 through RS232, realizes the control of the ambient light intensity and the background light source intensity near the detection chopping blade and the temperature control by sending current or temperature data to the visible light / infrared multi-band plane light source module, the first backlight plate 1-5 and the second backlight plate 1-13, reads the illumination reading of the illuminometer probe 1-6 in real time and displays, so that the wide spectrum light source transmits through the small hole and forms the visible light and infrared target with contrast with the environment.

[0050] The reference chopping blade can adopt the existing chopping blade or can be basically consistent with the structure of the detection chopping blade, and three holes which are 120° apart from each other are arranged on the reference chopping blade.

[0051] The visible light / infrared multi-band plane light source module adopts a laminated structure, the inner layer is a controllable surface light source, and the outer layer is an infrared heating source. The controllable surface light source is arranged in combination of plane LED lamp beads, adopts PMW (pulse width modulation) technology and constant current source driving control technology, the PMW can provide a dynamic adjustment range of three orders of magnitude, the constant current source driving control can provide a dynamic adjustment range of two orders of magnitude, the dynamic adjustment range of brightness reaches more than five orders of magnitude, and the working illumination range reaches 5×10 -4 lx-50lx; the infrared source provides a higher temperature than the chopping system; the working temperature of the high-temperature resistant LED lamp bead can reach more than 85℃, and can bear the heating requirement of the infrared source; the infrared source temperature is controlled at about 45℃, can provide radiation with a peak wavelength of 9.1μm, and the radiation range is more than 0.4μm-12μm.

[0052] As shown in Figure 1 Because the field of view of the chopping blade is limited and cannot fill the field of view of the large field of view fusion imaging system, the first backlight plate 1-5 and the second backlight plate 1-13 adopt the background light source intensity following, the same order of magnitude of the surface LED environment spectrum compensation light source is arranged in the field of view of the whole measured product 14, the influence of the global automatic gain of the large field of view measured product 14 on the detection is eliminated, and accurate detection is realized; the first backlight plate 1-5 and the second backlight plate 1-13 are built-in controllable surface light sources, the controllable surface light source is arranged in combination of plane LED lamp beads, the working illumination of the first backlight plate 1-5 and the second backlight plate 1-13 is the same as that of the visible light / infrared multi-band plane light source module, and the illumination range is 5×10 -4 lx-50lx.

[0053] The detection chopper is projected to the reflection type parallel light tube system off the primary and secondary mirrors, the light emitted after the detection chopper is equivalent to the parallel light from the infinite distance, and the detection chopper is equivalent to the target at the infinite distance, then the light is projected to the detector of the measured product, the image plane of the detection chopper on the detector is parallel to the real object, and after the image fusion system processing, the output is displayed on the display screen.

[0054] The reference high-speed camera 1-7 and the detection high-speed camera 15 adopt the same high-speed camera, which can output 1280*800 pixels at 2500fps, and the spectral response range is more than 0.4-1um, the lens of the reference high-speed camera 1-7 adopts an 8mm fixed-focus lens, which can clearly image the reference chopper under good illumination; the detection high-speed camera 15 adopts an 8mm-50mm zoom lens, which can realize clear imaging of the display screen of the measured fusion equipment by adjusting the zoom, and the minimum imaging distance of the lens of the detection high-speed camera 15 and the reference high-speed camera 1-7 is 0.3m, and the focusing range is 0.3m-infinity.

[0055] The control system 2 is composed of an industrial computer, a display and a power system, a time synchronization and delay measurement software module is installed on the operating system of the industrial computer, in order to facilitate operation and improve space utilization, the industrial computer, the display and the power system are uniformly installed in the cabinet, the CPU model parameter of the industrial computer is i78550U, and the industrial computer is connected with other components through a communication line 16. The control system sends control instructions through a serial port, and processes the image data collected by the detection high-speed camera and the reference high-speed camera through the time synchronization and delay measurement software module. As shown in Figure 5 , the two high-speed cameras are connected to the RS485 interface of the industrial computer for communication, and the control synchronization trigger is used for collection; the visible light / infrared multi-band plane light source module is connected to the RS232 interface of the industrial computer for serial communication; the motor is connected to the RS485 interface of the industrial computer for serial communication, and the rotation speed is controlled; the light intensity meter probe is connected to the industrial computer through a USB-to-serial port.

[0056] As shown in Figure 2 , the control system synchronously triggers the two high-speed cameras to complete high-speed synchronous shooting of the images of the detection chopper and the reference chopper respectively, and outputs two images to the time synchronization and delay measurement software module at the same time, and the time synchronization and delay measurement software module processes the images. As shown in Figure 4As shown, the present application uses the centroid positioning accuracy calculation method to extract the centroids of each target hole, calculate the angle of each centroid relative to the center, and find the reference line on the detection chopper. Since the angle between the three main lines of the detection chopper is 120° when designed, and the angle between the two main lines outside the same straight line and the reference line is 60°, the corresponding three main lines can be determined based on this angle constraint. Then, the centroids are grouped by the same diameter based on the distance between the centroid and the center, the angle difference of the corresponding frame target reference point is calculated, and finally, the imaging delay and synchronization measurement analysis and evaluation of the measured product 14 are realized based on the angle difference measurement method, and a detection report is generated.

[0057] The detailed measurement method of the present application is as follows:

[0058] (1) Install the detection high-speed camera 15 and check to ensure that each module is connected correctly;

[0059] (2) Turn on the measured product 14 and adjust it to the mode to be measured, place it in alignment with the target at infinity, i.e. the detection chopper, and adjust the imaging of the measured product 14 to the target to be clear, and align the detection high-speed camera 15 with the ocular lens of the measured product 14;

[0060] (3) Turn on the control power supply, the detection high-speed camera 15 switch and the illuminance meter probe 1-6 switch, and enter the following measurement process:

[0061] 1. Motor, visible light / infrared multi-band planar light source control

[0062] Motor control: click start / stop to control the motor to drive the two coaxial choppers to rotate or stop, and the rotation speed is variable;

[0063] Illuminance control and reading: input current parameters to the visible light / infrared multi-band planar light source and background environment supplementary light source of the detection chopper, control the illuminance (note to shield the box and indoor environmental stray light), and the time synchronization and delay measurement software module reads and displays the current environmental illuminance reading in real time through the illuminance meter probe 1-6;

[0064] Infrared heating control: control the heating of the detection chopper and prompt the current heating on / off state.

[0065] 2. Video acquisition

[0066] In combination with process 1, set the motor, backlight, visible light / infrared multi-band planar light source, control the required light conditions, temperature environment and target speed, and synchronously trigger the reference high-speed camera and the detection high-speed camera at a certain moment, and the two cameras acquire chopper images at the same time;

[0067] The chopper plate is controlled to rotate at a constant speed by the motor, and small holes are opened on the chopper plate as target reference points; a wide spectrum light source covers the spectrum range from visible light to long-wave infrared to illuminate the small holes;

[0068] The reference high-speed camera images the reference chopper plate through the third plane mirror 1-14 under good illumination, and the measured product images the detection chopper plate through the parallel light tube system, and the detection high-speed camera shoots the image of the detection chopper plate on the display screen of the measured product;

[0069] The image state of the detection high-speed camera 15 and the reference high-speed camera 1-7 is observed in real time under the current environmental conditions, and the image of the detection chopper plate passing through the measured product and the image of the reference chopper plate not passing through the measured product are collected respectively through the image real-time preview / video switching module in the time synchronization and delay measurement software module;

[0070] The aperture and focal length of the detection high-speed camera 15 are adjusted to the most clear image of the detection chopper plate in the real-time preview picture, the ROI (region of interest) range and center are adjusted through the interface, the center of the detection chopper plate is aligned, and all the target holes on the chopper plate are contained in the ROI area, and the ROI area is updated;

[0071] The detection high-speed camera 15 and the reference high-speed camera 1-7 are triggered synchronously for one data collection through the time synchronization and delay measurement software module of the control system, and the f0, f0+N, f0+2N... frames of images are taken and the collected data are adjusted; the corresponding reference point image angles α 00 , α 01 , α 02 ... of the reference chopper plate shot by the reference high-speed camera 1-7 and the corresponding reference point image angles α 10 , α 11 , α 12 ... of the detection chopper plate shot by the detection high-speed camera 15 through the measured product 14 are obtained.

[0072] 3. Delay and synchronization measurement

[0073] Image measurement analysis: adjust the threshold values of the current two images to the best (no noise and no missing in imaging) respectively, detect and obtain the current angular velocity ω of the chopper plate;

[0074] Select one of the detection channels for detection, and real-time visualization is performed on the display interface to observe the image angle difference detection of the reference high-speed camera 1-7 and the detection high-speed camera 15 shot in real time, and the angular difference |α 10 -α 00 |, |α 11 -α 01 |, |α 12 -α02 |... and the average angle difference a is obtained, according to the formula The channel fusion signal processing delay t of the current measured product 14 can be calculated. In order to improve the accuracy of the result, ten groups of data or more can be continuously collected to calculate the delay and take the average value;

[0075] In the fusion mode, for the synchronization measurement of different channels, taking the micro-light and thermal imaging channels as examples, the micro-light single-channel delay t1 and the thermal imaging single-channel delay t2 are measured according to the above method, and the dual-channel time synchronization of the fusion night vision imaging equipment is |t1-t2|.

[0076] 4. Data management

[0077] By entering the information including the product name, the detection personnel, the detection unit and the detection time into the time synchronization and delay measurement software module, the current related information and data results are saved, so that the subsequent data searching and deleting operations can be performed, and the detection report can be generated. Finally, the delay and synchronization measurement of a fusion imaging equipment is completed, and all the switches and power supplies are turned off.

[0078] Based on the delay and synchronization measurement device of the fusion imaging equipment, the single-channel time delay and the dual-channel time synchronization of the measured product are measured (in the fusion mode) under the conditions of 1000 fps of frame rate, 20 lx of illumination, 720° / s (2 circles / s) of rotation speed and 45° of heating temperature. The measurement results are shown in Table 1.

[0079] Table 1, measurement data

[0080]

[0081] As shown in Table 1, the single-channel time delay and the dual-channel time synchronization of the fusion imaging equipment can be intuitively, accurately and quickly measured, which provides data support for evaluating the image quality of the fusion imaging equipment and understanding the performance of the fusion system.

[0082] Although the preferred embodiments of the present application have been described, those skilled in the art can make further changes and modifications to the embodiments once they know the basic inventive concept. Therefore, the appended claims are intended to be interpreted as including all the changes and modifications falling within the scope of the present application.

[0083] Obviously, those skilled in the art can make various modifications and variations to the embodiments of the present application without departing from the spirit and scope of the embodiments of the present application. Thus, if these modifications and variations of the embodiments of the present application fall within the scope of the claims of the present application and their equivalent technologies, the present application also intends to include these modifications and variations.

Claims

1. A delay and synchronization measurement device for a fusion imaging equipment, characterized in that, The system includes a host, a control system, a product under test, and a high-speed camera. The host is used to acquire target images under different environments. It has an optical path through hole on its front housing. The product under test is located in front of the host and is used to align with the optical path through hole of the host and image the target. The high-speed camera is located in front of the product under test and is used to acquire images formed on the fusion imaging equipment under test. The control system is communicatively connected to the host and the high-speed camera and processes the image data acquired by the high-speed camera and the host to realize the time synchronization and delay measurement of the fusion imaging equipment. The host unit has an internal partition, with a test optical path compartment on one side and a reference optical path compartment on the other. The test optical path compartment contains a collimator system, a detection chopper, and a backlight assembly. The reference optical path compartment contains a reference chopper, a visible / infrared multi-band planar light source module, a speed control module, an illuminance meter probe, a third plane mirror, and a reference high-speed camera. The third plane mirror is equipped with multiple LED beads. The imaging optical path on the reference chopper is folded by the third plane mirror, reflecting the image from the reference chopper onto the reference camera. On the imaging surface of the high-speed camera, the visible light / infrared multi-band planar light source module is used to control the temperature and illuminance of the environment near the detection chopper. The illuminance meter probe is used to acquire the illuminance of the environment near the detection chopper. The detection chopper and the reference chopper are rigidly connected coaxially and in phase on the left and right sides of the partition and are driven to rotate by the rotation speed control module. The detection chopper is provided with a target hole group and a reference line. The collimator system projects the beam of light from the rotating detection chopper target into the detector of the fusion imaging equipment under test through the optical path through hole.

2. The delay and synchronization measurement device for a fusion imaging equipment according to claim 1, characterized in that, The collimator system includes an off-axis parabolic mirror, a first plane mirror, and a second plane mirror. The off-axis parabolic mirror is installed on the rear side of the test optical path chamber, corresponding to the optical path through-hole. The first plane mirror is installed on the left side of the test optical path chamber, and the second plane mirror is installed on the front side of the test optical path chamber. The off-axis parabolic mirror, the first plane mirror, and the second plane mirror form a folded optical path. The light beam on the detection chopper is projected onto the first plane mirror, and then projected onto the off-axis parabolic mirror through the folded optical path. The light beam on the off-axis parabolic mirror is then projected onto the detector of the fusion imaging equipment under test through the optical path through-hole.

3. The delay and synchronization measurement device for a fusion imaging equipment according to claim 1, characterized in that, The backlight assembly includes a first backlight and a second backlight. The first backlight is installed on the rear side of the test optical path compartment, and the second backlight is installed on the left side of the test optical path compartment.

4. The delay and synchronization measurement device for a fusion imaging equipment according to claim 1, characterized in that, The detection chopper is circular and has multiple target hole groups with the same center. The multiple target hole groups are evenly distributed on the circumference, and the center of at least one target hole group is on the same straight line as the center of the reference line hole.

5. The delay and synchronization measurement device for a fusion imaging equipment according to claim 4, characterized in that, Each target hole group consists of multiple holes, and the diameter of the holes gradually increases from the center along the radius. The reference line is composed of multiple holes.

6. The delay and synchronization measurement device for a fusion imaging equipment according to claim 1, characterized in that, The visible light / infrared multi-band planar light source module adopts a layered structure, with the inner layer being a controllable surface light source, which is a combination of planar LED beads, and the outer layer being an infrared heating source; the backlight panel of the backlight panel assembly has a built-in controllable surface light source, which has the same working illuminance as the visible light / infrared multi-band planar light source module.

7. The delay and synchronization measurement device for a fusion imaging equipment according to claim 1, characterized in that, Both the reference high-speed camera and the detection high-speed camera have high-speed imaging capabilities; the reference high-speed camera is equipped with a fixed focal length lens, and the detection high-speed camera is equipped with a variable focal length lens with a focusing range covering from the minimum imaging distance to infinity.

8. The delay and synchronization measurement device for a fusion imaging equipment according to claim 1, characterized in that, The image data acquired by the high-speed camera and the host computer are processed to achieve time synchronization and delay measurement of the fusion imaging equipment. Specifically, this includes: Obtain the angle α of the corresponding reference point image on the reference chopper captured by the reference high-speed camera. 00 α 01 α 02 ...and the angle α of the corresponding reference point image on the detection chopper captured by the detection high-speed camera through a fusion imaging device. 10 α 11 α 12 ...; Get the current angular velocity ω of the chopper; Calculate the angle difference |α| between the reference point and the corresponding frame. 10 -α 00 |,|α 11 -α 01 |,|α 12 -α 02 ... and calculate the mean angle difference α; according to The processing delay of the fusion signal in different channels of the fusion imaging equipment under test is calculated. In fusion mode, the absolute value of the difference in signal processing delay between different channels is used as the time synchronization.

9. A delay and synchronization measurement method for a fusion imaging device employing any one of the delay and synchronization measurement devices described in claims 1-8, characterized in that, Including the following steps: The backlight assembly, visible light / infrared multi-band planar light source module and speed control module are controlled by the control system to detect the uniform rotation of the chopper and the reference chopper under the drive of the speed control module. The reference high-speed camera images the reference chopper under the adjusted illumination, the test fusion imaging equipment images the test chopper through the collimator system, and the test high-speed camera captures the image of the test chopper on the test fusion imaging equipment. The image data acquired by the high-speed camera and the host are processed to achieve time synchronization and delay measurement of the fusion imaging equipment.

Images