Night vision projection apparatus for spatially multiplexing a visible light view and an infrared light view and method of using same

Abstract

The application discloses a night vision projection device capable of spatially multiplexing visible light view and infrared light view and a use method thereof, and belongs to the interweaving of visible light view and infrared light view. The night vision projection device comprises a double-path view input unit, a visible light parallel processing unit, an infrared light parallel processing unit, an optical light combining unit and a projection lens unit and the like. The double-path view input unit is connected with the visible light parallel processing unit and the infrared light parallel processing unit respectively. The visible light parallel processing unit and the infrared light parallel processing unit are connected with the optical light combining unit. The optical light combining unit is connected with the projection lens unit. The application has the beneficial effect that the visible light view image and the infrared light view image can be projected simultaneously.

Description

Technical Field

[0001] This invention relates to the interweaving of visible light and infrared light vision, and more particularly, to a night vision projection device that spatially multiplexes visible light and infrared light vision and its method of use. Background Technology

[0002] Chinese invention patent application CN107797371A, "Laser Projector with Night Vision Compatibility" (publication date: March 13, 2018), includes a method that automatically switches between day and night modes by arranging day and night mode phosphor wheels side-by-side and using a fine-tuning mechanism to control the switching path of the blue laser beam. In day mode, blue light excites R, G, B, and Y phosphors to achieve a wide color gamut. In night mode, O / G / B or A / G / B phosphors without infrared components are used, avoiding the 630–940nm wavelength band to ensure night vision compatibility. The drawback of this technical solution is that day and night modes are mutually exclusive, meaning that visible light and infrared light images cannot simultaneously appear on the projection screen. Summary of the Invention

[0003] The technical problem to be solved by the present invention is that existing night vision projection devices cannot project visible light and infrared light images at the same time. The present invention provides a night vision projection device and its method of use that spatially multiplexes visible light and infrared light images.

[0004] To solve the above-mentioned technical problems, the technical solution of the present invention is as follows: A night vision projection device that spatially multiplexes visible light and infrared light vision, comprising: a dual-channel vision input unit, a visible light parallel processing unit, an infrared light parallel processing unit, an optical combining unit, and a projection lens unit; the dual-channel vision input unit is configured to provide visible light vision signals and infrared light vision signals to the visible light parallel processing unit and the infrared light parallel processing unit, respectively; the visible light parallel processing unit is configured to output corresponding visible light signals to the optical combining unit according to the received visible light vision signals. The visible light beam and the infrared light parallel processing unit are configured to: output a corresponding infrared light beam to the optical combining unit based on the received infrared light visual signal; the optical combining unit is configured to: spatially combine the received visible light beam and the infrared light beam into a visible light-infrared light composite visual beam and output it to the projection lens unit; the projection lens unit is configured to: project the received visible light-infrared light composite visual beam onto a projection screen; wherein the visible light parallel processing unit and the infrared light parallel processing unit perform synchronous and coordinated processing. The beneficial effects include: simultaneously projecting visible light and infrared light visual images, suitable for professional scenarios such as aircraft night takeoff and landing training, vehicle-mounted driving night vision training, and nighttime urban simulated combat. Furthermore, the visible light parallel processing unit includes a visible light source, a visible light imaging driver chip, and a visible light imaging chip; the visible light source is configured to output a visible light source beam to the visible light imaging chip; the visible light imaging driver chip is configured to output a corresponding visible light imaging driver signal to the visible light imaging chip based on the received visible light scene signal; the visible light imaging chip is configured to output the visible light scene beam to the optical combining unit based on the received visible light source beam and the visible light imaging driver signal; the infrared light parallel processing unit includes an infrared light source, an infrared light imaging driver chip, and an infrared light imaging chip; the infrared light source is configured to output an infrared light source beam to the infrared light imaging chip; the infrared light imaging driver chip is configured to output a corresponding infrared light imaging driver signal to the infrared light imaging chip based on the received infrared light scene signal; the infrared light imaging chip is configured to output the infrared light scene beam to the optical combining unit based on the received infrared light source beam and the infrared light imaging driver signal. The beneficial effects are at least as follows: providing specific implementation schemes for the visible light parallel processing unit and the infrared light parallel processing unit.

[0005] As a preferred embodiment of a night vision projection device, the optical combining unit has a dichroic mirror or a polarizing combiner. The advantage lies at least in providing a specific implementation scheme for the optical combining unit.

[0006] As a preferred embodiment of the night vision projection device, it further includes: a mechanical fine-tuning mechanism configured to: adjust the position of the visible light parallel processing unit and / or the infrared light parallel processing unit, and / or adjust the angle of the optical combining unit. The beneficial effect is at least that it eliminates the influence of factors such as hardware processing precision, assembly errors, and differences in thermal expansion on the relative positions of the visible light and infrared light visual images among the visible light parallel processing unit, the infrared light parallel processing unit, and the optical combining unit.

[0007] Another technical solution of the present invention: a method of using a night vision projection device that spatially multiplexes visible light and infrared light vision, wherein the night vision projection device is selected from the above-mentioned night vision projection device, comprising: providing visible light vision signals and infrared light vision signals to the visible light parallel processing unit and the infrared light parallel processing unit respectively by the dual-channel vision input unit; the visible light parallel processing unit outputting a corresponding visible light vision beam to the optical combining unit according to the received visible light vision signal, and the infrared light parallel processing unit outputting a corresponding infrared light vision beam to the optical combining unit according to the received infrared light vision signal; the optical combining unit spatially combining the received visible light vision beam and the infrared light vision beam into a visible light-infrared light composite vision beam and outputting it to the projection lens unit; and the projection lens unit projecting the received visible light-infrared light composite vision beam onto a projection screen, so that the projection screen displays a visible light-infrared light composite vision image.

[0008] The beneficial effects are at least as follows: it can simultaneously project visible light and infrared light images, making it suitable for professional scenarios such as nighttime aircraft takeoff and landing training, vehicle-mounted driving night vision training, and nighttime urban simulated combat.

[0009] As a preferred embodiment of the method of use, it further includes: the visible light parallel processing unit and the infrared light parallel processing unit perform synchronous coordination processing, wherein the synchronous coordination processing includes: an input-side logic frame pairing step, a unit delay equalization step and / or an output-side frame latching coordination step.

[0010] The input-side logical frame pairing step includes: writing the visible light scene signal and the infrared light scene signal into independent buffers, and allowing simultaneous frame release only when both are ready and their respective logical frame sequence numbers are consistent.

[0011] The unit delay equalization step includes: calculating the processing delay L from frame release to the completion of image chip refresh for both the visible light link and the infrared light link. vis and L irBefore the combined light output, a release gate is set: the imaging chip refresh is triggered only when the frame timestamp difference |Δt| between the two current output frames is less than a threshold. Furthermore, if the infrared light link lags due to heavier PQ calculations, an equal amount of frame buffer is inserted into the visible light link, or hardware acceleration / reduction of non-critical algorithm orders is enabled for the infrared light link, so that L... vis ≈L ir .

[0012] The output-side frame latching coordination step includes: the frame updates of the visible light imaging chip and the infrared light imaging chip are controlled by the same pulse.

[0013] The beneficial effect is at least that the visible light visual image and the infrared visual image correspond to the same moment.

[0014] As a preferred embodiment of the method, the visible light and infrared light composite visual image undergoes soft alignment processing. This soft alignment processing includes: determining transformation parameters with respect to the visible light image coordinate system and the infrared light image coordinate system as a reference for geometric correction; and both the visible light parallel processing unit and the infrared light parallel processing unit employ a unified projection coordinate system + reference path and corrected path strategy during geometric correction. The reference path is selected from one of the visible light link and the infrared light link, while the corrected path is selected from the other of the visible light link and the infrared light link. The beneficial effect is at least that it achieves precise overlap between the visible light visual image and the infrared light visual image on the projection screen.

[0015] In addition to the technical problems solved by the present invention, the technical features constituting the technical solutions, and the beneficial effects brought about by the technical features of these technical solutions as described above, other technical problems that the present invention can solve, other technical features contained in the technical solutions, and the beneficial effects brought about by these technical features will be further explained in detail with reference to the accompanying drawings. Attached Figure Description

[0016] Figure 1 This is a schematic diagram of the structure of the night vision projection device of the present invention.

[0017] Figure 2 This is a flowchart of the method of using the night vision projection device of the present invention.

[0018] Figure 3 This is the data flow path of the night vision projection device of the present invention. Detailed Implementation

[0019] The present invention will now be described in further detail with reference to specific embodiments and accompanying drawings. It should be noted that these descriptions of embodiments are intended to aid in understanding the invention and do not constitute a limitation thereof. Furthermore, the technical features involved in the various embodiments of the present invention described below can be combined with each other as long as they do not conflict with each other.

[0020] See Figure 1 This application provides a night vision projection device that spatially multiplexes visible light and infrared light vision.

[0021] The night vision projection equipment described is suitable for night vision training scenarios with high requirements for display quality and system performance. For example, in aircraft night takeoff and landing training: the flight simulator needs to simultaneously display the runway lighting system (visible light) and ground thermal characteristics (infrared light). Another example is vehicle-mounted driving night vision training: the driver needs to simultaneously observe the road environment (visible light) and enemy targets (infrared light) while driving at night. Yet another example is nighttime urban simulated combat: the training ground needs to simultaneously display city streetlights, moonlight reflections, etc. (visible light) and personnel, vehicles, etc. (infrared light).

[0022] The night vision projection device includes: a dual-channel visual input unit, a visible light parallel processing unit, an infrared light parallel processing unit, an optical beam combining unit, and a projection lens unit. The dual-channel visual input unit is connected to both the visible light parallel processing unit and the infrared light parallel processing unit. Both the visible light parallel processing unit and the infrared light parallel processing unit are connected to the optical beam combining unit. The optical beam combining unit is connected to the projection lens unit. That is, the visible light parallel processing unit and the infrared light parallel processing unit share the optical beam combining unit and the projection lens unit.

[0023] The dual-channel visual input unit is configured to provide visible light visual signals and infrared light visual signals to the visible light parallel processing unit and the infrared light parallel processing unit, respectively.

[0024] In some embodiments, the visible light scene signal and the infrared light scene signal are both co-image signals.

[0025] In other embodiments, the visible light scene signal and the infrared light scene signal are both different scene signals.

[0026] The visible light parallel processing unit processes only the visible light scene signal and not the infrared light scene signal. The visible light parallel processing unit is configured to output a corresponding visible light scene beam to the optical combining unit based on the received visible light scene signal. Specifically, the visible light parallel processing unit includes a visible light source, a visible light imaging driver chip, and a visible light imaging chip. The visible light source is configured to output a visible light source beam to the visible light imaging chip. The visible light imaging driver chip is configured to output a corresponding visible light imaging driver signal to the visible light imaging chip based on the received visible light scene signal. The visible light imaging chip is configured to output the visible light scene beam to the optical combining unit based on the received visible light source beam and the visible light imaging driver signal.

[0027] The infrared parallel processing unit processes only the infrared light scene signal and not the visible light scene signal. The infrared parallel processing unit is configured to output a corresponding infrared light scene beam to the optical combining unit based on the received infrared light scene signal. Specifically, the infrared parallel processing unit includes an infrared light source, an infrared light imaging driver chip, and an infrared light imaging chip. The infrared light source is configured to output an infrared light source beam to the infrared light imaging chip. The infrared light imaging driver chip is configured to output a corresponding infrared light imaging driver signal to the infrared light imaging chip based on the received infrared light scene signal. The infrared light imaging chip is configured to output the infrared light scene beam to the optical combining unit based on the received infrared light source beam and the infrared light imaging driver signal.

[0028] The optical combining unit is configured to spatially combine the received visible light beam and the infrared light beam into a combined visible-infrared light beam and output it to the projection lens unit. Specifically, the optical combining unit has a dichroic mirror. The dichroic mirror is configured to reflect the visible light beam while simultaneously transmitting the infrared light beam, and the visible light beam and the infrared light beam after passing through the dichroic mirror are coaxial.

[0029] In some embodiments, the optical combining unit is replaced by a polarizing beam combiner. The polarizing beam combiner enables the spatial recombination of the visible light beam and the infrared light beam.

[0030] The projection lens unit is configured to project the received visible light and infrared light composite visual beam onto the projection screen, so that the projection screen displays the visible light and infrared light composite visual image, thereby achieving the purpose of simultaneously projecting visible light visual images and infrared light visual images.

[0031] An observer can see the visible light image with the naked eye, while the infrared image can be seen through night vision goggles. The visible light image and the infrared image are independent of each other and are displayed synchronously.

[0032] The hardware processing precision, assembly errors, and thermal expansion differences of the visible light parallel processing unit, the infrared light parallel processing unit, and the optical combining unit all affect the relative positions of the visible light and infrared light visual images. Therefore, the night vision projection device may further include a mechanical fine-tuning mechanism. This mechanism is configured to fine-tune the positions of the visible light parallel processing unit and the infrared light parallel processing unit, as well as the angle of the optical combining unit. Specifically, the mechanical fine-tuning mechanism includes a visible light precision translation stage (accuracy, for example, 0.1 mm), an infrared light precision translation stage (accuracy, for example, 0.1 mm), and a precision angle adjustment seat (accuracy, for example, 0.1°). The visible light imaging chip is mounted on the visible light precision translation stage. The visible light precision translation stage allows for fine-tuning of the visible light imaging chip's position in the X, Y, and Z directions. The infrared light imaging chip is mounted on the infrared light precision translation stage. The infrared light precision translation stage allows for fine-tuning of the infrared imaging chip's position in the X, Y, and Z directions. The dichroic mirror is mounted on the precision angle adjustment seat. This seat allows for angle fine-tuning of the dichroic mirror in two orthogonal directions, correcting the deviation in optical axis angle between the visible light beam and the infrared light beam.

[0033] The relative positions of the visible light image and the infrared image are affected by factors such as the thermal expansion of the projection lens unit. Therefore, the projection lens unit can employ a projection lens made of a material with a low coefficient of thermal expansion. Within the target projection distance range, the refraction of the visible light beam and the infrared image beam by the projection lens made of a material with a low coefficient of thermal expansion can achieve a dispersion error within one pixel.

[0034] Because visible light and infrared light have different spectral characteristics, the sensitivity of naked-eye observation and night vision goggles to different wavelengths of light also differs. Therefore, it is necessary to control the brightness ratio of the visible light and infrared light beams to ensure that the visible light and infrared light beams achieve an optimal balance in brightness. To this end, both the visible light and infrared light sources are equipped with independent brightness adjustments, and brightness balance adjustment settings are provided in the operating software. This ensures that the subjective brightness of the low-light environment seen by the naked eye is coordinated with that of the thermal target seen by the night vision goggles, and that the two gain adjustments do not overlap with each other's channels.

[0035] See Figure 2 This application provides a method for using a night vision projection device that spatially multiplexes visible light and infrared light visuals. The method includes: the dual-channel visual input unit providing visible light visual signals and infrared light visual signals to the visible light parallel processing unit and the infrared light parallel processing unit, respectively.

[0036] The visible light parallel processing unit outputs a corresponding visible light beam to the optical combining unit based on the received visible light visual signal. Similarly, the infrared light parallel processing unit outputs a corresponding infrared beam to the optical combining unit based on the received infrared light visual signal.

[0037] The optical combining unit spatially combines the received visible light beam and the infrared light beam into a visible-infrared composite beam and outputs it to the projection lens unit.

[0038] The projection lens unit projects the received visible light and infrared light composite visual beam onto the projection screen, so that the projection screen displays the visible light and infrared light composite visual image, thereby achieving the purpose of simultaneously projecting visible light visual images and infrared light visual images.

[0039] See Figure 3 The figure shows the data flow path of an embodiment of this application. First path before merging (visible light link): Visible light visual signal → Visible light video input interface → Geometric correction (Vis) → Visible light image processing → Visible light imaging driver chip → Visible light imaging chip. Second path before merging (infrared light link): Infrared light visual signal → Infrared light video input interface → Geometric correction (IR) → Infrared light image processing → Infrared light imaging driver chip → Infrared light imaging chip. Path after merging: Visible light imaging chip (infrared light imaging chip) → Optical combining unit → Projection lens unit → Projection screen → Observer.

[0040] An observer can see the visible light image with the naked eye, while the infrared image can be seen through night vision goggles. The visible light image and the infrared image are independent of each other and are displayed synchronously.

[0041] In some application scenarios, it is necessary to ensure that the visible light visual image and the infrared visual image correspond to the same moment. Therefore, the method of using the night vision projection device may further include: the visible light parallel processing unit and the infrared light parallel processing unit performing synchronous and coordinated processing.

[0042] The synchronization coordination process includes: input-side logical frame pairing steps, unit delay equalization steps, and output-side frame latching coordination steps.

[0043] The input-side logical frame pairing step includes writing the visible light scene signal and the infrared light scene signal into independent buffers. Simultaneous frame release is only allowed when both paths are ready and their respective logical frame numbers are identical. This avoids the situation where one path is processing frame N while the other is still stuck on frame N-1.

[0044] The unit delay equalization step includes: calculating the processing delay L from frame release to the completion of image chip refresh for both the visible light link and the infrared light link. vis and L ir Before combining and outputting the light, a release gate is set: the imaging chip refresh is triggered only when the frame timestamp difference |Δt| between the two currently output frames is less than a threshold (e.g., half a frame period). If the infrared light link lags due to heavier PQ calculations, an equivalent amount of frame buffer can be inserted into the visible light link, or hardware acceleration / reduction of non-critical algorithm orders can be enabled for the infrared light link, making L... vis ≈L ir .

[0045] The output-side frame latching coordination step includes: the frame updates of the visible light imaging chip and the infrared light imaging chip are controlled by the same pulse, ensuring that the visible light scene image and the infrared light scene image are switched / refreshed within the same projection cycle, preventing temporary spatial misalignment caused by one path updating first and the other path updating later.

[0046] Given that the mechanical fine-tuning mechanism still has sub-pixel residual deviations after hard alignment of the visible light scene image and the infrared light scene image, the method further includes: performing soft alignment on the visible light and infrared light composite scene image, with the aim of achieving precise overlap between the visible light scene image and the infrared light scene image on the projection screen.

[0047] The soft alignment process specifically includes: The transformation parameters between the visible light image coordinate system and the infrared light image coordinate system are determined as the benchmark for geometric correction. Calibration is performed at the factory or after field installation, configuring the visible light and infrared light visual signals into calibration patterns (e.g., checkerboard, crosshairs, or concentric circle arrays). The visible light and infrared calibration patterns are acquired by an external camera device or a built-in sensor. Corner points or phase-related feature points are extracted from the visible light and infrared calibration patterns respectively. Based on the corresponding feature points, the homography transformation matrix H (or affine transformation matrix A) from the visible light image coordinate system to the infrared light image coordinate system is solved, and optionally, radial and tangential distortion coefficients are estimated. After calibration, the homography transformation matrix H (or affine transformation matrix A) and distortion parameters can be written to a non-volatile storage area.

[0048] Both the visible light parallel processing unit and the infrared light parallel processing unit employ a unified projected coordinate system + reference path and rectified path strategy during geometric correction, rather than independently solving unrelated transformations for each path and outputting them separately. The reference path is selected from the visible light link. Identical mapping is performed, or only lens / optical path distortion is corrected for this path; the output pixel grid serves as the unified projected coordinate system, generally without additional translation / rotation warps. The rectified path is selected from the infrared light link. Warp remapping and bilinear / bicubic interpolation are performed on each frame according to H / A, mapping the infrared view pixels to a projection grid consistent with the reference path, ensuring that the two images are aligned at the same physical position on the screen after light combining.

[0049] In some embodiments, the reference path is selected from the infrared optical link, while the path being corrected is selected from the visible light link. It should be noted that due to the low-light effect inherent in real-world infrared night vision scenes, the rendered image does not exhibit numerous pixel-level image boundaries. Therefore, mapping the infrared scene to the visible light scene is a better approach.

[0050] Registration accuracy assessment and parameter update: In calibration or maintenance mode, the corrected visible light image and infrared image are overlaid, and the root mean square error of feature points or the peak value of cross-correlation in the overlapping area is calculated. When the error exceeds the 1-pixel threshold, recalibration or automatic iterative optimization (Δx, Δy, θ) is prompted. During normal operation, if changes in projection distance, temperature drift, or lens thermal deformation are detected that cause alignment degradation, parameter reloading or a limited number of automatic recalibrations can be triggered. The parameters are locked after the registration residual converges to within 1 pixel.

[0051] Thus, the mechanical fine-tuning mechanism completes the coarse alignment of the optical axis, and the soft alignment process completes the sub-pixel fine registration. The combination of the two satisfies the requirement for spatial consistency between the two images.

Claims

1. A night vision projection device that spatially multiplexes visible light and infrared light vision, characterized in that, include: The system comprises a dual-channel visual input unit, a visible light parallel processing unit, an infrared light parallel processing unit, an optical combining unit, and a projection lens unit. The dual-channel visual input unit is configured to provide visible light visual signals and infrared light visual signals to the visible light parallel processing unit and the infrared light parallel processing unit, respectively. The visible light parallel processing unit is configured to output a corresponding visible light visual beam to the optical combining unit based on the received visible light visual signal. The infrared light parallel processing unit is configured to output a corresponding infrared light visual beam to the optical combining unit based on the received infrared light visual signal. The optical combining unit is configured to spatially combine the received visible light visual beam and the infrared light visual beam into a visible light-infrared light composite visual beam and output it to the projection lens unit. The projection lens unit is configured to project the received visible light-infrared light composite visual beam onto a projection screen. The visible light parallel processing unit and the infrared light parallel processing unit perform synchronized and coordinated processing.

2. The night vision projection device according to claim 1, characterized in that, The visible light parallel processing unit includes a visible light source, a visible light imaging driver chip, and a visible light imaging chip. The visible light source is configured to output a visible light beam to the visible light imaging chip. The visible light imaging driver chip is configured to output a corresponding visible light imaging driver signal to the visible light imaging chip based on the received visible light scene signal. The visible light imaging chip is configured to output the visible light scene beam to the optical combining unit based on the received visible light source beam and the visible light imaging driver signal. The infrared light parallel processing unit includes an infrared light source, an infrared light imaging driver chip, and an infrared light imaging chip. The infrared light source is configured to output an infrared light beam to the infrared light imaging chip. The infrared light imaging driver chip is configured to output a corresponding infrared light imaging driver signal to the infrared light imaging chip based on the received infrared light scene signal. The infrared light imaging chip is configured to output the infrared light scene beam to the optical combining unit based on the received infrared light source beam and the infrared light imaging driver signal.

3. The night vision projection device according to claim 2, characterized in that, The optical combining unit has a dichroic mirror or a polarizing combiner.

4. The night vision projection device according to claim 2, characterized in that, Further includes: A mechanical fine-tuning mechanism is configured to: adjust the position of the visible light parallel processing unit and / or the infrared light parallel processing unit, and / or adjust the angle of the optical combining unit.

5. A method of using a night vision projection device that spatially multiplexes visible light and infrared light vision, wherein, The night vision projection device is selected from any one of claims 2 to 4, characterized in that it comprises: The dual-channel visual input unit provides visible light visual signals and infrared light visual signals to the visible light parallel processing unit and the infrared light parallel processing unit, respectively. The visible light parallel processing unit outputs a corresponding visible light scene beam to the optical combining unit based on the received visible light scene signal, and the infrared light parallel processing unit outputs a corresponding infrared light scene beam to the optical combining unit based on the received infrared light scene signal. The optical combining unit spatially combines the received visible light beam and the infrared light beam into a visible-infrared composite beam and outputs it to the projection lens unit; and... The projection lens unit projects the received visible light and infrared light composite visual beam onto the projection screen, so that the projection screen displays the visible light and infrared light composite visual image.

6. The method of use according to claim 5, characterized in that, Further includes: The visible light parallel processing unit and the infrared light parallel processing unit perform synchronous coordination processing, wherein the synchronous coordination processing includes: an input-side logic frame pairing step, a unit delay equalization step, and / or an output-side frame latching coordination step.

7. The method of use according to claim 6, characterized in that, The input-side logical frame pairing step includes: writing the visible light scene signal and the infrared light scene signal into independent buffers, and allowing simultaneous frame release only when both are ready and their respective logical frame sequence numbers are consistent.

8. The method of use according to claim 6, characterized in that, The unit delay equalization step includes: calculating the processing delay L from frame release to the completion of image chip refresh for both the visible light link and the infrared light link. vis and L ir Before combining and outputting the light, a release gate is set: the imaging chip is refreshed only when the frame timestamp difference |Δt| between the two current output frames is less than a threshold. If the infrared light link lags due to heavier PQ calculations, an equal amount of frame buffer is inserted into the visible light link, or hardware acceleration is enabled for the infrared light link or the order of non-critical algorithms is reduced, so that L... vis ≈L ir .

9. The method of use according to claim 6, characterized in that, The output-side frame latching coordination step includes: the frame updates of the visible light imaging chip and the infrared light imaging chip are controlled by the same pulse.

10. The method of use according to claim 5, characterized in that, The visible light and infrared light composite visual image is subjected to soft alignment processing, which includes: determining transformation parameters with respect to the visible light image coordinate system and the infrared light image coordinate system as a reference for geometric correction; and the visible light parallel processing unit and the infrared light parallel processing unit adopt a unified projection coordinate system + reference path and corrected path strategy during geometric correction; wherein the reference path is selected from one of the visible light link and the infrared light link, and the corrected path is selected from the other of the visible light link and the infrared light link.

Images