Visible light-short wave infrared synchronous imaging device and method

By designing visible-short-wave infrared synchronous imaging equipment, synchronous imaging of short-wave infrared and visible light is achieved using beam splitters and filter wheels, the problem of poor imaging effects in the prior art is solved and the imaging quality and real-time performance are improved.

CN119011980APending Publication Date: 2024-11-22ZHEJIANG LANYING INTELLIGENT TECH CO LTD

Patent Information

Application Number
CN202411303674.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-19
Publication Date
2024-11-22

AI Technical Summary

Technical Problem

Existing optical imaging equipment has poor imaging effects in harsh environments, especially the short-wave infrared resolution capability, long imaging time, redundant data, and it is difficult to achieve synchronous imaging of visible light and short-wave infrared.

Method used

Design a visible-short-wave infrared synchronous imaging device, using electronic control module, imaging system base, short-wave infrared camera, visible light camera, filter wheel and beam splitter. Through beam splitter, incident light is divided into short-wave infrared and visible light Two-way, and use filter wheel and electronic control module to achieve synchronous acquisition and processing of images, ensuring synchronization, registration and packaging of the two cameras.

Benefits of technology

It improves the resolution ability of short-wave infrared, shortens the imaging time, improves the imaging signal-to-noise ratio, and realizes synchronous imaging of visible light and short-wave infrared, and is suitable for a variety of scenarios, especially in harsh environments.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119011980A_ABST
    Figure CN119011980A_ABST
Patent Text Reader

Abstract

The visible light-short wave infrared synchronous imaging equipment comprises an electric control module, an imaging system base, a short wave infrared camera, a visible light camera, an optical filter rotating wheel and a beam splitter, wherein the short wave infrared camera, the visible light camera, the optical filter rotating wheel and the beam splitter have the same optical axis height; a beam splitter, a short-wave infrared camera and a visible light camera are arranged, so that synchronous image pairs can be quickly obtained; the optical filter rotating wheel improves the resolution capability of short wave infrared; the electric control module triggers the optical filter rotating wheel, the short-wave infrared camera and the visible light camera in a hard mode, visible light and short-wave infrared images are read in time and processed, and synchronous imaging is fast. The device is convenient to carry and good in overall imaging effect. The invention further discloses a visible light-short wave infrared synchronous imaging method which is high in logicality, capable of rapidly obtaining and processing imaging data, capable of considering efficiency and quality and suitable for imaging requirements under various application scenes and severe environments.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of synchronous imaging technology, and more particularly to a visible light-shortwave infrared synchronous imaging device and method. Background Art

[0002] Traditional optical imaging equipment often uses monocular visible light imaging technology, which has poor imaging effects in poor lighting conditions (such as at night or in foggy weather). Later, other types of light (such as infrared or ultraviolet) were combined with visible light for imaging, which expanded the spectral range of optical imaging and reduced the impact of ambient light intensity on the imaging of the equipment.

[0003] At present, some monitoring imaging equipment combines visible light and near-infrared bands for imaging. Since the near-infrared band is often black and white and has a short wavelength, it cannot effectively deal with severe weather such as haze, rain and fog, so the quality of the collected spectral information imaging is not very ideal. Existing maritime monitoring equipment uses the full band of short-wave infrared for imaging. Due to the low spectral resolution, the resolution ability of short-wave infrared cannot be fully exerted. Short-wave infrared band multi-spectral imaging equipment, which is widely used in industrial production, collects multiple sub-bands of short-wave infrared for imaging. Although the information is rich and the imaging quality is good, there is a lot of data redundancy during imaging, the amount of calculation is large, the imaging time is long, and it is not easy to be real-time. Some binocular imaging systems use two cameras placed side by side for imaging, which has the problem of asynchronous and misaligned, and it is a huge test for data processing. In addition, WO2018098742A1 combines visible light with ultraviolet light for synchronous imaging in harsh environments. Since ultraviolet light radiates organisms, its application range is limited and its universality is poor.

[0004] Therefore, how to improve the optical imaging devices and methods in the prior art, improve the short-wave infrared resolution capability, enrich the spectral information of imaging, shorten the imaging time, improve the imaging signal-to-noise ratio, and achieve simultaneous imaging of visible light and short-wave infrared while taking into account the imaging efficiency, so as to be suitable for a variety of scenarios and can be applied to simultaneous imaging in harsh environments is a problem that technical personnel in this field urgently need to solve. Summary of the invention

[0005] In view of this, the present invention provides a visible light-shortwave infrared synchronous imaging device and method, which are used to solve many problems faced by optical imaging devices and imaging methods in the background technology.

[0006] In order to achieve the above object, the present invention adopts the following technical solution:

[0007] A visible light-short-wave infrared synchronous imaging device, comprising: an electric control module, an imaging system base, and a short-wave infrared camera, a visible light camera, a filter wheel and a beam splitter arranged on the imaging system base at the same optical axis height;

[0008] The beam splitter splits the incident light into two paths, short-wave infrared and visible light, and the short-wave infrared camera and the visible light camera are respectively arranged on the two paths of light; the included angle between the beam splitter and the optical axes of the two cameras is 45°, and the included angle between the optical axes of the two cameras is 90°;

[0009] The short-wave infrared camera and the visible light camera collect visible light imaging data and short-wave infrared imaging data respectively;

[0010] The filter wheel is arranged between the beam splitter and the lens of the short-wave infrared camera, and is used to collect short-wave infrared imaging data of different wide bands;

[0011] The electric control module provides hard trigger signals for the filter wheel, the short-wave infrared camera and the visible light camera, reads the visible light and short-wave infrared images in time and processes the acquired image pairs.

[0012] Furthermore, the electric control module includes a power supply module, a single chip microcomputer and a soc chip;

[0013] The power supply module steps down the input 220V AC power and outputs stable DC power to power the single-chip microcomputer, SOC chip, visible light camera, filter wheel and short-wave infrared camera;

[0014] The soc chip communicates bidirectionally with the host computer and the single-chip microcomputer;

[0015] The single chip microcomputer is electrically connected to the filter wheel, the short-wave infrared camera and the visible light camera to provide a hard trigger signal;

[0016] The output ends of the visible light camera and the short-wave infrared camera are both connected to the input end of the SOC chip; the SOC chip synchronizes, aligns and packages the visible light imaging data and short-wave infrared imaging data collected by the two cameras respectively, and communicates with the host computer; the host computer responds to the control instructions of the synchronous imaging.

[0017] Furthermore, the model of the single chip microcomputer is STM32 microprocessor, the model of the soc chip is RK3588 core board, the model of the short wave infrared camera is AVT Goldeye-033, the model of the visible light camera is MV-CS050-60UC, and the model of the filter wheel is FLI HS-625.

[0018] Furthermore, it also includes a light-shielding sleeve, one side of which is connected to the lens of the short-wave infrared camera, and the other side of which is fixed to the filter wheel.

[0019] Furthermore, the light-shielding sleeve comprises a base plate and a barrel, one side of the base plate is fixed to the filter wheel, and the other side is detachably mounted with the barrel; the lens of the short-wave infrared camera extends into the barrel.

[0020] The shading sleeve designed by the present invention is easy to disassemble, which is conducive to replacing the shading sleeve component and ensures the technical effect of the equipment on stray light.

[0021] In addition, after the relative positions of the short-wave infrared camera and the filter wheel are fixed, the cylinder is locked on the bottom plate; there are vertical slide grooves on the cylinder to adapt to the error adjustment of the height assembly. The inner diameter of the cylinder is 10 mm larger than the outer diameter of the short-wave infrared camera objective lens, allowing the objective lens to focus and move smoothly.

[0022] Furthermore, it also includes: a short-wave infrared camera base, a visible light camera base, a beam splitter base and a filter wheel base, which are used to ensure that the optical axes of the short-wave infrared camera, the visible light camera, the beam splitter and the filter wheel are at the same height;

[0023] Furthermore, three slide grooves are arranged on the imaging system base, and the short-wave infrared camera base, the visible light camera base and the beam splitter base are installed on the three slide grooves in a one-to-one correspondence. The three slide grooves are arranged under the premise that "the angle between the beam splitter 81 and the optical axes of the two cameras is 45°, and the angle between the optical axes of the two cameras is 90°". The purpose is that the short-wave infrared camera base, the visible light camera base and the beam splitter base are installed on the three slide grooves in a one-to-one correspondence, and the position can be fine-tuned along the corresponding slide grooves on the imaging system base 3 to avoid affecting the imaging effect due to assembly errors during synchronous imaging, or to overcome the deficiency that the registration accuracy of the pre-calibrated synchronous imaging device will gradually decrease with the use of the device.

[0024] Furthermore, the thickness and weight of the imaging system base are adaptively set according to the vibration amplitude of the filter wheel, so as to reduce the vibration amplitude of the filter wheel.

[0025] Furthermore, the number of switching channels used by the single-chip microcomputer is consistent with the number of filters of the filter wheel; each switching channel corresponds to a filter, and each filter splits a band of short-wave infrared; the central wavelength / half-wave full width of the filter are 1040 / 120nm, 1260 / 160nm and 1570 / 210nm respectively; the number of filters is 3, and the number of switching channels of the single-chip microcomputer is 3.

[0026] The visible light-shortwave infrared synchronous imaging device disclosed in the present invention has the following beneficial effects:

[0027] (1) The optical axes of the short-wave infrared camera, the visible light camera, the filter wheel and the beam splitter on the imaging system base are at the same height; the beam splitter splits the incident light into two paths, short-wave infrared and visible light, and the short-wave infrared camera and the visible light camera are respectively arranged on the two paths of light; the included angles between the beam splitter and the optical axes of the two cameras are both 45°, and the included angles between the optical axes of the two cameras are 90°; this is conducive to achieving synchronous imaging of short-wave infrared and visible light, and ensuring the quality of synchronous imaging.

[0028] (2) Using the filter wheel to select a small number of wide bands of short-wave infrared for spectrometry can improve the resolution of short-wave infrared, shorten the overall imaging time, improve the imaging signal-to-noise ratio, and facilitate the real-time performance of simultaneous imaging of visible light and short-wave infrared.

[0029] (3) The electronic control module provides hard trigger signals for the filter wheel, short-wave infrared camera, and visible light camera, and reads the visible light and short-wave infrared images in a timely manner and processes the acquired images. The electronic control scheme is easy to operate in controlling the acquisition of imaging data. It can effectively control the visible light and short-wave infrared imaging data pairs acquired synchronously by the two cameras, and timely synchronize and align the captured imaging data pairs and perform registration processing, thereby improving the efficiency and quality of visible light-short-wave infrared synchronous imaging.

[0030] (4) The entire visible light-shortwave infrared synchronous imaging device has a compact structure design, is easy to move or carry, and is easy to operate. It can be adapted to a variety of application scenarios such as remote sensing detection, industrial inspection, and monitoring, and can also perform synchronous imaging in some harsh environments (such as at night or in foggy days).

[0031] (5) The combination of visible light technology and short-wave infrared technology has richer spectral information than devices that only use visible light for imaging; compared with the combination with infrared technology, the resulting image has color; compared with the combination with ultraviolet light, it is harmless to organisms and has a wider range of application scenarios; compared with placing two cameras side by side, synchronous imaging is easy to achieve; compared with visible light-short-wave infrared full-spectrum imaging equipment, it has a short imaging time, good real-time performance, and high short-wave infrared resolution.

[0032] In addition, the present invention also discloses a visible light-shortwave infrared synchronous imaging method, which comprises:

[0033] The host computer and the soc chip send multiple different synchronous imaging control instructions to the microcontroller at a certain interval;

[0034] The single chip microcomputer opens different switching channels in sequence according to the order of receiving synchronous imaging control instructions;

[0035] After the switching channel is turned on, the filter wheel splits the short-wave infrared light path into corresponding bands under one filter;

[0036] The visible light camera and the short-wave infrared camera collect corresponding imaging data respectively under the corresponding optical paths and transmit them to the soc chip;

[0037] The soc chip processes the short-wave infrared and visible light synchronous imaging data under different switching channels and communicates with the host computer;

[0038] The host computer responds to the control instructions of synchronous imaging.

[0039] Furthermore, the SOC chip uses three switching channels to obtain three sets of shortwave infrared and visible light synchronous imaging data respectively, and aligns and registers the three sets of synchronous imaging data pairs respectively, and then uniformly registers them to obtain aligned and synchronized visible light-three-channel shortwave infrared multispectral image pairs.

[0040] Compared with the existing synchronous imaging methods, the visible light-shortwave infrared synchronous imaging method disclosed in the present invention has the following beneficial effects:

[0041] (1) Using the filter wheel to split the different bands of short-wave infrared can improve the resolution of short-wave infrared, improve the imaging signal-to-noise ratio, and facilitate the real-time performance of simultaneous imaging of visible light and short-wave infrared. The filters used are all conducive to identification and detection tasks, which can ensure the imaging quality and shorten the overall imaging time.

[0042] (3) The electronic control module provides hard trigger signals for the filter wheel, short-wave infrared camera, and visible light camera, and reads the visible light and short-wave infrared images in a timely manner and processes the acquired images. The entire electronic control scheme is easy to operate in data acquisition and can timely capture and efficiently process the visible light and short-wave infrared imaging data collected by the two cameras, thereby improving the efficiency and quality of visible light-short-wave infrared synchronous imaging.

[0043] (2) The host computer and the SOC chip send multiple different synchronous imaging control instructions to the single-chip microcomputer at a certain interval, and open different switching channels in sequence according to the order of receiving the instructions; after the switching channel is turned on, the filter wheel splits the short-wave infrared light path into corresponding bands under one filter; the visible light camera and the short-wave infrared camera respectively collect corresponding imaging data under the corresponding light path and transmit them to the SOC chip; the SOC chip performs synchronous alignment and registration processing on the short-wave infrared and visible light synchronous imaging data under different switching channels, and communicates with the host computer; the host computer responds to the control instructions of synchronous imaging; the entire synchronous imaging method has strong logic and high control degree.

[0044] (3) The processing of the image stream in the above method includes synchronous alignment, separate registration and unified registration, so as to obtain a registered and synchronized visible light-three-channel short-wave infrared multispectral image pair with good imaging quality and fast imaging speed.

[0045] (4) The entire electronic control scheme of the above method is reasonable, which can not only ensure the synchronous triggering of the synchronous imaging control instructions, but also can timely capture and process the real-time acquired imaging data. The overall synchronous imaging effect, both in terms of imaging speed and imaging quality, is good. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying creative work.

[0047] Figure 1 A schematic structural diagram of a visible light-shortwave infrared synchronous imaging device provided by the present invention;

[0048] Figure 2 A schematic structural diagram of a light-shielding sleeve in a visible light-short-wave infrared synchronous imaging device provided by the present invention;

[0049] Figure 3 A schematic top view of the structure of a base in a visible light-shortwave infrared synchronous imaging device provided by the present invention;

[0050] Figure 4 A schematic diagram of an electronic framework of a visible light-shortwave infrared synchronous imaging device provided by the present invention.

[0051] Figure 5 The present invention provides a control logic for visible light-shortwave infrared synchronous imaging.

[0052] Among them, 1 is the filter wheel, 2 is the filter wheel base, 3 is the imaging system base, 4 is the fixed area of ​​the control circuit, 5 is the short-wave infrared camera, 6 is the short-wave infrared camera base, 7 is the light-shielding sleeve, 81 is the beam splitter, 82 is the beam splitter base, 9 is the visible light camera base, 10 is the visible light camera, 11 is the adjustment direction of the visible light camera base, 12 is the adjustment direction of the beam splitter, and 13 is the adjustment direction of the short-wave infrared camera base. DETAILED DESCRIPTION

[0053] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0054] See also Figure 1 As shown, the embodiment of the present invention discloses a visible light-short-wave infrared synchronous imaging device, including: an electric control module, an imaging system base 3, and a short-wave infrared camera 5, a visible light camera 10, a filter wheel 1 and a beam splitter 81 arranged on the imaging system base 3 at the same optical axis height;

[0055] The beam splitter 81 splits the incident light into short-wave infrared and visible light, and sets a short-wave infrared camera 5 and a visible light camera 10 on the two light beams respectively; the included angle between the beam splitter 81 and the optical axes of the two cameras is 45°, and the included angle between the optical axes of the two cameras is 90°;

[0056] The short-wave infrared camera 5 and the visible light camera 10 collect visible light imaging data and short-wave infrared imaging data respectively;

[0057] The filter wheel 1 is arranged between the beam splitter 81 and the lens of the short-wave infrared camera 5, and is used to collect short-wave infrared imaging data of different wide bands;

[0058] The electric control module provides hard trigger signals for the filter wheel 1, the short-wave infrared camera 5 and the visible light camera 10, reads the visible light and short-wave infrared images in time and processes the collected image pairs.

[0059] In this embodiment Figure 1 In the embodiment, a light shielding sleeve 7 is also included, one side of which is connected to the lens of the short-wave infrared camera 5, and the other side is fixed to the filter wheel 1. In other words, the light shielding sleeve 7 is located between the short-wave infrared lens and the filter wheel 1, and is used to prevent stray light from entering the short-wave infrared lens and affecting its imaging quality.

[0060] In this embodiment Figure 2 In the figure, the light shielding sleeve 7 includes a bottom plate and a cylinder body, one side of the bottom plate is fixed to the filter wheel 1, and the other side is detachably mounted with the cylinder body; the lens of the short-wave infrared camera 5 extends into the cylinder body. Therefore, the light shielding sleeve 7 is not only convenient to be disassembled from the synchronous imaging device, but also, because it is a split structure, it is convenient to replace any one or both of the two components of the light shielding sleeve 7, and its cost is low, which is conducive to the synchronous device always being able to maintain the performance of "preventing stray light from entering the lens of the short-wave infrared camera 5 and affecting the short-wave infrared imaging quality".

[0061] In this embodiment, since the shading sleeve 7 is designed by itself, it is more suitable for shading the objective lens of the short-wave infrared camera 5 in the synchronous imaging device of the present invention.

[0062] In addition, after the short-wave infrared camera 5 and the filter wheel 1 are fixed in relative positions, the barrel is first locked on the bottom plate, and then the bottom plate and the filter wheel 1 are fixed; the barrel may have a vertical slide groove to accommodate the error adjustment of the height assembly; the inner diameter of the barrel is 10 mm larger than the outer diameter of the objective lens of the short-wave infrared camera 5, that is, 0.1 mm, allowing the objective lens to focus and move smoothly.

[0063] In this embodiment Figure 1 The invention also includes: a short-wave infrared camera base 6, a visible light camera base 9, a beam splitter base 82 and a filter wheel base 2, which are used to ensure that the optical axes of the short-wave infrared camera 5, the visible light camera 10, the beam splitter 81 and the filter wheel 1 are at the same height;

[0064] In this embodiment Figure 1 In the figure, three slide grooves are arranged on the imaging system base 3, and the short-wave infrared camera base 6, the visible light camera base 9 and the beam splitter base 82 are installed on the three slide grooves in a one-to-one correspondence. The three slide grooves are arranged under the premise that "the angle between the beam splitter 81 and the optical axes of the two cameras is 45°, and the angle between the optical axes of the two cameras is 90°". The purpose is that the short-wave infrared camera base, the visible light camera base and the beam splitter base are installed on the three slide grooves in a one-to-one correspondence, and the position can be fine-tuned along the corresponding slide grooves on the imaging system base 3 to avoid affecting the imaging effect due to assembly errors during synchronous imaging, or to overcome the deficiency that the registration accuracy of the pre-calibrated synchronous imaging device will gradually decrease with the use of the device.

[0065] In this embodiment Figure 3 In the figure, there are adjustment directions of the visible light camera base 9, the short-wave infrared camera base 6 and the beam splitter base 82, 11 is the adjustment direction of the visible light camera base 9, 13 is the adjustment direction of the short-wave infrared camera base 6, and 12 is the adjustment direction of the beam splitter base 82. That is to say, the adjustment direction 11 of the visible light camera base 9 is consistent with the adjustment direction 13 of the short-wave infrared camera base 6, and both are perpendicular to the adjustment direction 12 of the beam splitter base 82.

[0066] In this embodiment, considering that the high-speed filter wheel 1 vibrates during operation, the thickness and weight of the imaging system base 3 are adaptively set according to the vibration amplitude, thereby avoiding the adverse effect on the imaging quality caused by excessive vibration amplitude generated by the high-speed operation of the filter wheel.

[0067] In this embodiment, the number of switching channels used by the single-chip microcomputer is consistent with the number of filters of the filter wheel; each switching channel corresponds to a filter, and each filter splits a band of short-wave infrared; the central wavelength / half-wave full width of the filter are 1040 / 120nm, 1260 / 160nm and 1570 / 210nm respectively; the number of filters is 3, and the number of switching channels of the single-chip microcomputer is 3.

[0068] In this embodiment Figure 4 In the figure, we can see the electronic framework schematic diagram of the visible light-shortwave infrared synchronous imaging device. The electronic control module includes a power supply module, a single-chip microcomputer and a soc chip;

[0069] The power supply module steps down the input 220V AC power and outputs stable DC power to power the single-chip microcomputer, soc chip, visible light camera 10, filter wheel 1 and short-wave infrared camera 5;

[0070] The soc chip has two-way communication with the host computer and the microcontroller;

[0071] The single chip microcomputer is electrically connected to the filter wheel 1, the short wave infrared camera 5 and the visible light camera 10 to provide a hard trigger signal;

[0072] The output ends of the visible light camera 10 and the short-wave infrared camera 5 are both connected to the input end of the SOC chip; the SOC chip synchronizes, aligns and packages the visible light imaging data and short-wave infrared imaging data collected by the two cameras respectively, and communicates with the host computer; the host computer responds to the control instructions of synchronous imaging.

[0073] In this embodiment, the model of the single chip microcomputer is STM32 microprocessor, the model of the soc chip is RK3588 core board, the model of the short wave infrared camera 5 is AVT Goldeye-033, the model of the visible light camera 10 is MV-CS050-60UC, and the model of the filter wheel 1 is FLI HS-625.

[0074] In this embodiment, the single-chip microcomputer generates hard trigger control signals for controlling the visible light camera, short-wave infrared camera, and filter wheel. The soc chip, as the main control platform, controls the single-chip microcomputer to send hard trigger control signals to the visible light camera, short-wave infrared camera, and filter wheel at the same time, reads the visible light and short-wave infrared images in time and performs preprocessing; performs two-way communication with the host computer and responds to control instructions; wherein the preprocessing includes but is not limited to image registration, data packaging, etc.; the host computer is a terminal device such as a computer connected via USB / network cable and a computer / mobile phone, tablet, etc. connected via WiFi / Bluetooth.

[0075] In this embodiment, the purpose of the filter wheel 1 is to improve the resolution of short-wave infrared and shorten the overall imaging time.

[0076] In this embodiment, the filter of the filter wheel 1 selects three wide bands that are most suitable for detecting typical targets such as pedestrians and vehicles from the full band of short-wave infrared. The three wide bands correspond to three different filters, whose center wavelength / half-wave full width are 1040 / 120nm, 1260 / 160nm and 1570 / 210nm respectively. The selected filters can take into account the rich spectral information and signal-to-noise ratio of imaging, the strong resolution of short-wave infrared, and the short overall imaging time.

[0077] In this embodiment, when collecting shortwave infrared imaging of different channels, after the channel switching is completed, the single-chip microcomputer hard triggers the visible light and shortwave infrared camera imaging to ensure the consistency of imaging time, and finally obtain three visible light-shortwave infrared image pairs.

[0078] In this embodiment Figure 5 A control logic of visible light-short-wave infrared synchronous imaging is disclosed, and a method of visible light-short-wave infrared synchronous imaging is obtained according to the control logic, the method comprising: a host computer and a soc chip send a plurality of different synchronous imaging control instructions to a single-chip microcomputer at a certain interval;

[0079] The single chip microcomputer opens different switching channels in sequence according to the order of receiving synchronous imaging control instructions;

[0080] After the switching channel is turned on, the filter wheel splits the short-wave infrared light path into corresponding bands under one filter;

[0081] The visible light camera and the short-wave infrared camera collect corresponding imaging data respectively under the corresponding optical paths and transmit them to the soc chip;

[0082] The soc chip processes the short-wave infrared and visible light synchronous imaging data under different switching channels and communicates with the host computer;

[0083] The host computer responds to the control instructions of synchronous imaging.

[0084] In this embodiment, taking into account the mechanical assembly error, the SOC chip uses three switching channels to obtain three sets of synchronous imaging data of shortwave infrared and visible light respectively, and performs synchronous alignment and registration on the three sets of synchronous imaging data pairs respectively, and then uniformly registers them to obtain an aligned and synchronized visible light-three-channel shortwave infrared multispectral image pair.

[0085] In this specification, each embodiment is described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the embodiments can be referred to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant parts can be referred to the method part.

[0086] The above description of the disclosed embodiments enables one skilled in the art to implement or use the present invention. Various modifications to these embodiments will be apparent to one skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to the embodiments shown herein, but rather to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A visible light-shortwave infrared synchronous imaging device, It is characterized in that include: An electric control module, an imaging system base, and a short-wave infrared camera, a visible light camera, a filter wheel and a beam splitter arranged on the imaging system base at the same height as the optical axis; The beam splitter splits the incident light into two paths, short-wave infrared and visible light, and the short-wave infrared camera and the visible light camera are respectively arranged on the two paths of light; the included angle between the beam splitter and the optical axes of the two cameras is 45°, and the included angle between the optical axes of the two cameras is 90°; The short-wave infrared camera and the visible light camera collect visible light imaging data and short-wave infrared imaging data respectively; The filter wheel is arranged between the beam splitter and the lens of the short-wave infrared camera, and is used to collect short-wave infrared imaging data of different wide bands; The electric control module provides hard trigger signals for the filter wheel, the short-wave infrared camera and the visible light camera, reads the visible light and short-wave infrared images in time and processes the acquired image pairs.

2. The visible light-shortwave infrared synchronous imaging device according to claim 1, It is characterized in that The electric control module includes a power supply module, a single chip microcomputer and a soc chip; The power supply module steps down the input 220V AC power and outputs stable DC power to power the single-chip microcomputer, SOC chip, visible light camera, filter wheel and short-wave infrared camera; The soc chip communicates bidirectionally with the host computer and the single-chip microcomputer; The single chip microcomputer is electrically connected to the filter wheel, the short-wave infrared camera and the visible light camera to provide a hard trigger signal; The output ends of the visible light camera and the short-wave infrared camera are both connected to the input end of the SOC chip; the SOC chip synchronizes, aligns and packages the visible light imaging data and short-wave infrared imaging data collected by the two cameras respectively, and communicates with the host computer; the host computer responds to the control instructions of the synchronous imaging.

3. The visible light-shortwave infrared synchronous imaging device according to claim 2, It is characterized in that The model of the single chip microcomputer is STM32 microprocessor, the model of the soc chip is RK3588 core board, the model of the short wave infrared camera is AVT Goldeye-033, the model of the visible light camera is MV-CS050-60UC, and the model of the filter wheel is FLI HS-625.

4. The visible light-shortwave infrared synchronous imaging device according to claim 1, It is characterized in that It also includes a light-shielding sleeve, one side of which is connected to the lens of the short-wave infrared camera, and the other side of which is fixed to the filter wheel.

5. The visible light-shortwave infrared synchronous imaging device according to claim 4, It is characterized in that The light-shielding sleeve comprises a bottom plate and a barrel, one side of the bottom plate is fixed to the filter wheel, and the other side is detachably mounted with the barrel; the lens of the short-wave infrared camera extends into the barrel.

6. The visible light-shortwave infrared synchronous imaging device according to claim 1, It is characterized in that Also includes: The short-wave infrared camera base, the visible light camera base, the beam splitter base and the filter wheel base are used to ensure that the optical axes of the short-wave infrared camera, the visible light camera, the beam splitter and the filter wheel are at the same height.

7. The visible light-shortwave infrared synchronous imaging device according to claim 1, It is characterized in that Three slide grooves are arranged on the imaging system base, and the short-wave infrared camera base, the visible light camera base and the beam splitter base are mounted on the three slide grooves in a one-to-one correspondence.

8. The visible light-shortwave infrared synchronous imaging device according to claim 1, It is characterized in that The number of switching channels used by the single-chip microcomputer is consistent with the number of filters of the filter wheel; each switching channel corresponds to a filter, and each filter splits a band of short-wave infrared; the central wavelength / half-wave full width of the filter are 1040 / 120nm, 1260 / 160nm and 1570 / 210nm respectively; the number of filters is 3, and the number of switching channels of the single-chip microcomputer is 3.

9. A method for simultaneous visible light-shortwave infrared imaging, It is characterized in that Based on any one of claims 2 to 8 of the visible light-shortwave infrared synchronous imaging device, the method comprises: The host computer and the soc chip send multiple different synchronous imaging control instructions to the microcontroller at a certain interval; The single chip microcomputer opens different switching channels in sequence according to the order of receiving synchronous imaging control instructions; After the switching channel is turned on, the filter wheel splits the short-wave infrared light path into corresponding bands under one filter; The visible light camera and the short-wave infrared camera collect corresponding imaging data respectively under the corresponding optical paths and transmit them to the soc chip; The soc chip processes the short-wave infrared and visible light synchronous imaging data under different switching channels and communicates with the host computer; The host computer responds to the control instructions of synchronous imaging.

10. A method for simultaneous visible light-shortwave infrared imaging, It is characterized in that The soc chip uses three switching channels to obtain three sets of synchronous imaging data of shortwave infrared and visible light respectively, and aligns and registers the three sets of synchronous imaging data pairs respectively, and then uniformly registers them to obtain aligned and synchronized visible light-three-channel shortwave infrared multispectral image pairs.

Citation Information

Patent Citations

  • Imaging method and device for bad environment

    WO2018098742A1

Cited By

  • Multiband imaging device based on objective lens turntable

    CN120871417A

  • A multi-band imaging device based on an objective lens turntable

    CN120871417B