Multi-source image and spectral information synchronous acquisition device

Abstract

The invention belongs to the field of spectrum detection, and particularly relates to a multi-source image and spectrum information synchronous acquisition device which comprises a carrier and a carrier, the carrier is used for carrying the carrier to move, and the carrier is provided with a hyperspectral imaging camera, a laser radar, a thermal imaging camera, an imaging spectrometer, a control mainboard and a processor; according to the invention, a hyperspectral imaging camera, a laser radar, a thermal imaging camera and an imaging spectrometer are arranged on a carrier; when the target detection system is used, the carrier is carried by the carrier to move, a target is detected, and the target detection system integrating hyperspectral imaging, laser radar and thermal imaging is realized. The different detection units synchronously collect target signals; fusion of multi-source signals is facilitated, and more dimensional information is provided for deep remote sensing data research; and the system is integrated, so that maximum information acquisition is realized with very low system cost.

Description

Technical Field

[0001] The present invention belongs to the field of spectrum detection, and in particular relates to a device for synchronously acquiring multi-source images and spectrum information. Background Art

[0002] The principle of spectral detection is based on the interaction between light and matter. Light is an electromagnetic wave with different wavelengths and frequencies. When light strikes a substance, it undergoes reflection and absorption, causing the wavelength and intensity of the light to change, forming a distinct spectrum. Every substance has its own unique spectral signature, much like a fingerprint, and these signatures can be used to analyze the composition and structure of the substance. Spectral detection is widely used in various industries and fields, including medicine, food, biology, ceramics, petroleum, glass, metals, inks, paper, minerals, coatings, soil, and more.

[0003] Most spectral detection devices in the prior art rely on hyperspectral imaging cameras to collect information about target sources. The collected information is relatively single and cannot synchronously collect multi-dimensional information of the same target source.

[0004] In view of this, there is an urgent need for a device for synchronously acquiring multi-source images and spectral information. Summary of the Invention

[0005] In view of the problems in the prior art, the present invention provides a device for synchronously acquiring multi-source images and spectral information to solve the problems in the prior art.

[0006] In order to achieve the above technical objectives, the technical solution of the present invention is: A device for synchronously acquiring multi-source images and spectral information includes a carrier and a support. The carrier is used to carry the support for movement. The support is provided with a hyperspectral imaging camera, a laser radar, a thermal imaging camera, an imaging spectrometer, a control mainboard, and a processor. The hyperspectral imaging camera and the thermal imaging camera are arranged on a first side of the carrier, and the laser radar is arranged on a second side of the carrier, wherein the first side and the second side are perpendicular to each other; The imaging spectrometer, the control mainboard and the processor are all arranged on the inner side of the carrier.

[0007] An RGB color camera is arranged on the carrier, and the RGB color camera is arranged on the first side.

[0008] The distance between the center point of the thermal imaging camera and the center point of the RGB color camera is between 40 mm and 42 mm.

[0009] The distance between the center point of the thermal imaging camera and the center point of the hyperspectral imaging camera is between 45 mm and 47 mm.

[0010] The distance between the center point of the RGB color camera and the center point of the hyperspectral imaging camera is between 64 mm and 66 mm.

[0011] The laser radar includes a radar shell, a laser transmitter and a laser receiver.

[0012] The line between the center of the receiving end of the laser receiver and the center of the transmitting end of the laser transmitter is L, the line between the center point of the thermal imaging camera and the center point of the hyperspectral imaging camera is N, and the RGB color camera is set on the side of N away from L.

[0013] The distance between L and the center point of the hyperspectral imaging camera is between 80 mm and 82 mm.

[0014] The laser radar further includes a driving assembly for driving the laser transmitter and the laser receiver to rotate in a direction perpendicular to the first side.

[0015] The incident slit of the imaging spectrometer is parallel to L.

[0016] The above structure of the present invention can achieve the following beneficial effects: By setting a hyperspectral imaging camera, lidar, thermal imaging camera and imaging spectrometer on the carrier; when in use, the carrier is carried by the vehicle to move and detect the target, realizing a target detection system that integrates hyperspectral imaging, lidar and thermal imaging; different detection units synchronously collect target signals; it is conducive to the fusion of multi-source signals and provides more dimensional information for deep remote sensing data research; and it is integrated into one to achieve maximum information acquisition at a very low system cost. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 It is a structural diagram of an embodiment of the present invention; Figure 2 Schematic diagram of the structure inside the carrier in an embodiment of the present invention; Figure 3 is a structural diagram of another perspective of an embodiment of the present invention; Figure 4 Schematic diagram of the field of view of the hyperspectral imaging camera, lidar, thermal imaging camera, and RGB color camera in the present invention.

[0018] In the figure: 1. Carrier; 2. Hyperspectral imaging camera; 3. LiDAR; 31. Radar housing; 32. Laser transmitter; 33. Laser receiver; 4. Thermal imaging camera; 5. Imaging spectrometer; 6. Control board; 7. Processor; 8. RGB color camera. DETAILED DESCRIPTION

[0019] In order to enable those skilled in the art to better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the embodiments described are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts should fall within the scope of protection of the present invention.

[0020] It should be noted that the terms "including" and "having" and any variations thereof in the specification and claims of the present invention and the above-mentioned drawings are intended to cover non-exclusive inclusions. For example, a process, method, apparatus, product or equipment that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or are inherent to these processes, methods, products or equipment.

[0021] The following is combined with Figure 1-4 This application is described in further detail.

[0022] refer to Figure 1-3 The device for synchronously acquiring multi-source images and spectral information shown includes a vehicle and a carrier 1. The vehicle is used to carry the carrier 1 for movement. The vehicle is preferably a drone. The carrier 1 is provided with a hyperspectral imaging camera 2, a laser radar 3, a thermal imaging camera 4, an imaging spectrometer 5, a control motherboard 6, and a processor 7. The hyperspectral imaging camera 2 and the thermal imaging camera 4 are arranged on a first side of the carrier 1, and the laser radar 3 is arranged on a second side of the carrier 1, with the first side and the second side being perpendicular to each other; The imaging spectrometer 5 , the control mainboard 6 and the processor 7 are all arranged on the inner side of the carrier 1 .

[0023] Based on the above structure, a hyperspectral imaging camera 2, a lidar 3, a thermal imaging camera 4 and an imaging spectrometer 5 are arranged on the carrier 1; when in use, the carrier 1 is carried by the vehicle to move and detect the target, thereby realizing a target detection system that integrates hyperspectral imaging, lidar and thermal imaging; different detection units synchronously collect target signals; it is conducive to the fusion of multi-source signals and provides more dimensional information for deep remote sensing data research; and it is integrated into one to achieve maximum information acquisition at a very low system cost.

[0024] Further optimization is, Figure 3 As shown, an RGB color camera 8 is provided on the carrier 1 and is provided on the first side. The RGB color camera 8 synchronously performs real-time image acquisition and storage and serves as a module with the largest field of view.

[0025] like Figure 1-3As shown, the laser radar 3 includes a radar housing 31, a laser emitter 32 and a laser receiver 33; the line between the center of the receiving end of the laser receiver 33 and the center of the transmitting end of the laser emitter 32 is L, the line between the center point of the thermal imaging camera 4 and the center point of the hyperspectral imaging camera 2 is N, and the RGB color camera 8 is arranged on the side of N away from L; the laser radar 3 also includes a driving component, which is used to drive the laser emitter 32 and the laser receiver 33 to rotate in a direction perpendicular to the first side. Multiple pairs of laser emitters 32 and laser receivers 33 can be fixedly installed on the rotor of the laser radar, and 360° scanning in the horizontal direction is achieved by rotating the internal driving component (motor), and the channels of the laser radar are evenly distributed in the vertical direction.

[0026] Further optimization is, Figure 4 As shown, in order to achieve synchronous real-time acquisition of the most ideal image from multiple sources of targets, the distance between the center point of the thermal imaging camera 4 and the center point of the RGB color camera 8 is between 40 mm and 42 mm (for example, 40 mm, 41 mm or 42 mm); the distance between the center point of the thermal imaging camera 4 and the center point of the hyperspectral imaging camera 2 is between 45 mm and 47 mm (for example, 45 mm, 46 mm or 47 mm); the distance between the center point of the RGB color camera 8 and the center point of the hyperspectral imaging camera 2 is between 64 mm and 66 mm (for example, 64 mm, 65 mm or 66 mm), and the distance between L and the center point of the hyperspectral imaging camera 2 is between 80 mm and 82 mm (for example, 80 mm, 81 mm or 82 mm); the incident slit of the imaging spectrometer 5 is parallel to L; since the thermal (infrared) imaging camera 4 (for example Figure 4 110-2, which is the field of view of the thermal imaging camera) and the RGB color camera 8 (as shown in FIG. Figure 4 110-1 is the field of view of the RGB acquisition camera) belongs to an area array camera, which captures full-frame area array images. Its frame rate is sufficient to meet the time response required by the data collected by the above-mentioned lidar and hyperspectral camera; and the field of view of the two is much larger than that of the lidar and hyperspectral camera, while the lidar is a point-by-point line scan (such as Figure 4 As shown in 110-4, it is the field of view of the laser radar). In this line, data is collected point by point, which is different from the hyperspectral line scan. The hyperspectral camera (such as Figure 4As shown in 110-3, the field of view of the hyperspectral camera is a slit (row) scan imaging. In this row, it is continuous. Using a fixed-focus imaging lens, the width of the target row information obtained each time will vary depending on the distance to the target. The time to collect the target in this row is related to the set exposure time parameters, camera frame rate, etc., which in turn affects the speed of the aircraft during flight. Otherwise, the collected row data will be distorted (the faster the flight speed, the compressed image; the slower the flight speed, the stretched image). Therefore, it is necessary to calculate the optimal flight parameters. In summary, as Figure 4 110-5 shows the final intercepted field of view line strip.

[0027] In summary, by arranging a hyperspectral imaging camera 2, a lidar 3, a thermal imaging camera 4 and an imaging spectrometer 5 on a carrier 1; when in use, the carrier 1 is carried by the vehicle to move and detect the target, thereby realizing a target detection system that integrates hyperspectral imaging, lidar and thermal imaging; different detection units synchronously collect target signals; it is conducive to the fusion of multi-source signals and provides more dimensional information for deep remote sensing data research; and it is integrated into one to achieve maximum information acquisition at a very low system cost.

[0028] Taking into account the fields of view, acquisition frame rates, and synchronization requirements of motion control of different detection units, synchronous acquisition of various components is achieved under the control of the control motherboard 6. In the subsequent data processing and analysis, the field of view (lowest) of the hyperspectral shooting is used as a reference benchmark, and other fields of view are spatially matched and corrected with it, ultimately realizing a lidar hyperspectral imaging system with thermal imaging temperature information. The data collected by the system includes a multi-source information structure that integrates the temperature, characteristic spectrum, spatial information (coordinates), and lidar three-dimensional point cloud data information of each target point (pixel point).

[0029] The above are only preferred embodiments of the present application, and the present invention is not limited to the above embodiments. It is understood that other improvements and variations directly derived or imagined by those skilled in the art without departing from the spirit and concept of the present invention should be considered to be included in the scope of protection of the present invention.

Claims

1. A device for synchronously acquiring multi-source images and spectral information, characterized by: The invention comprises a vehicle and a carrier (1), wherein the vehicle is used to carry the carrier (1) for movement, and the carrier (1) is provided with a hyperspectral imaging camera (2), a laser radar (3), a thermal imaging camera (4), an imaging spectrometer (5), a control mainboard (6), and a processor (7); The hyperspectral imaging camera (2) and the thermal imaging camera (4) are arranged on a first side of the carrier (1), and the laser radar (3) is arranged on a second side of the carrier (1), wherein the first side and the second side are perpendicular to each other; The imaging spectrometer (5), the control mainboard (6) and the processor (7) are all arranged on the inner side of the carrier (1).

2. The device for synchronously acquiring multi-source images and spectral information according to claim 1, wherein: An RGB color camera (8) is provided on the carrier (1), and the RGB color camera (8) is provided on the first side.

3. The device for synchronously acquiring multi-source images and spectral information according to claim 2, wherein: The distance between the center point of the thermal imaging camera (4) and the center point of the RGB color camera (8) is between 40 mm and 42 mm.

4. The device for synchronously acquiring multi-source images and spectral information according to claim 3, wherein: The distance between the center point of the thermal imaging camera (4) and the center point of the hyperspectral imaging camera (2) is between 45 mm and 47 mm.

5. The device for synchronously acquiring multi-source images and spectral information according to claim 4, characterized in that: The distance between the center point of the RGB color camera (8) and the center point of the hyperspectral imaging camera (2) is between 64 mm and 66 mm.

6. The device for synchronously acquiring multi-source images and spectral information according to claim 5, characterized in that: The laser radar (3) includes a radar housing (31), a laser transmitter (32) and a laser receiver (33).

7. The device for synchronously acquiring multi-source images and spectral information according to claim 6, wherein: The line between the center of the receiving end of the laser receiver (33) and the center of the transmitting end of the laser transmitter (32) is L, the line between the center point of the thermal imaging camera (4) and the center point of the hyperspectral imaging camera (2) is N, and the RGB color camera (8) is arranged on the side of N away from L.

8. The device for synchronously acquiring multi-source images and spectral information according to claim 7, characterized in that: The distance between L and the center point of the hyperspectral imaging camera (2) is between 80 mm and 82 mm.

9. The device for synchronously acquiring multi-source images and spectral information according to claim 6, wherein: The laser radar (3) further comprises a driving component, wherein the driving component is used to drive the laser transmitter (32) and the laser receiver (33) to rotate in a direction perpendicular to the first side.

10. The device for synchronously acquiring multi-source images and spectral information according to claim 7, wherein: The incident slit of the imaging spectrometer (5) is parallel to L.

Images