A multi-source image and spectral information synchronous acquisition device
By integrating a hyperspectral imaging camera, lidar, thermal imaging camera, and imaging spectrometer into the spectral detection device, the problem of the inability to simultaneously acquire multidimensional information in existing technologies is solved, realizing the fusion of multi-source signals and efficient information acquisition.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Utility models(China)
- Current Assignee / Owner
- SICHUAN DUALIX SPECTRAL IMAGING TECHNOLOGY CO LTD
- Filing Date
- 2025-06-24
- Publication Date
- 2026-06-12
AI Technical Summary
Existing spectral detection devices cannot simultaneously acquire multidimensional information from the same target source.
Design a multi-source image and spectral information synchronous acquisition device, including a hyperspectral imaging camera, lidar, thermal imaging camera, imaging spectrometer, control motherboard and processor. The device is carried by a carrier and moves to realize a target detection system integrating hyperspectral imaging, lidar and thermal imaging, and synchronously acquires multi-source signals.
It achieves the fusion of multi-source signals, providing more dimensional information for deep remote sensing data research, and the system has low cost, maximizing information acquisition.
Smart Images
Figure CN224354583U_ABST
Abstract
Description
Technical Field
[0001] This utility model belongs to the field of spectral detection, specifically relating to a device for synchronous acquisition of multi-source images and spectral information. Background Technology
[0002] The principle of spectroscopic detection is based on the interaction between light and matter. Light is an electromagnetic wave with different wavelengths and frequencies. When light strikes a substance, phenomena such as reflection and absorption occur, causing changes in the wavelength and intensity of the light, forming different spectra. Each substance has its unique spectral characteristics, much like a fingerprint, which can be used to analyze the composition and structure of the substance. Spectroscopic detection is widely used in many industries and fields, including pharmaceuticals, food, biology, ceramics, petroleum, glass, metals, inks, paper, ores, coatings, and soil.
[0003] Most existing spectral detection devices rely on hyperspectral imaging cameras to collect data from target sources, resulting in relatively limited information acquisition and an inability to simultaneously collect multidimensional information from the same target source.
[0004] In view of this, there is an urgent need for a device for simultaneous acquisition of multi-source images and spectral information. Utility Model Content
[0005] In view of the problems in the prior art, this utility model provides a device for simultaneous acquisition of multi-source images and spectral information to solve the problems in the prior art.
[0006] To achieve the above technical objectives, the technical solution of this utility model is as follows:
[0007] A device for synchronous acquisition of multi-source images and spectral information includes a carrier and a platform. The carrier is used to carry the platform for movement. The platform is equipped with a hyperspectral imaging camera, a lidar, a thermal imaging camera, an imaging spectrometer, a control motherboard, and a processor.
[0008] The hyperspectral imaging camera and thermal imaging camera are disposed on the first side of the carrier, and the lidar is disposed on the second side of the carrier, with the first side and the second side being perpendicular to each other;
[0009] The imaging spectrometer, control motherboard, and processor are all located inside the carrier.
[0010] An RGB color camera is mounted on the carrier and is positioned on the first side.
[0011] The distance between the center point of the thermal imaging camera and the center point of the RGB color camera is between 40 mm and 42 mm.
[0012] The distance between the center point of the thermal imaging camera and the center point of the hyperspectral imaging camera is between 45 mm and 47 mm.
[0013] The distance between the center point of the RGB color camera and the center point of the hyperspectral imaging camera is between 64 mm and 66 mm.
[0014] The lidar includes a lidar housing, a laser transmitter, and a laser receiver.
[0015] The line connecting the center of the laser receiver and the center of the laser emitter is L, the line connecting the center point of the thermal imaging camera and the center point of the hyperspectral imaging camera is N, and the RGB color camera is located on the side of N away from L.
[0016] The distance between L and the center point of the hyperspectral imaging camera is between 80 mm and 82 mm.
[0017] The lidar also includes a drive assembly for driving the laser emitter and laser receiver to rotate in a direction perpendicular to the first side.
[0018] The entrance slit of the imaging spectrometer is parallel to L.
[0019] The above-described structure of this utility model can achieve the following beneficial effects:
[0020] By mounting a hyperspectral imaging camera, lidar, thermal imaging camera, and imaging spectrometer on a carrier, and using the carrier to move and detect targets, a target detection system integrating hyperspectral imaging, lidar, and thermal imaging is achieved. The synchronous acquisition of target signals by different detection units facilitates the fusion of multi-source signals, providing more dimensional information for deep remote sensing data research. Furthermore, the system is integrated into one unit, maximizing information acquisition at a very low system cost. Attached Figure Description
[0021] Figure 1 This is a structural schematic diagram of an embodiment of the present utility model;
[0022] Figure 2 This is a schematic diagram of the internal structure of the carrier in an embodiment of this utility model;
[0023] Figure 3 This is a structural schematic diagram from another perspective of an embodiment of the present utility model;
[0024] Figure 4 This is a schematic diagram of the field of view of the hyperspectral imaging camera, lidar, thermal imaging camera, and RGB color camera in this utility model.
[0025] In the diagram: 1. Carrier; 2. Hyperspectral imaging camera; 3. LiDAR; 31. LiDAR housing; 32. Laser emitter; 33. Laser receiver; 4. Thermal imaging camera; 5. Imaging spectrometer; 6. Control motherboard; 7. Processor; 8. RGB color camera. Detailed Implementation
[0026] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the protection scope of the present invention.
[0027] It should be noted that the terms "comprising" and "having" and any variations thereof in the specification, claims and accompanying drawings of this utility model are intended to cover non-exclusive inclusion. For example, a process, method, apparatus, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are explicitly listed, but may include other steps or units that are not explicitly listed or that are inherent to such processes, methods, products or devices.
[0028] The following is in conjunction with the appendix Figure 1-4 This application will be described in further detail.
[0029] refer to Figure 1-3 The multi-source image and spectral information synchronous acquisition device shown includes a vehicle and a carrier 1. The vehicle is used to carry the carrier 1 for movement. The vehicle is preferably a drone. The carrier 1 is equipped with a hyperspectral imaging camera 2, a lidar 3, a thermal imaging camera 4, an imaging spectrometer 5, a control motherboard 6, and a processor 7.
[0030] The hyperspectral imaging camera 2 and the thermal imaging camera 4 are disposed on the first side of the carrier 1, and the lidar 3 is disposed on the second side of the carrier 1, with the first side and the second side being perpendicular to each other.
[0031] The imaging spectrometer 5, the control motherboard 6, and the processor 7 are all located inside the carrier 1.
[0032] Based on the above structure, a hyperspectral imaging camera 2, a lidar 3, a thermal imaging camera 4, and an imaging spectrometer 5 are installed on the carrier 1. In use, the carrier 1 is moved by the vehicle to detect the target, realizing a target detection system integrating hyperspectral imaging, lidar, and thermal imaging. The synchronous acquisition of target signals by different detection units is beneficial to the fusion of multi-source signals, providing more dimensional information for deep remote sensing data research. Furthermore, the integration into one system maximizes information acquisition at a very low system cost.
[0033] Further optimizations include, for example Figure 3 As shown, an RGB color camera 8 is installed on the carrier 1. The RGB color camera 8 is located on the first side and performs real-time image acquisition and storage simultaneously, serving as the module with the largest field of view.
[0034] like Figure 1-3 As shown, the lidar 3 includes a lidar housing 31, a laser emitter 32, and a laser receiver 33; the line connecting the center of the receiving end of the laser receiver 33 and the center of the emitting end of the laser emitter 32 is L, the line connecting the center point of the thermal imaging camera 4 and the center point of the hyperspectral imaging camera 2 is N, and the RGB color camera 8 is located on the side of N away from L; the lidar 3 also includes a driving assembly, which is used to drive the laser emitter 32 and the laser receiver 33 to rotate in a direction perpendicular to the first side. Multiple pairs of laser emitters 32 and laser receivers 33 can be fixedly installed on the rotor of the lidar. The horizontal 360° scanning is achieved by rotating through the internal driving assembly (motor), and the channels of the lidar are evenly distributed in the vertical direction.
[0035] Further optimizations include, for example Figure 4 As shown, in order to achieve the most ideal image acquisition in real time with multiple target sources, the distance between the center point of the thermal imaging camera 4 and the center point of the RGB color camera 8 is between 40 mm and 42 mm (e.g., 40 mm, 41 mm, or 42 mm); the distance between the center point of the thermal imaging camera 4 and the center point of the hyperspectral imaging camera 2 is between 45 mm and 47 mm (e.g., 45 mm, 46 mm, or 47 mm); the distance between the center point of the RGB color camera 8 and the center point of the hyperspectral imaging camera 2 is between 64 mm and 66 mm (e.g., 64 mm, 65 mm, or 66 mm); and the distance between L and the center point of the hyperspectral imaging camera 2 is between 80 mm and 82 mm (e.g., 80 mm, 81 mm, or 82 mm); the entrance slit of the imaging spectrometer 5 is parallel to L; because the thermal (infrared) imaging camera 4 (e.g., Figure 4 As shown in Figure 110-2, this represents the field of view of the thermal imaging camera and the RGB color camera 8 (as shown in Figure 110-2). Figure 4As shown in Figure 110-1 (which illustrates the field of view of the RGB acquisition camera), this is an area array camera that captures full-frame area array images. Its frame rate is sufficient to meet the time response requirements of the data acquired by the aforementioned LiDAR and hyperspectral cameras. Moreover, the field of view of both is much larger than that of LiDAR and hyperspectral cameras, while LiDAR uses point-by-point line scanning (e.g., ...). Figure 4 As shown in Figure 110-4, which represents the field of view of a lidar camera, data is collected point by point in this row, unlike hyperspectral line scanning; hyperspectral cameras (such as...) Figure 4 As shown in Figure 110-3, the field of view of the hyperspectral camera is a slit (line) scanning imaging system. This line is continuous, and a fixed-focus imaging lens is used. The width of each line of information acquired varies depending on the distance to the target. The time required to acquire this line of target data is related to the set exposure time parameters, camera frame rate, and thus the aircraft's flight speed. Otherwise, the acquired line data will be distorted (higher flight speeds result in compressed images; slower flight speeds result in stretched images). Therefore, optimal flight parameters need to be calculated. In summary, as... Figure 4 As shown in Figure 110-5, this is the final cropped field of view.
[0036] In summary, by mounting a hyperspectral imaging camera 2, a lidar 3, a thermal imaging camera 4, and an imaging spectrometer 5 on carrier 1, and using the carrier 1 to move and detect targets, a target detection system integrating hyperspectral imaging, lidar, and thermal imaging is achieved. The synchronous acquisition of target signals by different detection units facilitates the fusion of multi-source signals, providing more dimensional information for deep remote sensing data research. Furthermore, the system is integrated into one unit, maximizing information acquisition at a very low system cost.
[0037] Considering the synchronization requirements of different detection units in terms of field of view, acquisition frame rate, and motion control, the synchronous acquisition of each component is achieved under the control of the main control board 6. In the subsequent data processing and analysis, the field of view (lowest) of the hyperspectral imaging is used as the reference benchmark, and other fields of view are spatially matched and calibrated with it to finally realize a hyperspectral imaging system of lidar with thermal imaging temperature information. The data acquired by the system includes a multi-source information structure that integrates the temperature, characteristic spectrum, spatial information (coordinates), and lidar three-dimensional point cloud data of each target point (pixel).
[0038] The above are merely preferred embodiments of this application, and the present invention is not limited to the above embodiments. It is understood that other improvements and variations that can be directly derived or conceived by those skilled in the art without departing from the spirit and concept of the present invention should be considered to be included within the protection scope of the present invention.
Claims
1. A device for synchronous acquisition of multi-source images and spectral information, characterized in that: It includes a vehicle and a carrier (1), the vehicle being used to carry the carrier (1) for movement, and the carrier (1) being equipped with a hyperspectral imaging camera (2), a lidar (3), a thermal imaging camera (4), an imaging spectrometer (5), a control motherboard (6), and a processor (7). The hyperspectral imaging camera (2) and the thermal imaging camera (4) are disposed on the first side of the carrier (1), and the lidar (3) is disposed on the second side of the carrier (1), with the first side and the second side being perpendicular to each other; The imaging spectrometer (5), the control motherboard (6), and the processor (7) are all located inside the carrier (1).
2. The multi-source image and spectral information synchronous acquisition device according to claim 1, characterized in that: An RGB color camera (8) is provided on the carrier (1), and the RGB color camera (8) is located on the first side.
3. The multi-source image and spectral information synchronous acquisition device according to claim 2, characterized in that: The distance between the center point of the thermal imaging camera (4) and the center point of the RGB color camera (8) is between 40 mm and 42 mm.
4. The multi-source image and spectral information synchronous acquisition device according to claim 3, characterized in that: The distance between the center point of the thermal imaging camera (4) and the center point of the hyperspectral imaging camera (2) is between 45 mm and 47 mm.
5. The multi-source image and spectral information synchronous acquisition device according to claim 4, characterized in that: The distance between the center point of the RGB color camera (8) and the center point of the hyperspectral imaging camera (2) is between 64 mm and 66 mm.
6. The multi-source image and spectral information synchronous acquisition device according to claim 5, characterized in that: The lidar (3) includes a lidar housing (31), a laser transmitter (32), and a laser receiver (33).
7. The multi-source image and spectral information synchronous acquisition device according to claim 6, characterized in that: The line connecting the center of the receiving end of the laser receiver (33) and the center of the emitting end of the laser emitter (32) is L, the line connecting the center point of the thermal imaging camera (4) and the center point of the hyperspectral imaging camera (2) is N, and the RGB color camera (8) is located on the side of N away from L.
8. The multi-source image and spectral information synchronous acquisition device according to claim 7, characterized in that: The distance between L and the center point of the hyperspectral imaging camera (2) is between 80 mm and 82 mm.
9. The multi-source image and spectral information synchronous acquisition device according to claim 6, characterized in that: The lidar (3) also includes a drive assembly for driving the laser emitter (32) and the laser receiver (33) to rotate in a direction perpendicular to the first side.
10. The multi-source image and spectral information synchronous acquisition device according to claim 7, characterized in that: The entrance slit of the imaging spectrometer (5) is parallel to L.