Multi-source target detection device

Abstract

The utility model discloses a multi-source target detection device, and relates to the field of spectral detectors, a hyperspectral imaging module comprises a movable imaging lens protruding out of a mounting shell, an imaging spectrometer communicated with the imaging lens, and a detector mounted at the output part of the imaging spectrometer; the RGB camera and the imaging lens are located in the same acquisition direction, and a lens of the RGB camera is embedded into the surface of the shell to acquire an RGB image; the push-sweeping module is mounted on the inner wall of the mounting shell and comprises a driving motor, a sliding rail and a push-sweeping platform; the push-broom platform is mounted on the slide rail, the imaging lens is embedded in a mounting hole of the push-broom platform, and light enters through a slit at the entrance of the spectrometer; the push-scan platform is controlled based on the driving motor and moves along the sliding rail, and a hyperspectral image is obtained through push-scan. According to the scheme, the problems of poor precision and difficulty in correction of aircraft push-scan imaging are solved through the built-in push-scan module, and image type diversification is realized through the built-in multifunctional camera module.

Description

Technical Field

[0001] This application relates to the field of spectral detectors, and in particular to a multi-source target detection device. Background Technology

[0002] The working principle of a hyperspectral detector is as follows: the probe acquires target light, converts it into an electrical signal via a photoelectric converter, and then converts it into a digital signal via an A / D (digital-to-analog) converter before inputting it into a computer. It combines imaging and spectral technologies, simultaneously detecting the spatial characteristics of objects and generating a continuous spectrum of tens to hundreds of narrow bands for each spatial pixel, achieving high spectral resolution (typically less than 10 nanometers), suitable for fine-grained quantitative analysis in remote sensing. In forestry, hyperspectral detectors capture the reflection or absorption characteristics of vegetation in specific bands, forming a "spectral fingerprint," which, combined with algorithmic models, allows for the inversion of vegetation's physiological state. In environmental monitoring, hyperspectral detectors can identify surface pollutants through spectral differences, making them suitable for environmental monitoring in complex scenarios, such as identifying surface pollutants through spectral differences and assisting in assessing crop health. In agriculture, hyperspectral imaging technology can assist in assessing crop health, helping farmers better manage farmland. For example, by analyzing the spectral characteristics of crops, their nutritional status and pest and disease conditions can be determined, allowing for appropriate management measures.

[0003] In certain situations, target detection requires the combination of spectral analysis and image data analysis, while detection combined with aerial photography requires large-area image data analysis. However, it is difficult to achieve accurate positioning and regional image stitching by simply using spectral equipment with aircraft pushbroom imaging. The accuracy of spectral data is difficult to guarantee, and relying solely on spectral data cannot intuitively identify the target area, nor can it achieve diversification of target image types. Summary of the Invention

[0004] This application provides a multi-source target detection device to solve the problems of low accuracy and data reliability of pushbroom imaging in a large field of view and the limited image types of a single spectral detector.

[0005] The multi-source target detection device of this application includes a mounting shell, a hyperspectral imaging module, an RGB camera module, and a pushbroom module;

[0006] The hyperspectral imaging module includes a movable imaging lens protruding from the outside of the mounting housing, an imaging spectrometer inside the mounting housing that communicates with the imaging lens, and a detector installed at the output of the imaging spectrometer.

[0007] The RGB camera module is located inside the mounting housing, with the RGB camera and imaging lens positioned in the same acquisition direction, and the lens of the RGB camera embedded in the surface of the housing to acquire RGB images.

[0008] The push-broom module is installed on the inner wall of the mounting housing and includes a drive motor, a slide rail, and a push-broom platform. The push-broom platform is installed on the slide rail, and the imaging lens is embedded in the mounting hole of the push-broom platform. Light enters through the slit at the entrance of the spectrometer. The push-broom platform moves along the slide rail based on the control of the drive motor, and push-brooms to acquire hyperspectral images.

[0009] Specifically, the imaging spectrometer is a reflection-transmission integrated structure fixed inside the housing, with the inlet of the reflection section and the inlet of the transmission section forming a preset angle, and the detector installed at the outlet of the transmission section;

[0010] The entrance to the reflector is vertically downward, receiving light incident from the imaging lens through a slit. After reflection, the light enters the transmission section and the detector.

[0011] Specifically, a processor module and a control motherboard are also installed inside the mounting housing; the control motherboard is installed in the space between the reflective and transmissive parts of the imaging spectrometer.

[0012] The processor module is installed on the side of the transmission section of the imaging spectrometer, and the drive motor is located in the space between the transmission section and the detector of the imaging spectrometer.

[0013] Specifically, a thermal imaging camera is installed on the side of the reflector of the imaging spectrometer, and the thermal imaging lens is embedded in the surface of the housing to acquire thermal images according to control; the RGB camera is located between the processor module and the thermal imaging camera.

[0014] Specifically, the push-broom module also includes a push rod and a driver. One end of the push rod is connected to the output shaft of the drive motor, and the other end is connected to the push-broom platform.

[0015] The driver is located on the side of the drive motor and controls the drive motor to perform the push-broom operation.

[0016] Specifically, a pair of limiting plates distributed along the sliding rail movement direction are also set on the push-broom platform, and a pair of photoelectric limiting sensors matching the limiting plates are installed on the imaging spectrometer located above the push-broom platform; the push-broom module controls the push-broom distance by detecting the two limiting plates.

[0017] Specifically, the imaging lens and the mounting housing have an adjustment hole with an opening size larger than the lens barrel diameter at the interference fit. The imaging lens extends into the adjustment hole and is fitted into the mounting hole on the push-broom platform.

[0018] A flexible dustproof sheet is installed inside the adjustment hole, which encloses the imaging lens and is connected to the push-broom platform and the adjustment hole.

[0019] The beneficial effects of the technical solution provided in this application include at least the following: The detection device and image fusion correction method can correct the system attitude in real time based on the gimbal, and can better reflect the fusion of hyperspectral images, spectra, thermal imaging (temperature) and other information of the captured area, providing better support for subsequent analysis. An RGB camera is used to solve the problem of hyperspectral image distortion. The RGB camera and the hyperspectral camera are designed on the same platform, ensuring that their alignment angles are consistent, and achieving simultaneous imaging. Using a pixel-level image alignment high-matching method, the hyperspectral image and the area array camera image can be accurately registered, thereby achieving the purpose of image fusion and distortion correction.

[0020] Furthermore, the additional thermal imaging camera in this scheme can also achieve thermal imaging data acquisition of the target area and assist in image fusion correction. The entire device integrates multiple camera modules, processors, control motherboards, and pushbroom modules that control pushbroom operations into a limited space. With the help of RGB cameras, stabilization gimbals, and lens pushbroom imaging structures, it achieves the ability to acquire remote sensing images, spectra, temperature, and other information sources with high precision and high efficiency. It overcomes the problems of poor accuracy and difficulty in correction when using aircraft to achieve pushbroom imaging mode. It improves the spatial resolution of imaging and simultaneously reflects the advantages of diverse target image types in the same domain, providing technical support for scientific research and industry applications. Attached Figure Description

[0021] Figure 1 This is a schematic diagram of the structure of the hyperspectral imaging module provided in the embodiments of this application;

[0022] Figure 2 These are schematic diagrams and cross-sectional views of the imaging spectrometer provided in the embodiments of this application;

[0023] Figure 3 This is a schematic diagram of the overall structure of the multi-source target detection device provided in the embodiments of this application;

[0024] Figure 4 This is a diagram showing the lens installation of each camera module;

[0025] Figure 5 This is a schematic diagram of the overall structure of a multi-source target detection device from another perspective;

[0026] Figure 6 A cross-sectional view of the push-broom module is shown.

[0027] Figure 7 A partial cross-sectional magnified view of the pushbroom module and imaging lens is shown;

[0028] Figure 8 This is a flowchart of the coating method for the multi-source target detection device provided in this application;

[0029] Figure 9 This is a schematic diagram of stitching together RGB images and hyperspectral images taken at adjacent waypoints.

[0030] Reference numerals: 1. Mounting housing; 2. Imaging spectrometer; 3. Detector; 4. Imaging lens; 5. Thermal imaging camera; 6. RGB camera; 7. Processor module; 8. Control motherboard; 9. Drive motor; 10. Slide rail; 11. Flexible dustproof sheet; 12. Remote photoelectric limit sensor; 13. Remote limit plate; 14. Proximal photoelectric limit sensor; 15. Proximal limit plate; 16. Push-broom platform; 17. Push rod; 18. Driver; 19. Adjustment hole. Detailed Implementation

[0031] To make the objectives, technical solutions, and advantages of this application clearer, the embodiments of this application will be described in further detail below with reference to the accompanying drawings.

[0032] Figure 1 This is a schematic diagram of the hyperspectral imaging module provided in this application embodiment. The device is highly integrated into the enclosed mounting housing 1, and all the acquisition cameras are concentrated on one mounting surface. That is, when the device is installed on the aircraft, the acquisition surface should be vertically downward. The mounting housing 1 houses the hyperspectral imaging module, the RGB camera module, and the pushbroom module, etc.

[0033] Figure 1 The image only shows the shell surface in which various lens modules are embedded. The hyperspectral imaging module includes a movable imaging lens 4 protruding from the outside of the mounting shell 1, an imaging spectrometer 2 inside the mounting shell 1 that communicates with the imaging lens 4, and a detector 3 installed at the output of the imaging spectrometer 2.

[0034] The structure of imaging spectrometer 2 in this scheme can be referenced. Figure 2 As shown, the lower arrow indicates the direction of light entry, corresponding to imaging lens 4. The right arrow indicates the direction of light output, corresponding to the installation of detector 3. During installation, the light entry direction should be set vertically downwards to suit the aerial photography perspective.

[0035] Figure 3 This is a schematic diagram of the overall structure of the multi-source target detection device provided in this application embodiment, wherein the RGB camera module is also located inside the mounting housing 1. Figure 4This is a schematic diagram of the lens installation for each camera module. The RGB camera 6 and the imaging lens 4 are located in the same acquisition direction. The lens of the RGB camera 6 is embedded in the surface of the housing and acquires RGB images according to instructions. It's important to note that the imaging lens 4 of the hyperspectral imaging module is detachable and therefore positioned relatively outside the housing. Furthermore, the spectral principle dictates that the tube length cannot be placed inside the housing. The introduction of the RGB camera 6 is essentially to facilitate real-time acquisition of color RGB images for auxiliary positioning, as well as to assist in the stitching and correction of hyperspectral images, as described in the method embodiment.

[0036] Figure 5 This is a schematic diagram of the overall structure of the multi-source target detection device from another perspective. The pushbroom module is also mounted on the inner wall of the mounting housing 1, and is located on the housing surface near the various lenses. This module includes a drive motor 9, a slide rail 10, and a pushbroom platform 16. The slide rail 10 and drive motor 9 are fixed to the housing, while the pushbroom platform 16 is mounted on the slide rail 10. Controlled by the drive motor 9, it moves along the slide rail 10, and the pushbroom acquires hyperspectral images.

[0037] In this application's structure, the pushbroom platform 16 is used to support and move the imaging lens 4, and also serves to connect the imaging lens 4 with the imaging spectrometer 2 inside the housing. Because the collected light ultimately needs to enter the detector 3, the pushbroom platform 16 needs to have a (cylindrical) mounting hole that can embed the integrated imaging lens 4. The integrated imaging lens 4 is embedded in the mounting hole of the pushbroom platform 16, and the light enters through the slit at the entrance of the spectrometer 2. Figure 2 The circled part in the imaging spectrometer 2 is the slit entrance. It should be noted that the internal detailed structure of the imaging spectrometer 2 is not within the scope of protection of this application and will not be described here.

[0038] Because this multi-source target detection device needs to integrate control, acquisition, and data processing functions, it requires the integration of numerous components and processing modules. Furthermore, since the device needs to be installed on an aircraft, a rational spatial layout is essential. Therefore, this application designs the imaging spectrometer 2 as a single reflective-transmittance structure, which is then fixed inside the housing.

[0039] like Figure 2 As shown, the imaging spectrometer 2 is divided into a cylindrical reflective section and a transmissive section. The entrances of the reflective section and the transmissive section form a preset angle, and the detector 3 is installed at the exit of the transmissive section. In one possible embodiment, the preset angle is set to 45 degrees, so that the entrance of the reflective section is set vertically downward, receiving the light incident from the imaging lens 4 through a slit, and then entering the transmissive section and detector 3 after reflection. The detector 3 and the transmissive section also form a 45-degree angle with respect to the plane of the housing. The two angled spaces formed can accommodate other modules. In this application, the pushbroom module is placed in the space below the transmissive section of the imaging spectrometer 2.

[0040] The device also includes a processor module 7 and a control motherboard 8 inside the mounting housing 1. The control motherboard 8 is installed in the space (45 degrees) between the reflective and transmissive sections of the imaging spectrometer 2. The processor module 7 is installed on the side of the transmissive section of the imaging spectrometer 2, and the drive motor 9 of the push-broom module is located in the space below the transmissive section and detector 3 of the imaging spectrometer 2.

[0041] like Figure 3 and Figure 4 As shown, a thermal imaging camera 5 is installed on the side of the reflector of the imaging spectrometer 2. The thermal imaging lens is embedded in the surface of the housing and acquires thermal images according to control. An RGB camera 6 is positioned between the processor module 7 and the thermal imaging camera 5. The three lenses form a triangular positioning relationship, and the viewing angle of each lens is adjusted according to the actual situation.

[0042] To facilitate the description of the relationship between the imaging spectrometer 2 and the imaging lens 4, Figure 6 A cross-sectional view of the push-broom module is shown. Figure 7 A partial cross-sectional enlarged view of the pushbroom module and imaging lens is shown. The most important aspects of camera pushbroom are stability and sealing, because the imaging camera 4 is movable, but the imaging spectrometer 2 is fixed. Therefore, the pushbroom platform 16 connecting the two is extremely important. In this structure, an adjustment hole 19 with an opening larger than the lens barrel diameter is provided at the interference fit between the imaging lens 4 and the mounting housing 1. The imaging lens 4 extends into the adjustment hole 19 and fits into the mounting hole on the pushbroom platform 16. To achieve a dustproof sealing effect, a flexible dustproof sheet 11 is provided inside the adjustment hole 19, enclosing the imaging lens 4 and connecting to the pushbroom platform 16 and the adjustment hole 19. (Refer to...) Figure 7 The flexible dustproof sheet 11 features a fish-scale-like layered design, exhibiting excellent stretchability. The adjustment hole 19 can be designed as a rectangle, with the length of the rectangle corresponding to the direction of movement of the imaging lens 4. Alternatively, the rectangular adjustment hole 19 can be designed as a recessed groove, with protruding support ends around the rectangle. The flexible dustproof sheet 11 is fixed at both ends to the support ends along the width of the rectangle, while the support ends along the length of the rectangle support the flexible dustproof sheet 11. This flexible structure ensures a tight seal during movement, preventing external light from entering the imaging spectrometer 2.

[0043] from Figure 5 As can be seen from the diagram, the push-broom module also includes a push rod 17 and a driver 18. One end of the push rod 17 is connected to the output shaft of the drive motor 9, and the other end is connected to the push-broom platform 16. The driver 18 is located on the side of the drive motor 9. When the driver 18 receives the instruction sent by the processor module 7, it controls the drive motor 9 to run, and under the action of the push rod 17, it pulls the push-broom platform 16 to perform the push-broom operation along the slide rail 10.

[0044] Because the imaging lens 4 is embedded in the push-broom platform 16, this structure, under one-dimensional electronic control, causes the rear focal plane lens of the imaging lens 4 and the entrance slit of the imaging spectrometer 2 to tend to move relative to each other, thereby achieving push-broom imaging. The distance between the imaging lens 4 and the slit can be determined by the object distance, lens focal length, etc. The standard imaging relationship is: the distance from the imaging lens to the rear focal length imaging slit is 17.532mm. With the focal length of the imaging lens determined, the linear field of view of the target area can be basically determined, that is, the field of view that can be captured by the slit length. Under the drive of the aforementioned one-dimensional electronic control platform, the effective travel of the imaging lens 4 is 1cm. This travel determines the scanning field of view width of the system. Under a specified height or distance, the target area (area) of a single target can be determined by the aforementioned two field of view dimensions.

[0045] The effective travel distance of the imaging lens 4 is determined by sensor detection. A pair of limiting plates, namely a proximal limiting plate 15 and a distal limiting plate 13, are provided on the push-broom platform 16 along the moving direction of the slide rail 10. A pair of photoelectric limiting sensors, namely a distal photoelectric limiting sensor 12 and a proximal photoelectric limiting sensor 14, are installed on the imaging spectrometer 2 located above the push-broom platform 16 and matched with the limiting plates. When the push-broom platform 16 moves the distal limiting plate 13 to the distal photoelectric limiting sensor 12, it stops moving away from the drive motor 9; when the push-broom platform 16 moves the proximal limiting plate 15 to the proximal photoelectric limiting sensor 14, it stops moving closer to the drive motor 9. The maximum travel distance at both ends is set to 1 cm.

[0046] In the entire imaging system, the built-in thermal imaging camera is designed to acquire thermal radiation image information of the object being photographed, and to obtain and record information such as temperature of the target area through this thermal imaging camera.

[0047] Although the fields of view formed by the three detection modules are different, they need to work together to achieve data calibration and correction. The images from the three detection sources are fused in time and space to obtain more information about the target.

[0048] The layout of the hyperspectral imaging module lens, RGB camera lens, and thermal imaging camera lens is designed considering their respective sizes and field of view; it also takes into account the order and timing of data acquisition. Because the entire imaging system, including the built-in hyperspectral imaging module, RGB camera, thermal imaging module, microprocessor, and electronic control components, is stationary—meaning only the imaging lens moves—the system's center of gravity is very stable. This stability is significantly better than when the imaging lens is stationary while the built-in imaging spectrometer module is in motion.

[0049] When the aforementioned imaging lens moves by 1cm, the center of gravity of the entire system only changes slightly. During this process, the three-dimensional stabilization gimbal of the aircraft will make real-time attitude corrections based on the one-dimensional motion platform moving by one unit step. This ensures that in each precise motion state, the UAV-borne imaging system is statically related to the target being photographed. This effectively guarantees attitude accuracy and image quality. Compared with aircraft pushbroom imaging methods, it greatly reduces the difficulty of post-processing data and eliminates the need to correct POS information every time, showing significant advantages.

[0050] Figure 8 The flowchart shown is a multi-source target detection method provided in an embodiment of this application, used for a drone equipped with a multi-source target detection device, and includes the following steps:

[0051] S1. Start the RGB camera module to capture RGB image video stream in real time. When flying to the first aerial shooting point, acquire the first RGB image, identify the first ROI area and mark it.

[0052] In this embodiment, the device can have a built-in 800W pixel RGB camera with a field of view of 75 degrees. The RGB camera can be set to frame-style shooting mode and can operate in both video streaming and image capture modes. When not acquiring hyperspectral images, it transmits RGB images back to the ground in real time as a video stream. When the aircraft flies to the first aerial photography point (a preset aerial photography location) and determines that the hyperspectral camera needs to take a picture, the RGB camera continues to transmit the monitored image; the two are independent threads. After the image of this scene is captured, the system moves to the next waypoint under the corresponding instruction and continues the repetitive work.

[0053] Upon reaching the aerial photography location, the first step is to control the RGB camera to capture the first RGB image of that location and field of view. This image is primarily used to identify the (first) Region of Interest (ROI). Specifically, the ROI can be defined through algorithmic settings, ensuring that the hyperspectral imagery area is accurately identified. The goal is to enable real-time observation and identification of the ROI during aerial operations, even without acquiring a hyperspectral image, thus accurately determining the area to be photographed and achieving a "what you see is what you get" effect.

[0054] S2. Switch to pushbroom imaging mode and start the hyperspectral imaging module to capture a hyperspectral image of the first ROI region. In pushbroom imaging mode, the pushbroom module controls the imaging lens to move along the slide rail and captures several frames of the first hyperspectral image according to the instructions.

[0055] When the system receives a command to switch to pushbroom mode, it randomly activates the hyperspectral imaging module to capture hyperspectral images of the previously determined first region of interest (ROI). In pushbroom imaging mode, an encoder controls a motor to move at a specified speed and frequency, controlling the imaging lens to move along the slide rail, and capturing several frames of the first hyperspectral image according to the command. Simultaneously with capturing the spectral images, RGB image acquisition and transmission can also be initiated, facilitating real-time data observation by the ground workstation.

[0056] S3. After the push-broom is completed, start the RGB camera module to capture the intermediate RGB image, fly to the second aerial photography point to obtain the second RGB image and mark the second ROI area;

[0057] The RGB camera is triggered the moment hyperspectral pushbroom imaging is completed, capturing and saving an RGB image for subsequent stitching reference. Theoretically, the aircraft is stationary at the first aerial shooting point; the only movement is a slight travel difference in pushbroom mode, which does not affect the RGB camera's shooting effect. However, to ensure accuracy, this application still captures a frame from the normal recording phase after pushbroom is completed and marks it as the intermediate RGB image.

[0058] Next, the aircraft is controlled to move to the second aerial photography point, acquire the second RGB image, and mark the second ROI region within it. The two ROI regions are not entirely identical; they typically contain overlapping areas. This facilitates later data stitching for large areas to be collected. Because spectral data is a series of bands, it is impossible to stitch images from different perspectives using image recognition technology. Therefore, this application introduces RGB images, leveraging their recognizability to indirectly align and stitch spectral images.

[0059] S4. Determine the camera attitude and viewing angle based on the second RGB image and the intermediate RGB image, switch to pushbroom imaging mode, and then capture several frames of the second hyperspectral image of the second ROI region according to the instructions.

[0060] Figure 9 This is a schematic diagram illustrating the stitching of RGB and hyperspectral images captured at adjacent waypoints. The system captures images strictly according to the waypoint trajectory, with a 25% overlap between adjacent waypoints. This overlap is for stitching the captured hyperspectral images; however, this can be adjusted according to different scenarios. The RGB camera serves two purposes: observation and providing a reference for subsequent data stitching and correction using the captured RGB color images.

[0061] Since the coordinates of the two aerial photography points are fixed, when moving to a new aerial photography point, the second RGB image needs to include a portion of the intermediate RGB image. This means that, at the distance between two adjacent aerial photography points, the two Regions of Interest (ROIs) acquired by the hyperspectral imaging module in the corresponding imaging field of view overlap. The processor module determines the camera attitude and viewing angle based on the overlapping area between the second RGB image and the intermediate RGB image.

[0062] S5. Based on the camera's pose and perspective, and the intermediate RGB image, stitch and fuse the first hyperspectral image with the second hyperspectral image.

[0063] Camera pose and viewpoint are essentially the matrix transformation formula for image stitching and fusion. Once the ROI (Region of Interest) position in the RGB image is determined, the first stitching matrix between the corresponding waypoint RGB image and the hyperspectral image can be determined. By aligning the overlapping areas of the two RGB images, the second stitching matrix of the adjacent RGB images can be determined based on their coordinate relationships. Then, the stitching matrix relationship between the two hyperspectral images can be calculated by combining the first and second stitching matrices, allowing for direct fusion and stitching.

[0064] In some embodiments, to improve stitching accuracy and data richness, a thermal imaging camera is activated in pushbroom mode to capture thermal images. These thermal images can also be used to assist in hyperspectral image fusion and stitching, or to acquire thermal imaging data of a specific target area. Temperature and other information can then be acquired and recorded using these thermal images. To this end, this application can also set the imaging field of view of the RGB camera module to be larger than that of the hyperspectral imaging module. The imaging field of view of the thermal imaging camera is between that of the RGB camera module and the hyperspectral imaging module; that is, in terms of image content, the ROI area... Thermal imaging target area RGB region. This allows us to calculate the stitching matrix relationship of the hyperspectral image based on the RGB image and the thermal image respectively, and then calculate the final hyperspectral image stitching matrix relationship according to the set weight ratio, and then directly perform fusion stitching.

[0065] In summary, the technical effects of this application's solution include: the detection device and image fusion correction method can correct the system attitude in real time based on the gimbal, enabling better accuracy in fusing hyperspectral images, spectra, and thermal imaging (temperature) information of the captured area, providing better support for subsequent analysis. An RGB camera is used to address the problem of hyperspectral image distortion. By designing the RGB camera and the hyperspectral camera on the same platform and ensuring their alignment angles are consistent, simultaneous imaging is achieved. A pixel-level image alignment high-matching method can precisely register the hyperspectral image with the area array camera image, thereby achieving image fusion and distortion correction.

[0066] Furthermore, the additional thermal imaging camera in this scheme can also achieve thermal imaging data acquisition of the target area and assist in image fusion correction. The entire device integrates multiple camera modules, processors, control motherboards, and pushbroom modules that control pushbroom operations into a limited space. With the help of RGB cameras, stabilization gimbals, and lens pushbroom imaging structures, it achieves the ability to acquire remote sensing images, spectra, temperature, and other information sources with high precision and high efficiency. It overcomes the problems of poor accuracy and difficulty in correction when using aircraft to achieve pushbroom imaging mode. It improves the spatial resolution of imaging and simultaneously reflects the advantages of diverse target image types in the same domain, providing technical support for scientific research and industry applications.

[0067] This specific embodiment is merely an explanation of the present invention and is not intended to limit the invention. After reading this specification, those skilled in the art can make modifications to this embodiment without contributing any inventive step, but such modifications are protected by patent law as long as they are within the scope of the claims of the present invention.

Claims

1. A multi-source target detection device, characterized in that, It includes a mounting housing (1), a hyperspectral imaging module, an RGB camera module, and a pushbroom module; The hyperspectral imaging module includes a movable imaging lens (4) protruding from the outside of the mounting housing (1), an imaging spectrometer (2) inside the mounting housing (1) and communicating with the imaging lens (4), and a detector (3) installed at the output of the imaging spectrometer (2). The RGB camera module is located inside the mounting shell (1), wherein the RGB camera (6) and the imaging lens (4) are located in the same acquisition direction, and the lens of the RGB camera (6) is embedded in the surface of the shell to acquire RGB images; The push-broom module is installed on the inner wall of the mounting housing (1) and includes a drive motor (9), a slide rail (10) and a push-broom platform (16). The push-broom platform (16) is installed on the slide rail (10), and the imaging lens (4) is embedded in the mounting hole of the push-broom platform (16). Light enters through the slit at the entrance of the spectrometer (2). The push-broom platform (16) moves along the slide rail (10) based on the control of the drive motor (9) and push-brooms to acquire hyperspectral images.

2. The multi-source target detection device according to claim 1, characterized in that, The imaging spectrometer (2) is a reflection-transmission integrated structure fixed in the housing. The inlet of the reflection part and the inlet of the transmission part are at a preset angle. The detector (3) is installed at the outlet of the transmission part. The entrance of the reflector is vertically downward, and it receives the light incident from the imaging lens (4) through the slit. After reflection, the light enters the transmission part and the detector (3).

3. The multi-source target detection device according to claim 2, characterized in that, Inside the mounting housing (1) are also a processor module (7) and a control motherboard (8); the control motherboard (8) is installed in the space between the reflective part and the transmissive part of the imaging spectrometer (2); The processor module (7) is installed on the side of the transmission section of the imaging spectrometer (2), and the drive motor (9) is located in the space below the transmission section of the imaging spectrometer (2) and the detector (3).

4. The multi-source target detection device according to claim 3, characterized in that, A thermal imaging camera (5) is provided on the side of the reflector of the imaging spectrometer (2), and the thermal imaging lens is embedded in the surface of the housing to acquire thermal images according to the control; an RGB camera (6) is provided between the processor module (7) and the thermal imaging camera (5).

5. The multi-source target detection device according to claim 2, characterized in that, The push-broom module also includes a push rod (17) and a driver (18). One end of the push rod (17) is connected to the output shaft of the drive motor (9), and the other end is connected to the push-broom platform (16). The driver (18) is located on the side of the drive motor (9) and controls the drive motor (9) to perform the push-broom operation.

6. The multi-source target detection device according to any one of claims 1-5, characterized in that, A pair of limiting plates are also provided on the push-broom platform (16) along the moving direction of the slide rail (10). A pair of photoelectric limiting sensors matching the limiting plates are installed on the imaging spectrometer (2) located above the push-broom platform (16). The push-broom module controls the push-broom distance by detecting the two limiting plates.

7. The multi-source target detection device according to any one of claims 1-5, characterized in that, The imaging lens (4) and the mounting housing (1) are fitted with an adjustment hole (19) with an opening size larger than the diameter of the lens barrel. The imaging lens (4) extends into the adjustment hole (19) and fits into the mounting hole on the push-broom platform (16). A flexible dustproof sheet (11) is provided inside the adjustment hole (19) to enclose the imaging lens (4) and to connect with the push-broom platform (16) and the adjustment hole (19).

Images