Photoelectric detection system and detection method based on hyperspectral imaging and polarization imaging

Abstract

The invention belongs to the technical field of hyperspectral detection and polarization detection, and particularly relates to a photoelectric detection system and method based on hyperspectral imaging and polarization imaging. According to the photoelectric detection system, an on-chip integrated hyperspectral imaging module, an on-chip integrated polarization imaging module, a laser ranging module, a driving and control module, a target information processing and recognition module, a power supply module and a U-shaped frame structure platform are designed to jointly form an area array imaging detection system, and the resolution ratio of an output spectrum and a polarization image is 512 * 512. The hyperspectral polarization imaging system has the advantages of being simple in structure, small in size, light in weight and convenient to use, is suitable for airborne and vehicle-mounted detection of ground targets and underwater targets and detection of other sceneries, and has important military application prospects in reconnaissance, detection, recognition and positioning of stealth and camouflage targets.

Description

Technical Field

[0001] This invention belongs to the field of hyperspectral detection and polarization detection technology, specifically relating to a photoelectric detection system and detection method based on hyperspectral imaging and polarization imaging. Background Technology

[0002] In target detection, CCDs are commonly used to detect and identify conventional targets, where the imaging information reflects the target's intensity. However, with advancements in military camouflage technology, most military camouflage patterns can achieve similar light intensity to the background target across a wide wavelength range. This means that with traditional wide-band detectors, the target blends seamlessly into the background, making it difficult to detect. Currently, spectral and polarization imaging methods are used for detecting concealed and camouflaged targets, but spectral imaging takes a long time, making real-time detection and identification impossible. Furthermore, single detection methods cannot detect underwater targets. Therefore, a system is needed that can achieve real-time detection of concealed, camouflaged, and underwater targets, as well as target identification, tracking, and localization, to effectively detect camouflaged, stealthy, and underwater concealed targets. Summary of the Invention

[0003] (a) Technical problems to be solved

[0004] The technical problem to be solved by this invention is: how to provide a photoelectric detection system and detection method based on hyperspectral and polarization imaging to realize the spectral detection of stealth and camouflage targets, as well as the polarization detection of underwater targets, and at the same time, to identify, track and locate the targets.

[0005] (II) Technical Solution

[0006] To address the aforementioned technical problems, this invention provides a photoelectric detection system based on hyperspectral imaging and polarization imaging. The photoelectric detection system comprises an on-chip integrated hyperspectral imaging module, an on-chip integrated polarization imaging module, a laser ranging module, a driving and control module, a target information processing and recognition module, a power supply module, and a U-shaped frame structure platform, which together form an array imaging detection system, outputting spectral and polarization image resolutions of 512×512.

[0007] The photoelectric detection system can image without a push-broom mechanism, and can realize hyperspectral and polarization imaging, identification, tracking and positioning of distant camouflaged targets. The detection range is 360° horizontally and -10° to +60° vertically.

[0008] The photoelectric detection system uses spectral restoration and polarization detection algorithms to achieve spectral detection of stealth and camouflage targets, as well as polarization detection of underwater targets. It can also identify, track, and locate targets.

[0009] The on-chip integrated hyperspectral imaging module includes: a hyperspectral imaging CCD and a zoom lens;

[0010] The hyperspectral imaging CCD consists of a visible light CCD and a spectral coding mask. The spectral coding mask is a set of pixel-level broadband filters, with each pixel corresponding to a filter of different bandwidths. (See attached diagram.) Figure 3 By modulating and combining different filters, the target's spectral encoding imaging is achieved with a spectral resolution of 10nm and an output hyperspectral image resolution of 512×512. By adjusting the focal length of the zoom lens, the spectral imaging module can clearly image stealth and camouflage targets at different distances.

[0011] The on-chip integrated polarization imaging module includes: a polarization imaging CCD and a zoom lens;

[0012] The polarization imaging CCD has linear polarizers coated on each pixel at 0°, 90°, 180°, and 270°, enabling the output of four polarization states of the target. The output polarization image resolution is 512×512. (See attached image for details.) Figure 4 By adjusting the focal length of the zoom lens, the polarization imaging module can clearly image ground and underwater targets at different distances.

[0013] The target information processing and recognition module consists of the NVIDIA Orin NX core processor and its expansion board. It can support the operation of programs called by hyperspectral cameras and polarization cameras, and supports decoding and restoration algorithms based on hyperspectral encoded images, spectral target recognition network models, polarization degree extraction algorithms, polarization target recognition network models, and the operation of central control and data transmission programs.

[0014] The photoelectric detection system has one Ethernet port and one serial port as its external interfaces. It receives operating condition switching commands and motion control commands such as identification, tracking, and ranging from the central control terminal via Ethernet. It also sends uploading data, including photoelectric system operating conditions, target positioning information, and platform positioning information, to the central control terminal via Ethernet. It also sends real-time hyperspectral and polarization detection images and recognition results. The system receives latitude, longitude, altitude, and satellite positioning information from airborne or vehicle-mounted combined inertial navigation systems via the serial port.

[0015] The photoelectric detection system receives a specified horizontal / tilt angle from the central control terminal, or a horizontal / tilt tracking signal output by the tracking algorithm on the target information processing and recognition module. After algorithm calculation and data conditioning by the drive and control board, it outputs a PWM signal to drive the motor to move, and servos to the specified pitch angle according to the real-time closed-loop servo of the encoder. See the detailed process below. Figure 5 .

[0016] The U-shaped frame platform can achieve 360° horizontal rotation and -10° to +60° vertical pitch. See the detailed structure below. Figure 2 .

[0017] The photoelectric detection system is characterized by its simple structure, small size, light weight, and ease of use. It is suitable for airborne and vehicle-mounted detection of ground targets, underwater targets, and other objects. It has important military application prospects in the reconnaissance, detection, identification, and positioning of stealth and camouflaged targets.

[0018] Furthermore, the present invention also provides a detection method for a photoelectric detection system based on hyperspectral imaging and polarization imaging. The detection method is implemented based on the photoelectric detection system described in claim 7, and includes the following steps:

[0019] (1) Initialize the spectral camera or polarization camera;

[0020] (2) Select spectral detection or polarization detection;

[0021] (3) Run the spectral restoration algorithm to output the hyperspectral data cube, or run the polarization image solving algorithm to output the image polarization information;

[0022] (4) Run the recognition model to perform target recognition and capture on the spectral data cube or polarization image;

[0023] (5) Run the target tracking algorithm to identify and track the target;

[0024] (6) To measure the distance to the target and achieve precise positioning of stealth and camouflaged targets.

[0025] (III) Beneficial Effects

[0026] Compared with existing technologies, the hyperspectral polarization imaging system of this invention features a simple structure, small size, light weight, and ease of use. Compared with existing spectral and polarization technologies, this invention possesses real-time target detection, localization, search, and tracking capabilities. The detection method proposed in this invention can learn and train based on different targets, making it suitable for airborne and vehicle-mounted detection of ground targets, underwater targets, and other objects. It has significant military application prospects in the reconnaissance, detection, identification, and localization of stealth and camouflaged targets. Attached Figure Description

[0027] Figure 1 This is a diagram of the photoelectric detection system of the present invention;

[0028] Figure 2 This is a three-dimensional diagram of the photoelectric detection platform of the present invention;

[0029] Figure 3This is a diagram showing the external shape and target surface of the spectral camera of the present invention;

[0030] Figure 4 This is a diagram showing the shape and target surface of the polarization camera of the present invention;

[0031] Figure 5 This is a control flowchart of the detection system of the present invention. Detailed Implementation

[0032] To make the objectives, contents, and advantages of the present invention clearer, the specific embodiments of the present invention will be described in further detail below with reference to the accompanying drawings and examples.

[0033] To address the aforementioned technical problems, this invention provides a photoelectric detection system based on hyperspectral imaging and polarization imaging. The photoelectric detection system comprises an on-chip integrated hyperspectral imaging module, an on-chip integrated polarization imaging module, a laser ranging module, a driving and control module, a target information processing and recognition module, a power supply module, and a U-shaped frame structure platform, which together form an array imaging detection system, outputting spectral and polarization image resolutions of 512×512.

[0034] The photoelectric detection system can image without a push-broom mechanism, and can realize hyperspectral and polarization imaging, identification, tracking and positioning of distant camouflaged targets. The detection range is 360° horizontally and -10° to +60° vertically.

[0035] The photoelectric detection system uses spectral restoration and polarization detection algorithms to achieve spectral detection of stealth and camouflage targets, as well as polarization detection of underwater targets. It can also identify, track, and locate targets.

[0036] The on-chip integrated hyperspectral imaging module includes: a hyperspectral imaging CCD and a zoom lens;

[0037] The hyperspectral imaging CCD consists of a visible light CCD and a spectral coding mask. The spectral coding mask is a set of pixel-level broadband filters, with each pixel corresponding to a filter of different bandwidths. (See attached diagram.) Figure 3 By modulating and combining different filters, the target's spectral encoding imaging is achieved with a spectral resolution of 10nm and an output hyperspectral image resolution of 512×512. By adjusting the focal length of the zoom lens, the spectral imaging module can clearly image stealth and camouflage targets at different distances.

[0038] The on-chip integrated polarization imaging module includes: a polarization imaging CCD and a zoom lens;

[0039] The polarization imaging CCD has linear polarizers coated on each pixel at 0°, 90°, 180°, and 270°, enabling the output of four polarization states of the target. The output polarization image resolution is 512×512. (See attached image for details.) Figure 4 By adjusting the focal length of the zoom lens, the polarization imaging module can clearly image ground and underwater targets at different distances.

[0040] The target information processing and recognition module consists of the NVIDIA Orin NX core processor and its expansion board. It can support the operation of programs called by hyperspectral cameras and polarization cameras, and supports decoding and restoration algorithms based on hyperspectral encoded images, spectral target recognition network models, polarization degree extraction algorithms, polarization target recognition network models, and the operation of central control and data transmission programs.

[0041] The photoelectric detection system has one Ethernet port and one serial port as its external interfaces. It receives operating condition switching commands and motion control commands such as identification, tracking, and ranging from the central control terminal via Ethernet. It also sends uploading data, including photoelectric system operating conditions, target positioning information, and platform positioning information, to the central control terminal via Ethernet. It also sends real-time hyperspectral and polarization detection images and recognition results. The system receives latitude, longitude, altitude, and satellite positioning information from airborne or vehicle-mounted combined inertial navigation systems via the serial port.

[0042] The photoelectric detection system receives a specified horizontal / tilt angle from the central control terminal, or a horizontal / tilt tracking signal output by the tracking algorithm on the target information processing and recognition module. After algorithm calculation and data conditioning by the drive and control board, it outputs a PWM signal to drive the motor to move, and servos to the specified pitch angle according to the real-time closed-loop servo of the encoder. See the detailed process below. Figure 5 .

[0043] The U-shaped frame platform can achieve 360° horizontal rotation and -10° to +60° vertical pitch. See the detailed structure below. Figure 2 .

[0044] The photoelectric detection system is characterized by its simple structure, small size, light weight, and ease of use. It is suitable for airborne and vehicle-mounted detection of ground targets, underwater targets, and other objects. It has important military application prospects in the reconnaissance, detection, identification, and positioning of stealth and camouflaged targets.

[0045] Furthermore, the present invention also provides a detection method for a photoelectric detection system based on hyperspectral imaging and polarization imaging. The detection method is implemented based on the photoelectric detection system described in claim 7, and includes the following steps:

[0046] (1) Initialize the spectral camera or polarization camera;

[0047] (2) Select spectral detection or polarization detection;

[0048] (3) Run the spectral restoration algorithm to output the hyperspectral data cube, or run the polarization image solving algorithm to output the image polarization information;

[0049] (4) Run the recognition model to perform target recognition and capture on the spectral data cube or polarization image;

[0050] (5) Run the target tracking algorithm to identify and track the target;

[0051] (6) To measure the distance to the target and achieve precise positioning of stealth and camouflaged targets.

[0052] Example 1

[0053] This embodiment provides a photoelectric detection system and method based on hyperspectral and polarization imaging. Through spectral restoration algorithm and polarization detection algorithm, it realizes spectral detection of stealth and camouflage targets, as well as polarization detection of underwater targets.

[0054] Install the photoelectric detection system on the drone, and perform the following detection steps after powering it on:

[0055] (1) Initialize the spectral camera or polarization camera;

[0056] (2) Select spectral detection or polarization detection;

[0057] (3) After the camera acquires the original image, it runs the spectral restoration algorithm to output the hyperspectral data cube, or runs the polarization image fusion and enhancement solution algorithm to output the image polarization information.

[0058] (4) Run the recognition model to perform target recognition and capture on the spectral data cube or polarization image;

[0059] (5) According to the instructions, the target tracking algorithm is run to identify and track the target. At this time, the drive control system performs platform stability control and target tracking control on the system.

[0060] (6) Based on the ranging command, the target is measured and the target's position information is calculated to achieve accurate positioning of stealth and camouflage targets.

[0061] The above description is only a preferred embodiment of the present invention. It should be noted that for those skilled in the art, several improvements and modifications can be made without departing from the technical principles of the present invention, and these improvements and modifications should also be considered within the scope of protection of the present invention.

Claims

1. A photoelectric detection system based on hyperspectral imaging and polarization imaging, characterized in that, The photoelectric detection system is composed of an on-chip integrated hyperspectral imaging module, an on-chip integrated polarization imaging module, a laser ranging module, a drive and control module, a target information processing and recognition module, a power supply module, and a U-shaped frame structure platform, forming a planar array imaging detection system with an output spectral and polarization image resolution of 512×512.

2. The photoelectric detection system based on hyperspectral imaging and polarization imaging as described in claim 1, characterized in that, The photoelectric detection system can image without a pushbroom mechanism, and can realize hyperspectral and polarization imaging, identification, tracking and positioning of camouflaged targets at a distance. The detection range is 360° horizontally and -10° to +60° vertically.

3. The photoelectric detection system based on hyperspectral imaging and polarization imaging as described in claim 2, characterized in that, The photoelectric detection system uses spectral restoration and polarization detection algorithms to achieve spectral detection of stealth and camouflage targets, as well as polarization detection of underwater targets. It can also identify, track, and locate targets.

4. The photoelectric detection system based on hyperspectral imaging and polarization imaging as described in claim 3, characterized in that, The on-chip integrated hyperspectral imaging module includes: a hyperspectral imaging CCD and a zoom lens; The hyperspectral imaging CCD consists of a visible light CCD and a spectral coding mask. The spectral coding mask is a set of pixel-level broadband filters, with each pixel corresponding to a filter of different bandwidths. By modulating and combining different filters, spectral coding imaging of the target is achieved, with a spectral resolution of 10nm and an output hyperspectral image resolution of 512×512. By adjusting the focal length of the zoom lens, the spectral imaging module can clearly image camouflaged targets at different distances.

5. The photoelectric detection system based on hyperspectral imaging and polarization imaging as described in claim 4, characterized in that, The on-chip integrated polarization imaging module includes: a polarization imaging CCD and a zoom lens; The polarization imaging CCD has 0°, 90°, 180° and 270° linear polarizers coated on each pixel, which can output images of the target in four polarization states with a resolution of 512×512. By adjusting the focal length of the zoom lens, the polarization imaging module can clearly image ground and underwater targets at different distances.

6. The photoelectric detection system based on hyperspectral imaging and polarization imaging as described in claim 5, characterized in that, The target information processing and recognition module consists of the NVIDIA OrinNX core processor and its expansion board. It can support the operation of programs called by hyperspectral cameras and polarization cameras, and supports decoding and restoration algorithms based on hyperspectral encoded images, spectral target recognition network models, polarization degree extraction algorithms, polarization target recognition network models, and the operation of central control and data transmission programs.

7. The photoelectric detection system based on hyperspectral imaging and polarization imaging as described in claim 6, characterized in that, The photoelectric detection system has one Ethernet port and one serial port as its external interfaces. It receives operating condition switching commands and motion control commands such as identification, tracking, and ranging from the central control terminal via Ethernet. It also sends uploading data, including photoelectric system operating conditions, target positioning information, and platform positioning information, to the central control terminal via Ethernet. It also sends real-time hyperspectral and polarization detection images and recognition results. The system receives latitude, longitude, altitude, and satellite positioning information from airborne or vehicle-mounted combined inertial navigation systems via the serial port. The photoelectric detection system receives a specified horizontal / pitch angle sent by the central control terminal, or a horizontal / pitch tracking signal output by the tracking algorithm on the target information processing and recognition module. After the drive and control board performs algorithm calculations and data conditioning, it outputs a PWM signal to drive the motor to move, and then servos to the specified pitch angle according to the real-time closed-loop servo of the encoder.

8. The photoelectric detection system based on hyperspectral imaging and polarization imaging as described in claim 7, characterized in that, The U-shaped frame platform can achieve 360° horizontal rotation and -10° to +60° vertical pitch.

9. The photoelectric detection system based on hyperspectral imaging and polarization imaging as described in claim 8, characterized in that, The photoelectric detection system is characterized by its simple structure, small size, light weight, and ease of use. It is suitable for airborne and vehicle-mounted detection of ground targets, underwater targets, and other objects. It has important military application prospects in the reconnaissance, detection, identification, and positioning of stealth and camouflaged targets.

10. A detection method for a photoelectric detection system based on hyperspectral imaging and polarization imaging, characterized in that, The detection method is implemented based on the photoelectric detection system of claim 7, and the detection method includes the following steps: (1) Initialize the spectral camera or polarization camera; (2) Select spectral detection or polarization detection; (3) Run the spectral restoration algorithm to output the hyperspectral data cube, or run the polarization image solving algorithm to output the image polarization information; (4) Run the recognition model to perform target recognition and capture on the spectral data cube or polarization image; (5) Run the target tracking algorithm to identify and track the target; (6) To measure the distance to the target and achieve precise positioning of stealth and camouflaged targets.

Images