Polarization hyperspectral imaging system, imaging method and application

By designing a polarization hyperspectral imaging system and combining it with focusing and push-scan components, multi-dimensional information collection and recognition of distant targets are achieved, solving the problem of blind spots in existing technologies and providing a more accurate target recognition method.

CN120629023APending Publication Date: 2025-09-12SICHUAN DUALIX SPECTRAL IMAGING TECHNOLOGY CO LTD
View PDF 10 Cites 0 Cited by

Patent Information

Application Number
CN202510953437.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-07-11
Publication Date
2025-09-12

AI Technical Summary

Technical Problem

Existing imaging spectroscopy technology and imaging polarization technology have blind spots in long-distance target recognition. They cannot distinguish long-distance targets of the same material, and cannot recognize targets of the same shape, making target recognition difficult.

Method used

A polarization hyperspectral imaging system is designed, including a housing, an imaging lens, an imaging spectrometer, an array polarization camera, a focus-shift assembly, a push-sweep-shift assembly, and a processor. Focus adjustment and multi-dimensional target information acquisition are achieved through the coordination of the focus and push-sweep assemblies. Polarization information processing is performed by combining a CMOS image sensor and a micro-polarization filter array.

Benefits of technology

It realizes the multi-dimensional information acquisition of distant targets, improves the amount of information and recognition accuracy, can characterize targets in multiple dimensions, and provides a more scientific, comprehensive and accurate method for target detection, recognition and confirmation, which is suitable for applications in multiple fields.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120629023A_ABST
    Figure CN120629023A_ABST
Patent Text Reader

Abstract

The invention relates to the field of remote sensing detection imaging systems, in particular to a polarization hyperspectral imaging system, an imaging method and application, and the system comprises a housing, an imaging lens, an imaging spectrometer, an area array polarization camera, a focusing translation assembly, a push-broom translation assembly and a processor. A mounting hole is formed in one side wall of the shell; the imaging lens is fixed on the casing through the mounting hole and extends out of the casing; an imaging spectrometer and an area array polarization camera are sequentially arranged in the machine shell from the imaging lens to the back, and the imaging spectrometer is connected with the area array polarization camera. The focusing translation assembly is arranged in the shell, the push-broom translation assembly is arranged on the focusing translation assembly, and the imaging spectrometer is arranged on the push-broom translation assembly; the processor is arranged in the machine shell and connected with the area array polarization camera, the focusing translation assembly and the push-broom translation assembly, and the processor is connected with an electronic output interface.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of remote sensing detection imaging systems, and in particular to a polarization hyperspectral imaging system, an imaging method and applications. Background Art

[0002] Remote sensing, a detection technology that emerged in the 1960s, is a comprehensive technique based on the theory of electromagnetic waves. It uses various sensing instruments to collect, process, and ultimately image the electromagnetic waves radiated and reflected by distant targets, thereby detecting and identifying various objects on the ground. All objects have spectral characteristics. Specifically, they have different absorption, reflection, and radiation spectrum properties. Different objects reflect differently in the same spectral region, and the same object can also react differently to different spectra. Even the same object can reflect and absorb different spectra at different times and locations due to different angles of sunlight. Remote sensing technology uses these principles to make judgments about objects.

[0003] After evolving through the stages of panchromatic (black and white), color (RGB), and multispectral scanning imaging, the emergence of imaging spectroscopy in the early 1980s propelled optical remote sensing into a new phase: hyperspectral remote sensing. Hyperspectral refers to remote sensing science and technology with high spectral resolution. Imaging spectroscopy utilizes imaging spectrometers capable of acquiring very narrow, spectrally continuous image data in the ultraviolet, visible, near-infrared, and short-wave infrared regions of the electromagnetic spectrum. Imaging spectrometers provide spectral information from tens to hundreds of narrow bands for each pixel, forming a complete and continuous spectral curve. Imaging spectrometers record the complete spectrum of various objects within their field of view. Analyzing, processing, and studying this data is a multidisciplinary endeavor. As an emerging interdisciplinary field, it builds upon sensor and computer technologies and encompasses a wide range of disciplines, including electromagnetic wave theory, spectroscopy and colorimetry, physical / geometrical optics, electronic engineering, informatics, geography, agronomy, atmospheric science, and oceanography.

[0004] Light is an electromagnetic wave within a specific wavelength range, formed by alternating electric and magnetic fields that vibrate perpendicular to the direction of propagation. The human eye can only see a narrow band of electromagnetic waves, between 380nm and 780nm, known as visible light. Electromagnetic waves whose vibration direction is perpendicular to the direction of propagation are called transverse waves, which introduce polarization. With the development of optics, the direction of the magnetic vector is often referred to as the polarization direction, and the plane determined by the magnetic vector's propagation direction is called the polarization plane. Light has three fundamental properties: wavelength, intensity, and polarization. In machine vision, through spatial correction, line scan polarization cameras can enhance the contrast of difficult-to-distinguish objects and detect birefringence, stress, surface roughness, and other physical properties that are not detectable with conventional imaging. Therefore, the simultaneous acquisition of spatial, spectral, and polarization information yields more characteristic information that facilitates target differentiation.

[0005] However, existing detection and identification methods (imaging spectroscopy or imaging polarimetry) have blind spots. Imaging spectrometers cannot identify distant targets made of the same material (with the same characteristic spectrum), such as aircraft, missiles, and satellites tens or even thousands of kilometers away. To obtain shape information for small-scale targets at long distances, the optical system's focal length must be very long, making the instrument unacceptably large and heavy. Since the image of a distant target is often a single point, lacking physical shape information, imaging technology (shape recognition) is completely ineffective, rendering the target unrecognizable. Furthermore, targets of different shapes made of the same material can exhibit similar spectral characteristics, rendering spectroscopy indistinguishable, rendering imaging spectrometers completely ineffective and meaningless. Imaging polarimeter instruments cannot identify identically shaped real or fake targets, gaseous or liquid targets (which inherently have no shape), or identically shaped targets made of different materials, as they lack information about the spectral characteristics of the target's material.

[0006] Therefore, it is urgent to develop a new type of polarization hyperspectral imaging system to solve the problems existing in the above-mentioned existing imaging systems. Summary of the Invention

[0007] In response to the above problems, the present invention provides a novel polarization hyperspectral imaging system, imaging method and application solution combined with drones.

[0008] To achieve the above technical objectives, the present invention provides a polarization hyperspectral imaging system, comprising a housing, an imaging lens, an imaging spectrometer, an area array polarization camera, a focus and translation assembly, a push-sweep and translation assembly, and a processor; a mounting hole is provided on one side wall of the housing; the imaging lens is fixed to the housing through the mounting hole and the lens extends out of the housing; an imaging spectrometer and an area array polarization camera are sequentially arranged in the housing from the imaging lens backward, and the imaging spectrometer is connected to the area array polarization camera; the focus and translation assembly is arranged in the housing, the push-sweep and translation assembly is arranged on the focus and translation assembly, and the imaging spectrometer is arranged on the push-sweep and translation assembly; the processor is arranged in the housing and connected to the area array polarization camera, the focus and translation assembly, and the push-sweep and translation assembly, and the processor is connected to an electronic output interface.

[0009] Preferably, the focusing translation assembly includes a first mounting seat, a first motor, a first screw and a second mounting seat, the first mounting seat is fixed to the bottom surface of the inner part of the casing, the first motor is controlled by a processor and is mounted on the side of the second mounting seat, the output shaft of the first motor is connected to the first screw, the first screw is horizontally arranged and the screw nut is connected to the side of the first mounting seat through a first connecting block, and the first mounting seat and the second mounting seat are slidably connected through a first cross roller guide.

[0010] Preferably, the push-sweep translation assembly includes a second motor, a second lead screw and a third mounting seat, the second motor is controlled by a processor and mounted on the side of the second mounting seat, the output shaft of the second motor is connected to the second lead screw, the second lead screw is horizontally arranged and perpendicular to the first lead screw, the lead screw nut of the second lead screw is connected to the side of the third mounting seat through a second connecting block, the second mounting seat and the third mounting seat are slidably connected by a second cross roller guide rail, and the imaging spectrometer is mounted on the top surface of the third mounting seat.

[0011] Preferably, the imaging spectrometer comprises an incident slit, a first collimating lens group, a grating, a prism, and a second collimating lens group, which are sequentially arranged from the imaging lens toward the polarization direction of the surface array.

[0012] Preferably, the area array polarization camera includes a CMOS image sensor and a micro polarization filter array.

[0013] Preferably, the CMOS image sensor is a black and white polarized CMOS image sensor.

[0014] Preferably, an auxiliary camera is further included, which is installed on one side of the imaging lens and is used to monitor the field of view of the imaging lens. The auxiliary camera is electrically connected to the processor.

[0015] To achieve the above technical objectives, the present invention also provides a polarization hyperspectral imaging method, which specifically includes the following steps: The processor controls the movement of the focusing and translational components, and the imaging spectrometer moves under the drive of the focusing and translational components to achieve focal length adjustment between the imaging lens and the imaging spectrometer; The imaging lens forms an image of the target to be measured; The processor controls the movement of the push-sweep and translation assembly, and the imaging spectrometer moves according to the prescribed stroke driven by the push-sweep and translation assembly to perform push-sweep acquisition on the image output by the imaging lens; The surface array polarization camera receives the output optical signal of the imaging spectrometer and performs polarization resampling processing on the optical signal; The processor receives and stores output information of the area array polarization camera, and outputs the output information of the area array polarization camera to the outside of the imaging system through an electronic interface; The output information is analyzed and processed by a computer to obtain the required image results.

[0016] As an improvement, when the imaging system further includes an auxiliary camera, the imaging method is: The auxiliary camera monitors the field of view of the imaging lens in real time and feeds the field of view information back to the processor; The processor controls the movement of the focusing and translational components, and the imaging spectrometer moves under the drive of the focusing and translational components to achieve focal length adjustment between the imaging lens and the imaging spectrometer; The imaging lens forms an image of the target to be measured; The processor controls the movement of the push-sweep and translation assembly, and the imaging spectrometer moves according to the prescribed stroke driven by the push-sweep and translation assembly to perform push-sweep acquisition on the image output by the imaging lens; The surface array polarization camera receives the output optical signal of the imaging spectrometer and performs polarization resampling processing on the optical signal; The processor receives and stores output information of the area array polarization camera and the auxiliary camera, and outputs the output information to the outside of the imaging system through an electronic interface; The output information is analyzed and processed by a computer to obtain the required image results.

[0017] To achieve the above objectives, the present invention also provides a polarization hyperspectral imaging system mounted on a drone, comprising the aforementioned polarization hyperspectral imaging system, and fixing the polarization hyperspectral imaging system on a drone.

[0018] The present invention has the following beneficial effects: 1. The polarization hyperspectral imaging system described in the present invention can obtain a hyperdata cube of multidimensional information of the target, including the two-dimensional spatial image of the target, the spectral information of each resolvable spatial element in the image, and the polarization information of each resolvable spatial element and resolvable spectral element. It greatly improves the amount of information obtained by optical detection, characterizes and reflects the essence of the target from multiple aspects and dimensions, and provides more scientific, comprehensive and accurate new theories, methods, technologies and instruments for target detection, identification and confirmation.

[0019] 2. The polarization hyperspectral imaging system and method based on a transmission imaging spectrometer described in the present invention, while realizing traditional hyperspectral data acquisition, also rearranges and calculates the data through processing and analysis, and re-extracts and fuses information of pixels with different polarization state effects, thereby realizing independent hyperspectral image output and analysis under different states, and establishing an independent target recognition method and analysis method with image and spectrum integration that has attributes under various forms.

[0020] 3. The polarization hyperspectral imaging system and method based on a transmission imaging spectrometer described in the present invention have broad development and application prospects in many fields such as earth observation, space exploration, military reconnaissance, earth resource surveys, environmental protection, atmospheric detection, ocean remote sensing, crop and vegetation surveys, high-sensitivity detection of targets with extremely small individual sizes and clustered distribution characteristics, as well as biology, medicine, and life sciences. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 It is a structural schematic diagram of the present invention; Figure 2 It is a partial structural schematic diagram of the present invention; Figure 3 It is a partial structural schematic diagram of the present invention; Figure 4 It is a partial structural diagram of the present invention Figure 5 It is a partial structural schematic diagram of the present invention; Figure 6 It is a partial structural schematic diagram of the present invention; Figure 7 1 is a schematic structural diagram of the spectrometer of the present invention; Figure 8 is a polarization coding diagram of the polarization camera of the present invention; Figure 9 It is a schematic diagram of the imaging data conversion process of the present invention; Figure 10 It is a diagram showing an application example of the present invention; Figure 11 It is a diagram showing an application example of the present invention; Figure 12It is a diagram showing an application example of the present invention; FIG13 is a diagram showing an example of application of the present invention; Reference numerals: 1. Casing, 101. Front panel, 102. Rear panel, 103. Bottom panel, 104. Enclosure, 105. Handle; 2. Imaging lens; 3. Imaging spectrometer, 301. Entrance slit, 302. First collimating lens group, 303. Grating, 304. Prism, 305. Second collimating lens group; 4. Surface array polarization camera; 5. Focusing and translation assembly, 501. First mounting seat, 502. First motor, 503. First lead screw, 504. Second mounting seat, 505. First connecting block, 506. First cross roller guide; 6. Push-sweep translation assembly, 601. Second motor, 602. Second lead screw, 603. Second connecting block, 604. Third mounting seat, 605. Second cross roller guide; 7. Processor; 8. Auxiliary camera. DETAILED DESCRIPTION

[0022] Combine Figure 1 to Figure 1 3. The embodiments of the present invention are described in detail, but no limitation is imposed on the claims of the present invention.

[0023] Example 1 like Figure 1-4 As shown, a polarization hyperspectral imaging system includes a housing 1, an imaging lens 2, an imaging spectrometer 3, a surface array polarization camera 4, a focus translation component 5, a push-sweep translation component 6, and a processor 7; in: A mounting hole is provided on one side wall of the housing 1, and the imaging lens is fixed to the housing 1 through the mounting hole and extends out of the housing; An imaging spectrometer 3 and a surface array polarization camera 4 are sequentially arranged in the housing 1 from the imaging lens 2 to the rear, and the imaging spectrometer 3 is connected to the surface array polarization camera 4; like Figure 5-6As shown, the focus translation assembly 5 is arranged in the housing 1, and the focus translation assembly 5 includes a first mounting seat 501, a first motor 502, a first lead screw 503, a second mounting seat 504, a first connecting block 505 and a first cross roller guide 506. The first mounting seat 501 is fixed to the bottom surface of the inner part of the housing, the first motor 502 is controlled by the processor 7 and is mounted on the side of the second mounting seat 504, the output shaft of the first motor 502 is connected to the first lead screw 503, the first lead screw 503 is arranged horizontally and the lead screw nut is connected to the side of the first mounting seat 501 through the first connecting block 505, and the first mounting seat 501 and the second mounting seat 504 are slidably connected by the first cross roller guide 506; like Figure 7-8 As shown, the push-sweep translation assembly 6 includes a second motor 601, a second lead screw 602, a second connecting block 603, a third mounting seat 604 and a second cross roller guide 605. The second motor 601 is controlled by the processor 7 and is mounted on the side of the second mounting seat 504. The output shaft of the second motor 601 is connected to the second lead screw 602. The second lead screw 602 is horizontally arranged and perpendicular to the first lead screw 503. The lead screw nut of the second lead screw 602 is connected to the side of the third mounting seat 604 through the second connecting block 603. The second mounting seat 504 and the third mounting seat 604 are slidably connected by the second cross roller guide 605. The imaging spectrometer 3 is mounted on the top surface of the third mounting seat 604. The push-sweep translation assembly is arranged on the focusing translation assembly, and the imaging spectrometer is arranged on the push-sweep translation assembly; The processor 7 is disposed in the housing 1 and is connected to the area array polarization camera 4 , the focus translation assembly 5 , and the push-scan translation assembly 6 . The processor 7 is connected to an electronic output interface. Example 2 like Figure 1 As shown, considering that the field of view of the imaging lens cannot be accurately judged, and thus the imaging lens cannot be accurately controlled to capture images of the target to be measured, an improvement is made on the basis of Example 1, and an auxiliary camera 8 is installed on one side of the imaging lens to monitor the field of view of the imaging lens, and the auxiliary camera is electrically connected to the processor.

[0024] For the above two embodiments, the following preferred designs or improvements can be made: 1. The housing can be composed of a front panel 101, a rear panel 102, a bottom panel 103 and a panel 104. A handle 105 can be added to the outside of the housing for easy placement and carrying.

[0025] 2. The imaging lens is preferably a standard C-mount lens with a back focal length of 17.52mm. This selection can meet the imaging relationship between the standard fixed-focus C-mount lens and the imaging spectrometer entrance slit, that is, to ensure that the target image will be clearly presented on the slit after entering this standard imaging lens.

[0026] 3. The total effective stroke length of the push-sweep translation assembly driving the imaging spectrometer to move can be selected to be 1.8 cm, which can ensure that the push-sweep range of the imaging lens is 1 cm, meeting the requirements of push-sweep imaging of the imaging spectrometer incident slit relative to the target surface behind the imaging lens.

[0027] 4. After the image of the target is imaged by the imaging lens, the image will be focused on the slit. The size of the slit is preferably: 14.2mm in length and 30um in width.

[0028] 5. If Figure 7 As shown, the imaging spectrometer 3 can adopt a structure comprising an incident slit 301, a first collimating lens group 302, a grating 303, a prism 304, and a second collimating lens group 305. After the image of the incident slit passes through the first collimating lens group, the originally dispersed composite light is collimated into parallel composite light. The parallel composite light then enters the grating, which disperses the parallel light to form light with different independent spectra, that is, monochromatic light. The monochromatic light is then focused by the prism and collimated by the second collimating lens group to form monochromatic and parallel light.

[0029] 6. The area array polarization camera includes a CMOS image sensor and a micro-polarization filter array, wherein the CMOS image sensor is, for example, a black and white polarized CMOS image sensor, such as Sony's IMX250MZR-C.

[0030] 7. The electronic output interface should include at least USB 3.0 and HDMI. These two interfaces are the most widely used interfaces at present. They can efficiently and comprehensively transmit the output information of the polarization camera to external devices (such as computers), ensuring the reliability of the imaging system's data output performance.

[0031] 8. The auxiliary camera should preferably be a 5-megapixel RGB camera with an 80° field of view and USB 3.0 communication. This specification effectively controls the cost of the imaging system while also enabling the capture of video stream signals.

[0032] 9. A battery can be installed inside the casing to power the system, or other power supply methods can be used.

[0033] The following takes Example 2 as an example to illustrate the overall working principle of the present invention: 1. The auxiliary camera monitors the field of view of the imaging lens and feeds the field of view information back to the processor.

[0034] 2. The processor controls the movement of the focusing and translation components in combination with the field of view information. The imaging spectrometer moves under the drive of the focusing and translation components to achieve focal length adjustment between the imaging lens and the imaging lens.

[0035] 3. The imaging lens forms an image of the target to be measured.

[0036] 4. The processor controls the movement of the push-sweep translation assembly based on the field of view information. Driven by the push-sweep translation assembly, the imaging spectrometer moves according to the specified stroke and performs push-sweep acquisition on the image output by the imaging lens. Specifically, an imaging spectrometer and an area array polarization camera are combined and fixed to a two-dimensional translation mechanism (i.e., a translation mechanism consisting of a focusing translation assembly and a push-sweep translation assembly). The imaging lens is fixed to the housing and remains stationary. In other words, the imaging spectrometer and area array detector are combined, while the imaging lens is separate. During the imaging process, the two-dimensional translation mechanism drives the imaging spectrometer and area array polarization camera to move in one dimension (the scanning dimension). Push-sweep imaging mode only captures a single line on the target object at a time, and image stitching is achieved through the relative motion of the target object or the imaging mechanism. Therefore, the slit of the imaging spectrometer remains parallel to the mirror surface of the focusing lens, and the imaging lens moves relative to the spectral imager and area array detector, which are driven by the translation mechanism. This process is known as push-sweep hyperspectral imaging.

[0037] 5. The area array polarization camera receives the output light signal of the imaging spectrometer and performs polarization resampling on the light signal; 6. The processor receives and stores output information from the area array polarization camera and the auxiliary camera, and outputs the output information to the outside of the imaging system through an electronic interface; 7. Analyze and process the output information through a computer to obtain the required image results.

[0038] in: As a monitoring unit, the auxiliary camera's purpose is to locate the area captured by the imaging system for easy observation and adjustment. It also provides a set of RGB images of the synchronized area to facilitate later data image processing. The auxiliary camera's field of view is designed to be significantly larger than that of the imaging lens in the imaging system. Software-modified parameters ensure that the captured area and the monitored area are consistent. It also provides an image reference for later data image stitching, calibration, and correction, and can serve as an auxiliary tool or diagram to provide a basis for data acquisition quality.

[0039] The electronic interface serves as the imaging system's external output, connecting internal units (auxiliary cameras, polarization cameras, drive motors, etc.) with external terminals. Data collected by the system is not transmitted to the ground terminal in real time. Instead, it is stored in the processor's internal memory unit for later processing. For data requiring simpler processing and analysis, the processor's functionality can be expanded to process and analyze data directly and output externally. The imaging system's transmission capabilities can also be expanded by adding a wireless transmission module to wirelessly transmit real-time collected information back to the ground terminal, enabling real-time observation.

[0040] The system works as follows: After passing through the imaging lens, the target image is focused on a slit, which serves as the front window through which the target image enters the imaging spectrometer. The image of the incident slit passes through the first collimating lens group, which collimates the originally dispersed composite light into parallel composite light, thus constraining the direction of light propagation. This parallel light then enters a grating, which disperses it, resolving it into monochromatic light of different wavelengths, forming light with different independent spectra. This monochromatic light is then focused by a prism and collimated by a second collimating lens group, forming monochromatic and parallel light. Finally, this monochromatic parallel light enters a surface array polarization camera, which serves as the image detector, and is distributed across different pixels. The surface array polarization camera performs photoelectric conversion output, and the processor obtains the raw polarization hyperspectral image data. The hyperspectral imaging spectrometer can produce continuous images in hundreds of wavelength bands, and a spectral curve can be extracted for each image pixel. This method organically combines traditional two-dimensional imaging and spectroscopy techniques. While the imaging system acquires spatial information about the object being measured, the spectrometer system decomposes the object's radiation into spectral radiation of varying wavelengths. This allows for the acquisition of dozens or even hundreds of continuous narrow bands of information for each pixel within a spectral range. These bands are continuous rather than discrete, allowing for the extraction of a smooth and complete spectral curve from each pixel. Each pixel simultaneously contains both spectral and radiation information about the target object.

[0041] Due to the black and white array type used in polarization cameras, each pixel of this type of detector does not have completely consistent properties. The four polarization directions of the polarization camera are arranged as follows Figure 8 The polarization camera transmits signals in the layout shown, outputting signals at 90°, 45°, 135°, and 0°, respectively. This layout allows the polarization camera, as a detector, to provide information on four additional attitudes, while continuing with traditional hyperspectral imaging technology. By formatting and recalculating the collected data, more image data can be obtained.

[0042] The original polarization hyperspectral image data obtained were processed by computer, as shown in the comparison of Table 1 and Table 2: (1) The original spatial dimension of the polarization camera was 2448 pixels. After fusion processing, the number of spatial dimensions doubled to 4896 pixels; (2) The original spectral dimension of the polarization camera was 2048 pixels, and the number of collected and stored spectral channels became 1024 points.

[0043] Table 1: Original pixel distribution

[0044] Table 2: Pixel distribution after processing

[0045] Here are some examples of actually processing image data using a computer: After obtaining a hyperspectral image with polarization information through computer processing, the collected output image covers four polarization states (one image, four consistent sub-images). After processing, four independent polarization images are output, and the pixels in each independent state still maintain an independent hyperspectral data format (spectrum + image). In the provided data, the default background data is completely consistent. In the provided data, when performing reflectance calibration, the white frame data and the background data are considered to be consistent. The imaging data conversion process is as follows Figure 9 shown.

[0046] like Figure 10-12 As shown, this is the interface display diagram during computer processing: like Figure 10 As shown in the figure, the left side is the original polarization hyperspectral image, and the right side is the polarization component image. Figure 10 In the displayed computer processing interface, in the menu "Polarization Component Diagram" selection item, "S0" represents the total intensity image of the light wave, "S1" represents the intensity image of the linearly polarized light in the horizontal direction, "S2" is the intensity image of the linearly polarized light in the 45-degree direction, "S3" is the intensity image of the circularly polarized light, "P" is the polarization degree image (that is, the ratio of the intensity of the fully polarized light in the total light intensity), "C" is the polarization angle image (that is, the angle between the vibration direction of the polarized light and the reference direction), and "P+S0" is the fusion image of the polarization degree image and the intensity image. It can be seen from this that Figure 10 The polarization component image on the right shows the total light intensity image when "S0" is selected.

[0047] By processing the polarization component image, you can achieve image processing functions such as "histogram equalization", "pseudo color enhancement", "wavelet transform", etc., and you can click "restore image" to achieve the image processing and restoration function.

[0048] like Figure 11 As shown, the left side is the original polarization hyperspectral image, and the right side is the histogram equalized image.

[0049] like Figure 12 As shown, the left side is the original polarization hyperspectral image, and the right side is the pseudo-color enhanced image.

[0050] After obtaining the original polarization hyperspectral image data, the calibration plate (gray cloth) data under each state image can be used to perform reflectance calibration processing for each state; the dark background data under all states is considered to be consistent; the original data is converted into reflectance format data through the following algorithm;

[0051] in: : reflectance; DN: dimensionless unit value of pixel point on the original polarization hyperspectral image; D: dark background; W: white frame data under each polarization state; Here is another set of examples of actually processing image data through a computer: Figure 13 shows four sets of hyperspectral images and their corresponding spectra under different polarization states. Figure 13(a) shows the original hyperspectral image under different polarization states, while Figure 13(b) shows the spectra corresponding to the same pixel under different polarization states. Figure 13 shows differences between the spectra and images of the same pixel at different angles, allowing qualitative analysis of target attributes.

[0052] In summary: 1. The polarization hyperspectral imaging system described in the present invention can obtain a hyperdata cube of multidimensional information of the target, including the two-dimensional spatial image of the target, the spectral information of each resolvable spatial element in the image, and the polarization information of each resolvable spatial element and resolvable spectral element. It greatly improves the amount of information obtained by optical detection, characterizes and reflects the essence of the target from multiple aspects and dimensions, and provides more scientific, comprehensive and accurate new theories, methods, technologies and instruments for target detection, identification and confirmation.

[0053] 2. The polarization hyperspectral imaging system and method based on a transmission imaging spectrometer described in the present invention, while realizing traditional hyperspectral data acquisition, also rearranges and calculates the data through processing and analysis, and re-extracts and fuses information of pixels with different polarization state effects, thereby realizing independent hyperspectral image output and analysis under different states, and establishing an independent target recognition method and analysis method with image and spectrum integration that has attributes under various forms.

[0054] 3. The present invention innovatively combines its own independent polarization camera with a hyperspectral imaging system, achieving the intersection and integration of high technologies, forming a technology that is different from the existing single imaging technology. It is possible to achieve the function of simultaneously acquiring multiple types of information on one imaging system, and the types of information acquired are increasing; the sensitivity and accuracy of the acquired information are increasing; the size and quality of the system are decreasing; the degree of integration and intelligence are increasing; the ability to adapt to the environment is increasing; and the output-input ratio is increasing. The polarization hyperspectral imaging system and method described in the present invention have broad development and application prospects in many fields such as earth observation, space exploration, military reconnaissance, earth resource surveys, environmental protection, atmospheric detection, ocean remote sensing, crop and vegetation surveys, high-sensitivity detection of targets with extremely small individual sizes and clustered distribution characteristics, as well as biology, medicine, and life sciences. In specific applications, it can be implemented in combination with unmanned aerial vehicle technology, and the polarization hyperspectral imaging system described in the present invention can be fixed on a drone for aerial flight detection.

[0055] It is understood that the above specific description of the present invention is only used to illustrate the present invention and is not limited to the technical solutions described in the embodiments of the present invention. Those skilled in the art should understand that the present invention can still be modified or replaced with equivalents to achieve the same technical effects; as long as the use requirements are met, they are all within the scope of protection of the present invention.

Claims

1. A polarization hyperspectral imaging system, characterized in that: It includes a housing, an imaging lens, an imaging spectrometer, a surface array polarization camera, a focus translation component, a push-sweep translation component, and a processor; A mounting hole is provided on a side wall of the housing; The imaging lens is fixed to the housing through the mounting hole and extends out of the housing; An imaging spectrometer and an area array polarization camera are sequentially arranged in the housing from the imaging lens to the rear, and the imaging spectrometer is connected to the area array polarization camera; The focus translation assembly is arranged in the housing, the push-sweep translation assembly is arranged on the focus translation assembly, and the imaging spectrometer is arranged on the push-sweep translation assembly; The processor is arranged in the housing and is connected to the area array polarization camera, the focus adjustment and translation component, and the push-scan and translation component. The processor is connected to an electronic output interface.

2. The polarization hyperspectral imaging system according to claim 1, characterized in that: The focusing translation assembly includes a first mounting seat, a first motor, a first screw and a second mounting seat. The first mounting seat is fixed to the bottom surface of the inner part of the casing. The first motor is controlled by a processor and is mounted on the side of the second mounting seat. The output shaft of the first motor is connected to the first screw. The first screw is arranged horizontally and the screw nut is connected to the side of the first mounting seat through a first connecting block. The first mounting seat and the second mounting seat are slidably connected through a first cross roller guide rail.

3. The polarization hyperspectral imaging system according to claim 2, characterized in that: The push-sweep translation assembly includes a second motor, a second lead screw and a third mounting seat. The second motor is controlled by a processor and is mounted on the side of the second mounting seat. The output shaft of the second motor is connected to the second lead screw. The second lead screw is horizontally arranged and perpendicular to the first lead screw. The lead screw nut of the second lead screw is connected to the side of the third mounting seat through a second connecting block. The second mounting seat and the third mounting seat are slidably connected through a second cross roller guide rail. The imaging spectrometer is mounted on the top surface of the third mounting seat.

4. The polarization hyperspectral imaging system according to claim 1, characterized in that: The imaging spectrometer includes an incident slit, a first collimating lens group, a grating, and a second collimating lens group.

5. The polarization hyperspectral imaging system according to claim 1, characterized in that: The area array polarization camera includes a CMOS image sensor and a micro polarization filter array.

6. The polarization hyperspectral imaging system according to claim 1, characterized in that: The CMOS image sensor is a black and white polarized CMOS image sensor.

7. The polarization hyperspectral imaging system according to claim 1, characterized in that: It also includes an auxiliary camera, which is installed on one side of the imaging lens and is used to monitor the field of view of the imaging lens. The auxiliary camera is electrically connected to the processor.

8. The imaging method based on the polarization hyperspectral imaging system according to claim 1, comprising the following steps: The processor controls the movement of the focusing and translational components, and the imaging spectrometer moves under the drive of the focusing and translational components to achieve focal length adjustment between the imaging lens and the imaging spectrometer; The imaging lens forms an image of the target to be measured; The processor controls the movement of the push-sweep and translation assembly, and the imaging spectrometer moves according to the prescribed stroke driven by the push-sweep and translation assembly to perform push-sweep acquisition on the image output by the imaging lens; The surface array polarization camera receives the output optical signal of the imaging spectrometer and performs polarization resampling processing on the optical signal; The processor receives and stores output information of the area array polarization camera, and outputs the output information of the area array polarization camera to the outside of the imaging system through an electronic interface; The output information is analyzed and processed by a computer to obtain the required image results.

9. The imaging method of the polarization hyperspectral imaging system according to claim 7, comprising the following steps: The auxiliary camera monitors the field of view of the imaging lens in real time and feeds the field of view information back to the processor; The processor controls the movement of the focusing and translational components, and the imaging spectrometer moves under the drive of the focusing and translational components to achieve focal length adjustment between the imaging lens and the imaging spectrometer; The imaging lens forms an image of the target to be measured; The processor controls the movement of the push-sweep and translation assembly, and the imaging spectrometer moves according to the prescribed stroke driven by the push-sweep and translation assembly to perform push-sweep acquisition on the image output by the imaging lens; The surface array polarization camera receives the output optical signal of the imaging spectrometer and performs polarization resampling processing on the optical signal; The processor receives and stores output information of the area array polarization camera and the auxiliary camera, and outputs the output information to the outside of the imaging system through an electronic interface; The output information is analyzed and processed by a computer to obtain the required image results.

10. A polarization hyperspectral imaging system mounted on an unmanned aerial vehicle, comprising the polarization hyperspectral imaging system according to any one of claims 1 to 4, wherein the polarization hyperspectral imaging system is fixed on the unmanned aerial vehicle.

Citation Information

Patent Citations

  • Automatic focusing method of pushbroom imaging spectrometer

    CN105092026A

  • Pushbroom imaging spectrometer

    CN105092034A

  • Hyper-spectral rotating mirror scanning imaging system based on unmanned gyroplane and imaging method thereof

    CN105438489A

  • Lens scanning mode high-spectrum imaging system and rotor wing unmanned aerial vehicle

    CN107121192A

  • Hyperspectral polarization imaging system

    CN109405972A