Spectral polarization multi-mode composite imaging system and method

Abstract

A digital micromirror chip, a dispersion element, a spectrum-polarization regulator, a photoelectric detector and a control device are arranged, the digital micromirror chip comprises a micromirror matrix composed of a plurality of micromirrors, each micromirror in the micromirror matrix has a light-passing state and a light-shielding state, and the spectrum-polarization regulator and the photoelectric detector are connected with the digital micromirror chip. The state of each micro-mirror is independently controlled by the control equipment, a broadband filter device, a plurality of narrow-band filter devices and a plurality of linear polarization filter devices are distributed on a turntable of the spectrum-polarization regulator in a surrounding manner, and under the combination of the digital micro-mirror chip, the dispersion element, the spectrum-polarization regulator and the control equipment, the broadband filter device, the narrow-band filter devices and the linear polarization filter devices are distributed in a surrounding manner. Spectral polarization imaging of multiple channels can be achieved, and the technical requirement that three resolution ratios can simultaneously achieve the best in the spectral polarization imaging technology is met.

Description

Technical Field

[0001] The present invention relates to the technical field of optical systems, and in particular to a spectral polarization multi-mode composite imaging system and method. Background Art

[0002] Spectral imaging of a target can obtain two-dimensional spatial information and one-dimensional spectral information of the target, and polarization imaging of a target can obtain two-dimensional spatial information and multi-dimensional polarization information of the target. The spectral polarization imaging technology, which is a combination of spectral imaging and polarization imaging, can simultaneously obtain two-dimensional spatial information, one-dimensional spectral information and multi-dimensional polarization information of the target, thereby fully understanding the spectral characteristics of the target.

[0003] Prior art has disclosed a spectral polarization imaging technique that combines staring spectral imaging with time-sharing polarization imaging. This technique utilizes a combination of a liquid crystal tunable filter (LCTF) and a liquid crystal variable retarder (LCVR) to achieve spectral polarization imaging. Due to the inherent characteristics of staring spectral imaging, this technique can achieve high spatial resolution, but its spectral and temporal resolutions fall short of expectations.

[0004] At the same time, existing technologies also combine the coded aperture snapshot spectral imaging technology of digital micromirror devices (DMDs) with time-sharing polarization imaging technology to form coded aperture snapshot spectral polarization imaging technology. This technology uses a rotatable quarter-wave plate (QWP) and a rotatable polarizer as polarization modulation components to modulate the polarization information on the spectrum. A digital micromirror device is then used to achieve aperture coding. After modulation by a dispersion element, the resulting coded polarization-modulated spectral image is recorded by a camera. The polarization-modulated spectral image is estimated using a sparse constrained optimization method, and a demodulation algorithm is used to calculate a spectral polarization image with full-Stokes properties. This technology, thanks to the digital micromirror device, can achieve high temporal resolution, but the spectral and spatial resolutions fall short of expectations.

[0005] In addition, existing technology also discloses a compressed spatial-dimensional dual-coded hyperspectral polarization imaging system. This system combines coded aperture snapshot spectral imaging technology with split-focal plane polarization imaging technology. It uses a micropolarizer array (MPA) detector as a polarization modulation module, directly modulating polarization on the detector surface. It also uses a digital micromirror device for spatial encoding and a prism-grating-prism (PGP) to modulate spectral information. Finally, it acquires the target's spectral polarization information with a single exposure. This system, with the combination of the digital micromirror device and the PGP, can achieve high temporal resolution, but its spectral and spatial resolutions fall short of expectations.

[0006] Therefore, the spectral polarization imaging technologies listed above all have contradictions between temporal resolution, spatial resolution, and spectral resolution (hereinafter referred to as the three major resolutions). Specifically, the three major resolutions restrict each other, making it difficult to achieve the best at the same time. Summary of the Invention

[0007] The technical problem to be solved by the present invention is how to achieve three major resolutions and simultaneously achieve the best technical effect in spectral polarization imaging technology. In order to solve the above technical problem, the present invention provides a spectral polarization multi-mode composite imaging system and method, which specifically include a spectral polarization multi-mode composite imaging system, a spectral polarization multi-mode composite imaging method, a push-broom spectral imaging method, a staring spectral imaging method, a transformation spectral imaging method, a snapshot spectral imaging method, a push-broom spectral polarization imaging method, a transformation spectral polarization imaging method and a snapshot spectral polarization imaging method.

[0008] The present invention provides a spectral polarization multi-mode composite imaging system, which includes a control device and the following devices arranged in sequence along the propagation direction of signal light of a target imaging scene: A digital micromirror chip contains a micromirror matrix composed of multiple micromirrors, each of which has two states: light-transmitting and light-blocking. The state of each micromirror is individually controlled. dispersion element; A spectrum-polarization regulator is composed of a motor and a rotating disk disposed on the output shaft of the motor. A plurality of filter elements are arranged on the rotating disk in a surrounding manner. The plurality of filter elements are composed of a broadband filter element, a plurality of narrowband filter elements, and a plurality of linear polarization filter elements. The motor is used to drive the rotating disk to rotate so that one of the filter elements is located on the propagation path of the signal light. Photodetectors; The control device is electrically connected to the digital micromirror chip and the motor at the same time to respectively control the state of each micromirror and the rotation angle of the output shaft of the motor.

[0009] The spectral-polarization multi-mode composite imaging system disclosed in the present invention comprises a digital micromirror chip, a dispersive element, a spectral-polarization regulator, and a photodetector, arranged sequentially along the propagation direction of the signal light of the target imaging scene. The digital micromirror chip comprises a micromirror matrix composed of multiple micromirrors, each of which has two states: light-transmitting and light-blocking. Each state of the micromirror is individually controlled. Since the digital micromirror chip, the dispersive element, and the spectral-polarization regulator are arranged sequentially along the propagation direction of the signal light of the target imaging scene, when a micromirror in the micromirror matrix is in the light-transmitting state, the signal light received by this micromirror can be directed into the dispersive element; otherwise, it is not directed into the dispersive element. The signal light directed into the dispersive element is dispersed by the dispersive element to form dispersed light. Since a broadband filter element, several narrowband filters, and several linear polarization filters are arranged in a circular pattern on the rotating disk of the spectral-polarization regulator, the motor of the spectral-polarization regulator can position one of the filter elements in the propagation path of the signal light. Therefore, with the combination of digital micromirror chips, dispersion elements and spectral-polarization regulators, spectral polarization imaging of multiple channels can be achieved, and the imaging information can be received by photodetectors, ultimately achieving the acquisition of spectral and polarization information of the target.

[0010] At the same time, since the spectral polarization multi-mode composite imaging system disclosed in the present invention also includes a control device to respectively control the state of each micromirror and the rotation angle of the output shaft of the motor, it can further realize push-broom, staring, transformation, and snapshot spectral imaging on the basis of obtaining the spectral information and polarization information of the target. In addition, due to the setting of the linear polarization filter device, the push-broom, transformation, and snapshot spectral imaging can also be combined with polarization imaging to perform spectral polarization imaging, realizing a total of seven different imaging modes. In the context of this multi-mode spectral polarization imaging, different spectral polarization imaging modes can be selected for different target scenes to adjust the three major resolutions in a targeted manner, ultimately realizing highly flexible, multi-scene adaptive spectral polarization imaging, meeting the technical requirement of achieving the best three major resolutions simultaneously in spectral polarization imaging technology.

[0011] In one possible embodiment, the composite imaging system further includes an imaging lens, a collimating lens, and a converging lens. The imaging lens, the digital micromirror chip, the collimating lens, the dispersive element, the converging lens, the spectrum-polarization regulator, and the photodetector are sequentially arranged along the propagation direction of the signal light. The imaging lens forms a clear image of the target imaging scene on the surface of the digital micromirror chip, the collimating lens collimates the light reflected from the digital micromirror chip so that its main light is incident parallel to the surface of the dispersive element, and the converging lens converges the dispersed light beam to improve the efficiency of the photodetector in receiving imaging information.

[0012] The present invention provides a spectral polarization multi-mode composite imaging method, comprising the following steps: The user selects one of seven modes: push-broom spectral imaging, staring spectral imaging, transformation spectral imaging, snapshot spectral imaging, push-broom spectral polarization imaging, transformation spectral polarization imaging, and snapshot spectral polarization imaging; If the push-broom spectral imaging is selected, the push-broom spectral imaging method is executed to obtain an imaging result; If staring spectral imaging is selected, the staring spectral imaging method is executed to obtain an imaging result; If transform spectral imaging is selected, the transform spectral imaging method is executed to obtain an imaging result; If snapshot spectral imaging is selected, a snapshot spectral imaging method is executed to obtain an imaging result; If push-broom spectral polarization imaging is selected, the push-broom spectral polarization imaging method is executed to obtain an imaging result; If the transformation spectral polarization imaging is selected, the transformation spectral polarization imaging method is executed to obtain the imaging result; If snapshot spectral polarization imaging is selected, the snapshot spectral polarization imaging method is executed to obtain an imaging result.

[0013] The spectral polarization multi-mode composite imaging method disclosed in the present invention first allows the user to select one mode from seven modes, namely push-broom spectral imaging, staring spectral imaging, transformation spectral imaging, snapshot spectral imaging, push-broom spectral polarization imaging, transformation spectral polarization imaging, and snapshot spectral polarization imaging, according to different target scenes. Different methods are used for different modes to adjust the three major resolutions in a targeted manner, and ultimately achieve highly flexible, multi-scene adaptable spectral polarization imaging, meeting the technical requirement of achieving the best three major resolutions simultaneously in spectral polarization imaging technology.

[0014] The present invention provides a push-broom spectral imaging method, comprising the following steps: S11: adjusting the rotation angle of the output shaft of the motor by the control device so that the broadband filter device is located on the propagation path of the signal light of the target imaging scene; S12: Select multiple micromirror columns of the digital micromirror chip and divide the multiple micromirror columns into a plurality of column units; S13: controlling the light transmission of each column of units by the control device, and obtaining a corresponding dispersion spectrum image of each column of units when the light is transmitted by the photodetector; S14: All the dispersion spectrum images obtained in step S13 are stored in BIL format, and then the BIL format is converted into BSQ format by extracting the spectral information of the spatial position to represent the spatial distribution of the target imaging scene in different bands to obtain the imaging result.

[0015] The above-mentioned push-broom spectral imaging method stores the obtained dispersion spectral image in BIL format, and then converts it into BSQ format by extracting the spectral information of the spatial position, so that the push-broom spectral imaging information can represent the spatial distribution of the target imaging scene in different bands in detail.

[0016] The present invention provides a staring spectral imaging method, comprising the following steps: S21: selecting a plurality of micromirror columns of a digital micromirror chip, dividing the plurality of micromirror columns into a plurality of column units, and then controlling light transmission of all column units by the control device; S22: adjusting the rotation angle of the output shaft of the motor by the control device so that each narrowband filter device is located on the propagation path of the signal light, and obtaining a corresponding dispersion spectrum image by the photodetector when each narrowband filter device is located on the propagation path of the signal light; S23: Convert all the dispersion spectrum images obtained in step S22 into BSQ format to obtain imaging results.

[0017] The above-mentioned staring spectral imaging method realizes staring spectral imaging by controlling the rotation angle of the digital micromirror chip and the output shaft of the motor, thereby improving imaging efficiency and imaging quality.

[0018] The present invention provides a transformative spectral imaging method, comprising the following steps: S31: adjusting the rotation angle of the output shaft of the motor by the control device so that the broadband filter device is located on the propagation path of the signal light of the target imaging scene; S32: Select multiple micromirror columns of the digital micromirror chip and divide the multiple micromirror columns into a plurality of column units; S33: Set the order of the binary domain to be a non-singular matrix with the number of column elements obtained in step S32, and let i The transformation matrix j The values of all elements in the column are equal to the non-singular matrix i Rank j The element values of the column are used to generate a transformation matrix with the same number of column elements as that obtained in step S32; S34: controlling the states of all micromirrors in the column units obtained in step S32 according to each of the transformation matrices by the control device, and obtaining a dispersion spectrum image corresponding to each of the transformation matrices by a photodetector; S35: using a format conversion formula to convert all the dispersion spectrum images obtained in step S34 into a spectrum data cube in BIL format to obtain an imaging result.

[0019] The above-mentioned transformation-based spectral imaging method first places the broadband filter device on the propagation path of the signal light of the target imaging scene, and then generates a transformation matrix using a non-singular matrix constructed on the binary domain to manipulate the state of the micromirror and achieve control of spectral resolution and spatial resolution.

[0020] The present invention provides a snapshot spectral imaging method, comprising the following steps: S41: adjusting the rotation angle of the output shaft of the motor by the control device so that the broadband filter device is located on the propagation path of the signal light of the target imaging scene; S42: Selecting a plurality of micromirror rows and a plurality of micromirror columns of the digital micromirror chip to obtain a working area; S43: constructing a coding matrix on the binary domain that is adapted to the working area selected in step S42 and satisfies the constrained equidistance condition, and controlling the states of all micromirrors in the working area according to the coding matrix through the control device; S44: obtain dispersion spectrum image through photodetector; S45: Determine whether the number of currently acquired dispersion spectrum images is equal to a specified value. If yes, proceed to the next step; If not, then go back to step S43; S46: Using all the currently acquired dispersion spectral images, the spectral data cube reconstruction method is modeled as a least squares estimation problem with a regularization term; S47: Solve the least squares estimation problem to obtain a spectral data cube estimation value distribution, and use the spectral data cube estimation value distribution as an imaging result.

[0021] The above-mentioned snapshot spectral imaging method models the spectral data cube reconstruction method as a least squares estimation problem with a regularization term. By solving the least squares estimation problem to obtain the distribution of spectral data cube estimation values, not only the imaging efficiency is improved, but also the accuracy and time and spatial resolution can be controlled.

[0022] The present invention provides a push-broom spectral polarization imaging method, comprising the following steps: S51: adjusting the rotation angle of the output shaft of the motor by the control device so that one of the linear polarization filter elements is located on the propagation path of the signal light of the target imaging scene; S52: Select multiple micromirror columns of the digital micromirror chip, and divide the multiple micromirror columns into a plurality of column units; S53: controlling the light transmission of each column of units by the control device, and obtaining a corresponding dispersion spectrum image of each column of units when the light is transmitted by the photodetector; S54: storing all the dispersion spectrum images obtained in step S53 in a BIL format, and then converting the BIL format into a BSQ format by extracting spectral information of spatial positions to represent the spatial distribution of the target imaging scene in different bands; S55: Determine whether all linear polarization filter devices on the turntable have been traversed. If yes, proceed to the next step; If not, the control device is used to adjust the rotation angle of the output shaft of the motor so that the next linear polarization filter element is located on the propagation path of the signal light of the target imaging scene, and then the step S52 is executed again. S56: Cluster all currently acquired dispersion spectrum images in the BSQ format according to polarization channels to obtain spectrum data cubes under different polarization states, and obtain imaging results.

[0023] The above-mentioned push-broom spectral polarization imaging method realizes push-broom spectral polarization imaging by manipulating the rotation angle of the digital micromirror chip and the output shaft of the motor, and controls the digital micromirror chip multiple times, so that the temporal resolution and spectral resolution of the obtained imaging results can be controlled.

[0024] The present invention provides a transformation-type spectral polarization imaging method, which includes the following steps: S61: adjusting the rotation angle of the output shaft of the motor by the control device so that one of the linear polarization filter elements is located on the propagation path of the signal light of the target imaging scene; S62: Select multiple micromirror columns of the digital micromirror chip, and divide the multiple micromirror columns into a plurality of column units; S63: Set the order of the binary domain to be a non-singular matrix with the number of column elements obtained in step S62, and let i The transformation matrix j The values of all elements in the column are equal to the non-singular matrix i Rank j The element values of the column are used to generate a transformation matrix with the same number of column elements as that obtained in step S62; S64: controlling the states of all micromirrors in the column units obtained in step S62 according to each of the transformation matrices by the control device, and obtaining a dispersion spectrum image corresponding to each of the transformation matrices by a photodetector; S65: Determine whether all linear polarization filter devices on the turntable have been traversed. If yes, proceed to the next step; If not, adjusting the rotation angle of the output shaft of the motor by the control device so that the next linear polarization filter device is located on the propagation path of the signal light of the target imaging scene, and then returning to execute step S62; S66: Clustering all currently acquired dispersion spectrum images according to polarization channels to obtain spectrum data cubes under different polarization states, and obtaining imaging results.

[0025] The above-mentioned transformation-type spectral polarization imaging method sequentially adjusts each linear polarization filter element to the propagation path of the signal light of the target imaging scene, selects multiple micromirror columns of the digital micromirror chip in each adjustment, and manipulates these micromirrors according to the set transformation matrix to complete transformation-type spectral polarization imaging, thereby achieving controllable spectral resolution and temporal resolution while improving imaging efficiency and quality.

[0026] The present invention provides a snapshot spectral polarization imaging method, comprising the following steps: S71: adjusting the rotation angle of the output shaft of the motor by the control device so that one of the linear polarization filter elements is located on the propagation path of the signal light of the target imaging scene; S72: Selecting a plurality of micromirror rows and a plurality of micromirror columns of the digital micromirror chip to obtain a working area; S73: constructing a coding matrix on the binary domain that is compatible with the working area selected in step S72 and satisfies the constrained equidistance condition, and controlling the states of all micromirrors in the working area according to the coding matrix through the control device; S74: Obtaining dispersion spectrum images through photodetectors; S75: Determine whether all linear polarization filter devices on the turntable have been traversed. If yes, proceed to the next step; If not, adjusting the rotation angle of the output shaft of the motor by the control device so that the next linear polarization filter device is located on the propagation path of the signal light of the target imaging scene, and then returning to execute step S72; S76: Clustering all currently acquired dispersion spectrum images according to polarization channels to obtain spectrum data cubes under different polarization states, and obtaining imaging results.

[0027] The above-mentioned snapshot spectral polarization imaging method sequentially adjusts each linear polarization filter element to the propagation path of the signal light of the target imaging scene. In each adjustment, the working area of the digital micromirror chip is selected and the coding matrix is set. The state of all micromirrors in the working area is controlled according to the coding matrix set each time to complete snapshot spectral polarization imaging. While improving imaging quality and efficiency, it also achieves controllable spectral resolution, temporal resolution and spatial resolution. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] Figure 1 A schematic diagram of the optical path structure of a spectral polarization multi-mode composite imaging system disclosed in an embodiment of the present invention; Figure 2 This is a schematic structural diagram of a spectrum-polarization regulator disclosed in an embodiment of the present invention; Figure 3 A schematic diagram of a digital micromirror chip arranged in a square according to an embodiment of the present invention; Figure 4 A schematic diagram of the working area and the division of row reflection units and column reflection units of the diamond-arranged digital micromirror chip disclosed in an embodiment of the present invention; Figure 5 A schematic diagram of the modulation mode of the digital micromirror chip, the gating channel of the spectral-polarization modulator, and the data format obtained by the photodetector when the push-broom spectral imaging disclosed in an embodiment of the present invention is working; Figure 6 A schematic diagram of the modulation mode of the digital micromirror chip, the gating channel of the spectrum-polarization regulator, and the data format obtained by the photodetector when the staring spectral imaging disclosed in an embodiment of the present invention works; Figure 7 A schematic diagram of the modulation mode of the digital micromirror chip, the gating channel of the spectrum-polarization regulator, and the data format obtained by the photodetector when the transformable spectral imaging disclosed in an embodiment of the present invention works; Figure 8 A schematic diagram of the modulation mode of the digital micromirror chip, the gating channel of the spectrum-polarization regulator, and the data format obtained by the photodetector when the snapshot spectral imaging disclosed in an embodiment of the present invention works; Figure 9 A schematic diagram of the modulation mode of the digital micromirror chip, the gating channel of the spectral-polarization modulator, and the data format obtained by the photodetector when the push-broom spectral polarization imaging disclosed in an embodiment of the present invention is working; Figure 10 A schematic diagram of the modulation mode of the digital micromirror chip, the gating channel of the spectral-polarization modulator, and the data format obtained by the photodetector when the conversion-type spectral polarization imaging disclosed in an embodiment of the present invention works; Figure 11 This is a schematic diagram of the modulation mode of the digital micromirror chip, the gating channel of the spectral-polarization regulator, and the data format obtained by the photodetector when the snapshot spectral polarization imaging disclosed in an embodiment of the present invention works.

[0029] Description of reference numerals: 1. Target imaging scene, 2. Imaging lens, 3. Digital micromirror chip, 4. Collimating lens, 5. Dispersion element, 6. Converging lens, 7. Spectral-polarization regulator, 7-1. Motor, 7-2. Turntable, 8. Photodetector, 9. Control equipment. DETAILED DESCRIPTION

[0030] First, those skilled in the art should understand that these embodiments are merely used to explain the technical principles of the embodiments of the present application and are not intended to limit the scope of protection of the embodiments of the present application. Those skilled in the art may adjust them as needed to suit specific application scenarios.

[0031] In the embodiments of the present application, unless otherwise clearly specified and limited, the electrical connection between the first feature and the second feature means that there is a transmission of electrical signals between the first feature and the second feature. This electrical signal transmission can be either unidirectional or bidirectional, and the way to achieve the electrical connection can be electrical connection of wires, radio connection, electrical connection of electromagnetic media (such as semiconductors), communication achieved by channels, etc.

[0032] In the embodiments of the present application, unless otherwise expressly specified or limited, a first feature being "above" or "below" a second feature may mean that the first and second features are in direct contact, or that the first and second features are in indirect contact through an intermediate medium. Furthermore, a first feature being "above," "above," and "above" a second feature may mean that the first feature is directly above or obliquely above the second feature, or simply means that the first feature is higher in level than the second feature. A first feature being "below," "below," and "below" a second feature may mean that the first feature is directly below or obliquely below the second feature, or simply means that the first feature is lower in level than the second feature.

[0033] The present application will be further described in detail below with reference to the accompanying drawings and specific embodiments.

[0034] See also Figure 1 、 Figure 2 、 Figure 3 and Figure 4 , the embodiment of the present application discloses a spectral polarization multi-mode composite imaging system, Figure 1 This is a schematic diagram of the optical path structure of the composite imaging system. The composite imaging system includes a control device 9 and an imaging lens 2, a digital micromirror chip 3, a collimating lens 4, a dispersive element 5, a converging lens 6, a spectral-polarization modulator 7, and a photodetector 8, arranged in sequence along the propagation direction of the signal light emitted or reflected from the target imaging scene 1. The axes of the imaging lens 2, digital micromirror chip 3, collimating lens 4, dispersive element 5, and converging lens 6 are all located on the same horizontal plane. In this embodiment, biological cells are selected as the target imaging scene 1.

[0035] In the composite imaging system, the imaging lens 2 is used to clearly form an image of the target imaging scene 1 on the surface of the digital micromirror chip 3. The imaging lens 2 is independently designed and customized.

[0036] In the composite imaging system, the digital micromirror chip 3 includes a micromirror matrix composed of a plurality of micromirrors, and each micromirror has two states: light-transmitting and light-blocking. The state of each micromirror is controlled individually.

[0037] The digital micromirror chip 3 is a digital micromirror chip device, see Figure 3 and Figure 4 , which has (N rows, M columns) micromirrors, each of which has two states: light-transmitting and light-blocking. The state of each micromirror can be controlled individually to realize the function of optical switch. There are two main arrangements of micromirrors on the digital micromirror chip 3. One is a square arrangement, see Figure 3 , Figure 3 The middle (left) is a schematic diagram of a digital micromirror chip arranged in a square. Figure 3 The middle one is a schematic diagram of the rectangular arrangement after rotating 45°. Figure 3 The middle one (right) shows the reflection of light by micromirrors; the other one is a diamond arrangement, see Figure 4 The side length of each micromirror can be expressed as , the range of the deflection angle can be expressed as When using a square-arranged digital micromirror chip 3, it is necessary to rotate the digital micromirror chip 3 45° around the main axis (vertical micromirror surface upward) to ensure that the incident light and the signal light perpendicular to the micromirror surface are on the same horizontal plane. For details, see Figure 3 In the figure (right), a square arrangement rotated 45° is equivalent to a diamond arrangement.

[0038] Each micromirror in the digital micromirror chip 3 can be forward biased or reverse biased. When the deflection angle of a micromirror is equal to When the deflection angle of a micromirror is equal to When the micromirror is reverse biased, the micromirror cannot introduce the signal light into the collimating lens 4, that is, the micromirror is in a light-shielding state. In this embodiment, the digital micromirror chip 3 is a DLP7000 micromirror chip with a square arrangement. The relevant parameters are: , , See Figure 3 , this embodiment selects Column reflection unit, The row reflection units serve as the working area, and each column reflection unit contains Micromirror columns, each row reflection unit contains The side length of each (row or column) reflective unit is , is a positive real number. The six column reflection units are , the 4 row reflection units are , so there are Reflection units, the center position of each reflection unit is express.

[0039] In the composite imaging system, the collimating lens 4 is used to collimate the light reflected from the digital micromirror chip 3 so that its main light is incident on the surface of the dispersion element 5 in parallel.

[0040] In this composite imaging system, the dispersion element 5 is used to disperse and split the light beam incident on the surface of the dispersion element 5 to form dispersed light. A dispersion prism, a grating, or a prism-grating-prism (PGP) can be used, which has linear dispersion characteristics. The central wavelength of the dispersion element 5 is denoted as , linear dispersion is denoted as In this embodiment, a transmission blazed grating with a grating line count of 300 l / mm, a blazed wavelength of 550 nm, and an operating wavelength range of 400-800 nm is selected as the dispersion element 5.

[0041] In the composite imaging system, the converging lens 6 is used to converge the dispersed light output by the dispersive element 5 , so as to converge the dispersed light onto the surface of the spectrum-polarization modulator 7 .

[0042] See also Figure 2 In this composite imaging system, the spectrum-polarization regulator 7 is composed of a motor 7-1 and a turntable 7-2 arranged on the output shaft of the motor 7-1. A plurality of filter elements are arranged in a surrounding manner on the turntable 7-2. The plurality of filter elements are composed of a broadband filter element, a plurality of narrowband filter elements and a plurality of linear polarization filter elements. The motor 7-1 is used to drive the turntable 7-2 to rotate so that one of the filter elements is located on the propagation path of the signal light of the target imaging scene 1.

[0043] The spectrum-polarization regulator 7 is a wheel-type rotating mechanism that is driven by a motor 7-1 to control the rotation of a turntable 7-2. optical channels, which Optical channels include 1 broadband filter channel, spectral channels and Polarization channels, one of which is a broadband filter channel used to install broadband filter components. The filtering range of the installed broadband filter components is recorded as ; The spectral channels are denoted as , used to install narrowband filter devices, the filtering range of the installed narrowband filter devices is recorded as ,in For the The central wavelength of a narrowband filter device, For the The full width at half maximum of a narrowband filter device; The polarization channels are denoted as , used to install linear polarization filter components.

[0044] In this embodiment, a broadband filter device installed on the turntable 7-2 has a filtering range of 400 nm-800 nm. In addition, seven narrowband filter devices are installed on the turntable 7-2. The central wavelengths of these narrowband filter devices are 450 nm, 500 nm, 549 nm, 591 nm, 640 nm, 700 nm and 750 nm, respectively. The full width at half maximum of all narrowband filter devices is 5 nm. At the same time, four linear polarization filter devices are also installed on the turntable 7-2. The polarization angles of these four linear polarization filter devices are 0°, 45°, 90° and 135°. After obtaining the image information of the four polarization channels, the polarization component of the target imaging scene 1 can be solved by the following calculation formula : , , , , in, Indicates light intensity, represents the total incident light intensity, express Quantity and The light intensity difference of the components, Indicates the intensity difference between the 45° and 135° polarization components, Represents the intensity difference between left-handed and right-handed circularly polarized components.

[0045] In the composite imaging system, the photodetector 8 is used to receive image information to obtain and store the dispersion spectrum image. Insensitive (i.e. using a grayscale camera). The size of each pixel on the photodetector 8 is , different pixels are used In this embodiment, the photodetector 8 is a Hamamatsu C15550-22UP ORCA-Quest 2qCMOS camera. It has 4096×2304 pixels, and the side length of each pixel is 4.6 μm, which is approximately half the side length of the reflection unit of the digital micromirror device 3.

[0046] In this composite imaging system, the control device 9 includes a display and a central processing unit, wherein the central processing unit is electrically connected to the digital micromirror chip 3 and the motor 7-1 at the same time to respectively control the state of each micromirror and the rotation angle of the output shaft of the motor 7-1; the display is electrically connected to the central processing unit to display seven modes of push-broom spectral imaging, staring spectral imaging, transformation spectral imaging, snapshot spectral imaging, push-broom spectral polarization imaging, transformation spectral polarization imaging and snapshot spectral polarization imaging for user selection, and is also used to display the imaging results and image information received by the photodetector 8.

[0047] See also Figure 1 Signal light emitted or reflected by the target imaging scene 1 passes through the imaging lens 2 and enters the surface of the digital micromirror chip 3, forming a primary image on the surface of the digital micromirror chip 3. The digital micromirror chip 3 spatially modulates the primary image, and the modulated information enters the collimating lens 4. The collimating lens 4 collimates the light and directs it onto the surface of the dispersive element 5, dispersing the light. The dispersed light then enters the converging lens 6. Next, the filter components mounted on the turntable 7-2 select different channels of the light beam. Combined with the different modulation methods of the digital micromirror chip 3, seven different imaging modes can be achieved: push-broom spectral imaging, staring spectral imaging, transformation spectral imaging, snapshot spectral imaging, push-broom spectral polarization imaging, transformation spectral polarization imaging, and snapshot spectral polarization imaging. Finally, the photodetector 8 receives and stores the image information. Throughout this process, a central control processor coordinates the control of the digital micromirror chip 3, the spectral-polarization modulator 7, and the photodetector 8, as well as receives, stores, and processes the image information.

[0048] The physical model of the composite imaging system will be further disclosed below to facilitate those skilled in the art to gain an in-depth understanding of the operating mechanism and technical effects of the composite imaging system.

[0049] Let’s assume that after the signal light of the target imaging scene 1 enters the system, the spectral density after the imaging lens 2 is ,in represents the spatial dimension, Represents the spectral dimension (i.e. wavelength). Through the selective reflection effect of the digital micromirror chip 3 The spectral density after is: , Then, the spectral density of the signal light after passing through the collimating lens 4, the dispersive element 5 and the converging lens 6 is It is expressed as follows: , Among them, the Dirac function The magnification (or reduction) effect of the optical lens (including the collimating lens 4 and the converging lens 6) and the linear dispersion effect of the dispersion element 5 are described. is the scaling factor.

[0050] When the signal light enters the surface of the spectrum-polarization modulator 7, the following situations may occur due to the differences in the filter components installed on the rotating disk 7-2: (1) When the broadband filter device installed on the turntable 7-2 is located on the propagation path of the signal light of the target imaging scene 1, the continuous image (i.e., the dispersion spectrum image) on the photodetector 8 is expressed as: ; (2) Spectral channel of the current turntable 7-2 When the narrowband filter device mounted on is located on the propagation path of the signal light of the target imaging scene 1, the continuous image on the photodetector 8 is expressed as: ; (3) Polarization channel of the current turntable 7-2 When the linear polarization filter device mounted on is located on the propagation path of the signal light of the target imaging scene 1, the continuous images on the photodetector 8 are expressed as: .

[0051] Since the photodetector 8 is in two dimensions Upsampling, so in the presence of noise In the case of photodetector 8, the upper position The measured value at can be expressed as; , For a reflection unit composed of several micromirrors, the side length of each reflection unit is , which is s times the side length of the micromirror. Assume , is a positive integer. That is, the side length of the reflection unit on the digital micromirror chip 3 is the side length of each pixel on the photodetector 8. times. Then the selective reflection effect of the digital micromirror chip 3 can be expressed as position The switching state of the micromirror reflection unit is , in, It is a matrix composed of 0 and 1, corresponding to the switch state of different reflective units on the digital micromirror chip 3, the position of the photodetector 8 The measured value at can be rewritten as: , Will Expressed in discretized form , The discretization is expressed as ,in and represents the spatial dimension, represents the spectral dimension. Then the position on the photodetector 8 The measured value at can be expressed as: , in is the linear transformation matrix of the forward model of the composite imaging system, Generate according to certain rules. Usually assume It has sparseness in a certain transform domain, so that it can be solved in snapshot spectral imaging, that is, ,in is the sparse transformation matrix, is the vector of the basis representation of the sparse transformation matrix, then , in, .

[0052] See also Figures 5 to 11 The following further discloses a spectral polarization multi-mode composite imaging method using the spectral polarization multi-mode composite imaging system of this embodiment, which includes the following steps: The user selects one of seven modes: push-broom spectral imaging, staring spectral imaging, transformation spectral imaging, snapshot spectral imaging, push-broom spectral polarization imaging, transformation spectral polarization imaging, and snapshot spectral polarization imaging; If the push-broom spectral imaging is selected, the push-broom spectral imaging method is executed to obtain an imaging result; If staring spectral imaging is selected, the staring spectral imaging method is executed to obtain an imaging result; If transform spectral imaging is selected, the transform spectral imaging method is executed to obtain an imaging result; If snapshot spectral imaging is selected, a snapshot spectral imaging method is executed to obtain an imaging result; If push-broom spectral polarization imaging is selected, the push-broom spectral polarization imaging method is executed to obtain an imaging result; If the transformation spectral polarization imaging is selected, the transformation spectral polarization imaging method is executed to obtain the imaging result; If snapshot spectral polarization imaging is selected, the snapshot spectral polarization imaging method is executed to obtain an imaging result.

[0053] Figures 5 to 11All of them depict the modulation mode of the digital micromirror chip 3, the selection channel of the spectrum-polarization regulator 7, and the data format obtained by the photodetector 8. In the figure, the line where number 3 is located is the modulation mode of the digital micromirror chip 3, the line where number 7 is located is a schematic diagram of the selection channel of the spectrum-polarization regulator 7, and the line where number 8 is located is the data format obtained by the photodetector 8.

[0054] See also Figure 5 In this embodiment, the push-broom spectral imaging method includes the following steps: S11 : adjusting the rotation angle of the output shaft of the motor 7 - 1 through the control device 9 so that the broadband filter device is located on the propagation path of the signal light of the target imaging scene 1 .

[0055] S12: Select multiple micromirror columns of the digital micromirror chip 3 and divide the multiple micromirror columns into a plurality of column units.

[0056] S13: Control the light transmission of each column of units by the control device 9, and obtain the corresponding dispersion spectrum image of each column of units when the light is transmitted through the photodetector 8; Column cells , , when the Column cells When all micromirrors of the matrix are in the light-transmitting state (i.e., positive bias), No. All elements of the column have the value 1, while the other elements are 0. Photodetector 8 captures Column cells The corresponding dispersion spectrum images when the positive bias is given are recorded as ,common open.

[0057] S14: All the dispersion spectrum images obtained in step S13 are stored in BIL (band interleaved byline) format. Then, by extracting the spectral information of the spatial position, the BIL format is converted into BSQ (band sequential) format to represent the spatial distribution of the target imaging scene 1 in different bands to obtain the imaging result.

[0058] In the BIL format, on each dispersion spectrum image, the horizontal direction is the spectral dimension , the vertical direction is the spatial dimension , the spatial position can be directly extracted in the BIL format by calibration The spectral information of the target image scene 1 is obtained by converting the BIL format into the BSQ format. The BSQ format represents the spatial distribution of the target imaging scene 1 in different bands.

[0059] See also Figure 6 In this embodiment, the staring spectral imaging method includes the following steps: S21: Select multiple micro-mirror columns of the digital micro-mirror chip 3, divide the multiple micro-mirror columns into a plurality of column units, and then control all the column units to pass light through the control device 9. Specifically, make the digital micro-mirror chip 3 Column cells All positively biased, at this time, the matrix All elements of .

[0060] S22: The rotation angle of the output shaft of the motor 7-1 is adjusted by the control device 9 so that each narrowband filter device is located on the propagation path of the signal light. When each narrowband filter device is located on the propagation path of the signal light, the corresponding dispersion spectrum image is obtained by the photodetector 8. Finally, after traversing the seven narrowband filter devices, the photodetector 8 captures the spectrum images corresponding to all the narrowband filter devices, which are recorded as , a total of 7 pictures.

[0061] S23: Convert all the dispersion spectrum images obtained in step S22 into BSQ format to obtain imaging results.

[0062] See also Figure 7 In this embodiment, the transformation spectrum imaging method includes the following steps: S31 : adjusting the rotation angle of the output shaft of the motor 7 - 1 through the control device 9 so that the broadband filter device is located on the propagation path of the signal light of the target imaging scene 1 .

[0063] S32: Select multiple micromirror columns of the digital micromirror chip 3 and divide the multiple micromirror columns into Column units.

[0064] S33: Set the order of the non-singular matrix on the binary domain to 6, and let i The transformation matrix j The values of all elements in the column are equal to the non-singular matrix i Rank j The element values of the columns are used to generate 6 transformation matrices; in this embodiment, the non-singular matrix is a Hadamard matrix.

[0065] S34: The control device 9 controls the states of all the micromirrors in the column units obtained in step S32 according to each transformation matrix, and obtains the dispersion spectrum image corresponding to each transformation matrix through the photodetector 8. Then, the photodetector 8 captures the dispersion spectrum images corresponding to 6 frames of different patterns corresponding to the digital micromirror chip 3, which are recorded as , a total of 6 pictures.

[0066] S35: Convert all the dispersion spectrum images obtained in step S34 into a spectrum data cube in BIL format using a format conversion formula to obtain an imaging result. In this embodiment, the format conversion formula is: , in, for the reason To form a column vector, is a non-singular matrix, is the noise term, and then the spectral data cube in BIL format is: , Then convert it into BSQ format to obtain the imaging results.

[0067] See also Figure 8 In this embodiment, the snapshot spectral imaging method includes the following steps: S41 : adjusting the rotation angle of the output shaft of the motor 7 - 1 through the control device 9 so that the broadband filter device is located on the propagation path of the signal light of the target imaging scene 1 .

[0068] S42: Select multiple micromirror rows and multiple micromirror columns of the digital micromirror chip 3 to obtain a working area; in this embodiment, Column reflection unit, The row reflection units are used as the working area.

[0069] S43: Constructing a coding matrix on the binary domain that is adapted to the working area selected in step S42 and satisfies the constraint equidistance condition, and controlling the states of all micromirrors in the working area according to the coding matrix by the control device 9; wherein the constraint equidistance condition refers to For all S sparse vectors All are established. Among them, is the encoding matrix The constraint isometric coefficient, S sparse refers to the sparse vector Has at most S non-zero entries.

[0070] S44: Obtain a dispersion spectrum image through the photodetector 8.

[0071] S45: Determine whether the number of currently acquired dispersion spectrum images is equal to a specified value. If yes, proceed to the next step; If not, the process returns to step S43.

[0072] The specified value of this embodiment is set to 2, and then two dispersion spectrum images are obtained, which are recorded as and .

[0073] S46: Using all the currently acquired dispersion spectrum images, the spectrum data cube reconstruction method is modeled as a least squares estimation problem with a regularization term; that is, the spectrum data cube is: .

[0074] S47: Solve the least squares estimation problem to obtain the estimated value distribution of the spectral data cube, and use the estimated value distribution of the spectral data cube as the imaging result. This can be solved using the gradient projection sparse reconstruction method or the two-step iterative shrinkage threshold method. Modeling this as a least squares estimation problem with a regularization term is conventional technology, and those skilled in the art can consult relevant books on optimization models and algorithms. This will not be elaborated here.

[0075] See also Figure 9 In this embodiment, the push-broom spectral polarization imaging method includes the following steps: S51 : adjusting the rotation angle of the output shaft of the motor 7 - 1 through the control device 9 so that one of the linear polarization filter elements is located on the propagation path of the signal light of the target imaging scene 1 .

[0076] S52: Select multiple micromirror columns of the digital micromirror chip 3 and divide the multiple micromirror columns into a plurality of column units.

[0077] S53: Control each column of units to transmit light through the control device 9, and obtain the corresponding dispersion spectrum image of each column of units when the light is transmitted through the photodetector 8.

[0078] S54: All the dispersion spectrum images obtained in step S53 are stored in BIL format, and then the BIL format is converted into BSQ format by extracting the spectral information of the spatial position to represent the spatial distribution of the target imaging scene 1 in different bands.

[0079] S55: Determine whether all linear polarization filter devices on the turntable 7-2 have been traversed. If yes, proceed to the next step; If not, the rotation angle of the output shaft of the motor 7 - 1 is adjusted by the control device 9 to position the next linear polarization filter element on the propagation path of the signal light of the target imaging scene 1 , and then the process returns to step S52 .

[0080] S56: Cluster all currently acquired dispersion spectrum images in the BSQ format according to polarization channels to obtain spectrum data cubes under different polarization states, and obtain imaging results.

[0081] See also Figure 10 In this embodiment, the transformation spectral polarization imaging method includes the following steps: S61 : adjusting the rotation angle of the output shaft of the motor 7 - 1 through the control device 9 so that one of the linear polarization filter elements is located on the propagation path of the signal light of the target imaging scene 1 .

[0082] S62: Select multiple micromirror columns of the digital micromirror chip 3 and divide the multiple micromirror columns into a plurality of column units.

[0083] S63: Set the order of the binary domain to be a non-singular matrix with the number of column elements obtained in step S62, and let i The transformation matrix j The values of all elements in the column are equal to the non-singular matrix i Rank j The element values of the columns are calculated to generate a transformation matrix with the same number of column units as that obtained in step S62.

[0084] S64: The states of all micromirrors in the column units obtained in step S62 are controlled by the control device 9 according to each transformation matrix, and the dispersion spectrum image corresponding to each transformation matrix is obtained by the photodetector 8.

[0085] S65: Determine whether all linear polarization filter devices on the turntable 7-2 have been traversed. If yes, proceed to the next step; If not, the rotation angle of the output shaft of the motor 7 - 1 is adjusted by the control device 9 to position the next linear polarization filter element on the propagation path of the signal light of the target imaging scene 1 , and then the process returns to step S62 .

[0086] S66: Clustering all currently acquired dispersion spectrum images according to polarization channels to obtain spectrum data cubes under different polarization states, and obtaining imaging results.

[0087] See also Figure 11 In this embodiment, the snapshot spectral polarization imaging method includes the following steps: S71 : adjusting the rotation angle of the output shaft of the motor 7 - 1 through the control device 9 so that one of the linear polarization filter elements is located on the propagation path of the signal light of the target imaging scene 1 .

[0088] S72: Select multiple micromirror rows and multiple micromirror columns of the digital micromirror chip 3 to obtain a working area.

[0089] S73: Construct a coding matrix on the binary domain that is compatible with the working area selected in step S72 and satisfies the constrained equidistance condition, and control the states of all micromirrors in the working area according to the coding matrix through the control device 9.

[0090] S74: Obtaining a dispersion spectrum image through the photodetector 8; S75: Determine whether all linear polarization filter devices on the turntable 7-2 have been traversed. If yes, proceed to the next step; If not, the rotation angle of the output shaft of the motor 7 - 1 is adjusted by the control device 9 to place the next linear polarization filter element on the propagation path of the signal light of the target imaging scene 1 , and then the process returns to step S72 .

[0091] S76: Clustering all currently acquired dispersion spectrum images according to polarization channels to obtain spectrum data cubes under different polarization states, and obtaining imaging results.

[0092] The physical model and imaging method disclosed above demonstrate that the spectral-polarization multi-mode composite imaging system of this embodiment utilizes a digital micromirror chip 3, a dispersive element 5, and a spectral-polarization regulator 7, arranged sequentially along the propagation direction of the signal light of the target imaging scene. Therefore, when a micromirror in the micromirror matrix is in a light-transmitting state, the signal light received by this micromirror is directed into the dispersive element 5; otherwise, it is not directed into the dispersive element 5. The signal light directed into the dispersive element 5 is dispersed by the dispersive element 5 to form dispersed light. Since a broadband filter element, several narrowband filters, and several linear polarization filters are arranged in a circular pattern on the rotating disk 7-2 of the spectral-polarization regulator 7, the motor 7-1 of the spectral-polarization regulator 7 can position one of the filter elements in the propagation path of the signal light. Therefore, the combination of the digital micromirror chip 3, the dispersive element 5, and the spectral-polarization regulator 7 enables multi-channel spectral-polarization imaging. Imaging information is then received by the photodetector 8, ultimately enabling the acquisition of both spectral and polarization information of the target.

[0093] At the same time, because the composite imaging system also includes a control device 9 for separately controlling the state of each micromirror and the rotation angle of the output shaft of the motor 7-1, it can achieve push-broom, gaze, transformation, and snapshot spectral imaging based on the acquisition of the target's spectral and polarization information. In addition, due to the provision of the linear polarization filter device, push-broom, transformation, and snapshot spectral imaging can be combined with polarization imaging to perform spectral polarization imaging, achieving a total of seven different imaging modes. In the context of this multi-mode spectral polarization imaging, different spectral polarization imaging modes can be selected for different target scenes to specifically adjust the three major resolutions, ultimately achieving highly flexible, multi-scene adaptive spectral polarization imaging, meeting the technical requirement of achieving optimal simultaneous three major resolutions in spectral polarization imaging technology.

[0094] In the description of the embodiments of the present application, it should be noted that in the description of the present application, terms such as "inside" and "outside" indicating directions or positional relationships are based on the directions or positional relationships shown in the accompanying drawings. This is only for the convenience of description and does not indicate or imply that the device or component must have a specific orientation, be constructed and operated in a specific orientation. Therefore, it cannot be understood as a limitation on the present application.

[0095] In the description of the present application, the description with reference to the terms "one embodiment", "some embodiments", "in the present embodiment", "specific example", or "some examples" means that the specific features, mechanisms, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, mechanisms, materials or characteristics described can be combined in a suitable manner in any one or more embodiments or examples. In addition, those skilled in the art can combine and combine different embodiments or examples described in this specification and the features of different embodiments or examples, unless they are contradictory.

[0096] The above description is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in the present application should be included in the scope of protection of the present application. Therefore, the scope of protection of the present application should be based on the scope of protection of the claims.

Claims

1. A spectral polarization multi-mode composite imaging system, characterized in that: The composite imaging system includes a control device (9) and the following devices arranged in sequence along the propagation direction of the signal light of the target imaging scene (1): A digital micromirror chip (3) includes a micromirror matrix composed of a plurality of micromirrors, each of which has two states: light-transmitting and light-blocking. The state of each micromirror is individually controlled. dispersion element (5); A spectrum-polarization regulator (7) is composed of a motor (7-1) and a turntable (7-2) arranged on an output shaft of the motor (7-1), wherein a plurality of filter elements are arranged on the turntable (7-2) in a surrounding manner, wherein the plurality of filter elements are composed of a broadband filter element, a plurality of narrowband filter elements, and a plurality of linear polarization filter elements, and the motor (7-1) is used to drive the turntable (7-2) to rotate so that one of the filter elements is located on the propagation path of the signal light; Photodetector (8); The control device (9) is electrically connected to the digital micromirror chip (3) and the motor (7-1) at the same time, so as to respectively control the state of each micromirror and the rotation angle of the output shaft of the motor (7-1).

2. The spectral polarization multi-mode composite imaging system according to claim 1, characterized in that: The composite imaging system further comprises an imaging lens (2), a collimating lens (4) and a converging lens (6), wherein the imaging lens (2), the digital micromirror chip (3), the collimating lens (4), the dispersion element (5), the converging lens (6), the spectrum-polarization regulator (7) and the photodetector (8) are arranged in sequence along the propagation direction of the signal light.

3. A spectral polarization multi-mode composite imaging method, characterized in that: The spectral polarization multi-mode composite imaging system according to claim 1 or 2 comprises the following steps: The user selects one of seven modes: push-broom spectral imaging, staring spectral imaging, transformation spectral imaging, snapshot spectral imaging, push-broom spectral polarization imaging, transformation spectral polarization imaging, and snapshot spectral polarization imaging; If the push-broom spectral imaging is selected, the push-broom spectral imaging method is executed to obtain an imaging result; If staring spectral imaging is selected, the staring spectral imaging method is executed to obtain an imaging result; If transform spectral imaging is selected, the transform spectral imaging method is executed to obtain an imaging result; If snapshot spectral imaging is selected, a snapshot spectral imaging method is executed to obtain an imaging result; If push-broom spectral polarization imaging is selected, the push-broom spectral polarization imaging method is executed to obtain an imaging result; If the transformation spectral polarization imaging is selected, the transformation spectral polarization imaging method is executed to obtain the imaging result; If snapshot spectral polarization imaging is selected, the snapshot spectral polarization imaging method is executed to obtain an imaging result.

4. A push-broom spectral imaging method, characterized in that: The spectral polarization multi-mode composite imaging system according to claim 1 or 2 comprises the following steps: S11: adjusting the rotation angle of the output shaft of the motor (7-1) by the control device (9) so that the broadband filter device is located on the propagation path of the signal light of the target imaging scene (1); S12: Select multiple micromirror columns of the digital micromirror chip (3), and divide the multiple micromirror columns into a plurality of column units; S13: using the control device (9) to control the light transmission of each column of units, and obtaining the corresponding dispersion spectrum image of each column of units when the light is transmitted through the photoelectric detector (8); S14: All the dispersion spectrum images obtained in step S13 are stored in a BIL format, and then the BIL format is converted into a BSQ format by extracting the spectral information of the spatial position to represent the spatial distribution of the target imaging scene (1) in different bands to obtain an imaging result.

5. A staring spectral imaging method, characterized in that: The spectral polarization multi-mode composite imaging system according to claim 1 or 2 comprises the following steps: S21: selecting a plurality of micromirror columns of the digital micromirror chip (3), dividing the plurality of micromirror columns into a plurality of column units, and then controlling all the column units to pass light through the control device (9); S22: adjusting the rotation angle of the output shaft of the motor (7-1) by the control device (9) so as to respectively position each narrowband filter device on the propagation path of the signal light, and obtaining a corresponding dispersion spectrum image by the photodetector (8) when each narrowband filter device is located on the propagation path of the signal light; S23: Convert all the dispersion spectrum images obtained in step S22 into BSQ format to obtain imaging results.

6. A transform spectral imaging method, characterized in that: The spectral polarization multi-mode composite imaging system according to claim 1 or 2 comprises the following steps: S31: adjusting the rotation angle of the output shaft of the motor (7-1) by the control device (9) so that the broadband filter device is located on the propagation path of the signal light of the target imaging scene (1); S32: selecting a plurality of micromirror columns of the digital micromirror chip (3), and dividing the plurality of micromirror columns into a plurality of column units; S33: Set the order of the binary domain to be a non-singular matrix with the number of column elements obtained in step S32, and let i The transformation matrix j The values of all elements in the column are equal to the non-singular matrix i Rank j The element values of the column are used to generate a transformation matrix with the same number of column elements as that obtained in step S32; S34: controlling the states of all micromirrors in the column units obtained in step S32 according to each of the transformation matrices through the control device (9), and obtaining the dispersion spectrum image corresponding to each of the transformation matrices through the photodetector (8); S35: using a format conversion formula to convert all the dispersion spectrum images obtained in step S34 into a spectrum data cube in BIL format to obtain an imaging result.

7. A snapshot spectral imaging method, characterized in that: The spectral polarization multi-mode composite imaging system according to claim 1 or 2 comprises the following steps: S41: adjusting the rotation angle of the output shaft of the motor (7-1) by the control device (9) so that the broadband filter device is located on the propagation path of the signal light of the target imaging scene (1); S42: selecting a plurality of micromirror rows and a plurality of micromirror columns of the digital micromirror chip (3) to obtain a working area; S43: constructing a coding matrix on the binary domain that is adapted to the working area selected in step S42 and satisfies the constraint equidistance condition, and controlling the states of all micromirrors in the working area according to the coding matrix through the control device (9); S44: obtaining a dispersion spectrum image through a photodetector (8); S45: Determine whether the number of currently acquired dispersion spectrum images is equal to a specified value. If yes, proceed to the next step; If not, then go back to step S43; S46: Using all the currently acquired dispersion spectral images, the spectral data cube reconstruction method is modeled as a least squares estimation problem with a regularization term; S47: Solve the least squares estimation problem to obtain a spectral data cube estimation value distribution, and use the spectral data cube estimation value distribution as an imaging result.

8. A push-broom spectral polarization imaging method, characterized in that: The spectral polarization multi-mode composite imaging system according to claim 1 or 2 comprises the following steps: S51: adjusting the rotation angle of the output shaft of the motor (7-1) by the control device (9) so that one of the linear polarization filter elements is located on the propagation path of the signal light of the target imaging scene (1); S52: Select multiple micromirror columns of the digital micromirror chip (3), and divide the multiple micromirror columns into a plurality of column units; S53: controlling the light transmission of each column of units through the control device (9), and obtaining the corresponding dispersion spectrum image of each column of units when the light is transmitted through the photoelectric detector (8); S54: storing all the dispersion spectrum images obtained in step S53 in a BIL format, and then converting the BIL format into a BSQ format by extracting the spectrum information of the spatial position to represent the spatial distribution of the target imaging scene (1) in different bands; S55: Determine whether all linear polarization filter devices on the turntable (7-2) have been traversed. If yes, proceed to the next step; If not, the control device (9) is used to adjust the rotation angle of the output shaft of the motor (7-1) so that the next linear polarization filter element is located on the propagation path of the signal light of the target imaging scene (1), and then the step S52 is executed again; S56: Cluster all currently acquired dispersion spectrum images in the BSQ format according to polarization channels to obtain spectrum data cubes under different polarization states, and obtain imaging results.

9. A transformation-type spectral polarization imaging method, characterized in that: The spectral polarization multi-mode composite imaging system according to claim 1 or 2 comprises the following steps: S61: adjusting the rotation angle of the output shaft of the motor (7-1) by the control device (9) so that one of the linear polarization filter elements is located on the propagation path of the signal light of the target imaging scene (1); S62: Select multiple micromirror columns of the digital micromirror chip (3), and divide the multiple micromirror columns into a plurality of column units; S63: Set the order of the binary domain to be a non-singular matrix with the number of column elements obtained in step S62, and let i The transformation matrix j The values of all elements in the column are equal to the non-singular matrix i Rank j The element values of the column are used to generate a transformation matrix with the same number of column elements as that obtained in step S62; S64: controlling the states of all micromirrors in the column units obtained in step S62 according to each of the transformation matrices through the control device (9), and obtaining the dispersion spectrum image corresponding to each of the transformation matrices through the photodetector (8); S65: Determine whether all linear polarization filter devices on the turntable (7-2) have been traversed. If yes, proceed to the next step; If not, the control device (9) is used to adjust the rotation angle of the output shaft of the motor (7-1) so that the next linear polarization filter element is located on the propagation path of the signal light of the target imaging scene (1), and then the step S62 is executed again; S66: Clustering all currently acquired dispersion spectrum images according to polarization channels to obtain spectrum data cubes under different polarization states, and obtaining imaging results.

10. A snapshot spectral polarization imaging method, characterized in that: The spectral polarization multi-mode composite imaging system according to claim 1 or 2 comprises the following steps: S71: adjusting the rotation angle of the output shaft of the motor (7-1) by the control device (9) so that one of the linear polarization filter elements is located on the propagation path of the signal light of the target imaging scene (1); S72: Selecting a plurality of micromirror rows and a plurality of micromirror columns of the digital micromirror chip (3) to obtain a working area; S73: constructing a coding matrix on the binary domain that is compatible with the working area selected in step S72 and satisfies the constraint equidistance condition, and controlling the states of all micromirrors in the working area according to the coding matrix through the control device (9); S74: obtaining a dispersion spectrum image through a photodetector (8); S75: Determine whether all linear polarization filter devices on the turntable (7-2) have been traversed. If yes, proceed to the next step; If not, the control device (9) is used to adjust the rotation angle of the output shaft of the motor (7-1) so that the next linear polarization filter element is located on the propagation path of the signal light of the target imaging scene (1), and then the step S72 is executed again; S76: Clustering all currently acquired dispersion spectrum images according to polarization channels to obtain spectrum data cubes under different polarization states, and obtaining imaging results.

Images