Snapshot type visible light field-infrared spectrum high-resolution imager

Abstract

The invention relates to the technical field of optical imaging, in particular to a snapshot type visible light field-infrared spectrum high-resolution imager, which is characterized in that a target is subjected to beam shrinkage and collimation by a front Cassegrain system and then is respectively reflected and transmitted to a visible light field imaging system and an infrared spectrum imaging system through a beam splitter; through organic fusion of an infrared interference imaging spectrum technology and a visible light field imaging technology, multi-dimensional data cubes of a target can be obtained at the same time so as to realize real-time infrared detection of a fast changing target, a decoupling process of light field information and spectrum information is avoided, and complexity is reduced.

Description

Technical Field

[0001] The invention relates to the technical field of optical imaging, and in particular provides a snapshot type visible light field-infrared spectrum high-resolution imager. Background Art

[0002] Light field spectral imaging technology organically integrates light field imaging technology with spectral imaging technology to achieve full optical information of the target (seven-dimensional light field data ( x , y , z , θ , φ , λ , t ) detection and reconstruction has broad application space in biomedicine, target recognition, particle image velocimetry and environmental monitoring.

[0003] At present, light field spectral imaging technology mainly includes multi-angle scanning of the target, using a detector array to detect all-optical information, or introducing a light field imaging structure into an imaging spectrometer, and is mainly used in the visible light band. Among them, the technology of realizing all-optical information detection by multi-angle scanning of the target, such as the Ben-Gurion University of Israel in 2016, which scanned the liquid crystal compression hyperspectral imaging system in the horizontal plane along the direction perpendicular to the optical axis of the system, collected hyperspectral images at different positions with equal spacing to reconstruct the target's four-dimensional stereoscopic imaging spectrum. This type of technology has a long scanning time and poor stability due to its multi-angle scanning, and cannot detect rapidly changing targets in real time. The technology of realizing all-optical information detection by using multiple detectors and detector arrays, such as the multi-spectral light field imaging technology based on a multi-camera array proposed by Nanjing University in 2017, uses multiple cameras with different bandwidth filters to capture multi-spectral light field information. This type of technology is based on a detector array, resulting in a complex structure, data redundancy, high cost, and difficulty in lightweighting. In 2017, the University of Science and Technology of China proposed a snapshot hyperspectral light field imager that uses two cameras to obtain part of the light field information. The system consists of a light field camera and a coded aperture snapshot spectral imager (CASSI). The two branches are co-located through a beam splitter and calibrated in space, angle, and spectral dimensions. The RGB light field obtained by the light field camera contains the angle information of the scene, and the compressed measurement obtained by the coded aperture snapshot spectral imager encodes the hyperspectral information of the scene. The two complement each other to obtain a 5D hyperspectral light field with high angular resolution and spectral resolution. Although this system realizes snapshot detection of light field spectral imaging information, it cannot take into account the advantages of infrared detection. The technology of introducing light field imaging structure into imaging spectrometers, such as Harbin Institute of Technology in 2018, introduced the focused light field imaging structure into the snapshot hyperspectral imaging Fourier transform spectrometer, using a single detector to obtain the seven-dimensional light information of the target. Although this type of technology avoids the problems of the above two types of technologies, it is difficult to realize infrared band detection due to technical limitations. In addition, this type of technology collects multiple information dimensions on a single detector, and its back-end decoupling processing is difficult due to the existence of system errors.

[0004] In the existing scheme, the target's light field information is detected by scanning at multiple angles. Since the detection process requires scanning, the detection real-time performance is low and the stability cannot be well guaranteed. For the technology of using detector arrays to detect light field information, the cost is high due to the large number of detectors, and it is difficult to achieve lightweight design. This type of system is sensitive to environmental changes, the amount of data collected is also large, and the amount of calculation in the post-processing process is huge. As for the method of introducing light field imaging technology into snapshot spectral imaging technology, its technical principle is limited, the main working band is the visible light band, and the subsequent data processing is relatively complex. Summary of the invention

[0005] In order to solve the above problems, the present invention provides a snapshot visible light field-infrared spectrum high-resolution imager, which can simultaneously obtain multi-dimensional data cube of the target by organically integrating infrared interference imaging spectrum technology with visible light field imaging technology, so as to realize real-time infrared detection of rapidly changing targets, avoid the decoupling process of light field information and spectrum information, and reduce complexity.

[0006] The present invention provides a snapshot type visible light field-infrared spectrum high-resolution imager, comprising a coaxial reflection collimation system, a beam splitter, a visible light field imaging system and an infrared spectrum imaging system, wherein: The coaxial reflection collimation system comprises an entrance pupil 1 and a front Cassegrain collimation system; The visible light field imaging system comprises a light field camera imaging lens, a microlens array and a visible light detector; The infrared spectrum imaging system comprises an aperture array, a lens array, a light beam splitter and a compensation plate, a high-step multi-level micro-reflector, a low-step multi-level micro-reflector, a relay imaging system, and an infrared detector; The target enters the pre-Cassegrain collimation system from the entrance pupil 1, the pre-Cassegrain collimation system performs beam reduction and collimation on the object plane of the target, the beam splitter reflects the visible light of the target to the visible light field imaging system, and transmits the infrared light of the target to the infrared spectrum imaging system, the light field camera imaging lens focuses the visible light reflected by the beam splitter onto the microlens array, and images the light field information of the target onto the visible light detector; The aperture array and the lens array converge the transmitted infrared light imaging channels, and image them on the reflective surfaces of the high-step multi-level micro-reflector and the low-step multi-level micro-reflector through the lightweight beam splitter and the compensation plate, and phase modulate the infrared imaging of the target to obtain an infrared interference image array carrying spectral information. The infrared interference image array is coupled to the rear focal plane of the infrared detector by the relay imaging system, and the spectral information of the target is reconstructed through the infrared interference image array.

[0007] As a preferred solution, the light field camera imaging lens includes a primary imaging objective lens, a primary image plane, and a light field camera imaging objective lens. The primary imaging objective lens images the target once, and the primary image plane is located within the working distance of the visible light field imaging system. The light field camera imaging objective lens, the microlens array, and the visible light field detector constitute a non-focused visible light field imaging system, which performs light field imaging on the target and images the light field information of the target onto the visible light detector.

[0008] As a preferred solution, the front Cassegrain collimation system adopts a telecentric design, the primary imaging objective lens adopts a telecentric design, the target is imaged at the working distance of the visible light field imaging system, the light field camera imaging objective lens adopts a double telecentric design, the microlens array is placed at the focal plane of the light field camera imaging objective lens, and the detection depth range of the light field imaging part is for: (1) In the formula is the depth range, is the microlens diameter, is the focal length of the microlens, that is, the distance from the microlens to the primary relay image plane, It is the minimum resolvable size of a single-relay image.

[0009] As a preferred solution, when the number of pixels of the visible light detector is Q×Q, the number of the microlens array is No × No When the spatial resolution of the light field imaging is Q / No ×Q / No .

[0010] As a preferred solution, the aperture array is placed at the front focal plane of the lens array, and the number of the aperture array is N × N , the lens array is an image-side telecentric system, and the number of the lens array is N × N , the primary relay image plane is imaged with multiple aperture channels in a static interferometer system.

[0011] As a preferred solution, the lens array is arranged in a two-dimensional square, each lens unit is square, the duty cycle is 100%, and the size is d l × d l ,like d l = k × d m , then the light field imaging resolution is k × k .

[0012] As a preferred solution, the height of the low-step micro-reflector is , the height of the high-step micro-reflector is The high-step micro-reflector and the low-step micro-reflector are symmetrically placed about the beam splitter, and the high-step micro-reflector and the low-step micro-reflector form Phase modulation unit, each light field imaging unit is phase modulated by the corresponding light field interference image array, which contains the complete three-dimensional spatial distribution information and spectral information of the target, where the spectral sampling point is N 2 The multidimensional data cube of the snapshot visible light field-infrared spectrum high-resolution imager is Q / No ×Q / No ×P / No ×P / No × N 2 .

[0013] As a preferred solution, define is the step order of the high-step micro-reflector, is the step order of the low-step micro-reflector, For the High-step micro-mirrors and The phase modulation unit formed by the low-step micro-reflector has a modulated optical path difference. .

[0014] As a preferred solution, the relay imaging system couples the infrared interference image array to the rear focal plane of the infrared detector, the relay imaging system adopts an object-space telecentric optical path design, and the relay imaging system adopts an achromatic and athermal design.

[0015] As a preferred solution, all-optical information Probe, depth information z The incident angle of the light Refactoring; Establishing a four-dimensional light field of the microlens array and the visible light detector The mathematical matrix transfer model of is the focal plane coordinate of the detector, is the target principal surface coordinate, For the coordinates of the sub-microlenses on the microlens array, the coaxial space translation, rotation transformation matrix and off-axis space translation transformation matrix are derived, the microlens light field sampling model is established, the microlens mapping detection area is divided, the geometric correspondence between the target point and the pixel point is determined, the light field radiation model is established, and the image point light intensity of each matrix coordinate is obtained.

[0016] The present invention provides a snapshot type visible light field-infrared spectrum high-resolution imager, wherein a target main surface is collimated by a front Cassegrain system and then respectively reflected and transmitted to a visible light field imaging system and an infrared spectrum imaging system through a beam splitter, wherein the visible light field imaging system comprises a light field camera imaging lens and a microlens array, and the light field camera imaging objective lens focuses the light reflected from the beam splitter onto the microlens array, and images the light field information onto a visible light detector. The infrared spectral imaging system includes an aperture array, a lens array, a light beam splitter, a low-step micro-reflector, and a high-step micro-reflector. The infrared light transmitted by the beam splitter enters the infrared spectral imaging system, passes through the aperture array and the lens array, and is reflected and transmitted by the light beam splitter and the compensation plate respectively, and is imaged on the reflective surfaces of the high-step micro-reflector and the low-step micro-reflector in the form of an image array, and is then transmitted and reflected by the light beam splitter respectively, and is imaged on the infrared detector through the relay imaging system. By organically integrating the infrared interferometric imaging spectroscopy technology with the visible light field imaging technology, the multi-dimensional data cube of the target can be obtained simultaneously to realize real-time infrared detection of rapidly changing targets, avoid the decoupling process of light field information and spectral information, and reduce complexity. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 is a schematic structural diagram of a snapshot type visible light field-infrared spectrum high-resolution imager provided according to an embodiment of the present invention; Figure 2 This is a schematic diagram of the non-focused light field imaging principle of a snapshot type visible light field-infrared spectrum high-resolution imager provided according to an embodiment of the present invention; Figure 3 It is a schematic diagram of the optical path of the multiple interference imaging part of the snapshot type visible light field-infrared spectrum high-resolution imager provided in an embodiment of the present invention; Figure 4 It is a schematic diagram of reconstructing depth information by using a scale-depth space transformation algorithm based on a four-dimensional light field data cube of a snapshot type visible light field-infrared spectrum high-resolution imager provided according to an embodiment of the present invention.

[0018] Reference numerals include: Entrance pupil 1, front Cassegrain collimation system 2, beam splitter 3, primary imaging objective 4, primary image plane 5, light field camera imaging objective 6, microlens array 7, visible light detector 8, aperture array 9, lens array 10, lightweight beam splitter and compensation plate 11, high-step multi-level micro-mirror 12, low-step multi-level micro-mirror 13, relay imaging system 14, infrared detector 15. DETAILED DESCRIPTION

[0019] Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. In the following description, the same modules are represented by the same reference numerals. In the case of the same reference numerals, their names and functions are also the same. Therefore, the detailed description thereof will not be repeated.

[0020] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and do not constitute a limitation of the present invention.

[0021] Combination Figure 1 As shown, a snapshot type visible light field-infrared spectrum high-resolution imager is provided in an embodiment of the present invention, including a coaxial reflection collimation system, a beam splitter 3, a visible light field imaging system and an infrared spectrum imaging system, wherein: The beam splitter 3 reflects and refracts the visible light band and infrared band of the detection target to the visible light field imaging part and the multiple interference imaging part respectively; The coaxial reflection collimation system comprises an entrance pupil 1 and a front Cassegrain collimation system 2; The visible light field imaging system comprises a light field camera imaging lens, a microlens array 7 and a visible light detector 8; The infrared spectrum imaging system includes an aperture array 9, a lens array 10, a light beam splitter and compensation plate 11, a high-step multi-level micro-reflector 12, a low-step multi-level micro-reflector 13, a relay imaging system 14, and an infrared detector 15; The target enters the pre-Cassegrain collimation system 2 from the entrance pupil 1, the pre-Cassegrain collimation system 2 performs beam reduction and collimation on the object plane of the target, the beam splitter 3 reflects the visible light of the target to the visible light field imaging system, and transmits the infrared light of the target to the infrared spectrum imaging system, the light field camera imaging lens focuses the visible light reflected by the beam splitter 3 to the microlens array 7, and images the light field information of the target onto the visible light detector 8; The aperture array 9 and the lens array 10 converge the transmitted infrared light imaging channels, and image them on the reflective surfaces of the high-step multi-level micro-reflector 12 and the low-step multi-level micro-reflector 13 through the lightweight beam splitter and the compensation plate 11, and phase modulate the infrared imaging of the target to obtain an infrared interference image array carrying spectral information. The infrared interference image array is coupled to the rear focal plane of the infrared detector 15 by the relay imaging system 14, and the spectral information of the target is reconstructed through the infrared interference image array.

[0022] The present invention provides a snapshot type visible light field-infrared spectrum high-resolution imager, wherein the target main surface is collimated by a front Cassegrain system and then respectively reflected and transmitted to a visible light field imaging system and an infrared spectrum imaging system through a beam splitter 3, wherein the visible light field imaging system comprises a light field camera imaging lens and a microlens array 7, and the light field camera imaging objective lens 6 focuses the light reflected by the beam splitter onto the microlens array 7, and images the light field information onto a visible light detector 8. The infrared spectral imaging system includes an aperture array 9, a lens array 10, a light beam splitter, a low-step micro-reflector, and a high-step micro-reflector. The infrared light transmitted by the beam splitter enters the infrared spectral imaging system, passes through the aperture array 9 and the lens array 10, is reflected and transmitted by the light beam splitter and the compensation plate 11 respectively, and is imaged on the reflection surfaces of the high-step micro-reflector and the low-step micro-reflector in the form of an image array, and is then transmitted and reflected by the light beam splitter respectively, and is imaged on the infrared detector 15 through the relay imaging system 14. By organically integrating the infrared interference imaging spectroscopy technology with the visible light field imaging technology, the multi-dimensional data cube of the target can be obtained simultaneously to realize real-time infrared detection of rapidly changing targets, avoid the decoupling process of light field information and spectral information, and reduce complexity.

[0023] In some embodiments, the light field camera imaging lens includes a primary imaging objective lens 4, a primary image plane 5, and a light field camera imaging objective lens 6. The primary imaging objective lens 4 images the target once. The primary image plane 5 is located within the working distance of the visible light field imaging system. The light field camera imaging objective lens 6, the microlens array 7, and the visible light field detector constitute a non-focused visible light field imaging system, which performs light field imaging on the target and images the light field information of the target onto the visible light detector 8.

[0024] In some embodiments, the front Cassegrain collimation system 2 adopts a telecentric design, and through a reflective collimation method, it ensures the joint detection of the visible light band and the infrared light band. The one-shot imaging objective 4 adopts a telecentric design, and images the target at the working distance of the visible light field imaging system. The detection requirements of different distances can be matched by replacing the one-shot imaging objective 44. The light field camera imaging objective 6 adopts a double telecentric design, and the microlens array 7 is placed at the focal plane of the light field camera imaging objective 6. The detection depth range of the light field imaging part for: (1) In the formula is the depth range, is the microlens diameter, is the focal length of the microlens, that is, the distance from the microlens to the primary relay image plane, It is the minimum resolvable size of a single-relay image.

[0025] In some embodiments, when the number of pixels of the visible light detector 8 is Q×Q, the number of the microlens array 7 is No × Not when , the spatial resolution of the light field imaging is Q / No ×Q / No .

[0026] In some embodiments, the aperture array 9 is placed at the front focal plane of the lens array 10, and the number of the aperture array 9 is N × N , the lens array 10 is an image-side telecentric system, and the number of the lens array 10 is N × N , the primary relay image plane is imaged with multiple aperture channels in a static interferometer system.

[0027] In some embodiments, the lens array 10 is arranged in a two-dimensional square, each lens unit is square, the duty cycle is 100%, and the size is d l × d l ,like d l = k × d m , then the light field imaging resolution is k × k .

[0028] In some embodiments, the low-step micro-mirror height is , the height of the high-step micro-reflector is The high-step micro-reflector and the low-step micro-reflector are symmetrically placed about the beam splitter, and the high-step micro-reflector and the low-step micro-reflector form Phase modulation unit, each light field imaging unit is phase modulated by the corresponding light field interference image array, which contains the complete three-dimensional spatial distribution information and spectral information of the target, where the spectral sampling point is N 2 The multidimensional data cube of the snapshot visible light field-infrared spectrum high-resolution imager is Q / No ×Q / No ×P / No ×P / No × N 2 .

[0029] In some embodiments, the definition is the step order of the high-step micro-reflector, is the step order of the low-step micro-reflector, For the High-step micro-mirrors and The phase modulation unit formed by the low-step micro-reflector has a modulated optical path difference. .

[0030] In some embodiments, the relay imaging system 14 couples the infrared interference image array to the rear focal plane of the infrared detector 15, the relay imaging system 14 adopts an object-space telecentric optical path design, and the relay imaging system 14 adopts an achromatic and athermal design.

[0031] In some embodiments, the full optical information Probe, depth information z The incident angle of the light Refactoring; Establishing the four-dimensional light field of the microlens array 7 and the visible light detector 8 The mathematical matrix transfer model of is the focal plane coordinate of the detector, is the target principal surface coordinate, The coordinates of the sub-microlenses on the microlens array 7 are derived, the coaxial space translation, rotation transformation matrix and the off-axis space translation transformation matrix are derived, the microlens light field sampling model is established, the microlens mapping detection area is divided, the geometric correspondence between the target point and the pixel point is determined, the light field radiation model is established, and the image point light intensity of each matrix coordinate is obtained.

[0032] In some embodiments, the light beam splitter and compensation plate 11 split the incident light field into light paths for phase modulation. If the number of detector pixels is P×P, the angular resolution of the light field imaging is P / No ×P / No .

[0033] In some embodiments, The high-step micro-reflectors are placed orthogonally, and the height of the low-step micro-reflectors is To satisfy the principle of complementary optical path difference, the height of the high-step micro-reflector is The two-step micro-reflector is placed symmetrically about the beam splitter, and the two-step micro-reflector forms Phase modulation unit, each light field imaging unit is phase modulated by the corresponding light field interference image array, which contains the complete three-dimensional spatial distribution information and spectral information of the target, where the spectral sampling point is N 2 The multidimensional data cube of the snapshot visible light field-infrared spectrum high-resolution imager is Q / No ×Q / No ×P / No ×P / No × N 2 .definition is the step order of the high-step micro-reflector, is the step order of the low-step micro-reflector, For the High-step micro-mirrors and The phase modulation unit formed by the low-step micro-reflector has a modulated optical path difference. .

[0034] In some embodiments, the relay imaging system 14 couples the interference image array to the rear focal plane of the infrared detector 15, the relay imaging system 14 adopts an object-side telecentric optical path design, and the relay imaging system 14 adopts an achromatic and athermal design.

[0035] In some embodiments, the full optical information Probe, depth information z The incident angle of the light Refactoring.

[0036] Combination Figure 2 As shown, in order to achieve accurate positioning of each pixel and detection of light field intensity, a four-dimensional light field of the microlens array 7 and the visible light detector 8 is established. The mathematical matrix transfer model of is the focal plane coordinate of the detector, is the target principal surface coordinate, is the coordinate of the sub-microlens on the microlens array 7. The coaxial space translation, rotation transformation matrix and off-axis space translation transformation matrix are derived, the microlens light field sampling model is established, and the microlens mapping detection area is divided. The geometric correspondence between the target point and the pixel point can be determined, and the light field radiation model can be established to obtain the image point intensity of each matrix coordinate. In order to reconstruct the depth information of the target point, the scale-depth transformation algorithm is used to cube the four-dimensional light field data of the interference channel image unit. Perform a deep reconstruction.

[0037] Combination Figure 3 As described above, the figure shows the principle of multiple interference imaging. The problem of optical information crosstalk between spectral channels is solved by the aperture array 9. The target is collimated by the pre-Cassegrain collimation system 2 and the beam splitter 3, and then passes through the aperture array 9 and the lens array 10 in turn to obtain multiple imaging with different apertures. The image-side telecentric design is performed on each interference channel to achieve equal optical path difference modulation of the main light of each field of view. When all optical information is ignored When the detector temporal resolution changes and light blocking and loss are ignored, the full light function is , the light intensity distribution of the light field interference image array is derived as follows: (2) In the formula, P is the plenoptic function, is the light propagation angle, is the wavelength, for The sampling optical path difference of the interferometric channel of the coordinate, .

[0038] In some embodiments, the light field interference image intensity distribution can be further expressed as: (3) In the formula is the target four-dimensional light field data cube, Calculation derivation, The image spectral data cube of the target.

[0039] Combination Figure 4 As shown in the figure, the depth information is reconstructed based on the scale-depth space transformation algorithm based on the four-dimensional light field data cube. Intercept or The slice is an extreme plane image EPI, and the parallax relationship between the tilt angle of the linear structure in EPI and the sub-image is: (4) In the formula, D is the disparity between the top and bottom sub-images in the sub-image array where the polar plane image is located, Q for y The number of sub-images in the axis direction, p is the pixel size, β is the inclination angle of the linear structure.

[0040] Furthermore, in order to reconstruct the parallax, a scale-depth space with scale-invariant and rotation-invariant properties is constructed through the ray-Gaussian convolution kernel, and extreme points are found in the space. The ray-Gaussian convolution kernel is (5) in is the scale parameter of the convolution kernel, is the angle parameter of the convolution kernel.

[0041] In some embodiments, to achieve a denser target scene depth map, the light field scale-depth space (Lisad-2) is constructed by the normalized second-order derivative of the ray-Gaussian convolution kernel to achieve parallax reconstruction of non-edge feature rays (Lisad-1 achieves parallax reconstruction of edge feature rays). To achieve spectral reconstruction, the interference sequence composed of the same-name image points of each image unit is extracted as follows: (6) In the formula, X For the sub-image array along u The number of sub-images in the axis direction,Q For the sub-image array along v The number of sub-images in the axial direction. The spectrum curve can be reconstructed by Fourier transforming the interference intensity sequence.

[0042] In some embodiments, the visible light field image-infrared spectrum image fusion process fuses the visible light field image and the infrared spectrum image according to the NSCT algorithm. The two images are registered, the infrared spectrum image is smoothed and filtered, the visible light field image and the infrared spectrum image are decomposed into high-frequency information and low-frequency information, and the fusion is performed using appropriate fusion rules.

[0043] The present invention can achieve the following technical effects: 1. The present invention organically integrates visible light field imaging technology with infrared multiple interference spectral imaging technology, overcoming the common problems of existing light field spectral imaging technology based on multi-angle scanning or multiple detectors and detector arrays, such as long scanning time, complex structure, difficulty in assembly and adjustment, difficulty in lightweighting, and high cost. A snapshot visible light field-infrared spectral imager is proposed, which realizes snapshot detection and information reconstruction of multi-dimensional optical information, ensures high resolution through the visible light field imaging part, and takes into account the advantages of infrared detection.

[0044] 2. The snapshot visible light field-infrared spectrum imager proposed in the present invention adopts a static interference system to improve the stability of interference spectrum information sampling and reduce the volume and weight of the system.

[0045] 3. The snapshot visible light field-infrared spectrum imager proposed in the present invention has a spectral detection band that can cover the entire infrared band, reflects the thermal radiation characteristics of the target, is less affected by the environment, is easy to detect and identify hidden targets, and the characteristic peaks of the infrared band are densely distributed, and have a wide range of applications.

[0046] 4. The snapshot visible light field-infrared spectrum imager proposed in the present invention can obtain a light field interference image array, and through deep reconstruction and atlas data processing combined with visible light field and infrared spectrum image fusion technology, three-dimensional stereo atlas data information of the target can be obtained.

[0047] 5. The snapshot visible light field-infrared spectrum imager proposed in the present invention is connected through a beam splitter and can be independently designed. In addition, the design difficulty, processing difficulty and assembly difficulty are greatly reduced when the processing accuracy requirement is met.

[0048] Although the embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and cannot be understood as limiting the present invention. Those skilled in the art may change, modify, replace and modify the above embodiments within the scope of the present invention.

[0049] The above specific implementations of the present invention do not constitute a limitation on the protection scope of the present invention. Any other corresponding changes and modifications made based on the technical concept of the present invention should be included in the protection scope of the claims of the present invention.

Claims

1. A snapshot visible light field-infrared spectrum high-resolution imager, characterized in that: It includes a coaxial reflection collimation system, a beam splitter, a visible light field imaging system and an infrared spectrum imaging system, wherein: The coaxial reflection collimation system includes an entrance pupil and a front Cassegrain collimation system; The visible light field imaging system comprises a light field camera imaging lens, a microlens array and a visible light detector; The infrared spectrum imaging system comprises an aperture array, a lens array, a light beam splitter and a compensation plate, a high-step multi-level micro-reflector, a low-step multi-level micro-reflector, a relay imaging system, and an infrared detector; The target enters the pre-Cassegrain collimation system from the entrance pupil, the pre-Cassegrain collimation system performs beam reduction and collimation on the object plane of the target, the beam splitter reflects the visible light of the target to the visible light field imaging system, and transmits the infrared light of the target to the infrared spectrum imaging system, the light field camera imaging lens focuses the visible light reflected by the beam splitter onto the microlens array, and images the light field information of the target onto the visible light detector; The aperture array and the lens array converge the transmitted infrared light imaging channels, and image them on the reflective surfaces of the high-step multi-level micro-reflector and the low-step multi-level micro-reflector through the lightweight beam splitter and the compensation plate, and phase modulate the infrared imaging of the target to obtain an infrared interference image array carrying spectral information. The infrared interference image array is coupled to the rear focal plane of the infrared detector by the relay imaging system, and the spectral information of the target is reconstructed through the infrared interference image array.

2. The snapshot visible light field-infrared spectrum high-resolution imager according to claim 1, characterized in that: The light field camera imaging lens includes a primary imaging objective lens, a primary image plane, and a light field camera imaging objective lens. The primary imaging objective lens performs a primary imaging on the target. The primary image plane is located within the working distance of the visible light field imaging system. The light field camera imaging objective lens, the microlens array, and the visible light field detector constitute a non-focused visible light field imaging system, perform light field imaging on the target, and image the light field information of the target onto the visible light detector.

3. The snapshot visible light field-infrared spectrum high-resolution imager as claimed in claim 2, characterized in that: The front Cassegrain collimation system adopts a telecentric design, the primary imaging objective adopts a telecentric design, and the target is imaged at the working distance of the visible light field imaging system. The light field camera imaging objective adopts a double telecentric design, and the microlens array is placed at the focal plane of the light field camera imaging objective. The detection depth range of the light field imaging part for: (1) In the formula is the depth range, is the microlens diameter, is the focal length of the microlens, that is, the distance from the microlens to the primary relay image plane, It is the minimum resolvable size of a single-relay image.

4. The snapshot visible light field-infrared spectrum high-resolution imager as claimed in claim 3, characterized in that: When the number of pixels of the visible light detector is Q×Q, the number of the microlens array is Ne × Ne , the spatial resolution of the light field imaging is Q / Ne ×Q / Ne .

5. The snapshot visible light field-infrared spectrum high-resolution imager according to claim 1, characterized in that: The aperture array is placed at the front focal plane of the lens array, and the number of the aperture array is N × N , the lens array is an image-side telecentric system, and the number of the lens array is N × N , the primary relay image plane is imaged with multiple aperture channels in a static interferometer system.

6. The snapshot visible light field-infrared spectrum high-resolution imager according to claim 1 or 5, characterized in that: The lens array is arranged in a two-dimensional square, each lens unit is square, the duty cycle is 100%, and the size is d l × d l ,like d l = k × d m , then the light field imaging resolution is k × k .

7. The snapshot visible light field-infrared spectrum high-resolution imager according to claim 1 or 5, characterized in that: The height of the low-step micro-reflector is , the height of the high-step micro-reflector is The high-step micro-reflector and the low-step micro-reflector are symmetrically placed about the beam splitter, and the high-step micro-reflector and the low-step micro-reflector form Phase modulation unit, each light field imaging unit is phase modulated by the corresponding light field interference image array, which contains the complete three-dimensional spatial distribution information and spectral information of the target, where the spectral sampling point is N 2 The multidimensional data cube of the snapshot visible light field-infrared spectrum high-resolution imager is Q / Ne ×Q / Ne ×P / Ne ×P / Ne × N 2 .

8. The snapshot visible light field-infrared spectrum high-resolution imager according to claim 1 or 5, characterized in that: definition is the step order of the high-step micro-reflector, is the step order of the low-step micro-reflector, For the High-step micro-mirrors and The phase modulation unit formed by the low-step micro-reflector has a modulated optical path difference. .

9. The snapshot visible light field-infrared spectrum high-resolution imager according to claim 1 or 5, characterized in that: The relay imaging system couples the infrared interference image array to the rear focal plane of the infrared detector, the relay imaging system adopts an object-space telecentric optical path design, and the relay imaging system adopts an achromatic and athermal design.

10. The snapshot visible light field-infrared spectrum high-resolution imager according to claim 1, characterized in that: All-optical information Probe, depth information z The incident angle of the light Refactoring; Establishing a four-dimensional light field of the microlens array and the visible light detector The mathematical matrix transfer model of is the focal plane coordinate of the detector, is the target principal surface coordinate, For the coordinates of the sub-microlenses on the microlens array, the coaxial space translation, rotation transformation matrix and off-axis space translation transformation matrix are derived, the microlens light field sampling model is established, the microlens mapping detection area is divided, the geometric correspondence between the target point and the pixel point is determined, the light field radiation model is established, and the image point light intensity of each matrix coordinate is obtained.

Images