Micro-scanning super-resolution reconstruction method and device for interlaced coded infrared polarization image
By using a micro-scanning device and a super-resolution reconstruction method in an infrared polarization imaging system, the problems of low transmittance and insufficient resolution of interlaced coded infrared polarization focal plane detectors are solved, high-resolution infrared intensity and polarization image reconstruction is achieved, and the imaging quality and small target detection capability are improved.
Patent Information
- Application Number
- CN202411811528.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-10
- Publication Date
- 2025-09-23
AI Technical Summary
Existing interlaced coded infrared polarization focal plane detectors have problems such as low transmittance, complex structure, high cost and insufficient resolution, resulting in insufficient imaging quality and information richness, making it difficult to meet the needs of refined imaging.
A micro-scanning device is used to periodically move the projection position of the scene point to collect interlaced encoded infrared polarization image sequences. Horizontal super-resolution infrared intensity images and polarization images are generated through decomposition and reconstruction. Combined with the computational super-resolution reconstruction method, bidirectional super-resolution reconstruction of the image is achieved.
The resolution of the infrared imaging system is improved, making the image resolution four times that of the interlaced coded infrared polarization focal plane detector, enhancing the detection capability of small targets, with complete image detail information, small amount of calculation, good real-time algorithm, and easy hardware implementation.
Smart Images

Figure CN120689202A_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the field of infrared imaging technology, and in particular relates to a micro-scanning super-resolution reconstruction method and device for interlaced coded infrared polarization images. Background Art
[0002] Infrared imaging technology boasts advantages such as all-weather operation, passive operation, and strong penetration. With continuous advancements in infrared detector fabrication and infrared image processing algorithms, the performance of infrared imaging systems is becoming increasingly powerful, leading to their widespread application in daily life, industrial production, and military reconnaissance. However, when the thermal radiation difference between the target and the background is small, the recognition rate of traditional infrared detection systems decreases significantly. Furthermore, traditional infrared imaging technology struggles to withstand infrared countermeasures such as artificial infrared jamming and infrared camouflage. To further enhance infrared detection systems' ability to resist jamming and counter camouflage, infrared polarization imaging detection technology has become a hot topic of research worldwide.
[0003] Existing infrared polarization imaging systems can be divided into time-sharing imaging systems and real-time imaging systems. Emerging real-time imaging systems address the shortcomings of time-sharing imaging systems, which are incapable of imaging dynamic targets and cannot be mounted on moving platforms. This greatly expands the application scenarios of infrared polarization imaging systems. Existing real-time imaging systems include four major categories: channel-based, amplitude-based, aperture-based, and focal-plane-based. Compared to the other three imaging systems, the focal-plane-based system offers advantages such as compact structure, high integration, small size, low power consumption, good compatibility with infrared lenses, and fast real-time imaging. It is suitable for platforms with strict requirements on the size and weight of the imaging system. The focal-plane-based infrared polarization imaging system integrates a micropolarizer array onto an infrared focal plane detector chip, so that each pixel is equipped with a micropolarization grating at a specific angle, forming a polarization pixel array capable of capturing polarization information at a specific angle. Micropolarization gratings of different angles are arranged periodically in the array, enabling the simultaneous acquisition of polarization information at multiple angles.
[0004] The most widely used infrared polarization focal plane detector chip currently uses a micro-polarizer array arrangement that treats each 2×2 pixel as a "super pixel." Each super pixel contains micro-polarizers with polarization grating angles of 0°, 45°, 90°, and 135°. This arrangement results in the resolution of each of the four polarization angles obtained being only one-quarter of the resolution of the infrared focal plane detector chip. This loss of spatial resolution prevents the acquisition of a large amount of detailed information. In addition, this type of infrared polarization focal plane detector has the disadvantages of low transmittance and complex processes, resulting in high mass production costs. These defects reduce the effective detection range of the split focal plane infrared polarization imaging system, and the high cost also hinders the further promotion and application of the split focal plane infrared polarization imaging system.
[0005] The interlaced coded infrared polarization focal plane detector chip (CN118243236A) is designed to overcome the defects of low transmittance and complex structure in conventional micro-polarizer array arrangements. The chip forms interlaced polarization coding samples by making comb-shaped, periodically arranged polarization coding strips on an infrared substrate, which are aligned and packaged onto the photosensitive surface of the infrared imaging focal plane detector chip to form a detector chip with interlaced polarization coding characteristics. Compared with the situation where all pixels on the conventional infrared polarization focal plane detector chip are covered with polarization gratings, resulting in attenuation of the incident light intensity, the polarization coding strips designed with interlaced arrangement make half of the detector pixels not modulated by polarization coding, thereby significantly improving the transmittance; conventional detectors have micro-polarization gratings in two directions in each row and column, while the interlaced coded infrared polarization focal plane detector can use polarization coding strips with single-direction polarization gratings, which greatly simplifies the structural design, makes it easy to use nanoimprinting technology for mass production, and reduces production costs.
[0006] Interlaced coded infrared polarization focal plane detectors (IPFPDs) can simultaneously capture infrared intensity and polarization images. However, due to the interlaced arrangement of the polarization encoding strips, the resolution of these images is only half that of the IPFPD. Furthermore, due to hardware limitations, the resolution of an IPFPD is significantly lower than that of a visible light detector. This further reduction in resolution compromises image detail and information richness. To address this issue, super-resolution reconstruction techniques are needed to enhance the resolution of both intensity and polarization images, thereby improving image quality, compensating for hardware resolution limitations, and meeting the demands for refined imaging. Various computationally based super-resolution reconstruction methods have been proposed for conventional IPFPDs, including interpolation-based reconstruction, image reconstruction-based reconstruction, deep learning-based reconstruction, and frequency domain reconstruction. However, these methods generate reconstructed pixel data computationally, which hinders the ability to reflect true image detail. Furthermore, these algorithms are tied to the encoding scheme of the "micropolarizer" array, making them difficult to port to IPFPDs. Therefore, there is an urgent need to develop a super-resolution reconstruction method specifically suitable for interlaced coded infrared polarization focal plane detectors to effectively improve imaging quality and resolution and achieve more accurate polarization information acquisition and processing. Summary of the Invention
[0007] To address the above-mentioned problems in the prior art, the present invention provides a method and apparatus for micro-scanning super-resolution reconstruction of interlaced encoded infrared polarization images. The technical problems to be solved by the present invention are achieved through the following technical solutions:
[0008] In a first aspect, a micro-scanning super-resolution reconstruction method for interlaced coded infrared polarization images includes:
[0009] S100, constructing a micro-scanning device for changing the projection position of a scene point on an imaging plane;
[0010] S200, using a micro-scanning device to periodically move the projection position of each scene point on the imaging plane, and collect an interlaced coded infrared polarization image at each projection position to obtain a set of interlaced coded infrared polarization image sequences;
[0011] S300, decomposing and reconstructing the set of interlaced coded infrared polarization image sequences into infrared intensity images and infrared polarization images to generate horizontal super-resolution infrared intensity images and horizontal super-resolution infrared polarization images;
[0012] S400, using a computation-based super-resolution reconstruction method, performing vertical super-resolution reconstruction on both the horizontal super-resolution infrared intensity image and the horizontal super-resolution infrared polarization image to obtain a bidirectional super-resolution infrared intensity image and a bidirectional super-resolution infrared polarization image.
[0013] In a second aspect, the present invention provides a micro-scanning super-resolution reconstruction device for interlaced coded infrared polarization images, comprising:
[0014] A construction module is used to construct a micro-scanning device for changing the projection position of a scene point on an imaging plane;
[0015] An acquisition module, which uses a micro-scanning device to periodically move the projection position of each scene point on the imaging plane, acquires an interlaced coded infrared polarization image at each projection position, and obtains a set of interlaced coded infrared polarization image sequences;
[0016] a decomposition module, decomposing and reconstructing the set of interlaced coded infrared polarization image sequences into infrared intensity images and infrared polarization images, to generate horizontal super-resolution infrared intensity images and horizontal super-resolution infrared polarization images;
[0017] The reconstruction module uses a computation-based super-resolution reconstruction method to perform vertical super-resolution reconstruction on both the horizontal super-resolution infrared intensity image and the horizontal super-resolution infrared polarization image.
[0018] Beneficial effects:
[0019] The present invention provides a micro-scanning super-resolution reconstruction method and apparatus for interlaced-coded infrared polarization images. A micro-scanning device is constructed to change the projected position of scene points on an imaging plane. The micro-scanning device is used to acquire a sequence of interlaced-coded infrared polarization images in which the projected positions of a set of scene points are shifted horizontally by half a pixel width and vertically by one pixel height. The acquired interlaced-coded infrared polarization image sequence is then subjected to super-resolution decomposition and reconstruction, and a computationally-based super-resolution reconstruction method is applied to the reconstructed images. Ultimately, a bidirectional super-resolution infrared intensity image and a bidirectional super-resolution infrared polarization image are obtained, achieving a resolution four times that of an interlaced-coded infrared polarization focal plane detector.
[0020] The present invention performs super-resolution decomposition and reconstruction on a sequence of collected interlaced-coded infrared polarization images, producing horizontal super-resolution infrared intensity images and horizontal super-resolution infrared polarization images with a horizontal resolution twice that of the detector. Each point in the image represents actual imaging data of the target scene, effectively resolving the problem that reconstructed data obtained through calculations cannot accurately reflect scene details, thereby improving the detection capability of interlaced-coded infrared polarization imaging systems for small targets. Furthermore, super-resolution reconstruction of the horizontal super-resolution infrared intensity and polarization images involves only image splicing and interpolation calculations between adjacent rows of data. This approach minimizes computational complexity, improves real-time algorithm performance, and facilitates hardware implementation, addressing the shortcomings of current super-resolution reconstruction methods when applied to interlaced-coded infrared polarization focal plane detectors.
[0021] The present invention will be further described in detail below with reference to the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS
[0022] Figure 1 This is a flow chart of a micro-scanning super-resolution reconstruction method for interlaced-coded infrared polarization images proposed in an embodiment of the present invention;
[0023] Figure 2 This is a flow chart of an infrared polarization image sequence collected using a micro-scanning device according to an embodiment of the present invention;
[0024] Figure 3 This is a schematic diagram of the synthesis of an infrared intensity image and an infrared polarization image proposed in an embodiment of the present invention;
[0025] Figure 4 This is a structural diagram of a micro-scanning super-resolution reconstruction device for interlaced encoded infrared polarization images proposed in an embodiment of the present invention. DETAILED DESCRIPTION
[0026] The present invention will be further described in detail below with reference to specific examples, but the embodiments of the present invention are not limited thereto.
[0027] See Figure 1 、 Figure 2 and Figure 3 , Figure 1 This is a flow chart of a micro-scanning super-resolution reconstruction method for interlaced coded infrared polarization images proposed in an embodiment of the present invention. Figure 2 This is a flow chart of using a micro-scanning device to collect an infrared polarization image sequence according to an embodiment of the present invention. Figure 3 This is a schematic diagram of the synthesis of the infrared intensity image and the infrared polarization image proposed in an embodiment of the present invention. Figure 4 The present invention provides a schematic diagram of a micro-scanning super-resolution reconstruction device for interlaced encoded infrared polarization images.
[0028] like Figure 1 As shown, the present invention provides a micro-scanning super-resolution reconstruction method for interlaced coded infrared polarization images, comprising:
[0029] S100, constructing a micro-scanning device for changing the projection position of a scene point on an imaging plane;
[0030] The micro-scanning device is installed in an infrared polarization imaging system, which includes an optical system, a micro-scanning device, an infrared polarization focal plane detector, and an imaging circuit module; the infrared polarization focal plane detector is an interlaced coding infrared polarization focal plane detector.
[0031] The infrared polarization focal plane detector used in the present invention is an interlaced-coded infrared polarization focal plane detector, which is prior art. This interlaced-coded infrared polarization focal plane detector is described in patent document CN118243236A. This interlaced-coded infrared polarization focal plane detector captures infrared intensity information and infrared polarization information of incident light, respectively, and outputs the interlaced-coded infrared polarization image. The present invention incorporates the micro-scanning device in the optical system. This infrared polarization focal plane detector is prior art.
[0032] When in use, the interlaced-coded infrared polarization focal plane detector (IPFPD) has an operating wavelength range of 3.0-5.0 μm, a 640×512 array, equal pixel width and height, and 15 μm spacing in both the horizontal and vertical directions. The polarization gratings of the polarization encoding strips have a 90° transmission angle and are arranged in an interlaced pattern, their extension direction aligning with the horizontal direction of the photosensitive surface of the infrared polarization focal plane detector chip. A single polarization encoding strip is aligned with a horizontal row of pixels on the infrared polarization focal plane detector chip, has a width of 15 μm, and the vertical spacing between two adjacent polarization encoding strips is twice the pixel spacing, or 30 μm.
[0033] The micro-scanning device of the present invention is installed in the optical system. The micro-scanning device uses a focusing lens as a micro-scanning lens. The micro-scanning lens is fixed on a two-dimensional micro-displacement platform and driven by a piezoelectric motion mechanism to move on the two-dimensional micro-displacement platform to scan and obtain interlaced encoded infrared polarization images.
[0034] S200, using a micro-scanning device to periodically move the projection position of each scene point on the imaging plane, and collect an interlaced coded infrared polarization image at each projection position to obtain a set of interlaced coded infrared polarization image sequences;
[0035] In this step, in a current cycle of image acquisition, the piezoelectric motion mechanism is driven to control the micro-scanning lens to move the projection position of each scene point on the imaging plane of the interlaced coded infrared polarization focal plane detector a total of four times, according to two opposite directions in the horizontal direction, the displacement distance of the projection position of the scene point is 0.5 pixel width, and two opposite directions in the vertical direction, the displacement distance of the projection position of the scene point is 1 pixel height; and at the projection position after each movement, an interlaced coded infrared polarization image is collected to form an interlaced coded infrared polarization image sequence of the current cycle.
[0036] S300, decomposing and reconstructing the set of interlaced coded infrared polarization image sequences into infrared intensity images and infrared polarization images to generate horizontal super-resolution infrared intensity images and horizontal super-resolution infrared polarization images;
[0037] S400, using a computation-based super-resolution reconstruction method, performing vertical super-resolution reconstruction on both the horizontal super-resolution infrared intensity image and the horizontal super-resolution infrared polarization image to obtain a bidirectional super-resolution infrared intensity image and a bidirectional super-resolution infrared polarization image.
[0038] In a specific embodiment of the present invention, S210 includes:
[0039] S211, in a current cycle of capturing a set of interlaced coded infrared polarization image sequences, driving the piezoelectric motion mechanism to control the micro-scanning lens to move each scene point to an initial position on the imaging plane of the interlaced coded infrared polarization focal plane detector, and capturing the first image frame of the current cycle at the initial position;
[0040] S212, driving the piezoelectric motion mechanism to control the micro-scanning mirror to move leftward, so that the projection position of each scene point on the imaging plane moves leftward by 0.5 pixel width, and the second frame of the sequence is captured at this position;
[0041] S213, driving the piezoelectric motion mechanism to control the micro-scanning mirror to move upward, so that the projection position of each scene point on the imaging plane moves upward by one pixel height, and capturing the third frame of the sequence at this position;
[0042] S214, driving the piezoelectric motion mechanism to control the micro-scanning mirror to move rightward, so that the projection position of each scene point on the imaging plane moves rightward by 0.5 pixel width, and capturing the fourth frame of the sequence at this position;
[0043] S215 , composing the first to fourth frames of image into a set of interlaced encoded infrared polarization image sequences of the current period.
[0044] After the current cycle is completed, the present invention needs to drive the piezoelectric motion mechanism to control the micro-scanning lens to move downward, so that the projection position of each scene point on the imaging plane returns to the initial position when the first frame image is collected, preparing for the collection of the interlaced encoded infrared polarization image sequence of the next cycle.
[0045] like Figure 2 As shown, the present invention uses the micro scanning device according to Figure 2 The pattern shown periodically shifts the projection position of each scene point on the imaging plane. The first frame of an interlaced infrared polarization image sequence is captured with the micro-scanning lens in its initial position. The piezoelectric motion mechanism then drives the micro-scanning lens leftward, shifting the projection position of each scene point on the imaging plane by 0.5 pixel width. The second frame is captured at this shifted position. After the second frame is captured, the piezoelectric motion mechanism drives the micro-scanning lens upward, shifting the projection position of each scene point upward by one pixel height. The third frame is then captured. The piezoelectric motion mechanism then moves the micro-scanning lens rightward, shifting the projection position of each scene point by 0.5 pixel width. The fourth frame is captured at this position. Finally, the piezoelectric motion mechanism moves the micro-scanning lens downward, returning the projection position to its initial position from the first frame. This completes one cycle of interlaced infrared polarization image acquisition and prepares for the next set of interlaced infrared polarization image acquisition.
[0046] In a specific embodiment of the present invention, S300 includes:
[0047] S310, stitching all infrared intensity information in the interlaced-coded infrared polarization image sequence that has not been modulated by the polarization grating according to the actual positions of the scene points corresponding to the pixels in the world coordinate system, to generate a horizontal super-resolution infrared intensity image having a horizontal resolution that is twice the horizontal resolution of the interlaced-coded infrared polarization focal plane detector and a vertical resolution that is equal to the vertical resolution of the interlaced-coded infrared polarization focal plane detector;
[0048] S320, synchronously stitching all the interlaced-coded infrared polarization information in the interlaced-coded infrared polarization image sequence according to the actual position of the pixel corresponding to the scene point in the world coordinate system, to generate a horizontal super-resolution infrared polarization image with a horizontal resolution twice the horizontal resolution of the interlaced-coded infrared polarization focal plane detector and a vertical resolution equal to the vertical resolution of the interlaced-coded infrared polarization focal plane detector.
[0049] The present invention Figure 3 The method shown decomposes and reconstructs scene point information contained in four frames within a sequence of interlaced infrared polarization images, each with 512 rows and 640 columns. The response data for all pixels in the four frames that have not been modulated by the polarization grating are combined and spliced based on the actual positional relationships of their corresponding scene points on the imaging plane, generating a horizontal super-resolution infrared intensity image with 512 rows and 1280 columns. The horizontal resolution of this image is twice that of an interlaced infrared polarization focal plane detector (IPFPD), while the vertical resolution remains consistent with that of the IPFPD. Similarly, the response data for all pixels in the four frames that have been modulated by the polarization grating are combined and spliced based on the actual positional relationships of their corresponding scene points on the imaging plane, generating a horizontal super-resolution infrared polarization image with a horizontal resolution of twice that of the IPFPD and a vertical resolution equal to that of the IPFPD. The number of rows and columns is 512 and 1280, respectively.
[0050] In a specific embodiment of the present invention, S400 includes:
[0051] S410, using a computation-based super-resolution reconstruction method to perform vertical super-resolution reconstruction on the horizontal super-resolution infrared intensity image and the horizontal super-resolution infrared polarization image, respectively, to obtain a bidirectional super-resolution infrared intensity image and a bidirectional super-resolution infrared polarization image whose horizontal and vertical resolutions are twice the horizontal and vertical resolutions of the interlaced coded infrared polarization focal plane detector.
[0052] In a specific embodiment of the present invention, S410 includes:
[0053] S411, taking both the horizontal super-resolution infrared intensity image and the horizontal super-resolution infrared polarization image as images to be reconstructed;
[0054] S412, for each image to be reconstructed, taking an average of the data in the same column of two adjacent rows in the image to be reconstructed;
[0055] S413: Using the average value as the generated target data, and supplementing the target data between two adjacent rows of the image to be reconstructed, thereby obtaining a reconstructed image with horizontal and vertical resolutions twice that of the interlaced-coded infrared polarization focal plane detector. The reconstructed image corresponding to the horizontal super-resolution infrared intensity image is a bidirectional super-resolution infrared intensity image, and the reconstructed image corresponding to the horizontal super-resolution infrared polarization image is a bidirectional super-resolution infrared polarization image. The sizes of the bidirectional super-resolution infrared intensity image and the bidirectional super-resolution infrared polarization image are both 1024 rows and 1280 columns.
[0056] like Figure 4 As shown, the present invention provides a micro-scanning super-resolution reconstruction device for interlaced coded infrared polarization images, comprising:
[0057] A construction module 41 is used to construct a micro-scanning device for changing the projection position of a scene point on an imaging plane;
[0058] The acquisition module 42 uses a micro-scanning device to periodically move the projection position of each scene point on the imaging plane, and acquires an interlaced coded infrared polarization image at each projection position to obtain a set of interlaced coded infrared polarization image sequences;
[0059] a decomposition module 43 for decomposing and reconstructing the infrared intensity image and the infrared polarization image information of the set of interlaced encoded infrared polarization image sequences to generate a horizontal super-resolution infrared intensity image and a horizontal super-resolution infrared polarization image;
[0060] The reconstruction module 44 uses a computation-based super-resolution reconstruction method to perform vertical super-resolution reconstruction on both the horizontal super-resolution infrared intensity image and the horizontal super-resolution infrared polarization image.
[0061] The present invention provides a micro-scanning super-resolution reconstruction method and device for interlaced-coded infrared polarization images. A micro-scanning device is constructed to change the projected position of scene points on an imaging plane. The micro-scanning device is used to acquire a sequence of interlaced-coded infrared polarization images in which a set of scene points are horizontally displaced by half a pixel width and vertically by one pixel height. Subsequently, the acquired interlaced-coded infrared polarization image sequence is subjected to super-resolution decomposition and reconstruction, and a super-resolution reconstruction algorithm is applied to the reconstructed images. Ultimately, a bidirectional super-resolution infrared intensity image and a bidirectional super-resolution infrared polarization image are obtained, with a resolution four times that of an interlaced-coded infrared polarization focal plane detector. The present invention has the advantages of high reconstructed image resolution, complete preservation of scene detail information, low computational complexity, good real-time algorithm performance, and ease of hardware implementation.
[0062] Although the present application is described herein with reference to various embodiments, those skilled in the art will be able to understand and implement other variations of the disclosed embodiments in practicing the claimed application by reviewing the drawings, the disclosure, and the appended claims. In the claims, the word "comprising" does not exclude other components or steps, and "a" or "an" does not exclude a plurality.
[0063] The above is a further detailed description of the present invention in conjunction with specific preferred embodiments, and the specific implementation of the present invention should not be considered to be limited to these descriptions. For those skilled in the art of the present invention, without departing from the concept of the present invention, several simple deductions or substitutions can be made, which should be considered to fall within the scope of protection of the present invention.
Claims
1. A micro-scanning super-resolution reconstruction method for interlaced coded infrared polarization images, characterized in that: include: S100, constructing a micro-scanning device for changing the projection position of a scene point on an imaging plane; S200, using a micro-scanning device to periodically move the projection position of each scene point on the imaging plane, and collect an interlaced coded infrared polarization image at each projection position to obtain a set of interlaced coded infrared polarization image sequences; S300, decomposing and reconstructing the set of interlaced coded infrared polarization image sequences into infrared intensity images and infrared polarization images to generate horizontal super-resolution infrared intensity images and horizontal super-resolution infrared polarization images; S400, using a computation-based super-resolution reconstruction method, performing vertical super-resolution reconstruction on both the horizontal super-resolution infrared intensity image and the horizontal super-resolution infrared polarization image to obtain a bidirectional super-resolution infrared intensity image and a bidirectional super-resolution infrared polarization image.
2. The micro-scanning super-resolution reconstruction method of interlaced coded infrared polarization images according to claim 1, characterized in that: The micro-scanning device is installed in an infrared polarization imaging system, which includes an optical system, a micro-scanning device, an infrared polarization focal plane detector, and an imaging circuit module; the infrared polarization focal plane detector is an interlaced coding infrared polarization focal plane detector; The optical system is used to converge light onto the interlaced coded infrared polarization focal plane detector, which captures infrared intensity information and infrared polarization information of the incident light respectively and outputs the interlaced coded infrared polarization image.
3. The micro-scanning super-resolution reconstruction method of interlaced coded infrared polarization images according to claim 2, characterized in that: The micro-scanning device is installed in the optical system. The micro-scanning device uses a focusing lens as a micro-scanning lens. The micro-scanning lens is fixed on a two-dimensional micro-displacement platform and driven by a piezoelectric motion mechanism to move on the two-dimensional micro-displacement platform to scan and obtain an interlaced encoded infrared polarization image.
4. The micro-scanning super-resolution reconstruction method of interlaced coded infrared polarization images according to claim 3, characterized in that: S200 includes: S210, in a current cycle of image acquisition, driving the piezoelectric motion mechanism to control the micro-scanning lens to move the projection position of each scene point on the imaging plane of the interlaced coded infrared polarization focal plane detector a total of four times according to two opposite directions in the horizontal direction, the displacement distance of the projection position of the scene point being 0.5 pixel width, and two opposite directions in the vertical direction, the displacement distance of the projection position of the scene point being 1 pixel height; and acquiring an interlaced coded infrared polarization image at the projection position after each movement to form an interlaced coded infrared polarization image sequence of the current cycle.
5. The micro-scanning super-resolution reconstruction method of interlaced coded infrared polarization images according to claim 4, characterized in that: The S210 includes: S211, in a current cycle of capturing a set of interlaced coded infrared polarization image sequences, driving the piezoelectric motion mechanism to control the micro-scanning lens to move each scene point to an initial position on the imaging plane of the interlaced coded infrared polarization focal plane detector, and capturing the first image frame of the current cycle at the initial position; S212, driving the piezoelectric motion mechanism to control the micro-scanning mirror to move leftward, so that the projection position of each scene point on the imaging plane moves leftward by 0.5 pixel width, and the second frame of the sequence is captured at this position; S213, driving the piezoelectric motion mechanism to control the micro-scanning mirror to move upward, so that the projection position of each scene point on the imaging plane moves upward by one pixel height, and capturing the third frame of the sequence at this position; S214, driving the piezoelectric motion mechanism to control the micro-scanning mirror to move rightward, so that the projection position of each scene point on the imaging plane moves rightward by 0.5 pixel width, and capturing the fourth frame of the sequence at this position; S215 , composing the first to fourth frames of image into a set of interlaced encoded infrared polarization image sequences of the current period.
6. The micro-scanning super-resolution reconstruction method of interlaced coded infrared polarization images according to claim 5, characterized in that: After S214, the micro-scanning super-resolution reconstruction method of the interlaced coded infrared polarization image further includes: The piezoelectric motion mechanism is driven to control the downward movement of the micro-scanning mirror, so that the projection position of each scene point on the imaging plane returns to the initial position when the first frame of the image is collected, preparing for the collection of the next cycle of interlaced encoded infrared polarization image sequence.
7. The micro-scanning super-resolution reconstruction method of interlaced coded infrared polarization images according to claim 4, characterized in that: S300 includes: S310, stitching all infrared intensity information in the interlaced-coded infrared polarization image sequence that has not been modulated by the polarization grating according to the actual positions of the scene points corresponding to the pixels in the world coordinate system, to generate a horizontal super-resolution infrared intensity image having a horizontal resolution that is twice the horizontal resolution of the interlaced-coded infrared polarization focal plane detector and a vertical resolution that is equal to the vertical resolution of the interlaced-coded infrared polarization focal plane detector; S320, synchronously stitching all the interlaced-coded infrared polarization information in the interlaced-coded infrared polarization image sequence according to the actual position of the scene point corresponding to the pixel in the world coordinate system, to generate a horizontal super-resolution infrared polarization image with a horizontal resolution twice the horizontal resolution of the interlaced-coded infrared polarization focal plane detector and a vertical resolution equal to the vertical resolution of the interlaced-coded infrared polarization focal plane detector.
8. The micro-scanning super-resolution reconstruction method of interlaced coded infrared polarization images according to claim 7, characterized in that: S400 includes: S410, using a computation-based super-resolution reconstruction method to perform vertical super-resolution reconstruction on the horizontal super-resolution infrared intensity image and the horizontal super-resolution infrared polarization image, respectively, to obtain a bidirectional super-resolution infrared intensity image and a bidirectional super-resolution infrared polarization image whose horizontal and vertical resolutions are twice the horizontal and vertical resolutions of the interlaced coded infrared polarization focal plane detector.
9. The micro-scanning super-resolution reconstruction method of interlaced coded infrared polarization images according to claim 8, characterized in that: The S410 includes: S411, taking both the horizontal super-resolution infrared intensity image and the horizontal super-resolution infrared polarization image as images to be reconstructed; S412, for each image to be reconstructed, taking an average of the data in the same column of two adjacent rows in the image to be reconstructed; S413, using the average value as the generated target data, and supplementing the target data between two adjacent rows of the image to be reconstructed, to obtain a reconstructed image with a horizontal and vertical resolution that is twice the horizontal and vertical resolutions of the interlaced coded infrared polarization focal plane detector; wherein the reconstructed image corresponding to the horizontal super-resolution infrared intensity image is a bidirectional super-resolution infrared intensity image, and the reconstructed image corresponding to the horizontal super-resolution infrared polarization image is a bidirectional super-resolution infrared polarization image.
10. A micro-scanning super-resolution reconstruction device for interlaced coded infrared polarization images, characterized in that: include: A construction module is used to construct a micro-scanning device for changing the projection position of a scene point on an imaging plane; An acquisition module, which uses a micro-scanning device to periodically move the projection position of each scene point on the imaging plane, acquires an interlaced coded infrared polarization image at each projection position, and obtains a set of interlaced coded infrared polarization image sequences; a decomposition module, decomposing and reconstructing the set of interlaced coded infrared polarization image sequences into infrared intensity images and infrared polarization images, to generate horizontal super-resolution infrared intensity images and horizontal super-resolution infrared polarization images; The reconstruction module uses a computation-based super-resolution reconstruction method to perform vertical super-resolution reconstruction on both the horizontal super-resolution infrared intensity image and the horizontal super-resolution infrared polarization image.
Citation Information
Patent Citations
Interlaced coding type infrared polarization focal plane detector chip and preparation method thereof
CN118243236A