Micro-scanning super-resolution reconstruction method and device for interlaced coded infrared dual-band images

Abstract

The present invention provides a micro-scanning super-resolution reconstruction method and device for interlaced-coded infrared dual-band images. A micro-scanning device is constructed to change the projection position of scene points on an imaging plane. The micro-scanning device is used to acquire a sequence of interlaced-coded infrared dual-band images in which the projection positions of a group of scene points are displaced by half a pixel width in the horizontal direction and by one pixel height in the vertical direction. Subsequently, the acquired interlaced-coded infrared dual-band image sequence undergoes dual-band information separation and single-band information recombination. A super-resolution reconstruction algorithm is applied to the recombined images, ultimately yielding bidirectional super-resolution narrow-band infrared images and bidirectional super-resolution wide-band infrared images with a resolution four times that of an interlaced-coded dual-band infrared focal plane detector. The present invention has the advantages of high reconstructed image resolution, complete preservation of scene detail information, low computational complexity, good real-time algorithm performance, and ease of hardware implementation.

Description

Technical Field

[0001] The present invention belongs to the field of infrared imaging technology, and in particular relates to a micro-scanning super-resolution reconstruction method and device for interlaced coded infrared dual-band images. Background Art

[0002] Dual-band infrared imaging systems effectively improve their observation and anti-interference capabilities by comprehensively utilizing infrared information from different wavelengths. Current dual-band infrared imaging systems can be divided into three main categories based on their structure: the first type consists of two single-band infrared imaging systems that respond to different wavelengths (e.g., CN103974039B); the second type uses a spectroscopic element in an optical system to separate incident infrared light into different wavelengths, with focal plane detectors corresponding to the respective wavelengths receiving the separated incident infrared light, thereby acquiring dual-band infrared information (e.g., CN105227818B); and the third type combines a dual-band infrared focal plane detector (FPD) capable of responding to both wavelengths with an optical system (e.g., CN105244357B). Both of these systems contain two FPDs, which are bulky, costly, and subject to spatial and temporal registration errors between the two detectors, limiting their application. The third type of dual-band infrared imaging system has the advantages of high integration, miniaturization, small spatial registration error, and no temporal registration error of dual-band signals, and has a wider range of application scenarios.

[0003] As the core component of the third category of dual-band infrared imaging systems, dual-band infrared focal plane detectors (FPIs) are primarily classified into two types. The first is an array-type FPI, in which adjacent pixels within the focal plane array respond to different wavelengths. These pixels are staggered to capture information from the same target scene in two wavelength bands. The second is a stacked dual-color FPI, which utilizes a lamination process to stack two stacked photodiodes or infrared quantum wells. Each stack responds to a different infrared wavelength band, allowing information from both wavelengths to be captured at the same pixel location. Both existing types of FPIs require both radiation response and signal readout within a relatively small space within a single pixel or adjacent pixels. This places significant demands on the design and fabrication of the detector materials, device packaging, and readout circuitry. The complex fabrication process and high cost limit the application of dual-band infrared imaging systems.

[0004] The interlaced-coded dual-band infrared focal plane detector chip (CN111653630A) aims to address the complex manufacturing process and high precision requirements of conventional array-based dual-band infrared focal plane detectors, which are caused by the staggered arrangement of pixels in different bands. This chip forms a microfilter array by coating an infrared substrate with a comb-shaped, periodically arranged filter film. This microfilter array is then affixed to the focal plane of the infrared focal plane detector, creating a detector chip with interlaced dual-band coding characteristics. The filter film only allows infrared light in a narrow band to pass through, allowing the pixels behind the comb-shaped filter film in the chip's focal plane array to capture narrow-band infrared image information, while the remaining pixels capture wide-band infrared image information. Compared with preparing pixels with different working bands arranged in an interlaced manner on a focal plane array, this chip achieves the function of separating infrared signals into different pixels according to bands by pasting a comb-shaped filter film aligned with the pixels and arranged in alternate rows on an infrared substrate. It avoids the complex process of preparing pixels of different bands arranged in an interlaced manner on a focal plane array of a conventional array-type dual-band infrared focal plane detector. It has the advantages of simple manufacturing process, compact structure, high integration, and high accuracy of pixel registration of different bands.

[0005] Interlaced-coded dual-band infrared focal plane detectors can capture both narrowband and broadband image information simultaneously. However, due to the interlaced arrangement of the monochromatic filters on the microfilters, the resolution of both narrowband and broadband images is only half that of the dual-band infrared focal plane detector. Furthermore, due to hardware limitations, the resolution of dual-band infrared focal plane detectors is significantly lower than that of visible light detectors. Therefore, further reductions in resolution will affect the image's detail quality and information richness. To address this issue, super-resolution reconstruction technology is needed to enhance the resolution of both narrowband and broadband images, thereby improving image quality, compensating for hardware resolution limitations, and meeting the needs of refined imaging.

[0006] A variety of computationally-based super-resolution reconstruction methods have been proposed for conventional array-based dual-band infrared focal plane detectors, including interpolation, image reconstruction, deep learning, and frequency-domain reconstruction. However, due to errors in the prior models describing the quality degradation mechanism during image sampling, these methods often fail to accurately represent the true details of the image when generating reconstructed pixel data through computation. Furthermore, these algorithms typically rely on the arrangement of pixels responsive to different wavelengths on the infrared focal plane array, making them difficult to apply to interlaced-coded detectors. Therefore, there is an urgent need to develop a super-resolution reconstruction method specifically designed for interlaced-coded dual-band infrared focal plane detectors to improve imaging quality and resolution, thereby achieving low-cost, high-precision dual-band infrared imaging. Summary of the Invention

[0007] To address the above-mentioned problems in the prior art, the present invention provides a method and apparatus for micro-scanning super-resolution reconstruction of interlaced encoded infrared dual-band images. The technical problems to be solved by the present invention are achieved through the following technical solutions:

[0008] In a first aspect, a micro-scanning super-resolution reconstruction method for interlaced coded infrared dual-band images includes:

[0009] S100, constructing a micro-scanning device for changing the projection position of a scene point on an imaging plane;

[0010] S200, using a micro-scanning device to periodically move the projection position of each scene point on the imaging plane, and collect an interlaced coded infrared dual-band image at each projection position to obtain a set of interlaced coded infrared dual-band image sequences;

[0011] S300, performing dual-band information separation and single-band information recombination on the set of interlaced encoded infrared dual-band image sequences to generate a horizontal super-resolution narrow-band infrared image and a horizontal super-resolution wide-band infrared image;

[0012] S400, using a computation-based super-resolution reconstruction method, vertically super-resolution reconstructing the horizontal super-resolution narrow-band infrared image and the horizontal super-resolution wide-band infrared image to obtain a bidirectional super-resolution narrow-band infrared image and a bidirectional super-resolution wide-band infrared image.

[0013] In a second aspect, the present invention provides a micro-scanning super-resolution reconstruction device for interlaced coded infrared dual-band images, comprising:

[0014] A construction module is used to construct a micro-scanning device for changing the projection position of a scene point on an imaging plane;

[0015] An acquisition module, which uses a micro-scanning device to periodically move the projection position of each scene point on the imaging plane, and acquires an interlaced coded infrared dual-band image at each projection position to obtain a set of interlaced coded infrared dual-band image sequences;

[0016] a decomposition module for separating dual-band information and recombining single-band information on the set of interlaced encoded infrared dual-band image sequences to generate a horizontal super-resolution narrow-band infrared image and a horizontal super-resolution wide-band infrared image;

[0017] The reconstruction module uses a computation-based super-resolution reconstruction method to perform vertical super-resolution reconstruction on both the horizontal super-resolution narrow-band infrared image and the horizontal super-resolution wide-band infrared image.

[0018] Beneficial effects:

[0019] The present invention provides a micro-scanning super-resolution reconstruction method and device for interlaced-coded infrared dual-band images. A micro-scanning device is constructed to change the projected position of scene points on an imaging plane. The micro-scanning device is used to acquire a sequence of interlaced-coded infrared dual-band images in which the projected positions of a group of scene points are shifted horizontally by half a pixel width and vertically by one pixel height. Subsequently, the acquired interlaced-coded infrared dual-band image sequence undergoes dual-band information separation and single-band information recombination. A super-resolution reconstruction algorithm is applied to the recombined images, ultimately yielding bidirectional super-resolution narrow-band infrared images and bidirectional super-resolution wide-band infrared images with a resolution four times that of an interlaced-coded dual-band infrared focal plane detector.

[0020] The present invention separates the dual-band information and reconstructs the single-band information from the collected interlaced-coded dual-band infrared image sequence, resulting in horizontal super-resolution narrow-band infrared images and horizontal super-resolution wide-band infrared images with a horizontal resolution twice that of the detector. Each point in the image represents actual imaging data of the target scene, effectively resolving the problem that reconstructed data obtained through calculations cannot truly reflect scene details, and improving the detection capability of interlaced-coded dual-band infrared imaging systems for small targets. Furthermore, super-resolution reconstruction of horizontal super-resolution narrow-band infrared images and horizontal super-resolution wide-band infrared images involves only image splicing and interpolation calculations between two adjacent rows of data. This reduces computational complexity, improves real-time algorithm performance, and facilitates hardware implementation, addressing the shortcomings of current super-resolution reconstruction methods when applied to interlaced-coded dual-band infrared focal plane detectors.

[0021] The present invention will be further described in detail below with reference to the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Figure 1 This is a flow chart of a micro-scanning super-resolution reconstruction method for interlaced-coded infrared dual-band images proposed in an embodiment of the present invention;

[0023] Figure 2 This is a flow chart of an infrared dual-band image sequence acquired using a micro-scanning device according to an embodiment of the present invention;

[0024] Figure 3 Schematic diagram of synthesizing a narrow-band infrared image and a wide-band infrared image according to an embodiment of the present invention;

[0025] Figure 4 This is a structural diagram of a micro-scanning super-resolution reconstruction device for interlaced-coded infrared dual-band images proposed in an embodiment of the present invention. DETAILED DESCRIPTION

[0026] The present invention will be further described in detail below with reference to specific examples, but the embodiments of the present invention are not limited thereto.

[0027] See Figure 1 、 Figure 2 and Figure 3 , Figure 1 This is a flow chart of a micro-scanning super-resolution reconstruction method for interlaced coded infrared dual-band images proposed in an embodiment of the present invention. Figure 2 This is a flow chart of using a micro-scanning device to collect an infrared dual-band image sequence according to an embodiment of the present invention. Figure 3 It is a schematic diagram of synthesizing a narrow-band infrared image and a wide-band infrared image proposed in an embodiment of the present invention. Figure 4 The present invention provides a schematic diagram of a micro-scanning super-resolution reconstruction device for interlaced coded infrared dual-band images.

[0028] like Figure 1 As shown, the present invention provides a micro-scanning super-resolution reconstruction method for interlaced coded infrared dual-band images, comprising:

[0029] S100, constructing a micro-scanning device for changing the projection position of a scene point on an imaging plane;

[0030] Among them, the micro-scanning device is installed in the infrared dual-band imaging system, which includes an optical system, a micro-scanning device, a dual-band infrared focal plane detector, and an imaging circuit module; the dual-band infrared focal plane detector is an interlaced coded dual-band infrared focal plane detector.

[0031] The dual-band infrared focal plane detector used in the present invention is an interlaced-coded dual-band infrared focal plane detector, which is currently available. This interlaced-coded dual-band infrared focal plane detector is described in patent document CN111653630A. The present invention incorporates a micro-scanning device into the optical system, and this dual-band infrared focal plane detector is currently available.

[0032] When in use, the interlaced-coded dual-band infrared focal plane detector (IFPD) has an operating band of 3.0-5.0 μm, a 640×512 array, and equal pixel height and width. The pixel spacing is 15 μm in both the horizontal and vertical directions. The filter strips operate in an interlaced pattern with a horizontal orientation aligned with the photosensitive surface of the IFPD chip. A single filter strip aligns horizontally with a row of pixels on the IFPD chip. Its width is 15 μm, and the vertical spacing between two adjacent filter strips is twice the pixel spacing, or 30 μm.

[0033] The micro-scanning device of the present invention is installed in an optical system. It uses a focusing lens as a micro-scanning lens, which is fixed to a two-dimensional micro-displacement platform and driven by a piezoelectric motion mechanism to move on the two-dimensional micro-displacement platform, thereby scanning and obtaining interlaced infrared dual-band images. Specifically, a piezoelectric scanning stage is used as the two-dimensional micro-displacement platform and the piezoelectric motion mechanism. The piezoelectric scanning stage is made of piezoelectric ceramic material and has two horizontal and vertical motion directions. Its maximum horizontal and vertical travel range is 80μm. By varying the voltage on the piezoelectric scanning stage, the micro-scanning lens is driven to perform pixel-scale horizontal or vertical displacement on the scanning stage.

[0034] S200, using a micro-scanning device to periodically move the projection position of each scene point on the imaging plane, and collect an interlaced coded infrared dual-band image at each projection position to obtain a set of interlaced coded infrared dual-band image sequences;

[0035] In this step, in the current cycle of an image acquisition, the piezoelectric scanning stage is driven to control the micro-scanning lens to move the projection position of each scene point on the imaging plane of the interlaced coded dual-band infrared focal plane detector a total of four times, according to the rule of performing two horizontal displacements in opposite directions with a displacement distance of 0.5 pixel width and two vertical displacements in opposite directions with a displacement distance of 1 pixel height. At the projection position after each movement, an interlaced coded infrared dual-band image is collected to form an interlaced coded infrared dual-band image sequence of the current cycle. The horizontal displacement and the vertical displacement are performed alternately so that the movement trajectory of the projection position of the scene point on the imaging plane within one cycle forms a closed rectangle.

[0036] S300, performing dual-band information separation and single-band information recombining on a set of interlaced encoded infrared dual-band image sequences to generate a horizontal super-resolution narrow-band infrared image and a horizontal super-resolution wide-band infrared image;

[0037] S400 , using a computation-based super-resolution reconstruction method, vertically super-resolution reconstructs both the horizontal super-resolution narrow-band infrared image and the horizontal super-resolution wide-band infrared image to obtain a bidirectional super-resolution narrow-band infrared image and a bidirectional super-resolution wide-band infrared image.

[0038] In a specific embodiment of the present invention, S210 includes:

[0039] S211, in a current cycle of capturing a set of interlaced coded dual-band infrared image sequences, driving the piezoelectric scanning stage to control the micro-scanning lens to move each scene point to an initial position on the imaging plane of the interlaced coded dual-band infrared focal plane detector, and capturing the first frame of the current cycle at the initial position;

[0040] S212, driving the piezoelectric scanning stage to control the micro-scanning lens to move leftward, so that the projection position of each scene point on the imaging plane moves leftward by 0.5 pixel width, and the second frame of the sequence is captured at this position;

[0041] S213, driving the piezoelectric scanning stage to control the micro-scanning mirror to move upward, so that the projection position of each scene point on the imaging plane moves upward by one pixel height, and the third frame of the sequence is captured at this position;

[0042] S214, driving the piezoelectric scanning stage to control the micro-scanning lens to move rightward, so that the projection position of each scene point on the imaging plane moves rightward by 0.5 pixel width, and the fourth frame of the sequence is captured at this position;

[0043] S215 , composing the first to fourth frames of image into a set of interlaced encoded infrared dual-band image sequences of the current period.

[0044] After the current cycle is completed, the present invention needs to drive the piezoelectric scanning stage to control the micro-scanning lens to move downward, so that the projection position of each scene point on the imaging plane returns to the initial position when the first frame image is collected, preparing for the collection of the interlaced encoded infrared dual-band image sequence in the next cycle.

[0045] like Figure 2 As shown, the present invention uses a micro scanning device according to Figure 2 The pattern shown here periodically shifts the projection position of each scene point on the imaging plane. The first frame of an interlaced-coded infrared dual-band image sequence is captured with the micro-scanning lens in its initial position. The piezoelectric scanning stage then drives the micro-scanning lens leftward, shifting the projection position of each scene point on the imaging plane by 0.5 pixel width. The second frame is captured at this shifted position. After the second frame is captured, the piezoelectric scanning stage drives the micro-scanning lens upward, shifting the projection position of each scene point upward by one pixel height. The third frame is then captured. The piezoelectric scanning stage then moves the micro-scanning lens rightward, shifting the projection position of each scene point by 0.5 pixel width. The fourth frame is captured at this position. Finally, the piezoelectric scanning stage moves the micro-scanning lens downward, returning the projection position to its initial position from the first frame. This completes one cycle of interlaced-coded infrared dual-band image acquisition and prepares for the next set of interlaced-coded infrared dual-band image acquisition.

[0046] In a specific embodiment of the present invention, S300 includes:

[0047] The narrow-band infrared image information provided by all pixels with filters installed in front of them in the interlaced coded dual-band infrared image sequence is stitched and reassembled according to the real spatial position of the scene points corresponding to the pixels in the world coordinate system, thereby generating a horizontal super-resolution narrow-band infrared image with a horizontal resolution twice that of the interlaced coded dual-band infrared focal plane detector and a vertical resolution equal to the vertical resolution of the interlaced coded dual-band infrared focal plane detector;

[0048] S320, synchronously stitching and recombining the wide-band infrared image information provided by all pixels in the interlaced coded infrared dual-band image sequence that do not have a filter film installed in front of them according to the real spatial positions of the scene points corresponding to the pixels in the world coordinate system, to generate a horizontal super-resolution wide-band infrared image with a horizontal resolution that is twice the horizontal resolution of the interlaced coded dual-band infrared focal plane detector and a vertical resolution that is equal to the vertical resolution of the interlaced coded dual-band infrared focal plane detector.

[0049] The present invention Figure 3 The method shown here separates the dual-band information and reconstructs the single-band information for scene point information contained in four frames within a sequence of interlaced-coded dual-band infrared images, each frame having 512 rows and 640 columns. The response data for all pixels in the four frames with front filters are combined and stitched together based on the actual positional relationships of their corresponding scene points on the imaging plane, generating a horizontal super-resolution narrow-band infrared image of 512 rows and 1280 columns. This image has a horizontal resolution equivalent to twice that of an interlaced-coded dual-band infrared focal plane detector, while its vertical resolution remains consistent with that of an interlaced-coded dual-band infrared focal plane detector. Similarly, the response data of all pixels in the four frames without filter films installed in front are also combined and spliced ​​according to their actual positional relationship when projected onto the corresponding scene points in the imaging plane, generating a horizontal super-resolution wide-band infrared image with a horizontal resolution twice that of the interlaced-coded dual-band infrared focal plane detector and a vertical resolution equal to that of the interlaced-coded dual-band infrared focal plane detector. The number of rows and columns is 512 and 1280, respectively.

[0050] In a specific embodiment of the present invention, S400 includes:

[0051] S410 uses a computation-based super-resolution reconstruction method to perform vertical super-resolution reconstruction on the horizontal super-resolution narrow-band infrared image and the horizontal super-resolution wide-band infrared image, respectively, to obtain a bidirectional super-resolution narrow-band infrared image and a bidirectional super-resolution wide-band infrared image with horizontal and vertical resolutions twice that of an interlaced-coded dual-band infrared focal plane detector.

[0052] In a specific embodiment of the present invention, S410 includes:

[0053] S411, taking both the horizontal super-resolution narrow-band infrared image and the horizontal super-resolution wide-band infrared image as images to be reconstructed;

[0054] S412, for each image to be reconstructed, taking an average of the data in the same column of two adjacent rows in the image to be reconstructed;

[0055] At step S413, the average value is used as the generated target data, and the target data is added between two adjacent rows of the image to be reconstructed, thereby obtaining a reconstructed image with a horizontal and vertical resolution twice that of the interlaced-coded dual-band infrared focal plane detector. The reconstructed image corresponding to the horizontal super-resolution narrow-band infrared image is a bidirectional super-resolution narrow-band infrared image, and the reconstructed image corresponding to the horizontal super-resolution wide-band infrared image is a bidirectional super-resolution wide-band infrared image. The size of both the bidirectional super-resolution narrow-band infrared image and the bidirectional super-resolution wide-band infrared image is 1024 rows and 1280 columns.

[0056] like Figure 4 As shown, the present invention provides a micro-scanning super-resolution reconstruction device for interlaced coded infrared dual-band images, comprising:

[0057] A construction module 41 is used to construct a micro-scanning device for changing the projection position of a scene point on an imaging plane;

[0058] The acquisition module 42 uses a micro-scanning device to periodically move the projection position of each scene point on the imaging plane, and acquires an interlaced coded infrared dual-band image at each projection position to obtain a set of interlaced coded infrared dual-band image sequences;

[0059] A decomposition module 43 performs dual-band information separation and single-band information recombining on a set of interlaced encoded infrared dual-band image sequences to generate a horizontal super-resolution narrow-band infrared image and a horizontal super-resolution wide-band infrared image;

[0060] The reconstruction module 44 uses a computation-based super-resolution reconstruction method to perform vertical super-resolution reconstruction on both the horizontal super-resolution narrow-band infrared image and the horizontal super-resolution wide-band infrared image.

[0061] The present invention provides a micro-scanning super-resolution reconstruction method and device for interlaced-coded infrared dual-band images. A micro-scanning device is constructed to change the projected position of scene points on an imaging plane. The micro-scanning device is used to acquire a sequence of interlaced-coded infrared dual-band images in which a set of scene points are horizontally displaced by half a pixel width and vertically by one pixel height. Subsequently, the acquired sequence of interlaced-coded infrared dual-band images undergoes dual-band information separation and single-band information recombination. A super-resolution reconstruction algorithm is applied to the recombined images, ultimately yielding bidirectional super-resolution narrow-band infrared images and bidirectional super-resolution wide-band infrared images with a resolution four times that of an interlaced-coded dual-band infrared focal plane detector. The present invention has the advantages of high reconstructed image resolution, complete preservation of scene detail information, low computational complexity, good real-time algorithm performance, and ease of hardware implementation.

[0062] Although the present application is described herein with reference to various embodiments, those skilled in the art will be able to understand and implement other variations of the disclosed embodiments in practicing the claimed application by reviewing the drawings, the disclosure, and the appended claims. In the claims, the word "comprising" does not exclude other components or steps, and "a" or "an" does not exclude a plurality.

[0063] The above is a further detailed description of the present invention in conjunction with specific preferred embodiments, and the specific implementation of the present invention should not be considered to be limited to these descriptions. For those skilled in the art of the present invention, without departing from the concept of the present invention, several simple deductions or substitutions can be made, which should be considered to fall within the scope of protection of the present invention.

Claims

1. A micro-scanning super-resolution reconstruction method for interlaced coded infrared dual-band images, characterized in that: include: S100, constructing a micro-scanning device for changing the projection position of a scene point on an imaging plane; S200, using a micro-scanning device to periodically move the projection position of each scene point on the imaging plane, and collect an interlaced coded infrared dual-band image at each projection position to obtain a set of interlaced coded infrared dual-band image sequences; S300, performing dual-band information separation and single-band information recombination on the set of interlaced encoded infrared dual-band image sequences to generate a horizontal super-resolution narrow-band infrared image and a horizontal super-resolution wide-band infrared image; S400, using a computation-based super-resolution reconstruction method, performing vertical super-resolution reconstruction on both the horizontal super-resolution narrow-band infrared image and the horizontal super-resolution wide-band infrared image to obtain a bidirectional super-resolution narrow-band infrared image and a bidirectional super-resolution wide-band infrared image; Among them, S200 includes: S210, in a current cycle of image acquisition, driving the piezoelectric motion mechanism to control the micro-scanning lens to move the projection position of each scene point on the imaging plane of the interlaced-coded dual-band infrared focal plane detector a total of four times, in accordance with a pattern of performing two horizontal displacements in opposite directions with the projection position of the scene point displaced by a distance of 0.5 pixel width, and performing two vertical displacements in opposite directions with the projection position of the scene point displaced by a distance of 1 pixel height; and capturing an interlaced-coded infrared dual-band image at the projection position after each displacement to form an interlaced-coded infrared dual-band image sequence for the current cycle; the horizontal displacements and the vertical displacements are performed alternately so that the movement trajectory of the projection position of the scene point on the imaging plane within one cycle forms a closed rectangle; S300 includes: S310, stitching and reassembling the narrow-band infrared image information provided by all pixels in the interlaced-coded dual-band infrared image sequence that have filters installed in front of them, stitching and reassembling the information according to the real spatial positions of the scene points corresponding to the pixels in the world coordinate system, to generate a horizontal super-resolution narrow-band infrared image having a horizontal resolution that is twice the horizontal resolution of the interlaced-coded dual-band infrared focal plane detector and a vertical resolution that is equal to the vertical resolution of the interlaced-coded dual-band infrared focal plane detector; S320, synchronously splicing and recombining the wide-band infrared image information provided by all pixels in the interlaced-coded dual-band infrared image sequence that do not have a filter film installed in front of them according to the real spatial positions of the scene points corresponding to the pixels in the world coordinate system, to generate a horizontal super-resolution wide-band infrared image with a horizontal resolution that is twice the horizontal resolution of the interlaced-coded dual-band infrared focal plane detector and a vertical resolution that is equal to the vertical resolution of the interlaced-coded dual-band infrared focal plane detector; S400 includes: S410, using a computation-based super-resolution reconstruction method, performs vertical super-resolution reconstruction on the horizontal super-resolution narrow-band infrared image and the horizontal super-resolution wide-band infrared image, respectively, to obtain a bidirectional super-resolution narrow-band infrared image and a bidirectional super-resolution wide-band infrared image whose horizontal and vertical resolutions are twice the horizontal and vertical resolutions of the interlaced coded dual-band infrared focal plane detector.

2. The micro-scanning super-resolution reconstruction method of interlaced coded infrared dual-band images according to claim 1, characterized in that: The micro-scanning device is installed in an infrared dual-band imaging system, which includes an optical system, a micro-scanning device, a dual-band infrared focal plane detector, and an imaging circuit module; the dual-band infrared focal plane detector is an interlaced coding dual-band infrared focal plane detector; The optical system is used to converge light onto the interlaced coded dual-band infrared focal plane detector, which captures the infrared intensity information of the incident light in the narrow band and the wide band respectively, and outputs the interlaced coded infrared dual-band image.

3. The micro-scanning super-resolution reconstruction method of interlaced coded infrared dual-band images according to claim 2, characterized in that: The micro-scanning device is installed in the optical system. The micro-scanning device uses a focusing lens as a micro-scanning lens. The micro-scanning lens is fixed on a two-dimensional micro-displacement platform and driven by a piezoelectric motion mechanism to move on the two-dimensional micro-displacement platform to scan and obtain interlaced encoded infrared dual-band images.

4. The micro-scanning super-resolution reconstruction method of interlaced coded infrared dual-band images according to claim 1, characterized in that: The S210 includes: S211, in a current cycle of capturing a set of interlaced coded dual-band infrared image sequences, driving the piezoelectric motion mechanism to control the micro-scanning lens to move each scene point to an initial position on the imaging plane of the interlaced coded dual-band infrared focal plane detector, and capturing the first image frame of the current cycle at the initial position; S212, driving the piezoelectric motion mechanism to control the micro-scanning mirror to move leftward, so that the projection position of each scene point on the imaging plane moves leftward by 0.5 pixel width, and the second frame of the sequence is captured at this position; S213, driving the piezoelectric motion mechanism to control the micro-scanning mirror to move upward, so that the projection position of each scene point on the imaging plane moves upward by one pixel height, and capturing the third frame of the sequence at this position; S214, driving the piezoelectric motion mechanism to control the micro-scanning mirror to move rightward, so that the projection position of each scene point on the imaging plane moves rightward by 0.5 pixel width, and capturing the fourth frame of the sequence at this position; S215 , composing the first to fourth frames of image into a set of interlaced encoded infrared dual-band image sequences of the current period.

5. The micro-scanning super-resolution reconstruction method of interlaced coded infrared dual-band images according to claim 4, characterized in that: After S214, the micro-scanning super-resolution reconstruction method for interlaced coded infrared dual-band images further includes: The piezoelectric motion mechanism is driven to control the downward movement of the micro-scanning mirror, so that the projection position of each scene point on the imaging plane returns to the initial position when the first frame of the image is collected, preparing for the collection of the next cycle of interlaced coded infrared dual-band image sequence.

6. The micro-scanning super-resolution reconstruction method of interlaced coded infrared dual-band images according to claim 1, characterized in that: The S410 includes: S411, taking both the horizontal super-resolution narrow-band infrared image and the horizontal super-resolution wide-band infrared image as images to be reconstructed; S412, for each image to be reconstructed, taking an average of the data in the same column of two adjacent rows in the image to be reconstructed; S413, using the average value as the generated target data, and supplementing the target data between two adjacent rows of the image to be reconstructed, to obtain a reconstructed image whose horizontal and vertical resolutions are twice the horizontal and vertical resolutions of the interlaced coded dual-band infrared focal plane detector; wherein the reconstructed image corresponding to the horizontal super-resolution narrow-band infrared image is a bidirectional super-resolution narrow-band infrared image, and the reconstructed image corresponding to the horizontal super-resolution wide-band infrared image is a bidirectional super-resolution wide-band infrared image.

7. A micro-scanning super-resolution reconstruction device for interlaced coded infrared dual-band images, characterized in that: include: A construction module is used to construct a micro-scanning device for changing the projection position of a scene point on an imaging plane; An acquisition module, which uses a micro-scanning device to periodically move the projection position of each scene point on the imaging plane, and acquires an interlaced coded infrared dual-band image at each projection position to obtain a set of interlaced coded infrared dual-band image sequences; a decomposition module for separating dual-band information and recombining single-band information on the set of interlaced encoded infrared dual-band image sequences to generate a horizontal super-resolution narrow-band infrared image and a horizontal super-resolution wide-band infrared image; a reconstruction module, which uses a computation-based super-resolution reconstruction method to perform vertical super-resolution reconstruction on both the horizontal super-resolution narrow-band infrared image and the horizontal super-resolution wide-band infrared image; Wherein, the acquisition module includes: In a current cycle of image acquisition, the piezoelectric motion mechanism is driven to control the micro-scanning lens to move the projection position of each scene point on the imaging plane of the interlaced-coded dual-band infrared focal plane detector a total of four times, according to a pattern of performing two horizontal displacements in opposite directions with the projection position of the scene point displaced by a distance of 0.5 pixel width, and performing two vertical displacements in opposite directions with the projection position of the scene point displaced by a distance of 1 pixel height; and at the projection position after each displacement, an interlaced-coded infrared dual-band image is collected to form an interlaced-coded infrared dual-band image sequence of the current cycle; the horizontal displacements and the vertical displacements are performed alternately so that the movement trajectory of the projection position of the scene point on the imaging plane within one cycle forms a closed rectangle; The decomposition module includes: splicing and recombining the narrow-band infrared image information provided by all pixels in the interlaced-coded dual-band infrared image sequence that have filters installed in front of them, and performing the splicing and recombining according to the real spatial positions of the scene points corresponding to the pixels in the world coordinate system, to generate a horizontal super-resolution narrow-band infrared image having a horizontal resolution that is twice the horizontal resolution of the interlaced-coded dual-band infrared focal plane detector and a vertical resolution that is equal to the vertical resolution of the interlaced-coded dual-band infrared focal plane detector; Synchronously splicing and recombining the wide-band infrared image information provided by all pixels in the interlaced-coded dual-band infrared image sequence that do not have a filter film installed in front of them according to the real spatial positions of the scene points corresponding to the pixels in the world coordinate system, to generate a horizontal super-resolution wide-band infrared image with a horizontal resolution that is twice the horizontal resolution of the interlaced-coded dual-band infrared focal plane detector and a vertical resolution that is equal to the vertical resolution of the interlaced-coded dual-band infrared focal plane detector; The reconstruction module includes: A computation-based super-resolution reconstruction method is used to perform vertical super-resolution reconstruction on the horizontal super-resolution narrow-band infrared image and the horizontal super-resolution wide-band infrared image, respectively, to obtain a bidirectional super-resolution narrow-band infrared image and a bidirectional super-resolution wide-band infrared image, whose horizontal and vertical resolutions are both twice the horizontal and vertical resolutions of the interlaced-coded dual-band infrared focal plane detector.

Images