Micro-scanning super-resolution reconstruction method and device for interlaced coding infrared dual-band image

Through the microscan super-resolution reconstruction method and the computing-based super-resolution reconstruction technology, interlaced coded infrared dual-band images are processed, solving the problems of complex manufacturing processes, high cost and low image resolution in the prior art, and achieving high-resolution and low-cost dual-band infrared imaging effect.

CN119741204AActive Publication Date: 2025-04-01NORTHWESTERN POLYTECHNICAL UNIV
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
CN202411811529.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-12-10
Publication Date
2025-04-01
Estimated Expiration
2044-12-10

AI Technical Summary

Technical Problem

The existing dual-band infrared focal plane detectors have limited the application of dual-band infrared imaging systems due to complex manufacturing processes, high accuracy requirements and high cost. At the same time, the image resolution of the interlaced encoded dual-band infrared focal plane detector is low, which affects the detail quality and information richness of the image.

Method used

By using the microscan super-resolution reconstruction method, the projection position of the scene points of the microscan device periodically moves, the interlaced encoded infrared dual-band image sequence is collected, and the dual-band information separation and single-band information reorganization are performed. Then, using the calculation-based super-resolution reconstruction method, the image is perpendicularly super-resolution narrow band and wide band infrared images are generated.

Benefits of technology

The bidirectional super-resolution narrow and wide band infrared images with an image resolution of four times that of interlaced encoded dual-band infrared focal plane detectors is achieved, which improves imaging quality and detection capabilities of small targets, and reduces the computational volume and algorithm complexity.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119741204A_ABST
    Figure CN119741204A_ABST
Patent Text Reader

Abstract

The invention provides a micro-scanning super-resolution reconstruction method and device for an interlaced coding infrared dual-band image, and the method comprises the steps: constructing a micro-scanning device which is used for changing the projection position of a field spot on an imaging plane; a micro-scanning device is utilized to acquire an interlaced coding infrared dual-band image sequence in which the projection positions of a group of scene points have 1 / 2 pixel width displacement in the horizontal direction and have one pixel height displacement in the vertical direction. Then, carrying out dual-band information separation and single-band information recombination on the acquired interlaced coding infrared dual-band image sequence, and applying a super-resolution reconstruction algorithm on the recombined image; and finally obtaining a bidirectional super-resolution narrow-band infrared image and a bidirectional super-resolution wide-band infrared image of which the resolution is four times of that of the interlaced coding type dual-band infrared focal plane detector. The method has the advantages of high resolution of reconstructed images, complete reservation of scene detail information, small operand, good algorithm real-time performance and convenience in hardware implementation.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention belongs to the technical field of infrared imaging, and in particular relates to a micro-scanning super-resolution reconstruction method and device for interlaced coded infrared dual-band images. Background Art

[0002] The dual-band infrared imaging system effectively improves the observation ability and anti-interference ability of the infrared imaging system by comprehensively utilizing infrared information of different bands. The current dual-band infrared imaging systems can be divided into three categories according to different structures: the first type of dual-band infrared imaging system is composed of two sets of single-band infrared imaging systems that respond to different bands (for example, CN103974039B); the second type uses the spectroscopic element in the optical system to separate the incident infrared light into different bands, and the focal plane detectors of the corresponding bands receive the separated incident infrared light to achieve the acquisition of dual-band infrared information (for example, CN105227818B); the third type of dual-band infrared imaging system is composed of a dual-band infrared focal plane detector that responds to two bands of infrared information and an optical system (for example, CN105244357B). The first two types of infrared dual-band imaging systems both include two infrared focal plane detectors, which have the defects of large size, high cost, and spatial registration and temporal registration errors between the two detectors, and their application is limited. The third type of dual-band infrared imaging system has the advantages of high integration, miniaturization, small spatial registration error, and no temporal registration error of dual-band signals, and has a wider range of application scenarios.

[0003] As the core component of the third type of dual-band infrared imaging system, the structure of the dual-band infrared focal plane detector is mainly divided into two types: the first is an array-type dual-band infrared focal plane detector, in which adjacent pixels in the focal plane array of the detector respond to different bands, and pixels of different bands are arranged in an interlaced manner to obtain information of the same target scene in two bands; the second is a stacked two-color focal plane detector, in which two stacked photodiodes or infrared quantum wells are stacked together through a stacking process. Each stack responds to a different infrared band, thereby collecting information of two infrared bands at the same pixel position. Both existing types of dual-band infrared focal plane detectors require the radiation response and signal readout of the two bands to be realized in a small space of one pixel or adjacent pixels, which puts forward quite high design and preparation process requirements for the detector's materials, device packaging and readout circuit design. The complex preparation process and high cost limit the application of dual-band infrared imaging systems.

[0004] The interlaced coded dual-band infrared focal plane detector chip (CN111653630A) aims to solve the defects of conventional array-type dual-band infrared focal plane detectors, which are complicated manufacturing process and high manufacturing precision requirements due to the staggered arrangement of pixels in different bands. The chip is formed by coating a comb-shaped, periodically arranged filter film on an infrared substrate to form a micro-filter array, and the micro-filter array is pasted to the focal plane of the infrared focal plane detector to form a detector chip with interlaced dual-band coding characteristics. The filter film only allows infrared light in a narrower band to pass through, so that the pixels behind the comb-shaped filter film in the focal plane array of the chip capture narrow-band infrared image information, while the remaining pixels capture wide-band infrared image information. Compared with preparing pixels with different working bands arranged in an interlaced manner on a focal plane array, this chip realizes the function of separating infrared signals into different pixels by band by pasting a comb-shaped filter film that is aligned with the pixels and arranged in alternate rows on an infrared substrate. This avoids the complex process flow of preparing pixels of different bands arranged in an interlaced manner on a focal plane array of a conventional array-type dual-band infrared focal plane detector. It has the advantages of simple manufacturing process, compact structure, high integration, and high registration accuracy of pixels of different bands.

[0005] The interlaced coded dual-band infrared focal plane detector can capture both narrowband image information and wideband image information. However, due to the interlaced arrangement of the monochromatic filter film on the microfilter, the resolution of the narrowband image and the wideband image is only half of that of the dual-band infrared focal plane detector. At the same time, due to hardware limitations, the resolution of the dual-band infrared focal plane detector is significantly lower than that of the visible light detector, so this further reduction in resolution will affect the image detail quality and information richness. In order to solve this problem, it is necessary to introduce super-resolution reconstruction technology to improve the resolution of narrowband image information and wideband images, thereby improving image quality, making up for the lack of hardware resolution, and meeting the needs of refined imaging.

[0006] For conventional array-type dual-band infrared focal plane detectors, a variety of computationally based super-resolution reconstruction methods have been proposed, including interpolation, image reconstruction, deep learning, and frequency domain reconstruction. However, due to the errors in the prior model describing the quality degradation mechanism during image sampling, these methods often fail to accurately present the real details of the image when generating reconstructed pixel data through calculation. In addition, these algorithms usually rely on the arrangement of pixels responding to different bands on the infrared focal plane array, which makes them difficult to apply to interlaced coded detectors. Therefore, there is an urgent need to develop a super-resolution reconstruction method designed specifically for interlaced coded dual-band infrared focal plane detectors to improve imaging quality and resolution, thereby achieving low-cost, high-precision dual-band infrared imaging. Summary of the invention

[0007] In order to solve the above problems existing in the prior art, the present invention provides a method and device for micro-scanning super-resolution reconstruction of interlaced coded infrared dual-band images. The technical problem to be solved by the present invention is achieved through the following technical solutions:

[0008] In a first aspect, a micro-scanning super-resolution reconstruction method for an interlaced coded infrared dual-band image comprises:

[0009] S100, constructing a micro scanning device for changing the projection position of a scene point on an imaging plane;

[0010] S200, using a micro-scanning device to periodically move the projection position of each scene point on the imaging plane, collect an interlaced coded infrared dual-band image at each projection position, and obtain a set of interlaced coded infrared dual-band image sequences;

[0011] S300, performing dual-band information separation and single-band information reorganization on the set of interlaced encoded infrared dual-band image sequences to generate a horizontal super-resolution narrow-band infrared image and a horizontal super-resolution wide-band infrared image;

[0012] S400, using a computation-based super-resolution reconstruction method, vertically super-resolution reconstruction is performed on both the horizontal super-resolution narrow-band infrared image and the horizontal super-resolution wide-band infrared image to obtain a bidirectional super-resolution narrow-band infrared image and a bidirectional super-resolution wide-band infrared image.

[0013] In a second aspect, the present invention provides a micro-scanning super-resolution reconstruction device for interlaced coded infrared dual-band images, comprising:

[0014] A construction module is used to construct a micro scanning device for changing the projection position of a scene point on an imaging plane;

[0015] The acquisition module uses a micro-scanning device to periodically move the projection position of each scene point on the imaging plane, and acquires the interlaced coded infrared dual-band image at each projection position to obtain a set of interlaced coded infrared dual-band image sequences;

[0016] A decomposition module is used to separate dual-band information and reorganize single-band information of the set of interlaced encoded infrared dual-band image sequences to generate a horizontal super-resolution narrow-band infrared image and a horizontal super-resolution wide-band infrared image;

[0017] The reconstruction module uses a computation-based super-resolution reconstruction method to perform vertical super-resolution reconstruction on both the horizontal super-resolution narrow-band infrared image and the horizontal super-resolution wide-band infrared image.

[0018] Beneficial effects:

[0019] The present invention provides a micro-scanning super-resolution reconstruction method and device for interlaced coded infrared dual-band images, constructs a micro-scanning device for changing the projection position of a scene point on an imaging plane, and uses the micro-scanning device to obtain an interlaced coded infrared dual-band image sequence in which the projection position of a group of scene points has a half pixel width displacement in the horizontal direction and a pixel height displacement in the vertical direction. Subsequently, the collected interlaced coded infrared dual-band image sequence is subjected to dual-band information separation and single-band information reorganization, and a super-resolution reconstruction algorithm is applied to the reorganized image, and finally a bidirectional super-resolution narrow-band infrared image and a bidirectional super-resolution wide-band infrared image with a resolution four times that of an interlaced coded dual-band infrared focal plane detector are obtained.

[0020] The present invention separates dual-band information and reorganizes single-band information for the collected interlaced coded infrared dual-band image sequence, and obtains a horizontal super-resolution narrow-band infrared image and a horizontal super-resolution wide-band infrared image whose horizontal resolution is twice the horizontal resolution of the detector. Each point of data in the image is the real imaging data of the target scene, which effectively solves the problem that the reconstructed data obtained by calculation is difficult to truly reflect the scene detail information, and improves the detection capability of the interlaced coded infrared dual-band imaging system for small targets. In addition, the super-resolution reconstruction of the horizontal super-resolution narrow-band infrared image and the horizontal super-resolution wide-band infrared image only involves the splicing of the image and the interpolation calculation between two adjacent rows of data, with a small amount of calculation, good real-time algorithm, and convenient hardware implementation, which solves the shortcomings of the current super-resolution reconstruction method when applied to the interlaced coded dual-band infrared focal plane detector.

[0021] The present invention will be further described in detail below with reference to the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Figure 1 It is a flow chart of a micro-scanning super-resolution reconstruction method of an interlaced coded infrared dual-band image proposed in an embodiment of the present invention;

[0023] Figure 2 It is a flow chart of an infrared dual-band image sequence collected by a micro-scanning device proposed in an embodiment of the present invention;

[0024] Figure 3 It is a schematic diagram of synthesizing a narrow-band infrared image and a wide-band infrared image proposed in an embodiment of the present invention;

[0025] Figure 4 It is a structural diagram of a micro-scanning super-resolution reconstruction device for interlaced encoded infrared dual-band images proposed in an embodiment of the present invention. DETAILED DESCRIPTION

[0026] The present invention is further described in detail below with reference to specific embodiments, but the embodiments of the present invention are not limited thereto.

[0027] See also Figure 1 , Figure 2 and Figure 3 , Figure 1 is a flow chart of a micro-scanning super-resolution reconstruction method for interlaced encoded infrared dual-band images proposed in an embodiment of the present invention. Figure 2 is a flow chart of using a micro scanning device to collect an infrared dual-band image sequence according to an embodiment of the present invention. Figure 3 It is a schematic diagram of synthesizing a narrow-band infrared image and a wide-band infrared image proposed in an embodiment of the present invention. Figure 4 The present invention provides a schematic diagram of a micro-scanning super-resolution reconstruction device for interlaced encoded infrared dual-band images.

[0028] like Figure 1 As shown, the present invention provides a micro-scanning super-resolution reconstruction method for interlaced coded infrared dual-band images, comprising:

[0029] S100, constructing a micro scanning device for changing the projection position of a scene point on an imaging plane;

[0030] Among them, the micro-scanning device is installed in the infrared dual-band imaging system, and the infrared dual-band imaging system includes an optical system, a micro-scanning device, a dual-band infrared focal plane detector, and an imaging circuit module; the dual-band infrared focal plane detector is an interlaced coded dual-band infrared focal plane detector.

[0031] The dual-band infrared focal plane detector used in the present invention is an interlaced coded dual-band infrared focal plane detector, which is a prior art. The interlaced coded dual-band infrared focal plane detector is a dual-band infrared focal plane detector described in patent document CN111653630A. The present invention installs a micro scanning device in an optical system, and the dual-band infrared focal plane detector is a prior art.

[0032] When the present invention is used, the working band of the interlaced coding dual-band infrared focal plane detector is 3.0-5.0 μm, the array is 640×512, and the pixel height is equal to the pixel width. The spacing of the pixels in the horizontal and vertical directions is 15 μm. The working band of the filter strip is 3.0-4.0 μm, and the arrangement is interlaced, and the extension direction is consistent with the horizontal direction of the photosensitive surface of the infrared focal plane detector chip. A single filter strip is aligned with a row of pixels in the horizontal direction of the infrared focal plane detector chip, and its width is 15 μm. The spacing between two adjacent filter strips in the vertical direction is twice the pixel spacing, that is, 30 μm.

[0033] The micro-scanning device of the present invention is installed in an optical system. The micro-scanning device uses a focusing lens as a micro-scanning lens. The micro-scanning lens is fixed on a two-dimensional micro-displacement platform and driven by a piezoelectric motion mechanism to move on the two-dimensional micro-displacement platform to scan and obtain an interlaced encoded infrared dual-band image. Specifically, a piezoelectric scanning platform is used as a two-dimensional micro-displacement platform and a piezoelectric motion mechanism. The piezoelectric scanning platform is made of piezoelectric ceramic material and has two horizontal and vertical movement directions. The maximum travel range in the horizontal and vertical directions is 80 μm. The micro-scanning lens is driven to perform horizontal or vertical displacement of a pixel scale on the scanning platform by changing the voltage on the piezoelectric scanning platform.

[0034] S200, using a micro-scanning device to periodically move the projection position of each scene point on the imaging plane, collect an interlaced coded infrared dual-band image at each projection position, and obtain a set of interlaced coded infrared dual-band image sequences;

[0035] In this step, in the current cycle of an image acquisition, according to the rule of performing two horizontal displacements in opposite directions with a projection position displacement distance of 0.5 pixel width of the scene point and two vertical displacements in opposite directions with a projection position displacement distance of 1 pixel height of the scene point, the piezoelectric scanning stage is driven to control the micro-scanning lens to move the projection position of each scene point on the imaging plane of the interlaced coded dual-band infrared focal plane detector a total of four times; and at the projection position after each movement, an interlaced coded infrared dual-band image is collected to form an interlaced coded infrared dual-band image sequence of the current cycle; the horizontal displacement and the vertical displacement are performed alternately, so that the moving trajectory of the projection position of the scene point on the imaging plane in one cycle forms a closed rectangle.

[0036] S300, performing dual-band information separation and single-band information reorganization on a set of interlaced coded infrared dual-band image sequences to generate a horizontal super-resolution narrow-band infrared image and a horizontal super-resolution wide-band infrared image;

[0037] S400, using a computation-based super-resolution reconstruction method, vertically super-resolution reconstruction is performed on both the horizontal super-resolution narrow-band infrared image and the horizontal super-resolution wide-band infrared image to obtain a bidirectional super-resolution narrow-band infrared image and a bidirectional super-resolution wide-band infrared image.

[0038] In a specific implementation of the present invention, S210 includes:

[0039] S211, in the current cycle of capturing a set of interlaced coded infrared dual-band image sequences, driving the piezoelectric scanning stage to control the micro-scanning lens to move each scene point to an initial position on the imaging plane of the interlaced coded dual-band infrared focal plane detector, and capturing the first frame of the current cycle at the initial position;

[0040] S212, driving the piezoelectric scanning stage to control the micro scanning lens to move leftward, so that the projection position of each scene point on the imaging plane moves leftward by 0.5 pixel width, and the second frame image of the sequence is collected at this position;

[0041] S213, driving the piezoelectric scanning stage to control the micro scanning lens to move upward, so that the projection position of each scene point on the imaging plane moves upward by one pixel height, and the third frame image of the sequence is collected at this position;

[0042] S214, driving the piezoelectric scanning stage to control the micro scanning lens to move rightward, so that the projection position of each scene point on the imaging plane moves rightward by 0.5 pixel width, and the fourth frame image of the sequence is collected at this position;

[0043] S215, composing the first to fourth frames of images into a set of interlaced encoded infrared dual-band image sequences of the current period.

[0044] After the current cycle is completed, the present invention needs to drive the piezoelectric scanning stage to control the micro-scanning lens to move downward, so that the projection position of each scene point on the imaging plane returns to the initial position when the first frame image is collected, preparing for the collection of the interlaced encoded infrared dual-band image sequence of the next cycle.

[0045] like Figure 2 As shown, the present invention uses a micro scanning device according to Figure 2 The rule shown periodically moves the projection position of each scene point on the imaging plane. The first frame of the interlaced coded infrared dual-band image sequence is collected when the micro-scanning lens is in the initial position. Then, the piezoelectric scanning stage drives the micro-scanning lens to move to the left, so that the projection position of each scene point on the imaging plane moves to the left by 0.5 pixel width, and the second frame of the image is collected at this displacement position. After completing the acquisition of the second frame of the image, the piezoelectric scanning stage drives the micro-scanning lens to move upward, so that the projection position of each scene point is offset upward by 1 pixel height, and then the third frame of the image is collected. Subsequently, the piezoelectric scanning stage moves the micro-scanning lens to the right, so that the projection position of each scene point is offset to the right by 0.5 pixel width, and the fourth frame of the image is collected at this position. Finally, the piezoelectric scanning stage moves the micro-scanning lens downward, so that the projection position is restored to the initial position when the first frame was collected, thereby completing a cycle of interlaced coded infrared dual-band image sequence acquisition, and preparing for the acquisition of the next set of interlaced coded infrared dual-band image sequences.

[0046] In a specific implementation of the present invention, S300 includes:

[0047] The narrow-band infrared image information provided by all pixels with filter films installed in front of them in the interlaced coded infrared dual-band image sequence is stitched and reassembled, and the stitching and reorganization are performed according to the real spatial position of the scene point corresponding to the pixel in the world coordinate system, so as to generate a horizontal super-resolution narrow-band infrared image with a horizontal resolution twice that of the interlaced coded dual-band infrared focal plane detector and a vertical resolution equal to the vertical resolution of the interlaced coded dual-band infrared focal plane detector;

[0048] S320, synchronously stitching and recombining the wide-band infrared image information provided by all pixels in the interlaced coded infrared dual-band image sequence that do not have a filter film installed in front according to the real spatial position of the scene point corresponding to the pixel in the world coordinate system, to generate a horizontal super-resolution wide-band infrared image with a horizontal resolution that is twice the horizontal resolution of the interlaced coded dual-band infrared focal plane detector and a vertical resolution that is equal to the vertical resolution of the interlaced coded dual-band infrared focal plane detector.

[0049] The present invention Figure 3 The method shown is to separate the dual-band information and reorganize the single-band information of the scene point information contained in the four frames of images in a set of interlaced coded infrared dual-band image sequences, and each frame of the image has 512 rows and 640 columns. The response data of all the pixels with filter films installed in front of the four frames of images are combined and spliced ​​one by one based on the actual position relationship of their corresponding scene points on the imaging plane to generate a horizontal super-resolution narrow-band infrared image with a size of 512 rows and 1280 columns. The horizontal resolution of this image is equivalent to twice the horizontal resolution of the interlaced coded dual-band infrared focal plane detector, while the vertical resolution remains consistent with the vertical resolution of the interlaced coded dual-band infrared focal plane detector. Similarly, the response data of all pixels in the four frames without filter films installed in front are combined and spliced ​​according to their actual positional relationship when projected to the corresponding scene points in the imaging plane, to generate a horizontal super-resolution wide-band infrared image with a horizontal resolution twice that of the interlaced coded dual-band infrared focal plane detector and a vertical resolution equal to the vertical resolution of the interlaced coded dual-band infrared focal plane detector. The number of rows and columns is 512 and 1280, respectively.

[0050] In a specific implementation of the present invention, S400 includes:

[0051] S410, using a computation-based super-resolution reconstruction method, performs vertical super-resolution reconstruction on the horizontal super-resolution narrow-band infrared image and the horizontal super-resolution wide-band infrared image, respectively, to obtain a bidirectional super-resolution narrow-band infrared image and a bidirectional super-resolution wide-band infrared image whose horizontal and vertical resolutions are twice the horizontal and vertical resolutions of an interlaced coded dual-band infrared focal plane detector.

[0052] In a specific implementation of the present invention, S410 includes:

[0053] S411, taking both the horizontal super-resolution narrow-band infrared image and the horizontal super-resolution wide-band infrared image as images to be reconstructed;

[0054] S412, for each image to be reconstructed, taking an average value of data in the same column of two adjacent rows in the image to be reconstructed;

[0055] S413, taking the average value as the generated target data, and supplementing the target data between two adjacent rows of the image to be reconstructed, to obtain a reconstructed image whose horizontal and vertical resolutions are twice the horizontal and vertical resolutions of the interlaced coded dual-band infrared focal plane detector; wherein the reconstructed image corresponding to the horizontal super-resolution narrow-band infrared image is a bidirectional super-resolution narrow-band infrared image, and the reconstructed image corresponding to the horizontal super-resolution wide-band infrared image is a bidirectional super-resolution wide-band infrared image. The sizes of the bidirectional super-resolution narrow-band infrared image and the bidirectional super-resolution wide-band infrared image are both 1024 rows and 1280 columns.

[0056] like Figure 4 As shown, the present invention provides a micro-scanning super-resolution reconstruction device for interlaced coded infrared dual-band images, comprising:

[0057] A construction module 41 is used to construct a micro scanning device for changing the projection position of a scene point on an imaging plane;

[0058] The acquisition module 42 uses a micro-scanning device to periodically move the projection position of each scene point on the imaging plane, and acquires the interlaced coded infrared dual-band image at each projection position to obtain a set of interlaced coded infrared dual-band image sequences;

[0059] A decomposition module 43 performs dual-band information separation and single-band information reorganization on a set of interlaced coded infrared dual-band image sequences to generate a horizontal super-resolution narrow-band infrared image and a horizontal super-resolution wide-band infrared image;

[0060] The reconstruction module 44 uses a computation-based super-resolution reconstruction method to perform vertical super-resolution reconstruction on both the horizontal super-resolution narrow-band infrared image and the horizontal super-resolution wide-band infrared image.

[0061] The present invention provides a micro-scanning super-resolution reconstruction method and device for interlaced coded infrared dual-band images, constructs a micro-scanning device for changing the projection position of scene points on an imaging plane, and uses the micro-scanning device to obtain a set of interlaced coded infrared dual-band image sequences in which a group of scene points have a half pixel width displacement in the horizontal direction and a pixel height displacement in the vertical direction. Subsequently, the collected interlaced coded infrared dual-band image sequence is subjected to dual-band information separation and single-band information reorganization, and a super-resolution reconstruction algorithm is applied to the reorganized image, and finally a bidirectional super-resolution narrow-band infrared image and a bidirectional super-resolution wide-band infrared image with a resolution four times that of an interlaced coded dual-band infrared focal plane detector are obtained. The present invention has the advantages of high resolution of reconstructed images, complete preservation of scene detail information, small amount of calculation, good real-time algorithm, and easy hardware implementation.

[0062] Although the present application is described herein in conjunction with various embodiments, in the process of implementing the claimed application, those skilled in the art may understand and implement other variations of the disclosed embodiments by reviewing the drawings, the disclosure, and the appended claims. In the claims, the word "comprising" does not exclude other components or steps, and "a" or "an" does not exclude a plurality of components or steps.

[0063] The above contents are further detailed descriptions of the present invention in combination with specific preferred embodiments, and it cannot be determined that the specific implementation of the present invention is limited to these descriptions. For ordinary technicians in the technical field to which the present invention belongs, several simple deductions or substitutions can be made without departing from the concept of the present invention, which should be regarded as falling within the protection scope of the present invention.

Claims

1. A micro-scanning super-resolution reconstruction method for interlaced coded infrared dual-band images, characterized in that: include: S100, constructing a micro scanning device for changing the projection position of a scene point on an imaging plane; S200, using a micro-scanning device to periodically move the projection position of each scene point on the imaging plane, collect an interlaced coded infrared dual-band image at each projection position, and obtain a set of interlaced coded infrared dual-band image sequences; S300, performing dual-band information separation and single-band information reorganization on the set of interlaced encoded infrared dual-band image sequences to generate a horizontal super-resolution narrow-band infrared image and a horizontal super-resolution wide-band infrared image; S400, using a computation-based super-resolution reconstruction method, vertically super-resolution reconstruction is performed on both the horizontal super-resolution narrow-band infrared image and the horizontal super-resolution wide-band infrared image to obtain a bidirectional super-resolution narrow-band infrared image and a bidirectional super-resolution wide-band infrared image.

2. The micro-scanning super-resolution reconstruction method of interlaced coded infrared dual-band images according to claim 1 is characterized in that: The micro-scanning device is installed in an infrared dual-band imaging system, which includes an optical system, a micro-scanning device, a dual-band infrared focal plane detector, and an imaging circuit module; the dual-band infrared focal plane detector is an interlaced coding dual-band infrared focal plane detector; The optical system is used to converge light onto the interlaced coded dual-band infrared focal plane detector, which captures infrared intensity information of incident light in a narrow band and a wide band respectively, and outputs the interlaced coded infrared dual-band image.

3. The micro-scanning super-resolution reconstruction method of interlaced coded infrared dual-band images according to claim 2 is characterized in that: The micro-scanning device is installed in the optical system. The micro-scanning device uses a focusing lens as a micro-scanning lens. The micro-scanning lens is fixed on a two-dimensional micro-displacement platform and driven by a piezoelectric motion mechanism to move on the two-dimensional micro-displacement platform to scan and obtain an interlaced encoded infrared dual-band image.

4. The micro-scanning super-resolution reconstruction method of interlaced coded infrared dual-band images according to claim 3 is characterized in that: S200 includes: S210, in a current cycle of image acquisition, according to the rule of performing two horizontal displacements in opposite directions with a projection position displacement distance of 0.5 pixel width of the scene point and performing two vertical displacements in opposite directions with a projection position displacement distance of 1 pixel height of the scene point, driving the piezoelectric motion mechanism to control the micro-scanning lens to move the projection position of each scene point on the imaging plane of the interlaced coded dual-band infrared focal plane detector a total of four times; and at the projection position after each movement, collecting an interlaced coded infrared dual-band image to form an interlaced coded infrared dual-band image sequence of the current cycle; the horizontal displacement and the vertical displacement are performed alternately, so that the moving trajectory of the projection position of the scene point on the imaging plane in one cycle forms a closed rectangle.

5. The micro-scanning super-resolution reconstruction method of interlaced coded infrared dual-band images according to claim 4 is characterized in that: S210 includes: S211, in the current cycle of capturing a set of interlaced coded infrared dual-band image sequences, driving the piezoelectric motion mechanism to control the micro-scanning lens to move each scene point to an initial position on the imaging plane of the interlaced coded dual-band infrared focal plane detector, and capturing the first frame of the current cycle at the initial position; S212, driving the piezoelectric motion mechanism to control the micro-scanning mirror to move leftward, so that the projection position of each scene point on the imaging plane moves leftward by 0.5 pixel width, and the second frame image of the sequence is collected at this position; S213, driving the piezoelectric motion mechanism to control the micro-scanning mirror to move upward, so that the projection position of each scene point on the imaging plane moves upward by one pixel height, and the third frame image of the sequence is collected at this position; S214, driving the piezoelectric motion mechanism to control the micro-scanning mirror to move rightward, so that the projection position of each scene point on the imaging plane moves rightward by 0.5 pixel width, and the fourth frame image of the sequence is collected at this position; S215, composing the first to fourth frames of images into a set of interlaced encoded infrared dual-band image sequences of the current period.

6. The micro-scanning super-resolution reconstruction method of interlaced coded infrared dual-band images according to claim 5, characterized in that: After S214, the micro-scanning super-resolution reconstruction method of the interlaced coded infrared dual-band image further includes: The piezoelectric motion mechanism is driven to control the micro-scanning mirror to move downward, so that the projection position of each scene point on the imaging plane returns to the initial position when the first frame of the image is collected, preparing for the collection of the next cycle of interlaced encoded infrared dual-band image sequence.

7. The micro-scanning super-resolution reconstruction method of interlaced coded infrared dual-band images according to claim 4, characterized in that: S300 includes: S310, stitching and reorganizing the narrow-band infrared image information provided by all the pixels with filter films installed in front of them in the interlaced coded infrared dual-band image sequence, stitching and reorganizing according to the real spatial positions of the scene points corresponding to the pixels in the world coordinate system, to generate a horizontal super-resolution narrow-band infrared image with a horizontal resolution twice that of the interlaced coded dual-band infrared focal plane detector and a vertical resolution equal to the vertical resolution of the interlaced coded dual-band infrared focal plane detector; S320, synchronously stitching and recombining the wide-band infrared image information provided by all pixels in the interlaced coded infrared dual-band image sequence that do not have a filter film installed in front according to the real spatial position of the scene point corresponding to the pixel in the world coordinate system, to generate a horizontal super-resolution wide-band infrared image with a horizontal resolution that is twice the horizontal resolution of the interlaced coded dual-band infrared focal plane detector and a vertical resolution that is equal to the vertical resolution of the interlaced coded dual-band infrared focal plane detector.

8. The micro-scanning super-resolution reconstruction method of interlaced coded infrared dual-band images according to claim 7, characterized in that: S400 includes: S410, using a computation-based super-resolution reconstruction method to perform vertical super-resolution reconstruction on the horizontal super-resolution narrow-band infrared image and the horizontal super-resolution wide-band infrared image, respectively, to obtain a bidirectional super-resolution narrow-band infrared image and a bidirectional super-resolution wide-band infrared image whose horizontal and vertical resolutions are twice the horizontal and vertical resolutions of the interlaced coded dual-band infrared focal plane detector.

9. The micro-scanning super-resolution reconstruction method of interlaced coded infrared dual-band images according to claim 8, characterized in that: S410 includes: S411, taking both the horizontal super-resolution narrow-band infrared image and the horizontal super-resolution wide-band infrared image as images to be reconstructed; S412, for each image to be reconstructed, taking an average value of data in the same column of two adjacent rows in the image to be reconstructed; S413, taking the average value as the generated target data, and supplementing the target data between two adjacent rows of the image to be reconstructed, to obtain a reconstructed image whose horizontal and vertical resolutions are twice the horizontal and vertical resolutions of the interlaced coded dual-band infrared focal plane detector; wherein the reconstructed image corresponding to the horizontal super-resolution narrow-band infrared image is a bidirectional super-resolution narrow-band infrared image, and the reconstructed image corresponding to the horizontal super-resolution wide-band infrared image is a bidirectional super-resolution wide-band infrared image.

10. A micro-scanning super-resolution reconstruction device for interlaced coded infrared dual-band images, characterized in that: include: A construction module is used to construct a micro scanning device for changing the projection position of a scene point on an imaging plane; The acquisition module uses a micro-scanning device to periodically move the projection position of each scene point on the imaging plane, and acquires the interlaced coded infrared dual-band image at each projection position to obtain a set of interlaced coded infrared dual-band image sequences; A decomposition module is used to separate dual-band information and reorganize single-band information of the set of interlaced encoded infrared dual-band image sequences to generate a horizontal super-resolution narrow-band infrared image and a horizontal super-resolution wide-band infrared image; The reconstruction module uses a computation-based super-resolution reconstruction method to perform vertical super-resolution reconstruction on both the horizontal super-resolution narrow-band infrared image and the horizontal super-resolution wide-band infrared image.

Citation Information

Patent Citations

  • Intelligent infrared thermal imaging and high-definition visible light dual-band video surveillance system

    CN103974039B

  • An ultraviolet-visible double optical path imaging detection system

    CN105227818B

  • Visible and Infrared Hybrid Imaging Detector Pixel Structure and Its Preparation Method

    CN105244357B

  • Manufacturing method of double-color focal plane detector and double-color image acquisition method

    CN111653630A

  • Multi-aperture multi-band high-resolution-ratio imaging device and method

    CN104168429A