An infrared array image enhancement system and method based on contourlet transform

Through contourlet transformation and denoising processing technology, the image blur problem in infrared imaging systems is solved, the image clarity and contrast of the image are improved, and a clearer infrared imaging effect is achieved.

CN112884674BActive Publication Date: 2024-11-22CHANGZHOU YUANJING ELECTRONIC TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202110270843.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-03-12
Publication Date
2024-11-22
Estimated Expiration
2041-03-12

AI Technical Summary

Technical Problem

When an infrared imaging system acquires images, the image is blurred due to the influence of infrared components in natural light and the infrared radiation that is not targeted at a distance.

Method used

Using an infrared array image enhancement system based on contourlet transformation, contourlet transformation and denoising are performed through the combination of image acquisition, infrared focal plane array, circuit reading, analog signal processing, analog-to-digital conversion, digital signal processing and display units, and the contourlet transformation and denoising are performed to separate And enhance the high-frequency and low-frequency components of the image, improving the contrast and details of the image.

Benefits of technology

The signal-to-noise ratio and contrast of the image are improved, thereby improving the sharpness of the image.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112884674B_ABST
    Figure CN112884674B_ABST
Patent Text Reader

Abstract

The present invention relates to the field of infrared thermal imaging technology, and in particular to an infrared array image enhancement system and method based on contourlet transform, the system comprising: an image acquisition unit for receiving infrared radiation transmitted by the target and background through the atmosphere; an infrared focal plane array unit for converting the light signal focused by the image acquisition unit into an electrical signal proportional to the light signal; a circuit readout unit for reading and outputting the electrical signal converted from the infrared focal plane array unit; an analog signal processing unit for amplifying the electrical signal of the circuit readout unit; an analog-to-digital conversion unit for converting the analog signal into a digital signal; a digital signal processing unit for performing contourlet transform on the converted digital signal and performing denoising on the transformed signal; and a display unit for displaying a new image after the transform and denoising process. The present invention improves the contrast of high-frequency components and improves the details of low-frequency components.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of infrared thermal imaging technology, and in particular to an infrared array image enhancement system and method based on contourlet transform. Background Art

[0002] Infrared thermal imaging uses infrared detectors and optical imaging lenses to receive the infrared radiation energy distribution pattern of the target to be measured and reflect it on the photosensitive element of the infrared detector, thereby obtaining an infrared thermal image, which corresponds to the heat distribution field on the surface of the object. The infrared imaging system is a passive imaging system, so it has good concealment. It breaks through the visual limitations of the human eye due to illumination and spectral response range, so it has a longer working distance than the visible light system, has stronger smoke penetration and anti-interference capabilities, and can work almost around the clock.

[0003] However, since natural light contains a lot of infrared components, these infrared components will affect the color. Moreover, during image acquisition, infrared components emitted by distant non-targets will also affect the final image, resulting in problems such as blurred images.

[0004] The information disclosed in this background technology section is only intended to deepen the understanding of the overall background technology of the present invention, and should not be regarded as acknowledging or suggesting in any form that the information constitutes the prior art known to those skilled in the art. Summary of the invention

[0005] The technical problem to be solved by the present invention is to provide an infrared array image enhancement system and method based on contourlet transform to improve the clarity of infrared imaging.

[0006] In order to achieve the above object, the present invention provides an infrared array image enhancement system based on contourlet transform, comprising:

[0007] An image acquisition unit, used to receive infrared radiation transmitted by the target and background through the atmosphere;

[0008] An infrared focal plane array unit, connected to the image acquisition unit, and used to convert the optical signal focused by the image acquisition unit into an electrical signal proportional to the optical signal;

[0009] A circuit readout unit, connected to the infrared focal plane array unit, for reading and outputting the electrical signal converted from the infrared focal plane array unit;

[0010] an analog signal processing unit, connected to the circuit readout unit, and used to amplify the electrical signal of the circuit readout unit;

[0011] an analog-to-digital conversion unit, connected to the analog signal processing unit, and configured to convert the analog signal into a digital signal;

[0012] A digital signal processing unit, connected to the analog-to-digital conversion unit, for performing contourlet transformation on the converted digital signal and performing denoising on the transformed signal;

[0013] The display unit is connected to the digital signal processing unit and is used to display the new image after the transformation and denoising process.

[0014] Furthermore, the infrared focal plane array unit also includes a bias unit and a drive pulse generating unit, the bias unit is used to amplify the entire signal cycle of the triode circuit, and the drive pulse generating unit is used to provide a drive pulse for the infrared focal plane array unit.

[0015] Furthermore, the digital signal processing unit is used to obtain low-frequency components and high-frequency components by performing contourlet transform on the digital signal, and to denoise the obtained low-frequency components and high-frequency components.

[0016] Furthermore, the denoising method of the digital signal processing unit includes hard threshold denoising, soft threshold denoising and semi-threshold denoising.

[0017] Furthermore, the digital signal processing unit performs a mapping transformation function on the denoised high-frequency component to enhance the denoised high-frequency component, and its gain function is as follows:

[0018]

[0019]

[0020]

[0021] Among them, W in (i, j) represents the coefficient after contourlet decomposition, W out (i, j) represents the contourlet coefficient obtained by the mapping function, b is the noise threshold, c is the gain adjustment factor, and d ranges from 0.05 to 1.

[0022] Furthermore, the digital signal processing unit performs a mapping transformation function on the denoised low-frequency component to enhance the denoised low-frequency component, and the linear mapping function is as follows:

[0023]

[0024]

[0025] in:

[0026] Win (i, j) represents the coefficient after contourlet decomposition, W out (i, j) represents the contourlet coefficient obtained by the mapping function, a is the noise gain, b is the noise threshold, c is the gain adjustment factor, and d ranges from 0.05 to 1.

[0027] Furthermore, the digital signal processing unit also uses an inverse transformation method on the transformed high-frequency component and the low-frequency component to obtain a new image.

[0028] Another aspect of the present invention further provides an infrared array image enhancement method, which is applied to the infrared array image enhancement system based on contourlet transform as described in any one of claims 1 to 7, and is characterized in that it comprises the following steps:

[0029] Acquire a target image and focus it on the photosensitive surface of an infrared focal plane array unit;

[0030] Acquiring an analog electrical signal converted by the infrared focal plane array unit;

[0031] amplifying the analog electrical signal and converting it into a digital electrical signal;

[0032] Performing contourlet transformation on the digital electrical signal to obtain a low-frequency component and a high-frequency component;

[0033] De-noising low-frequency components and high-frequency components;

[0034] The high frequency components are enhanced by mapping transformation functions to improve the contrast of the image;

[0035] Perform linear mapping function transformation on low-frequency components to enhance image details;

[0036] The transformed high-frequency components and low-frequency components are inversely transformed to obtain a new image.

[0037] Furthermore, the function for mapping the high frequency component is:

[0038]

[0039]

[0040]

[0041] Among them, W in (i, j) represents the coefficient after contourlet decomposition, W out(i, j) represents the contourlet coefficient obtained by the mapping function, b is the noise threshold, c is the gain adjustment factor, and d ranges from 0.05 to 1.

[0042] Furthermore, the function for performing linear mapping function transformation on the low-frequency component is:

[0043]

[0044]

[0045] in:

[0046] W in (i, j) represents the coefficient after contourlet decomposition, W out (i, j) represents the contourlet coefficient obtained by the mapping function, a is the noise gain, b is the noise threshold, c is the gain adjustment factor, and d ranges from 0.05 to 1.

[0047] The beneficial effects of the present invention are as follows: the present invention utilizes contourlet transform to transform and denoise the high-frequency components and low-frequency components of an image, thereby improving the contrast of the high-frequency components and the details of the low-frequency components, and finally uses an inverse transform method to combine the two, thereby improving the signal-to-noise ratio and contrast of the image, thereby improving the clarity of the image. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0049] Figure 1 Schematic diagram of the structure of an infrared array image enhancement system based on contourlet transform in an embodiment of the present invention;

[0050] Figure 2 The figure is a flow chart of an image enhancement method using an infrared array image enhancement system based on contourlet transform in an embodiment of the present invention. DETAILED DESCRIPTION

[0051] The technical solutions in the embodiments of the present invention will be described clearly and completely below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than all the embodiments.

[0052] It should be noted that when an element is referred to as being "fixed to" another element, it may be directly on the other element or there may be a central element. When an element is considered to be "connected to" another element, it may be directly connected to the other element or there may be a central element at the same time. The terms "vertical", "horizontal", "left", "right" and similar expressions used herein are for illustrative purposes only and do not represent the only implementation method.

[0053] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by technicians in the technical field of the present invention. The terms used in the specification of the present invention are only for the purpose of describing specific embodiments and are not intended to limit the present invention. The term "and / or" used in this article includes any and all combinations of one or more related listed items. The infrared array image enhancement system based on contourlet transform of the present invention can separate multi-scale analysis and directional analysis, making the image enhancement effect more obvious and highlighting the part of interest. It is more superior to the current wavelet transform method. The following part of this embodiment will describe the system and method in detail.

[0054] The infrared array image enhancement system based on contourlet transform of the present invention can perform multi-scale analysis and directional analysis separately, making the image enhancement effect more obvious and highlighting the part of interest. It is more superior to the current wavelet transform method. The following part of this embodiment will describe the system and method in detail.

[0055] like Figure 1 The infrared array image enhancement system based on contourlet transform shown in the figure comprises: an infrared focal plane array unit 20, an infrared focal plane array unit 20, a circuit readout unit 30, an analog signal processing unit 40, an analog-to-digital conversion unit 50, a digital signal processing unit 60 and a display unit 70, wherein:

[0056] The image acquisition unit 10 is used to receive infrared radiation transmitted by the target and background through the atmosphere; the image acquisition unit 10 here can be an optical system, for example, it can be a lens combination at the lens end of a camera. Through the image acquisition unit 10, the target to be collected can be focused to improve the quality of the collected image.

[0057] The infrared focal plane array unit 20 is connected to the image acquisition unit 10 and is used to convert the optical signal focused by the image acquisition unit 10 into an electrical signal proportional to the optical signal; a photosensitive element array is arranged on the infrared focal plane array unit 20, and the photosensitive element array can convert the optical signal into an electrical signal.

[0058] The circuit readout unit 30 is connected to the infrared focal plane array unit 20 and is used to read the electrical signal converted from the infrared focal plane array unit 20 and output it; the output here is a one-dimensional video signal.

[0059] The analog signal processing unit 40 is connected to the circuit readout unit 30 and is used to amplify the electrical signal of the circuit readout unit 30; the one-dimensional video signal is amplified by the analog signal processor to facilitate the subsequent signal processing.

[0060] The analog-to-digital conversion unit 50 is connected to the analog signal processing unit 40 and is used to convert the analog signal into a digital signal;

[0061] The digital signal processing unit 60 is connected to the analog-to-digital conversion unit 50 and is used to perform contourlet transformation on the converted digital signal and perform denoising on the transformed signal;

[0062] The display unit 70 is connected to the digital signal processing unit 60 and is used to display the new image after the transformation and denoising process.

[0063] In the above embodiment, the high-frequency component and the low-frequency component of the image are transformed and denoised by using contourlet transform, thereby improving the contrast of the high-frequency component and improving the details of the low-frequency component. Finally, the inverse transformation method is used to combine the two, so that the image has improved signal-to-noise ratio and contrast, thereby improving image clarity.

[0064] In a preferred embodiment of the present invention, the infrared focal plane array unit 20 further includes a bias unit and a driving pulse generating unit 22. The bias unit is used to amplify the entire signal cycle of the triode circuit, and the driving pulse generating unit 22 is used to provide a driving pulse for the infrared focal plane array unit 20. In the triode amplifier circuit, if no bias circuit is added, only one half cycle of the signal generates current in the base, and a part of this half cycle will be less than the threshold voltage of the triode. Therefore, the triode can only amplify less than one half cycle of the signal. In order to amplify the entire signal cycle, a bias circuit needs to be added.

[0065] Specifically, when processing the digital signal, the digital signal processing unit 60 is used to obtain low-frequency components and high-frequency components by performing contourlet transformation on the digital signal, and to denoise the obtained low-frequency components and high-frequency components.

[0066] Regarding denoising, the denoising methods of the digital signal processing unit 60 include hard threshold denoising, soft threshold denoising and semi-threshold denoising. Hard denoising has the advantage of high signal-to-noise ratio, but there is jitter and it is not smooth, while the characteristic of soft denoising is smoothness. In the embodiment of the present invention, different methods are used to denoise the high-frequency component and the low-frequency component respectively, and since the noise strength of the high-frequency component is different at different levels and in different directions, different threshold parameters, that is, the semi-threshold method, are used to retain as many useful information features as possible.

[0067] The processed high-frequency components are enhanced by an adaptive mapping transformation function. The adaptive transformation adopted can perform linear stretching to different degrees according to the characteristics of the coefficients in each layer direction, thereby improving the contrast of the image. The digital signal processing unit 60 enhances the denoised high-frequency components by a mapping transformation function, and its gain function is as follows:

[0068]

[0069]

[0070]

[0071] Among them, W in (i, j) represents the coefficient after contourlet decomposition, W out (i, j) represents the contourlet coefficient obtained by the mapping function, b is the noise threshold, c is the gain adjustment factor (the value range is 20 to 50), and the range of d is 0.05-1.

[0072] Furthermore, the same linear transformation is applied to the low-frequency components to achieve the effect of enhancing the image details to a certain extent. The linear mapping function is as follows:

[0073]

[0074]

[0075] in:

[0076] W in (i, j) represents the coefficient after contourlet decomposition, W out (i, j) represents the contourlet coefficient obtained by the mapping function, a is the noise gain, b is the noise threshold, c is the gain adjustment factor, and d ranges from 0.05 to 1. a' has the same meaning as a, b' has the same meaning as b, c' has the same meaning as c, and d' has the same meaning as d, but the values ​​are different.

[0077] Finally, the digital signal processing unit also uses an inverse transformation method on the transformed high-frequency component and low-frequency component to obtain a new image.

[0078] The embodiment of the present invention further provides an infrared array image enhancement method, which is applied to the above-mentioned infrared array image enhancement system based on contourlet transform, such as Figure 2 As shown in , the following steps are included:

[0079] S10: Acquire the target image and focus it on the photosensitive surface of the infrared focal plane array unit;

[0080] S20: Acquire the analog electrical signal converted by the infrared focal plane array unit;

[0081] S30: amplifying the analog electrical signal and converting it into a digital electrical signal;

[0082] S40: performing contourlet transformation on the digital electrical signal to obtain a low-frequency component and a high-frequency component;

[0083] S50: denoising low-frequency components and high-frequency components;

[0084] S60: performing mapping transformation function enhancement on the high frequency component to improve the contrast of the image;

[0085] S70: performing a linear mapping function transformation on the low-frequency component to enhance the details of the image;

[0086] S80: Perform inverse transformation on the transformed high-frequency component and low-frequency component to obtain a new image. The specific processing method of the high-frequency component and the low-frequency component has been described above and will not be repeated here; it should also be pointed out that the system and method in the embodiment of the present invention can also be applied in the fields of early warning, detection and tracking, imaging guidance, scientific research, remote sensing, industrial detection, etc.

[0087] Those skilled in the art should understand that the present invention is not limited to the above embodiments, and the above embodiments and descriptions are only for explaining the principles of the present invention. Without departing from the spirit and scope of the present invention, the present invention may have various changes and improvements, and these changes and improvements fall within the scope of the present invention to be protected. The scope of protection of the present invention is defined by the attached claims and their equivalents.

Claims

1. An infrared array image enhancement system based on contourlet transform, characterized in that: include: An image acquisition unit, used to receive infrared radiation transmitted by the target and background through the atmosphere; An infrared focal plane array unit, connected to the image acquisition unit, and used to convert the optical signal focused by the image acquisition unit into an electrical signal proportional to the optical signal; A circuit readout unit, connected to the infrared focal plane array unit, for reading and outputting the electrical signal converted from the infrared focal plane array unit; an analog signal processing unit, connected to the circuit readout unit, and used to amplify the electrical signal of the circuit readout unit; an analog-to-digital conversion unit, connected to the analog signal processing unit, and configured to convert the analog signal into a digital signal; A digital signal processing unit, connected to the analog-to-digital conversion unit, for performing contourlet transformation on the converted digital signal and performing denoising on the transformed signal; A display unit connected to the digital signal processing unit, used to display the new image after the transformation and denoising process; The digital signal processing unit is used to obtain low-frequency components and high-frequency components by performing contourlet transformation on the digital signal, and denoise the obtained low-frequency components and high-frequency components; the denoising method of the digital signal processing unit includes hard threshold denoising, soft threshold denoising and semi-threshold denoising; The high-frequency component and the low-frequency component are denoised by different methods respectively, and the high-frequency component is denoised by a semi-threshold method; the digital signal processing unit performs a mapping transformation function on the denoised high-frequency component to enhance the denoised high-frequency component, and the gain function is as follows: in, represents the coefficients after contourlet decomposition, represents the contourlet coefficient obtained by the mapping function, b is the noise threshold, c is the gain adjustment factor, and d ranges from 0.05 to 1; The digital signal processing unit performs a mapping transformation function on the denoised low-frequency component to enhance the denoised low-frequency component, and the linear mapping function is as follows: in: represents the coefficients after contourlet decomposition, represents the contourlet coefficient obtained by using the mapping function, a is the noise gain, b is the noise threshold, c is the gain adjustment factor, and d ranges from 0.05 to 1.

2. The infrared array image enhancement system based on contourlet transform according to claim 1, characterized in that: The infrared focal plane array unit also includes a bias unit and a driving pulse generating unit. The bias unit is used to amplify the entire signal cycle of the triode circuit, and the driving pulse generating unit is used to provide a driving pulse for the infrared focal plane array unit.

3. The infrared array image enhancement system based on contourlet transform according to claim 1, characterized in that: The digital signal processing unit also uses an inverse transformation method on the transformed high-frequency component and the low-frequency component to obtain a new image.

4. An infrared array image enhancement method, applied to the infrared array image enhancement system based on contourlet transform as claimed in any one of claims 1 to 3, characterized in that: The following steps are involved: Acquire a target image and focus it on the photosensitive surface of an infrared focal plane array unit; Acquiring an analog electrical signal converted by the infrared focal plane array unit; amplifying the analog electrical signal and converting it into a digital electrical signal; Performing contourlet transformation on the digital electrical signal to obtain a low-frequency component and a high-frequency component; De-noising low-frequency components and high-frequency components; The high frequency components are enhanced by mapping transformation functions to improve the contrast of the image; Perform linear mapping function transformation on low-frequency components to enhance image details; The transformed high-frequency components and low-frequency components are inversely transformed to obtain a new image.