Correction coefficient determination method, stripe noise correction method, device and equipment

Abstract

The embodiment of the invention provides a correction coefficient determination method, a stripe noise correction method, a device and equipment, and relates to the technical field of infrared detection, and the correction coefficient determination method comprises the steps: obtaining the response output of each pixel in thermal imaging equipment at a first transmittance and a second transmittance for a uniform black body at a first temperature and a second temperature, calculating a first gain matrix and a second gain matrix according to a two-point correction method based on response outputs obtained under the first transmittance and the second transmittance respectively; the first temperature is higher than the second temperature; the second transmittance is smaller than the first transmittance; respectively extracting high-frequency information of the first gain matrix and the second gain matrix in the first direction to obtain first high-frequency information and second high-frequency information; and replacing the second high-frequency information contained in the second gain matrix with the first high-frequency information to obtain a third gain matrix for correcting stripe noise in the second direction. Therefore, the applicability of the determined correction coefficient can be improved.

Description

Technical Field

[0001] The present application relates to the field of infrared detection technology, and in particular to a correction coefficient determination method, a stripe noise correction method, a device and an apparatus. Background Art

[0002] The infrared detector in a thermal imaging device converts infrared radiation emitted by an object into an electrical signal to produce an infrared image. Infrared detectors typically use an infrared focal plane array (IFPA) to receive infrared radiation. Integrating readout circuits and an ADC (analog to digital converter) are used to convert the infrared radiation emitted by an object into an electrical signal, generating the response output of each pixel in the IFPA to produce an infrared image. The integrating readout circuit and ADC can be referred to as signal conversion circuits. Pixels in the same row and / or column share a signal conversion circuit; that is, the signal conversion circuit is shared at the row and / or column level. Signal conversion circuits in different rows often differ and lack consistency, resulting in differences in the response output of pixels in different rows. This means that pixels in different rows will produce different response outputs to the same infrared radiation, resulting in horizontal lines in the infrared image. Similarly, lack of consistency in signal conversion circuits in different columns can result in vertical lines in the infrared image. Both horizontal and vertical lines are referred to as streak noise, and the presence of streak noise can lead to poor image quality in infrared images.

[0003] For example, stripe noise can be corrected using a two-point correction method. Based on the response output of each pixel in the thermal imaging device to two uniform blackbodies at relatively high and low temperatures, a gain coefficient for compensating for gain stripe noise and an offset coefficient for compensating for offset stripe noise can be calibrated. Both the gain coefficient and the offset coefficient can be referred to as correction coefficients. Gain stripe noise is affected by the intensity of infrared radiation emitted by the object to be detected. When the object to be detected is an ultra-high temperature object, the infrared radiation intensity emitted by the object to be detected is relatively high, and the intensity of the gain stripe noise is also relatively high. However, because the temperature of the uniform blackbody used during calibration cannot reach ultra-high temperatures, the calibrated gain coefficient cannot effectively correct gain stripe noise, and its applicability is low.

[0004] It can be seen that how to improve the applicability of the determined correction coefficient to effectively correct the stripe noise and improve the image quality of infrared images has become an urgent problem to be solved. Summary of the Invention

[0005] The present invention aims to provide a method for determining a correction coefficient, a method, apparatus, and device for correcting streak noise, thereby improving the applicability of the determined correction coefficients, effectively correcting streak noise, and improving the image quality of infrared images. The specific technical solutions are as follows:

[0006] In a first aspect of the present application, a method for determining a correction coefficient is provided, the method comprising:

[0007] Obtaining the response output of each pixel in the thermal imaging device at a first transmittance to a uniform black body at a first temperature and a second temperature, respectively, and calculating a gain coefficient of each pixel according to a two-point correction method based on the obtained response outputs to obtain a first gain matrix; wherein the first temperature is greater than the second temperature;

[0008] Obtaining response outputs of each pixel at a second transmittance for a uniform black body at the first temperature and the second temperature, respectively, and calculating a gain coefficient of each pixel according to a two-point correction method based on the obtained response outputs to obtain a second gain matrix; wherein the second transmittance is less than the first transmittance;

[0009] Extracting high-frequency information of the first gain matrix and the second gain matrix in a first direction respectively to obtain first high-frequency information and second high-frequency information; wherein the first direction is one of a horizontal direction and a column direction;

[0010] The second high-frequency information contained in the second gain matrix is ​​replaced by the first high-frequency information to obtain a third gain matrix for correcting stripe noise in a second direction; wherein the second direction is another direction in the horizontal direction and the column direction except the first direction.

[0011] Optionally, extracting high-frequency information of the first gain matrix and the second gain matrix in the first direction respectively to obtain first high-frequency information and second high-frequency information includes:

[0012] respectively extracting low-frequency information of the first gain matrix and the second gain matrix in the second direction to obtain first low-frequency information and second low-frequency information;

[0013] respectively extracting low-frequency information of the first low-frequency information and the second low-frequency information in the first direction to obtain third low-frequency information and fourth low-frequency information;

[0014] The third low-frequency information in the first low-frequency information is removed to obtain high-frequency information of the first gain matrix in the first direction as first high-frequency information, and the fourth low-frequency information in the second low-frequency information is removed to obtain high-frequency information of the second gain matrix in the first direction as second high-frequency information.

[0015] Optionally, respectively extracting low-frequency information of the first gain matrix and the second gain matrix in the second direction to obtain first low-frequency information and second low-frequency information includes:

[0016] Calculating the mean of each row of gain coefficients in the second direction in the first gain matrix to obtain an element in the first low-frequency information; calculating the mean of each row of gain coefficients in the second direction in the second gain matrix to obtain an element in the second low-frequency information;

[0017] The removing the third low-frequency information from the first low-frequency information to obtain high-frequency information of the first gain matrix in the first direction as the first high-frequency information, and removing the fourth low-frequency information from the second low-frequency information to obtain high-frequency information of the second gain matrix in the first direction as the second high-frequency information, includes:

[0018] The third low-frequency information is removed from the first low-frequency information, and the removal result is expanded in the second direction to obtain high-frequency information of the first gain matrix in the first direction as the first high-frequency information. The fourth low-frequency information is removed from the second low-frequency information, and the removal result is expanded in the second direction to obtain high-frequency information of the second gain matrix in the first direction as the second high-frequency information.

[0019] Optionally, extracting low-frequency information of the first low-frequency information and the second low-frequency information in the first direction respectively to obtain third low-frequency information and fourth low-frequency information includes:

[0020] filtering the elements in the first low-frequency information according to a sliding mean filtering algorithm to obtain third low-frequency information;

[0021] The elements in the second low-frequency information are filtered according to a sliding mean filtering algorithm to obtain fourth low-frequency information.

[0022] Optionally, the gain coefficient of each pixel in the third gain matrix represents: a difference between the gain coefficient of the pixel in the second gain matrix and a corresponding element in the second high-frequency information, and a sum of the gain coefficient of the pixel in the first high-frequency information;

[0023] or,

[0024] The gain coefficient of each pixel in the third gain matrix represents: the product of the ratio of the gain coefficient of the pixel in the second gain matrix to the corresponding element in the second high-frequency information and the element corresponding to the pixel in the first high-frequency information.

[0025] Optionally, after replacing the second high-frequency information included in the second gain matrix with the first high-frequency information to obtain a third gain matrix for correcting the stripe noise in the second direction, the method further includes:

[0026] Calculating the response output of each pixel at the first transmittance to a uniform black body at the first temperature and the second temperature using the third gain matrix and a two-point correction method, and calculating the gain coefficient of each pixel according to the two-point correction method based on the calculated response output to obtain a fourth gain matrix;

[0027] Calculating the response output of each pixel at the second transmittance to a uniform black body at the first temperature and the second temperature using the third gain matrix and a two-point correction method, and calculating the gain coefficient of each pixel using the two-point correction method based on the calculated response output to obtain a fifth gain matrix;

[0028] extracting high-frequency information in the second direction from the fourth gain matrix and the fifth gain matrix respectively to obtain third high-frequency information and fourth high-frequency information;

[0029] The fourth high-frequency information included in the fifth gain matrix is ​​replaced by the third high-frequency information to obtain a sixth gain matrix for correcting stripe noise in the first direction.

[0030] Optionally, the first transmittance represents: the overall transmittance inside the thermal imaging device when the thermal imaging device is not equipped with a lens, or the overall transmittance inside the thermal imaging device when equipped with a first lens; the second transmittance represents: the overall transmittance inside the thermal imaging device when equipped with a second lens.

[0031] A second aspect of the present application further provides a stripe noise correction method, the method comprising:

[0032] Obtaining a gain matrix for correcting streak noise; wherein the obtained gain matrix is ​​obtained based on any of the correction coefficient determination methods described above;

[0033] Using the obtained gain matrix and two-point correction method, the initial response output detected by each pixel in the thermal imaging device is corrected to obtain the corrected target response output;

[0034] The obtained target response output is used to generate an infrared image.

[0035] Optionally, the method of using the obtained gain matrix and the two-point correction method to correct the initial response output detected by each pixel in the thermal imaging device to obtain a corrected target response output includes:

[0036] Using the acquired third gain matrix for correcting the stripe noise in the second direction and a two-point correction method, correcting the initial response output detected by each pixel in the thermal imaging device to obtain a corrected target response output;

[0037] or,

[0038] The initial response output detected by each pixel in the thermal imaging device is corrected using the third gain matrix and the two-point correction method obtained for correcting the stripe noise in the second direction to obtain a corrected response output; and the response output after the single correction is corrected using the sixth gain matrix and the two-point correction method obtained for correcting the stripe noise in the first direction to obtain a corrected target response output.

[0039] In a third aspect of the present application, there is further provided a correction coefficient determination device, the device comprising:

[0040] a first gain matrix calculation module, configured to obtain a response output of each pixel in the thermal imaging device at a first transmittance, for a uniform black body at a first temperature and a second temperature, respectively, and calculate a gain coefficient of each pixel according to a two-point correction method based on the obtained response outputs to obtain a first gain matrix; wherein the first temperature is greater than the second temperature;

[0041] a second gain matrix calculation module, configured to obtain a response output of each pixel at a second transmittance to a uniform black body at the first temperature and the second temperature, respectively, and calculate a gain coefficient of each pixel according to a two-point correction method based on the obtained response output to obtain a second gain matrix; wherein the second transmittance is less than the first transmittance;

[0042] a high-frequency information extraction module, configured to extract high-frequency information of the first gain matrix and the second gain matrix in a first direction, respectively, to obtain first high-frequency information and second high-frequency information; wherein the first direction is one of a horizontal direction and a column direction;

[0043] a third gain matrix determination module, configured to replace the second high-frequency information contained in the second gain matrix with the first high-frequency information to obtain a third gain matrix for correcting stripe noise in a second direction; wherein the second direction is another direction in the horizontal and column directions other than the first direction.

[0044] Optionally, the high-frequency information extraction module includes:

[0045] A first extraction submodule, configured to extract low-frequency information of the first gain matrix and the second gain matrix in a second direction respectively, to obtain first low-frequency information and second low-frequency information;

[0046] a second extraction submodule, configured to extract low-frequency information of the first low-frequency information and the second low-frequency information in a first direction, respectively, to obtain third low-frequency information and fourth low-frequency information;

[0047] a high-frequency information determination submodule, configured to remove the third low-frequency information from the first low-frequency information to obtain high-frequency information of the first gain matrix in the first direction as first high-frequency information, and to remove the fourth low-frequency information from the second low-frequency information to obtain high-frequency information of the second gain matrix in the first direction as second high-frequency information.

[0048] Optionally, the first extraction submodule is specifically configured to calculate the mean of the gain coefficients in each row in the second direction in the first gain matrix to obtain an element in the first low-frequency information; and calculate the mean of the gain coefficients in each row in the second direction in the second gain matrix to obtain an element in the second low-frequency information;

[0049] The high-frequency information determination submodule is specifically configured to remove the third low-frequency information from the first low-frequency information, expand the removal result in the second direction, and obtain high-frequency information of the first gain matrix in the first direction as the first high-frequency information; and remove the fourth low-frequency information from the second low-frequency information, expand the removal result in the second direction, and obtain high-frequency information of the second gain matrix in the first direction as the second high-frequency information.

[0050] Optionally, the second extraction submodule is specifically used to filter the elements in the first low-frequency information according to a sliding mean filtering algorithm to obtain third low-frequency information; and filter the elements in the second low-frequency information according to a sliding mean filtering algorithm to obtain fourth low-frequency information.

[0051] Optionally, the gain coefficient of each pixel in the third gain matrix represents: the difference between the gain coefficient of the pixel in the second gain matrix and the corresponding element in the second high-frequency information, and the sum of the element corresponding to the pixel in the first high-frequency information; or, the gain coefficient of each pixel in the third gain matrix represents: the ratio of the gain coefficient of the pixel in the second gain matrix and the corresponding element in the second high-frequency information, and the product of the element corresponding to the pixel in the first high-frequency information.

[0052] Optionally, the device further includes:

[0053] a fourth gain matrix calculation module, configured to, after replacing the second high-frequency information included in the second gain matrix with the first high-frequency information to obtain a third gain matrix for correcting streak noise in the second direction, calculate, using the third gain matrix and a two-point correction method, a response output of each pixel at the first transmittance for a uniform black body at the first temperature and the second temperature, respectively; and, based on the calculated response output, calculate a gain coefficient of each pixel using the two-point correction method to obtain a fourth gain matrix;

[0054] a fifth gain matrix calculation module, configured to calculate, using the third gain matrix and a two-point correction method, a response output of each pixel at the second transmittance to a uniform black body at the first temperature and the second temperature, respectively, and calculate a gain coefficient of each pixel according to the two-point correction method based on the calculated response output to obtain a fifth gain matrix;

[0055] a high-frequency information determination module, configured to extract high-frequency information in the second direction from the fourth gain matrix and the fifth gain matrix, respectively, to obtain third high-frequency information and fourth high-frequency information;

[0056] The sixth gain matrix determination module is configured to replace the fourth high-frequency information included in the fifth gain matrix with the third high-frequency information to obtain a sixth gain matrix for correcting the stripe noise in the first direction.

[0057] Optionally, the first transmittance represents: the overall transmittance inside the thermal imaging device when the thermal imaging device is not equipped with a lens, or the overall transmittance inside the thermal imaging device when equipped with a first lens; the second transmittance represents: the overall transmittance inside the thermal imaging device when equipped with a second lens.

[0058] In a fourth aspect of the present application, a stripe noise correction device is provided, comprising:

[0059] A gain matrix acquisition module, configured to acquire a gain matrix for correcting streak noise; wherein the acquired gain matrix is ​​obtained based on any of the correction coefficient determination methods described above;

[0060] A response output correction module is used to correct the initial response output detected by each pixel in the thermal imaging device using the obtained gain matrix and the two-point correction method to obtain a corrected target response output;

[0061] The infrared image generation module is used to generate an infrared image using the obtained target response output.

[0062] Optionally, the response output correction module is specifically configured to correct the initial response output detected by each pixel in the thermal imaging device using the acquired third gain matrix for correcting the stripe noise in the second direction and a two-point correction method to obtain a corrected target response output;

[0063] or,

[0064] The initial response output detected by each pixel in the thermal imaging device is corrected using the third gain matrix and the two-point correction method obtained for correcting the stripe noise in the second direction to obtain a corrected response output; and the response output after the single correction is corrected using the sixth gain matrix and the two-point correction method obtained for correcting the stripe noise in the first direction to obtain a corrected target response output.

[0065] Another aspect of the present application provides an electronic device, including:

[0066] Memory for storing computer programs;

[0067] The processor is configured to implement any of the above-mentioned correction coefficient determination methods or any of the above-mentioned stripe noise correction methods when executing the program stored in the memory.

[0068] An embodiment of the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the computer program implements any of the above-mentioned correction coefficient determination methods or any of the above-mentioned stripe noise correction methods.

[0069] An embodiment of the present application further provides a computer program product comprising instructions, which, when executed on a computer, enables the computer to execute any of the aforementioned correction coefficient determination methods or any of the aforementioned stripe noise correction methods.

[0070] Beneficial effects of the embodiments of the present application:

[0071] A correction coefficient determination method provided in an embodiment of the present application can obtain the response output of each pixel in a thermal imaging device for a uniform black body at a first temperature and a second temperature, respectively, at a first transmittance, and calculate the gain coefficient of each pixel according to a two-point correction method based on the obtained response output to obtain a first gain matrix; wherein the first temperature is greater than the second temperature; obtain the response output of each pixel for a uniform black body at the first temperature and the second temperature, respectively, at a second transmittance, and calculate the gain coefficient of each pixel according to a two-point correction method based on the obtained response output to obtain a second gain matrix; wherein the second transmittance is less than the first transmittance; extract high-frequency information of the first gain matrix and the second gain matrix in a first direction respectively to obtain first high-frequency information and second high-frequency information; wherein the first direction is one of the horizontal and column directions; replace the second high-frequency information contained in the second gain matrix with the first high-frequency information to obtain a third gain matrix for correcting stripe noise in the second direction; wherein the second direction is another direction in the horizontal and column directions other than the first direction.

[0072] Based on the above processing, for the same temperature, the higher the transmittance of the thermal imaging device, the greater the infrared radiation intensity received by each pixel. Accordingly, by detecting a uniform black body of the first and second temperatures at a higher transmittance (i.e., the first transmittance), the situation of detecting an ultra-high temperature object at a lower transmittance (i.e., the second transmittance) can be simulated. Accordingly, the response output of each pixel at the first transmittance can effectively represent the response output when detecting an ultra-high temperature object, and can also effectively reflect the gain-related stripe noise that is greatly affected by the infrared radiation intensity. In this case, the high-frequency information (i.e., the first high-frequency information) in the first direction of the calculated gain matrix (i.e., the first gain matrix) can also effectively compensate for the stripe noise in the second direction when detecting an ultra-high temperature object.

[0073] Because ultra-high-temperature objects emit high levels of infrared radiation, to prevent infrared radiation saturation at each pixel in a thermal imaging device, the transmittance of thermal imaging devices is often low when measuring ultra-high-temperature objects. Accordingly, the response output of each pixel in the thermal imaging device at the second transmittance effectively reflects the impact of the lower transmittance on the response output of each pixel. In this case, the low-frequency information in the calculated gain matrix (i.e., the second gain matrix) can effectively compensate for the low-frequency noise when detecting ultra-high-temperature objects.

[0074] Therefore, the second high-frequency information in the second gain matrix can be replaced with the first high-frequency information to obtain a third gain matrix. Subsequently, using this third gain matrix effectively compensates for streak noise in the second direction when detecting ultra-high-temperature objects, while also effectively compensating for the impact of low transmittance on the response output of each pixel. In other words, the third gain matrix is ​​suitable for correcting streak noise in areas with high gain intensity. This improves the applicability of the determined correction coefficients, effectively correcting streak noise and improving the quality of infrared images.

[0075] Of course, it is not necessary to achieve all the advantages described above at the same time when implementing any product or method of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0076] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other embodiments can also be obtained based on these drawings.

[0077] Figure 1 A schematic diagram of a first flow chart of a method for determining a correction coefficient provided in an embodiment of the present application;

[0078] Figure 2 A second flow chart of the method for determining the correction coefficient provided in an embodiment of the present application;

[0079] Figure 3 A schematic flow chart of a stripe noise correction method provided in an embodiment of the present application;

[0080] Figure 4 A schematic flow chart of another stripe noise correction method provided in an embodiment of the present application;

[0081] Figure 5a A schematic diagram of an infrared image generated using the initial response output detected by each pixel provided in an embodiment of the present application;

[0082] Figure 5b A schematic diagram of an infrared image generated using a corrected target response output provided by an embodiment of the present application;

[0083] Figure 6 A schematic structural diagram of a correction coefficient determination device provided in an embodiment of the present application;

[0084] Figure 7 A schematic structural diagram of a stripe noise correction device provided in an embodiment of the present application;

[0085] Figure 8 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0086] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field based on this application are within the scope of protection of this application.

[0087] Objects with temperatures above absolute zero (-273°C) emit infrared radiation. The infrared detector in a thermal imaging device converts this radiation into electrical signals, producing an infrared image. The infrared radiation emitted by an object passes through the thermal imaging device's lens and is received by the infrared detector's infrared focal plane array (IFPA). Combined with a signal conversion circuit, this converts the object's infrared radiation into electrical signals, generating the response output of each pixel in the IFPA to produce an infrared image.

[0088] In order to solve the problem of stripe noise and low image quality in infrared images obtained by thermal imaging equipment, the stripe noise can be corrected by the two-point correction method. However, the gain coefficient obtained by calibration cannot effectively correct the stripe noise in the gain aspect with higher intensity, and its applicability is not high.

[0089] In order to improve the applicability of the determined correction coefficients, effectively correct streak noise, and improve the image quality of infrared images, the present application provides a correction coefficient determination method, which can be applied to electronic devices. For example, the electronic device can be a processor in a thermal imaging device, and the processor can execute steps S101 to S104 to obtain a third gain matrix for correcting streak noise in the second direction. Figure 1 , Figure 1 This is a schematic diagram of a first flow chart of a method for determining a correction coefficient provided in an embodiment of the present application. The method may include the following steps:

[0090] Step S101: Obtain the response output of each pixel in the thermal imaging device at a first transmittance to a uniform black body at a first temperature and a second temperature, respectively, and calculate the gain coefficient of each pixel according to the two-point correction method based on the obtained response output to obtain a first gain matrix.

[0091] The first temperature is greater than the second temperature.

[0092] Step S102: Obtain the response output of each pixel at the second transmittance for a uniform black body at the first temperature and the second temperature, respectively, and calculate the gain coefficient of each pixel according to the two-point correction method based on the obtained response output to obtain a second gain matrix.

[0093] The second transmittance is smaller than the first transmittance.

[0094] Step S103: extracting high-frequency information of the first gain matrix and the second gain matrix in the first direction respectively to obtain first high-frequency information and second high-frequency information.

[0095] The first direction is one of a transverse direction and a column direction.

[0096] Step S104: replacing the second high-frequency information included in the second gain matrix with the first high-frequency information to obtain a third gain matrix for correcting the stripe noise in the second direction.

[0097] The second direction is another direction in the transverse direction and the column direction except the first direction.

[0098] Based on the above processing, for the same temperature, the higher the transmittance of the thermal imaging device, the greater the infrared radiation intensity received by each pixel. Accordingly, by detecting a uniform black body of the first and second temperatures at a higher transmittance (i.e., the first transmittance), the situation of detecting an ultra-high temperature object at a lower transmittance (i.e., the second transmittance) can be simulated. Accordingly, the response output of each pixel at the first transmittance can effectively represent the response output when detecting an ultra-high temperature object, and can also effectively reflect the gain-related stripe noise that is greatly affected by the infrared radiation intensity. In this case, the high-frequency information (i.e., the first high-frequency information) in the first direction of the calculated gain matrix (i.e., the first gain matrix) can also effectively compensate for the stripe noise in the second direction when detecting an ultra-high temperature object.

[0099] Because ultra-high-temperature objects emit high levels of infrared radiation, to prevent infrared radiation saturation at each pixel in a thermal imaging device, the transmittance of thermal imaging devices is often low when measuring ultra-high-temperature objects. Accordingly, the response output of each pixel in the thermal imaging device at the second transmittance effectively reflects the impact of the lower transmittance on the response output of each pixel. In this case, the low-frequency information in the calculated gain matrix (i.e., the second gain matrix) can effectively compensate for the low-frequency noise when detecting ultra-high-temperature objects.

[0100] Therefore, the second high-frequency information in the second gain matrix can be replaced with the first high-frequency information to obtain a third gain matrix. Subsequently, using this third gain matrix effectively compensates for streak noise in the second direction when detecting ultra-high-temperature objects, while also effectively compensating for the impact of low transmittance on the response output of each pixel. In other words, the third gain matrix is ​​suitable for correcting streak noise in areas with high gain intensity. This improves the applicability of the determined correction coefficients, effectively correcting streak noise and improving the quality of infrared images.

[0101] For steps S101 and S102, two uniform black bodies at different temperatures can be pre-set, namely, uniform black bodies at a first temperature and a second temperature. The first temperature is greater than the second temperature. For example, the first temperature can be 50°C or 60°C, and the second temperature can be 10°C or 15°C. The transmittance of the thermal imaging device can be set to a first transmittance and a second transmittance, respectively. The second transmittance is less than the first transmittance.

[0102] For the same temperature, the higher the transmittance of a thermal imaging device, the greater the intensity of infrared radiation received by each pixel. Accordingly, by detecting uniform black bodies at first and second temperatures at a higher transmittance (i.e., the first transmittance), it is possible to simulate detecting ultra-high temperature objects at a lower transmittance (i.e., the second transmittance). The response output of each pixel at the first transmittance effectively represents the response output when detecting an ultra-high temperature object, and thus effectively reflects the gain-related streak noise, which is significantly affected by infrared radiation intensity. Streak noise is a high-frequency noise.

[0103] Because ultra-high-temperature objects emit high levels of infrared radiation, to prevent infrared radiation saturation at each pixel in a thermal imaging device, the transmittance of thermal imaging devices is often low when measuring ultra-high-temperature objects. Accordingly, the response output of each pixel in the thermal imaging device at the second transmittance effectively reflects the impact of the lower transmittance on the pixel's response output. This effectively reflects low-frequency noise, but not fringe noise in the gain region, which is more significantly affected by infrared radiation intensity.

[0104] The first transmittance and the second transmittance may represent the overall transmittance within the thermal imaging device. For example, the overall transmittance within the thermal imaging device may be adjusted by adjusting the lens of the thermal imaging device and / or optical parameters within the thermal imaging device. For example, optical parameters may include aperture and exposure time. A larger aperture and a longer exposure time result in a higher overall transmittance.

[0105] In one implementation, the first transmittance represents: the overall transmittance inside the thermal imaging device when the thermal imaging device is not equipped with a lens, or the overall transmittance inside the thermal imaging device when equipped with a first lens; the second transmittance represents: the overall transmittance inside the thermal imaging device when equipped with a second lens.

[0106] In this implementation, the thermal imaging device may not be equipped with a lens, or it may be equipped with a first lens so that the overall transmittance within the thermal imaging device is a first transmittance. The thermal imaging device may be equipped with a second lens so that the overall transmittance within the thermal imaging device is a second transmittance. The first lens and the second lens may be made of different materials, or they may be made of the same material, with the aperture of the first lens being larger than the aperture of the second lens. The first lens may be called a high-transmittance lens, and the second lens may be called a low-transmittance lens or an ultra-high-temperature lens. For example, the aperture of the first lens may be F1.0, and the aperture of the second lens may be F4.0.

[0107] In this way, the transmittance of the thermal imaging device can be set, and the first transmittance can be ensured to be greater than the second transmittance, thereby ensuring that the response output of each pixel in the thermal imaging device at different transmittances can be obtained later to calculate the gain matrix.

[0108] At a first transmittance, the thermal imaging device detects a uniform blackbody at a first temperature and a second temperature, respectively. Accordingly, the response output of each pixel in the thermal imaging device at the first transmittance, respectively, for the uniform blackbody at the first temperature and the second temperature, can be obtained. Based on the obtained response output, the gain coefficient of each pixel can be calculated using the two-point correction method to obtain a first gain matrix. The coordinates of any pixel in the infrared focal plane array are consistent with the position of the pixel's gain coefficient in the gain matrix. For example, for a pixel with coordinates (i, j) in the infrared focal plane array, that is, the pixel in the i-th row and j-th column of the infrared focal plane array, the gain coefficient of this pixel can be located in the i-th row and j-th column of the gain matrix.

[0109] The two-point correction response model of the infrared detector is as follows:

[0110] Y i,j =G i,j ·K i,j ·X i,j +C i,j

[0111] Among them, Y i,j G represents the response output of the pixel with coordinates (i, j) in the infrared focal plane array after correction using the two-point correction method. i,j Represents the initial gain coefficient of the pixel with coordinates (i, j), G i,j =1,K i,j Represents the non-uniform correction coefficient of the pixel with coordinates (i, j), that is, the gain coefficient of the pixel with coordinates (i, j) in the gain matrix (which can be expressed as K), X i,j Represents the initial response output detected by the pixel with coordinates (i, j), C i,j is the offset coefficient of the pixel with coordinates (i, j).

[0112] According to the two-point correction method, the gain coefficient of each pixel can be calculated according to the following formula:

[0113]

[0114] Among them, K i,j Represents the gain coefficient of the pixel with coordinates (i, j) in the gain matrix, H i,j The pixel with coordinates (i, j) is outputted in response to a uniform black body at the first temperature. L i,jrepresents the response output of the pixel with coordinates (i, j) to a uniform black body at the second temperature, where I and J represent the row and column numbers of the pixel in the infrared focal plane array, respectively.

[0115] Based on the above method, the first gain matrix can be calculated. Similarly, under the second transmittance, the second gain matrix can be calculated. The execution order of step S101 and step S102 can be set as needed and is not limited.

[0116] For steps S103 and S104, the first direction can be either the horizontal or column direction, and the second direction can be another direction other than the first direction. For example, the first direction can be the horizontal direction, and the second direction can be the column direction; or, the first direction can be the column direction, and the second direction can be the horizontal direction. High-frequency information of the first gain matrix and the second gain matrix in the first direction can be extracted, respectively, to obtain first high-frequency information and second high-frequency information. The high-frequency information can also be in matrix form. For the method of extracting high-frequency information, please refer to the relevant description of Methods 1 and 2 in the subsequent embodiments.

[0117] The high-frequency information (i.e., the first high-frequency information) in the first direction of the gain matrix (i.e., the first gain matrix) calculated under high transmittance conditions can effectively compensate for the stripe noise in the second direction when detecting ultra-high temperature objects. The low-frequency information in the gain matrix (i.e., the second gain matrix) calculated under low transmittance conditions can effectively compensate for the low-frequency noise when detecting ultra-high temperature objects. However, since the temperature of the uniform black body used when calibrating the second gain matrix cannot reach ultra-high temperatures, the response output of each pixel in the thermal imaging device at a lower transmittance (i.e., the second transmittance) cannot effectively represent the response output when detecting ultra-high temperature objects. In this case, the high-frequency information (i.e., the second high-frequency information) in the calculated second gain matrix cannot effectively compensate for the stripe noise in the second direction when detecting ultra-high temperature objects.

[0118] Therefore, the second high-frequency information contained in the second gain matrix can be replaced with the first high-frequency information to obtain a third gain matrix for correcting streak noise in the second direction. Subsequently, using this third gain matrix can effectively compensate for streak noise in the second direction when detecting ultra-high-temperature objects, while also effectively compensating for the effects of low transmittance on the response output of each pixel.

[0119] In one embodiment, the gain coefficient of each pixel in the third gain matrix represents: the difference between the gain coefficient of the pixel in the second gain matrix and the corresponding element in the second high-frequency information, and the sum of the element corresponding to the pixel in the first high-frequency information; or, the gain coefficient of each pixel in the third gain matrix represents: the ratio of the gain coefficient of the pixel in the second gain matrix and the corresponding element in the second high-frequency information, and the product of the element corresponding to the pixel in the first high-frequency information.

[0120] In the embodiment of the present application, the second high-frequency information contained in the second gain matrix can be replaced with the first high-frequency information by addition, subtraction, multiplication, or division operations to obtain the third gain matrix, which can also be referred to as obtaining the third gain matrix through a masking scheme.

[0121] When using addition and subtraction operations, for each pixel, the difference between the gain coefficient of the pixel in the second gain matrix and the corresponding element in the second high-frequency information can be calculated, and the sum of the obtained difference and the element corresponding to the pixel in the first high-frequency information can be calculated to obtain the gain coefficient of the pixel in the third gain matrix. Alternatively, the sum of the gain coefficient of the pixel in the second gain matrix and the corresponding element in the first high-frequency information can be calculated first, and the difference between the obtained sum and the element corresponding to the pixel in the second high-frequency information can be calculated to obtain the gain coefficient of the pixel in the third gain matrix. The order of addition and subtraction calculations is not limited, as long as the gain coefficient of the pixel in the third gain matrix can represent: the difference between the gain coefficient of the pixel in the second gain matrix and the corresponding element in the second high-frequency information, and the sum of the element corresponding to the pixel in the first high-frequency information.

[0122] When using multiplication and division operations, for each pixel, the ratio of the gain coefficient of the pixel in the second gain matrix to the corresponding element in the second high-frequency information can be calculated, and the product of the obtained ratio and the element corresponding to the pixel in the first high-frequency information can be calculated to obtain the gain coefficient of the pixel in the third gain matrix. Alternatively, the product of the gain coefficient of the pixel in the second gain matrix and the corresponding element in the first high-frequency information can be calculated first, and the ratio of the obtained product to the element corresponding to the pixel in the second high-frequency information can be calculated to obtain the gain coefficient of the pixel in the third gain matrix. The order of multiplication and division calculations is not limited, as long as the gain coefficient of the pixel in the third gain matrix can be expressed as: the product of the ratio of the gain coefficient of the pixel in the second gain matrix to the corresponding element in the second high-frequency information and the element corresponding to the pixel in the first high-frequency information.

[0123] Based on the above processing, the second high-frequency information contained in the second gain matrix can be replaced with the first high-frequency information, resulting in a third gain matrix for correcting streak noise in the second direction. Subsequently, using this third gain matrix effectively corrects streak noise in the second direction when detecting ultra-high-temperature objects while also effectively compensating for the effects of low transmittance on the response output of each pixel. In other words, the third gain matrix is ​​suitable for correcting streak noise in areas with high gain intensity.

[0124] In addition, compared with addition and subtraction operations, multiplication and division operations will cause the noise information in the first high-frequency information and the second high-frequency information to be expanded. Therefore, the first high-frequency information and the second high-frequency information obtained by addition and subtraction operations are relatively less affected by the noise information, which can further improve the effectiveness of the third gain matrix obtained by subsequently replacing the second high-frequency information in the second gain matrix with the first high-frequency information, and further ensure that the applicability of the determined correction coefficient can be improved to effectively correct the stripe noise and improve the quality of the infrared image.

[0125] In this application, the high-frequency information contained in the gain matrix can be extracted by the following methods:

[0126] In method 1, the low-frequency information of the first gain matrix and the second gain matrix in the first direction can be extracted respectively to obtain the fifth low-frequency information and the sixth low-frequency information. For example, for any gain matrix of the first gain matrix and the second gain matrix, the gain matrix can be filtered in the first direction according to the first filtering method to obtain the low-frequency information of the gain matrix in the first direction. For example, the first filtering method can be mean filtering, sliding mean filtering, or Gaussian filtering. The fifth low-frequency information in the first gain matrix can be removed to obtain the high-frequency information of the first gain matrix in the first direction, that is, the first high-frequency information, and the sixth low-frequency information in the second gain matrix can be removed to obtain the high-frequency information of the second gain matrix in the first direction, that is, the second high-frequency information. For example, the difference between the first gain matrix and the fifth low-frequency information can be calculated to obtain the first high-frequency information, and the difference between the second gain matrix and the sixth low-frequency information can be calculated to obtain the second high-frequency information.

[0127] In the second approach, low-frequency information of the first gain matrix and the second gain matrix in the second direction can be extracted, and then the extracted low-frequency information can be processed to obtain high-frequency information of the first gain matrix and the second gain matrix in the first direction. Figure 2 , Figure 2 This is a second flow chart of the correction coefficient determination method provided in the embodiment of the present application. Step S103 includes:

[0128] Step S1031: extracting low-frequency information of the first gain matrix and the second gain matrix in the second direction respectively to obtain first low-frequency information and second low-frequency information.

[0129] Step S1032: extracting low-frequency information of the first low-frequency information and the second low-frequency information in the first direction respectively to obtain third low-frequency information and fourth low-frequency information.

[0130] Step S1033: removing the third low-frequency information from the first low-frequency information to obtain the high-frequency information of the first gain matrix in the first direction as the first high-frequency information, and removing the fourth low-frequency information from the second low-frequency information to obtain the high-frequency information of the second gain matrix in the first direction as the second high-frequency information.

[0131] In an embodiment of the present application, low-frequency information in the second direction of the first and second gain matrices can be extracted separately to obtain the first and second low-frequency information. For example, for either the first or second gain matrix, the gain matrix can be filtered in the second direction using a second filtering method to obtain the low-frequency information of the gain matrix in the second direction. For example, the second filtering method can be mean filtering, sliding mean filtering, or Gaussian filtering. Furthermore, low-frequency information in the first direction of the first and second low-frequency information can be extracted separately to obtain third and fourth low-frequency information. For example, for the first or second low-frequency information, the low-frequency information can be filtered in the first direction using a third filtering method to obtain the low-frequency information of the low-frequency information in the first direction. For example, the third filtering method can be mean filtering, sliding mean filtering, or Gaussian filtering. The first, second, and third filtering methods can be the same or different and can be selected as needed without specific limitation. The third low-frequency information is removed from the first low-frequency information to obtain high-frequency information of the first gain matrix in the first direction as the first high-frequency information. The fourth low-frequency information in the second low-frequency information is removed to obtain high-frequency information of the second gain matrix in the first direction as the second high-frequency information.

[0132] Based on the above processing, by extracting low-frequency information in the second direction from the first and second gain matrices and then processing the extracted low-frequency information, high-frequency information in the first direction from the first and second gain matrices is obtained. This reduces the impact of high-frequency noise in the gain matrices, further ensuring that the obtained high-frequency information can effectively compensate for streak noise in the second direction when detecting ultra-high-temperature objects, thereby improving the accuracy of the obtained high-frequency information. Furthermore, this further ensures the accuracy of the subsequently obtained third gain matrix, further improving the applicability of the determined correction coefficients, effectively correcting streak noise and improving the quality of infrared images.

[0133] In one embodiment, step S1031 may include: calculating the mean of each row of gain coefficients in the second direction in the first gain matrix to obtain elements in the first low-frequency information; calculating the mean of each row of gain coefficients in the second direction in the second gain matrix to obtain elements in the second low-frequency information.

[0134] Step S1033 may include: removing the third low-frequency information in the first low-frequency information, and expanding the removal result in the second direction to obtain the high-frequency information of the first gain matrix in the first direction as the first high-frequency information, and removing the fourth low-frequency information in the second low-frequency information, and expanding the removal result in the second direction to obtain the high-frequency information of the second gain matrix in the first direction as the second high-frequency information.

[0135] In an embodiment of the present application, the second filtering method can be mean filtering. For each row in the second direction in the first gain matrix, the mean of the gain coefficients of the row can be calculated as the element of the row in the first low-frequency information. For each row in the second direction in the second gain matrix, the mean of the gain coefficients of the row can be calculated as the element of the row in the second low-frequency information. When the second direction is horizontal, each row in the second direction is a row. Accordingly, the first low-frequency information and the second low-frequency information can be column matrices, and the number of elements contained in the first low-frequency information and the second low-frequency information is the same as the number of rows of the second gain matrix. When the second direction is column-oriented, each row in the second direction is a column. Accordingly, the first low-frequency information and the second low-frequency information can be row matrices, and the number of elements contained in the first low-frequency information and the second low-frequency information is the same as the number of columns of the second gain matrix.

[0136] Taking the second direction as the column direction as an example, the first gain matrix can be expressed as K1, and the second gain matrix can be expressed as K2. The first low-frequency information and the second low-frequency information can be extracted according to the following formula:

[0137]

[0138] Among them, K1L j K1 represents the element in the jth column of the first low-frequency information; i,j K2L represents the element in the i-th row and j-th column of the first gain matrix; I and J represent the number of rows and columns of pixels in the infrared focal plane array, respectively. j K2 represents the element in the jth column of the second low-frequency information; i,j Represents the element in the i-th row and j-th column of the second gain matrix. Correspondingly, K1L represents the first low-frequency information, and K2L represents the second low-frequency information. The first low-frequency information and the second low-frequency information can also be called a column-wise low-frequency matrix.

[0139] In this case, in the first and second low-frequency information, each row in the second direction has only one element. Correspondingly, in the third low-frequency information derived from the first low-frequency information and the fourth low-frequency information derived from the second low-frequency information, each row in the second direction also has only one element. The removal result obtained by removing the third low-frequency information from the first low-frequency information can be referred to as the first removal result, and the removal result obtained by removing the fourth low-frequency information from the second low-frequency information can be referred to as the second removal result. In both the first and second removal results, each row in the second direction also has only one element.

[0140] To ensure that the second high-frequency information contained in the second gain matrix can subsequently be replaced with the first high-frequency information, it is necessary to ensure that the dimensions of the first high-frequency information, the second high-frequency information, and the second gain matrix are consistent. That is, it is necessary to ensure that the number of elements in each row in the second direction of the first high-frequency information and the second high-frequency information is the same as the number of gain coefficients in each row in the second direction of the second gain matrix. Therefore, it is necessary to expand the first and second removal results in the second direction so that the expanded first and second high-frequency information have the same dimensions as the second gain matrix.

[0141] For example, the elements of each row in the first direction of the expanded first high-frequency information and the second high-frequency information can be the same. If the second direction is horizontal, the first removal result and the second removal result can be column matrices, and the first removal result and the second removal result can be expanded in the column direction respectively, and the elements of each row in the expanded first high-frequency information and the second high-frequency information are the same. If the second direction is column, the first removal result and the second removal result can be row matrices, and the first removal result and the second removal result can be expanded in the horizontal direction respectively, and the elements of each column in the expanded first high-frequency information and the second high-frequency information are the same. For example, if the number of rows of each pixel is I and the number of columns is J, then the second gain matrix is ​​a matrix with I rows and J columns, and the first removal result and the second removal result are row matrices with J columns. The first removal result and the second removal result can be expanded in the horizontal direction according to the following formula:

[0142] K1LH′ i,j =K1LH j , i=1,2,3……I

[0143] K2LH' i,j =K2LH j , i=1,2,3……I

[0144] Among them, K1LH and K2LH represent the first removal result and the second removal result respectively, K1LH' i,j and K2LH' i,j Respectively represent the elements of the i-th row and j-th column in the first high-frequency information and the second high-frequency information; K1LHj Represents the element in the jth column of the first removal result; K2LH j Represents the element in the j-th column of the second removal result.

[0145] Based on the above processing, the first and second low-frequency information can be extracted through mean filtering. This ensures that the low-frequency information in the second direction from the first and second gain matrices can be extracted and then processed to obtain the high-frequency information in the first direction from the first and second gain matrices. This reduces the impact of high-frequency noise in the gain matrices, further ensuring that the obtained high-frequency information can effectively compensate for streak noise in the second direction when detecting ultra-high-temperature objects, thereby improving the accuracy of the obtained high-frequency information. Furthermore, this further ensures the accuracy of the subsequently obtained third gain matrix, further improving the applicability of the determined correction coefficients, effectively correcting streak noise and improving the quality of infrared images.

[0146] In one embodiment, step S1032 may include: filtering the elements in the first low-frequency information according to a sliding mean filtering algorithm to obtain third low-frequency information; and filtering the elements in the second low-frequency information according to a sliding mean filtering algorithm to obtain fourth low-frequency information.

[0147] In an embodiment of the present application, the third filtering method may be a sliding mean filtering. The sliding window size may be set as needed without specific limitation. For example, the sliding window size may be 8 or 10. For each element in the first low-frequency information, the sliding window corresponding to the element in the first direction may be determined according to the sliding window size, and the mean of each element contained in the sliding window corresponding to the element may be calculated to obtain the sliding mean corresponding to the element as the element at the position of the element in the third low-frequency information. Taking the first direction as the horizontal direction as an example, the first gain matrix may be expressed as K1, and the second gain matrix may be expressed as K2. The third low-frequency information and the fourth low-frequency information may be extracted according to the following formula:

[0148]

[0149] Among them, K1LL j Represents the element of the jth column in the third low-frequency information; K1L j+m represents the element in the j+mth column of the first low-frequency information; n represents the size of the sliding window. K2LL j represents the element of the jth column in the fourth low-frequency information; K2L j+m Represents the element in the j+mth column of the second low-frequency information. Correspondingly, K1LL represents the third low-frequency information, and K2LL represents the fourth low-frequency information. The third low-frequency information and the fourth low-frequency information can also be called a horizontal low-frequency matrix.

[0150] The first removal result and the second removal result can be obtained by the following formula:

[0151] K1LH j =K1L j -K1LL j

[0152] K2LH j =K2L j -K2LL j

[0153] Among them, K1LH j Represents the element in the jth column of the first removal result; K1L j Represents the element in the jth column of the first low-frequency information; K1LL j K2LH represents the element in the jth column of the third low-frequency information. j Represents the element in the jth column of the second removal result; K2L j Represents the element in the jth column of the second low-frequency information; K2LL j Represents the element in the j-th column of the fourth low-frequency information.

[0154] Accordingly, the third gain matrix can be calculated by any of the following formulas:

[0155] Knew i,j =K2 i,j -K2LH′ i,j +K1LH' i,j

[0156] Knew i,j =K2 i,j / K2LH' i,j ×K1LH' i,j

[0157] Among them, Knew i,j represents the gain coefficient of the i-th row and j-th column in the third gain matrix, K2 i,j Represents the gain coefficient of the i-th row and j-th column in the second gain matrix, K1LH' i,j and K2LH' i,j Represent the elements in the i-th row and j-th column in the first high-frequency information and the second high-frequency information respectively.

[0158] Based on the above processing, the third and fourth low-frequency information can be extracted through sliding mean filtering. This ensures that the low-frequency information in the second direction from the first and second gain matrices can be extracted and then processed to obtain the high-frequency information in the first direction from the first and second gain matrices. This reduces the impact of high-frequency noise in the gain matrices, further ensuring that the obtained high-frequency information can effectively compensate for streak noise in the second direction when detecting ultra-high-temperature objects, thereby improving the accuracy of the obtained high-frequency information. Furthermore, this further ensures the accuracy of the subsequently obtained third gain matrix and improves the applicability of the determined correction coefficients, effectively correcting streak noise and enhancing the quality of infrared images.

[0159] In one embodiment, a correction coefficient (i.e., a sixth gain matrix) for correcting the stripe noise in the first direction may also be determined to correct the stripe noise in the first direction. After step S104, the correction coefficient determination method further includes:

[0160] Step 1: Using the third gain matrix and the two-point correction method, calculate the response output of each pixel at the first transmittance for the uniform black body at the first temperature and the second temperature, respectively. Based on the calculated response output, calculate the gain coefficient of each pixel according to the two-point correction method to obtain the fourth gain matrix.

[0161] Step 2: Using the third gain matrix and the two-point correction method, calculate the response output of each pixel for the uniform black body at the first temperature and the second temperature at the second transmittance, and based on the calculated response output, calculate the gain coefficient of each pixel according to the two-point correction method to obtain the fifth gain matrix.

[0162] Step 3: Extract high-frequency information in the second direction from the fourth gain matrix and the fifth gain matrix respectively to obtain third high-frequency information and fourth high-frequency information.

[0163] Step 4: Replace the fourth high-frequency information included in the fifth gain matrix with the third high-frequency information to obtain a sixth gain matrix for correcting the stripe noise in the first direction.

[0164] In the embodiment of the present application, the response output calculated in steps 1 and 2 is the corrected response output obtained by correcting the response output of each pixel at the first transmittance for the uniform black body at the first temperature and the second temperature using a third gain matrix according to the two-point correction method. The process of calculating the gain matrix according to the two-point correction method based on the calculated response output in steps 1 and 2 is similar to the process of calculating the gain matrix in steps S101 and S102 in the above embodiment. For details, please refer to the relevant description of steps S101-S102 in the above embodiment. Steps 3 and 4 are similar to steps S103 and S104 in the above embodiment. For details, please refer to the relevant description of steps S103 and S104 in the above embodiment.

[0165] Based on the above processing, a sixth gain matrix for correcting streak noise in the first direction can be further determined based on the third gain matrix for correcting streak noise in the second direction. Subsequently, the third and sixth gain matrices can be used to correct streak noise in the first and second directions using the two-point correction method. This further ensures effective streak noise correction, thereby improving the quality of infrared images.

[0166] Based on the same inventive concept, an embodiment of the present application also provides a stripe noise correction method, which can be applied to electronic devices. For example, the electronic device can be a processor in a thermal imaging device, and the processor can execute steps S301 to S303 to correct the response output detected by each pixel, and generate an infrared image based on the corrected response output. Subsequently, the processor can also send the obtained infrared image to a display device for displaying images, so that the obtained infrared image is displayed by the display device. Alternatively, the thermal imaging device can include a display module for displaying images, and the processor can send the obtained infrared image to the display module, so that the obtained infrared image is displayed by the display module. See Figure 3 , Figure 3 A schematic flow chart of a stripe noise correction method provided in an embodiment of the present application, the method comprising:

[0167] Step S301: Obtain a gain matrix for correcting stripe noise.

[0168] The obtained gain matrix is ​​obtained based on any of the correction coefficient determination methods described above.

[0169] Step S302: using the acquired gain matrix and the two-point correction method, correct the initial response output detected by each pixel in the thermal imaging device to obtain a corrected target response output.

[0170] Step S303: Generate an infrared image using the obtained target response output.

[0171] In an embodiment of the present application, a gain matrix can be obtained in advance based on the correction coefficient determination method described in any of the above embodiments. The obtained gain matrix can be only the third gain matrix, or it can be the third gain matrix and the sixth gain matrix. The obtained gain matrix and the two-point correction method can be used to correct the initial response output detected by each pixel in the thermal imaging device to obtain a corrected target response output. Furthermore, the obtained target response output can be used to generate an infrared image. For example, the obtained target response output can be mapped to a range of 0-255 to obtain pixel values ​​in the infrared image, that is, to obtain the infrared image.

[0172] Based on the above processing, a gain matrix with high applicability can be used to correct the stripe noise according to the two-point correction method. The stripe noise can be corrected effectively to improve the quality of the infrared image.

[0173] In one embodiment, step S302 includes: using the acquired third gain matrix for correcting the stripe noise in the second direction and a two-point correction method, correcting the initial response output detected by each pixel in the thermal imaging device to obtain a corrected target response output;

[0174] or,

[0175] The initial response output detected by each pixel in the thermal imaging device is corrected using the third gain matrix and the two-point correction method obtained for correcting the stripe noise in the second direction to obtain a corrected response output; and the response output after the single correction is corrected using the sixth gain matrix and the two-point correction method obtained for correcting the stripe noise in the first direction to obtain a corrected target response output.

[0176] In embodiments of the present application, the third gain matrix and the two-point correction method can be used alone to correct the streak noise in the second direction for the initial response output detected by each pixel, thereby obtaining a corrected target response output. For example, according to the two-point correction response model described in the above embodiment, the initial response output detected by each pixel in the thermal imaging device can be used as X, and the third gain matrix can be used as K. The response output after correcting the streak noise in the second direction can be calculated and used as the corrected target response output.

[0177] Alternatively, the third gain matrix and the two-point correction method can be used to first correct the initial response output detected by each pixel for stripe noise in the second direction, obtaining a corrected response output. Then, the sixth gain matrix and the two-point correction method can be used to correct the stripe noise in the first direction for the corrected response output, obtaining a corrected target response output. For example, according to the two-point correction response model in the above embodiment, the initial response output detected by each pixel in the thermal imaging device can be used as X, and the third gain matrix can be used as K to calculate the response output after correcting the stripe noise in the second direction, obtaining the corrected response output. Then, according to the two-point correction response model in the above embodiment, the response output after correcting the stripe noise in the first direction can be used as X, and the sixth gain matrix can be used as K to calculate the response output after further correcting the stripe noise in the first direction, obtaining the corrected target response output.

[0178] In this way, it is possible to ensure that a gain matrix with high applicability can be used to correct the stripe noise in the first direction and the second direction according to the two-point correction method, thereby effectively correcting the stripe noise and improving the quality of the infrared image.

[0179] In one embodiment, see Figure 4 , Figure 4 A schematic flow chart of another stripe noise correction method provided in an embodiment of the present application, the method comprising:

[0180] Step S401: Calibrate the high-gain lens K1 and the ultra-high-temperature lens K2. The thermal imaging device can be equipped with a high-gain lens (i.e., the first lens in the above embodiment) to calibrate at a first transmittance to obtain a first gain matrix K1, i.e., step S101 in the above embodiment. The thermal imaging device can also be equipped with an ultra-high-temperature lens (i.e., the second lens in the above embodiment) to calibrate at a second transmittance to obtain a second gain matrix K2, i.e., step S102 in the above embodiment.

[0181] Step S402: Perform horizontal or column filtering on K1 and K2, respectively, to obtain K1L and K2L. Specifically, extract the low-frequency information of the first gain matrix K1 and the second gain matrix K2 in the second direction, respectively, to obtain the first low-frequency information K1L and the second low-frequency information K2L. This is similar to step S1031 in the above embodiment.

[0182] Step S403: Process K1L and K2L to extract high-frequency information for the high-gain and ultra-high-temperature lenses, respectively. Specifically, the first low-frequency information K1L and the second low-frequency information K2L are processed to obtain first high-frequency information K1LH' and second high-frequency information K2LH'. This corresponds to steps S1032 and S1033 in the aforementioned embodiment.

[0183] Step S404: Obtain the ultra-high temperature compensation Knew through the mask scheme. Knew is the gain matrix in the above embodiment, that is, step S104 in the above embodiment.

[0184] Step S405: Output the image. i,j =Knew i,j ·X i,j +C i,j Correct the response output of each pixel detection, where Y i,j Represents the target response output after correction of the pixel with coordinate (i, j) in the infrared focal plane array, Knew i,j represents the gain coefficient of the i-th row and j-th column in the gain matrix, X i,j Represents the initial response output detected by the pixel with coordinates (i, j), C i,j is the offset coefficient of the pixel with coordinates (i, j). The corrected target response output can be used to generate an infrared image as the final output image. This is steps S302 and S303 in the above embodiment.

[0185] In one embodiment, see Figure 5a and Figure 5b , Figure 5a This is a schematic diagram of an infrared image generated using the initial response output detected by each pixel, as provided in an embodiment of the present application. The infrared image generated in this case contains obvious vertical lines, resulting in poor image quality. The streak noise correction method provided in an embodiment of the present application can be used to correct the initial response output detected by each pixel, resulting in a corrected target response output. Figure 5b This is a schematic diagram of an infrared image generated using a corrected target response output according to an embodiment of the present invention. Using the target response output corrected by the streak noise correction method according to an embodiment of the present invention, the vertical lines in the generated infrared image are significantly improved, resulting in higher image quality.

[0186] Based on the same inventive concept, the present application also provides a correction coefficient determination device, see Figure 6 , Figure 6 This is a schematic diagram of the structure of a correction coefficient determination device provided in an embodiment of the present application. The device includes:

[0187] A first gain matrix calculation module 601 is configured to obtain the response output of each pixel in the thermal imaging device at a first transmittance for a uniform black body at a first temperature and a second temperature, respectively, and calculate the gain coefficient of each pixel according to a two-point correction method based on the obtained response output to obtain a first gain matrix; wherein the first temperature is greater than the second temperature;

[0188] A second gain matrix calculation module 602 is configured to obtain the response output of each pixel at a second transmittance to a uniform black body at the first temperature and the second temperature, respectively, and calculate a gain coefficient of each pixel according to a two-point correction method based on the obtained response output to obtain a second gain matrix; wherein the second transmittance is less than the first transmittance;

[0189] A high-frequency information extraction module 603 is configured to extract high-frequency information of the first gain matrix and the second gain matrix in a first direction, respectively, to obtain first high-frequency information and second high-frequency information; wherein the first direction is one of a horizontal direction and a column direction;

[0190] The third gain matrix determination module 604 is configured to replace the second high-frequency information contained in the second gain matrix with the first high-frequency information to obtain a third gain matrix for correcting stripe noise in a second direction; wherein the second direction is another direction in the horizontal and column directions other than the first direction.

[0191] Based on the correction coefficient determination device provided in the embodiment of the present application, for the same temperature, the higher the transmittance of the thermal imaging device, the greater the infrared radiation intensity received by each pixel. Accordingly, the detection of a uniform black body of the first temperature and the second temperature at a higher transmittance (i.e., the first transmittance) can be performed to simulate the situation of detecting an ultra-high temperature object at a lower transmittance (i.e., the second transmittance). Accordingly, the response output of each pixel at the first transmittance can effectively represent the response output when detecting an ultra-high temperature object, and can also effectively reflect the gain-related stripe noise that is greatly affected by the infrared radiation intensity. In this case, the high-frequency information (i.e., the first high-frequency information) of the calculated gain matrix (i.e., the first gain matrix) in the first direction can also effectively compensate for the stripe noise in the second direction when detecting an ultra-high temperature object.

[0192] Because ultra-high-temperature objects emit high levels of infrared radiation, to prevent infrared radiation saturation at each pixel in a thermal imaging device, the transmittance of thermal imaging devices is often low when measuring ultra-high-temperature objects. Accordingly, the response output of each pixel in the thermal imaging device at the second transmittance effectively reflects the impact of the lower transmittance on the response output of each pixel. In this case, the low-frequency information in the calculated gain matrix (i.e., the second gain matrix) can effectively compensate for the low-frequency noise when detecting ultra-high-temperature objects.

[0193] Therefore, the second high-frequency information in the second gain matrix can be replaced with the first high-frequency information to obtain a third gain matrix. Subsequently, using this third gain matrix effectively compensates for streak noise in the second direction when detecting ultra-high-temperature objects, while also effectively compensating for the impact of low transmittance on the response output of each pixel. In other words, the third gain matrix is ​​suitable for correcting streak noise in areas with high gain intensity. This improves the applicability of the determined correction coefficients, effectively correcting streak noise and improving the quality of infrared images.

[0194] In one embodiment, the high-frequency information extraction module 603 includes:

[0195] A first extraction submodule, configured to extract low-frequency information of the first gain matrix and the second gain matrix in a second direction respectively, to obtain first low-frequency information and second low-frequency information;

[0196] a second extraction submodule, configured to extract low-frequency information of the first low-frequency information and the second low-frequency information in a first direction, respectively, to obtain third low-frequency information and fourth low-frequency information;

[0197] a high-frequency information determination submodule, configured to remove the third low-frequency information from the first low-frequency information to obtain high-frequency information of the first gain matrix in the first direction as first high-frequency information, and to remove the fourth low-frequency information from the second low-frequency information to obtain high-frequency information of the second gain matrix in the first direction as second high-frequency information.

[0198] In one embodiment, the first extraction submodule is specifically configured to calculate the mean of each row of gain coefficients in the second direction in the first gain matrix to obtain an element in the first low-frequency information; calculate the mean of each row of gain coefficients in the second direction in the second gain matrix to obtain an element in the second low-frequency information;

[0199] The high-frequency information determination submodule is specifically configured to remove the third low-frequency information from the first low-frequency information, expand the removal result in the second direction, and obtain high-frequency information of the first gain matrix in the first direction as the first high-frequency information; and remove the fourth low-frequency information from the second low-frequency information, expand the removal result in the second direction, and obtain high-frequency information of the second gain matrix in the first direction as the second high-frequency information.

[0200] In one embodiment, the second extraction submodule is specifically configured to filter the elements in the first low-frequency information according to a sliding mean filtering algorithm to obtain third low-frequency information; and filter the elements in the second low-frequency information according to a sliding mean filtering algorithm to obtain fourth low-frequency information.

[0201] In one embodiment, the gain coefficient of each pixel in the third gain matrix represents: the difference between the gain coefficient of the pixel in the second gain matrix and the corresponding element in the second high-frequency information, and the sum of the element corresponding to the pixel in the first high-frequency information; or, the gain coefficient of each pixel in the third gain matrix represents: the ratio of the gain coefficient of the pixel in the second gain matrix and the corresponding element in the second high-frequency information, and the product of the element corresponding to the pixel in the first high-frequency information.

[0202] In one embodiment, the apparatus further comprises:

[0203] a fourth gain matrix calculation module, configured to, after replacing the second high-frequency information included in the second gain matrix with the first high-frequency information to obtain a third gain matrix for correcting streak noise in the second direction, calculate, using the third gain matrix and a two-point correction method, a response output of each pixel at the first transmittance for a uniform black body at the first temperature and the second temperature, respectively; and, based on the calculated response output, calculate a gain coefficient of each pixel using the two-point correction method to obtain a fourth gain matrix;

[0204] a fifth gain matrix calculation module, configured to calculate, using the third gain matrix and a two-point correction method, a response output of each pixel at the second transmittance to a uniform black body at the first temperature and the second temperature, respectively, and calculate a gain coefficient of each pixel according to the two-point correction method based on the calculated response output to obtain a fifth gain matrix;

[0205] a high-frequency information determination module, configured to extract high-frequency information in the second direction from the fourth gain matrix and the fifth gain matrix, respectively, to obtain third high-frequency information and fourth high-frequency information;

[0206] The sixth gain matrix determination module is configured to replace the fourth high-frequency information included in the fifth gain matrix with the third high-frequency information to obtain a sixth gain matrix for correcting the stripe noise in the first direction.

[0207] In one embodiment, the first transmittance represents: the overall transmittance inside the thermal imaging device when the thermal imaging device is not equipped with a lens, or the overall transmittance inside the thermal imaging device when equipped with a first lens; the second transmittance represents: the overall transmittance inside the thermal imaging device when equipped with a second lens.

[0208] The present application also provides a stripe noise correction device. Figure 7 , Figure 7 This is a schematic structural diagram of a stripe noise correction device provided in an embodiment of the present application, the device comprising:

[0209] A gain matrix acquisition module 701 is configured to acquire a gain matrix for correcting streak noise; wherein the acquired gain matrix is ​​obtained based on any of the correction coefficient determination methods described above;

[0210] The response output correction module 702 is used to correct the initial response output detected by each pixel in the thermal imaging device using the obtained gain matrix and the two-point correction method to obtain a corrected target response output;

[0211] The infrared image generation module 703 is configured to generate an infrared image using the obtained target response output.

[0212] The stripe noise correction device provided in the embodiment of the present application can use a gain matrix with high applicability to correct stripe noise according to the two-point correction method, and can effectively correct stripe noise to improve the quality of infrared images.

[0213] In one embodiment, the response output correction module 702 is specifically configured to correct the initial response output detected by each pixel in the thermal imaging device using the acquired third gain matrix for correcting the stripe noise in the second direction and the two-point correction method to obtain a corrected target response output;

[0214] or,

[0215] The initial response output detected by each pixel in the thermal imaging device is corrected using the third gain matrix and the two-point correction method obtained for correcting the stripe noise in the second direction to obtain a corrected response output; and the response output after the single correction is corrected using the sixth gain matrix and the two-point correction method obtained for correcting the stripe noise in the first direction to obtain a corrected target response output.

[0216] The present application also provides an electronic device, such as Figure 8 Shown, including:

[0217] Memory 801, used for storing computer programs;

[0218] The processor 802 is configured to implement any of the aforementioned correction coefficient determination methods or any of the aforementioned stripe noise correction methods when executing the program stored in the memory 801 .

[0219] Furthermore, the electronic device may further include a communication bus and / or a communication interface, and the processor 802, the communication interface, and the memory 801 communicate with each other via the communication bus.

[0220] The communication bus mentioned in the electronic device mentioned above may be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus. This communication bus can be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is used in the figure, but this does not mean that there is only one bus or only one type of bus.

[0221] The communication interface is used for communication between the above electronic device and other devices.

[0222] The memory may include random access memory (RAM) or non-volatile memory (NVM), such as at least one disk storage. Alternatively, the memory may be at least one storage device located away from the processor.

[0223] The above-mentioned processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, and discrete hardware components.

[0224] In another embodiment provided in the present application, a computer-readable storage medium is also provided, which stores a computer program. When the computer program is executed by a processor, the steps of any of the above-mentioned correction coefficient determination methods or any of the above-mentioned stripe noise correction methods are implemented.

[0225] In another embodiment provided by the present application, a computer program product including instructions is also provided, which, when executed on a computer, enables the computer to execute any correction coefficient determination method or any stripe noise correction method in the above embodiments.

[0226] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one website, computer, server or data center to another website, computer, server or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrations. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a solid-state drive (SSD).

[0227] It should be noted that, in this document, relational terms such as first and second, etc., are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply the existence of any such actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article, or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article, or device. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or device comprising the element.

[0228] Each embodiment in this specification is described in a related manner. Similar portions between the various embodiments can be referenced to each other. Each embodiment focuses on the differences between the other embodiments. In particular, the device, electronic device, computer-readable storage medium, and computer program product embodiments are generally similar to the method embodiments, so their descriptions are relatively simple. For related portions, reference can be made to the descriptions of the method embodiments.

[0229] The above description is only a preferred embodiment of the present application and is not intended to limit the scope of protection of the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present application are included in the scope of protection of the present application.

Claims

1. A method for determining a correction coefficient, characterized in that: The method comprises: Obtaining the response output of each pixel in the thermal imaging device at a first transmittance to a uniform black body at a first temperature and a second temperature, respectively, and calculating a gain coefficient of each pixel according to a two-point correction method based on the obtained response outputs to obtain a first gain matrix; wherein the first temperature is greater than the second temperature; Obtaining response outputs of each pixel at a second transmittance for a uniform black body at the first temperature and the second temperature, respectively, and calculating a gain coefficient of each pixel according to a two-point correction method based on the obtained response outputs to obtain a second gain matrix; wherein the second transmittance is less than the first transmittance; Extracting high-frequency information of the first gain matrix and the second gain matrix in a first direction respectively to obtain first high-frequency information and second high-frequency information; wherein the first direction is one of a horizontal direction and a column direction; The second high-frequency information contained in the second gain matrix is ​​replaced by the first high-frequency information to obtain a third gain matrix for correcting stripe noise in a second direction; wherein the second direction is another direction in the horizontal direction and the column direction except the first direction.

2. The method according to claim 1, characterized in that The extracting high-frequency information of the first gain matrix and the second gain matrix in the first direction respectively to obtain first high-frequency information and second high-frequency information includes: respectively extracting low-frequency information of the first gain matrix and the second gain matrix in the second direction to obtain first low-frequency information and second low-frequency information; respectively extracting low-frequency information of the first low-frequency information and the second low-frequency information in the first direction to obtain third low-frequency information and fourth low-frequency information; The third low-frequency information in the first low-frequency information is removed to obtain high-frequency information of the first gain matrix in the first direction as first high-frequency information, and the fourth low-frequency information in the second low-frequency information is removed to obtain high-frequency information of the second gain matrix in the first direction as second high-frequency information.

3. The method according to claim 2, characterized in that The extracting low-frequency information of the first gain matrix and the second gain matrix in the second direction respectively to obtain first low-frequency information and second low-frequency information includes: Calculating the mean of each row of gain coefficients in the second direction in the first gain matrix to obtain an element in the first low-frequency information; calculating the mean of each row of gain coefficients in the second direction in the second gain matrix to obtain an element in the second low-frequency information; The removing the third low-frequency information from the first low-frequency information to obtain high-frequency information of the first gain matrix in the first direction as the first high-frequency information, and removing the fourth low-frequency information from the second low-frequency information to obtain high-frequency information of the second gain matrix in the first direction as the second high-frequency information, includes: The third low-frequency information is removed from the first low-frequency information, and the removal result is expanded in the second direction to obtain high-frequency information of the first gain matrix in the first direction as the first high-frequency information. The fourth low-frequency information is removed from the second low-frequency information, and the removal result is expanded in the second direction to obtain high-frequency information of the second gain matrix in the first direction as the second high-frequency information.

4. The method according to claim 2 or 3, characterized in that The extracting low-frequency information of the first low-frequency information and the second low-frequency information in the first direction respectively to obtain third low-frequency information and fourth low-frequency information includes: filtering the elements in the first low-frequency information according to a sliding mean filtering algorithm to obtain third low-frequency information; The elements in the second low-frequency information are filtered according to a sliding mean filtering algorithm to obtain fourth low-frequency information.

5. The method according to claim 1, characterized in that The gain coefficient of each pixel in the third gain matrix represents: the difference between the gain coefficient of the pixel in the second gain matrix and the corresponding element in the second high-frequency information, and the sum of the gain coefficient of the pixel in the first high-frequency information; or, The gain coefficient of each pixel in the third gain matrix represents: the product of the ratio of the gain coefficient of the pixel in the second gain matrix to the corresponding element in the second high-frequency information and the element corresponding to the pixel in the first high-frequency information.

6. The method according to claim 1, characterized in that After replacing the second high-frequency information included in the second gain matrix with the first high-frequency information to obtain a third gain matrix for correcting the stripe noise in the second direction, the method further includes: Calculating the response output of each pixel at the first transmittance to a uniform black body at the first temperature and the second temperature using the third gain matrix and a two-point correction method, and calculating the gain coefficient of each pixel according to the two-point correction method based on the calculated response output to obtain a fourth gain matrix; Calculating the response output of each pixel at the second transmittance to a uniform black body at the first temperature and the second temperature using the third gain matrix and a two-point correction method, and calculating the gain coefficient of each pixel using the two-point correction method based on the calculated response output to obtain a fifth gain matrix; extracting high-frequency information in the second direction from the fourth gain matrix and the fifth gain matrix respectively to obtain third high-frequency information and fourth high-frequency information; The fourth high-frequency information included in the fifth gain matrix is ​​replaced by the third high-frequency information to obtain a sixth gain matrix for correcting stripe noise in the first direction.

7. The method according to claim 1, characterized in that The first transmittance represents: the overall transmittance inside the thermal imaging device when the thermal imaging device is not equipped with a lens, or the overall transmittance inside the thermal imaging device when equipped with a first lens; the second transmittance represents: the overall transmittance inside the thermal imaging device when equipped with a second lens.

8. A stripe noise correction method, characterized in that: The method comprises: Obtaining a gain matrix for correcting streak noise; wherein the obtained gain matrix is ​​obtained based on the method according to any one of claims 1 to 7; Using the obtained gain matrix and two-point correction method, the initial response output detected by each pixel in the thermal imaging device is corrected to obtain the corrected target response output; The obtained target response output is used to generate an infrared image.

9. The method according to claim 8, characterized in that The method of using the obtained gain matrix and the two-point correction method to correct the initial response output detected by each pixel in the thermal imaging device to obtain the corrected target response output includes: Using the acquired third gain matrix for correcting the stripe noise in the second direction and a two-point correction method, correcting the initial response output detected by each pixel in the thermal imaging device to obtain a corrected target response output; or, The initial response output detected by each pixel in the thermal imaging device is corrected using the third gain matrix and the two-point correction method obtained for correcting the stripe noise in the second direction to obtain a corrected response output; and the response output after the single correction is corrected using the sixth gain matrix and the two-point correction method obtained for correcting the stripe noise in the first direction to obtain a corrected target response output.

10. A correction coefficient determination device, characterized in that: The device comprises: a first gain matrix calculation module, configured to obtain a response output of each pixel in the thermal imaging device at a first transmittance, for a uniform black body at a first temperature and a second temperature, respectively, and calculate a gain coefficient of each pixel according to a two-point correction method based on the obtained response outputs to obtain a first gain matrix; wherein the first temperature is greater than the second temperature; a second gain matrix calculation module, configured to obtain a response output of each pixel at a second transmittance to a uniform black body at the first temperature and the second temperature, respectively, and calculate a gain coefficient of each pixel according to a two-point correction method based on the obtained response output to obtain a second gain matrix; wherein the second transmittance is less than the first transmittance; a high-frequency information extraction module, configured to extract high-frequency information of the first gain matrix and the second gain matrix in a first direction, respectively, to obtain first high-frequency information and second high-frequency information; wherein the first direction is one of a horizontal direction and a column direction; a third gain matrix determination module, configured to replace the second high-frequency information contained in the second gain matrix with the first high-frequency information to obtain a third gain matrix for correcting stripe noise in a second direction; wherein the second direction is another direction in the horizontal and column directions other than the first direction.

11. The device according to claim 10, characterized in that The high-frequency information extraction module includes: A first extraction submodule, configured to extract low-frequency information of the first gain matrix and the second gain matrix in a second direction respectively, to obtain first low-frequency information and second low-frequency information; a second extraction submodule, configured to extract low-frequency information of the first low-frequency information and the second low-frequency information in a first direction, respectively, to obtain third low-frequency information and fourth low-frequency information; a high-frequency information determination submodule, configured to remove the third low-frequency information from the first low-frequency information to obtain high-frequency information of the first gain matrix in the first direction as first high-frequency information, and remove the fourth low-frequency information from the second low-frequency information to obtain high-frequency information of the second gain matrix in the first direction as second high-frequency information; and / or, The first extraction submodule is specifically configured to calculate the mean of each row of gain coefficients in the second direction in the first gain matrix to obtain an element in the first low-frequency information; and calculate the mean of each row of gain coefficients in the second direction in the second gain matrix to obtain an element in the second low-frequency information; The high-frequency information determination submodule is specifically configured to remove the third low-frequency information from the first low-frequency information, and expand the removal result in the second direction to obtain high-frequency information of the first gain matrix in the first direction as the first high-frequency information; and remove the fourth low-frequency information from the second low-frequency information, and expand the removal result in the second direction to obtain high-frequency information of the second gain matrix in the first direction as the second high-frequency information; and / or, a second extraction submodule, specifically configured to filter the elements in the first low-frequency information using a sliding mean filtering algorithm to obtain third low-frequency information; and filter the elements in the second low-frequency information using a sliding mean filtering algorithm to obtain fourth low-frequency information; and / or, The gain coefficient of each pixel in the third gain matrix represents: the difference between the gain coefficient of the pixel in the second gain matrix and the element corresponding to the pixel in the second high-frequency information, and the sum of the element corresponding to the pixel in the first high-frequency information; or the gain coefficient of each pixel in the third gain matrix represents: the product of the ratio of the gain coefficient of the pixel in the second gain matrix and the element corresponding to the pixel in the second high-frequency information, and the element corresponding to the pixel in the first high-frequency information; and / or, The device further comprises: a fourth gain matrix calculation module, configured to, after replacing the second high-frequency information included in the second gain matrix with the first high-frequency information to obtain a third gain matrix for correcting streak noise in the second direction, calculate, using the third gain matrix and a two-point correction method, a response output of each pixel at the first transmittance for a uniform black body at the first temperature and the second temperature, respectively; and, based on the calculated response output, calculate a gain coefficient of each pixel using the two-point correction method to obtain a fourth gain matrix; a fifth gain matrix calculation module, configured to calculate, using the third gain matrix and a two-point correction method, a response output of each pixel at the second transmittance to a uniform black body at the first temperature and the second temperature, respectively, and calculate a gain coefficient of each pixel according to the two-point correction method based on the calculated response output to obtain a fifth gain matrix; a high-frequency information determination module, configured to extract high-frequency information in the second direction from the fourth gain matrix and the fifth gain matrix, respectively, to obtain third high-frequency information and fourth high-frequency information; a sixth gain matrix determining module, configured to replace the fourth high-frequency information included in the fifth gain matrix with the third high-frequency information, to obtain a sixth gain matrix for correcting the stripe noise in the first direction; and / or, The first transmittance represents: the overall transmittance inside the thermal imaging device when the thermal imaging device is not equipped with a lens, or the overall transmittance inside the thermal imaging device when equipped with a first lens; the second transmittance represents: the overall transmittance inside the thermal imaging device when equipped with a second lens.

12. A stripe noise correction device, characterized in that: The device comprises: A gain matrix acquisition module, configured to acquire a gain matrix for correcting streak noise; wherein the acquired gain matrix is ​​obtained based on the method according to any one of claims 1 to 7; A response output correction module is used to correct the initial response output detected by each pixel in the thermal imaging device using the obtained gain matrix and the two-point correction method to obtain a corrected target response output; The infrared image generation module is used to generate an infrared image using the obtained target response output.

13. The device according to claim 12, characterized in that The response output correction module is specifically configured to correct the initial response output detected by each pixel in the thermal imaging device using the acquired third gain matrix for correcting the stripe noise in the second direction and the two-point correction method to obtain a corrected target response output; or, The initial response output detected by each pixel in the thermal imaging device is corrected using the third gain matrix and the two-point correction method obtained for correcting the stripe noise in the second direction to obtain a corrected response output; and the response output after the single correction is corrected using the sixth gain matrix and the two-point correction method obtained for correcting the stripe noise in the first direction to obtain a corrected target response output.

14. An electronic device, characterized in that: include: Memory for storing computer programs; The processor is configured to implement the method described in any one of claims 1 to 7 or any one of claims 8 to 9 when executing a program stored in a memory.

15. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method according to any one of claims 1 to 7 or any one of claims 8 to 9 is implemented.

16. A computer program product, characterized in that When the computer program product is run on a computer, the computer is enabled to execute the method according to any one of claims 1 to 7 or any one of claims 8 to 9.

Images