Data compensation method and device applied to infrared thermal imaging equipment and electronic equipment

CN117782333BActive Publication Date: 2026-10-27HANGZHOU MICROIMAGE SOFTWARE CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202311705914.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-12-12
Publication Date
2026-10-27
Estimated Expiration
2043-12-12

Smart Images

  • Figure CN117782333B_ABST
    Figure CN117782333B_ABST
Patent Text Reader

Abstract

Embodiments of the present application disclose a data compensation method and device applied to an infrared thermal imaging device and an electronic device. The embodiments check whether a lens currently matched by the infrared thermal imaging device at a current focal length is a calibrated reference lens. When it is checked that the current lens at the current focal length is not the calibrated reference lens, the calibration data compensation information of the calibrated reference lens is adjusted by using the difference between the relative luminance of the calibrated reference lens and the relative luminance of the current lens, target data compensation information is obtained, and the original infrared image data output by the infrared thermal imaging device based on the current lens at the current focal length is compensated by using the target data compensation information. The infrared image data is compensated, and the phenomenon of vignetting of the infrared image data is inhibited.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of infrared detection, and in particular to data compensation methods, devices and electronic equipment used in infrared thermal imaging equipment. Background Technology

[0002] The infrared image data output by an infrared thermal imaging device is affected by the relative illumination of the lens used with the device. Here, the relative illumination of the lens refers to the ratio of the illuminance at each position in the image plane to the illuminance of the central field of view. Figure 1 An example is shown showing the curve of the relative illumination of the lens.

[0003] If the relative illumination of the lens is too low, the brightness difference between the edge and center data of the image will be too large, resulting in infrared image data output by the infrared thermal imaging device, such as... Figure 2 As shown, the uniformity of the infrared image data is inconsistent, resulting in a vignetting phenomenon, which degrades the resolution and temperature measurement uniformity of the infrared image data. Summary of the Invention

[0004] This application provides a data compensation method, apparatus, and electronic device for infrared thermal imaging equipment, which aims to suppress the vignetting phenomenon in infrared image data by compensating for the infrared image data.

[0005] This application provides a data compensation method for infrared thermal imaging equipment, the method being applied to infrared thermal imaging equipment, including:

[0006] Check whether the lens currently matched by the infrared thermal imaging device is the calibrated reference lens;

[0007] When the current lens is identified as the calibrated reference lens, the target data compensation information is determined based on the calibration data compensation information of the calibrated reference lens.

[0008] When it is found that the current lens is not the reference lens to be calibrated, the calibration data compensation information of the reference lens is adjusted by using the difference between the relative illumination of the calibrated reference lens and the relative illumination of the current lens to obtain the target data compensation information.

[0009] The target data compensation information is used to compensate the original infrared image data output by the infrared thermal imaging device based on the current lens.

[0010] A data compensation device for use in infrared thermal imaging equipment, the device comprising:

[0011] The inspection unit is used to check whether the lens currently matched by the infrared thermal imaging device is the calibrated reference lens;

[0012] The determining unit is used to determine target data compensation information based on the calibration data compensation information of the calibrated reference lens when the checking unit detects that the current lens is the calibrated reference lens; and to adjust the calibration data compensation information of the calibrated reference lens by utilizing the difference between the relative illumination of the calibrated reference lens and the relative illumination of the current lens when the checking unit detects that the current lens is not the calibrated reference lens, so as to obtain target data compensation information.

[0013] The compensation unit is used to compensate the original infrared image data output by the infrared thermal imaging device based on the current lens using target data compensation information.

[0014] An electronic device comprising: a processor and a memory;

[0015] The memory is used to store machine-executable instructions;

[0016] The processor is configured to read and execute machine-executable instructions stored in the memory to implement the above method.

[0017] The technical solutions provided by the embodiments of this application may include the following beneficial effects:

[0018] This embodiment first checks whether the lens currently matched by the infrared thermal imaging device is the calibrated reference lens at the current focal length. If it is found that the current lens is the calibrated reference lens at the current focal length, the target data compensation information is determined directly based on the calibration data compensation information of the calibrated reference lens. The target data compensation information is then used to compensate the original infrared image data output by the infrared thermal imaging device based on the current lens at the current focal length. If it is found that the current lens is not the calibrated reference lens at the current focal length, the calibration data compensation information of the calibrated reference lens is adjusted based on the difference between the relative illumination of the calibrated reference lens and the relative illumination of the current lens to obtain the target data compensation information. The target data compensation information is then used to compensate the original infrared image data output by the infrared thermal imaging device based on the current lens at the current focal length. By compensating the infrared image data, the phenomenon of vignetting in the infrared image data can be suppressed.

[0019] Furthermore, in this embodiment, when it is detected that the current lens is not the calibrated reference lens, the difference between the relative illumination of the calibrated reference lens and the relative illumination of the current lens is used to adjust the calibration data compensation information of the calibrated reference lens to obtain the target data compensation information, instead of using the time-consuming and laborious target data compensation information of multiple different lenses to determine it, thereby reducing costs and improving compensation efficiency.

[0020] Furthermore, in this embodiment, when the lens currently matched to the infrared thermal imaging device is a zoom lens, since the relative illumination of the zoom lens varies under different focusing states (focal lengths), in order to avoid the uniformity of the infrared image output by the infrared thermal imaging device from becoming vignetted due to the lack of compensation or correction for the difference in relative illumination of the lens, which would cause the resolution and temperature measurement uniformity of the output infrared image to deteriorate, this embodiment can also achieve compensation based on the difference in relative illumination of the zoom lens under different focusing states (focal lengths) according to the above method. This enables continuous compensation when the zoom lens continuously zooms.

[0021] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and do not limit this application. Attached Figure Description

[0022] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this specification and, together with the description, serve to explain the principles of this specification.

[0023] Figure 1 This is a schematic diagram of the relative illumination curve of the lens;

[0024] Figure 2 This is a schematic diagram illustrating the vignetting effect in infrared image data.

[0025] Figure 3 A flowchart illustrating the method provided in this application embodiment;

[0026] Figure 4 A flowchart illustrating the implementation of step 303 in an embodiment of this application;

[0027] Figure 5 This is a schematic diagram of vignetting suppression provided in an embodiment of this application;

[0028] Figure 6 This is a structural diagram of the device provided in the embodiments of this application;

[0029] Figure 7 This is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0030] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application as detailed in the appended claims.

[0031] The terminology used in this application is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. The singular forms “a,” “the,” and “the” used in this application and the appended claims are also intended to include the plural forms unless the context clearly indicates otherwise. It should also be understood that the term “and / or” as used herein refers to and includes any or all possible combinations of one or more of the associated listed items.

[0032] It should be understood that although the terms first, second, third, etc., may be used in this application to describe various information, such information should not be limited to these terms. These terms are only used to distinguish information of the same type from one another. For example, without departing from the scope of this application, first information may also be referred to as second information, and similarly, second information may also be referred to as first information. Depending on the context, the word "if" as used herein may be interpreted as "when," "when," or "in response to determination."

[0033] To enable those skilled in the art to better understand the technical solutions provided in the embodiments of this application, and to make the above-mentioned objectives, features and advantages of the embodiments of this application more apparent and understandable, the technical solutions in the embodiments of this application will be further described in detail below with reference to the accompanying drawings.

[0034] See Figure 3 , Figure 3 This is a flowchart illustrating a method provided in an embodiment of this application. The process is applied to an infrared thermal imaging device. In this embodiment, the infrared thermal imaging device is currently equipped with a corresponding lens (also referred to as the currently matched lens). Optionally, the lens can be a magnifying lens or a zoom lens. Here, the magnifying lens has a fixed focal length, while the zoom lens has variable focal lengths. A zoom lens is essentially a combination of multiple magnifying lenses, and the relative illumination curves of the zoom lens are different at different focal lengths. A change in the focal length or focusing state of the zoom lens is equivalent to switching magnifying lenses.

[0035] like Figure 3 As shown, the process may include the following steps:

[0036] Step 301: Check whether the lens currently matched by the infrared thermal imaging device is the calibrated reference lens; if the current lens is found to be the calibrated reference lens, proceed to step 302; if the current lens is not found to be the calibrated reference lens, proceed to step 303.

[0037] Optionally, in this embodiment, if the lens currently matched by the infrared thermal imaging device is a zoom lens, as described above, the zoom lens has variable focal lengths. Optionally, for a zoom lens, it can be calibrated as a reference lens at a certain focal length or focusing state. Based on this, there are multiple ways to specifically implement the step 301 of checking whether the lens currently matched by the infrared thermal imaging device is the calibrated reference lens. For example, the current focal length used by the lens currently matched by the infrared thermal imaging device can be obtained. If the current focal length is the reference focal length (the infrared thermal imaging device will record the reference focal length locally), then the lens currently matched by the infrared thermal imaging device is determined to be the calibrated reference lens; otherwise, the lens currently matched by the infrared thermal imaging device is determined not to be the calibrated reference lens. Alternatively, an external instruction can be received, which indicates whether the lens currently matched by the infrared thermal imaging device is the calibrated reference lens at the current focal length, and the lens currently matched by the infrared thermal imaging device is determined to be the calibrated reference lens based on the external instruction.

[0038] Optionally, in this embodiment, if the lens currently matched by the infrared thermal imaging device is the aforementioned magnifying lens, then in step 301, checking whether the lens currently matched by the infrared thermal imaging device is the calibrated reference lens can be implemented in many ways. For example, it can rely on external instructions (used to indicate whether the lens currently matched by the infrared thermal imaging device is the calibrated reference lens); or, it can obtain the lens configuration information (such as the model number, which at least includes indication information used to indicate whether the lens currently matched by the infrared thermal imaging device is the calibrated reference lens), and check whether the lens currently matched by the infrared thermal imaging device is the calibrated reference lens based on the lens configuration information.

[0039] Step 302: Determine the target data compensation information based on the calibration data compensation information of the reference lens. Then proceed to step 304.

[0040] Step 302 is performed on the premise that the lens currently matched by the infrared thermal imaging device is the calibrated reference lens. Once it is determined that the lens currently matched by the infrared thermal imaging device is the calibrated reference lens, as described in step 302, the target data compensation information can be determined directly based on the calibration data compensation information of the calibrated reference lens; for example, the calibration data compensation information of the calibrated reference lens can be directly determined as the aforementioned target data compensation information.

[0041] As an example, the calibration data compensation information of the reference lens is calibrated using a calibration matrix, such as a K matrix. Correspondingly, the target data compensation information can also be implemented using a matrix, such as a K matrix.

[0042] Step 303: Using the difference between the relative illumination of the calibrated reference lens and the relative illumination of the current lens, adjust the calibration data compensation information of the calibrated reference lens to obtain the target data compensation information. Then, proceed to step 304.

[0043] Step 303 is performed after it is determined that the lens currently matched by the infrared thermal imaging device is not the calibrated reference lens. Once it is determined that the lens currently matched by the infrared thermal imaging device is not the calibrated reference lens, then as described in step 303, the target data compensation information is calculated based on the difference in relative illumination between different magnifications (reference lens and current lens). As for how to use the difference in relative illumination between the calibrated reference lens and the current lens to adjust the calibration data compensation information of the calibrated reference lens in step 303 to obtain the target data compensation information, the following will explain. Figure 4 Examples will be given, but I won't go into detail here.

[0044] Step 304: Use target data compensation information to compensate the original infrared image data output by the infrared thermal imaging device based on the current lens at the current focal length.

[0045] Optionally, in this embodiment, step 304 can be compensated using the following formula 1:

[0046] Y i,j =K i,j ·(X i,j -B i,j )+C i,j ;(Formula 1)

[0047] Where (i, j) represents the position of a pixel on the detector in the infrared thermal imaging device, K i,j X is the compensation information that matches the pixel at position (i, j) in the target data compensation information. i,j B is the data in the original infrared image data that matches the pixel at position (i, j). i,j C represents the data matching the pixel at position (i, j) in the background image acquired by the infrared thermal imaging device when the baffle in the infrared thermal imaging device is activated; i,j The offset coefficient is set for the pixel at position (i, j). The offset coefficients set for pixels at different positions in the detector can be the same or different. i,j For X i,j The data obtained after compensation is specifically the data obtained after compensating the data in the original infrared image data that matches the pixel at position (i, j).

[0048] It should be noted that Formula 1 above is just an example and is not intended to be limiting.

[0049] This concludes the process. Figure 1 The process is shown below.

[0050] pass Figure 1 As shown in the flowchart, this embodiment first checks whether the lens currently matched by the infrared thermal imaging device is the calibrated reference lens at the current focal length. If it is found that the current lens is the calibrated reference lens at the current focal length, the target data compensation information is determined directly based on the calibration data compensation information of the calibrated reference lens. The target data compensation information is then used to compensate the original infrared image data output by the infrared thermal imaging device based on the current lens at the current focal length. If it is found that the current lens is not the calibrated reference lens at the current focal length, the calibration data compensation information of the calibrated reference lens is adjusted based on the difference between the relative illumination of the calibrated reference lens and the relative illumination of the current lens to obtain the target data compensation information. The target data compensation information is then used to compensate the original infrared image data output by the infrared thermal imaging device based on the current lens at the current focal length. By compensating the infrared image data, the phenomenon of vignetting in the infrared image data can be suppressed.

[0051] Furthermore, in this embodiment, when it is detected that the current lens is not the calibrated reference lens, the difference between the relative illumination of the calibrated reference lens and the relative illumination of the current lens is used to adjust the calibration data compensation information of the calibrated reference lens to obtain the target data compensation information, instead of using the time-consuming and laborious target data compensation information of multiple different lenses to determine it, thereby reducing costs and improving compensation efficiency.

[0052] Furthermore, in this embodiment, when the lens currently matched to the infrared thermal imaging device is a zoom lens, since the relative illumination of the zoom lens varies under different focusing states (focal lengths), in order to avoid the uniformity of the infrared image output by the infrared thermal imaging device from becoming vignetted due to the lack of compensation or correction for the difference in relative illumination of the lens, which would cause the resolution and temperature measurement uniformity of the output infrared image to deteriorate, this embodiment can also achieve compensation based on the difference in relative illumination of the zoom lens under different focusing states (focal lengths) according to the above method. This enables continuous compensation when the zoom lens continuously zooms.

[0053] The following is about Figure 4 The process is described as follows:

[0054] See Figure 4 , Figure 4 A flowchart illustrating the implementation of step 103 in an embodiment of this application. Figure 4 As shown, the process may include the following steps:

[0055] Step 401: Filter the calibration data compensation information of the reference lens to obtain reference data compensation information.

[0056] In this embodiment, if the lens currently matched by the infrared thermal imaging device is a zoom lens, then the calibration data compensation information of the reference lens is the calibration data compensation information of the reference focal length.

[0057] In this embodiment, filtering the calibration data compensation information of the calibrated reference lens can be implemented in many ways, such as spatial filtering. As one example, spatial filtering may include at least one of the following filtering methods: 3D model fitting filtering, mean filtering, Gaussian filtering, bilateral filtering, guided filtering, and median filtering.

[0058] Optionally, by filtering the calibration data compensation information of the reference lens according to spatial domain filtering, high-frequency information (via K) can be obtained. 11 (representation) and low-frequency information (via K) 12 express).

[0059] Taking mean filtering as an example, the calibration data compensation information of the reference lens can be filtered using the following formula 2:

[0060] Among them, Y i,j For the above K 12 X i+k,j+l This represents the calibration data compensation information of the reference lens being calibrated, (i, j) represents the position of the pixel on the detector in the infrared thermal imaging device, and L represents the value of L in the filter window size (2L+1)*(2L+1). For example, the filter window size is (2k+1)*(2k+1), meaning the filter window size can be 3*3, 5*5, 7*7, etc. When the filter window size is 5*5, L is 2, so the above formula 2 can be converted into the following formula 3:

[0061]

[0062] As described above, by filtering the calibration data compensation information of the reference lens according to spatial domain filtering, high-frequency information K will be obtained. 11 and low-frequency information K 12 Then in the above Y i,j For the above K 12 Under the premise that K11 can be expressed by the following formula 4: Y ij =X j+k,j+l -Y i,j ; where Y ij ' represents K11, and this embodiment focuses on K. 12The aforementioned reference data compensation information can be K. 12 .

[0063] Step 402: Determine the optical center position corresponding to the current lens based on the reference data compensation information.

[0064] In this embodiment, the determination of the optical center position corresponding to the current lens based on the above-mentioned reference data compensation information can be achieved in many ways, such as using the centroid method, center method, centroid method, Gaussian fitting method, circle center fitting method, etc. This embodiment does not specifically limit the method.

[0065] Taking the above-mentioned center method as an example, step 402 can be implemented as follows: draw N contour lines using the reference data compensation information; determine the optical center position corresponding to the current lens using the center position of the graphic enclosed by each contour line.

[0066] Optionally, in this embodiment, the center position of the shape enclosed by each contour line can be calculated according to the following formula 5:

[0067]

[0068] In formula 5, (i n j n ) represents the nth contour line L n The center position of the enclosed figure, A n For the nth contour line L n The area of ​​the enclosed figure, where (i, j) represents two different coordinate axes in the coordinate system.

[0069] Optionally, in this embodiment, the determination of the optical center position of the current lens by using the center position of the graphic enclosed by each contour line can be implemented in many ways, such as taking the center of the graphic formed by the center positions of each contour line as the optical center position, etc.

[0070] As an example, the center of the graphic formed by the center positions of the shapes enclosed by the contour lines can be used as the optical center position according to the following formula 6:

[0071]

[0072] In Formula 6, the above (i c ,j c ) represents the optical center position mentioned above, N represents the number of center positions of the figure, and i n j n As described in Formula 5.

[0073] Step 403: Determine the image height corresponding to each pixel based on the distance from each pixel on the detector in the infrared thermal imaging device to the optical center position.

[0074] Optionally, step 403 can be implemented using the following formula 7:

[0075]

[0076] In Equation 7, (i, j) represents the position of any pixel on the detector, h i,j This represents the image height corresponding to the pixel at position (i, j) on the detector, where i c j c As described in Formula 6, it will not be repeated here.

[0077] Step 404: Based on the relative illumination difference between the relative illumination of the reference lens and the current lens corresponding to the image height of each pixel, the reference data compensation information is adjusted to obtain the target data compensation information.

[0078] Optionally, in this embodiment, step 404 can be specifically implemented as follows:

[0079] Step a1: For each pixel, the position of the pixel is (i,j), and the corresponding image height is h. i,j Then, find h under the relative illumination curve of the aforementioned reference lens. i,j The corresponding relative illuminance value E1(h) i,j ); and, find h under the relative illumination curve of the current lens. i,j The corresponding relative illuminance value E m (h i,j ).

[0080] Step a2, based on the above E1(h) i,j ) and E m (h i,j This determines the relative illumination difference between the relative illumination of the reference lens corresponding to the pixel and the relative illumination of the current lens.

[0081] Optionally, in this embodiment, the difference in relative illuminance can be expressed by the following formula:

[0082] Thus, through steps a1 and a2, the relative illumination difference between the image height corresponding to any pixel and the relative illumination of the aforementioned reference lens and the current lens has been determined.

[0083] Subsequently, as described in step 404, the reference data compensation information can be adjusted based on the relative illumination difference between the relative illumination of the reference lens and the current lens corresponding to the image height of each pixel, to obtain the target data compensation information. For example, the reference data compensation information can be adjusted according to the following formula:

[0084]

[0085] In Formula 8, (i, j) represents the position of a pixel on the detector in the infrared thermal imaging device, K1(i, j) is the compensation information in the reference data compensation information that matches the pixel at position (i, j), and K m (i,j) represents the adjusted data of K1(i,j), E m (h i,j ), E1(h i,j As described above.

[0086] This concludes the process. Figure 4 The process is shown below.

[0087] pass Figure 4 The process shown demonstrates how to adjust the calibration data compensation information of the calibrated reference lens by utilizing the difference between the relative illumination of the calibrated reference lens and the relative illumination of the current lens, thereby obtaining the target data compensation information.

[0088] After obtaining the target data compensation information, as described in step 304 above, the target data compensation information can be used to compensate the original infrared image data output by the infrared thermal imaging device based on the current lens at the current focal length. Figure 5 Is Figure 2 The compensation effect is illustrated using the image shown as an example.

[0089] The methods provided in the embodiments of this application have been described above. The apparatus provided in the embodiments of this application is described below:

[0090] See Figure 6 , Figure 6 This is a structural diagram of the device provided in an embodiment of this application. Figure 6 As shown, the device may include:

[0091] The inspection unit is used to check whether the lens currently matched by the infrared thermal imaging device is the calibrated reference lens;

[0092] The determining unit is used to determine target data compensation information based on the calibration data compensation information of the calibrated reference lens when the checking unit detects that the current lens is the calibrated reference lens; and to adjust the calibration data compensation information of the calibrated reference lens by utilizing the difference between the relative illumination of the calibrated reference lens and the relative illumination of the current lens when the checking unit detects that the current lens is not the calibrated reference lens, so as to obtain target data compensation information.

[0093] The compensation unit is used to compensate the original infrared image data output by the infrared thermal imaging device based on the current lens using target data compensation information.

[0094] Optionally, if the lens currently matched by the infrared thermal imaging device is a zoom lens, and the zoom lens has variable focal lengths, checking whether the lens currently matched by the infrared thermal imaging device is a calibrated reference lens includes: obtaining the current focal length used by the lens currently matched by the infrared thermal imaging device; if the current focal length is a reference focal length, then determining that the lens currently matched by the infrared thermal imaging device is a calibrated reference lens; otherwise, determining that the lens currently matched by the infrared thermal imaging device is not a calibrated reference lens; or, receiving an external instruction, the external instruction indicating whether the lens currently matched by the infrared thermal imaging device is a calibrated reference lens at the current focal length, and determining whether the lens currently matched by the infrared thermal imaging device is a calibrated reference lens based on the external instruction.

[0095] If the lens currently matched by the infrared thermal imaging device has a fixed focal length, checking whether the lens currently matched by the infrared thermal imaging device is a calibrated reference lens includes: obtaining lens configuration information of the lens currently matched by the infrared thermal imaging device, the lens configuration information including at least indication information for indicating whether the lens currently matched by the infrared thermal imaging device is a calibrated reference lens; determining whether the lens currently matched by the infrared thermal imaging device is a calibrated reference lens based on the lens configuration information; or, receiving an external instruction indicating whether the lens currently matched by the infrared thermal imaging device is a calibrated reference lens, and determining whether the lens currently matched by the infrared thermal imaging device is a calibrated reference lens based on the external instruction.

[0096] Optionally, the calibration data compensation information of the reference lens is represented by a calibrated matrix;

[0097] The step of determining the target data compensation information based on the calibration data compensation information of the reference lens includes: determining the calibration matrix of the reference lens as the target data compensation information.

[0098] Optionally, adjusting the calibration data compensation information of the calibrated reference lens based on the difference between the relative illumination of the calibrated reference lens and the relative illumination of the current lens to obtain the target data compensation information includes:

[0099] The calibration data compensation information of the reference lens is filtered to obtain reference data compensation information;

[0100] Based on the aforementioned reference data compensation information, determine the optical center position corresponding to the current lens;

[0101] The image height corresponding to each pixel is determined based on the distance from each pixel on the detector in the infrared thermal imaging device to the optical center position.

[0102] Based on the relative illumination difference between the relative illumination of the reference lens and the relative illumination of the current lens corresponding to the image height of each pixel, the reference data compensation information is adjusted to obtain the target data compensation information.

[0103] Optionally, determining the optical center position of the current lens based on the reference data compensation information includes:

[0104] N contour lines are drawn using the reference data compensation information;

[0105] By using the center position of the shape enclosed by the contour lines, the optical center position corresponding to the current lens can be determined.

[0106] Optionally, based on the relative illumination curve of the reference lens and the relative illumination curve of the current lens, determining the relative illumination difference between the relative illumination of the reference lens and the relative illumination of the current lens for each pixel includes:

[0107] For each pixel, the position of the pixel is (i,j), and the corresponding image height is h. i,j ,but:

[0108] Find h under the relative illumination curve of the reference lens. i,j The corresponding relative illuminance value E1(h) i,j ); and, find h under the relative illumination curve of the current lens. i,j The corresponding relative illuminance value E m (h i,j );

[0109] Based on the E1(h) i,j ) and E m (h i,j The relative illumination difference between the relative illumination of the reference lens and the relative illumination of the current lens is determined based on the image height corresponding to the pixel.

[0110] Optionally, adjusting the reference data compensation information based on the relative illumination difference to obtain the target data compensation information includes:

[0111] The target data compensation information is determined according to the following formula:

[0112]

[0113] Where (i, j) represents the position of a pixel on the detector in the infrared thermal imaging device, K1(i, j) is the compensation information in the reference data compensation information that matches the pixel at position (i, j), and E m (h i,j () indicates the h value found under the relative illumination curve of the current lens. i,j The corresponding relative illuminance value, h i,j E1(h) represents the image height corresponding to the cell at position (i, j). i,j () represents the h found under the relative illumination curve of the reference lens. i,j The corresponding relative illuminance value.

[0114] This concludes the process. Figure 6 Structural description of the device shown.

[0115] Correspondingly, embodiments of this application also provide a hardware structure diagram of an electronic device, specifically as follows: Figure 7 As shown, the electronic device can be a device implementing the above-described method. Figure 7 As shown, the hardware architecture includes a processor and memory.

[0116] The memory is used to store machine-executable instructions;

[0117] The processor is configured to read and execute machine-executable instructions stored in the memory to implement the steps in the method described above.

[0118] As one embodiment, the memory can be any electronic, magnetic, optical, or other physical storage device that can contain or store information such as executable instructions, data, etc. For example, the memory can be volatile memory, non-volatile memory, or similar storage media. Specifically, the memory can be RAM (Random Access Memory), flash memory, storage drives (such as hard disk drives), solid-state drives, any type of storage disk (such as optical discs, DVDs, etc.), or similar storage media, or combinations thereof.

[0119] The above description is merely a preferred embodiment of this application and is not intended to limit this application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the scope of protection of this application.

Claims

1. A data compensation method for infrared thermal imaging equipment, characterized in that, This method is applied to infrared thermal imaging equipment, including: Check whether the lens currently matched by the infrared thermal imaging device is the calibrated reference lens; When the current lens is found to be a calibrated reference lens, the target data compensation information is determined based on the calibration data compensation information of the calibrated reference lens; when the current lens is found not to be a calibrated reference lens, the calibration data compensation information of the calibrated reference lens is adjusted by using the difference between the relative illumination of the calibrated reference lens and the relative illumination of the current lens to obtain the target data compensation information. The target data compensation information is used to compensate the original infrared image data output by the infrared thermal imaging device based on the current lens at the current focal length.

2. The method according to claim 1, characterized in that, If the lens currently matched by the infrared thermal imaging device is a zoom lens, and the zoom lens has variable focal lengths, the step of checking whether the lens currently matched by the infrared thermal imaging device is a calibrated reference lens includes: obtaining the current focal length used by the lens currently matched by the infrared thermal imaging device; if the current focal length is a reference focal length, then determining that the lens currently matched by the infrared thermal imaging device is a calibrated reference lens; otherwise, determining that the lens currently matched by the infrared thermal imaging device is not a calibrated reference lens; or, receiving an external instruction, the external instruction indicating whether the lens currently matched by the infrared thermal imaging device is a calibrated reference lens at the current focal length, and determining whether the lens currently matched by the infrared thermal imaging device is a calibrated reference lens based on the external instruction. If the lens currently matched by the infrared thermal imaging device has a fixed focal length, checking whether the lens currently matched by the infrared thermal imaging device is a calibrated reference lens includes: obtaining lens configuration information of the lens currently matched by the infrared thermal imaging device, the lens configuration information including at least indication information for indicating whether the lens currently matched by the infrared thermal imaging device is a calibrated reference lens; determining whether the lens currently matched by the infrared thermal imaging device is a calibrated reference lens based on the lens configuration information; or, receiving an external instruction indicating whether the lens currently matched by the infrared thermal imaging device is a calibrated reference lens, and determining whether the lens currently matched by the infrared thermal imaging device is a calibrated reference lens based on the external instruction.

3. The method according to claim 1, characterized in that, The calibration data compensation information of the reference lens is represented by the calibrated matrix; The step of determining the target data compensation information based on the calibration data compensation information of the reference lens includes: determining the calibration matrix of the reference lens as the target data compensation information.

4. The method according to claim 1, characterized in that, The step of adjusting the calibration data compensation information of the calibrated reference lens by utilizing the difference between the relative illumination of the calibrated reference lens and the relative illumination of the current lens, to obtain the target data compensation information, includes: The calibration data compensation information of the reference lens is filtered to obtain reference data compensation information; Based on the aforementioned reference data compensation information, determine the optical center position corresponding to the current lens; The image height corresponding to each pixel is determined based on the distance from each pixel on the detector in the infrared thermal imaging device to the optical center position. Based on the relative illumination difference between the relative illumination of the reference lens and the relative illumination of the current lens corresponding to the image height of each pixel, the reference data compensation information is adjusted to obtain the target data compensation information.

5. The method according to claim 4, characterized in that, The step of filtering the calibration data compensation information of the reference lens to obtain reference data compensation information includes: The calibration data compensation information of the reference lens is filtered according to spatial domain filtering to obtain high-frequency information K. 11 and low-frequency information K 12 ; Based on the low-frequency information K 12 The reference data compensation information is then determined.

6. The method according to claim 4, characterized in that, Determining the optical center position of the current lens based on the reference data compensation information includes: N contour lines are drawn using the reference data compensation information; By using the center position of the shape enclosed by the contour lines, the optical center position corresponding to the current lens can be determined.

7. The method according to claim 4, characterized in that, Based on the relative illumination curve of the reference lens and the relative illumination curve of the current lens, the relative illumination difference between the relative illumination of the reference lens and the relative illumination of the current lens is determined according to the image height corresponding to each pixel, including: For each pixel, the position of the pixel is (i,j), and the corresponding image height is h. i,j ,but: Find h under the relative illumination curve of the reference lens. i,j The corresponding relative illuminance value E1(h) i,j ); and, find h under the relative illumination curve of the current lens. i,j The corresponding relative illuminance value E m (h i,j ); Based on the E1(h) i,j ) and E m (h i,j The relative illumination difference between the relative illumination of the reference lens and the relative illumination of the current lens is determined based on the image height corresponding to the pixel.

8. The method according to claim 4 or 7, characterized in that, The step of adjusting the reference data compensation information based on the relative illumination difference to obtain the target data compensation information includes: The target data compensation information is determined according to the following formula: Where (i, j) represents the position of a pixel on the detector in the infrared thermal imaging device, K1(i, j) is the compensation information in the reference data compensation information that matches the pixel at position (i, j), and E m (h i,j () indicates the h value found under the relative illumination curve of the current lens. i,j The corresponding relative illuminance value, h i,j E1(h) represents the image height corresponding to the cell at position (i, j). i,j () represents the h found under the relative illumination curve of the reference lens. i,j The corresponding relative illuminance value.

9. A data compensation device for use in infrared thermal imaging equipment, characterized in that, This device is used in infrared thermal imaging equipment, including: The inspection unit is used to check whether the lens currently matched by the infrared thermal imaging device is the calibrated reference lens; The determining unit is used to determine target data compensation information based on the calibration data compensation information of the calibrated reference lens when the checking unit detects that the current lens is the calibrated reference lens; and to adjust the calibration data compensation information of the calibrated reference lens by utilizing the difference between the relative illumination of the calibrated reference lens and the relative illumination of the current lens when the checking unit detects that the current lens is not the calibrated reference lens, so as to obtain target data compensation information. The compensation unit is used to compensate the original infrared image data output by the infrared thermal imaging device based on the current lens using target data compensation information.

10. The apparatus according to claim 9, characterized in that, If the lens currently matched by the infrared thermal imaging device is a zoom lens, and the zoom lens has variable focal lengths, the step of checking whether the lens currently matched by the infrared thermal imaging device is a calibrated reference lens includes: obtaining the current focal length used by the lens currently matched by the infrared thermal imaging device; if the current focal length is a reference focal length, then determining that the lens currently matched by the infrared thermal imaging device is a calibrated reference lens; otherwise, determining that the lens currently matched by the infrared thermal imaging device is not a calibrated reference lens; or, receiving an external instruction, the external instruction indicating whether the lens currently matched by the infrared thermal imaging device is a calibrated reference lens at the current focal length, and determining whether the lens currently matched by the infrared thermal imaging device is a calibrated reference lens based on the external instruction. If the lens currently matched by the infrared thermal imaging device has a fixed focal length, checking whether the lens currently matched by the infrared thermal imaging device is a calibrated reference lens includes: obtaining lens configuration information of the lens currently matched by the infrared thermal imaging device, the lens configuration information including at least indication information for indicating whether the lens currently matched by the infrared thermal imaging device is a calibrated reference lens; determining whether the lens currently matched by the infrared thermal imaging device is a calibrated reference lens based on the lens configuration information; or, receiving an external instruction indicating whether the lens currently matched by the infrared thermal imaging device is a calibrated reference lens, and determining whether the lens currently matched by the infrared thermal imaging device is a calibrated reference lens based on the external instruction. The calibration data compensation information of the reference lens is represented by the calibrated matrix; The step of determining the target data compensation information based on the calibration data compensation information of the reference lens includes: determining the calibration matrix of the reference lens as the target data compensation information; The step of adjusting the calibration data compensation information of the calibrated reference lens to obtain target data compensation information by utilizing the difference between the relative illumination of the calibrated reference lens and the relative illumination of the current lens includes: filtering the calibration data compensation information of the calibrated reference lens to obtain reference data compensation information; determining the optical center position corresponding to the current lens based on the reference data compensation information; determining the image height corresponding to each pixel based on the distance from each pixel on the detector in the infrared thermal imaging device to the optical center position; and adjusting the reference data compensation information based on the relative illumination difference between the relative illumination of the reference lens and the relative illumination of the current lens at the image height corresponding to each pixel to obtain target data compensation information. Determining the optical center position of the current lens based on the reference data compensation information includes: N contour lines are drawn using the reference data compensation information; By using the center position of the shape enclosed by each contour line, the optical center position corresponding to the current lens can be determined; Based on the relative illumination curve of the reference lens and the relative illumination curve of the current lens, the relative illumination difference between the relative illumination of the reference lens and the relative illumination of the current lens is determined according to the image height corresponding to each pixel, including: For each pixel, the position of the pixel is (i,j), and the corresponding image height is h. i,j ,but: Find h under the relative illumination curve of the reference lens. i,j The corresponding relative illuminance value E1(h) i,j ); and, find h under the relative illumination curve of the current lens. i,j The corresponding relative illuminance value E m (h i,j ); Based on the E1(h) i,j ) and E m (h i,j The relative illumination difference between the relative illumination of the reference lens and the relative illumination of the current lens is determined, based on the image height corresponding to the pixel. The step of adjusting the reference data compensation information based on the relative illumination difference to obtain the target data compensation information includes: The target data compensation information is determined according to the following formula: Where (i, j) represents the position of a pixel on the detector in the infrared thermal imaging device, K1(i, j) is the compensation information in the reference data compensation information that matches the pixel at position (i, j), and E m (h i,j () indicates the h value found under the relative illumination curve of the current lens. i,j The corresponding relative illuminance value, h i,j E1(h) represents the image height corresponding to the cell at position (i, j). i,j () represents the h found under the relative illumination curve of the reference lens. i,j The corresponding relative illuminance value.

11. An electronic device, characterized in that, The electronic device includes: a processor and memory; The memory is used to store machine-executable instructions; The processor is configured to read and execute machine-executable instructions stored in the memory to implement the method as described in any one of claims 1 to 9.

Citation Information

Patent Citations

  • Adaptive infrared non-uniformity calibration method based on motion state estimation

    CN106017695A

  • Method and system for processing low-illuminance image

    US20090180704A1