Shutter anomaly detection method and device, thermal imaging camera and storage medium

Abstract

The invention discloses a shutter anomaly detection method and device, a thermal imaging camera and a storage medium. The method comprises the following steps: determining the on-off state of an anti-burn mechanism of the thermal imaging camera in real time; wherein the on-off state of the anti-burning mechanism comprises an on-state of the anti-burning mechanism and an off-state of the anti-burning mechanism; acquiring a shot image of the thermal imaging camera according to the on-off state of the anti-burn mechanism, and performing gray value analysis on the shot image to determine a gray value analysis result; and judging whether the shutter of the thermal imaging camera is in an abnormal state or not according to the gray value analysis result. According to the technical scheme, gray value analysis can be performed on the shot image of the thermal imaging camera according to the on-off state of the anti-burning mechanism of the thermal imaging camera, and the abnormality of the shutter can be quickly judged according to the gray value analysis result, so that the loss caused by the abnormality of the shutter of the thermal imaging machine core can be solved and prevented at the fastest speed and at the minimum cost.

Description

Technical Field

[0001] The present invention relates to the technical field of thermal imaging cameras, and in particular to a shutter abnormality detection method, device, thermal imaging camera and storage medium. Background Art

[0002] With the rapid development of infrared technology, thermal imaging cameras are widely used in various fields such as industrial temperature measurement, human body temperature measurement, forest fire prevention, etc. As an important component of thermal imaging cameras, the shutter plays a key role in the non-uniformity correction of infrared images, temperature correction in temperature measurement, and anti-burning of infrared detectors. The normal use of thermal imaging cameras is inseparable from the normal operation of the thermal imaging movement shutter.

[0003] In order to ensure the effective control of the shutter of the thermal imaging movement and enable the thermal imaging camera to work normally under various working conditions, relevant technicians have proposed various shutter state control methods. Although these methods can solve the abnormal closing or opening of the shutter of the thermal imaging movement to a certain extent, with the increase in the service life of the thermal imaging camera or due to high-intensity impact of natural external forces, the shutter will be irreversibly damaged, resulting in the shutter being unable to be controlled normally. If the abnormality of the shutter is not discovered in time, it may cause damage to the infrared detector at the least. For example, if the shutter cannot be closed normally, when a high-temperature object far higher than the infrared thermal imaging temperature measurement range appears in the observation area, the detector will be burned. In severe cases, it may cause missed reporting of fires, resulting in significant property losses. For example, due to the abnormal closure of the shutter, the fire point information cannot be detected. Therefore, it is very important to accurately and quickly detect the abnormal state of the shutter of the thermal imaging camera. Summary of the invention

[0004] The present invention provides a shutter abnormality detection method, device, thermal imaging camera and storage medium to solve the technical problem that the abnormal state of the shutter of the thermal imaging camera cannot be detected in time and causes various losses.

[0005] According to one aspect of the present invention, there is provided a shutter abnormality detection method, comprising:

[0006] Determine in real time the switch state of the anti-burn mechanism of the thermal imaging camera; wherein the switch state of the anti-burn mechanism includes an anti-burn mechanism turned on state and an anti-burn mechanism turned off state;

[0007] According to the switch state of the anti-burn mechanism, the captured image of the thermal imaging camera is acquired, and grayscale value analysis is performed on the captured image to determine the grayscale value analysis result;

[0008] Whether the shutter of the thermal imaging camera is in an abnormal state is determined according to the gray value analysis result.

[0009] According to another aspect of the present invention, there is provided a shutter abnormality detection device, comprising:

[0010] An anti-burn mechanism switch state determination module is used to determine the anti-burn mechanism switch state of the thermal imaging camera in real time; wherein the anti-burn mechanism switch state includes an anti-burn mechanism turned on state and an anti-burn mechanism turned off state;

[0011] A grayscale value analysis result determination module, used to obtain the image captured by the thermal imaging camera according to the switch state of the anti-burn mechanism, and perform grayscale value analysis on the captured image to determine the grayscale value analysis result;

[0012] The abnormal state judgment module is used to judge whether the shutter of the thermal imaging camera is in an abnormal state according to the gray value analysis result.

[0013] According to another aspect of the present invention, a thermal imaging camera is provided, the thermal imaging camera comprising:

[0014] at least one processor; and

[0015] a memory communicatively connected to the at least one processor; wherein,

[0016] The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the shutter abnormality detection method described in any embodiment of the present invention.

[0017] According to another aspect of the present invention, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the shutter abnormality detection method described in any embodiment of the present invention when executed.

[0018] The shutter abnormality detection scheme of the embodiment of the present invention determines the switch state of the anti-burn mechanism of the thermal imaging camera in real time; wherein the switch state of the anti-burn mechanism includes the anti-burn mechanism turned on state and the anti-burn mechanism turned off state; according to the switch state of the anti-burn mechanism, the captured image of the thermal imaging camera is obtained, and the captured image is subjected to grayscale value analysis to determine the grayscale value analysis result; according to the grayscale value analysis result, it is judged whether the shutter of the thermal imaging camera is in an abnormal state. Through the technical scheme provided by the embodiment of the present invention, according to the switch state of the anti-burn mechanism of the thermal imaging camera, the captured image is subjected to grayscale value analysis to determine the grayscale value analysis result without the need for additional hardware support, and the shutter abnormality is quickly judged according to the grayscale value analysis result, which helps to solve and prevent the losses caused by the abnormal shutter of the thermal imaging movement at the fastest speed and with the lowest cost.

[0019] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0021] Figure 1 is a flow chart of a shutter abnormality detection method provided according to Embodiment 1 of the present invention;

[0022] Figure 2 is a schematic diagram of a thermal imaging image processing process provided by an embodiment of the present invention;

[0023] Figure 3 is a schematic diagram of a detection window provided by an embodiment of the present invention;

[0024] Figure 4 is a grayscale histogram of an original image of a natural scene output by an infrared detector of a thermal imaging camera provided by an embodiment of the present invention;

[0025] Figure 5 is a grayscale histogram of a shutter original image output by an infrared detector of a thermal imaging camera provided by an embodiment of the present invention;

[0026] Figure 6 is a flow chart of a shutter abnormality detection method provided by Embodiment 2 of the present invention;

[0027] Figure 7 is a structural schematic diagram of a shutter abnormality detection device provided according to Embodiment 3 of the present invention;

[0028] Figure 8 It is a schematic diagram of the structure of a thermal imaging camera that implements the shutter anomaly detection method according to an embodiment of the present invention. DETAILED DESCRIPTION

[0029] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0030] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0031] Embodiment 1

[0032] Figure 1 A flowchart of a shutter abnormality detection method is provided for the first embodiment of the present invention. This embodiment can be applied to abnormality detection of the shutter of a thermal imaging camera. The method can be executed by a shutter abnormality detection device. The shutter abnormality detection device can be implemented in the form of hardware and / or software. The shutter abnormality detection device can be configured in a thermal imaging camera. Figure 1 As shown, the method includes:

[0033] S110. Determine in real time the switch state of the anti-burn mechanism of the thermal imaging camera; wherein the switch state of the anti-burn mechanism includes an anti-burn mechanism turned on state and an anti-burn mechanism turned off state.

[0034] Among them, thermal imaging cameras are cameras that detect infrared energy in a non-contact manner and convert it into electrical signals through sensors to obtain image pictures and temperature information. The shutter in a thermal imaging camera refers to the baffle in front of the thermal imaging infrared detector. The baffle is an important component of the thermal imaging movement and plays a vital role in non-uniformity correction and temperature measurement. During the use of thermal imaging cameras, in order to prevent high-temperature objects from being permanently burned due to radiation intensity exceeding the tolerable range of the thermal imaging infrared detector, an anti-burn mechanism is usually set. When there is a high-temperature object in the observation area, the anti-burn mechanism is turned on, and the shutter of the thermal imaging movement is closed to block the irradiation of high-temperature radiation. When the anti-burn mechanism is not turned on, the shutter of the thermal imaging movement is in the open state, ensuring that the infrared radiation within the observation field of view irradiates the detector target surface, thereby forming a clear infrared image.

[0035] In the embodiment of the present invention, the switch state of the anti-burn mechanism in the thermal imaging camera can be determined by reading the switch state flag of the anti-burn mechanism in the thermal imaging camera in real time. For example, when the switch state flag of the anti-burn mechanism is 1, it is determined that the switch state of the anti-burn mechanism in the thermal imaging camera is the anti-burn mechanism turned on state, and when the switch state flag of the anti-burn mechanism is 0, it is determined that the switch state of the anti-burn mechanism in the thermal imaging camera is the anti-burn mechanism turned off state.

[0036] S120. Acquire an image captured by the thermal imaging camera according to the switch state of the anti-burn mechanism, and perform grayscale value analysis on the captured image to determine a grayscale value analysis result.

[0037] In an embodiment of the present invention, according to the switch state of the anti-burn mechanism, the captured image of the thermal imaging camera is obtained, and the grayscale value analysis is performed on the captured image to determine the grayscale value analysis result. Wherein, the captured image of the thermal imaging camera is different when the switch state of the anti-burn mechanism is different, and the grayscale value analysis result of the captured image is different. For example, when it is determined that the switch state of the anti-burn mechanism of the camera is the anti-burn mechanism on state, the image currently captured by the camera is obtained, and the grayscale value analysis is performed on the currently captured image to determine the maximum grayscale value of the currently captured image. For another example, when it is determined that the switch state of the anti-burn mechanism of the camera is the anti-burn mechanism not on state, multiple frames of images captured by the camera within a preset time period are obtained, and the grayscale value analysis is performed on the multiple frames of images captured within the preset time period to determine the grayscale value standard deviation of each image.

[0038] S130. Determine whether the shutter of the thermal imaging camera is in an abnormal state according to the gray value analysis result.

[0039] In the embodiment of the present invention, due to different switch states of the anti-burn mechanism, different captured images of the thermal imaging camera are obtained, and the corresponding grayscale value analysis results are different. Therefore, the grayscale value analysis results under different switch states of the anti-burn mechanism are analyzed, and whether the shutter of the thermal imaging camera is in an abnormal state is determined according to the grayscale value analysis results. Optionally, when it is determined that the shutter of the thermal imaging camera is in an abnormal state according to the grayscale value analysis results, a shutter abnormality alarm process is performed. The advantage of such a setting is that the loss caused by the abnormal shutter of the thermal imaging camera can be solved and prevented at the fastest speed and minimum cost.

[0040] Optionally, according to the switch state of the anti-burn mechanism, the captured image of the thermal imaging camera is obtained, and the grayscale value analysis is performed on the captured image to determine the grayscale value analysis result, including: when it is determined that the thermal imaging camera is in a state where the anti-burn mechanism is not turned on, at least two first images continuously captured by the thermal imaging camera within a preset time period are obtained, and the grayscale value standard deviation of each first image is determined respectively; wherein the preset time period is greater than the non-uniform correction duration of the thermal imaging camera; according to the grayscale value analysis result, it is judged whether the shutter of the thermal imaging camera is in an abnormal state, including: when the grayscale value standard deviations of the at least two first images are both less than a preset standard deviation threshold, it is determined that the shutter of the thermal imaging camera is in an abnormal state.

[0041] Figure 2 A schematic diagram of a thermal imaging image processing process provided by an embodiment of the present invention. Figure 2 As shown, the original image is the original image output by the infrared detector in the thermal imaging camera, and the original image can be represented as Frame src , for the original image Frame src Perform non-uniform correction and represent the image after non-uniform correction as Frame nuc Since the dynamic range of grayscale values ​​of the image after non-uniform correction is small, the user cannot distinguish the photographed object with the naked eye. Therefore, the image frame after non-uniform correction is nuc Contrast stretching is performed, and the image after contrast stretching is used as the final output image of the thermal imaging camera. The final output image of the thermal imaging camera can be represented as Frame dst The thermal imaging camera needs to perform non-uniform correction on the original image output by the infrared detector at regular intervals. During the non-uniform correction process, the shutter needs to be closed to prevent external light from entering the infrared detector. The shutter blocks the incoming light.

[0042] According to the principle of non-uniform correction, when the shutter is in an abnormal state of long-closed or long-open, after non-uniform correction, the output image Frame of the thermal imaging camera dst It is always a uniform image with a very small standard deviation, which rarely appears in the actual observation scene of the thermal imaging camera. Therefore, it can be used as the prior condition P of the abnormal shutter state.

[0043] In an embodiment of the present invention, when it is determined that the thermal imaging camera is in a state where the anti-burn mechanism is not turned on, at least two first images continuously taken by the thermal imaging camera within a preset time period are obtained. Based on the above-mentioned priori condition P, for each first image taken within the preset time period, the standard deviation of the grayscale value of the current first image is calculated. When the standard deviation of the grayscale value of each first image taken within the preset time period is less than the preset standard deviation threshold, it is determined that the shutter of the thermal imaging camera is in an abnormal state, that is, the shutter of the thermal imaging camera is in an abnormally long open state or abnormally long closed state. It should be noted that in order to avoid accidental errors, when the proportion of first images with a standard deviation less than the preset standard deviation threshold among all first images is greater than a preset proportion, it can also be determined that the shutter of the thermal imaging camera is in an abnormal state. Among them, each first image taken within the preset time period can be understood as the final output image Frame of the thermal imaging camera. dst , the preset time period is greater than the non-uniform correction duration of the thermal imaging camera. Since the frequency of the thermal imaging camera taking images is consistent, the number of first images taken within the preset time period is greater than the number of shutter images taken within the non-uniform correction duration. In the embodiment of the present invention, by setting the preset time period to be greater than the non-uniform correction duration of the thermal imaging camera, the influence of the normal closing of the shutter during the non-uniform correction on the determination of the shutter abnormal state can be effectively avoided, thereby improving the accuracy of the determination of the shutter abnormal state.

[0044] Optionally, according to the switch state of the anti-burn mechanism, the image captured by the thermal imaging camera is obtained, and the grayscale value analysis is performed on the captured image to determine the grayscale value analysis result, including: when it is determined that the thermal imaging camera is in the anti-burn mechanism on state, a second image currently captured by the thermal imaging camera is obtained, and the highest grayscale value of the second image is determined; according to the grayscale value analysis result, it is judged whether the shutter of the thermal imaging camera is in an abnormal state, including: when the highest grayscale value meets a preset condition, it is determined that the shutter of the thermal imaging camera is in an abnormally open state.

[0045] In an embodiment of the present invention, when it is determined that the thermal imaging camera is in the state of the anti-burn mechanism being turned on, the second image currently captured by the thermal imaging camera is obtained, wherein the second image currently captured can be understood as an infrared image captured by the thermal imaging camera at the moment when the thermal imaging camera is determined to be in the state of the anti-burn mechanism being turned on. The second image is analyzed for grayscale values ​​to determine the highest grayscale value of the second image, and when the highest grayscale value meets a preset condition, it is determined that the thermal imaging camera is in an abnormally turned-on state. It can be understood that because the thermal imaging camera is currently in the state of the anti-burn mechanism being turned on, there must be high-temperature radiation in the observation field of the thermal imaging camera, and if the shutter is currently in the open state, there must be a large grayscale value in the captured second image. Therefore, when the highest grayscale value is greater than a certain grayscale threshold, it can be determined that the shutter of the thermal imaging camera is in an abnormally turned-on state.

[0046] Optionally, when the highest grayscale value meets a preset condition, it is determined that the shutter of the thermal imaging camera is in an abnormally open state, including: obtaining the current cavity temperature of the thermal imaging movement of the thermal imaging camera; determining the target average grayscale value corresponding to the current cavity temperature according to the current cavity temperature and a preset correspondence table between the cavity temperature and the average grayscale value; when the difference between the highest grayscale value and the target average grayscale value is greater than a preset grayscale threshold, it is determined that the shutter of the thermal imaging camera is in an abnormally open state.

[0047] In an embodiment of the present invention, when the shutter of the thermal imaging camera is normally closed, the shutter will block the thermal imaging infrared detector, causing the image captured by the thermal imaging camera to be a shutter image. Since the shutter is a baffle with a uniform surface temperature, the grayscale value of the shutter image captured is evenly distributed. For example, the average grayscale value of the shutter image is shutter. Among them, the average grayscale value of the shutter image is related to the cavity temperature of the thermal imaging core of the thermal imaging camera. Different cavity temperatures correspond to different average grayscale values ​​of the shutter image. Therefore, the current cavity temperature of the thermal imaging core of the thermal imaging camera is obtained, and a correspondence table of the pre-set cavity temperature and the average grayscale value is obtained, and the target average grayscale value matching the current cavity temperature is searched in the correspondence table. When the current cavity temperature cannot be found in the correspondence table, the target average grayscale value matching the current cavity temperature can be determined by interpolating the correspondence table. Among them, the correspondence table between cavity temperature and average grayscale value can be obtained by calibrating the thermal imaging movement before the thermal imaging camera leaves the factory, that is, at different cavity temperatures of the thermal imaging movement, the average grayscale value of the current shutter image is recorded and saved in the non-volatile memory of the thermal imaging camera in a tabular form. Different cavity temperatures map different average grayscale values ​​of shutter images.

[0048] If the shutter is currently open, there must be a large grayscale value in the second image. If the highest grayscale value of the second image is maxgray, then maxgray>>shutter. Therefore, the difference between the highest grayscale value maxgray and the target average grayscale value shutter is calculated. When the shutter of the thermal imaging camera is abnormally opened, Indicates the preset grayscale threshold.

[0049] The shutter abnormality detection method of the embodiment of the present invention determines the switch state of the anti-burn mechanism of the thermal imaging camera in real time; wherein the switch state of the anti-burn mechanism includes the anti-burn mechanism turned on state and the anti-burn mechanism turned off state; according to the switch state of the anti-burn mechanism, the captured image of the thermal imaging camera is obtained, and the captured image is subjected to grayscale value analysis to determine the grayscale value analysis result; according to the grayscale value analysis result, it is judged whether the shutter of the thermal imaging camera is in an abnormal state. Through the technical solution provided by the embodiment of the present invention, according to the switch state of the anti-burn mechanism of the thermal imaging camera, the captured image is subjected to grayscale value analysis to determine the grayscale value analysis result without the need for additional hardware support, and the shutter abnormality is quickly judged according to the grayscale value analysis result, which helps to solve and prevent the losses caused by the abnormal shutter of the thermal imaging movement at the fastest speed and with the lowest cost.

[0050] In some embodiments, when it is determined that the thermal imaging camera is in a state where the anti-burn mechanism is not turned on, at least two first images continuously shot by the thermal imaging camera within a preset time period are obtained, and the grayscale value standard deviations of the at least two first images are determined respectively, including: when it is determined that the thermal imaging camera is in a state where the anti-burn mechanism is not turned on, taking n*Ns as a detection window, obtaining the first images of the detection window continuously shot by the thermal imaging camera within a preset time period; wherein N s represents the number of frames of shutter images continuously shot within the non-uniform correction time, where n is an integer greater than 1; and calculates the gray value standard deviation of each first image in the detection window respectively.

[0051] Assume that the number of shutter image frames continuously collected by the thermal imaging camera during non-uniformity correction is N s , with n*N s (n>1) frames are used as the detection window win, and the first image of the detection window win continuously shot by the thermal imaging camera within the preset time period is obtained, that is, n*N frames continuously shot by the thermal imaging camera within the preset time period are obtained. sThe first image is n. n can be adjusted according to the detection sensitivity, for example, n can be 4. Based on the prior condition P, for each first image in the detection window, the gray value standard deviation σ of the current first image is calculated, and it is determined whether the gray value standard deviation σ of the current first image is less than the preset standard deviation threshold when When , the current first image is marked as s. When each first image in the detection window win is marked as s, it is determined that the shutter of the thermal imaging camera is in an abnormal state. In the embodiment of the present invention, Figure 3 A schematic diagram of a detection window provided by an embodiment of the present invention, such as Figure 3 As shown in the figure, a, b, and c are different time periods where non-uniformity correction may occur. By setting n*N s The detection window of n*N filters out the influence of normal shutter closing on the abnormal shutter state judgment during non-uniform correction. s The detection window makes the number of first images adjustable and has strong adaptability. No matter when the non-uniformity correction occurs during the detection, it does not affect the accuracy of the abnormal shutter state judgment.

[0052] In some embodiments, when the grayscale value standard deviations of the at least two first images are less than a preset standard deviation threshold, determining that the shutter of the thermal imaging camera is in an abnormal state includes: when the grayscale value standard deviations of the at least two first images are less than a preset standard deviation threshold, acquiring the original image currently output by the infrared detector of the thermal imaging camera; determining the grayscale histogram distribution of the original image; when the grayscale histogram distribution is Gaussian distribution or Gaussian mixture distribution, determining that the shutter of the thermal imaging camera is in an abnormally long open state. Optionally, when the grayscale histogram distribution is non-Gaussian distribution or non-Gaussian mixture distribution, determining that the shutter of the thermal imaging camera is in an abnormally long closed state.

[0053] In the embodiment of the present invention, when the gray value standard deviation of at least two first images is less than the preset standard deviation threshold, it is determined that the shutter of the thermal imaging camera is in an abnormal state, wherein the abnormal state includes an abnormal long open state and an abnormal long closed state. Therefore, when the gray value standard deviation of at least two first images is less than the preset standard deviation threshold, the original image Frame' currently output by the infrared detector of the thermal imaging camera is obtained. src , by the original image Frame' currently output by the infrared detector of the thermal imaging camera src An analysis is performed to further determine whether the shutter of the thermal imaging camera is in an abnormally long open state or an abnormally long closed state.

[0054] By collecting the original image frames of multiple actual observation scenes of the thermal imaging camera src, analyze its grayscale histogram, remove the grayscale value statistics with grayscale values ​​less than 10 to eliminate the influence of outliers, take the remaining grayscale values ​​as valid grayscale values, and make grayscale value statistics within the valid grayscale values ​​to obtain Frame src Histogram distribution of src . Figure 4 The grayscale histogram of the original image of a natural scene output by the infrared detector of a thermal imaging camera provided in an embodiment of the present invention. Figure 4 As shown in the figure, after a large number of statistics, it is found that the Frame collected in natural scenes src The histogram distribution of is Gaussian distribution or Gaussian mixture distribution. Figure 5 The grayscale histogram of the shutter original image output by the infrared detector of a thermal imaging camera provided in an embodiment of the present invention. The shutter original image refers to the shutter image captured by the infrared detector of the thermal imaging camera when the shutter is closed, and the shutter original image has not been subjected to non-uniform correction. Figure 5 As shown, the grayscale histogram of the shutter original image collected when the shutter is closed is significantly different from the Gaussian distribution and the Gaussian mixture distribution. Therefore, the embodiment of the present invention analyzes the grayscale histogram distribution of the original image currently output by the infrared detector of the thermal imaging camera, and determines whether the grayscale histogram distribution is Gaussian distribution or Gaussian mixture distribution. If so, it is determined that the shutter of the thermal imaging camera is in an abnormally long open state, otherwise, it is determined that the shutter of the thermal imaging camera is in an abnormally long closed state.

[0055] Optionally, when the grayscale histogram distribution is non-Gaussian distribution or non-Gaussian mixed distribution, it is determined that the shutter of the thermal imaging camera is in an abnormally long closed state, including: when the grayscale histogram distribution is non-Gaussian distribution or non-Gaussian mixed distribution, determining the grayscale value range of the original image and the target grayscale value whose grayscale value statistics are greater than a preset statistical threshold according to the grayscale histogram distribution; when the grayscale value range of the original image is less than the preset grayscale range and the grayscale range length corresponding to the target grayscale value is greater than the preset grayscale range length, it is determined that the shutter of the thermal imaging camera is in an abnormally long closed state.

[0056] In the embodiment of the present invention, Figure 5As shown in FIG. 1 , the grayscale histogram of the shutter original image collected when the shutter is closed is not only significantly different from the Gaussian distribution and the Gaussian mixture distribution, but also has the following two characteristics: (a) its grayscale value range is smaller than that of the natural scene, and (b) a higher statistical value occupies a wider grayscale value range. Therefore, when the grayscale histogram of the original image currently output by the infrared detector is neither Gaussian distribution nor Gaussian mixture distribution, the grayscale value range of the original image and the target grayscale value whose grayscale value statistics are greater than the preset statistical value threshold are further determined according to the grayscale histogram distribution. When the grayscale value range of the original image is less than the preset grayscale range and the grayscale range length corresponding to the target grayscale value is greater than the preset grayscale range length, it means that the grayscale histogram distribution of the original image has the above two characteristics (a) and (b). Therefore, it can be determined that the shutter of the imaging camera is in an abnormally long closed state. The advantage of this setting is that it can further accurately determine whether the shutter of the thermal imaging camera is in an abnormally long closed state.

[0057] Embodiment 2

[0058] Figure 6 A flowchart of a shutter abnormality detection method provided in Embodiment 2 of the present invention is shown in FIG. Figure 6 As shown, the method includes:

[0059] S610. Determine in real time the switch state of the anti-burn mechanism of the thermal imaging camera; wherein the switch state of the anti-burn mechanism includes an anti-burn mechanism turned on state and an anti-burn mechanism turned off state.

[0060] S620: when it is determined that the thermal imaging camera is in a state where the anti-burn mechanism is not turned on, s The first image of the detection window continuously captured by the thermal imaging camera within a preset time period is obtained; wherein N s represents the number of frames of shutter images continuously shot within the non-uniform correction time, where n is an integer greater than 1.

[0061] S630, respectively calculating the gray value standard deviation of each first image in the detection window.

[0062] S640: When the grayscale value standard deviations of the first images in the detection window are all less than a preset standard deviation threshold, an original image currently output by the infrared detector of the thermal imaging camera is obtained.

[0063] S650: Determine the grayscale histogram distribution of the original image.

[0064] S660, determine whether the grayscale histogram distribution is Gaussian distribution or Gaussian mixture distribution, if so, execute S670, otherwise, execute S680.

[0065] S670: Determine that the shutter of the thermal imaging camera is in an abnormally long open state.

[0066] S680: Determine that the shutter of the thermal imaging camera is in an abnormally long closed state.

[0067] S690: When it is determined that the thermal imaging camera is in an anti-burn mechanism on state, obtain a second image currently captured by the thermal imaging camera, and determine a maximum grayscale value of the second image.

[0068] S6100. Obtain a current cavity temperature of a thermal imaging core of the thermal imaging camera.

[0069] S6110. Determine a target average grayscale value corresponding to the current cavity temperature according to the current cavity temperature and a preset correspondence table between cavity temperature and average grayscale value.

[0070] S6120: When the difference between the highest grayscale value and the target average grayscale value is greater than a preset grayscale threshold, determine that the shutter of the thermal imaging camera is in an abnormally open state.

[0071] Through the technical solution provided by the embodiment of the present invention, without the need for additional hardware support, grayscale value analysis is performed on the image captured by the thermal imaging camera according to the switch state of the anti-burn mechanism of the thermal imaging camera, and shutter abnormalities are quickly determined based on the grayscale value analysis results, which helps to solve and prevent losses caused by abnormal shutter of the thermal imaging movement at the fastest speed and minimum cost.

[0072] Embodiment 3

[0073] Figure 7 A schematic structural diagram of a shutter abnormality detection device provided in Embodiment 3 of the present invention.

[0074] like Figure 7 As shown, the device comprises:

[0075] The anti-burn mechanism switch state determination module 710 is used to determine the anti-burn mechanism switch state of the thermal imaging camera in real time; wherein the anti-burn mechanism switch state includes the anti-burn mechanism turned on state and the anti-burn mechanism turned off state;

[0076] A grayscale value analysis result determination module 720 is used to obtain the image captured by the thermal imaging camera according to the switch state of the anti-burn mechanism, and perform grayscale value analysis on the captured image to determine the grayscale value analysis result;

[0077] The abnormal state judgment module 730 is used to judge whether the shutter of the thermal imaging camera is in an abnormal state according to the gray value analysis result.

[0078] Optionally, the gray value analysis result determination module includes:

[0079] a gray value standard deviation determination unit, configured to obtain at least two first images continuously shot by the thermal imaging camera within a preset time period and respectively determine the gray value standard deviation of each first image when it is determined that the thermal imaging camera is in a non-open state of the anti-burn mechanism; wherein the preset time period is greater than the non-uniformity correction time length of the thermal imaging camera;

[0080] The abnormal state judgment module includes:

[0081] The abnormal state determination unit is used to determine that the shutter of the thermal imaging camera is in an abnormal state when the standard deviations of the gray values ​​of the at least two first images are all less than a preset standard deviation threshold.

[0082] Optionally, the gray value standard deviation determining unit is used to:

[0083] When it is determined that the thermal imaging camera is in a state where the anti-burn mechanism is not turned on, n*N s The first image of the detection window continuously captured by the thermal imaging camera within a preset time period is obtained; wherein N s represents the number of frames of shutter images continuously captured within the non-uniform correction time, where n is an integer greater than 1;

[0084] The grayscale value standard deviation of each first image in the detection window is calculated respectively.

[0085] Optionally, the abnormal state determining unit is used to:

[0086] When the grayscale value standard deviations of the at least two first images are all less than a preset standard deviation threshold, acquiring the original image currently output by the infrared detector of the thermal imaging camera;

[0087] Determining the grayscale histogram distribution of the original image;

[0088] When the grayscale histogram distribution is Gaussian distribution or Gaussian mixture distribution, it is determined that the shutter of the thermal imaging camera is in an abnormally long open state.

[0089] Optionally, the device further comprises:

[0090] The abnormal long-closed state determination module is used to determine that the shutter of the thermal imaging camera is in an abnormal long-closed state when the grayscale histogram distribution is non-Gaussian distribution or non-Gaussian mixed distribution.

[0091] Optionally, the abnormal long closed state determination module is used to:

[0092] When the grayscale histogram distribution is non-Gaussian distribution or non-Gaussian mixed distribution, determining the grayscale value range of the original image and the target grayscale value whose grayscale value statistics are greater than a preset statistics threshold according to the grayscale histogram distribution;

[0093] When the grayscale value range is smaller than the preset grayscale range and the grayscale range length corresponding to the target grayscale value is larger than the preset grayscale range length, it is determined that the shutter of the thermal imaging camera is in an abnormally long closed state.

[0094] Optionally, the gray value analysis result determination module includes:

[0095] a maximum grayscale value determining unit, configured to, when it is determined that the thermal imaging camera is in an anti-burn mechanism on state, obtain a second image currently captured by the thermal imaging camera and determine a maximum grayscale value of the second image;

[0096] The abnormal state judgment module includes:

[0097] The abnormal opening state determining unit is used to determine that the shutter of the thermal imaging camera is in an abnormal opening state when the highest grayscale value meets a preset condition.

[0098] Optionally, the abnormal opening state determining unit is used to:

[0099] Obtaining the current cavity temperature of the thermal imaging core of the thermal imaging camera;

[0100] Determining a target average grayscale value corresponding to the current cavity temperature according to the current cavity temperature and a preset correspondence table between the cavity temperature and the average grayscale value;

[0101] When the difference between the highest grayscale value and the target average grayscale value is greater than a preset grayscale threshold, it is determined that the shutter of the thermal imaging camera is in an abnormally open state.

[0102] The shutter abnormality detection device provided in the embodiment of the present invention can execute the shutter abnormality detection method provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.

[0103] Embodiment 4

[0104] Figure 8A schematic diagram of the structure of a thermal imaging camera 10 that can be used to implement an embodiment of the present invention is shown. The thermal imaging camera is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The thermal imaging camera can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or claimed herein.

[0105] like Figure 8 As shown, the thermal imaging camera 10 includes at least one processor 11, and a memory connected to the at least one processor 11, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., wherein the memory stores a computer program that can be executed by at least one processor, and the processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 to the random access memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the thermal imaging camera 10 can also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other through a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0106] A number of components in the thermal imaging camera 10 are connected to the I / O interface 15, including: an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a disk, an optical disk, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the thermal imaging camera 10 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0107] The processor 11 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 11 performs the various methods and processes described above, such as a shutter abnormality detection method.

[0108] In some embodiments, the shutter abnormality detection method may be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 18. In some embodiments, part or all of the computer program may be loaded and / or installed on the thermal imaging camera 10 via the ROM 12 and / or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the shutter abnormality detection method described above may be performed. Alternatively, in other embodiments, the processor 11 may be configured to perform the shutter abnormality detection method in any other appropriate manner (e.g., by means of firmware).

[0109] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0110] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer program is executed by the processor, the functions / operations specified in the flow chart and / or block diagram are implemented. The computer program may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0111] In the context of the present invention, a computer-readable storage medium may be a tangible medium that may contain or store a computer program for use by or in combination with an instruction execution system, device or equipment. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0112] To provide interaction with a user, the systems and techniques described herein may be implemented on a thermal imaging camera having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the thermal imaging camera. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).

[0113] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0114] A computing system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The client and server relationship is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services.

[0115] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in the present invention can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution of the present invention can be achieved, and this document does not limit this.

[0116] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A shutter abnormality detection method, characterized in that: include: Determine in real time the switch state of the anti-burn mechanism of the thermal imaging camera; wherein the switch state of the anti-burn mechanism includes an anti-burn mechanism turned on state and an anti-burn mechanism turned off state; According to the switch state of the anti-burn mechanism, the captured image of the thermal imaging camera is acquired, and grayscale value analysis is performed on the captured image to determine the grayscale value analysis result; Whether the shutter of the thermal imaging camera is in an abnormal state is determined according to the gray value analysis result.

2. The method according to claim 1, characterized in that According to the switch state of the anti-burn mechanism, the captured image of the thermal imaging camera is acquired, and grayscale value analysis is performed on the captured image to determine the grayscale value analysis result, including: When it is determined that the thermal imaging camera is in a non-activation state of the anti-burn mechanism, obtaining at least two first images continuously shot by the thermal imaging camera within a preset time period, and determining the gray value standard deviation of the at least two first images respectively; wherein the preset time period is greater than the non-uniformity correction time length of the thermal imaging camera; Judging whether the shutter of the thermal imaging camera is in an abnormal state according to the gray value analysis result includes: When the grayscale value standard deviations of the at least two first images are all smaller than a preset standard deviation threshold, it is determined that the shutter of the thermal imaging camera is in an abnormal state.

3. The method according to claim 2, characterized in that When it is determined that the thermal imaging camera is in a state where the anti-burn mechanism is not turned on, obtaining at least two first images continuously shot by the thermal imaging camera within a preset time period, and determining grayscale value standard deviations of the at least two first images respectively, including: When it is determined that the thermal imaging camera is in a state where the anti-burn mechanism is not turned on, n*N s The first image of the detection window continuously captured by the thermal imaging camera within a preset time period is obtained; wherein N s represents the number of frames of shutter images continuously captured within the non-uniform correction time, where n is an integer greater than 1; The grayscale value standard deviation of each first image in the detection window is calculated respectively.

4. The method according to claim 2, characterized in that: When the grayscale value standard deviations of the at least two first images are all less than a preset standard deviation threshold, determining that the shutter of the thermal imaging camera is in an abnormal state includes: When the grayscale value standard deviations of the at least two first images are all less than a preset standard deviation threshold, acquiring the original image currently output by the infrared detector of the thermal imaging camera; Determining the grayscale histogram distribution of the original image; When the grayscale histogram distribution is Gaussian distribution or Gaussian mixture distribution, it is determined that the shutter of the thermal imaging camera is in an abnormally long open state.

5. The method according to claim 4, characterized in that Also includes: When the grayscale histogram distribution is non-Gaussian distribution or non-Gaussian mixed distribution, determining the grayscale value range of the original image and the target grayscale value whose grayscale value statistics are greater than a preset statistics threshold according to the grayscale histogram distribution; When the grayscale value range is smaller than the preset grayscale range and the grayscale range length corresponding to the target grayscale value is larger than the preset grayscale range length, it is determined that the shutter of the thermal imaging camera is in an abnormally long closed state.

6. The method according to claim 1, characterized in that According to the switch state of the anti-burn mechanism, the captured image of the thermal imaging camera is acquired, and grayscale value analysis is performed on the captured image to determine the grayscale value analysis result, including: When it is determined that the thermal imaging camera is in an anti-burn mechanism on state, acquiring a second image currently captured by the thermal imaging camera, and determining a maximum grayscale value of the second image; Judging whether the shutter of the thermal imaging camera is in an abnormal state according to the gray value analysis result includes: When the highest grayscale value meets a preset condition, it is determined that the shutter of the thermal imaging camera is in an abnormally open state.

7. The method according to claim 6, characterized in that When the highest grayscale value meets a preset condition, determining that the shutter of the thermal imaging camera is in an abnormally open state includes: Obtaining the current cavity temperature of the thermal imaging core of the thermal imaging camera; Determining a target average grayscale value corresponding to the current cavity temperature according to the current cavity temperature and a preset correspondence table between cavity temperature and average grayscale value; When the difference between the highest grayscale value and the target average grayscale value is greater than a preset grayscale threshold, it is determined that the shutter of the thermal imaging camera is in an abnormally open state.

8. A shutter abnormality detection device, characterized in that: include: An anti-burn mechanism switch state determination module is used to determine the anti-burn mechanism switch state of the thermal imaging camera in real time; wherein the anti-burn mechanism switch state includes an anti-burn mechanism turned on state and an anti-burn mechanism turned off state; A grayscale value analysis result determination module, used to obtain the image captured by the thermal imaging camera according to the switch state of the anti-burn mechanism, and perform grayscale value analysis on the captured image to determine the grayscale value analysis result; The abnormal state judgment module is used to judge whether the shutter of the thermal imaging camera is in an abnormal state according to the gray value analysis result.

9. A thermal imaging camera, characterized in that: The thermal imaging camera comprises: at least one processor; and a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the shutter abnormality detection method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the shutter abnormality detection method according to any one of claims 1 to 7 when executed.

Images