A black body detection method, device and equipment

Abstract

The present application provides a blackbody detection method, apparatus and device. The method includes: determining a sub-image corresponding to a configured blackbody detection area in a thermal imaging image; determining a target area in the sub-image where the thermal imaging information matches the corresponding attribute information of the blackbody; and determining a blackbody detection result based on the feature information of the target area. Through the technical solution of the present application, the accuracy of thermal imaging temperature measurement can be ensured.

Description

Technical Field

[0001] The present application relates to the technical field of image processing, and particularly to a method, device, and equipment for detecting a blackbody. Background Art

[0002] A thermal imaging device (such as a camera for implementing thermal imaging functions) can collect thermal imaging images. Based on the gray values of target objects (such as target humans) in the thermal imaging images, the temperature values of the target objects can be determined, that is, the temperature values of the target objects are obtained, thereby realizing the temperature detection of the target objects. Among them, the thermal imaging device can use thermal imaging technology to collect thermal imaging images. Thermal imaging technology detects infrared energy (heat) in a non-contact manner and converts it into an electrical signal, and then generates a thermal imaging image. The thermal imaging image is an image related to the temperature value of the object surface, and the temperature value of the object surface can be determined based on the thermal imaging image.

[0003] In order to accurately measure the temperature values of target objects passing through the thermal imaging channel (i.e., the field of view of the thermal imaging device), a blackbody is usually placed in the thermal imaging channel. The blackbody is an idealized radiator that can absorb all wavelengths of radiation energy without energy reflection and transmission. That is to say, the blackbody only emits infrared electromagnetic waves but does not reflect the electromagnetic waves of the external environment, making its radiation situation only related to the temperature value, effectively avoiding interference from the external environment and the influence of its own materials. On this basis, the blackbody, as a calibration device, is a standard temperature source. The temperature value of the blackbody (i.e., the reference temperature value) can be set. After the thermal imaging device determines the temperature value of the target object based on the thermal imaging image, the temperature value of the target object is calibrated with the reference temperature value of the blackbody as the standard, thereby improving the accuracy of the temperature value of the target object, making the measurement of the temperature value more accurate, greatly improving the temperature measurement accuracy of the target object, and reducing the temperature measurement error to ±0.3 degrees.

[0004] However, after the blackbody is placed in the thermal imaging channel, during the actual use of the blackbody, the blackbody may be manually moved. When the blackbody is manually moved, the thermal imaging device cannot know that the blackbody has been manually moved and still calibrates the temperature value of the target object with the reference temperature value of the blackbody (i.e., the temperature value at the original position of the blackbody (the position before the blackbody is moved)), and the calibrated temperature value may be a temperature value with a large error, resulting in inaccurate measurement results of the temperature value. Summary of the Invention

[0005] The present application provides a method for detecting a blackbody, and the method includes:

[0006] Determine a sub-image corresponding to a configured blackbody detection area in the thermal imaging image;

[0007] Determine a target area in the sub-image where the thermal imaging information matches the corresponding attribute information of the blackbody;

[0008] Determine the blackbody detection result based on the feature information of the target area.

[0009] In a possible implementation, the determining the target area in the sub-image where the thermal imaging information matches the corresponding attribute information of the blackbody includes:

[0010] Based on the thermal imaging information of each pixel point in the sub-image, select target pixel points that match the corresponding attribute information of the blackbody from all pixel points in the sub-image;

[0011] Determine the target area based on all the target pixel points in the sub-image.

[0012] Exemplarily, the selecting target pixel points that match the corresponding attribute information of the blackbody from all pixel points in the sub-image based on the thermal imaging information of each pixel point in the sub-image includes:

[0013] If the thermal imaging information is the gray value of the pixel point and the corresponding attribute information of the blackbody is the target gray value corresponding to the configured target blackbody temperature, for each pixel point in the sub-image, if the gray value of this pixel point is not less than the target gray value, then determine that this pixel point is a target pixel point; or,

[0014] If the thermal imaging information is the gray value of the pixel point and the corresponding attribute information of the blackbody is the target gray value, for each pixel point in the sub-image, if the absolute value of the difference between the gray value of this pixel point and the target gray value is less than the first threshold, then determine that this pixel point is a target pixel point; or,

[0015] If the thermal imaging information is the temperature value of the pixel point and the corresponding attribute information of the blackbody is the target blackbody temperature, for each pixel point in the sub-image, if the absolute value of the difference between the temperature value of this pixel point and the target blackbody temperature is less than the second threshold, then determine that this pixel point is a target pixel point; or,

[0016] If the thermal imaging information is the pseudo-color value of the pixel point and the corresponding attribute information of the blackbody is the target pseudo-color value corresponding to the target blackbody temperature, for each pixel point in the sub-image, if the absolute value of the difference between the pseudo-color value of this pixel point and the target pseudo-color value is less than the third threshold, then determine that this pixel point is a target pixel point.

[0017] Exemplarily, the for each pixel point in the sub-image, if the gray value of this pixel point is not less than the target gray value, then determine that this pixel point is a target pixel point includes:

[0018] Perform binarization processing on the sub-image based on the target gray value to obtain a binarized image; wherein, for each pixel point in the sub-image, if the gray value of the pixel point is not less than the target gray value, the gray value of the pixel point in the binarized image is the first value, and if the gray value of the pixel point is less than the target gray value, the gray value of the pixel point in the binarized image is the second value;

[0019] Determine all pixel points with the first value in the binarized image as target pixel points.

[0020] Exemplarily, the determining the target area based on all target pixel points in the sub-image includes: obtaining the connected components composed of all target pixel points; if the number of connected components is one, determining the connected component as the target area; if the number of connected components is at least two, selecting the connected component with the largest area from all connected components as the target area.

[0021] Exemplarily, the characteristic information of the target area includes at least one of the following: the number of pixel points in the target area, the shape of the target area, and the ratio of the area of the target area to the area of the sub-image; the determining the black body detection result based on the characteristic information of the target area includes:

[0022] If the characteristic information includes the number of pixel points in the target area, when the number of pixel points is less than the preset number threshold, determine that the black body detection result is that there is no black body in the black body detection area;

[0023] Or, if the characteristic information includes the shape of the target area, when the shape is not the specified shape, determine that the black body detection result is that there is no black body in the black body detection area;

[0024] Or, if the characteristic information includes the ratio of the area of the target area to the area of the sub-image, when the ratio of the area of the target area to the area of the sub-image is less than the preset ratio threshold, determine that the black body detection result is that there is no black body in the black body detection area.

[0025] In a possible implementation manner, the determining the black body detection result based on the characteristic information of the target area includes: if the characteristic information includes the number of pixel points in the target area and the shape of the target area, when the number of pixel points is not less than the preset number threshold and the shape is the specified shape, determine that the black body detection result is that there is a black body in the black body detection area;

[0026] Wherein, the specified shape is determined based on the actual shape of the black body.

[0027] In a possible implementation, the method further includes:

[0028] If the blackbody detection result is that there is no blackbody in the blackbody detection area, when displaying the thermal imaging image, an alarm message indicating the absence of a blackbody is superimposed and displayed on the thermal imaging image.

[0029] In a possible implementation, the method further includes:

[0030] Obtain the position information corresponding to the blackbody detection area; wherein, if the blackbody detection area is a rectangular area, the position information is the 4 vertex coordinates of the rectangular area, or the position information is 1 vertex coordinate of the rectangular area, and the width and height; wherein, the position information corresponding to the blackbody detection area is determined based on the actual position of the blackbody;

[0031] Based on the position information corresponding to the blackbody detection area, determine the image coordinate information corresponding to the blackbody detection area in the thermal imaging image, and the image coordinate information includes 4 vertex coordinates; wherein, the image coordinate information is used to determine the sub-image corresponding to the blackbody detection area in the thermal imaging image.

[0032] In a possible implementation, the method further includes:

[0033] When the actual position of the blackbody changes, obtain the changed position information corresponding to the blackbody detection area, and the changed position information is determined based on the changed actual position of the blackbody;

[0034] Based on the changed position information corresponding to the blackbody detection area, determine the changed image coordinate information corresponding to the blackbody detection area in the thermal imaging image.

[0035] The present application provides a blackbody detection device, and the device includes:

[0036] An acquisition module, configured to determine a sub-image corresponding to a configured blackbody detection area in a thermal imaging image;

[0037] A determination module, configured to determine a target area in which the thermal imaging information in the sub-image matches the blackbody corresponding attribute information, and determine the blackbody detection result based on the feature information of the target area.

[0038] The present application provides a blackbody detection device, including: a processor and a machine-readable storage medium, the machine-readable storage medium stores machine-executable instructions that can be executed by the processor; the processor is configured to execute the machine-executable instructions to implement the above-mentioned blackbody detection method.

[0039] The present application provides a machine-readable storage medium storing machine-executable instructions executable by a processor. Wherein, the processor is configured to execute the machine-executable instructions to implement the above-mentioned blackbody detection method.

[0040] As can be seen from the above technical solutions, in the embodiments of the present application, after placing a blackbody in the thermal imaging channel, a blackbody detection area corresponding to the actual position of the blackbody can be configured. In this way, a sub-image corresponding to the blackbody detection area can be determined from the thermal imaging image, and a blackbody detection result can be determined based on the sub-image, that is, there is a blackbody in the blackbody detection area or there is no blackbody in the blackbody detection area. Based on the above method, during the actual use of the blackbody, if the blackbody is manually moved, it can be determined that there is no blackbody in the blackbody detection area, thereby giving an abnormal alarm and prompting the management personnel to place the blackbody back into the thermal imaging channel. In this way, when calibrating the temperature value of the target object based on the reference temperature value of the blackbody, the calibrated temperature value is a temperature value with a small error, that is, the measurement result of the temperature value is accurate, improving the temperature measurement accuracy, and ensuring the stability and reliability of the blackbody in the thermal imaging temperature measurement process, and ensuring the temperature measurement accuracy. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings required for the description of the embodiments of the present application or the prior art. Obviously, the drawings in the following description are only some embodiments recorded in the present application. For those of ordinary skill in the art, other drawings can also be obtained based on these drawings of the embodiments of the present application.

[0042] Figure 1 is a flowchart of the blackbody detection method in an embodiment of the present application;

[0043] Figure 2 is a schematic structural diagram of a system in an embodiment of the present application;

[0044] Figure 3 is a schematic diagram of a blackbody detection area in an embodiment of the present application;

[0045] Figure 4 is a schematic diagram of the blackbody detection process in an embodiment of the present application;

[0046] Figure 5A is a schematic diagram showing that there is no blackbody in the blackbody detection area in an embodiment of the present application;

[0047] Figure 5B is a schematic diagram showing that the blackbody is blocked by an object in an embodiment of the present application;

[0048] Figure 6It is a schematic structural diagram of a blackbody detection device in an embodiment of the present application;

[0049] Figure 7 It is a hardware structure diagram of a thermal imaging device in an embodiment of the present application. Specific embodiments

[0050] The terms used in the embodiments of the present application are only for the purpose of describing specific embodiments and do not limit the present application. The singular forms "a", "the", and "said" used in the present application and the claims are also intended to include the plural forms unless the context clearly indicates otherwise. It should also be understood that the term "and / or" used herein refers to any or all possible combinations of one or more of the associated listed items.

[0051] It should be understood that although the terms first, second, third, etc. may be used in the embodiments of the present application to describe various information, such information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of the present application, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, in addition, the word "if" used may be interpreted as "when" or "while" or "in response to determining".

[0052] Before introducing the technical solutions of the embodiments of the present application, the technical terms related to the present application are introduced first:

[0053] Black body: A black body is an idealized radiator that can absorb all wavelengths of radiant energy (i.e., absorb all electromagnetic radiation), without energy reflection and transmission. That is to say, a black body only emits infrared electromagnetic waves but does not reflect the electromagnetic waves of the external environment. The absorption coefficient of a black body for electromagnetic waves of any wavelength is 1, and the transmission coefficient is 0. The radiation situation of a black body is only related to the temperature value, thus effectively avoiding the interference of the external environment and the influence of its own materials. In the field of thermal imaging temperature measurement, a black body is a heat source with a regular shape whose temperature can be adjusted, serving as a temperature reference during temperature measurement for temperature value calibration.

[0054] Thermal imaging technology: Thermal imaging technology is to detect infrared energy (heat) non - contactly, convert the infrared energy into an electrical signal, and then generate a thermal imaging image based on the electrical signal. The thermal imaging image is an image related to the temperature value of the object surface, and the temperature value of the object surface can be determined based on the thermal imaging image.

[0055] Thermal imaging device: A thermal imaging device is a device used to implement thermal imaging functions, such as a camera, etc. The thermal imaging device can collect thermal imaging images and determine the temperature value of the target object (such as a target human body) based on the gray value of the target object in the thermal imaging image, thereby realizing the temperature detection of the target object.

[0056] Binarization: Image binarization is to set the gray value of the pixel points on the image to 0 or 255, that is, to present the image with an obvious black-and-white effect. For example, the value range of a grayscale image is 0 - 255 (i.e., 256 brightness levels). An appropriate binarization threshold can be set. If the gray value of a pixel point in the grayscale image is not less than the binarization threshold, the gray value of this pixel point is set to 255. If the gray value of a pixel point in the grayscale image is less than the binarization threshold, the gray value of this pixel point is set to 0. In this way, a binarized image can be obtained, and the gray value of the pixel points in this binarized image can be 0 or 255.

[0057] Connected component: The area composed of pixel points with the same gray value and adjacent positions in the image is called a connected component. Connected component analysis refers to finding and marking each connected component in the image. That is to say, based on the connected component analysis method, each connected component in the image can be known, and no restrictions are imposed on this connected component analysis method.

[0058] Thermal imaging channel: After deploying a thermal imaging device in the target scene (i.e., any scene where temperature detection is required), the thermal imaging device can collect thermal imaging images of the target object (such as a target human body, that is, any human body passing through the thermal imaging channel) passing through the thermal imaging channel. The thermal imaging device determines the temperature value of the target object based on the thermal imaging image. In this article, the channel through which the target object passes is called the thermal imaging channel.

[0059] Obviously, the thermal imaging channel needs to be within the field of view of the thermal imaging device. When the thermal imaging device collects thermal imaging images within the field of view, it is the thermal imaging image of the thermal imaging channel. That is to say, when the target object passes through the thermal imaging channel, the thermal imaging image collected by the thermal imaging device will include the target object.

[0060] Thermal imaging temperature measurement: In order to accurately measure the temperature value of the target object passing through the thermal imaging channel, a blackbody is usually placed in the thermal imaging channel. As a calibration device, the blackbody is a standard temperature source, and the temperature value of the blackbody (i.e., the reference temperature value) can be set according to experience. After the thermal imaging device determines the temperature value of the target object based on the thermal imaging image, the temperature value of the target object is calibrated with the reference temperature value of the blackbody, so as to improve the accuracy of the temperature value of the target object, make the measurement of the temperature value more accurate, greatly improve the temperature measurement accuracy of the target object, and be able to reduce the temperature measurement error to ±0.3 degrees.

[0061] Exemplarily, the working range of the reference temperature value of the blackbody may be related to the product type of the blackbody. The working ranges of different products may be the same or different. For example, the working range of the reference temperature value is 5 degrees to 50 degrees, and there is no limitation on this. Based on this, any temperature value within this working range can be used as the reference temperature value, and this reference temperature value can be set according to experience. For example, the reference temperature value can be 40 degrees.

[0062] For the convenience of description, in this embodiment, the reference temperature value of the blackbody is referred to as the target blackbody temperature. That is, the target blackbody temperature is a configurable temperature value, such as any temperature value within the working range, such as 40 degrees, etc. Obviously, after setting the target blackbody temperature of the blackbody to 40 degrees, the blackbody in the thermal imaging channel is a standard temperature source of 40 degrees, that is, the temperature value of this blackbody is 40 degrees. After the thermal imaging device determines the temperature value of the target object based on the thermal imaging image, since the temperature value of the blackbody in the thermal imaging image is 40 degrees, therefore, the temperature value of the target object can be calibrated based on the target blackbody temperature of the blackbody (i.e., 40 degrees), and there is no limitation on this calibration process, thereby improving the accuracy of the temperature value of the target object.

[0063] In summary, it can be seen that during the thermal imaging temperature measurement process, a blackbody needs to be placed in the thermal imaging channel. However, in the actual use of the blackbody, if the blackbody is manually moved, then the temperature value obtained by calibration will be a temperature value with a large error, that is, the measurement result of the temperature value is inaccurate.

[0064] In view of the above findings, in the embodiments of the present application, a blackbody detection method is proposed. During the actual use of the blackbody, if the blackbody is manually moved, it can be determined that there is no blackbody in the blackbody detection area, thereby giving an abnormal alarm and prompting the management personnel to place the blackbody back into the thermal imaging channel. In this way, when calibrating the temperature value of the target object based on the target blackbody temperature of the blackbody, the temperature value obtained by calibration is a temperature value with a small error, that is, the measurement result of the temperature value is accurate, improving the temperature measurement accuracy.

[0065] The technical solutions of the embodiments of the present application will be described below in conjunction with specific embodiments.

[0066] A blackbody detection method is proposed in the embodiments of the present application. Refer to Figure 1 As shown, the method may include:

[0067] Step 101, determine the sub-image corresponding to the configured blackbody detection area in the thermal imaging image.

[0068] In a possible implementation, a thermal imaging image within the field of view of a thermal imaging device can be obtained, and a sub-image corresponding to the blackbody detection region can be determined from the thermal imaging image. For example, the field of view of the thermal imaging device may include a configured blackbody detection region. Therefore, for the thermal imaging image within the field of view of the thermal imaging device, the thermal imaging image includes a sub-image corresponding to the blackbody detection region.

[0069] Exemplarily, after deploying the thermal imaging device in the target scenario, the thermal imaging device can collect a thermal imaging image within the field of view of the thermal imaging device. Since the thermal imaging channel is within the field of view of the thermal imaging device, the thermal imaging image collected by the thermal imaging device is a thermal imaging image of the thermal imaging channel. When the target object passes through the thermal imaging channel, the thermal imaging image collected by the thermal imaging device may include the target object (such as the target human body). After obtaining the thermal imaging image, the sub-image corresponding to the blackbody detection region in the thermal imaging image can be determined.

[0070] In a possible implementation, before step 101, it is necessary to obtain a blackbody detection region, which is within the field of view of the thermal imaging device. That is to say, the thermal imaging image within the field of view includes the blackbody detection region, that is, a sub-image corresponding to the blackbody detection region can be determined from the thermal imaging image. For example, the following method can be used to obtain the blackbody detection region:

[0071] Obtain the position information corresponding to the blackbody detection region. For example, the user configures the position information corresponding to the blackbody detection region, and the position information corresponding to the blackbody detection region is determined based on the actual position of the blackbody, that is, the position information corresponding to the blackbody detection region can be configured based on the actual position of the blackbody placed in the thermal imaging channel.

[0072] The blackbody detection region can be a rectangular region or other shapes, and the shape of the blackbody detection region is not limited. Hereinafter, a rectangular region is taken as an example. When the blackbody detection region is a rectangular region, the position information corresponding to the blackbody detection region can be the 4 vertex coordinates of the rectangular region. Or, the position information corresponding to the blackbody detection region can be the 3 vertex coordinates of the rectangular region (the 4th vertex coordinate can be deduced using 3 vertex coordinates, that is, the 4 vertex coordinates of the rectangular region can be known). Or, the position information corresponding to the blackbody detection region can be 1 vertex coordinate of the rectangular region and the width and height of the rectangular region (the 4 vertex coordinates of the rectangular region can be deduced using 1 vertex coordinate, width and height).

[0073] After obtaining the position information corresponding to the blackbody detection area, the image coordinate information corresponding to the blackbody detection area in the thermal imaging image can be determined based on the position information corresponding to the blackbody detection area, and the image coordinate information can include the four vertex coordinates. For example, based on the position information corresponding to the blackbody detection area, the four vertex coordinates of the blackbody detection area (i.e., the rectangular area) can be obtained, and these four vertex coordinates are the image coordinate information corresponding to the blackbody detection area in the thermal imaging image.

[0074] Exemplarily, after obtaining the image coordinate information, the image coordinate information can also be stored, and the image coordinate information is used to determine the sub-image corresponding to the blackbody detection area in the thermal imaging image. On this basis, for step 101, after obtaining each frame of thermal imaging image, the sub-image corresponding to the image coordinate information (i.e., the four vertex coordinates) can be determined from the thermal imaging image, and this sub-image is the sub-image corresponding to the blackbody detection area in the thermal imaging image, and subsequent steps are performed based on this sub-image.

[0075] In a possible implementation manner, when the actual position of the blackbody changes, the user can configure the changed position information corresponding to the blackbody detection area, and the changed position information is determined based on the changed actual position of the blackbody. On this basis, the changed position information corresponding to the blackbody detection area can be obtained, and the changed position information can be the four vertex coordinates of the rectangular area, or, the three vertex coordinates of the rectangular area, or, one vertex coordinate of the rectangular area, and the width and height of the rectangular area.

[0076] After obtaining the changed position information corresponding to the blackbody detection area, the changed image coordinate information corresponding to the blackbody detection area in the thermal imaging image can be determined based on the changed position information corresponding to the blackbody detection area, and the image coordinate information can include the four vertex coordinates.

[0077] Further, after obtaining the changed image coordinate information, the changed image coordinate information (i.e., replacing the image coordinate information before the change) can be stored. On this basis, after obtaining each frame of thermal imaging image, for step 101, the sub-image corresponding to the changed image coordinate information can be determined from the thermal imaging image, and this sub-image is used as the sub-image corresponding to the blackbody detection area.

[0078] Step 102: Determine the target area in the sub-image where the thermal imaging information matches the corresponding attribute information of the blackbody.

[0079] For example, based on the corresponding attribute information of the blackbody and the thermal imaging information of each pixel point in the sub-image, the target area that matches the corresponding attribute information of the blackbody can be determined from all the pixel points of the sub-image.

[0080] In a possible implementation, the following steps can be used to determine the target area:

[0081] Step 1021: Based on the thermal imaging information of each pixel point in the sub-image, select target pixel points from all the pixel points in the sub-image that match the corresponding attribute information of the black body. That is to say, the thermal imaging information of the target pixel points matches the corresponding attribute information of the black body, and for other pixel points except the target pixel points, the thermal imaging information of the other pixel points does not match the corresponding attribute information of the black body.

[0082] Exemplarily, for each pixel point in the sub-image, if the thermal imaging information of the pixel point matches the corresponding attribute information of the black body, then the pixel point is taken as the target pixel point; if the thermal imaging information of the pixel point does not match the corresponding attribute information of the black body, then the pixel point is prohibited from being taken as the target pixel point.

[0083] Among them, for each pixel point in the sub-image, if it is known from the thermal imaging information of the pixel point that the pixel point may be a pixel point corresponding to the black body, it means that the thermal imaging information of the pixel point matches the corresponding attribute information of the black body; if it is known from the thermal imaging information of the pixel point that the pixel point cannot be a pixel point corresponding to the black body, it means that the thermal imaging information of the pixel point does not match the corresponding attribute information of the black body.

[0084] In a possible implementation, the following method can be used to determine the target pixel points in the sub-image. Of course, the following method is only a few examples, and the determination method of the target pixel points is not limited.

[0085] Method 1: The thermal imaging information of the pixel points in the sub-image is the gray value of the pixel points, and the corresponding attribute information of the black body is the target gray value corresponding to the configured target black body temperature. For each pixel point in the sub-image, if the gray value of the pixel point is not less than the target gray value, it is determined that the pixel point is the target pixel point; if the gray value of the pixel point is less than the target gray value, it is determined that the pixel point is not the target pixel point.

[0086] Exemplarily, the target black body temperature can be a pre-configured temperature value, that is, the reference temperature value in the above embodiment. For the definition of the target black body temperature, refer to the above embodiment and will not be repeated here. For example, the target black body temperature can be any temperature value within the working range of the black body, such as 40 degrees, etc.

[0087] Exemplarily, the functional relationship between the black body temperature and the gray value can be stored in advance. This functional relationship is related to the product type of the thermal imaging device. The functional relationships of different types of thermal imaging devices can be the same or different. This functional relationship can be configured according to experience or obtained by using a certain algorithm. There is no limitation on this functional relationship as long as the functional relationship can be obtained and stored.

[0088] This functional relationship is used to represent the relationship between the blackbody temperature and the grayscale value. That is to say, for a certain grayscale value, by querying this functional relationship, the blackbody temperature corresponding to this grayscale value can be obtained. For a certain blackbody temperature, by querying this functional relationship, the grayscale value corresponding to this blackbody temperature can be obtained.

[0089] Exemplarily, based on the pre-stored functional relationship between the blackbody temperature and the grayscale value, the target grayscale value corresponding to the target blackbody temperature can be determined based on the functional relationship between the blackbody temperature and the grayscale value. For example, by querying this functional relationship based on the target blackbody temperature, the grayscale value corresponding to the target blackbody temperature is obtained. For the convenience of distinction, the grayscale value corresponding to the target blackbody temperature is denoted as the target grayscale value.

[0090] In Method 1, based on this target grayscale value, for each pixel point in the sub-image, if the grayscale value of this pixel point is not less than this target grayscale value, then this pixel point is the target pixel point. If the grayscale value of this pixel point is less than this target grayscale value, then this pixel point is not the target pixel point.

[0091] Exemplarily, for Method 1, the sub-image can also be binarized based on this target grayscale value (i.e., the target grayscale value is used as the binarization threshold) to obtain a binary image. When binarizing the sub-image, for each pixel point in the sub-image, if the grayscale value of this pixel point is not less than the target grayscale value, then the grayscale value of this pixel point in the binary image is the first value (such as 255). If the grayscale value of this pixel point is less than the target grayscale value, then the grayscale value of this pixel point in the binary image is the second value (such as 0). In summary, the grayscale value of the pixel points in the binary image is the first value or the second value. On this basis, all pixel points in the binary image with the grayscale value being the first value can be determined as the target pixel points, while all pixel points in the binary image with the grayscale value being the second value are not the target pixel points.

[0092] Method 2: The thermal imaging information of the pixel points in the sub-image is the grayscale value of the pixel points, and the blackbody corresponding attribute information is the target grayscale value corresponding to the configured target blackbody temperature. On this basis, for each pixel point in the sub-image, if the absolute value of the difference between the grayscale value of this pixel point and this target grayscale value is less than the first threshold, then it is determined that this pixel point is the target pixel point; if the absolute value of the difference between the grayscale value of this pixel point and this target grayscale value is not less than the first threshold, then it is determined that this pixel point is not the target pixel point.

[0093] Exemplarily, the target blackbody temperature and the target gray value are referred to in Method 1, which will not be elaborated here. In Method 2, based on the target gray value, for each pixel point in the sub-image, the absolute value of the difference between the gray value of the pixel point and the target gray value can be calculated. If the absolute value is less than the first threshold (which can be configured according to experience, such as 1, 2, 3, etc., and there is no limitation on this), then the pixel point is the target pixel point; if the absolute value is not less than the first threshold, then the pixel point is not the target pixel point.

[0094] Obviously, if the absolute value is less than the first threshold, it means that the gray value of the pixel point is relatively close to the target gray value. That is to say, the pixel point may be the pixel point corresponding to the blackbody.

[0095] Method 3: The thermal imaging information of the pixel points in the sub-image is the temperature value of the pixel points, and the blackbody corresponding attribute information is the configured target blackbody temperature. On this basis, for each pixel point in the sub-image, if the absolute value of the difference between the temperature value of the pixel point and the target blackbody temperature is less than the second threshold, then it can be determined that the pixel point is the target pixel point; if the absolute value of the difference between the temperature value of the pixel point and the target blackbody temperature is not less than the second threshold, then it can be determined that the pixel point is not the target pixel point.

[0096] Exemplarily, the target blackbody temperature is referred to in Method 1, which will not be elaborated here. In Method 1, it has been introduced that "the functional relationship between the blackbody temperature and the gray value is pre-stored". On this basis, based on this functional relationship, for each pixel point in the sub-image, the temperature value of the pixel point can be queried based on the gray value of the pixel point, so as to obtain the temperature value of each pixel point in the sub-image.

[0097] In Method 3, based on the target blackbody temperature, for each pixel point in the sub-image, the absolute value of the difference between the temperature value of the pixel point and the target blackbody temperature can be calculated. If the absolute value is less than the second threshold (which can be configured according to experience, such as 1, 2, 3, etc., and there is no limitation on this), then the pixel point is the target pixel point; if the absolute value is not less than the second threshold, then the pixel point is not the target pixel point. Obviously, if the absolute value is less than the second threshold, it means that the temperature value of the pixel point is relatively close to the target blackbody temperature. That is to say, the pixel point may be the pixel point corresponding to the blackbody.

[0098] Method 4: The thermal imaging information of the pixel points in the sub-image is the pseudo-color value of the pixel points, and the corresponding attribute information of the black body is the target pseudo-color value corresponding to the configured target black body temperature (that is, the target pseudo-color value corresponding to the target gray value corresponding to the target black body temperature). On this basis, for each pixel point in the sub-image, if the absolute value of the difference between the pseudo-color value of the pixel point and the target pseudo-color value is less than the third threshold, it can be determined that the pixel point is the target pixel point; if the absolute value of the difference between the pseudo-color value of the pixel point and the target pseudo-color value is not less than the third threshold, it can be determined that the pixel point is not the target pixel point.

[0099] Exemplarily, for the target black body temperature and the target gray value, refer to Method 1, which will not be elaborated here. In Method 4, the mapping relationship between the pseudo-color value and the gray value can be pre-stored. This mapping relationship is related to the product type of the thermal imaging device. This mapping relationship can be configured according to experience or obtained by using a certain algorithm. There is no limitation on this mapping relationship as long as the mapping relationship can be obtained and stored. Based on this mapping relationship, the target pseudo-color value corresponding to the target gray value can be obtained by querying this mapping relationship with the target gray value. For each pixel point in the sub-image, the pseudo-color value of this pixel point can be obtained by querying this mapping relationship based on the gray value of this pixel point, so as to obtain the pseudo-color value of each pixel point in the sub-image.

[0100] In Method 4, based on the target pseudo-color value, for each pixel point in the sub-image, the absolute value of the difference between the pseudo-color value of this pixel point and the target pseudo-color value can be calculated. If this absolute value is less than the third threshold (which can be configured according to experience, such as 1, 2, 3, etc., and there is no limitation on this), then this pixel point is the target pixel point. If this absolute value is not less than the third threshold, then this pixel point is not the target pixel point. Obviously, if this absolute value is less than the third threshold, it means that the pseudo-color value of this pixel point is relatively close to the target pseudo-color value, that is to say, this pixel point may be the pixel point corresponding to the black body.

[0101] In summary, based on Methods 1-4, the target pixel points can be determined from the sub-image.

[0102] Step 1022: Determine the target area based on all the target pixel points in the sub-image.

[0103] For example, obtain the connected components composed of all target pixel points in the sub-image. For example, using the connected component analysis method, the area composed of adjacent target pixel points in the sub-image is used as the connected component, and this process is not restricted. If the number of connected components is one, then this connected component can be determined as the target area. Or, if the number of connected components is at least two, select the connected component with the largest area from all connected components (i.e., at least two connected components) as the target area; of course, in practical applications, other connected components can also be determined as the target area, such as the connected component with the second largest area as the target area, and this is not restricted.

[0104] So far, step 102 is completed, that is, the target area is determined from the sub-image.

[0105] Step 103: Determine the blackbody detection result based on the feature information of the target area; where the blackbody detection result is that there is a blackbody in the blackbody detection area, or there is no blackbody in the blackbody detection area.

[0106] Exemplarily, based on the actual physical characteristics of the blackbody placed in the thermal imaging channel (such as the actual size of the blackbody, the actual shape of the blackbody, etc.), it can be determined whether the feature information of the target area matches the actual physical characteristics. If it matches, it is determined that the blackbody detection result is that there is a blackbody in the blackbody detection area; if it does not match, it is determined that the blackbody detection result is that there is no blackbody in the blackbody detection area. For example, if the actual physical characteristic is the actual size of the blackbody, and the feature information of the target area matches the actual size of the blackbody, it is determined that the blackbody detection result is that there is a blackbody in the blackbody detection area; if the feature information of the target area does not match the actual size of the blackbody, it is determined that the blackbody detection result is that there is no blackbody in the blackbody detection area. Another example, if the actual physical characteristic is the actual shape of the blackbody, and the feature information of the target area matches the actual shape of the blackbody, it is determined that the blackbody detection result is that there is a blackbody in the blackbody detection area; if the feature information of the target area does not match the actual shape of the blackbody, it is determined that the blackbody detection result is that there is no blackbody in the blackbody detection area.

[0107] In a possible implementation, the feature information of the target area may include but is not limited to at least one of the following: the number of pixel points in the target area, the shape of the target area, and the ratio of the area of the target area to the area of the sub-image. Of course, the above are only several examples of the feature information, and this is not restricted.

[0108] Based on the above feature information, the blackbody detection result can be determined as follows:

[0109] Case 1: The feature information of the target area includes the number of pixel points in the target area. On this basis, when the number of pixel points is less than a preset number threshold (which can be configured according to experience and is related to the actual size of the black body, such as 400, etc.), it is determined that there is no black body in the black body detection area. When the number of pixel points is not less than the preset number threshold, it is determined that there is a black body in the black body detection area.

[0110] Case 2: The feature information of the target area includes the shape of the target area. On this basis, when the shape is not the specified shape, it is determined that there is no black body in the black body detection area. When the shape is the specified shape, it is determined that there is a black body in the black body detection area.

[0111] Exemplarily, the specified shape is determined based on the actual shape of the black body placed in the thermal imaging channel. For example, if the black body placed in the thermal imaging channel is square, the specified shape can be rectangular. If the black body placed in the thermal imaging channel is circular, the specified shape can be circular. There is no restriction on this specified shape.

[0112] Case 3: The feature information of the target area includes the ratio of the area of the target area to the area of the sub-image. On this basis, when the ratio of the area of the target area to the area of the sub-image is less than a preset ratio threshold (which can be configured according to experience and there is no restriction on this preset ratio threshold), it is determined that there is no black body in the black body detection area. When the ratio of the area of the target area to the area of the sub-image is not less than the preset ratio threshold, it is determined that there is a black body in the black body detection area.

[0113] Case 4: The feature information of the target area includes the number of pixel points in the target area and the shape of the target area. On this basis, when the number of pixel points in the target area is less than the preset number threshold, and / or, the shape of the target area is not the specified shape, it is determined that there is no black body in the black body detection area. When the number of pixel points in the target area is not less than the preset number threshold, and the shape of the target area is the specified shape, it is determined that there is a black body in the black body detection area.

[0114] Case 5: The characteristic information of the target area includes the number of pixel points in the target area, the shape of the target area, and the ratio of the area of the target area to the area of the sub-image. On this basis, when the number of pixel points in the target area is less than the preset number threshold, and / or the shape of the target area is not the specified shape, and / or the ratio of the area of the target area to the area of the sub-image is less than the preset ratio threshold, it is determined that there is no black body in the black body detection area for the black body detection result. When the number of pixel points in the target area is not less than the preset number threshold, the shape of the target area is the specified shape, and the ratio of the area of the target area to the area of the sub-image is not less than the preset ratio threshold, it is determined that there is a black body in the black body detection area for the black body detection result.

[0115] Of course, the above several cases are only examples, and there is no limitation on the determination method of this black body detection result.

[0116] In a possible implementation manner, after determining the black body detection result (the black body detection result is that there is a black body in the black body detection area, or there is no black body in the black body detection area), if the black body detection result is that there is a black body in the black body detection area, then display the thermal imaging image. If the black body detection result is that there is no black body in the black body detection area, then display the thermal imaging image. When displaying the thermal imaging image, an alarm information indicating the absence of a black body can also be superimposed and displayed on the thermal imaging image.

[0117] As can be seen from the above technical solutions, in the embodiments of the present application, after placing a black body in the thermal imaging channel, the black body detection area corresponding to the actual position of the black body can be configured. In this way, the sub-image corresponding to the black body detection area can be determined from the thermal imaging image, and the black body detection result can be determined based on the sub-image, that is, there is a black body in the black body detection area or there is no black body in the black body detection area. Based on the above method, during the actual use of the black body, if the black body is manually moved, it can be determined that there is no black body in the black body detection area, so as to perform an abnormal alarm and prompt the management personnel to place the black body back into the thermal imaging channel. In this way, when calibrating the temperature value of the target object based on the reference temperature value of the black body, the calibrated temperature value is a temperature value with a small error, that is, the measurement result of the temperature value is accurate, improving the temperature measurement accuracy, and ensuring the stability and reliability of the black body during the thermal imaging temperature measurement process and ensuring the temperature measurement accuracy.

[0118] The black body detection method of the embodiments of the present application will be described below in combination with specific application scenarios.

[0119] See Figure 2As shown in the figure, it is a schematic diagram of the system structure of an embodiment of the present application. The system structure may include a client 21 and a thermal imaging device 22. The client 21 may be an APP (application program) on a terminal device (such as a personal computer, a laptop, a smart phone, etc.), or may be a browser on the terminal device. The thermal imaging device 22 is a device for implementing the thermal imaging function, such as a camera, etc., and there is no limitation thereto.

[0120] In an embodiment of the present application, the blackbody detection method may be implemented by the thermal imaging device 22, that is, the thermal imaging device 22 collects a thermal imaging image and executes steps 101 - step 103 based on the thermal imaging image to implement the blackbody detection method. Alternatively, the blackbody detection method may also be implemented by the client 21, that is, the thermal imaging device 22 collects a thermal imaging image, sends the thermal imaging image to the client 21, and the client 21 executes steps 101 - step 103 based on the thermal imaging image to implement the blackbody detection method. Alternatively, the blackbody detection method may also be jointly implemented by the thermal imaging device 22 and the client 21. Hereinafter, an example of the cooperation between the two to implement the blackbody detection will be described.

[0121] The client 21 may obtain the position information corresponding to the blackbody detection area and send the position information corresponding to the blackbody detection area to the thermal imaging device 22. For example, the position information corresponding to the blackbody detection area may be sent to the thermal imaging device 22 through an HTTP (HyperText Transfer Protocol) message. The thermal imaging device 22 performs blackbody detection based on the position information corresponding to the blackbody detection area, obtains a blackbody detection result, and sends the thermal imaging image and the blackbody detection result to the client 21. For example, the thermal imaging image and the blackbody detection result are sent to the client 21 through an HTTP message. The client 21 displays the thermal imaging image, and when there is no blackbody in the blackbody detection area, an alarm message is superimposed and displayed on the thermal imaging image.

[0122] In summary, in the blackbody detection method, it may include a process of obtaining the position information corresponding to the blackbody detection area, a process of blackbody detection based on the position information corresponding to the blackbody detection area, and a process of displaying the thermal imaging image and the blackbody detection result. Hereinafter, the implementation manners of these three processes will be described.

[0123] First, the process of obtaining the position information corresponding to the blackbody detection area.

[0124] When the user uses the blackbody moving warning function, the blackbody can be fixed in the thermal imaging channel, and the thermal imaging device 22 can collect the thermal imaging images within the field of view. Since the thermal imaging channel is within this field of view, the thermal imaging images will include the blackbody in the thermal imaging channel. By viewing the thermal imaging images, the user can know the position of the blackbody in the thermal imaging images. In this way, the user can configure the blackbody detection area based on the position of the blackbody in the thermal imaging images. When configuring the blackbody detection area, it is necessary to ensure that the blackbody detection area is within the range of the thermal imaging images, and it is necessary to ensure that the blackbody is within the range of the blackbody detection area, that is, the blackbody detection area includes the blackbody, and the thermal imaging images include the blackbody detection area.

[0125] Refer to Figure 3 As shown, it is a schematic diagram of the blackbody detection area. The outermost layer is the thermal imaging image, the innermost layer is the blackbody, and the middle layer is the blackbody detection area. The blackbody detection area includes the blackbody, and the center point of the blackbody detection area coincides with the center point of the blackbody. The thermal imaging image includes the blackbody detection area, and the center point of the thermal imaging image coincides with the center point of the blackbody detection area. Of course, in practical applications, it is not limited to the way of the center points coinciding. As long as the blackbody detection area includes the blackbody and the thermal imaging image includes the blackbody detection area.

[0126] The client 21 can display to the user Figure 3 the thermal imaging image shown. The user can draw a rectangular box (i.e., a rectangular area) in the thermal imaging image, and this rectangular area is the blackbody detection area. When drawing the blackbody detection area, it is necessary to ensure that the blackbody detection area includes the blackbody and the thermal imaging image includes the blackbody detection area.

[0127] After the user draws the blackbody detection area, the client 21 can obtain the 4 vertex coordinates of the blackbody detection area, and these 4 vertex coordinates are the position information corresponding to the blackbody detection area. For example, taking the upper left corner of the thermal imaging image as the coordinate origin, with the horizontal rightward as the horizontal axis and the horizontal downward as the vertical axis to establish an image coordinate system, these 4 vertex coordinates are the 4 vertex coordinates in this image coordinate system. Of course, in practical applications, other ways can also be used to establish the image coordinate system, and there is no limit to this.

[0128] After the client 21 obtains the position information corresponding to the blackbody detection area, it can send the position information corresponding to the blackbody detection area to the thermal imaging device 22. The thermal imaging device 22 can obtain the position information corresponding to the blackbody detection area from the client 21, that is, the 4 vertex coordinates of the blackbody detection area.

[0129] After the thermal imaging device 22 obtains the position information corresponding to the blackbody detection area, it can determine the image coordinate information corresponding to the blackbody detection area in the thermal imaging image, and the image coordinate information includes the coordinates of 4 vertices. For example, assuming that the position information corresponding to the blackbody detection area is vertex coordinate a1, vertex coordinate a2, vertex coordinate a3, and vertex coordinate a4, then the image coordinate information corresponding to the blackbody detection area in the thermal imaging image is vertex coordinate a1, vertex coordinate a2, vertex coordinate a3, and vertex coordinate a4. After obtaining the image coordinate information, the thermal imaging device 22 can store the image coordinate information.

[0130] In a possible implementation manner, the user can replace the blackbody at any time (for example, the size and / or shape of the blackbody may change), and the user can also move the position of the blackbody at any time (that is, the position of the blackbody changes).

[0131] Obviously, when replacing the blackbody, since the blackbody detection area is usually larger than the size of the blackbody, if the position of the blackbody does not change, the user does not need to redraw the blackbody detection area. When the user moves the position of the blackbody (that is, the actual position of the blackbody placed in the thermal imaging channel changes), the user needs to redraw the blackbody detection area. For the specific method, refer to the above embodiments and will not be repeated here.

[0132] After the user redraws the blackbody detection area, the client 21 can obtain the coordinates of 4 vertices of the new blackbody detection area, and these 4 vertex coordinates are the position information corresponding to the new blackbody detection area. The client 21 sends the position information corresponding to the new blackbody detection area to the thermal imaging device 22. The thermal imaging device 22 obtains the position information corresponding to the new blackbody detection area and determines the new image coordinate information corresponding to the new blackbody detection area in the thermal imaging image. For example, if the position information corresponding to the new blackbody detection area is vertex coordinate b1, vertex coordinate b2, vertex coordinate b3, and vertex coordinate b4, then the new image coordinate information corresponding to the new blackbody detection area in the thermal imaging image is vertex coordinate b1, vertex coordinate b2, vertex coordinate b3, and vertex coordinate b4. After obtaining the new image coordinate information, the thermal imaging device 22 can store the new image coordinate information.

[0133] Second, the blackbody detection process based on the position information corresponding to the blackbody detection area.

[0134] See Figure 4 As shown in the figure, it is a schematic diagram of the blackbody detection process, and this process may include the following steps:

[0135] Step 401, the thermal imaging device 22 obtains a thermal imaging image within the field of view of the thermal imaging device 22.

[0136] Step 402: The thermal imaging device 22 determines a sub-image corresponding to the blackbody detection area from the thermal imaging image. For example, assuming that the image coordinate information corresponding to the blackbody detection area in the thermal imaging image is vertex coordinate a1, vertex coordinate a2, vertex coordinate a3, and vertex coordinate a4, the thermal imaging device 22 may use the rectangular area formed by vertex coordinate a1, vertex coordinate a2, vertex coordinate a3, and vertex coordinate a4 as the sub-image corresponding to the blackbody detection area in the thermal imaging image, which is subsequently denoted as sub-image x.

[0137] Step 403: The thermal imaging device 22 selects target pixel points that match the corresponding attribute information of the blackbody from all pixel points of sub-image x based on the thermal imaging information of each pixel point in sub-image x.

[0138] The implementation process of step 403 can refer to methods 1-4 of step 1021, and there is no limitation thereto. For example, taking method 1 as an example, the thermal imaging device 22 performs binarization processing on sub-image x based on the target gray value corresponding to the target blackbody temperature to obtain a binarized image. Exemplarily, for each pixel point in sub-image x, if the gray value of the pixel point is not less than the target gray value, the gray value of the pixel point in the binarized image is the first value (such as 255). If the gray value of the pixel point is less than the target gray value, the gray value of the pixel point in the binarized image is the second value (such as 0). In summary, the gray value of the pixel points in the binarized image can be the first value or the second value. Then, the thermal imaging device 22 may use all pixel points with the first value as the target pixel points in the binarized image.

[0139] Step 404: The thermal imaging device 22 determines a target area based on all the target pixel points in the sub-image.

[0140] For example, using a connected region detection algorithm, the area formed by all adjacent target pixel points is used as a connected domain. If the number of connected domains is one, the connected domain is determined as the target area. Or, if the number of connected domains is at least two, the connected domain with the largest area is selected from the at least two connected domains as the target area. Of course, other connected domains may also be determined as the target area, and there is no limitation thereto.

[0141] Step 405: The thermal imaging device 22 determines whether the shape of the target area is a specified shape.

[0142] If so, step 406 may be executed; if not, step 408 may be executed.

[0143] Exemplarily, the specified shape can be determined based on the shape of the black body placed in the thermal imaging channel. For example, if the black body placed in the thermal imaging channel is square, the specified shape can be rectangular; if the black body placed in the thermal imaging channel is circular, the specified shape can be circular. There is no limit to the specified shape.

[0144] Step 406: The thermal imaging device 22 determines whether the number of pixel points in the target area is not less than a preset number threshold (which can be configured according to experience and is related to the actual size of the black body, such as 400, etc.).

[0145] If so, step 407 can be executed; if not, step 408 can be executed.

[0146] Step 407: The thermal imaging device 22 determines that the black body detection result is that there is a black body in the black body detection area.

[0147] Step 408: The thermal imaging device 22 determines that the black body detection result is that there is no black body in the black body detection area.

[0148] In summary, it can be seen that assuming the target black body temperature of the black body is 40 degrees, since the temperature of the target object (such as the target human body) passing through the thermal imaging channel is less than 40 degrees, and the temperature of other objects in the thermal imaging channel except the black body is also less than 40 degrees. Therefore, when determining the target area based on all pixel points with the first value of gray scale values in the binary image, the temperature values corresponding to these pixel points are greater than or equal to 40 degrees, that is, the target area should be the area where the black body is located, thus excluding the area of the target object (such as the target human body).

[0149] Of course, in practical applications, there may be interference. Therefore, it is also possible to detect whether the shape of the target area is the specified shape. If not, it means that the object in the target area is not a black body (the black body should be the specified shape), so as to know that the black body detection result is that there is no black body in the black body detection area.

[0150] If the shape of the target area is the specified shape, it is also possible to detect whether the number of pixel points in the target area is not less than a preset number threshold. Among them, if the number of pixel points in the target area is less than the preset number threshold, it means that the target area is not a black body (the number of pixel points corresponding to the black body is related to the actual size of the black body, and the number of pixel points corresponding to the black body can be pre-configured as the preset number threshold), so as to know that the black body detection result is that there is no black body in the black body detection area. If the number of pixel points in the target area is not less than the preset number threshold, it can be known that the black body detection result is that there is a black body in the black body detection area.

[0151] In summary, the thermal imaging device 22 can determine the blackbody detection result, which is that there is a blackbody in the blackbody detection area, or the blackbody detection result is that there is no blackbody in the blackbody detection area, so as to determine whether the blackbody is abnormal (or determine whether the blackbody is normal). Among them, the blackbody being abnormal means that there is no blackbody in the blackbody detection area, and the blackbody being normal means that there is a blackbody in the blackbody detection area.

[0152] Third, the display process of the thermal imaging image and the blackbody detection result.

[0153] After obtaining the blackbody detection result, the thermal imaging device 22 can send the thermal imaging image and the blackbody detection result to the client 21 together, and the client 21 receives the thermal imaging image and the blackbody detection result.

[0154] Exemplarily, if the blackbody detection result is that there is a blackbody in the blackbody detection area, the client 21 can display the thermal imaging image, that is, only display the thermal imaging image. If the blackbody detection result is that there is no blackbody in the blackbody detection area, the client 21 can display the thermal imaging image, and on the basis of displaying the thermal imaging image, an alarm message can also be superimposed and displayed on the thermal imaging image, that is, the alarm message is presented on the preview screen of the thermal imaging channel, and the alarm message is used to indicate that there is no blackbody in the blackbody detection area.

[0155] In summary, after the thermal imaging device 22 starts running, it can always be in the blackbody anomaly detection state. During the operation of the thermal imaging device 22, if the blackbody is located in the blackbody detection area, the blackbody detection result of the thermal imaging device 22 is that there is a blackbody in the blackbody detection area. In this case, the client 21 only displays the thermal imaging image (that is, no alarm message will be displayed). If the blackbody is not located in the blackbody detection area, the blackbody detection result of the thermal imaging device 22 is that there is no blackbody in the blackbody detection area. In this case, the client 21 displays the thermal imaging image and superimposes and displays an alarm message on the thermal imaging image. For example, the client 21 can display the alarm message at the center position of the thermal imaging image, and there is no limit to this display position.

[0156] Exemplarily, the blackbody is not located in the blackbody detection area, resulting in the blackbody detection result being that there is no blackbody in the blackbody detection area. There can be the following two situations: Situation 1: There is no blackbody in the blackbody detection area itself, that is, the blackbody has been abnormally moved, as shown in Figure 5A shown. Situation 2: There is a blackbody in the blackbody detection area, but the blackbody is blocked by an object, as shown in Figure 5B shown. In this Situation 2, it is also considered that the blackbody is not located in the blackbody detection area, that is, the blackbody detection result is that there is no blackbody in the blackbody detection area.

[0157] As can be seen from the above technical solutions, in the actual use process of the black body in the embodiments of the present application, if the black body is manually moved, it can be determined that there is no black body in the black body detection area, so as to perform an abnormal alarm and prompt the management staff to place the black body back into the thermal imaging channel. In this way, when calibrating the temperature value of the target object based on the reference temperature value of the black body, the calibrated temperature value is a temperature value with a small error, that is, the measurement result of the temperature value is accurate, improving the temperature measurement accuracy. The above method can ensure the stability and reliability of the black body in the thermal imaging temperature measurement process, that is, it ensures the accuracy of the thermal imaging temperature measurement.

[0158] In this embodiment, the user is supported to configure the black body detection area in the thermal imaging field of view screen. Once the black body is moved out of this black body detection area, the preview screen will prompt an alarm message. When the black body is moved back into this black body detection area, the alarm message will disappear. The user only needs to configure the black body detection area, so that the thermal imaging device can be applicable when facing different black bodies, the position of the black body is slightly moved, or the position of the black body is adjusted. Supporting the user to configure the black body detection area can be applicable to all black bodies. The user only needs to configure it once. When the user moves the position of the black body, only need to redraw a black body detection area. The black body detection area can be configured by the user at will, as long as the black body is ensured to be within this black body detection area, which gives the user a great degree of configuration freedom, and the configuration is also very simple and intuitive. In addition, when the black body abnormal alarm is triggered, the alarm message can be superimposed and displayed, with strong privacy. When the black body moves back into the black body detection area or the occlusion is removed, the alarm message will automatically disappear, and the user does not need to perform redundant operations, which is highly practical.

[0159] Based on the same inventive concept as the above method, in the embodiments of the present application, a black body detection device is proposed. Refer to Figure 6 As shown, it is the structural diagram of the black body detection device. The black body detection device includes: an acquisition module 61, configured to determine a sub-image corresponding to the configured black body detection area in the thermal imaging image; a determination module 62, configured to determine a target area in which the thermal imaging information in the sub-image matches the corresponding attribute information of the black body, and determine the black body detection result based on the feature information of the target area.

[0160] Exemplarily, when the determination module 62 determines the target area in which the thermal imaging information in the sub-image matches the corresponding attribute information of the black body, it is specifically configured to: based on the thermal imaging information of each pixel point in the sub-image, select target pixel points that match the corresponding attribute information of the black body from all pixel points in the sub-image; determine the target area based on all the target pixel points in the sub-image.

[0161] Exemplarily, when the determining module 62 selects target pixel points that match the corresponding attribute information of the black body from all pixel points of the sub-image based on the thermal imaging information of each pixel point in the sub-image, it specifically is used for: If the thermal imaging information is the gray value of a pixel point, and the corresponding attribute information of the black body is the target gray value corresponding to the configured target black body temperature, for each pixel point in the sub-image, if the gray value of this pixel point is not less than the target gray value, then it is determined that this pixel point is a target pixel point; or,

[0162] If the thermal imaging information is the gray value of a pixel point, and the corresponding attribute information of the black body is the target gray value, for each pixel point in the sub-image, if the absolute value of the difference between the gray value of this pixel point and the target gray value is less than a first threshold value, then it is determined that this pixel point is a target pixel point; or,

[0163] If the thermal imaging information is the temperature value of a pixel point, and the corresponding attribute information of the black body is the target black body temperature, for each pixel point in the sub-image, if the absolute value of the difference between the temperature value of this pixel point and the target black body temperature is less than a second threshold value, then it is determined that this pixel point is a target pixel point; or,

[0164] If the thermal imaging information is the pseudo-color value of a pixel point, and the corresponding attribute information of the black body is the target pseudo-color value corresponding to the target black body temperature, for each pixel point in the sub-image, if the absolute value of the difference between the pseudo-color value of this pixel point and the target pseudo-color value is less than a third threshold value, then it is determined that this pixel point is a target pixel point.

[0165] Exemplarily, when the determining module 62 determines that a pixel point is a target pixel point if the gray value of this pixel point is not less than the target gray value for each pixel point in the sub-image, it specifically is used for: performing binarization processing on the sub-image based on the target gray value to obtain a binarized image; wherein, for each pixel point in the sub-image, if the gray value of this pixel point is not less than the target gray value, then the gray value of this pixel point in the binarized image is a first value, and if the gray value of this pixel point is less than the target gray value, then the gray value of this pixel point in the binarized image is a second value; determining all pixel points with the first value as the gray value in the binarized image as target pixel points.

[0166] Exemplarily, when the determining module 62 determines the target area based on all target pixel points in the sub-image, it specifically is used for: obtaining the connected domains composed of all target pixel points; if the number of connected domains is one, then determining this connected domain as the target area; if the number of connected domains is at least two, then selecting the connected domain with the largest area from all connected domains as the target area.

[0167] Exemplarily, the feature information of the target area includes at least one of the following: the number of pixel points in the target area, the shape of the target area, and the ratio of the area of the target area to the area of the sub-image; when determining the black body detection result based on the feature information of the target area, the determination module 62 is specifically configured to: if the feature information includes the number of pixel points in the target area, when the number of pixel points is less than a preset number threshold, determine that there is no black body in the black body detection area in the black body detection result; or, if the feature information includes the shape of the target area, when the shape is not the specified shape, determine that there is no black body in the black body detection area in the black body detection result; or, if the feature information includes the ratio of the area of the target area to the area of the sub-image, when the ratio of the area of the target area to the area of the sub-image is less than a preset ratio threshold, determine that there is no black body in the black body detection area in the black body detection result.

[0168] Exemplarily, when determining the black body detection result based on the feature information of the target area, the determination module 62 is specifically configured to: if the feature information includes the number of pixel points in the target area and the shape of the target area, when the number of pixel points is not less than a preset number threshold and the shape is the specified shape, determine that there is a black body in the black body detection area in the black body detection result;

[0169] Wherein, the specified shape is determined based on the actual shape of the black body.

[0170] Exemplarily, the black body detection device may further include (not shown in the figure): a display module, configured to, if the black body detection result is that there is no black body in the black body detection area, when displaying the thermal imaging image, superimpose and display warning information indicating the absence of a black body on the thermal imaging image.

[0171] Exemplarily, the acquisition module 61 is further configured to acquire the position information corresponding to the black body detection area; wherein, if the black body detection area is a rectangular area, the position information is the 4 vertex coordinates of the rectangular area, or the position information is 1 vertex coordinate of the rectangular area, and the width and height; wherein, the position information corresponding to the black body detection area is determined based on the actual position of the black body; based on the position information corresponding to the black body detection area, determine the image coordinate information corresponding to the black body detection area in the thermal imaging image, and the image coordinate information includes 4 vertex coordinates; wherein, the image coordinate information is used to determine the sub-image corresponding to the black body detection area in the thermal imaging image.

[0172] Exemplarily, the obtaining module 61 is further configured to, when the actual position of the black body changes, obtain the changed position information corresponding to the black body detection area, where the changed position information is determined based on the changed actual position of the black body; and determine the changed image coordinate information corresponding to the black body detection area in the thermal imaging image based on the changed position information corresponding to the black body detection area.

[0173] Based on the same application concept as the above method, an embodiment of the present application also proposes a black body detection device. Refer to Figure 7 As shown, the black body detection device may include: a processor 71 and a machine-readable storage medium 72, where the machine-readable storage medium 72 stores machine-executable instructions that can be executed by the processor 71; the processor 71 is configured to execute the machine-executable instructions to implement the black body detection method in the above embodiment. For example, when the processor 71 executes the machine-executable instructions, the following steps are implemented:

[0174] Determine a sub-image in the thermal imaging image corresponding to the configured black body detection area;

[0175] Determine a target area in the sub-image where the thermal imaging information matches the corresponding attribute information of the black body;

[0176] Determine the black body detection result based on the feature information of the target area.

[0177] Based on the same application concept as the above method, an embodiment of the present application further provides a machine-readable storage medium, on which a number of computer instructions are stored. When the computer instructions are executed by a processor, the black body detection method disclosed in the above examples of the present application can be implemented.

[0178] Among them, the above machine-readable storage medium can be any electronic, magnetic, optical or other physical storage device that can contain or store information, such as executable instructions, data, etc. For example, the machine-readable storage medium can be: RAM (Random Access Memory), volatile memory, non-volatile memory, flash memory, storage drives (such as hard disk drives), solid-state drives, any type of storage disk (such as optical discs, DVDs, etc.), or similar storage media, or a combination thereof.

[0179] The systems, devices, modules, or units described in the above embodiments can be specifically implemented by computer chips or entities, or by products with certain functions. A typical implementation device is a computer, and the specific form of the computer can be a personal computer, laptop computer, cellular phone, camera phone, smart phone, personal digital assistant, media player, navigation device, email transceiver device, game console, tablet computer, wearable device, or a combination of any several of these devices.

[0180] For the convenience of description, when describing the above devices, they are divided into various units according to their functions and described separately. Of course, when implementing the present application, the functions of each unit can be implemented in one or more software and / or hardware.

[0181] Those skilled in the art should understand that the embodiments of the present application can be provided as a method, system, or computer program product. Therefore, the present application can take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the embodiments of the present application can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.

[0182] The present application is described with reference to the flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each flow and / or block in the flowchart and / or block diagram, as well as the combination of flows and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing devices to generate a machine, such that the instructions executed by the processor of the computer or other programmable data processing devices generate a device for implementing the functions specified in Figure 1 one or more of the processes or multiple processes and / or blocks Figure 1 one or more of the blocks or multiple blocks.

[0183] Moreover, these computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, such that the instructions stored in the computer-readable memory generate a manufactured article including an instruction device that implements the functions specified in Figure 1 one or more of the processes or multiple processes and / or blocks Figure 1 one or more of the blocks or multiple blocks.

[0184] These computer program instructions can also be loaded onto a computer or other programmable data processing apparatus, so that a series of operation steps are executed on the computer or other programmable apparatus to produce a computer-implemented process, thereby providing instructions for implementing the steps specified in one process or a plurality of processes and / or one block or a plurality of blocks in the flow Figure 1 one process or a plurality of processes and / or Figure 1 one block or a plurality of blocks.

[0185] The above are only embodiments of the present application and are not intended to limit the present application. Various modifications and variations can be made to the present application by those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included within the scope of the claims of the present application.

Claims

1. A black body detection method, characterized in that, The method includes: Determining a sub-image corresponding to a configured blackbody detection area in a thermal imaging image; Determining a target area in the sub-image where the thermal imaging information matches the corresponding attribute information of the blackbody; wherein, the thermal imaging information is the gray value of a pixel point, and the corresponding attribute information of the blackbody is the target gray value corresponding to a configured target blackbody temperature; or, the thermal imaging information is the temperature value of a pixel point, and the corresponding attribute information of the blackbody is the target blackbody temperature; or, the thermal imaging information is the pseudo-color value of a pixel point, and the corresponding attribute information of the blackbody is the target pseudo-color value corresponding to the target blackbody temperature; Determining a blackbody detection result based on the feature information of the target area; wherein, the feature information of the target area includes at least one of the following: the number of pixel points in the target area, the shape of the target area, and the ratio of the area of the target area to the area of the sub-image.

2. The method according to claim 1, wherein The determining of the target area in the sub-image where the thermal imaging information matches the corresponding attribute information of the blackbody includes: Based on the thermal imaging information of each pixel point in the sub-image, selecting target pixel points that match the corresponding attribute information of the blackbody from all pixel points in the sub-image; Determining the target area based on all the target pixel points in the sub-image.

3. The method according to claim 2, wherein The selecting of the target pixel points that match the corresponding attribute information of the blackbody from all pixel points in the sub-image based on the thermal imaging information of each pixel point in the sub-image includes: If the thermal imaging information is the gray value of a pixel point, and the corresponding attribute information of the blackbody is the target gray value corresponding to a configured target blackbody temperature, for each pixel point in the sub-image, if the gray value of the pixel point is not less than the target gray value, then determining that the pixel point is a target pixel point; or, If the thermal imaging information is the gray value of a pixel point, and the corresponding attribute information of the blackbody is the target gray value, for each pixel point in the sub-image, if the absolute value of the difference between the gray value of the pixel point and the target gray value is less than a first threshold, then determining that the pixel point is a target pixel point; or, If the thermal imaging information is the temperature value of a pixel point, and the corresponding attribute information of the blackbody is the target blackbody temperature, for each pixel point in the sub-image, if the absolute value of the difference between the temperature value of the pixel point and the target blackbody temperature is less than a second threshold, then determining that the pixel point is a target pixel point; or, If the thermal imaging information is the pseudo-color value of a pixel point, and the corresponding attribute information of the blackbody is the target pseudo-color value corresponding to the target blackbody temperature, for each pixel point in the sub-image, if the absolute value of the difference between the pseudo-color value of the pixel point and the target pseudo-color value is less than a third threshold, then determining that the pixel point is a target pixel point.

4. The method according to claim 3, wherein For each pixel point in the sub-image, if the gray value of the pixel point is not less than the target gray value, then determining that the pixel point is a target pixel point, includes: Perform binarization processing on the sub-image based on the target gray value to obtain a binarized image; wherein, for each pixel point in the sub-image, if the gray value of the pixel point is not less than the target gray value, the gray value of the pixel point in the binarized image is the first value, and if the gray value of the pixel point is less than the target gray value, the gray value of the pixel point in the binarized image is the second value; Determine all pixel points with the first value in the binarized image as target pixel points.

5. The method according to any one of claims 2-4, wherein The determining the target area based on all the target pixel points in the sub-image includes: Obtain the connected components composed of all target pixel points; If the number of connected components is one, determine the connected component as the target area; If the number of connected components is at least two, select the connected component with the largest area from all connected components as the target area.

6. The method according to claim 1, wherein The determining the black body detection result based on the feature information of the target area includes: If the feature information includes the number of pixel points in the target area, when the number of pixel points is less than a preset number threshold, determine that the black body detection result is that there is no black body in the black body detection area; Or, if the feature information includes the shape of the target area, when the shape is not the specified shape, determine that the black body detection result is that there is no black body in the black body detection area; Or, if the feature information includes the ratio of the area of the target area to the area of the sub-image, when the ratio of the area of the target area to the area of the sub-image is less than a preset ratio threshold, determine that the black body detection result is that there is no black body in the black body detection area.

7. The method according to claim 6, wherein The determining the black body detection result based on the feature information of the target area includes: If the feature information includes the number of pixel points in the target area and the shape of the target area, when the number of pixel points is not less than a preset number threshold and the shape is the specified shape, determine that the black body detection result is that there is a black body in the black body detection area; Wherein, the specified shape is determined based on the actual shape of the black body.

8. The method according to claim 1, characterized in that The method further includes: If the black body detection result is that there is no black body in the black body detection area, when displaying the thermal imaging image, superimpose and display warning information indicating the absence of a black body on the thermal imaging image.

9. The method according to claim 1, wherein The method further includes: Obtain the position information corresponding to the black body detection area; wherein, if the black body detection area is a rectangular area, the position information is the 4 vertex coordinates of the rectangular area, or the position information is 1 vertex coordinate of the rectangular area, and the width and height; wherein, the position information corresponding to the black body detection area is determined based on the actual position of the black body; Based on the position information corresponding to the blackbody detection area, determine the image coordinate information corresponding to the blackbody detection area in the thermal imaging image, where the image coordinate information includes the coordinates of 4 vertices; wherein, the image coordinate information is used to determine the sub-image corresponding to the blackbody detection area in the thermal imaging image.

10. The method according to claim 9, characterized in that, The method further includes: When the actual position of the blackbody changes, obtain the changed position information corresponding to the blackbody detection area, where the changed position information is determined based on the changed actual position of the blackbody; Based on the changed position information corresponding to the blackbody detection area, determine the changed image coordinate information corresponding to the blackbody detection area in the thermal imaging image.

11. A black body detection device, characterized in that, The apparatus includes: An acquisition module, configured to determine a sub-image corresponding to a configured blackbody detection area in the thermal imaging image; A determination module, configured to determine a target area in the sub-image where the thermal imaging information matches the corresponding attribute information of the blackbody, and determine a blackbody detection result based on the feature information of the target area; Wherein, the thermal imaging information is the gray value of a pixel point, and the corresponding attribute information of the blackbody is the target gray value corresponding to the configured target blackbody temperature; or, the thermal imaging information is the temperature value of a pixel point, and the corresponding attribute information of the blackbody is the target blackbody temperature; or, the thermal imaging information is the pseudo-color value of a pixel point, and the corresponding attribute information of the blackbody is the target pseudo-color value corresponding to the target blackbody temperature; The feature information of the target area includes at least one of the following: the number of pixel points in the target area, the shape of the target area, and the ratio of the area of the target area to the area of the sub-image.

12. The apparatus according to claim 11, wherein: Among them, When determining the target area in the sub-image where the thermal imaging information matches the corresponding attribute information of the blackbody, the determination module is specifically configured to: based on the thermal imaging information of each pixel point in the sub-image, select target pixel points that match the corresponding attribute information of the blackbody from all pixel points in the sub-image; determine the target area based on all the target pixel points in the sub-image; Wherein, when the determining module selects target pixel points that match the corresponding attribute information of the black body from all pixel points of the sub-image based on the thermal imaging information of each pixel point in the sub-image, it specifically is used for: If the thermal imaging information is the gray value of a pixel point and the corresponding attribute information of the black body is the target gray value corresponding to the configured target black body temperature, for each pixel point in the sub-image, if the gray value of this pixel point is not less than the target gray value, then it is determined that this pixel point is a target pixel point; or, if the thermal imaging information is the gray value of a pixel point and the corresponding attribute information of the black body is the target gray value, for each pixel point in the sub-image, if the absolute value of the difference between the gray value of this pixel point and the target gray value is less than the first threshold, then it is determined that this pixel point is a target pixel point; or, if the thermal imaging information is the temperature value of a pixel point and the corresponding attribute information of the black body is the target black body temperature, for each pixel point in the sub-image, if the absolute value of the difference between the temperature value of this pixel point and the target black body temperature is less than the second threshold, then it is determined that this pixel point is a target pixel point; or, if the thermal imaging information is the pseudo-color value of a pixel point and the corresponding attribute information of the black body is the target pseudo-color value corresponding to the target black body temperature, for each pixel point in the sub-image, if the absolute value of the difference between the pseudo-color value of this pixel point and the target pseudo-color value is less than the third threshold, then it is determined that this pixel point is a target pixel point; Wherein, when the determining module, for each pixel point in the sub-image, if the gray value of this pixel point is not less than the target gray value, then it is determined that this pixel point is a target pixel point, it specifically is used for: performing binarization processing on the sub-image based on the target gray value to obtain a binarized image; wherein, for each pixel point in the sub-image, if the gray value of this pixel point is not less than the target gray value, then the gray value of this pixel point in the binarized image is the first value, and if the gray value of this pixel point is less than the target gray value, then the gray value of this pixel point in the binarized image is the second value; determining all pixel points with the first value in the binarized image as target pixel points; Wherein, when the determining module determines the target area based on all target pixel points in the sub-image, it specifically is used for: obtaining the connected regions formed by all target pixel points; if the number of connected regions is one, then determining this connected region as the target area; if the number of connected regions is at least two, then selecting the connected region with the largest area from all connected regions as the target area; Among them, when the determining module determines the blackbody detection result based on the feature information of the target area, it is specifically used for: if the feature information includes the number of pixel points in the target area, when the number of pixel points is less than a preset number threshold, it is determined that there is no blackbody in the blackbody detection area; or, if the feature information includes the shape of the target area, when the shape is not the specified shape, it is determined that there is no blackbody in the blackbody detection area; or, if the feature information includes the ratio of the area of the target area to the area of the sub-image, when the ratio of the area of the target area to the area of the sub-image is less than a preset ratio threshold, it is determined that there is no blackbody in the blackbody detection area. Among them, when the determining module determines the blackbody detection result based on the feature information of the target area, it is specifically used for: if the feature information includes the number of pixel points in the target area and the shape of the target area, when the number of pixel points is not less than a preset number threshold and the shape is the specified shape, it is determined that there is a blackbody in the blackbody detection area; where the specified shape is determined based on the actual shape of the blackbody. Among them, the device further includes: a display module, which is used for, if the blackbody detection result is that there is no blackbody in the blackbody detection area, when displaying the thermal imaging image, superimposing and displaying warning information indicating the absence of a blackbody on the thermal imaging image. Among them, the obtaining module is further used for obtaining the position information corresponding to the blackbody detection area; where, if the blackbody detection area is a rectangular area, the position information is the 4 vertex coordinates of the rectangular area, or the position information is the 1 vertex coordinate of the rectangular area, and the width and height; the position information corresponding to the blackbody detection area is determined based on the actual position of the blackbody; based on the position information corresponding to the blackbody detection area, determining the image coordinate information corresponding to the blackbody detection area in the thermal imaging image, and the image coordinate information includes 4 vertex coordinates; where the image coordinate information is used to determine the sub-image corresponding to the blackbody detection area in the thermal imaging image. Among them, the obtaining module is further used for, when the actual position of the blackbody changes, obtaining the changed position information corresponding to the blackbody detection area, and the changed position information is determined based on the changed actual position of the blackbody; based on the changed position information corresponding to the blackbody detection area, determining the changed image coordinate information corresponding to the blackbody detection area in the thermal imaging image.

13. A black body detection device, characterized in that, Including: A processor and a machine-readable storage medium, where the machine-readable storage medium stores machine-executable instructions that can be executed by the processor; The processor is used to execute the machine-executable instructions to implement the method steps described in any one of claims 1-10.

Images