Temperature measurement device, method and machine-readable storage medium based on visible light camera

Abstract

The present application provides a temperature measurement device, method and machine-readable storage medium based on a visible light camera. In one example, the temperature measurement device based on a visible light camera includes: a visible light camera, an infrared thermometer and a processor; wherein the processor can be used to determine the visible light temperature measurement data of the temperature measurement object based on the visible light response data; determine the discrete degree of the visible light response data of the temperature measurement area of ​​the infrared thermometer; when the discrete degree of the visible light response data of the temperature measurement area of ​​the infrared thermometer is less than a preset threshold, determine the temperature measurement correction coefficient based on the infrared temperature measurement data of the temperature measurement area of ​​the infrared thermometer and the visible light temperature measurement data of the temperature measurement area of ​​the infrared thermometer, and correct the visible light temperature measurement data of the temperature measurement object. The solution provided in the embodiment of the present application can improve the accuracy of temperature measurement using a visible light camera.

Description

Technical Field

[0001] The present application relates to the field of non-contact temperature measurement, and in particular to a temperature measurement device, method and machine-readable storage medium based on a visible light camera. Background Art

[0002] In nature, all objects above absolute zero are constantly radiating energy. The temperature measurement technology that uses a visible light camera to obtain visible light images has the characteristics of low cost, low requirements on the use environment, ability to achieve high temperature measurement, and ability to provide the temperature field of the measured surface.

[0003] How to improve the accuracy of temperature measurement using visible light cameras has become a hot research direction. Summary of the invention

[0004] In view of this, the present application provides a temperature measurement device, method and machine-readable storage medium based on a visible light camera.

[0005] Specifically, the present application is implemented through the following technical solutions:

[0006] According to a first aspect of an embodiment of the present application, a temperature measurement device based on a visible light camera is provided, comprising: a visible light camera, an infrared thermometer, and a processor; the visible light camera and the infrared thermometer share an optical path, and the temperature measurement area of ​​the infrared thermometer covers n visible light pixels, n≥1; wherein:

[0007] The visible light camera is used to collect visible light response data of the temperature measurement object;

[0008] The infrared thermometer is used to perform infrared temperature measurement on a temperature measurement object to obtain infrared temperature measurement data of the temperature measurement object;

[0009] The processor is used to determine the visible light temperature measurement data of the temperature measurement object according to the visible light response data;

[0010] The processor is also used to determine the degree of discreteness of the visible light response data of the temperature measurement area of ​​the infrared thermometer; when the degree of discreteness of the visible light response data of the temperature measurement area of ​​the infrared thermometer is less than a preset threshold, a temperature measurement correction coefficient is determined based on the infrared temperature measurement data of the temperature measurement area of ​​the infrared thermometer and the visible light temperature measurement data of the temperature measurement area of ​​the infrared thermometer, and the visible light temperature measurement data of the temperature measurement object is corrected based on the temperature measurement correction coefficient, and the corrected visible light temperature measurement data of the temperature measurement object is used as the actual visible light temperature measurement data.

[0011] According to a second aspect of an embodiment of the present application, a temperature measurement method based on a visible light camera is provided, which is applied to a temperature measurement device based on a visible light camera, wherein the temperature measurement device based on a visible light camera comprises a visible light camera, an infrared thermometer, and a processor; the visible light camera and the infrared thermometer share an optical path, and the temperature measurement area of ​​the infrared thermometer covers n visible light pixels, where n≥1; the method comprises:

[0012] Determining visible light temperature measurement data of the temperature measurement object according to the visible light response data of the temperature measurement object collected by the visible light camera;

[0013] Determine the discrete degree of visible light response data of the temperature measurement area of ​​the infrared thermometer;

[0014] When the discreteness of the visible light response data of the temperature measurement area of ​​the infrared thermometer is less than a preset threshold, determining a temperature measurement correction coefficient according to the infrared temperature measurement data of the temperature measurement object acquired by the infrared thermometer and the visible light temperature measurement data of the temperature measurement area of ​​the infrared thermometer;

[0015] The visible light temperature measurement data of the temperature measurement object is corrected according to the temperature measurement correction coefficient, and the corrected visible light temperature measurement data of the temperature measurement object is used as the actual visible light temperature measurement data.

[0016] According to a third aspect of an embodiment of the present application, an electronic device is provided, including a processor and a memory, wherein the memory stores machine executable instructions that can be executed by the processor, and the processor is used to execute the machine executable instructions to implement the method provided in the second aspect.

[0017] According to a fourth aspect of an embodiment of the present application, a machine-readable storage medium is provided, wherein the machine-readable storage medium stores machine-executable instructions, and when the machine-executable instructions are executed by a processor, the method provided in the second aspect is implemented.

[0018] The technical solution provided by this application can at least bring the following beneficial effects:

[0019] By introducing an infrared thermometer, the infrared thermometer and the visible light camera adopt a common optical path solution, and the temperature measurement area of ​​the infrared thermometer covers n (n≥1) visible light pixels. During the temperature measurement process, on the one hand, temperature measurement based on visible light can be performed to obtain visible light temperature measurement data; on the other hand, temperature measurement based on infrared radiation can be performed to obtain infrared temperature measurement data, and based on the comparison result of the discrete degree of visible light response data of the temperature measurement area of ​​the infrared thermometer with a preset threshold, when the discrete degree of visible light response data of the temperature measurement area of ​​the infrared thermometer is less than the preset threshold, the visible light temperature measurement data is corrected according to the infrared temperature measurement data, thereby improving the accuracy of temperature measurement through the visible light camera. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 is a structural schematic diagram of a temperature measurement device based on a visible light camera shown in an exemplary embodiment of the present application;

[0021] Figure 2 is a schematic diagram of a temperature measurement area of ​​an infrared thermometer shown in an exemplary embodiment of the present application;

[0022] Figure 3 is a schematic diagram of a temperature measurement process based on a visible light camera shown in an exemplary embodiment of the present application;

[0023] Figure 4 is a flow chart of a temperature measurement method based on a visible light camera shown in an exemplary embodiment of the present application;

[0024] Figure 5 is a structural schematic diagram of a temperature measuring device based on a visible light camera shown in an exemplary embodiment of the present application;

[0025] Figure 6 It is a schematic diagram of the hardware structure of an electronic device shown in an exemplary embodiment of the present application. DETAILED DESCRIPTION

[0026] In order to enable those skilled in the art to better understand the technical solutions provided by the embodiments of the present application and to make the above-mentioned purposes, features and advantages of the embodiments of the present application more obvious and understandable, the technical solutions in the embodiments of the present application are further described in detail below in conjunction with the accompanying drawings.

[0027] It should be noted that the serial numbers of the steps in the embodiments of the present application do not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0028] See also Figure 1 , is a structural schematic diagram of a temperature measurement device based on a visible light camera provided in an embodiment of the present application, such as Figure 1 As shown, the temperature measurement device 100 based on a visible light camera may include a visible light camera 110, an infrared thermometer 120 and a processor 130; the visible light camera 110 and the infrared thermometer 120 share an optical path, and the temperature measurement area of ​​the infrared thermometer 120 covers n visible light pixels, n≥1; wherein:

[0029] The visible light camera 110 is used to collect visible light response data of the temperature measurement object;

[0030] The infrared thermometer 120 is used to perform infrared temperature measurement on the temperature measurement object to obtain infrared temperature measurement data of the temperature measurement object;

[0031] The processor 130 is used to determine the visible light temperature measurement data of the temperature measurement object according to the visible light response data;

[0032] The processor 130 is also used to determine the degree of discreteness of the visible light response data of the temperature measurement area of ​​the infrared thermometer; when the degree of discreteness of the visible light response data of the temperature measurement area of ​​the infrared thermometer is less than a preset threshold, a temperature measurement correction coefficient is determined based on the infrared temperature measurement data of the temperature measurement area of ​​the infrared thermometer and the visible light temperature measurement data of the temperature measurement area of ​​the infrared thermometer, and the visible light temperature measurement data of the temperature measurement object is corrected based on the temperature measurement correction coefficient, and the corrected visible light temperature measurement data of the temperature measurement object is used as the actual visible light temperature measurement data.

[0033] In an embodiment of the present application, in order to improve the accuracy of temperature measurement based on a visible light camera, an infrared thermometer can be introduced into a temperature measurement device based on a visible light camera, and the temperature measurement data of the visible light camera (which can be called visible light temperature measurement data) can be corrected using the temperature measurement data of the infrared thermometer (which can be called infrared temperature measurement data).

[0034] However, considering that for objects with poor surface uniformity, the infrared temperature measurement data will have greater volatility and poor stability, accordingly, the credibility of the infrared temperature measurement data will be relatively low and the reference value will be relatively small. If the low-credibility infrared temperature measurement data is used to correct the visible light temperature measurement data, the accuracy of the visible light temperature measurement data may be reduced.

[0035] Therefore, in order to improve the accuracy of temperature measurement based on visible light cameras, before correcting the visible light temperature measurement data based on the infrared temperature measurement data, it is necessary to determine whether the infrared temperature measurement data is credible. If it is determined that the infrared temperature measurement data is credible, the visible light temperature measurement data is corrected based on the infrared temperature measurement data.

[0036] Exemplarily, the uniformity of the surface of the temperature measurement object (the surface of the temperature measurement object corresponding to the temperature measurement area of ​​the infrared thermometer) can be characterized by the degree of discreteness of the visible light response data of the temperature measurement area of ​​the infrared thermometer, and then the credibility of the infrared temperature measurement data can be determined.

[0037] Exemplarily, the degree of dispersion of the visible light response data of the temperature measurement area of ​​the infrared thermometer is negatively correlated with the credibility of the infrared temperature measurement data.

[0038] For example, the higher the degree of discreteness of the visible light response data in the temperature measurement area of ​​the infrared thermometer, the worse the surface uniformity of the temperature measurement object and the lower the credibility of the infrared temperature measurement data; the lower the degree of discreteness of the visible light response data in the temperature measurement area of ​​the infrared thermometer, the better the surface uniformity of the temperature measurement object and the higher the credibility of the infrared temperature measurement data.

[0039] Accordingly, in the embodiment of the present application, the processor 130 can collect visible light response data of the temperature measurement object through a visible light camera, and determine the visible light temperature measurement data of the temperature measurement object based on the visible light response data.

[0040] For example, the visible light response data represents the brightness or color information of each pixel in the image, which is obtained by converting light into electrical signals and digitizing them through the camera's sensor.

[0041] In one example, a machine learning method (such as linear regression, support vector machine, neural network, etc.) can be used to establish a relationship model between visible light response data and temperature data, and the known visible light response data and corresponding temperature data can be used to train the model. Thus, a relationship model for determining visible light temperature measurement data based on the visible light response data can be obtained. Furthermore, the trained relationship model can be used to determine the visible light temperature measurement data of the temperature measurement object with the visible light response data of the temperature measurement object as input.

[0042] On the other hand, the discreteness of the visible light response data of the temperature measurement area of ​​the infrared thermometer can be determined based on the visible light response data.

[0043] In one example, the degree of dispersion can be characterized by range, interquartile range, mean deviation, variance, standard deviation, multivariate ratio, or coefficient of dispersion.

[0044] The range is the difference between the maximum and minimum values ​​in the data sample.

[0045] The interquartile range is the difference between the upper quarter and the lower quarter of the data sample; the upper quarter refers to the value at the 75% position of the data after the data set is arranged in ascending order, that is, the 75th percentile; the lower quarter refers to the value at the 25% position of the data after the data set is arranged in ascending order, that is, the 25th percentile.

[0046] The mean difference is the sum of the absolute values ​​of the differences between each data sample and the mean value of each data sample divided by the total number of data samples, such as:

[0047]

[0048] Where n is the total number of data samples, is the data sample i (1≤i≤n), is the average value of each data sample.

[0049] The variance is the sum of the squares of the differences between each data sample and the mean of each data sample divided by the total number of data samples minus 1, such as:

[0050]

[0051] The standard deviation is the square root of the variance, that is:

[0052]

[0053] The outlier ratio is the ratio of the frequency of the non-modal group to the total frequency, such as:

[0054]

[0055] in, is the total frequency of the data sample, is the frequency of the mode group; the mode group is the value with the highest frequency in a set of data.

[0056] The coefficient of dispersion is the ratio of the standard deviation to the mean, such as:

[0057]

[0058] In the embodiment of the present application, after determining the discrete degree of visible light response data of the temperature measurement area of ​​the infrared thermometer, the processor 130 can compare the discrete degree of visible light response data of the temperature measurement area of ​​the infrared thermometer with a preset threshold (which can be set according to actual needs).

[0059] When the discrete degree of the visible light response data of the temperature measurement area of ​​the infrared thermometer is less than the preset threshold, it can be determined that the current infrared temperature measurement data is relatively reliable, and the visible light temperature measurement data can be corrected based on the current infrared temperature measurement data.

[0060] In this case, the temperature measurement correction coefficient can be determined based on the infrared temperature measurement data of the temperature measurement area of ​​the infrared thermometer and the visible light temperature measurement data of the temperature measurement area of ​​the infrared thermometer, and the visible light temperature measurement data of the temperature measurement object can be corrected based on the temperature measurement correction coefficient, and the corrected visible light temperature measurement data of the temperature measurement object can be used as the actual visible light temperature measurement data.

[0061] For example, the temperature measurement correction coefficient may be the difference between the visible light temperature measurement data to be corrected and the actual visible light temperature measurement data, and the correction of the visible light temperature measurement data may be achieved by adding the temperature measurement correction coefficient to the visible light temperature measurement data to be corrected; or, the temperature measurement correction coefficient may be the ratio between the visible light temperature measurement data to be corrected and the actual visible light temperature measurement data, and the correction of the visible light temperature measurement data may be achieved by dividing the visible light temperature measurement data to be corrected by the temperature measurement correction coefficient.

[0062] It should be noted that in the embodiment of the present application, as an example, when the number of visible light pixels covered by the temperature measurement area of ​​the infrared thermometer is 1, it can be assumed that the discreteness of the visible light response data of the temperature measurement area of ​​the infrared thermometer is less than a preset threshold. In this case, the visible light temperature measurement data can be corrected based on the infrared temperature measurement data, and the corrected visible light temperature measurement data of the temperature measurement object can be used as the actual visible light temperature measurement data; when the number of visible light pixels covered by the temperature measurement area of ​​the infrared thermometer is more than 1, the correction judgment can be further performed in the above manner, and its specific implementation will not be repeated here.

[0063] It can be seen that in Figure 1 In the temperature measurement device based on the visible light camera shown, an infrared thermometer is introduced. The infrared thermometer and the visible light camera adopt a common optical path solution, and the temperature measurement area of ​​the infrared thermometer covers n (n≥1) visible light pixels. During the temperature measurement process, on the one hand, temperature measurement based on visible light can be performed to obtain visible light temperature measurement data; on the other hand, temperature measurement based on infrared radiation can be performed to obtain infrared temperature measurement data, and based on the comparison result of the discrete degree of visible light response data of the temperature measurement area of ​​the infrared thermometer with a preset threshold, when the discrete degree of visible light response data of the temperature measurement area of ​​the infrared thermometer is less than the preset threshold, the visible light temperature measurement data is corrected according to the infrared temperature measurement data, thereby improving the accuracy of temperature measurement by the visible light camera.

[0064] In some embodiments, the processor 130 can be specifically used to obtain visible light response data of a designated channel of the temperature measurement area of ​​the infrared thermometer; wherein the designated channel includes at least one of the R channel, the G channel, and the B channel; based on the visible light response data of the designated channel of the temperature measurement area of ​​the infrared thermometer, determine the discrete degree of the visible light response data of the temperature measurement area of ​​the infrared thermometer.

[0065] Exemplarily, a visible light pixel may include multiple channels.

[0066] For example, a visible light pixel may include M*N (eg, 2*2) channels, and each channel may be one of the R / G / B channels.

[0067] For example, for a 2*2 channel visible light pixel, its channels can be RGGB, RRGB or RGBB, etc.

[0068] Exemplarily, visible light response data of a specified channel of the temperature measurement area of ​​the infrared thermometer can be obtained, and the degree of discreteness of the visible light response data of the temperature measurement area of ​​the infrared thermometer can be determined based on the visible light response data of the specified channel of the temperature measurement area of ​​the infrared thermometer.

[0069] The designated channel includes at least one of an R channel, a G channel, and a B channel (which can be set according to actual needs). For example, the designated channel can include an R channel.

[0070] For example, taking the designated channel as the R channel, the visible light response data of the R channel of the temperature measurement area of ​​the infrared thermometer can be obtained, and the range of the visible light response data of the R channel of the temperature measurement area of ​​the infrared thermometer can be determined as the discrete degree of the visible light response data of the temperature measurement area of ​​the infrared thermometer.

[0071] For another example, taking the designated channel as channel G, the visible light response data of channel G of the temperature measurement area of ​​the infrared thermometer can be obtained, and the average difference of the visible light response data of channel G of the temperature measurement area of ​​the infrared thermometer can be determined as the discreteness of the visible light response data of the temperature measurement area of ​​the infrared thermometer.

[0072] In one example, the designated channels include multiple channels among an R channel, a G channel, and a B channel;

[0073] The processor 130 can be specifically used to determine the discrete degree of the visible light response data of each designated channel of the temperature measurement area of ​​the infrared thermometer, and determine the discrete degree of the visible light response data of the temperature measurement area of ​​the infrared thermometer based on the discrete degree of the visible light response data of each designated channel of the temperature measurement area of ​​the infrared thermometer.

[0074] Exemplarily, in order to improve the accuracy of determining the discreteness of visible light response data, visible light response data of multiple channels may be selected for determining the discreteness.

[0075] When the designated channels include multiple channels among the R channel, the G channel and the B channel, the discrete degree of the visible light response data of each designated channel of the temperature measurement area of ​​the infrared thermometer can be determined respectively, and based on the discrete degree of the visible light response data of each designated channel of the temperature measurement area of ​​the infrared thermometer, the discrete degree of the visible light response data of the temperature measurement area of ​​the infrared thermometer can be determined.

[0076] For example, the maximum value or minimum value of the discreteness of the visible light response data of each designated channel of the temperature measurement area of ​​the infrared thermometer can be determined as the discreteness of the visible light response data of the temperature measurement area of ​​the infrared thermometer; or, the average value, variance or standard deviation of the discreteness of the visible light response data of each designated channel of the temperature measurement area of ​​the infrared thermometer can be determined as the discreteness of the visible light response data of the temperature measurement area of ​​the infrared thermometer.

[0077] For example, taking the designated channels including R channel and B channel as an example, the discrete degree of visible light response data of R channel of the temperature measurement area of ​​the infrared thermometer and the discrete degree of visible light response data of B channel of the temperature measurement area of ​​the infrared thermometer can be determined respectively, and the maximum value of the discrete degree of visible light response data of R channel and the discrete degree of visible light response data of B channel can be determined as the discrete degree of visible light response data of the temperature measurement area of ​​the infrared thermometer.

[0078] For another example, taking the designated channels including R channel, G channel and B channel as an example, the discrete degree of visible light response data of R channel of the temperature measurement area of ​​the infrared thermometer, the discrete degree of visible light response data of G channel of the temperature measurement area of ​​the infrared thermometer, and the discrete degree of visible light response data of B channel of the temperature measurement area of ​​the infrared thermometer can be determined respectively, and the average value of the discrete degree of visible light response data of R channel, the discrete degree of visible light response data of G channel, and the discrete degree of visible light response data of B channel can be determined as the discrete degree of visible light response data of the temperature measurement area of ​​the infrared thermometer.

[0079] In some embodiments, the processor 130 can be specifically used to determine the temperature measurement correction coefficient using the infrared temperature measurement data of the temperature measurement area of ​​the infrared thermometer and the visible light temperature measurement data of the temperature measurement area of ​​the infrared thermometer as input and using a pre-constructed temperature measurement correction function.

[0080] Exemplarily, in order to improve the efficiency and accuracy of determining the temperature measurement correction coefficient, a function for determining the temperature measurement correction coefficient (which may be called a temperature measurement correction function) can be pre-constructed. The temperature measurement correction function can take the infrared temperature measurement data of the temperature measurement area of ​​the infrared thermometer and the visible light temperature measurement data of the temperature measurement area of ​​the infrared thermometer as input, and output the corresponding temperature measurement correction coefficient.

[0081] Accordingly, when it is determined that the discreteness of the visible light response data of the temperature measurement area of ​​the infrared thermometer is less than a preset threshold, the infrared temperature measurement data of the temperature measurement area of ​​the infrared thermometer and the visible light temperature measurement data of the temperature measurement area of ​​the infrared thermometer can be used as input, and a pre-constructed temperature measurement correction function can be used to determine the temperature measurement correction coefficient.

[0082] For example, the temperature measurement correction function can be as follows:

[0083]

[0084] in, The infrared temperature measurement data of the temperature measurement area of ​​the infrared thermometer. It is the visible light temperature measurement data of the temperature measurement area of ​​the infrared thermometer. is the temperature correction factor.

[0085] In some embodiments, the processor 130 can be specifically used to determine the average value of the visible light temperature measurement data of the temperature measurement area of ​​the infrared thermometer, and determine the difference between the average value and the infrared temperature measurement data of the temperature measurement area of ​​the infrared thermometer, and determine the temperature measurement correction coefficient based on the difference.

[0086] Exemplarily, in order to reduce the complexity of determining the temperature measurement correction coefficient, the temperature measurement correction coefficient may be determined based on the difference between the average value of the visible light temperature measurement data and the infrared temperature measurement data in the temperature measurement area of ​​the infrared thermometer.

[0087] Accordingly, when it is determined that the discreteness of the visible light response data of the temperature measurement area of ​​the infrared thermometer is less than a preset threshold, the average value of the visible light temperature measurement data of the temperature measurement area of ​​the infrared thermometer can be determined, and the difference between the average value and the infrared temperature measurement data of the temperature measurement area of ​​the infrared thermometer can be determined, and the temperature measurement correction coefficient can be determined based on the difference.

[0088] For example, assuming that the average value of the visible light temperature measurement data in the temperature measurement area of ​​the infrared thermometer is T1, and the infrared temperature measurement data in the temperature measurement area of ​​the infrared thermometer is T2, ΔT (ΔT=T2-T1) can be determined as the temperature measurement correction coefficient, and ΔT can be added to the visible light temperature measurement data of the temperature measurement object to correct the visible light temperature measurement data of the temperature measurement object, and the corrected visible light temperature measurement data of the temperature measurement object is used as the actual visible light temperature measurement data.

[0089] In some embodiments, the processor 130 can be specifically used to determine the average value of the visible light temperature measurement data of the temperature measurement area of ​​the infrared thermometer, and determine the ratio of the average value to the infrared temperature measurement data of the temperature measurement area of ​​the infrared thermometer, and determine the temperature measurement correction coefficient based on the ratio.

[0090] Exemplarily, in order to reduce the complexity of determining the temperature measurement correction coefficient, the temperature measurement correction coefficient may be determined based on the ratio of the average value of the visible light temperature measurement data to the infrared temperature measurement data in the temperature measurement area of ​​the infrared thermometer.

[0091] Accordingly, when it is determined that the discreteness of the visible light response data of the temperature measurement area of ​​the infrared thermometer is less than a preset threshold, the average value of the visible light temperature measurement data of the temperature measurement area of ​​the infrared thermometer can be determined, and the ratio of the average value to the infrared temperature measurement data of the temperature measurement area of ​​the infrared thermometer can be determined, and the temperature measurement correction coefficient can be determined based on the ratio.

[0092] For example, assuming that the average value of the visible light temperature measurement data in the temperature measurement area of ​​the infrared thermometer is T1, and the infrared temperature measurement data in the temperature measurement area of ​​the infrared thermometer is T2, then T R (T R=T1 / T2) is determined as the temperature measurement correction coefficient, and is divided by T based on the visible light temperature measurement data of the temperature measurement object. R , to correct the visible light temperature measurement data of the temperature measurement object, and use the corrected visible light temperature measurement data of the temperature measurement object as the actual visible light temperature measurement data.

[0093] In some embodiments, the processor 130 may also be used to update the currently stored temperature measurement correction coefficient according to the determined temperature measurement correction coefficient when the discrete degree of the visible light response data of the temperature measurement area of ​​the infrared thermometer is less than a preset threshold value; wherein the initial value of the currently stored temperature measurement correction coefficient is a default value;

[0094] The processor 130 can also be used to correct the visible light temperature measurement data of the temperature measurement object according to the currently stored temperature measurement correction coefficient when the discrete degree of the visible light response data of the temperature measurement area of ​​the infrared thermometer is greater than or equal to a preset threshold, and use the corrected visible light temperature measurement data of the temperature measurement object as the actual visible light temperature measurement data.

[0095] Exemplarily, when the temperature measurement correction coefficient is determined as described above, the processor 130 may update the currently stored temperature measurement correction coefficient according to the determined temperature measurement correction coefficient, for example, replace the currently stored temperature measurement correction coefficient with the determined temperature measurement correction coefficient.

[0096] Exemplarily, the initial value of the currently stored temperature measurement correction coefficient is a default value.

[0097] In one example, the corrected visible light temperature measurement data obtained by correcting the visible light temperature measurement data using the default temperature measurement correction coefficient (ie, the initial temperature measurement correction coefficient) is the same as the visible light temperature measurement data before correction.

[0098] For example, when the degree of discreteness of the visible light response data in the temperature measurement area of ​​the infrared thermometer is greater than or equal to a preset threshold, it can be determined that the surface uniformity of the temperature measurement object is poor, the volatility of the infrared temperature measurement data is relatively high, and the credibility is relatively low.

[0099] In this case, there is no need to correct the visible light temperature measurement data based on the current infrared temperature measurement data. Instead, the visible light temperature measurement data of the temperature measurement object can be corrected based on the currently stored temperature measurement correction coefficient (such as the temperature measurement correction coefficient determined last time), and the corrected visible light temperature measurement data of the temperature measurement object can be used as the actual visible light temperature measurement data.

[0100] In order to enable those skilled in the art to better understand the technical solutions provided in the embodiments of the present application, the technical solutions provided in the embodiments of the present application are described below with reference to specific examples.

[0101] In this embodiment, for a device having both a visible light camera (such as a CCD or CMOS camera, used for array temperature measurement) and an infrared thermometer (used for single-point temperature measurement), the visible light camera and the infrared thermometer adopt a common optical path solution, and the temperature measurement area of ​​the infrared thermometer covers at least one visible light pixel. The schematic diagram can be as follows: Figure 2 shown.

[0102] like Figure 3 As shown, for the above equipment, the temperature measurement implementation process based on visible light is as follows:

[0103] 1. Obtain the response data of the visible light camera and calculate the temperature measurement data of the visible light camera.

[0104] 2. Calculate the discreteness of the visible light response data in the temperature measurement area of ​​the infrared thermometer.

[0105] For example, the degree of dispersion can be characterized by indicators such as range, interquartile range, mean deviation, variance, standard deviation, multivariate ratio or coefficient of dispersion.

[0106] 3. When the degree of dispersion is less than a preset threshold, the temperature measurement correction coefficient of the visible light camera (referred to as the temperature measurement correction coefficient) is calculated and updated based on the temperature measurement data of the infrared thermometer and the temperature measurement data of the visible light camera in the temperature measurement area of ​​the infrared thermometer. For example, the calculated temperature measurement correction coefficient is used as the latest temperature measurement correction coefficient to overwrite the currently stored temperature measurement correction coefficient. When the degree of dispersion is greater than or equal to the preset threshold, the temperature measurement correction coefficient is not updated.

[0107] 4. According to the current temperature measurement correction coefficient, the visible light temperature measurement data is corrected to obtain the corrected visible light temperature measurement data.

[0108] See also Figure 4 , is a flow chart of a temperature measurement method based on a visible light camera provided in an embodiment of the present application, wherein the temperature measurement method based on a visible light camera can be applied to the temperature measurement device based on a visible light camera in the above embodiment, such as a processor in the temperature measurement device based on a visible light camera, such as Figure 4 As shown, the temperature measurement method based on a visible light camera may include the following steps:

[0109] Step S400: Determine visible light temperature measurement data of the temperature measurement object according to the visible light response data of the temperature measurement object collected by the visible light camera.

[0110] Step S410: determine the discreteness of the visible light response data of the temperature measurement area of ​​the infrared thermometer.

[0111] In an embodiment of the present application, in order to improve the accuracy of temperature measurement based on a visible light camera, an infrared thermometer can be introduced into a temperature measurement device based on a visible light camera, and the temperature measurement data of the visible light camera (which can be called visible light temperature measurement data) can be corrected using the temperature measurement data of the infrared thermometer (which can be called infrared temperature measurement data).

[0112] However, considering that for objects with poor surface uniformity, the infrared temperature measurement data will have greater volatility and poor stability, accordingly, the credibility of the infrared temperature measurement data will be relatively low and the reference value will be relatively small. If the low-credibility infrared temperature measurement data is used to correct the visible light temperature measurement data, the accuracy of the visible light temperature measurement data may be reduced.

[0113] Therefore, in order to improve the accuracy of temperature measurement based on visible light cameras, before correcting the visible light temperature measurement data based on the infrared temperature measurement data, it is necessary to determine whether the infrared temperature measurement data is credible. If it is determined that the infrared temperature measurement data is credible, the visible light temperature measurement data is corrected based on the infrared temperature measurement data.

[0114] Exemplarily, the uniformity of the surface of the temperature measurement object (the surface of the temperature measurement object corresponding to the temperature measurement area of ​​the infrared thermometer) can be characterized by the degree of discreteness of the visible light response data of the temperature measurement area of ​​the infrared thermometer, and then the credibility of the infrared temperature measurement data can be determined.

[0115] Exemplarily, the degree of dispersion of the visible light response data of the temperature measurement area of ​​the infrared thermometer is negatively correlated with the credibility of the infrared temperature measurement data.

[0116] For example, the higher the degree of discreteness of the visible light response data in the temperature measurement area of ​​the infrared thermometer, the worse the surface uniformity of the temperature measurement object and the lower the credibility of the infrared temperature measurement data; the lower the degree of discreteness of the visible light response data in the temperature measurement area of ​​the infrared thermometer, the better the surface uniformity of the temperature measurement object and the higher the credibility of the infrared temperature measurement data.

[0117] Accordingly, in the embodiment of the present application, on the one hand, the visible light response data of the temperature measurement object can be collected by a visible light camera, and the visible light temperature measurement data of the temperature measurement object can be determined based on the visible light response data.

[0118] For example, the visible light response data represents the brightness or color information of each pixel in the image, which is obtained by converting light into electrical signals and digitizing them through the camera's sensor (such as CMOS or CCD sensor).

[0119] In one example, a machine learning method (such as linear regression, support vector machine, neural network, etc.) can be used to establish a relationship model between visible light response data and temperature data, and the known visible light response data and corresponding temperature data can be used to train the model. Thus, a relationship model for determining visible light temperature measurement data based on the visible light response data can be obtained. Furthermore, the trained relationship model can be used to determine the visible light temperature measurement data of the temperature measurement object with the visible light response data of the temperature measurement object as input.

[0120] On the other hand, the discreteness of the visible light response data of the temperature measurement area of ​​the infrared thermometer can be determined based on the visible light response data.

[0121] In one example, the degree of dispersion can be characterized by range, interquartile range, mean deviation, variance, standard deviation, multivariate ratio, or coefficient of dispersion.

[0122] Step S420: When the discreteness of the visible light response data of the temperature measurement area of ​​the infrared thermometer is less than a preset threshold, determine the temperature measurement correction coefficient based on the infrared temperature measurement data of the temperature measurement object obtained by the infrared thermometer and the visible light temperature measurement data of the temperature measurement area of ​​the infrared thermometer.

[0123] Step S430: correct the visible light temperature measurement data of the temperature measurement object according to the temperature measurement correction coefficient, and use the corrected visible light temperature measurement data of the temperature measurement object as the actual visible light temperature measurement data.

[0124] In an embodiment of the present application, when the discrete degree of the visible light response data of the temperature measurement area of ​​the infrared thermometer is determined, the discrete degree of the visible light response data of the temperature measurement area of ​​the infrared thermometer can be compared with a preset threshold (which can be set according to actual needs).

[0125] When the discrete degree of the visible light response data of the temperature measurement area of ​​the infrared thermometer is less than the preset threshold, it can be determined that the current infrared temperature measurement data is relatively reliable, and the visible light temperature measurement data can be corrected based on the current infrared temperature measurement data.

[0126] In this case, the temperature measurement correction coefficient can be determined based on the infrared temperature measurement data of the temperature measurement area of ​​the infrared thermometer and the visible light temperature measurement data of the temperature measurement area of ​​the infrared thermometer, and the visible light temperature measurement data of the temperature measurement object can be corrected based on the temperature measurement correction coefficient, and the corrected visible light temperature measurement data of the temperature measurement object can be used as the actual visible light temperature measurement data.

[0127] For example, the temperature measurement correction coefficient may be the difference between the visible light temperature measurement data to be corrected and the actual visible light temperature measurement data, and the correction of the visible light temperature measurement data may be achieved by adding the temperature measurement correction coefficient to the visible light temperature measurement data to be corrected; or, the temperature measurement correction coefficient may be the ratio between the visible light temperature measurement data to be corrected and the actual visible light temperature measurement data, and the correction of the visible light temperature measurement data may be achieved by dividing the visible light temperature measurement data to be corrected by the temperature measurement correction coefficient.

[0128] In some embodiments, the above-mentioned determination of the discrete degree of the visible light response data of the temperature measurement area of ​​the infrared thermometer may include:

[0129] Obtaining visible light response data of a designated channel of a temperature measurement area of ​​the infrared thermometer; wherein the designated channel includes at least one of an R channel, a G channel, and a B channel;

[0130] The discrete degree of the visible light response data of the temperature measurement area of ​​the infrared thermometer is determined according to the visible light response data of the designated channel of the temperature measurement area of ​​the infrared thermometer.

[0131] Exemplarily, a visible light pixel may include multiple channels.

[0132] For example, a visible light pixel may include M*N (eg, 2*2) channels, and each channel may be one of the R / G / B channels.

[0133] For example, for a 2*2 channel visible light pixel, its channels can be RGGB, RRGB or RGBB, etc.

[0134] Exemplarily, visible light response data of a specified channel of the temperature measurement area of ​​the infrared thermometer can be obtained, and the degree of discreteness of the visible light response data of the temperature measurement area of ​​the infrared thermometer can be determined based on the visible light response data of the specified channel of the temperature measurement area of ​​the infrared thermometer.

[0135] The designated channel includes at least one of an R channel, a G channel, and a B channel (which can be set according to actual needs). For example, the designated channel can include an R channel.

[0136] For example, taking the designated channel as the R channel, the visible light response data of the R channel of the temperature measurement area of ​​the infrared thermometer can be obtained, and the range of the visible light response data of the R channel of the temperature measurement area of ​​the infrared thermometer can be determined as the discrete degree of the visible light response data of the temperature measurement area of ​​the infrared thermometer.

[0137] For another example, taking the designated channel as channel G, the visible light response data of channel G of the temperature measurement area of ​​the infrared thermometer can be obtained, and the average difference of the visible light response data of channel G of the temperature measurement area of ​​the infrared thermometer can be determined as the discreteness of the visible light response data of the temperature measurement area of ​​the infrared thermometer.

[0138] In some embodiments, when the designated channel includes multiple channels among the R channel, the G channel, and the B channel, the above-mentioned determination of the discrete degree of the visible light response data of the temperature measurement area of ​​the infrared thermometer may include:

[0139] The discrete degree of the visible light response data of the temperature measurement area of ​​the infrared thermometer is determined according to the discrete degree of the visible light response data of each designated channel of the temperature measurement area of ​​the infrared thermometer and the discrete degree of the visible light response data of each designated channel of the temperature measurement area of ​​the infrared thermometer.

[0140] Exemplarily, in order to improve the accuracy of determining the discreteness of visible light response data, visible light response data of multiple channels may be selected for determining the discreteness.

[0141] When the designated channels include multiple channels among the R channel, the G channel and the B channel, the discrete degree of the visible light response data of each designated channel of the temperature measurement area of ​​the infrared thermometer can be determined respectively, and based on the discrete degree of the visible light response data of each designated channel of the temperature measurement area of ​​the infrared thermometer, the discrete degree of the visible light response data of the temperature measurement area of ​​the infrared thermometer can be determined.

[0142] For example, the maximum value or minimum value of the discreteness of the visible light response data of each designated channel of the temperature measurement area of ​​the infrared thermometer can be determined as the discreteness of the visible light response data of the temperature measurement area of ​​the infrared thermometer; or, the average value, variance or standard deviation of the discreteness of the visible light response data of each designated channel of the temperature measurement area of ​​the infrared thermometer can be determined as the discreteness of the visible light response data of the temperature measurement area of ​​the infrared thermometer.

[0143] For example, taking the designated channels including R channel and B channel as an example, the discrete degree of visible light response data of R channel of the temperature measurement area of ​​the infrared thermometer and the discrete degree of visible light response data of B channel of the temperature measurement area of ​​the infrared thermometer can be determined respectively, and the maximum value of the discrete degree of visible light response data of R channel and the discrete degree of visible light response data of B channel can be determined as the discrete degree of visible light response data of the temperature measurement area of ​​the infrared thermometer.

[0144] For another example, taking the designated channels including R channel, G channel and B channel as an example, the discrete degree of visible light response data of R channel of the temperature measurement area of ​​the infrared thermometer, the discrete degree of visible light response data of G channel of the temperature measurement area of ​​the infrared thermometer, and the discrete degree of visible light response data of B channel of the temperature measurement area of ​​the infrared thermometer can be determined respectively, and the average value of the discrete degree of visible light response data of R channel, the discrete degree of visible light response data of G channel, and the discrete degree of visible light response data of B channel can be determined as the discrete degree of visible light response data of the temperature measurement area of ​​the infrared thermometer.

[0145] In some embodiments, the above-mentioned determination of the temperature measurement correction coefficient based on the infrared temperature measurement data of the temperature measurement object acquired by the infrared thermometer and the visible light temperature measurement data of the temperature measurement area of ​​the infrared thermometer may include:

[0146] The infrared temperature measurement data of the temperature measurement area of ​​the infrared thermometer and the visible light temperature measurement data of the temperature measurement area of ​​the infrared thermometer are taken as input, and the temperature measurement correction coefficient is determined using a pre-constructed temperature measurement correction function.

[0147] Exemplarily, in order to improve the efficiency and accuracy of determining the temperature measurement correction coefficient, a function for determining the temperature measurement correction coefficient (which may be called a temperature measurement correction function) can be pre-constructed. The temperature measurement correction function can take the infrared temperature measurement data of the temperature measurement area of ​​the infrared thermometer and the visible light temperature measurement data of the temperature measurement area of ​​the infrared thermometer as input, and output the corresponding temperature measurement correction coefficient.

[0148] Accordingly, when it is determined that the discreteness of the visible light response data of the temperature measurement area of ​​the infrared thermometer is less than a preset threshold, the infrared temperature measurement data of the temperature measurement area of ​​the infrared thermometer and the visible light temperature measurement data of the temperature measurement area of ​​the infrared thermometer can be used as input, and a pre-constructed temperature measurement correction function can be used to determine the temperature measurement correction coefficient.

[0149] In some embodiments, the above-mentioned determination of the temperature measurement correction coefficient based on the infrared temperature measurement data of the temperature measurement object acquired by the infrared thermometer and the visible light temperature measurement data of the temperature measurement area of ​​the infrared thermometer may include:

[0150] Determine the average value of the visible light temperature measurement data in the temperature measurement area of ​​the infrared thermometer, and determine the difference between the average value and the infrared temperature measurement data in the temperature measurement area of ​​the infrared thermometer, and determine the temperature measurement correction coefficient based on the difference.

[0151] Exemplarily, in order to reduce the complexity of determining the temperature measurement correction coefficient, the temperature measurement correction coefficient may be determined based on the difference between the average value of the visible light temperature measurement data and the infrared temperature measurement data in the temperature measurement area of ​​the infrared thermometer.

[0152] Accordingly, when it is determined that the discreteness of the visible light response data of the temperature measurement area of ​​the infrared thermometer is less than a preset threshold, the average value of the visible light temperature measurement data of the temperature measurement area of ​​the infrared thermometer can be determined, and the difference between the average value and the infrared temperature measurement data of the temperature measurement area of ​​the infrared thermometer can be determined, and the temperature measurement correction coefficient can be determined based on the difference.

[0153] For example, assuming that the average value of the visible light temperature measurement data in the temperature measurement area of ​​the infrared thermometer is T1, and the infrared temperature measurement data in the temperature measurement area of ​​the infrared thermometer is T2, ΔT (ΔT=T2-T1) can be determined as the temperature measurement correction coefficient, and ΔT can be added to the visible light temperature measurement data of the temperature measurement object to correct the visible light temperature measurement data of the temperature measurement object, and the corrected visible light temperature measurement data of the temperature measurement object is used as the actual visible light temperature measurement data.

[0154] In some embodiments, the above-mentioned determination of the temperature measurement correction coefficient based on the infrared temperature measurement data of the temperature measurement object acquired by the infrared thermometer and the visible light temperature measurement data of the temperature measurement area of ​​the infrared thermometer may include:

[0155] Determine the average value of the visible light temperature measurement data in the temperature measurement area of ​​the infrared thermometer, and determine the ratio of the average value to the infrared temperature measurement data in the temperature measurement area of ​​the infrared thermometer, and determine the temperature measurement correction coefficient based on the ratio.

[0156] Exemplarily, in order to reduce the complexity of determining the temperature measurement correction coefficient, the temperature measurement correction coefficient may be determined based on the ratio of the average value of the visible light temperature measurement data to the infrared temperature measurement data in the temperature measurement area of ​​the infrared thermometer.

[0157] Accordingly, when it is determined that the discreteness of the visible light response data of the temperature measurement area of ​​the infrared thermometer is less than a preset threshold, the average value of the visible light temperature measurement data of the temperature measurement area of ​​the infrared thermometer can be determined, and the ratio of the average value to the infrared temperature measurement data of the temperature measurement area of ​​the infrared thermometer can be determined, and the temperature measurement correction coefficient can be determined based on the ratio.

[0158] For example, assuming that the average value of the visible light temperature measurement data in the temperature measurement area of ​​the infrared thermometer is T1, and the infrared temperature measurement data in the temperature measurement area of ​​the infrared thermometer is T2, then T R (T R =T1 / T2) is determined as the temperature measurement correction coefficient, and is divided by T based on the visible light temperature measurement data of the temperature measurement object. R , to correct the visible light temperature measurement data of the temperature measurement object, and use the corrected visible light temperature measurement data of the temperature measurement object as the actual visible light temperature measurement data.

[0159] In some embodiments, after determining the temperature measurement correction coefficient based on the infrared temperature measurement data of the temperature measurement area of ​​the infrared thermometer and the visible light temperature measurement data of the temperature measurement area of ​​the infrared thermometer, the following steps may also be performed:

[0160] The currently stored temperature measurement correction coefficient is updated according to the determined temperature measurement correction coefficient; wherein the initial value of the currently stored temperature measurement correction coefficient is a default value.

[0161] The temperature measurement solution based on a visible light camera provided in the embodiment of the present application may also include:

[0162] When the discrete degree of the visible light response data of the temperature measurement area of ​​the infrared thermometer is greater than or equal to the preset threshold, the visible light temperature measurement data of the temperature measurement object is corrected according to the currently stored temperature measurement correction coefficient, and the corrected visible light temperature measurement data of the temperature measurement object is used as the actual visible light temperature measurement data.

[0163] Exemplarily, when the temperature measurement correction coefficient is determined as described above, the currently stored temperature measurement correction coefficient may be updated according to the determined temperature measurement correction coefficient, for example, the currently stored temperature measurement correction coefficient may be replaced with the determined temperature measurement correction coefficient.

[0164] Exemplarily, the initial value of the currently stored temperature measurement correction coefficient is a default value.

[0165] In one example, the corrected visible light temperature measurement data obtained by correcting the visible light temperature measurement data using the default temperature measurement correction coefficient (ie, the initial temperature measurement correction coefficient) is the same as the visible light temperature measurement data before correction.

[0166] For example, when the degree of discreteness of the visible light response data in the temperature measurement area of ​​the infrared thermometer is greater than or equal to a preset threshold, it can be determined that the surface uniformity of the temperature measurement object is poor, the volatility of the infrared temperature measurement data is relatively high, and the credibility is relatively low.

[0167] In this case, there is no need to correct the visible light temperature measurement data based on the current infrared temperature measurement data. Instead, the visible light temperature measurement data of the temperature measurement object can be corrected based on the currently stored temperature measurement correction coefficient (such as the temperature measurement correction coefficient determined last time), and the corrected visible light temperature measurement data of the temperature measurement object can be used as the actual visible light temperature measurement data.

[0168] See also Figure 5 The present application also provides a temperature measurement device based on a visible light camera, such as Figure 5 As shown, the temperature measuring device based on the visible light camera may include:

[0169] A first determining unit, configured to determine visible light temperature measurement data of the temperature measurement object according to the visible light response data of the temperature measurement object collected by the visible light camera;

[0170] A second determining unit is used to determine the discrete degree of visible light response data of the temperature measurement area of ​​the infrared thermometer;

[0171] A third determining unit is used to determine a temperature measurement correction coefficient based on the infrared temperature measurement data of the temperature measurement object acquired by the infrared thermometer and the visible light temperature measurement data of the temperature measurement area of ​​the infrared thermometer when the discreteness of the visible light response data of the temperature measurement area of ​​the infrared thermometer is less than a preset threshold;

[0172] The correction unit is used to correct the visible light temperature measurement data of the temperature measurement object according to the temperature measurement correction coefficient, and use the corrected visible light temperature measurement data of the temperature measurement object as the actual visible light temperature measurement data.

[0173] In some embodiments, the third determination unit determines the discrete degree of the visible light response data of the temperature measurement area of ​​the infrared thermometer, including:

[0174] Obtaining visible light response data of a designated channel of a temperature measurement area of ​​the infrared thermometer; wherein the designated channel includes at least one of an R channel, a G channel, and a B channel;

[0175] Determining the discreteness of the visible light response data of the temperature measurement area of ​​the infrared thermometer according to the visible light response data of the designated channel of the temperature measurement area of ​​the infrared thermometer;

[0176] The degree of dispersion is characterized by range, interquartile range, mean deviation, variance, standard deviation, multivariate ratio or coefficient of dispersion.

[0177] In some embodiments, when the designated channel includes multiple channels among the R channel, the G channel, and the B channel, the third determination unit determines the discrete degree of the visible light response data of the temperature measurement area of ​​the infrared thermometer, including:

[0178] The discrete degree of the visible light response data of the temperature measurement area of ​​the infrared thermometer is determined according to the discrete degree of the visible light response data of each designated channel of the temperature measurement area of ​​the infrared thermometer and the discrete degree of the visible light response data of each designated channel of the temperature measurement area of ​​the infrared thermometer.

[0179] In some embodiments, the third determination unit determines the temperature measurement correction coefficient according to the infrared temperature measurement data of the temperature measurement object acquired by the infrared thermometer and the visible light temperature measurement data of the temperature measurement area of ​​the infrared thermometer, including:

[0180] Taking the infrared temperature measurement data of the temperature measurement area of ​​the infrared thermometer and the visible light temperature measurement data of the temperature measurement area of ​​the infrared thermometer as input, and using a pre-constructed temperature measurement correction function, determine a temperature measurement correction coefficient;

[0181] or,

[0182] Determine an average value of visible light temperature measurement data of the temperature measurement area of ​​the infrared thermometer, and determine a difference between the average value and the infrared temperature measurement data of the temperature measurement area of ​​the infrared thermometer, and determine a temperature measurement correction coefficient based on the difference;

[0183] or,

[0184] The average value of the visible light temperature measurement data of the temperature measurement area of ​​the infrared thermometer is determined, and the ratio of the average value to the infrared temperature measurement data of the temperature measurement area of ​​the infrared thermometer is determined, and the temperature measurement correction coefficient is determined according to the ratio.

[0185] In some embodiments, after the third determination unit determines the temperature measurement correction coefficient based on the infrared temperature measurement data of the temperature measurement area of ​​the infrared thermometer and the visible light temperature measurement data of the temperature measurement area of ​​the infrared thermometer, it further includes:

[0186] Updating the currently stored temperature measurement correction coefficient according to the determined temperature measurement correction coefficient; wherein the initial value of the currently stored temperature measurement correction coefficient is a default value;

[0187] The correction unit is also used to correct the visible light temperature measurement data of the temperature measurement object according to the currently stored temperature measurement correction coefficient when the discrete degree of the visible light response data of the temperature measurement area of ​​the infrared thermometer is greater than or equal to a preset threshold, and use the corrected visible light temperature measurement data of the temperature measurement object as the actual visible light temperature measurement data.

[0188] An embodiment of the present application provides an electronic device, including a processor and a memory, wherein the memory stores machine executable instructions that can be executed by the processor, and the processor is used to execute the machine executable instructions to implement the temperature measurement method based on a visible light camera described above.

[0189] See also Figure 6 , is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application. The electronic device may include a processor 601 and a memory 602 storing machine executable instructions. The processor 601 and the memory 602 may communicate via a system bus 603. In addition, by reading and executing the machine executable instructions corresponding to the temperature measurement logic based on the visible light camera in the memory 602, the processor 601 may execute the temperature measurement method based on the visible light camera described above.

[0190] The memory 602 mentioned herein may be any electronic, magnetic, optical or other physical storage device that may contain or store information, such as executable instructions, data, etc. For example, the machine-readable storage medium may be: RAM (RadomAccess Memory, random access memory), volatile memory, non-volatile memory, flash memory, storage drive (such as hard disk drive), solid state drive, any type of storage disk (such as optical disk, DVD, etc.), or similar storage medium, or a combination thereof.

[0191] In some embodiments, a storage medium is also provided, such as Figure 6 The memory 602 in the memory 602 is a machine-readable storage medium, and the storage medium stores machine-executable instructions. When the machine-executable instructions are executed by the processor, the temperature measurement method based on the visible light camera described above is implemented. For example, the storage medium can be ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.

Claims

1. A temperature measurement device based on a visible light camera, characterized in that: include: A visible light camera, an infrared thermometer and a processor; the visible light camera and the infrared thermometer share an optical path, and the temperature measurement area of ​​the infrared thermometer covers n visible light pixels, n≥1; wherein: The visible light camera is used to collect visible light response data of the temperature measurement object; The infrared thermometer is used to perform infrared temperature measurement on a temperature measurement object to obtain infrared temperature measurement data of the temperature measurement object; The processor is used to determine the visible light temperature measurement data of the temperature measurement object according to the visible light response data; The processor is further used to determine the degree of discreteness of the visible light response data of the temperature measurement area of ​​the infrared thermometer; when the degree of discreteness of the visible light response data of the temperature measurement area of ​​the infrared thermometer is less than a preset threshold, a temperature measurement correction coefficient is determined based on the infrared temperature measurement data of the temperature measurement area of ​​the infrared thermometer and the visible light temperature measurement data of the temperature measurement area of ​​the infrared thermometer, and the visible light temperature measurement data of the temperature measurement object is corrected based on the temperature measurement correction coefficient, and the corrected visible light temperature measurement data of the temperature measurement object is used as the actual visible light temperature measurement data.

2. The temperature measuring device based on a visible light camera according to claim 1, characterized in that: The processor is specifically used to obtain visible light response data of a designated channel of the temperature measurement area of ​​the infrared thermometer; wherein the designated channel includes at least one of an R channel, a G channel, and a B channel; and determine a discrete degree of the visible light response data of the temperature measurement area of ​​the infrared thermometer according to the visible light response data of the designated channel of the temperature measurement area of ​​the infrared thermometer; The degree of dispersion is characterized by range, interquartile range, mean deviation, variance, standard deviation, multivariate ratio or coefficient of dispersion.

3. The temperature measuring device based on a visible light camera according to claim 2, characterized in that: The designated channels include multiple channels among the R channel, the G channel and the B channel; The processor is specifically used to respectively determine the discrete degree of the visible light response data of each designated channel of the temperature measurement area of ​​the infrared thermometer, and determine the discrete degree of the visible light response data of the temperature measurement area of ​​the infrared thermometer based on the discrete degree of the visible light response data of each designated channel of the temperature measurement area of ​​the infrared thermometer.

4. The temperature measuring device based on a visible light camera according to claim 1, characterized in that: The processor is specifically used to use the infrared temperature measurement data of the temperature measurement area of ​​the infrared thermometer and the visible light temperature measurement data of the temperature measurement area of ​​the infrared thermometer as input, and use a pre-constructed temperature measurement correction function to determine the temperature measurement correction coefficient; or, The processor is specifically used to determine the average value of the visible light temperature measurement data of the temperature measurement area of ​​the infrared thermometer, and determine the difference between the average value and the infrared temperature measurement data of the temperature measurement area of ​​the infrared thermometer, and determine the temperature measurement correction coefficient according to the difference; or, The processor is specifically used to determine the average value of the visible light temperature measurement data of the temperature measurement area of ​​the infrared thermometer, and determine the ratio of the average value to the infrared temperature measurement data of the temperature measurement area of ​​the infrared thermometer, and determine the temperature measurement correction coefficient based on the ratio.

5. The temperature measuring device based on a visible light camera according to claim 1, characterized in that: The processor is further configured to update the currently stored temperature measurement correction coefficient according to the determined temperature measurement correction coefficient when the discrete degree of the visible light response data of the temperature measurement area of ​​the infrared thermometer is less than a preset threshold value; wherein the initial value of the currently stored temperature measurement correction coefficient is a default value; The processor is also used to correct the visible light temperature measurement data of the temperature measurement object according to the currently stored temperature measurement correction coefficient when the discrete degree of the visible light response data of the temperature measurement area of ​​the infrared thermometer is greater than or equal to a preset threshold, and use the corrected visible light temperature measurement data of the temperature measurement object as the actual visible light temperature measurement data.

6. A temperature measurement method based on a visible light camera, characterized in that: Applicable to a temperature measurement device based on a visible light camera, the temperature measurement device based on a visible light camera comprises a visible light camera, an infrared thermometer and a processor; the visible light camera and the infrared thermometer share an optical path, and the temperature measurement area of ​​the infrared thermometer covers n visible light pixels, n≥1; the method comprises: Determining visible light temperature measurement data of the temperature measurement object according to the visible light response data of the temperature measurement object collected by the visible light camera; Determine the discrete degree of visible light response data of the temperature measurement area of ​​the infrared thermometer; When the discreteness of the visible light response data of the temperature measurement area of ​​the infrared thermometer is less than a preset threshold, determining a temperature measurement correction coefficient according to the infrared temperature measurement data of the temperature measurement object acquired by the infrared thermometer and the visible light temperature measurement data of the temperature measurement area of ​​the infrared thermometer; The visible light temperature measurement data of the temperature measurement object is corrected according to the temperature measurement correction coefficient, and the corrected visible light temperature measurement data of the temperature measurement object is used as the actual visible light temperature measurement data.

7. The method according to claim 6, characterized in that Determining the discrete degree of visible light response data of the temperature measurement area of ​​the infrared thermometer includes: Obtaining visible light response data of a designated channel of a temperature measurement area of ​​the infrared thermometer; wherein the designated channel includes at least one of an R channel, a G channel, and a B channel; Determining the discreteness of the visible light response data of the temperature measurement area of ​​the infrared thermometer according to the visible light response data of the designated channel of the temperature measurement area of ​​the infrared thermometer; The degree of dispersion is characterized by range, interquartile range, mean deviation, variance, standard deviation, heterogeneity ratio or coefficient of dispersion; Wherein, in the case where the designated channel includes multiple channels among the R channel, the G channel and the B channel, determining the discrete degree of the visible light response data of the temperature measurement area of ​​the infrared thermometer includes: The discrete degree of the visible light response data of the temperature measurement area of ​​the infrared thermometer is determined according to the discrete degree of the visible light response data of each designated channel of the temperature measurement area of ​​the infrared thermometer and the discrete degree of the visible light response data of each designated channel of the temperature measurement area of ​​the infrared thermometer.

8. The method according to claim 6, characterized in that The method of determining the temperature measurement correction coefficient based on the infrared temperature measurement data of the temperature measurement object acquired by the infrared thermometer and the visible light temperature measurement data of the temperature measurement area of ​​the infrared thermometer includes: Taking the infrared temperature measurement data of the temperature measurement area of ​​the infrared thermometer and the visible light temperature measurement data of the temperature measurement area of ​​the infrared thermometer as input, and using a pre-constructed temperature measurement correction function, determine a temperature measurement correction coefficient; or, Determine an average value of visible light temperature measurement data of the temperature measurement area of ​​the infrared thermometer, and determine a difference between the average value and the infrared temperature measurement data of the temperature measurement area of ​​the infrared thermometer, and determine a temperature measurement correction coefficient based on the difference; or, The average value of the visible light temperature measurement data of the temperature measurement area of ​​the infrared thermometer is determined, and the ratio of the average value to the infrared temperature measurement data of the temperature measurement area of ​​the infrared thermometer is determined, and the temperature measurement correction coefficient is determined according to the ratio.

9. The method according to claim 6, characterized in that After determining the temperature measurement correction coefficient based on the infrared temperature measurement data of the temperature measurement area of ​​the infrared thermometer and the visible light temperature measurement data of the temperature measurement area of ​​the infrared thermometer, the method further includes: Updating the currently stored temperature measurement correction coefficient according to the determined temperature measurement correction coefficient; wherein the initial value of the currently stored temperature measurement correction coefficient is a default value; The method further comprises: When the discrete degree of the visible light response data of the temperature measurement area of ​​the infrared thermometer is greater than or equal to a preset threshold, the visible light temperature measurement data of the temperature measurement object is corrected according to the currently stored temperature measurement correction coefficient, and the corrected visible light temperature measurement data of the temperature measurement object is used as the actual visible light temperature measurement data.

10. An electronic device, characterized in that: The method comprises a processor and a memory, wherein the memory stores machine executable instructions that can be executed by the processor, and the processor is used to execute the machine executable instructions to implement the method according to any one of claims 6 to 9.

11. A machine-readable storage medium, characterized in that: The machine-readable storage medium stores machine-executable instructions, and when the machine-executable instructions are executed by a processor, the method according to any one of claims 6 to 9 is implemented.

Images