A high temperature early warning method and movable device

Abstract

The present invention discloses a high temperature early warning method and a mobile device, which determines whether there is a possibility of fire in the surrounding environment by acquiring a current frame thermal imaging image, and determines the comprehensive danger value of the object by the maximum temperature and the area of ​​the maximum temperature of the object different from the ambient temperature, so as to reflect the degree of danger of the surrounding environment. When the comprehensive danger value is greater than the preset comprehensive danger value, the alarm module is controlled to sound an alarm. Early warning can be performed before the fire is large and produces a lot of smoke, which improves safety and leaves users with sufficient time to deal with danger and escape time. Controlling the alarm module to sound an alarm helps users to understand the danger in a timely manner through the alarm of the alarm module.

Description

Technical Field

[0001] The present invention relates to the field of fire safety, and in particular to a high temperature early warning method and a movable device. Background Art

[0002] With the development of society, people have more and more household appliances in their homes, and safety hazards are also increasing. In life, fires may be caused by various reasons such as aging of home wiring, so fire warning is very important. The existing technology uses smoke alarms to alarm and warn when a large amount of smoke is generated due to a fire. However, when smoke is generated, the fire is often large and difficult to control, which does not leave people enough time to deal with danger and escape. Summary of the invention

[0003] The purpose of the present invention is to provide a high temperature early warning method and a movable device. Early warning can be given before a fire is large and produces a lot of smoke, which improves safety and leaves users with sufficient time to deal with danger and escape. Controlling the alarm module to issue an alarm helps users to understand the danger in a timely manner through the alarm module's alarm.

[0004] In order to solve the above technical problems, the present invention provides a high temperature early warning method, comprising:

[0005] Acquire a current frame thermal imaging image of the environment, and determine an object with a temperature different from that of the environment according to a temperature distribution in the current frame thermal imaging image;

[0006] determining a maximum temperature and an area of ​​the maximum temperature of the object;

[0007] Determining a comprehensive risk value of the object according to the maximum temperature and the area of ​​the maximum temperature, wherein the comprehensive risk value is positively correlated with both the maximum temperature and the area of ​​the maximum temperature;

[0008] If the comprehensive risk value is greater than the preset comprehensive risk value, the control alarm module will alarm.

[0009] Preferably, it also includes:

[0010] If the highest temperature of the object is greater than a preset temperature threshold and the comprehensive danger value of the object is not greater than the preset comprehensive danger value, an early warning prompt is issued.

[0011] Preferably, if the highest temperature of the object is greater than a preset temperature threshold and the comprehensive risk value of the object is not greater than the preset comprehensive risk value, the method further includes:

[0012] determining a temperature profile of the object;

[0013] determining whether the temperature profile of the object is complete;

[0014] If yes, proceed to the step of issuing an early warning prompt;

[0015] If not, the user is prompted that some hidden dangers cannot be predicted.

[0016] Preferably, determining whether the temperature profile of the object is complete includes:

[0017] Determining whether the temperature profile of the object is a closed figure;

[0018] If so, determining that the temperature profile of the object is complete;

[0019] If not, it is determined that the temperature profile of the object is incomplete.

[0020] Preferably, determining the area of ​​the object with the highest temperature comprises:

[0021] determining a temperature profile of the object;

[0022] determining a profile of a maximum temperature of the object from a temperature profile of the object;

[0023] The area of ​​the contour of the highest temperature of the object is calculated to obtain the area of ​​the highest temperature.

[0024] Preferably, after obtaining the current frame thermal imaging image of the environment, the method further includes:

[0025] Determine whether the current working mode is fire warning mode or body temperature measurement mode;

[0026] If it is the fire warning mode, then entering the step of determining the maximum temperature of the object and the area of ​​the maximum temperature;

[0027] If it is the body temperature measurement mode, the maximum temperature of the object is determined, and the health status of the body temperature of the object is judged based on the preset biological health temperature range selected by the user and the maximum temperature.

[0028] Preferably, controlling the alarm module to alarm includes:

[0029] The control alarm module alarms, and the frequency of the alarm is positively correlated with the comprehensive risk value.

[0030] Preferably, after obtaining the current frame thermal imaging image of the environment, the method further includes:

[0031] Determine whether there is a reference frame image;

[0032] If not, taking the current frame thermal imaging image as a new reference frame image and entering the step of determining an object with a temperature different from the ambient temperature according to the temperature distribution in the current frame thermal imaging image;

[0033] If so, determining whether the change between the current frame thermal imaging image and the reference frame image is greater than a preset threshold;

[0034] If it is greater than the preset threshold, the current frame thermal imaging image is used as a new reference frame image and the step of determining an object with a temperature different from the ambient temperature according to the temperature distribution in the current frame thermal imaging image is entered;

[0035] If it is not greater than the preset threshold, return to the step of acquiring the current frame thermal imaging image of the environment;

[0036] Determining an object with a temperature different from that of the environment according to the temperature distribution in the current frame of the thermal imaging image comprises:

[0037] An object having a temperature different from that of the environment is determined according to the temperature distribution in the new reference frame image.

[0038] Preferably, after determining the object having a temperature different from the ambient temperature according to the temperature distribution in the new reference frame image, the method further includes:

[0039] Determining feature points of an object having a different temperature from the ambient temperature in the new reference frame image;

[0040] After determining the comprehensive risk value of the object according to the maximum temperature and the area of ​​the maximum temperature, the method further includes:

[0041] By comparing the feature points of the determined object with the feature points of objects in the database, it is determined whether the determined object already exists in the database or whether it is a newly added object;

[0042] If the determined object already exists in the database, updating the characteristic points and the comprehensive risk value of the object existing in the database;

[0043] If the determined object is a newly added object, the feature points and the comprehensive risk value of the newly added object are added to the database;

[0044] sorting the comprehensive risk values ​​of all objects in the database according to the size of the comprehensive risk values;

[0045] Control alarm module alarm, including:

[0046] Controlling the alarm module to prompt and alarm the feature points of the object with the largest comprehensive risk value;

[0047] When the maximum comprehensive risk value prompt end condition is met, the feature points and comprehensive risk value of the object with the largest comprehensive risk value in the database are deleted, and the step of sorting the comprehensive risk values ​​of all objects in the database according to the size of the comprehensive risk value is returned until there is no comprehensive risk value in the database that is greater than the preset comprehensive risk value.

[0048] The present invention also provides a movable device, comprising:

[0049] A thermal imaging module, used to photograph the environment around the movable device to obtain a thermal imaging image;

[0050] Memory for storing computer programs;

[0051] A processor is used to implement the steps of the high temperature warning method as described above when executing the computer program.

[0052] The present invention provides a high temperature early warning method and a mobile device, which determines whether there is a possibility of fire in the surrounding environment by acquiring the current frame thermal imaging image, and determines the comprehensive danger value of the object by the maximum temperature and the area of ​​the maximum temperature of the object different from the ambient temperature, so as to reflect the degree of danger of the surrounding environment. When the comprehensive danger value is greater than the preset comprehensive danger value, the alarm module is controlled to sound an alarm. Early warning can be performed before the fire is large and produces a lot of smoke, which improves safety and leaves users with sufficient time to deal with danger and escape time. Controlling the alarm module to sound an alarm helps users to understand the danger in time through the alarm of the alarm module. BRIEF DESCRIPTION OF THE DRAWINGS

[0053] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the prior art and the drawings required for use in the embodiments are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0054] Figure 1 A flow chart of a high temperature early warning method provided by the present invention;

[0055] Figure 2 A schematic diagram of a scene captured by a thermal imaging image;

[0056] Figure 3 A schematic diagram of another scene captured by a thermal imaging image;

[0057] Figure 4 A schematic diagram of another scene captured by a thermal imaging image;

[0058] Figure 5a A schematic diagram of a scenario in which the high temperature warning method provided by the present invention is applied to a movable device;

[0059] Figure 5b A schematic diagram of another scenario when the high temperature warning method provided by the present invention is applied to a movable device;

[0060] Figure 6 A schematic structural diagram of a movable device provided by the present invention. DETAILED DESCRIPTION

[0061] The core of the present invention is to provide a high temperature early warning method and a movable device. Early warning can be given before the fire is large and produces a lot of smoke, which improves safety and leaves users with sufficient time to deal with danger and escape. Controlling the alarm module to issue an alarm helps users to understand the danger in time through the alarm module's alarm.

[0062] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0063] Please refer to Figure 1 , Figure 1 The present invention provides a flowchart of a high temperature early warning method.

[0064] The high temperature early warning method includes:

[0065] S11: Acquire a current frame thermal imaging image of the environment, and determine an object with a temperature different from that of the environment according to the temperature distribution in the current frame thermal imaging image;

[0066] Considering that when smoke alarms are used for fire warning, the fire is often difficult to control and a large amount of smoke is generated when the alarm is generated, which does not leave the user with sufficient time to respond. In order to solve the above problems, in this embodiment, thermal imaging images are used to detect the surrounding environment, and objects with different temperatures from the ambient temperature are determined based on the temperature distribution in the current frame of thermal imaging images. Compared with smoke alarms, thermal imaging images have a stronger ability to detect the ambient temperature and a longer range. In addition, since the temperature of the surrounding environment is directly monitored, the occurrence of danger can be detected before the fire occurs or smoke is generated. The current frame of thermal imaging images here can be acquired periodically or in real time, and this embodiment does not make any special restrictions here.

[0067] In addition, when determining an object with a temperature different from the ambient temperature based on the temperature distribution in the current frame thermal imaging image, the current frame thermal imaging image can be enhanced using a multi-scale retinex algorithm, and the enhanced current frame thermal imaging image can be segmented using a histogram method to obtain an object with a temperature different from the ambient temperature. This implementation is not particularly limited here.

[0068] S12: Determine the maximum temperature of the object and the area of ​​the maximum temperature;

[0069] Considering that only using thermal imaging images to determine the highest temperature of an object that is different from the ambient temperature to reflect the danger level of the object and determine whether an alarm is needed is less safe in some cases. For example, some objects whose temperatures do not reach the threshold that requires an alarm but whose highest temperature area is large may also be dangerous. For details, please refer to Figure 2 and Figure 3 , Figure 2 Schematic diagram of the scene captured by the thermal imaging image. Figure 3 This is a schematic diagram of another scene captured by a thermal imaging image. Figure 3 The area of ​​the highest temperature of the candle flame is compared to Figure 2 Although the maximum temperature does not increase, the increase in the area of ​​the maximum temperature increases the possibility of fire, and it is necessary to warn the user. Therefore, in this embodiment, the maximum temperature and the area of ​​the maximum temperature of the object are determined, so that the danger level of the object can be comprehensively judged by the maximum temperature and the area of ​​the maximum temperature of the object.

[0070] It should be noted that, considering that different colors are displayed for different temperatures in thermal imaging images, when the temperatures at different locations of an object are different, the colors of the object at different locations in the thermal imaging image are also different. However, when the temperatures are similar, the colors are also similar. Based on this imaging principle and image recognition principle, when the temperatures in a thermal imaging image are not much different, for example, the temperature difference is within 2 degrees Celsius, the colors in the thermal imaging image are almost the same. Based on this, when determining the area of ​​the highest temperature of an object in a thermal imaging image, the area of ​​the highest temperature that is usually identified is the area of ​​the highest temperature and the temperature that is not much different from the highest temperature, and the area of ​​this area is the area of ​​the highest temperature.

[0071] It should also be noted that in addition to comprehensively judging the degree of danger of an object by the area of ​​the object's highest temperature and the highest temperature, the degree of danger of an object can also be comprehensively judged by the ratio of the area of ​​the object's highest temperature to the area of ​​the scene where the object is located in the current frame of the thermal imaging image and the highest temperature of the object. This embodiment is not particularly limited here.

[0072] S13: determining the comprehensive hazard value of the object according to the maximum temperature and the area of ​​the maximum temperature, wherein the comprehensive hazard value is positively correlated with the maximum temperature and the area of ​​the maximum temperature;

[0073] In order to comprehensively judge the danger level of the object by using the maximum temperature of the object and the area of ​​the maximum temperature, in this embodiment, the comprehensive danger value of the object is determined according to the maximum temperature of the object and the area of ​​the maximum temperature of the object, and the greater the maximum temperature of the object or the greater the area of ​​the maximum temperature of the object, the greater the total danger value of the object. By setting the comprehensive danger value, the danger level of the environment is linked to the maximum temperature of the object and the area of ​​the maximum temperature, which intuitively reflects the danger level of the environment. Here, the corresponding relationship between the comprehensive danger value and the maximum temperature of the object and the area of ​​the maximum temperature of the object can be, but is not limited to, comprehensive danger value = a*the area of ​​the maximum temperature of the object+b*the maximum temperature of the object, where a and b are coefficients greater than 0, as long as the comprehensive danger value is positively correlated with the maximum temperature and the area of ​​the maximum temperature.

[0074] S14: If the comprehensive hazard value is greater than the preset comprehensive hazard value, the control alarm module alarms.

[0075] In order to warn the user when a fire may occur in an object in the environment, so that the user can timely understand the dangerous situation of the surrounding environment, in this embodiment, when the comprehensive danger value of the object is greater than the preset comprehensive danger value, it means that the object is likely to have a fire and it is necessary to warn the user, so the alarm module is controlled to alarm. The alarm module here can be a buzzer or an alarm light, which is not particularly limited in this embodiment.

[0076] In summary, in this embodiment, the current frame thermal imaging image is obtained to determine whether there is a possibility of fire in the surrounding environment, and the object's comprehensive danger value is determined by the object's maximum temperature and the area of ​​the maximum temperature that are different from the ambient temperature, so as to reflect the degree of danger in the surrounding environment. When the comprehensive danger value is greater than the preset comprehensive danger value, the alarm module is controlled to sound an alarm. Early warning can be given before the fire is large and produces a lot of smoke, which improves safety, leaves users with sufficient time to deal with danger and escape time, and helps users to understand the danger in time and respond through the alarm of the alarm module.

[0077] Based on the above embodiments:

[0078] As a preferred embodiment, it also includes:

[0079] If the highest temperature of the object is greater than the preset temperature threshold and the comprehensive hazard value of the object is not greater than the preset comprehensive hazard value, an early warning prompt is issued.

[0080] Considering that for some objects with a high maximum temperature but a small area of ​​the maximum temperature, although the comprehensive hazard value is lower than the preset comprehensive hazard value, there is still a hidden danger of fire danger, and the user needs to be reminded. Therefore, in this embodiment. When the maximum temperature of the object is greater than the preset temperature threshold and the comprehensive hazard value of the object is not greater than the preset comprehensive hazard value, an early warning prompt will be issued to the user. The early warning prompt here can be, but is not limited to, prompting the user through a visualization module, such as a computer pop-up window. The comprehensiveness of the hazard judgment is improved, and the personal and property safety of the user is further protected.

[0081] As a preferred embodiment, if the highest temperature of the object is greater than a preset temperature threshold and the comprehensive risk value of the object is not greater than a preset comprehensive risk value, the method further includes:

[0082] determining the temperature profile of an object;

[0083] Determine whether the temperature profile of the object is complete;

[0084] If yes, proceed to the step of issuing an early warning prompt;

[0085] If not, the user is prompted that some hidden dangers cannot be predicted.

[0086] Considering that the images captured by the thermal imaging image are limited, if the outline of the object captured in the thermal imaging image is incomplete, the degree of danger of the part of the object not captured by the thermal imaging image cannot be judged. For example, the actual comprehensive danger value of the object reaches the preset comprehensive danger value, which may cause a fire. However, due to the incomplete outline of the object in the thermal imaging image, the comprehensive danger value of the object obtained is only the comprehensive danger value of the part of the object captured by the thermal imaging image, which leads to a misjudgment of the danger. Therefore, in this embodiment, when the highest temperature of the object is greater than the preset temperature threshold and the comprehensive danger value of the object is not greater than the preset comprehensive danger value, the temperature contour of the object is first determined, and then it is determined whether the temperature contour of the object is complete. If the temperature contour of the object is complete, it means that the comprehensive danger value of the object is the actual comprehensive danger value of the object, and the step of issuing an early warning prompt is entered. If the temperature contour of the object is incomplete, it means that the comprehensive danger value of the object is only the comprehensive danger value of the part of the object captured by the thermal imaging image. The comprehensive danger value of the object as a whole may reach the preset comprehensive danger value, and there is a risk of fire. Therefore, the user will be prompted that some hidden dangers cannot be predicted. Here, when the user is prompted that some hidden dangers cannot be predicted, it can also be prompted to the user through a visualization module, such as a pop-up window on a computer, but not limited to.

[0087] In summary, in this embodiment, by judging whether the temperature profile of the object is complete and indicating that some hidden dangers cannot be predicted when the temperature profile is incomplete, the safety of the user is further guaranteed.

[0088] As a preferred embodiment, judging whether the temperature profile of the object is complete includes:

[0089] Determine whether the temperature contour of the object is a closed figure;

[0090] If so, the temperature profile of the object is determined to be complete;

[0091] If not, it is determined that the temperature profile of the object is incomplete.

[0092] In this embodiment, whether the temperature contour of the object is complete is determined by determining whether the temperature contour of the object is a closed figure, and the implementation method is simple and intuitive. Figure 4 , Figure 4 Schematic diagram of another scene captured by thermal imaging images. Figure 4 If the temperature contour of the object corresponding to 42 and 43 in is not a closed figure, then it is determined that its temperature contour is incomplete. Figure 4 If the highest temperature of the object corresponding to 42 and 43 is greater than the preset temperature threshold and the comprehensive hazard value of the object is not greater than the preset comprehensive hazard value, the user should be prompted that some hidden dangers cannot be predicted. Figure 4 If the temperature contour of the object corresponding to 41 in is a closed figure, then its temperature contour is considered complete. Figure 4 If the highest temperature of the object corresponding to 41 in the above is greater than the preset temperature threshold and the comprehensive danger value of the object is not greater than the preset comprehensive danger value, the step of issuing an early warning prompt is entered.

[0093] As a preferred embodiment, determining the area of ​​the object with the highest temperature includes:

[0094] determining the temperature profile of an object;

[0095] determining a maximum temperature profile of the object from the temperature profile of the object;

[0096] Calculate the area of ​​the contour of the object with the highest temperature to obtain the area of ​​the highest temperature.

[0097] Please refer to Figure 4 , Figure 4 This is a schematic diagram of another scene captured by a thermal imaging image. The thermal imaging image uses different colors to distinguish the parts of the captured image with different temperatures. Since the area of ​​room temperature is large, the room temperature is first determined in the thermal imaging image, and then the largest contour of other objects is determined by the room temperature encirclement method. After obtaining the largest contour of the object, the contour of the highest temperature of the object is determined according to the temperature contour of the object, and the area of ​​the contour of the highest temperature is calculated, that is, the area of ​​the highest temperature.

[0098] As a preferred embodiment, after acquiring the current frame thermal imaging image of the environment, the method further includes:

[0099] Determine whether the current working mode is fire warning mode or body temperature measurement mode;

[0100] If it is the fire warning mode, the step of determining the maximum temperature of the object and the area of ​​the maximum temperature is entered;

[0101] If it is the body temperature measurement mode, the maximum temperature of the object is determined, and the health status of the object's body temperature is judged based on the preset biological health temperature range and the maximum temperature selected by the user.

[0102] Considering that the body temperature of infants and pets is not easy to measure with a mercury thermometer, in this embodiment, a thermal imaging image is used to measure the body temperature of infants or pets. In the fire warning mode, the steps of determining the maximum temperature and the area of ​​the maximum temperature of the object are entered. In the body temperature measurement mode, the maximum temperature of the object is determined, and the health status of the body temperature of the object is judged according to the preset biological health temperature range and the maximum temperature selected by the user. The fire warning mode and the body temperature measurement mode can be switched by the user through an additional control module, but are not limited to. The function of measuring body temperature and the reuse of the thermal imaging function are realized, and compared with the traditional method of measuring body temperature with a mercury thermometer, it is more convenient and the measurement result is more accurate.

[0103] As a preferred embodiment, controlling the alarm module to alarm includes:

[0104] The control alarm module alarms, and the frequency of the alarm is positively correlated with the comprehensive risk value.

[0105] Considering that a single alarm frequency cannot effectively distinguish between the situation where the danger level of the environment is low and the situation where the danger level of the environment is high, the user may make the wrong response. Therefore, in this embodiment, the alarm frequency is positively correlated with the comprehensive danger value of the object, so that the user can judge the danger level of the object according to the alarm frequency and then choose the appropriate handling method. For example, when the comprehensive danger value of the object is high, a corresponding high-frequency alarm is issued. The user judges that the danger level is high based on the alarm frequency, and will give priority to escaping and calling the fire department instead of trying to solve the problem by himself.

[0106] In addition, in addition to being positively correlated with the comprehensive risk value, the alarm frequency can also increase in a step-by-step manner when the comprehensive risk value increases, so that when the comprehensive risk value of the object increases, the user can judge that the degree of danger of the object is increasing based on the increase in the alarm frequency, which helps the user judge the degree of danger of the object so that the user can take appropriate measures.

[0107] As a preferred embodiment, after acquiring the current frame thermal imaging image of the environment, the method further includes:

[0108] Determine whether there is a reference frame image;

[0109] If not, the current frame thermal imaging image is used as a new reference frame image and the step of determining the object with a temperature different from the ambient temperature according to the temperature distribution in the current frame thermal imaging image is entered;

[0110] If so, determine whether the change between the current frame thermal imaging image and the reference frame image is greater than a preset threshold;

[0111] If it is greater than a preset threshold, the current frame thermal imaging image is used as a new reference frame image and the step of determining an object with a temperature different from the ambient temperature is entered according to the temperature distribution in the current frame thermal imaging image;

[0112] If it is not greater than the preset threshold, return to the step of obtaining the current frame thermal imaging image of the environment;

[0113] Determine objects with different temperatures from the ambient temperature based on the temperature distribution in the current frame of thermal imaging image, including:

[0114] An object having a temperature different from that of the environment is determined based on the temperature distribution in the new reference frame image.

[0115] Considering that if image recognition is performed on each frame of image to determine objects with a temperature different from the ambient temperature, the computational complexity of the processor is increased, and when the change between two adjacent frames of image is very small, the obtained comprehensive hazard value of the object is the same, but the computing power of the processor is occupied, therefore, in this embodiment, a reference frame image is set, and it is determined whether the change between the current frame of thermal imaging image and the reference frame image is greater than a preset threshold to determine whether image recognition is needed, and image recognition is not performed when the change between the current frame of thermal imaging image and the reference frame image is small.

[0116] Specifically, after acquiring the current frame of thermal imaging image, it is determined whether there is a reference frame image. When acquiring the first frame of thermal imaging image, since there is no reference frame image before, the current thermal imaging image will be used as a new reference frame image, and then the step of determining the object with a different temperature from the ambient temperature according to the temperature distribution in the current frame of thermal imaging image is entered. When acquiring a non-first frame of thermal imaging image, it is determined whether the amount of change between the current frame of thermal imaging image and the reference frame image is greater than a preset threshold. Here, the amount of change between the current frame of thermal imaging image and the reference frame image is greater than the preset threshold, which may be but is not limited to: the current frame of thermal imaging image is translated by more than a certain threshold compared to the reference frame image, for example, the translation is more than 15%; the current frame of thermal imaging image has a new object added to it compared to the reference frame image; the current frame of thermal imaging image has a new object reduced compared to the reference frame image; the temperature change of the same part of the current frame of thermal imaging image compared to the reference frame image exceeds a preset value. If the change between the current frame thermal imaging image and the reference frame image is greater than a preset threshold, it means that the current frame thermal imaging image has a large change compared to the object or the object's highest temperature or the area of ​​the object's highest temperature in the reference frame image, and there may be a risk of fire. Therefore, the reference frame image needs to be updated, and the current frame thermal imaging image is used as a new reference frame image, and the object with a different temperature from the ambient temperature is determined based on the temperature distribution in the new reference frame image; if the change between the current frame thermal imaging image and the reference frame image is not greater than a preset threshold, it means that the current frame thermal imaging image has a small change compared to the object or the object's highest temperature or the area of ​​the object's highest temperature in the reference frame image, and there is no need to occupy the processor's computing power to re-recognize the image and determine the object with a different temperature from the ambient temperature.

[0117] To sum up, in this embodiment, by setting the reference frame image, when the current frame thermal imaging image does not change much from the reference frame image, there is no need to occupy the processor's computing power to re-perform image recognition, which ensures user safety while improving the processor's work efficiency.

[0118] As a preferred embodiment, after determining the object with a temperature different from the ambient temperature according to the temperature distribution in the new reference frame image, the method further includes:

[0119] Determine feature points of an object having a different temperature from the ambient temperature in a new reference frame image;

[0120] After determining the comprehensive hazard value of the object based on the maximum temperature and the area of ​​the maximum temperature, it also includes:

[0121] By comparing the feature points of the determined object with the feature points of the objects in the database, it is determined whether the determined object already exists in the database or whether it is a newly added object;

[0122] If the determined object already exists in the database, the characteristic points and the comprehensive risk value of the object existing in the database are updated;

[0123] If the determined object is a newly added object, the feature points and comprehensive risk value of the newly added object are added to the database;

[0124] Sort the comprehensive risk values ​​of all objects in the database according to the size of the comprehensive risk values;

[0125] Control alarm module alarm, including:

[0126] The control alarm module prompts and issues an alarm for the characteristic points of the object with the largest comprehensive risk value;

[0127] When the maximum comprehensive risk value prompt end condition is met, the feature points and comprehensive risk value of the object with the largest comprehensive risk value in the database are deleted, and the step of sorting the comprehensive risk values ​​of all objects in the database according to the size of the comprehensive risk value is returned until there is no comprehensive risk value in the database that is greater than the preset comprehensive risk value.

[0128] When considering applying the above high temperature warning method to mobile devices, such as wristbands, mobile phones or VR glasses, please refer to Figure 5a and Figure 5b , Figure 5a A schematic diagram of a scenario in which the high temperature warning method provided by the present invention is applied to a mobile device. Figure 5b The schematic diagram of another scenario when the high temperature warning method provided by the present invention is applied to a movable device. The shooting range of the thermal imaging module will change with the movement of the user. Considering that an object that exceeds the preset high temperature threshold needs to be alarmed, but because the comprehensive danger value of the object in the reference frame image is not the largest, the alarm is not given priority to the object. As the user moves, the reference frame image is updated, and the object is not in the new reference frame image, resulting in that although the comprehensive danger value of the object reaches the preset comprehensive danger value, the object is not alarmed, so that the danger around the user cannot be detected.

[0129] In order to solve the above problem, in this embodiment, after determining the comprehensive danger value of the object according to the maximum temperature and the area of ​​the maximum temperature, the characteristic points of the object are also identified, such as the position, the center of mass, the outline, the maximum temperature and the area of ​​the maximum temperature, etc., and then the characteristic points of the object are compared with the characteristic points in the database to determine whether the object is a newly added object. If the characteristic points of the object have been stored in the database, the comprehensive danger value of the object in the database is updated. If the characteristic points of the object are not stored in the database, it means that the object is a newly added object, and the characteristic points and the comprehensive danger value of the object are added to the database. Then, the comprehensive danger values ​​of all objects in the database are sorted according to the size of the comprehensive danger values, and the alarm module is controlled to alarm the object with the largest comprehensive danger value. The feature points are prompted and an alarm is issued so that the user can locate the object with the largest comprehensive risk value according to the feature points of the object with the largest comprehensive risk value. When the condition for ending the prompt of the maximum comprehensive risk value is met, for example, when a danger relief instruction sent by the user in response to the prompt is received, indicating that the danger of the object with the largest comprehensive risk value has been eliminated by the user, or the time for the prompt of the maximum comprehensive risk value reaches a preset time length (the purpose is to facilitate the alarm of other objects in the database whose comprehensive risk values ​​exceed the preset comprehensive risk value), the processor deletes the feature points and comprehensive risk value of the object with the largest comprehensive risk value in the database, and returns to the step of sorting the comprehensive risk values ​​of all objects in the database according to the size of the comprehensive risk value until there is no comprehensive risk value in the database greater than the preset comprehensive risk value.

[0130] In summary, in this embodiment, by saving the feature points and comprehensive hazard values ​​of the same object in the database, and updating the feature points and comprehensive hazard values ​​of the same object when the reference frame is updated, it is achieved that even if the object whose comprehensive hazard value exceeds the preset comprehensive hazard value due to the movement of the movable device is not in the reference frame, the object will be alarmed. In addition, the feature points of the object with the largest comprehensive hazard value are prompted, so that the user can accurately locate the object alarmed by the alarm module, thereby improving the efficiency of hazard handling.

[0131] Please refer to Figure 6 , Figure 6 A schematic structural diagram of a movable device provided by the present invention.

[0132] The present invention also provides a movable device, comprising:

[0133] The thermal imaging module 61 is used to photograph the environment around the movable device to obtain a thermal imaging image;

[0134] A memory 62, for storing computer programs;

[0135] The processor 63 is used to implement the steps of the high temperature warning method as described above when executing the computer program.

[0136] The removable device here may be, but is not limited to, a wristband, a mobile phone or VR glasses.

[0137] Please refer to the above-mentioned embodiments for the introduction of the mobile device, and this application will not go into details here.

[0138] In this specification, each embodiment is described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the embodiments can be referred to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant parts can be referred to the method part.

[0139] It should be noted that, in this specification, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "comprise", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the statement "comprises a ..." does not exclude the presence of other identical elements in the process, method, article or device including the element.

[0140] The above description of the disclosed embodiments enables those skilled in the art to implement or use the present invention. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to the embodiments shown herein, but rather to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A high temperature early warning method, characterized in that: include: Acquire a current frame thermal imaging image of the environment, and determine an object with a temperature different from that of the environment according to a temperature distribution in the current frame thermal imaging image; Determine the maximum temperature of the object and the area of ​​the maximum temperature; the maximum temperature refers to the highest value among the temperatures at different positions of the object; Determining a comprehensive risk value of the object according to the maximum temperature and the area of ​​the maximum temperature, wherein the comprehensive risk value is positively correlated with both the maximum temperature and the area of ​​the maximum temperature; If the comprehensive risk value is greater than the preset comprehensive risk value, the control alarm module alarms; After determining the object with a different temperature from the ambient temperature according to the temperature distribution in the new reference frame image, the method further includes: Determine the feature points of the object with different temperature from the ambient temperature in the new reference frame image; wherein, when it is determined that the reference frame image does not exist, the current frame thermal imaging image is used as the new reference frame image; when it is determined that the reference frame image exists and the amount of change between the current frame thermal imaging image and the reference frame image is greater than a preset threshold, the current frame thermal imaging image is used as the new reference frame image; After determining the comprehensive risk value of the object according to the maximum temperature and the area of ​​the maximum temperature, the method further includes: By comparing the feature points of the determined object with the feature points of objects in the database, it is determined whether the determined object already exists in the database or whether it is a newly added object; If the determined object already exists in the database, updating the characteristic points and the comprehensive risk value of the object existing in the database; If the determined object is a newly added object, the feature points and the comprehensive risk value of the newly added object are added to the database; sorting the comprehensive risk values ​​of all objects in the database according to the size of the comprehensive risk values; Control alarm module alarm, including: Controlling the alarm module to prompt and alarm the feature points of the object with the largest comprehensive risk value; When the maximum comprehensive risk value prompt end condition is met, the feature points and comprehensive risk value of the object with the largest comprehensive risk value in the database are deleted, and the step of sorting the comprehensive risk values ​​of all objects in the database according to the size of the comprehensive risk value is returned until there is no comprehensive risk value in the database that is greater than the preset comprehensive risk value.

2. The high temperature early warning method according to claim 1, characterized in that: Also includes: If the highest temperature of the object is greater than a preset temperature threshold and the comprehensive danger value of the object is not greater than the preset comprehensive danger value, an early warning prompt is issued.

3. The high temperature early warning method according to claim 2, characterized in that: If the highest temperature of the object is greater than a preset temperature threshold and the comprehensive risk value of the object is not greater than the preset comprehensive risk value, the method further includes: determining a temperature profile of the object; determining whether the temperature profile of the object is complete; If yes, proceed to the step of issuing an early warning prompt; If not, the user is prompted that some hidden dangers cannot be predicted.

4. The high temperature early warning method according to claim 3, characterized in that: Determining whether the temperature profile of the object is complete includes: Determining whether the temperature profile of the object is a closed figure; If so, determining that the temperature profile of the object is complete; If not, it is determined that the temperature profile of the object is incomplete.

5. The high temperature early warning method according to claim 1, characterized in that: Determining the area of ​​the object with the highest temperature, comprising: determining a temperature profile of the object; determining a profile of a maximum temperature of the object from a temperature profile of the object; The area of ​​the contour of the highest temperature of the object is calculated to obtain the area of ​​the highest temperature.

6. The high temperature early warning method according to claim 1, characterized in that: After obtaining the current frame thermal imaging image of the environment, it also includes: Determine whether the current working mode is fire warning mode or body temperature measurement mode; If it is the fire warning mode, then entering the step of determining the maximum temperature of the object and the area of ​​the maximum temperature; If it is the body temperature measurement mode, the maximum temperature of the object is determined, and the health status of the body temperature of the object is judged based on the preset biological health temperature range selected by the user and the maximum temperature.

7. The high temperature early warning method according to claim 1, characterized in that: Control alarm module alarm, including: The control alarm module alarms, and the frequency of the alarm is positively correlated with the comprehensive risk value.

8. The high temperature early warning method according to any one of claims 1 to 7, characterized in that: After obtaining the current frame thermal imaging image of the environment, it also includes: Determine whether there is a reference frame image; If not, taking the current frame thermal imaging image as a new reference frame image and entering the step of determining an object with a temperature different from the ambient temperature according to the temperature distribution in the current frame thermal imaging image; If so, determining whether the change between the current frame thermal imaging image and the reference frame image is greater than a preset threshold; If it is greater than the preset threshold, the current frame thermal imaging image is used as a new reference frame image and the step of determining an object with a temperature different from the ambient temperature according to the temperature distribution in the current frame thermal imaging image is entered; If it is not greater than the preset threshold, return to the step of acquiring the current frame thermal imaging image of the environment; Determining an object with a temperature different from that of the environment according to the temperature distribution in the current frame of the thermal imaging image comprises: An object having a temperature different from that of the environment is determined according to the temperature distribution in the new reference frame image.

9. A movable device, characterized in that: include: A thermal imaging module, used to photograph the environment around the movable device to obtain a thermal imaging image; Memory for storing computer programs; A processor, configured to implement the steps of the high temperature warning method according to any one of claims 1 to 8 when executing the computer program.

Images