Infrared thermal imaging protection and monitoring methods, devices, equipment, systems and media

Abstract

This application provides an infrared thermal imaging protection and monitoring method, device, equipment, system, and medium. By recognizing infrared images, the location data and morphological feature data of the target monitoring object are determined. Based on the location data and corresponding temperature distribution data, the target temperature data is determined. Furthermore, based on the target morphological feature data, target temperature data, and reference body temperature feature data, the corresponding target body temperature feature data is determined. Finally, the target temperature measurement location data is determined based on the target morphological feature data. Temperature protection and monitoring data is then determined from the corresponding target body temperature feature data. The obtained temperature protection and monitoring data has high accuracy. Moreover, the equipment or system using the infrared thermal imaging protection method provided in this application does not require contact with the target monitoring object, avoiding discomfort for the target monitoring object during protection and monitoring, while also protecting the privacy and security of the target monitoring object.

Description

Technical Field

[0001] This application relates to the field of intelligent monitoring technology, and in particular to an infrared thermal imaging protection monitoring method, device, equipment, system and medium. Background Technology

[0002] In today's society, people are paying more and more attention to their own safety and health. The functions of monitoring systems are no longer limited to simply showing images. People hope that monitoring systems can have more functions to ensure the safety and health of themselves and their families.

[0003] Currently, most surveillance systems on the market use visible light cameras, which can achieve video monitoring and derivative functions based on video monitoring. For example, Chinese patent CN109598229A provides a monitoring technology that performs action recognition based on video frames and adds sensors to the camera to expand monitoring functions. Another example is CN108366007A, which provides a monitoring technology that adds vibration sensors to monitor the operation of smart homes. Due to the impact of the pandemic in recent years, many surveillance systems have added body temperature detection functions. For example, CN111854972A provides a body temperature monitoring system that measures the temperature of passing pedestrians based on infrared thermometry. However, these products are all developed based on visible light cameras, which is not conducive to protecting people's privacy.

[0004] To alleviate the pressure of needing to measure target body temperature regularly in some scenarios (such as children with fever or patients after surgery), some automatic body temperature monitoring products have appeared on the market. Although these products can monitor a person's body temperature for a long time, they are generally contact products, meaning they need to come into contact with the skin. They feel foreign when worn, are easy to fall off, and have a poor user experience. Summary of the Invention

[0005] To address the existing technical problems, this application provides an infrared thermal imaging protective monitoring method, apparatus, device, system, and computer-readable storage medium that does not require close-fitting wearing and can protect privacy.

[0006] An infrared thermal imaging protection and monitoring method includes:

[0007] Acquire infrared images containing the target monitoring object;

[0008] The infrared image is identified to determine the location data of the target monitored object in the infrared image and the target morphological feature data of the target monitored object;

[0009] Based on the location data and the temperature distribution data mapped from the infrared image, the target temperature data of the target monitored object is obtained;

[0010] Based on the target morphological feature data, the target temperature data, and the reference body temperature feature data corresponding to the target monitored object, determine the target body temperature feature data corresponding to the target morphological feature data;

[0011] Based on the target morphological feature data, the target temperature measurement location data of the target monitored object is determined, and based on the target body temperature feature data and the target temperature measurement location data, the temperature protection monitoring data of the target monitored object is obtained.

[0012] An infrared thermal imaging protection and monitoring device, comprising:

[0013] The image acquisition module is used to acquire infrared images containing the target monitoring object;

[0014] The identification module is used to identify the infrared image and determine the location data of the target monitoring object in the infrared image and the target morphological feature data of the target monitoring object;

[0015] The temperature acquisition module is used to obtain the target temperature data of the target monitored object based on the location data and the temperature distribution data mapped from the infrared image.

[0016] The status acquisition module is used to determine the target body temperature feature data corresponding to the target morphological feature data based on the target morphological feature data, the target temperature data, and the reference body temperature feature data corresponding to the target monitoring object;

[0017] The temperature monitoring module is used to determine the target temperature measurement location data of the target monitored object based on the target morphological feature data, and to obtain the temperature protection monitoring data of the target monitored object based on the target body temperature feature data and the target temperature measurement location data.

[0018] An infrared thermal imaging protection and monitoring device includes a memory and a processor. The memory stores a computer program that can be executed by the processor. When the computer program is executed by the processor, it implements the infrared thermal imaging protection and monitoring method as described above.

[0019] An infrared thermal imaging protection and monitoring system includes an infrared acquisition device, a processor, a cloud server, and terminal devices;

[0020] The infrared acquisition device is used to acquire infrared data of the monitored area and send the infrared data to the processor;

[0021] The processor processes the infrared data according to the infrared thermal imaging protection and monitoring method to obtain corresponding processed data, which includes corresponding protection and monitoring data and / or corresponding reminder data.

[0022] The cloud server is used to acquire the processed data and send the processed data to the terminal device;

[0023] The terminal device is used to display the processed data.

[0024] A computer-readable storage medium storing a computer program, wherein the computer program, when executed by a processor, implements the infrared thermal imaging protection and monitoring method described herein.

[0025] As can be seen from the above, the infrared thermal imaging protection and monitoring method provided in this application identifies the infrared image corresponding to the target monitored object, determines the location data and target morphological feature data of the target monitored object, then determines the target temperature data of the target monitored object based on the location data and the temperature distribution data corresponding to the infrared image, and determines the target body temperature feature data corresponding to the target morphological feature data based on the target morphological feature data, target temperature data, and reference body temperature feature data, and then determines the target temperature measurement location data of the target monitored object based on the target morphological feature data, thereby determining the temperature protection and monitoring data of the target monitored object from the corresponding target body temperature feature data based on the target temperature measurement location data. Since the infrared thermal imaging protection and monitoring method provided in this application constructs target body temperature feature data corresponding to the target monitored object in different morphological states based on the target morphological feature data of the target monitored object, and determines the target temperature measurement location data based on the target morphological feature data, it can accurately obtain the temperature protection and monitoring data corresponding to the target monitored object from the target body temperature feature data in the corresponding states, thus achieving effective monitoring of the target monitored object. Furthermore, the infrared thermal imaging protection and monitoring method provided in this application achieves temperature monitoring of the target object by acquiring infrared data of the monitoring area where the target object is located. Therefore, the thermal imaging protection and monitoring equipment or system that applies the infrared thermal imaging protection method provided in this application does not need to contact the target object, thus avoiding the problem of uncomfortable user experience for the target object during the protection and monitoring of the target object, while also protecting the privacy and security of the target object. Attached Figure Description

[0026] Figure 1 This is a schematic diagram of the infrared thermal imaging protection and monitoring method provided in accordance with the embodiments of this application;

[0027] Figure 2 This is a flowchart illustrating the process of obtaining location data and morphological feature data of the target monitored object in the infrared thermal imaging protection and monitoring method provided in the embodiments of this application;

[0028] Figure 3This is a flowchart illustrating the process of obtaining temperature protection monitoring data of a target monitoring object using an infrared thermal imaging protection monitoring method provided in some embodiments of this application.

[0029] Figure 4 This is a schematic diagram of the process for obtaining target temperature data of the target monitored object in the infrared thermal imaging protection and monitoring method provided in the embodiments of this application;

[0030] Figure 5 This is a schematic diagram of the infrared thermal imaging protection and monitoring method provided in accordance with the embodiments of this application;

[0031] Figure 6 This is a flowchart illustrating the infrared thermal imaging protection and monitoring method provided according to an embodiment of this application.

[0032] Figure 7 This is a schematic diagram of the structure of the infrared thermal imaging protection and monitoring device provided in accordance with the embodiments of this application;

[0033] Figure 8 This is a schematic diagram of the structure of an infrared thermal imaging protection and monitoring device provided according to an embodiment of this application;

[0034] Figure 9 This is a schematic diagram of the infrared thermal imaging protection and monitoring system provided in accordance with the embodiments of this application;

[0035] Figure 10 A schematic diagram of the workflow of an infrared thermal imaging protection and monitoring system that applies the infrared thermal imaging protection and monitoring method provided in the embodiments of this application;

[0036] Figure 11 A schematic diagram illustrating the workflow of temperature protection monitoring for a system applying the thermal imaging protection monitoring method provided in the embodiments of this application;

[0037] Figure 12 A schematic diagram illustrating the workflow of state protection monitoring for a system applying the thermal imaging protection monitoring method provided in the embodiments of this application;

[0038] Figure 13 This is a schematic diagram illustrating the workflow of the intelligent identification module in an infrared thermal imaging protection and monitoring system provided according to some embodiments of this application. Detailed Implementation

[0039] The technical solution of this application will be further described in detail below with reference to the accompanying drawings and specific embodiments.

[0040] To make the objectives, technical solutions, and advantages of this application clearer, the application will be further described in detail below with reference to the accompanying drawings. The described embodiments should not be regarded as limitations on this application. All other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0041] In the following description, the phrase "some embodiments" refers to a subset of all possible embodiments. It should be noted that "some embodiments" can be the same subset or different subsets of all possible embodiments, and can be combined with each other without conflict.

[0042] In the following description, the terms "first, second, and third" are used merely to distinguish similar objects and do not represent a specific ordering of objects. It is understood that "first, second, and third" may be interchanged in a specific order or sequence where permitted, so that the embodiments of this application described herein can be implemented in an order other than that illustrated or described herein.

[0043] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein is for the purpose of describing embodiments of this application only and is not intended to limit this application.

[0044] Please see Figure 1 The diagram shown is a schematic flowchart of an infrared thermal imaging protection and monitoring method provided according to an embodiment of this application. The infrared thermal imaging protection and monitoring method provided in this application is applied to applications such as... Figure 8 The infrared thermal imaging protection and monitoring equipment shown may be used in applications such as Figure 9 In the infrared thermal imaging protection and monitoring system shown, the infrared thermal imaging protection and monitoring device or the processor in the infrared thermal imaging protection and monitoring system, when executing the corresponding computer program, implements the steps of the infrared thermal imaging protection and monitoring method provided according to any embodiment of this application. In this embodiment, the infrared thermal imaging protection and monitoring method includes S01, S02, S03, S04, and S05, which are described in detail below.

[0045] S01: Acquire an infrared image containing the target monitoring object.

[0046] Infrared images refer to images obtained by taking pictures or videos of the monitored area where the target object is located. The monitored area refers to the infrared acquisition area of ​​the infrared acquisition device in the infrared thermal imaging protection and monitoring system using the infrared thermal imaging protection and monitoring method provided in this application embodiment; that is, the visual area of ​​the infrared acquisition device, or the area of ​​interest to the user or the area the user expects to monitor. The target object is located within the monitored area. Infrared images can be directly acquired from the infrared acquisition device, or obtained by converting the raw NUC (Non-Uniformity Correction) data acquired from the infrared acquisition device, or obtained from temperature data converted from NUC data. This temperature data includes temperature matrix data or can be directly an infrared image carrying temperature distribution information. In some embodiments, NUC data and / or the aforementioned temperature data can be further acquired simultaneously with the infrared image. NUC data refers to the raw infrared electrical signal acquired by the infrared acquisition device, which can be a voltage signal or a current signal. It is the infrared electrical signal generated by the infrared acquisition device receiving infrared light reflected back from objects in the monitored area and processing it. The intensity of infrared light reflected from different locations within a monitored area varies, resulting in different values ​​for the NUC data at those locations. Therefore, by converting the NUC data from different locations within the monitored area into corresponding temperature data, the temperature data of the monitored area can be obtained. Infrared acquisition devices are those capable of infrared thermal imaging, such as infrared thermal imagers.

[0047] S02: Identify the infrared image to determine the position data of the target monitored object in the infrared image (such as the overall outline of a person and the positions of the eyes, nose, ears, arms, forehead and other components in the infrared image) and the target morphological feature data of the target monitored object (such as the posture features of a person standing, sitting, squatting, lying down and falling, and the positions of the eyes, nose, ears, arms, forehead and other components in the infrared image under different postures).

[0048] The location data of a target monitoring object in an infrared image includes the overall outline of the target monitoring object and the location information of its constituent parts in the infrared image. That is, obtaining the location data of a target monitoring object by identifying it in an infrared image includes obtaining the location region of the overall outline of the target monitoring object in the infrared image, and further includes obtaining the location regions of the constituent parts of the target monitoring object in the infrared image. Specifically, target detection algorithms can be used to identify targets in infrared images to identify the target monitoring object in the infrared image, and further, based on the target temperature data of the target monitoring object, determine the various constituent parts of the target monitoring object, thereby obtaining the location information of the overall outline of the target monitoring object and the location information of its constituent parts. The constituent parts of the target monitoring object include, but are not limited to, eyes, nose, ears, arms, forehead, etc.

[0049] Target morphological feature data includes the posture information of the target monitored object and the information of its constituent parts in different postures. The target morphological information of the monitored object is obtained by recognizing infrared images, including recognizing the infrared images to determine the overall contour information of the monitored object, and determining the posture information of the monitored object based on the overall contour information. Furthermore, obtaining target morphological feature data by recognizing infrared images also includes determining the information of the constituent parts of the monitored object in each posture based on the target temperature data of the monitored object in each posture. The posture information includes, but is not limited to, postures such as standing, sitting, squatting, lying down, and falling. The constituent part information includes the position information of each constituent part of the monitored object in different postures.

[0050] S03: Based on the location data and the temperature distribution data mapped from the infrared image, obtain the target temperature data of the target monitored object (such as the temperature of the monitored person among the various temperatures corresponding to the infrared image).

[0051] Infrared images are images that characterize the temperature distribution information of a monitored area by mapping the temperature information of various objects within that area. Therefore, each pixel or pixel region in an infrared image has a corresponding temperature, which constitutes the temperature distribution data of the monitored area. This temperature distribution data is mapped to the infrared image. This temperature distribution data can be obtained directly from the acquisition device, or it can be obtained by first acquiring NUC data from the infrared acquisition device and then converting it to obtain the corresponding temperature distribution data. Temperature distribution data can refer to matrix-type numerical data or infrared images carrying temperature distribution information. The temperature distribution data consists of temperature data corresponding to different locations within the monitored area. Therefore, the temperature distribution data not only contains the temperature information of the monitored area but also its location information. Thus, the target temperature data of the monitored object within the monitored area can be determined based on the temperature distribution data. Specifically, based on the location region of the overall outline of the monitored object in the infrared image, the pixels belonging to the monitored object in the infrared image are determined. Based on the above mapping relationship, the temperature corresponding to the pixels belonging to the monitored object is determined. The temperatures corresponding to each pixel of the monitored object constitute the target temperature data of the monitored object.

[0052] In some application scenarios, the target objects within the monitoring area are in motion. Therefore, it is necessary to utilize target detection and tracking algorithms to obtain the location data of the target objects in real time, and adjust the monitoring area of ​​the infrared acquisition device in real time based on the location data of the target objects, so that the target objects are located within the monitoring area during the monitoring period, and the infrared information of the target objects can be collected by the infrared acquisition device.

[0053] S04: Based on the target morphological feature data, the target temperature data, and the reference body temperature feature data corresponding to the target monitored object (such as a human body standard body temperature reference template), determine the target body temperature feature data (such as the body temperature feature map of the monitored person) corresponding to the target morphological feature data.

[0054] The reference body temperature characteristic data corresponding to the target monitored object refers to the reference temperature distribution data of each component of the target monitored object. If the target monitored object is a person, the reference body temperature characteristic data can be a human body temperature characteristic template. Therefore, the reference temperature data of the corresponding components of the target monitored object can be determined from the reference body temperature characteristic data. Based on the target temperature data and the reference body temperature characteristic data of the target monitored object, the components of each temperature or group of temperatures in the target temperature data can be determined, thereby determining the temperature map of each component of the target monitored object, i.e., the target body temperature characteristic map. Infrared images generally only include the outline information of the target monitored object and do not display detailed texture information. Therefore, temperature protection monitoring of the target monitored object based on infrared images is beneficial for protecting the privacy of the target monitored object. The target body temperature characteristic data of the target monitored object contains temperature information corresponding to different components. Depending on the different temperature measurement sites required for the target monitored object, the temperature of the corresponding measurement site can be read from the target body temperature characteristic data of the target monitored object. The temperature measurement site is selected from one or more components of the target monitored object.

[0055] Because the morphological features of the monitored object change in infrared images, obtaining temperature information of the monitored object's measurement sites solely based on target temperature data and reference body temperature feature data will result in errors. This is because changes in the positional information of the constituent parts of the monitored object will correspondingly change the positional information of the temperature measurement points. Therefore, reading the corresponding temperature data from the target body temperature feature data of the monitored object based on the positional information of the temperature measurement points will also produce corresponding deviations, leading to inaccurate temperature monitoring. In this embodiment, in addition to the target temperature data and reference body temperature feature data of the monitored object, the target morphological feature data of the monitored object is further used to obtain target body temperature feature data corresponding to different postures of the monitored object. That is, different target body temperature feature data corresponds to each target morphological feature data. For example, target body temperature feature data corresponding to the monitored object in a standing posture, or body temperature feature data corresponding to the monitored object in a lying posture, etc. It should be noted that the body temperature feature data can be a series of temperature values ​​corresponding to each constituent part of the monitored object, or it can be a body temperature feature map characterizing the temperature distribution of the constituent parts of the monitored object.

[0056] S05: Based on the target morphological feature data, determine the target temperature measurement location data of the target monitored object (such as the position of the temperature measurement parts such as mouth, eyes, nose, ears, and arms in the infrared image), and based on the target body temperature feature data and the target temperature measurement location data, obtain the temperature protection monitoring data of the target monitored object (such as the body temperature change curve of the monitored person).

[0057] Based on target morphological feature data, the positional information of each component of the target monitored object under different postures can be determined. From this positional information, the positional information of the component corresponding to the target temperature measurement point can be determined, thus establishing the target temperature measurement location data. Determining the target temperature measurement location data based on target morphological feature data ensures the consistency of the obtained temperature measurement data each time, which is beneficial for temperature protection monitoring of the same temperature measurement site on the target monitored object. After determining the target temperature measurement location data, the temperature corresponding to the target temperature measurement location data is read from the target body temperature feature data corresponding to the target morphological feature data, thus obtaining the temperature protection monitoring data of the target monitored object. The target temperature measurement location data is the positional information of one or more temperature measurement target sites in the infrared image among the various components of the target monitored object. The temperature measurement target site refers to the component of the target monitored object whose temperature needs to be monitored. For example, if the forehead temperature of the target monitored object needs to be monitored, then the forehead is the corresponding temperature measurement target site among the various components of the target monitored object.

[0058] As can be seen from the above, the infrared thermal imaging protection and monitoring method provided in this application identifies the infrared image corresponding to the target monitored object, determines the location data and target morphological feature data of the target monitored object, then determines the target temperature data of the target monitored object based on the location data and the temperature distribution data corresponding to the infrared image, and determines the target body temperature feature data corresponding to the target morphological feature data based on the target morphological feature data, target temperature data, and reference body temperature feature data, and then determines the target temperature measurement location data of the target monitored object based on the target morphological feature data, thereby determining the temperature protection and monitoring data of the target monitored object from the corresponding target body temperature feature data based on the target temperature measurement location data. Since the infrared thermal imaging protection and monitoring method provided in this application constructs target body temperature feature data corresponding to the target monitored object in different morphological states based on the target morphological feature data of the target monitored object, and determines the target temperature measurement location data based on the target morphological feature data, it can accurately obtain the temperature protection and monitoring data corresponding to the target monitored object from the target body temperature data corresponding to the corresponding morphological state, thus achieving effective monitoring of the target monitored object. Furthermore, the infrared thermal imaging protection and monitoring method provided in this application embodiment achieves temperature monitoring of the target monitoring object by acquiring infrared data of the monitoring area where the target monitoring object is located. Therefore, the thermal imaging protection and monitoring equipment or system that applies the infrared thermal imaging protection method provided in this application embodiment does not need to contact the target monitoring object, thus avoiding the problem of uncomfortable user experience for the target monitoring object during the protection and monitoring of the target monitoring object, while also protecting the privacy and security of the target monitoring object.

[0059] In some embodiments, the temperature distribution data of the infrared image mapping in S02 is NUC data obtained by the infrared image acquisition device used to acquire the infrared image, that is, NUC data needs to be further acquired in S01. In other embodiments, the temperature distribution data of the infrared image mapping in S02 is temperature data obtained based on the NUC data acquired by the infrared image acquisition device, that is, the temperature data needs to be further acquired in S01.

[0060] Please see Figure 2 The diagram illustrates a flowchart of the infrared thermal imaging protection and monitoring method for acquiring location data and morphological feature data of a target monitoring object, according to some embodiments of this application. In this embodiment, S02 specifically includes S021 and S022, which are described in detail below.

[0061] S021: The infrared image is identified to determine the overall outline of the target monitoring object and the position data of the overall outline in the infrared image.

[0062] Infrared image recognition refers to extracting features from infrared images based on a trained neural network model, and then determining the location information of the target monitoring object in the infrared image based on the extracted features.

[0063] S022: Based on the overall contour, identify and determine the target morphological feature data of the target monitoring object. The target morphological feature data includes the feature data corresponding to each component of the overall contour and the posture feature data of the target monitoring object.

[0064] After determining the overall outline of the target monitoring object, the outline is further identified to obtain the object's posture information. Based on the target temperature data corresponding to the overall outline and reference body temperature characteristic data, the constituent parts corresponding to each temperature or group of temperatures in the target temperature data under different postures are determined. This allows for the determination of the positional information of each constituent part of the target monitoring object under different postures, and ultimately, the determination of the target morphological characteristic data. The target morphological characteristic data of the target monitoring object includes the object's posture information and the positional information of each constituent part under the corresponding posture.

[0065] Please see Figure 3 The diagram illustrates a flowchart of an infrared thermal imaging protection monitoring method for obtaining temperature protection monitoring data of a target object according to some embodiments of this application. In this embodiment, obtaining temperature protection monitoring data of the target object based on the target body temperature characteristic data and the target temperature measurement location data in step S05 specifically includes steps S051 and S052, which are described below.

[0066] S051: Based on the target body temperature characteristic data and the target temperature measurement location data, determine the target monitoring temperature data of the target monitored object (such as the temperature corresponding to the temperature measurement parts of the monitored person's mouth, eyes, nose, ears, arms, etc.).

[0067] S052: Obtain temperature protection monitoring data of the target monitoring object based on the target monitoring temperature data of the target monitoring object within a specified period.

[0068] The location data of the target monitored object refers to the target body temperature characteristic data, which refers to the temperature distribution data of different components of the target monitored object under various target forms (postures). In some embodiments, the target body temperature characteristic data can be a body temperature characteristic map of the target monitored object under a corresponding target form, from which the temperature data of each component can be read. The target temperature measurement location data is the location information of the temperature measurement target part in the infrared image. The temperature measurement target part is the component of the target monitored object whose temperature is being monitored, such as the forehead, eyes, mouth, ears, or nose. After determining the target temperature measurement location data of the temperature measurement target part, the temperature data of the target monitored object's temperature measurement target part can be read from the corresponding target body temperature characteristic data based on this location data; that is, the target monitored temperature data.

[0069] A specified period refers to the period during which the target object needs to be monitored, or a partitioned time period set within the monitoring time of the target object. This specified period can generally be set by the user through the interactive device in the infrared thermal imaging protection monitoring system, such as through a terminal device. It should be noted that acquiring infrared data of the monitoring area in S02 includes acquiring infrared images of the monitoring area in real time, i.e., acquiring infrared images collected in real time by the infrared acquisition device. Each acquisition time point of the infrared acquisition device corresponds to an infrared image. The monitoring area corresponding to infrared images at different acquisition time points may be different, and the target monitoring temperature data of the target object corresponding to different acquisition time points may also be different. Therefore, the target monitoring temperature data of the target object within the specified period can reflect the temperature change information of the temperature measurement target part of the target object. Based on the temperature change information of the temperature measurement target part of the target object, the corresponding temperature protection monitoring data of the target object can be obtained, so as to realize real-time or timed monitoring of the temperature of the target object.

[0070] Furthermore, in some embodiments, obtaining the temperature protection monitoring data of the target monitoring object based on the target monitoring temperature data of the target monitoring object within a specified period in S052 specifically includes: obtaining the target monitoring temperature change curve of the target monitoring object based on the change of the target monitoring temperature data corresponding to the target temperature measurement location data within a specified period.

[0071] In this embodiment, the infrared images acquired in real time by the infrared acquisition device in step S02 are used to obtain real-time target monitoring temperature data of the target body part of the monitored object. The real-time target monitoring temperature data of the monitored object within a specified period reflects the temperature change information of the target body part of the monitored object within that period, and this temperature change information is represented as a curve, i.e., the target monitoring temperature change curve. The target monitoring temperature change curve of the monitored object is a curve showing the temperature change over time. If the monitored object is a person, the corresponding target monitoring temperature change curve is the human body temperature curve. The target monitoring temperature change curve of the monitored object serves as protective monitoring data obtained for temperature protection monitoring. In some embodiments, a temperature report of the monitored object can also be generated and output based on the target monitoring temperature change curve of the monitored object for display by the terminal device in the infrared thermal imaging protective monitoring system.

[0072] In some embodiments, the infrared thermal imaging protection and monitoring method provided in this application further includes: generating temperature anomaly alert data when it is determined, based on the target monitoring temperature data, that a temperature anomaly exists corresponding to the target monitoring object. Furthermore, the temperature anomaly alert data can be displayed by a terminal device in the infrared thermal imaging protection and monitoring system.

[0073] To determine whether the target monitoring temperature data of a target object is abnormal, you can directly compare the target monitoring temperature data of the target object with the corresponding reference temperature. Alternatively, you can determine whether the temperature of the target object is abnormal based on the conditions met by the temperature protection monitoring data determined from the target monitoring temperature data of the target object.

[0074] In some embodiments, it can be determined whether the target monitored object has a temperature abnormality based on whether the current target monitored temperature data of the target monitored object meets a preset temperature condition and / or whether the change of the target monitored temperature data within a specified period meets a preset change condition. If so, temperature abnormality alert data is generated.

[0075] In this embodiment, it is possible to determine whether the target monitored object is experiencing a temperature anomaly based either on its current target monitored temperature data or on its temperature protection monitoring data. The preset temperature condition can refer to a preset temperature threshold or a preset temperature range. For example, if the target monitored object is a person, the preset temperature condition can be set to any temperature between 37 degrees Celsius and 37.3 degrees Celsius. The preset temperature change condition can refer to a preset temperature change trend. If the target monitored object's temperature change curve differs significantly from the preset temperature change trend, it indicates that the target monitored object's temperature is abnormal. An abnormal temperature in the target monitored object can include both an abnormal temperature of the target monitored object itself and a significant discrepancy between the temperature monitored by the infrared thermal imaging protection monitoring equipment and the actual temperature of the target monitored object, i.e., a monitoring anomaly.

[0076] Please see Figure 4 As shown, it is a flowchart illustrating the process of obtaining target temperature data of a target monitored object in the infrared thermal imaging protection monitoring method provided in the embodiments of this application. Specifically, in this embodiment, determining the temperature data of the target monitored object based on the location data monitoring data in S042 includes S041, S042, S043, and S044, which are described in detail below.

[0077] S041: Based on the location data, read the temperature data corresponding to the location data from the temperature distribution data.

[0078] S042: Determine whether the temperature data corresponding to the location data meets the preset temperature data.

[0079] S043: When the temperature data corresponding to the location data satisfies the preset temperature data, the temperature data corresponding to the location data is used as the target temperature data of the target monitoring object.

[0080] S044: When the candidate temperature data does not meet the preset temperature data, return to the step of identifying the infrared image and determining the location data of the target monitoring object in the infrared image.

[0081] After obtaining the location data of the target monitored object, the corresponding temperature data can be read from the temperature distribution data corresponding to the infrared image based on the location of the target monitored object. The preset temperature data can refer to a specific temperature or a temperature range. The comparison and judgment between candidate temperature data and preset temperature data can be performed directly using traditional algorithms, or a deep learning algorithm can be used to learn the temperature characteristics of the target monitored object and use them as preset temperature data. When the temperature data corresponding to the aforementioned location data is input into the temperature judgment model implemented based on the deep learning algorithm, the corresponding judgment result is obtained. If the temperature data corresponding to the current location data meets the preset temperature data, then the current temperature data corresponding to the aforementioned location data is used as the target temperature data of the target monitored object. Otherwise, it is necessary to return to S02 to relocate the target monitored object, and obtain the corresponding temperature data again based on the relocated location data, and perform the above judgment again, until the temperature data corresponding to the current location data meets the preset temperature data. If the number of relocation operations exceeds a preset number and the temperature data corresponding to the current location data still does not meet the preset temperature data, an abnormal alarm is triggered.

[0082] In some embodiments, S042 may specifically include: inputting the temperature data corresponding to the location data into the trained temperature judgment model to obtain judgment result data on whether the temperature data corresponding to the location data meets the preset temperature data.

[0083] The temperature judgment model is obtained through big data analysis and training based on the temperature data of corresponding users stored in the user database of the thermal imaging protection and monitoring system. During training, this model learns the normal temperature characteristics of the target monitored object (i.e., the characteristics of the preset temperature data). Therefore, when the temperature data corresponding to the location data is input, it can determine whether the temperature corresponding to the location data meets the preset temperature data based on its learning results. If it does, the judgment result is a first value; if not, it is a second value. Therefore, based on the value of the judgment result data output by the temperature judgment model, it can be determined whether the current temperature data corresponding to the location data meets the preset temperature data.

[0084] Furthermore, in some embodiments, after obtaining the temperature data of the target monitored object in S03, it can be determined whether the target temperature data is normal temperature data based on the target temperature data of the target monitored object and the reference body temperature characteristic data of the target monitored object. If so, S04 is executed; otherwise, S03 is continued. In some embodiments, the infrared thermal imaging protection monitoring method further includes: storing the temperature protection monitoring data of the target monitored object into a corresponding user database according to the category of the target monitored object.

[0085] To facilitate the training of temperature judgment models using data from the user database, the protective monitoring data corresponding to the target monitored object can be stored according to its category. That is, the protective monitoring data for each category of target monitored object is stored in a separate user database. The category of the target monitored object can refer to its gender, age, or other classification methods. Storing the protective monitoring data of the target monitored object according to its category facilitates personalized monitoring services for the target monitored object. For example, the target monitored object can be identified by facial recognition using terminal equipment in an infrared thermal imaging protective monitoring system, and the corresponding protective monitoring data can be retrieved based on the facial recognition result.

[0086] Please see Figure 5 As shown, it is a schematic diagram of the infrared thermal imaging protection and monitoring method provided according to the embodiment of this application. In this embodiment, after S02, the infrared thermal imaging protection and monitoring method further includes S06, which is described as follows.

[0087] S06: Based on the target morphological feature data of the target monitored object, determine whether the state of the target monitored object has changed. If so, generate state change reminder data.

[0088] The target morphological feature data obtained based on the current infrared image data can be compared with the target morphological feature data obtained based on the previous infrared image data to determine whether the current state of the target monitoring object has changed. If so, the status change can be displayed on the terminal device in the infrared thermal imaging protection and monitoring system to remind the user to pay attention to the change in the state of the target monitoring object, thereby realizing the protection and monitoring of the state of the target monitoring object.

[0089] Continue reading Figure 5 As shown, in some embodiments, after executing S0S02, the infrared thermal imaging protection monitoring method further includes S07, which is described below.

[0090] S07: Based on the target morphological feature data monitored by the target, determine whether the target object is in an abnormal state. If so, generate abnormal state alert data.

[0091] Abnormal states can be due to the inherent abnormality of the monitored object itself, or to abnormal state data obtained due to malfunctions in the thermal imaging protection and monitoring system that does not reflect the actual situation of the monitored object. The system can determine whether the current state of the monitored object is abnormal based on whether the current infrared image data meets preset state data. If so, an abnormal state alert can be displayed on the terminal device of the infrared thermal imaging protection and monitoring system to remind the user of the abnormal state of the monitored object, thereby achieving protective monitoring of the monitored object's state.

[0092] See Figure 6 As shown, it is a flowchart of the infrared thermal imaging protection and monitoring method provided according to the embodiment of this application. In this embodiment, after S02 is executed, the infrared thermal imaging protection and monitoring method further includes S081 and S082, which are described as follows.

[0093] S081: Based on the target morphological feature data, determine whether the target monitoring object is in a sleep state.

[0094] S082: When the target monitored object is in a sleeping state, the infrared image data is input into the trained blanket-kicking judgment model to determine whether the target monitored object has kicked off the blanket. If so, blanket-kicking reminder data is generated.

[0095] After obtaining the status data of the target monitored object, it can be further determined whether the status data indicates that the target monitored object is currently asleep. If so, the infrared image needs to be input into the blanket-kicking judgment model to determine the blanket-kicking action. The blanket-kicking judgment model can be a model based on traditional algorithms or deep learning algorithms. It mainly uses the change in the heat source area of ​​the target monitored object to determine whether there is a blanket-kicking action. If the blanket-kicking action is found, the terminal device in the infrared thermal imaging protection monitoring system can display a blanket-kicking action reminder. It should be noted that the blanket-kicking described in this embodiment is not limited to kicking the blanket with the foot; it includes any form of action of removing any covering that is obstructing the target monitored object. Please refer to [link to relevant documentation]. Figure 7The diagram shows a schematic of an infrared thermal imaging protection and monitoring device provided according to an embodiment of this application. In this embodiment, the infrared thermal imaging protection and monitoring device includes an image acquisition module 701, an identification module 702, a temperature acquisition module 703, a status acquisition module 704, and a temperature monitoring module 705. Specifically, the image acquisition module 701 acquires an infrared image containing the target monitoring object; the identification module 702 identifies the infrared image to determine the position data of the target monitoring object in the infrared image and the target morphological feature data of the target monitoring object; the temperature acquisition module 703 obtains the target temperature data of the target monitoring object based on the position data and the temperature distribution data mapped from the infrared image; the status acquisition module 704 determines the target body temperature feature data corresponding to the target morphological feature data based on the target temperature feature data, the target temperature data, and the reference body temperature feature data corresponding to the target monitoring object; and the temperature monitoring module 705 determines the target temperature measurement location data of the target monitoring object based on the target morphological feature data, and obtains the temperature protection and monitoring data of the target monitoring object based on the target body temperature feature data and the target temperature measurement location data.

[0096] In some embodiments, the infrared thermal imaging protection monitoring device further includes a status monitoring module ( Figure 7 (Not recorded in the document), wherein the status monitoring module is used to determine whether the status of the target monitored object has changed based on the target morphological feature data of the target monitored object, and if so, to generate status change reminder data; and / or is used to determine whether the target monitored object is in an abnormal state based on the target morphological feature data of the target monitored object, and if so, to generate status abnormality reminder data.

[0097] In some embodiments, the status monitoring module is further configured to determine whether the target monitored object is in a sleeping state based on the target morphological feature data, and when the target monitored object is in a sleeping state, input the infrared image data into the trained blanket-kicking judgment model to determine whether the target monitored object has kicked the blanket. If so, blanket-kicking reminder data is generated.

[0098] In some embodiments, the infrared thermal imaging protection monitoring device further includes a storage control module ( Figure 7 (Not recorded in the document), wherein the storage control module is used to store the temperature protection monitoring data of the target monitoring object into the corresponding user database according to the category of the target monitoring object.

[0099] In some embodiments, the identification module 702 is further configured to identify the infrared image, determine the overall outline of the target monitoring object and the position data of the overall outline in the infrared image, and identify the target morphological feature data of the target monitoring object based on the overall outline, wherein the target morphological feature data includes the feature data corresponding to each component of the overall outline and the posture feature data of the target monitoring object.

[0100] In some embodiments, the temperature acquisition module 703 is specifically used to perform S041 to S042 as described above.

[0101] In some embodiments, the temperature acquisition module 703 is further configured to input the temperature data corresponding to the location data into the trained temperature judgment model to obtain the judgment result data on whether the temperature data corresponding to the location data meets the preset temperature data.

[0102] In some embodiments, the temperature monitoring module 705 is further configured to determine the target monitoring temperature data of the target monitored object based on the target body temperature characteristic data and the target temperature measurement location data, and to obtain the temperature protection monitoring data of the target monitored object based on the target monitoring temperature data of the target monitored object within a specified period.

[0103] In some embodiments, the temperature monitoring module 705 is further configured to obtain the target monitoring temperature change curve of the target monitoring object based on the change of the target monitoring temperature data corresponding to the target temperature measurement location data within a specified period.

[0104] In some embodiments, the temperature monitoring module 705 is further configured to generate temperature abnormality alert data when it is determined, based on the target monitoring temperature data, that there is a temperature abnormality in the corresponding target monitoring object.

[0105] In some embodiments, the temperature monitoring module 705 is further configured to determine whether the target monitoring object has a temperature abnormality based on whether the current target monitoring temperature data of the target monitoring object meets a preset temperature condition and / or whether the change of the target monitoring temperature data within a specified period meets a preset change condition; if so, generate temperature abnormality alert data.

[0106] It should be noted that the infrared thermal imaging protection and monitoring device provided in the above embodiments is only illustrated by the division of the above-described program modules in the process of implementing the infrared thermal imaging protection and monitoring method. In practical applications, the above processing can be assigned to different program modules as needed, that is, the internal structure of the device can be divided into different program modules to complete all or part of the method steps described above. In addition, the infrared thermal imaging protection and monitoring device and the infrared thermal imaging protection and monitoring method embodiments provided in the above embodiments belong to the same concept, and their specific implementation process can be found in the method embodiments, which will not be repeated here.

[0107] Please see Figure 8 The diagram shows a schematic representation of an infrared thermal imaging protection and monitoring device provided according to an embodiment of this application. In this embodiment, the infrared thermal imaging protection and monitoring device includes a processor 801 and a memory 802. The memory 802 stores a computer program executable by the processor. When the computer program is executed by the processor, it implements the infrared thermal imaging protection and monitoring method described in any embodiment of this application. The infrared thermal imaging protection and monitoring device and the infrared thermal imaging protection and monitoring method provided in the aforementioned embodiments can achieve the same technical effects; therefore, to avoid repetition, further details are omitted here.

[0108] Please see Figure 9 The diagram shows a schematic of an infrared thermal imaging protection and monitoring system provided according to an embodiment of this application. In this embodiment, the infrared thermal imaging protection and monitoring system includes an infrared acquisition device 901, a processor 902, a cloud server 903, and a terminal device 904. The infrared acquisition device 901 is used to acquire infrared data of the monitored area and send the infrared data to the processor 902. The processor 902 processes the infrared data according to the infrared thermal imaging protection and monitoring method provided in any embodiment of this application to obtain corresponding processed data, which includes corresponding protection and monitoring data and / or corresponding alert data. The cloud server 903 is used to acquire the processed data output by the processor 902 and send the processed data to the terminal device 904. The terminal device 904 is used to display the processed data output by the processor 902.

[0109] In some embodiments, the cloud server 903 is also used to classify and store the processed data output by the processor 902 according to the category of the target monitored object.

[0110] This application provides an infrared thermal imaging protection and monitoring system for monitoring a user's body temperature, status, and other conditions. In some embodiments, the system mainly includes four parts: an infrared acquisition device, a processor, a cloud server, and a terminal device. Data transmission between the infrared acquisition device, the cloud server, and the terminal device can be completed via Wi-Fi. The infrared acquisition device is used to collect temperature data, save and process the raw NUC data to generate temperature data and infrared image data, and transmit the temperature data and infrared image data along with the NUC data to the processor, which then identifies and judges the data. The processor receives and processes the data provided by the infrared acquisition device. This module can be divided into three parts: a body temperature monitoring module, a status monitoring module, and a user database. These three modules can be integrated together or separately on the infrared acquisition device, deployed in a cloud server, or embedded in an APP.

[0111] like Figure 10 The diagram illustrates the workflow of an infrared thermal imaging protection and monitoring system applying the infrared thermal imaging protection and monitoring method provided in this application. In this embodiment, the infrared acquisition device is an infrared imaging camera. The intelligent recognition module in the processor reads data from the infrared imaging camera to obtain corresponding infrared data, which includes image data, NUC data, and temperature data. The image data is infrared image data containing the target monitoring object, and the temperature data is temperature distribution data of the monitoring area. The intelligent recognition module in the processor processes the acquired infrared data to obtain protection and monitoring data for the target monitoring object and corresponding alert data. The protection and monitoring data includes body temperature curve data and status data, and the alert data includes temperature abnormality alert data, status abnormality alert data, and status change alert data. The terminal device is a mobile terminal such as a mobile phone or laptop, which displays the processed data obtained by the processor's intelligent recognition module.

[0112] like Figure 11The diagram illustrates the workflow of a temperature protection monitoring system using the thermal imaging protection monitoring method provided in this application. The body temperature monitoring module in this system is used to locate and read the temperature, and then upload the obtained temperature data to a cloud server. The cloud server analyzes the protection monitoring big data stored in the user data to determine if the temperature data is valid. If valid, the valid temperature data is transmitted to the body temperature monitoring module to generate a body temperature curve. If invalid, the system needs to return to the body temperature monitoring module to relocate and read the temperature. The body temperature monitoring module locates the target monitoring object based on temperature distribution data and reads the temperature data based on the target monitoring object's location data. In addition to storing the protection monitoring data of the target monitoring object in the user database, the cloud server is also used to transmit protection monitoring data and various alert data, as well as to perform anomaly detection for temperature and status data. Furthermore, it uses data from the user database to train various intelligent models in the intelligent recognition module of the processor, such as training a temperature anomaly detection model and a status anomaly detection model. The cloud server is also used to send body temperature data and abnormal alerts to mobile terminals, which then display the body temperature curve and provide alerts for any abnormalities.

[0113] In some embodiments, the process of body temperature monitoring is as follows: First, the location of the target monitoring object is located based on infrared image data using image algorithms to determine the temperature measurement point. The temperature data of the temperature measurement point is read, and the validity of the temperature measurement data is determined through big data analysis. This process is repeated continuously to draw a time-temperature curve. Through early big data learning and later training, it is possible to make intelligent judgments on whether there is an abnormality in body temperature. A body temperature curve is drawn based on the recorded valid body temperature data, and long-term body temperature data can be saved to generate a body temperature report for easy comparison and use in body temperature management.

[0114] like Figure 12 The diagram illustrates the workflow of a system using the thermal imaging protection monitoring method provided in this application. First, the state recognition module identifies and judges the state. If the target monitored object is currently in a non-sleep state, such as an abnormal state like falling or crying, or if there is a state change, abnormal state alert data (i.e., an alert) and state change alert data are generated and sent to the cloud server. If the current state is sleep, the blanket-kicking model in the state recognition module needs to judge the blanket-kicking behavior based on infrared image data. If the judgment result indicates that a blanket-kicking action has occurred, blanket-kicking alert data is generated and sent to the cloud server. The cloud server then sends the received alert data to the terminal device, where the corresponding alert is displayed by the terminal device's app.

[0115] In some embodiments, the process of status protection monitoring includes: first, determining whether the target is active, crying, fallen, asleep, or in another state through sound recognition and trajectory recognition; the APP will push a reminder when the target's state changes; and some abnormal situations can be automatically generated for video playback. Based on the status recognition results, the target's sleep time can be recorded and a sleep report generated. If the target is asleep, a blanket-kicking detection algorithm is used. The blanket-kicking detection model learns the heat source area change pattern of the monitored object through training to determine if there is a blanket-kicking action. If blanket-kicking is detected, the APP pushes a reminder. A user database can be deployed on a cloud server to collect user body temperature data for training the body temperature and status judgment models. Through training, the model can make judgments more relevant to the target. Different databases can be established for different targets to achieve personalized customization. It is recommended that the user database be deployed in the cloud for data transmission and storage. Additionally, the body temperature monitoring module and status recognition module can also be deployed in the cloud for data processing. The terminal device is used to display the monitoring footage captured by the infrared camera and to query body temperature reports, sleep reports, abnormal alerts, and abnormal playback, providing a clearer understanding of the target's health status.

[0116] Please see Figure 13 The diagram shown illustrates the workflow of an intelligent identification module in an infrared thermal imaging protection and monitoring system according to some embodiments of this application. In this embodiment, the intelligent identification module in the infrared thermal imaging protection and monitoring system refers to a module capable of receiving and processing data (infrared images) provided by a monitoring camera (infrared acquisition device). This module can be divided into three parts: a body temperature monitoring module, a status recognition monitoring module, and a user database. These three modules can be integrated together or separately on the monitoring camera, deployed on a cloud server, or embedded in a mobile device. The following describes the process in conjunction with... Figure 13 These three modules will be described in detail below. It should be noted that in the embodiments described below, the target monitoring object is a person, and is described as the monitored person; in other embodiments, the target monitoring object is not limited to a person.

[0117] The body temperature monitoring module is used to establish a working human body model diagram based on the mapping relationship between temperature and various body parts in a human body reference temperature feature map that characterizes the temperature distribution of different body parts. This model diagram establishes the mapping relationship between body parts and body temperature. However, based on the location of the target temperature measurement site, a fixed temperature measurement point is selected in the working human body model diagram. This point is used to monitor the body temperature of the monitored individual. After determining the fixed temperature measurement point, the corresponding temperature is read from the working human body model diagram based on the location information of this fixed temperature measurement point (target temperature measurement location data) to obtain the temperature protection monitoring data of the monitored object.

[0118] The status recognition and monitoring module is used to characterize the overall temperature (target temperature data) of the monitored object, and to generate a reference body temperature feature map (i.e., a human standard body temperature reference template) based on the temperature distribution of different components of the monitored object. Figure 13 The system uses a human body temperature feature template to depict the human body temperature feature map (target body temperature feature data) of the monitored object. Based on the recognition of infrared images, it determines the posture of the monitored object (including the monitored person's movements and shape) and the feature information of each component part (e.g., eyes, nose, ears, arms, etc.). It determines the position information of the temperature measurement target part in the infrared image under different postures, realizing that the temperature measurement point comes from the same component part under different postures, ensuring the consistency of temperature measurement position, and reducing the error caused by different morphological features. Obviously, the body temperature monitoring module and the state recognition monitoring module provided in this application embodiment complement each other, jointly constructing a body temperature-body posture mapping relationship map (target body temperature feature data corresponding to different postures) in order to accurately obtain the target monitoring temperature of the monitored person.

[0119] The user database is used to collect user body temperature data for training body temperature and status judgment models. Through training, the model can make judgments that are more in line with the target. Different databases are established for different targets to achieve personalized customization.

[0120] Furthermore, the infrared thermal imaging protection and monitoring system provided in this application embodiment also includes a cloud server and a mobile terminal. The cloud server is used for data transmission and storage, and for establishing a user database. Additionally, the user database, body temperature monitoring module, and status recognition module can also be deployed in the cloud for data processing. The mobile terminal is used to display the monitoring images captured by the infrared camera, as well as body temperature, posture, and status information.

[0121] Based on the above introduction to each module and Figure 13As shown in the embodiment of this application, the working process of the infrared thermal imaging protection and monitoring system is as follows: A body temperature monitoring module locates the target monitoring object in the infrared image, and based on the location, reads the temperature from the temperature distribution data corresponding to the infrared image to obtain the temperature belonging to the target monitoring object, i.e., the target temperature data. A state recognition module identifies the limbs, organs, and other morphological features of the monitored person based on the infrared image, obtaining the target morphological feature data of the target monitoring object. Then, based on the target temperature data, target morphological feature data, and human body temperature feature template (reference body temperature feature data), a mapping is performed between the components of the monitored object and the temperature to draw a human body temperature model (target body temperature feature data under the corresponding posture). Then, based on the human body temperature model, the temperature measurement location is determined, and temperature is measured at the measurement location to obtain the target monitoring temperature. Furthermore, based on the human body temperature model, the state of the monitored person is judged, i.e., an abnormal state judgment is performed, and the corresponding judgment result is obtained. Finally, the obtained target monitoring temperature and / or anomaly judgment results are input into the user database for storage. The user database then transmits the target monitoring temperature and / or anomaly judgment results to the mobile terminal or cloud server for processing. In addition, the user database stores big data on human body temperature characteristics. Based on this data, big data analysis is performed on the target temperature data of the monitored person to determine whether the target temperature data is normal. Furthermore, the training dataset stored in the user database can be used to train the temperature monitoring module and the state recognition monitoring module, and the trained model can be ported to the mobile terminal or cloud server. In some embodiments, the monitored person's body temperature curve and its corresponding anomaly alerts (including temperature anomalies and state anomalies) are displayed on the mobile terminal's screen.

[0122] The infrared thermal imaging protection and monitoring method provided in this application can be used to monitor patient care in wards. It can monitor patient body temperature in real time. For example, patients who have just undergone surgery need to have their body temperature measured regularly. Through this system, the body temperature curve can be tracked in real time. The mobile terminal is installed at the nurses' station, and the nurses' station will receive an alert when the body temperature is abnormal. Nurses can also keep track of the patient's basic movements through infrared imaging, relieving the pressure on medical staff. Furthermore, infrared images protect patient privacy to a certain extent. It can be integrated with other intelligent systems to realize intelligent wards. The infrared thermal imaging protection and monitoring method provided in this application can also be used for child care. The system helps parents keep track of their child's real-time body temperature. If abnormalities occur, they can be detected and dealt with in a timely manner. When a child has a fever, their status can be monitored in real time through the mobile terminal, eliminating the need to get up at regular intervals to manually measure their body temperature. The system can also track the child's daily routine and protect the child's privacy to a certain extent. It is also applicable to older children, helping parents relieve the pressure of childcare.

[0123] In summary, the infrared thermal imaging protection and monitoring method and system provided in the embodiments of this application bring at least one of the following beneficial effects in some embodiments:

[0124] 1. By combining infrared images and temperature data, a body temperature-body state model of the target is established through mapping relationships, which facilitates temperature monitoring and status monitoring.

[0125] 2. Based on the target morphological feature data of the target monitoring object, accurately determine the fixed temperature measurement location and improve the accuracy of temperature monitoring.

[0126] 3. Non-contact body temperature monitoring is achieved through infrared thermal imaging, which can monitor the body temperature of the target object in real time.

[0127] 4. By performing status recognition on infrared images and obtaining a body temperature-body posture model based on the recognized status and determined temperature, abnormal body postures can be detected based on this model to issue an alert, effectively improving the monitoring performance of the target monitoring object.

[0128] This application also provides a computer-readable storage medium storing a computer program. When executed by a processor, this computer program implements the various processes of the above-described infrared thermal imaging protection and monitoring method embodiments, achieving the same technical effects. To avoid repetition, further details are omitted here. The computer-readable storage medium may be a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, etc.

[0129] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. An infrared thermal imaging protection and monitoring method, characterized in that, include: Acquire infrared images containing the target monitoring object; The infrared image is identified to determine the location data of the target monitored object in the infrared image and the target morphological feature data of the target monitored object; Based on the location data and the temperature distribution data mapped from the infrared image, the target temperature data of the target monitored object is obtained; the location data includes the overall outline of the target monitored object and the location information of its constituent parts in the infrared image. Based on the target temperature data and reference body temperature characteristic data, the relationship between the temperature and each component of the target monitoring object is determined, and the target body temperature characteristic data of the target monitoring object is obtained. Based on the posture indicated by the target morphological feature data, obtain the target body temperature feature data corresponding to the target monitoring object under different postures; The target morphological feature data includes the posture information of the target monitored object and the information of its constituent parts under different postures; Based on the target morphological feature data, the position information of each component of the target monitoring object under different postures is determined, and the position information of the temperature measurement target part is determined from it as the target temperature measurement position data; and based on the target temperature measurement position data, the temperature corresponding to the target temperature measurement position data is read from the target body temperature feature data corresponding to the target morphological feature data, so as to obtain the temperature protection monitoring data of the target monitoring object.

2. The infrared thermal imaging protection and monitoring method according to claim 1, characterized in that, The temperature distribution data mapped by the infrared image is NUC data obtained by the infrared image acquisition device used to acquire the infrared image.

3. The infrared thermal imaging protection and monitoring method according to claim 1, characterized in that, The step of identifying the infrared image and determining the location data of the target monitored object in the infrared image and the target morphological feature data of the target monitored object includes: The infrared image is identified to determine the overall outline of the target monitored object and the position data of the overall outline in the infrared image. Based on the overall contour, the target morphological feature data of the target monitoring object is determined. The target morphological feature data includes the feature data of each component of the overall contour and the posture feature data of the target monitoring object.

4. The infrared thermal imaging protection and monitoring method according to claim 1, characterized in that, The step of obtaining temperature protection monitoring data for the target monitored object by reading the temperature corresponding to the target temperature measurement location data from the target body temperature feature data corresponding to the target morphological feature data based on the target temperature measurement location data includes: Based on the target temperature measurement location data, the temperature corresponding to the target temperature measurement location data is read from the target body temperature characteristic data and used as the target monitoring temperature data of the target monitoring object; Based on the target monitoring temperature data of the target monitoring object within a specified period, obtain the temperature protection monitoring data of the target monitoring object.

5. The infrared thermal imaging protection and monitoring method according to claim 4, characterized in that, The step of obtaining temperature protection monitoring data of the target monitoring object based on the target monitoring temperature data of the target monitoring object within a specified period includes: Based on the changes in the target monitoring temperature data corresponding to the target temperature measurement location data within a specified period, the target monitoring temperature change curve of the target monitoring object is obtained.

6. The infrared thermal imaging protection and monitoring method according to claim 4, characterized in that, Also includes: When it is determined that there is a temperature anomaly in the target monitored object based on the target monitored temperature data, a temperature anomaly alert is generated.

7. The infrared thermal imaging protection and monitoring method according to claim 6, characterized in that, When it is determined from the target monitoring temperature data that there is a temperature anomaly corresponding to the target monitoring object, the generation of temperature anomaly alert data includes: Based on whether the current target monitoring temperature data of the target monitoring object meets the preset temperature conditions and / or whether the change of the target monitoring temperature data within a specified period meets the preset change conditions, it is determined whether the target monitoring object has a temperature abnormality. If so, temperature abnormality alert data is generated.

8. The infrared thermal imaging protection and monitoring method according to claim 1, characterized in that, The step of obtaining the target temperature data of the target monitored object based on the location data and the temperature distribution data mapped from the infrared image includes: Based on the location data, read the temperature data corresponding to the location data from the temperature distribution data; Determine whether the temperature data corresponding to the location data meets the preset temperature data; When the temperature data corresponding to the location data meets the preset temperature data, the temperature data corresponding to the location data is used as the target temperature data of the target monitoring object; If the temperature data corresponding to the location data does not meet the preset temperature data, the process returns to identifying the infrared image and determining the location data of the target monitoring object in the infrared image.

9. The infrared thermal imaging protection and monitoring method according to claim 8, characterized in that, The determination of whether the temperature data corresponding to the location data meets the preset temperature data includes: The temperature data corresponding to the location data is input into the trained temperature judgment model to obtain the judgment result data on whether the temperature data corresponding to the location data meets the preset temperature data.

10. The infrared thermal imaging protection and monitoring method according to claim 1, characterized in that, Also includes: Based on the category of the target monitoring object, the temperature protection monitoring data of the target monitoring object is stored in the corresponding user database.

11. The infrared thermal imaging protection and monitoring method according to claim 1, characterized in that, After identifying the infrared image and determining the location data of the target monitored object in the infrared image and the target morphological feature data of the target monitored object, the method further includes: Based on the target morphological feature data of the monitored object, determine whether the state of the monitored object has changed; if so, generate state change alert data; and / or, Based on the target morphological feature data of the target monitored object, determine whether the target monitored object is in an abnormal state. If so, generate abnormal state alert data.

12. The infrared thermal imaging protection and monitoring method according to claim 1, characterized in that, After identifying the infrared image and determining the location data of the target monitored object in the infrared image and the target morphological feature data of the target monitored object, the method further includes: Based on the target morphological feature data, determine whether the target being monitored is in a sleep state; When the target monitored object is in a sleeping state, the infrared image data is input into the trained blanket-kicking judgment model to determine whether the target monitored object has kicked off the blanket. If so, blanket-kicking reminder data is generated.

13. An infrared thermal imaging protection and monitoring device, characterized in that, include: The image acquisition module is used to acquire infrared images containing the target monitoring object; The identification module is used to identify the infrared image and determine the location data of the target monitoring object in the infrared image and the target morphological feature data of the target monitoring object; The temperature acquisition module is used to obtain the target temperature data of the target monitored object based on the location data and the temperature distribution data mapped from the infrared image; the location data includes the overall outline of the target monitored object and the position information of its constituent parts in the infrared image; The status acquisition module is used to determine the relationship between the temperature of each component of the target monitoring object and the target body temperature characteristic data based on the target temperature data and the reference body temperature characteristic data, and to obtain the target body temperature characteristic data of the target monitoring object. Based on the posture indicated by the target morphological feature data, obtain the target body temperature feature data corresponding to the target monitoring object under different postures; The target morphological feature data includes the posture information of the target monitored object and the information of its constituent parts under different postures; The temperature monitoring module is used to determine the position information of each component of the target monitored object in different postures based on the target morphological feature data, and determine the position information of the temperature measurement target part as the target temperature measurement position data; and based on the target temperature measurement position data, read the temperature corresponding to the target temperature measurement position data from the target body temperature feature data corresponding to the target morphological feature data, and obtain the temperature protection monitoring data of the target monitored object.

14. An infrared thermal imaging protection and monitoring device, characterized in that, The method includes a memory and a processor. The memory stores a computer program that can be executed by the processor. When the computer program is executed by the processor, it implements the infrared thermal imaging protection and monitoring method as described in any one of claims 1 to 12.

15. An infrared thermal imaging protection and monitoring system, characterized in that, This includes infrared acquisition devices, processors, cloud servers, and terminal devices; The infrared acquisition device is used to acquire infrared data of the monitored area and send the infrared data to the processor; The processor processes the infrared data according to any one of claims 1 to 12 to obtain corresponding processed data, the processed data including corresponding protection and monitoring data and / or corresponding reminder data; The cloud server is used to acquire the processed data and send the processed data to the terminal device; The terminal device is used to display the processed data.

16. The infrared thermal imaging protection and monitoring system according to claim 15, characterized in that, The cloud server is also used to classify and store the processed data according to the category of the target monitored object.

17. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, implements the infrared thermal imaging protection and monitoring method as described in any one of claims 1 to 12.

Images