Excessive heating prevention device and heating system

The overheating prevention device uses an infrared array sensor and AI image processing to detect user presence and cooking operations, addressing the challenge of preventing overheating in heating systems without hindering user convenience by adjusting heating output accordingly.

WO2024247026A1PCT designated stage expired Publication Date: 2024-12-05MITSUBISHI ELECTRIC CORP
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/JP2023/019867
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-29
Publication Date
2024-12-05

AI Technical Summary

Technical Problem

Existing heating systems face challenges in accurately detecting the presence of a user to prevent overheating without impairing user convenience, as body surface temperature can rise due to heat emitted from heating devices or objects, leading to false detection and potential interference with user operations.

Method used

An overheating prevention device equipped with an infrared array sensor above the cooking device to detect the temperature of both the object and the user, using AI for image processing to determine if a cooking operation is being performed, and adjusting heating output based on user presence and operation information.

Benefits of technology

Accurately determines user presence and cooking operations, preventing excessive heating while maintaining user convenience by automatically adjusting heating power only when necessary, enhancing safety and reducing energy consumption.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure JP2023019867_05122024_PF_FP_ABST
    Figure JP2023019867_05122024_PF_FP_ABST
Patent Text Reader

Abstract

The present invention comprises: an infrared imaging device (300) that is disposed at a distant position above a heating unit (21) so that the heating unit (21) and a user are inside an imaging range; a temperature calculation unit (7) that calculates the temperature of an object to be heated on the basis of a thermal image obtained from the infrared imaging device (300); a human detection unit (6) that detects the presence of the user on the basis of the thermal image; and a control unit (2) that controls operation of the heating unit (21) via the communication unit (4) on the basis of information regarding an operation by the user obtained from a heating device (200) via a communication unit (4), the user detection result obtained from the human detection unit (6), and the temperature information of the object to be heated obtained from the temperature calculation unit (7).
Need to check novelty before this filing date? Find Prior Art

Description

Overheat protection and heating system

[0001] This application relates to an overheating prevention device and heating system.

[0002] To prevent users from forgetting to turn off heating devices, they often have safety devices that detect the presence of a person (user) nearby and adjust the temperature or extinguish the fire. There is also a need for real-time, non-contact measurement of the temperature of the object to be heated in order to control the output of the heating device. However, if the heating power is automatically adjusted while the user is operating the heating device, it can interfere with the user's operation and actually reduce user convenience.

[0003] Therefore, a cooking device has been proposed (see, for example, Patent Document 1) that installs an infrared array sensor above the cooking device to simultaneously detect the temperature of the heated object and people, and determines whether cooking is being performed based on the area over which the temperature of the heated object changes.

[0004] JP 2021-34222 A (paragraphs 0027 to 0028, Figures 1, 0069 to 0075, Figure 12)

[0005] However, because body surface temperature can rise due to heat emitted from a heating device or heated object, setting a temperature threshold for human detection using only temperature information is complicated. Also, temperature information from each pixel alone can falsely detect heat sources other than a human, making it difficult to accurately detect the presence or absence of a user.

[0006] The present application discloses technology for solving the above-mentioned problems, and aims to provide an overheating prevention device and heating system that prevent overheating without compromising user convenience.

[0007] The overheating prevention device disclosed in the present application is characterized by comprising a communication unit that communicates with a heating device, a heating unit that heats an object to be heated by the heating device and an infrared imaging device that is installed at a position above the heating unit so that the user operating the heating device is within the imaging range, a temperature calculation unit that calculates the temperature of the object to be heated based on a thermal image obtained from the infrared imaging device, a human detection unit that detects the presence of the user based on the thermal image, and a control unit that controls the operation of the heating unit via the communication unit based on information regarding the user's operation obtained from the heating device via the communication unit, the user detection result obtained from the human detection unit, and the temperature information of the object to be heated obtained from the temperature calculation unit.

[0008] The overheating prevention device and heating system disclosed in the present application can accurately determine whether the user is performing cooking operations, thereby providing an overheating prevention device and heating system that prevents overheating without compromising user convenience.

[0009] 11A and 11B are side views for explaining a situation in which an adult and a child are standing in front of the heating device according to the second embodiment. 11A and 11B are side views for explaining a situation in which an adult and a child are standing in front of the heating device according to the second embodiment. 12A and 12B are schematic views for explaining a situation in which an adult and a child are standing in front of the heating device according to the second embodiment. 12B are schematic views for explaining a situation in which an adult and a child are standing in front of the heating device according to the second embodiment. 12C are schematic views for explaining a situation in which an adult and a child are standing in front of the heating device according to the second embodiment. 12D are schematic views for explaining a situation in which an adult and a child are standing in front of the heating device according to the second embodiment. 12E are flowcharts for explaining a situation in which an adult and a child are standing in front of the heating device according to the second embodiment. 12F are flowcharts for explaining a situation in which an adult and a child are standing in front of the heating device according to the second embodiment. 12G are flowcharts for explaining a situation in which an adult and a child are standing in front of the heating device according to the second embodiment. 12G are schematic views ... 16A and 16B are diagrams showing a thermal image and a corrected thermal image obtained when a high-temperature heated object and a user are simultaneously captured in a heating system according to a fourth embodiment. A flowchart showing the operation of a heating system according to the fourth embodiment. A flowchart showing the operation of a heating system according to the fifth embodiment. A side view for explaining a situation when a user is standing in front of a heating device and cooking in a heating system according to a sixth embodiment. A block diagram showing the configuration of a heating system configured using an overheating prevention device according to the sixth embodiment.

[0010] The overheating prevention device of the present application and a heating system configured using the same will be described with reference to the drawings. Note that similar or corresponding components are given the same reference numerals, and repeated explanations may be omitted. Furthermore, the embodiments shown below are merely examples, and the present application is not limited to these embodiments.

[0011] 1 to 8 are diagrams for explaining the configuration and operation of an overheating prevention device according to a first embodiment and a heating system configured using the same, with Fig. 1 being a block diagram showing the configuration of a heating system in which an overheating prevention device and a heating device cooperate by being connected via a network via communication, and Fig. 2 being a block diagram showing the configuration of a heating system in which an overheating prevention device according to a modified example, a heating device, and a server cooperate by being connected via a network via communication.

[0012] Fig. 3 is a schematic diagram showing the configuration of an infrared imaging device constituting the overheating prevention device, Fig. 4 is a diagram showing an example of an infrared image obtained when a line image is taken of a user and an object to be heated, Fig. 5 is a side view showing an example of the arrangement of a heating system together with a user, and Fig. 6 is a schematic side view showing the configuration of an overheating prevention device according to a modified example. Furthermore, Fig. 7 is a flowchart showing the operation of the heating system, and Fig. 8 is a flowchart showing the operation of a heating system according to a second modified example.

[0013] As shown in FIG. 1, the heating system according to the first embodiment includes a heating device 200 having a heating section 21 that performs heating, and an overheating prevention device 100 that communicates with the heating device 200 and controls the operation of the heating device 200.

[0014] The overheating prevention device 100 includes an infrared imaging device 300 that acquires signals for generating a thermal image, a thermal image generation unit 5 that generates a thermal image from the acquired signal to detect the presence of a user, and a temperature calculation unit 7 that calculates the temperature of the heated object from the signal. It also includes a communication unit 4 that communicates with the heating device 200, and a control unit 2 that controls the device itself and controls the heating device 200 via the communication unit 4 based on user presence information from the human detection unit 6 and temperature information of the heated object from the temperature calculation unit 7. It also includes a memory unit 8 that stores programs or data required for calculations. It may also include a light source 9, such as an LED (light-emitting diode), to illuminate the heated object and the user.

[0015] The operation unit 1 may be an interface capable of inputting and displaying information, such as a touch panel, or a physical interface, such as a button or lever. The control unit 2 and the control unit 23 of the heating device 200 are processing devices configured with a CPU (Central Processing Unit), an MCU (Micro Controller Unit), an MPU (Micro Processor Unit), an FPGA (Field-Programmable Gate Array), an ASIC (Application Specific Integrated Circuit), or the like. The storage unit 8 is, for example, a flash memory.

[0016] The human detection unit 6 uses AI (artificial intelligence) image processing to detect the presence or absence of a human user and their behavior from the thermal image. Deep learning techniques such as SSD (Single Shot Multi Box Detector) or YOLO (You Only Look Once) can be applied to the AI ​​image processing.

[0017] Heating device 200 has a function of increasing the temperature of an object to be heated that is in contact with or in proximity to it by using flame, hot air, induction heating, or other methods, and includes heating unit 21 that heats the object to be heated. It also includes operation unit 24 that accepts user operations, and control unit 23 that controls the operation of heating unit 21 based on the operation content of operation unit 24 and instructions from overheating prevention device 100.

[0018] It also has a communication unit 25 that communicates with the overheating prevention device 100 (communication unit 4), and information is transmitted to and from the communication unit 4 via a wireless connection such as Wi-Fi (registered trademark), Bluetooth (registered trademark), 4G or 5G, or via a wired connection such as a communication cable or wired LAN.

[0019] The heating device also includes a storage unit 22 that stores data including programs required for control and recipe information describing heating conditions, etc. Furthermore, it may also include a sensor 26 that detects pressure applied to a table for placing the object to be heated, a trivet, etc. (not shown).

[0020] The heating device 200 can control the heat power based on the temperature information obtained from the temperature calculation unit 7 of the overheating prevention device 100 so as to reproduce a recipe selected by operating the operation unit 24 from the recipe information stored in the memory unit 22.

[0021] The human detection unit 6 that performs image processing using AI may be installed outside the overheating prevention device 100. For example, as shown in the modified example in FIG. 2, the thermal image generation unit 5 and the human detection unit 6 may be relocated to a server 500 as a thermal image generation unit 52 and a human detection unit 55, and a memory unit 54, a setting unit 51, and a communication unit 53 may be provided. Information from the infrared imaging device 300 may be transmitted to the server 500 via the communication unit 4, and after image processing using AI is performed by the human detection unit 55 installed in the server 500, the detection results may be transmitted to the overheating prevention device 100.

[0022] 3, the infrared imaging device 300 includes an infrared imaging element 32 having a matrix of pixels that absorb infrared light and output an electrical signal corresponding to the energy of the infrared light, and an infrared-transmitting lens 31 that focuses the incident infrared light on the infrared imaging element 32. The device also includes an ADC 33 (analog-to-digital converter) that converts the analog signal for each pixel output from the infrared imaging element 32 into a digital signal, a frame memory 34, and an FPN memory 35. The device may also include a light-shielding member 36 and a reference temperature detector 37 for acquiring a reference thermal image.

[0023] The thermal image is, for example, a grayscale image with brightness values ​​corresponding to the temperature of the heat source, as shown in Figure 4. A method for acquiring a thermal image using the infrared imaging device 300 will now be described. Note that the term "thermal image" in this "thermal image acquisition method" refers to the signals used to generate a two-dimensional thermal image in the thermal image generation unit 5. While not strictly an image, it will be described as an "image" for ease of intuitive understanding. Each pixel of the infrared imaging element 32 has different sensitivity to the amount of light, output offset for each pixel, and temperature characteristics of these. Therefore, a reference thermal image is acquired and saved in advance, and a thermal image is obtained by outputting the difference between the reference thermal image and the input signal from the subject.

[0024] In one example of a method for acquiring a reference thermal image, an image is captured for a predetermined period of time with the infrared-transmitting lens 31 covered with the light-shielding member 36. The captured data is averaged over a preset number of frames and stored in the FPN memory 35 for use as the reference thermal image. The temperature of the light-shielding member 36 is measured by the reference temperature detector 37 and recorded in the FPN memory 35 as the reference temperature.

[0025] The light-shielding member 36 is, for example, a mechanical shutter made of a black-painted aluminum plate. The reference temperature detection unit 37 is, for example, a temperature integrated circuit (IC) attached to the mechanical shutter with thermal conductive tape. Since the output from each pixel is a relative brightness value based on the reference thermal image, it is necessary to perform calculations using the reference temperature to convert it to temperature.

[0026] Alternatively, a member of a uniform temperature may be photographed during pre-shipment inspection at the factory of the infrared imaging device 300, and the thermal image and temperature of the member taken at that time may be stored as a reference thermal image and reference temperature in the FPN memory 35. In this case, the light-shielding member 36 and the reference temperature detector 37 are not required.

[0027] Next, an image of the object to be measured is captured. The infrared light incident on the infrared transmitting lens 31 is imaged on the infrared imaging element 32. The infrared imaging element 32 can be a microbolometer, a thermopile, a thermal diode, or the like, which has a two-dimensionally arranged focal plane array (FPA) structure.

[0028] Each pixel of the infrared imaging element 32 absorbs infrared rays and outputs an electrical signal corresponding to the energy of the absorbed infrared rays. This signal is amplified and converted into a digital signal by the ADC 33 and input to the frame memory 34. The frame memory 34 records the difference between the reference thermal image recorded in the FPN memory 35 and the resulting image. By outputting this to the outside, a two-dimensional thermal image can be obtained.

[0029] When the temperature of the infrared imaging element 32 changes due to self-heating of the infrared imaging element 32 and the ADC 33, or changes in the environmental temperature, the temperature of the photographed subject appears to have changed on the thermal image. To correct this, the temperature change of the infrared imaging element 32 may be read by an element temperature detection unit (not shown) installed near the element, and input and recorded in the frame memory 34, and the thermal image may be corrected.

[0030] In the heating system according to the first embodiment, as shown in FIG. 5, the overheating prevention device 100 incorporating the infrared imaging device 300 is installed above the heating device 200, and is adjusted in position and angle so that the heating unit and the user standing in front of it are within the imaging range.

[0031] On the other hand, in addition to steam and smoke rising from the heated object heated by the heating device 200, oil splashes may occur. Therefore, oil, soot, water droplets, etc. may adhere to the infrared-transmitting lens 31 of the infrared imaging device 300 installed above the heated part, and if this adhesion occurs, the transmittance of infrared rays may decrease, reducing the accuracy of temperature measurement and causing malfunction of the internal circuitry.

[0032] Therefore, in order to prevent these from adhering to the infrared imaging device 300, a protective member 10 may be attached to the front surface 300f of the infrared imaging device 300, as shown in Fig. 6. Furthermore, since the light source 9 for illuminating the heated object is also similarly affected by oil, water droplets, etc., a protective member 10 may also be disposed on the front surface 9f. It is preferable to use a material with high infrared transmittance for the protective member 10, such as silicon, germanium, or high density poly-ethylene (HDPE).

[0033] Based on the above-described configuration, automatic heating control in the heating system according to the first embodiment will be described with reference to the flowchart in Fig. 7. First, the control unit 2 determines whether heating has started based on a signal from the heating device 200 (step S100). The determination of whether heating has started may be triggered by, for example, the power or heating start button being turned on in the operation unit 24 of the heating device 200. Note that the determination of whether heating has ended (step S800), which will be described later, can also be triggered by, for example, the power being turned off or the heating end button being operated.

[0034] When heating starts ("Yes" in step S100), thermal image capture by the infrared imaging device 300 starts (step S110). Infrared rays emitted from the heated object and the user (person) are converted into electrical signals by the infrared imaging device 300 and output as digital signals. Using these digital signals, the temperature calculation unit 7 calculates the temperature (step S120).

[0035] A conversion formula from the digital signal value (brightness value) to the object temperature, or a table of correction coefficients used for conversion, is stored in advance in the memory unit 8. Information on the calculated temperature is sent to the control unit 2, which determines whether an abnormal temperature has been detected based on whether the calculated temperature is higher than a reference value (step S200).

[0036] If an abnormally high temperature is detected ("Yes" in step S200), the control unit 2 adjusts or stops (powers off) the output of the heating unit 21 via the control unit 23 of the heating device 200 (step S250). Then, the process proceeds to step S110.

[0037] On the other hand, if no abnormally high temperature is detected ("No" in step S200), the signal output from the infrared imaging device 300 is converted into a thermal image for detecting a user by the thermal image generation unit 5 and output to the human detection unit 6.

[0038] The human detection unit 6 determines whether a user is present in the thermal image through image processing using AI (step S210). The trained AI model used for human detection is stored in advance in the storage unit 8. When using the server 500 as described in FIG. 2, the AI ​​model may be stored in the storage unit 54 of the server 500. Furthermore, the AI ​​model may be updated to the latest version via a cloud (not shown).

[0039] The determination result of whether or not a user is present (human detection result) is sent to the control unit 2, and if a user is present ("Yes" in step S300), the process proceeds to step S110. On the other hand, if a user is not present ("No" in step S300), the output of the heating device 200 is automatically adjusted based on the recipe information stored in the memory unit 22 of the heating device 200 (because an abnormal temperature has not been detected) (step S700).

[0040] The process from step S110 onwards is repeated until it is determined that heating has finished (step S800 becomes "Yes"), thereby reliably preventing excessive heating and supporting cooking work without interfering with the user's operation.

[0041] The AI ​​model stored in the storage unit 8 and the image processing performed by the human detection unit 6 may be configured to determine whether the user is facing the heating device 200. As a second modified example, heating control utilizing information on whether the user is facing the heating device 200 will be described with reference to the flowchart in FIG.

[0042] 8 is the same as the flow described in FIG. 7 except that step S320 is inserted between step S300 and step S700, and therefore a description of the similar parts will be omitted. If a user is present in step S300 ("Yes"), the human detection unit 6 determines whether the person is facing the heating device 200 (step S320).

[0043] Even if a user is present in front of the heating device 200, if the person is facing away from the heating device 200 ("No" in step S320), the automatic control of the heating device 200 is performed in the same way as when the user is not present (step S700). On the other hand, if the person is facing the heating device ("Yes" in step S320), the process proceeds to step S110.

[0044] It is also possible to combine the human detection information from the human detection unit 6 with information from the temperature calculation unit 7 to determine whether the temperature of the detected object is within a predetermined range of human body surface temperatures, and then output the result as user presence / absence information. Also, in step S320, it is also possible to determine whether a pressure change of a certain level or more is occurring from the signal from the sensor 26 of the heating device 200, thereby determining whether the user is operating the heating device 200, i.e., whether the user is approaching the heating device 200.

[0045] By configuring the heating system as described above, it is possible to obtain the temperature of the object to be heated and information on the presence or absence of a user in front of the heating device 200 with a single infrared imaging device 300. Since there is no need to combine multiple sensors or cameras, the system can be made smaller and simpler.

[0046] By utilizing the temperature information, it is possible to improve the safety of the heating device 200 by detecting if the heating device 200 has been left on or if abnormal heat is generated, and it is also possible to reduce labor and energy consumption through automatic temperature control. In addition, since the temperature can be measured without contact, it is possible to reduce the labor required for equipment maintenance compared to using a contact thermometer.

[0047] By utilizing user presence information extracted from thermal images using AI image processing, the temperature is automatically adjusted only when the user is not in front of the heating device 200, preventing temperature adjustments that are contrary to the user's intentions. As a result, it is possible to support heating work without compromising the convenience of the heating system for the user.

[0048] Furthermore, by determining whether the user is facing the heating device 200 in addition to whether the user is present, it is possible to prevent automatic control from being stopped by mistakenly determining that a person who is close to the heating device 200 but not looking at it is working. Furthermore, compared to when the device is attached to the heating device 200 and the temperature of the heated object is measured from below, it is possible to measure the temperature distribution and surface condition of the heated object, improving the controllability of the heating device 200 and enabling early detection of excessive heating. Furthermore, by utilizing body surface temperature information to determine whether or not a person is present, detection accuracy can be further improved.

[0049] In the case where the part of the heating system that executes calculation processing is configured using software using a microcomputer, it may be possible to configure it as a single piece of hardware 2H that includes a processor 2H0 and a storage device 2H1, as shown in Fig. 9. Although not shown, the storage device 2H1 includes a volatile storage device such as a random access memory and a non-volatile auxiliary storage device such as a flash memory.

[0050] Furthermore, a hard disk auxiliary storage device may be provided instead of flash memory. The processor 2H0 executes a program input from the storage device 2H1. In this case, the program is input from the auxiliary storage device to the processor 2H0 via a volatile storage device. The processor 2H0 may output data such as calculation results to the volatile storage device of the storage device 2H1, or may store the data in the auxiliary storage device via the volatile storage device.

[0051] By connecting the devices equipped with this hardware 2H (overheating prevention device 100, heating device 200, server 500) to a network via communication, it is possible to construct a heating system of the present application, not limited to embodiment 1.

[0052] Embodiment 2. In this embodiment 2, an example will be described in which a notification function is provided to the heating system described in embodiment 1. Figures 10 to 13 are used to explain the configuration and operation of the heating system according to embodiment 2, with Figure 10 being a block diagram corresponding to Figure 1 showing the configuration of a heating system configured using an overheating prevention device, Figure 11A being a side view illustrating the situation when an adult stands in front of the heating device, and Figure 11B being a side view corresponding to Figure 11A illustrating the situation when a child stands in front of the heating device.

[0053] 12A is a schematic diagram illustrating a thermal image acquired when an adult stands in front of the heating device, and FIG. 12B is a schematic diagram corresponding to FIG. 12A illustrating a thermal image acquired when a child stands in front of the heating device. FIG. 13 is a flowchart illustrating the operation of the heating system. In the second embodiment, the basic configuration of each device constituting the heating system is the same as in the first embodiment, and FIGS. 2 to 6 are used.

[0054] As shown in Fig. 10, the overheating prevention device 100 constituting the heating system according to the second embodiment is configured by adding a notification unit 11 to the overheating prevention device described in Fig. 1. The AI ​​model stored in the memory unit 8 and the image analysis performed by the human detection unit 6 are also provided with a function for distinguishing between adults and children. The notification unit 11 has a function for issuing a warning sound or an alarm such as a notification to a smartphone if a child is detected during heating.

[0055] 11A and 11B, the infrared imaging device 300 built into the overheating prevention device 100 is attached directly above the object to be heated, and its position and angle are adjusted so that it can capture an image of a user standing in front of the object to be heated and the heating device 200, which is a cooking device. Examples of thermal images of an adult and a child captured by the infrared imaging device 300 are shown in Figures 12A and 12B. To improve the accuracy of distinguishing between adults and children, the angle of view of the infrared imaging device 300 may be adjusted so that the entire head of an adult is not captured in the image, but the entire head of a child is captured.

[0056] The heating control using the identification information to distinguish between adults and children will be described with reference to the flowchart in Figure 13. In the flow in Figure 13, steps S400 to S420 have been inserted between step S300 ("yes") and step S800. If the answer is "yes" in step S300, the process proceeds to steps S400 to S420 instead of step S110. The flow is the same as that described in Figure 7, except that the same parts will not be described again.

[0057] If a user is present in step S300 ("Yes"), the system identifies whether the person is an adult or a child (step S400). If the detected person is determined to be a child ("Yes"), the heating unit stops heating (step S410), and the alarm unit 11 issues an alarm indicating that heating has stopped (step S420), and the system proceeds to step S800.

[0058] By positioning the infrared imaging device 300 so that it captures images from directly above the heated object, the imaging range of the infrared imaging device 300 is limited to at least the area in front of the heating device 200, preventing surrounding heat sources or passersby from being captured in the image. This reduces false detections and improves the accuracy of human detection. Furthermore, if a child approaches while heating is in progress, the heating device 200 can stop heating and sound an alarm, improving the safety of the heating system.

[0059] Third Embodiment In this third embodiment, an example of limiting the human detection area in a thermal image will be described. Figures 14 and 15 are used to explain the configuration and operation of a heating system according to the third embodiment. Figure 14 is a schematic diagram showing the relationship between the thermal image acquired when a user stands in front of the heating device and the human detection area, and Figure 15 is a flowchart showing the operation of the heating system. In the third embodiment, the basic configuration of each device constituting the heating system is the same as in the first and second embodiments, and Figures 1 to 6 and 10 are used.

[0060] The overheating prevention device 100 constituting the heating system according to the third embodiment is configured by adding new functions to the memory unit 8 and the human detection unit 6 described in the first and second embodiments. Specifically, as shown in Fig. 14, the area for detecting a user (person) (human detection area) is set to a predetermined region in the thermal image, rather than the entire thermal image.

[0061] For example, if it is not expected that a person will be present above the heating device 200, a human detection area can be set outside the heating device 200 to prevent the heated object on the heating device 200 from being mistakenly detected as a person. The operation of the automatic heating control when a human detection area is set will be described with reference to the flowchart in Figure 15.

[0062] 15, step S320 is inserted between step S300 ("yes") and step S700. If the answer is "yes" in step S300, the process does not immediately proceed to step S110 but proceeds to step S320. Other than this, the process is the same as the flow described in FIG. 7, and a description of the similar parts will be omitted.

[0063] If a user is present in step S300 ("Yes"), it is determined whether the person is within the human detection area (step S320). If it is determined that the person is detected within the area ("Yes"), the process proceeds to step S110. On the other hand, if it is determined that the person is detected outside the area ("No"), it is determined that the person is not a human, and the process proceeds to step S700, just as with "No" in step S300. In other words, whether a user is detected within the human detection area is incorporated into the determination.

[0064] The infrared imaging device 300 allows the imaging range to be set for each pixel, so that, for example, when installing the system, the thermal image can be checked on a separately prepared monitor, allowing for easy and highly accurate area division. This simplifies system installation, improves installation flexibility, and limits the human detection area as needed to reduce false detections and improve detection accuracy. Although not shown, a simple monitor for area setting may be built in.

[0065] Fourth Embodiment. In this fourth embodiment, a configuration for easily distinguishing between a person whose temperature is lower than that of the heated object and the background is described. Figures 16A to 17 are used to explain the configuration and operation of a heating system according to the fourth embodiment. Figure 16A shows a thermal image obtained when a user stands in front of a heating device and the high-temperature heated object and the person are simultaneously captured, and Figure 16B shows a corrected thermal image obtained by filtering the thermal image of Figure 16A. Figure 17 is a flowchart showing the operation of the heating system. In this fourth embodiment, the basic configuration of each device constituting the heating system is the same as in the first to third embodiments, and Figures 1 to 6 and 10 are used.

[0066] As shown in Figure 16A, when a high-temperature object and a person are photographed simultaneously, the brightness value of the person is relatively small, resulting in a slight difference in brightness between the person and the background in the thermal image, making it difficult to distinguish them. For this reason, the thermal image generation unit 5 is equipped with a filtering function that filters brightness values ​​before outputting the thermal image, eliminating high-temperature heat sources that are clearly not human. This allows the person and background to be separated even when photographing a high-temperature object, making it easy for the user to detect them. Meanwhile, by not applying filtering to the brightness value information used for temperature calculation, the temperature of the heated object can be accurately measured.

[0067] The operation of the automatic heating control with thermal image filtering will be described with reference to the flowchart in Fig. 17. The flow in Fig. 17 is the same as the flow described in Fig. 7 except that steps S202 to S204 are inserted between step S200 ("No") and step S210, and therefore a description of the similar parts will be omitted.

[0068] If no abnormal temperature is detected in step S200 ("No"), it is determined whether the brightness value of the detected temperature is outside a preset range (higher than the upper limit or lower than the lower limit) (step S202). If the brightness value is within the preset range ("No"), the process proceeds to step S210. On the other hand, if a brightness value outside the preset range is detected ("Yes"), a filter process is performed to replace heat sources on the thermal image that are significantly higher or lower than a person with brightness values ​​equivalent to that of a person (step S204), and then the process proceeds to step S210.

[0069] Accurate human detection can be achieved by setting upper and lower limits based on whether the brightness is significantly higher or lower than the brightness expected for a human (general body temperature). This allows a single infrared imaging device 300 to accurately measure the temperature information of the heated object and detect the presence or absence of a user, even during high-temperature heating operations, without the need for a separate human detection means such as a camera or pyroelectric sensor. This allows accurate control of the heating device 200, even when the heated object is being heated to a high temperature.

[0070] Fifth Embodiment In the fifth embodiment, an example will be described in which control is performed taking into consideration the time when the user is not present. FIG. 18 is a flowchart illustrating the configuration and operation of a heating system according to the fifth embodiment. Note that the basic configuration of each device constituting the heating system in the fifth embodiment is the same as in the first to fourth embodiments, and FIGS. 1 to 6 and 10 are used.

[0071] The memory unit 8 of the overheating prevention device 100 is configured to store a history of the detection results from the human detection unit 6 for a certain period of time. The human detection unit 6 is configured to determine not only whether a user is present, but also whether the user has been absent for a long period of time. The operation of the automatic heating control, which also takes into account the length of time the user has been absent, will be described with reference to the flowchart in FIG. 18. Note that the flow in FIG. 18 is the same as the flow described in FIG. 7, except that steps S710 to S720 are inserted between steps S700 and S800, and a description of the similar parts will be omitted.

[0072] When a user is not detected ("No" in step S300) and the output of the heating unit 21 is automatically adjusted (step S700), the time during which the user is not detected is recorded in the memory unit 8. Then, it is determined whether the time during which the user is absent is longer than a preset time (step S710). If the time during which the user is absent is longer than the preset time ("Yes"), it is assumed that the user has not been watching the fire for a long time, and the power to the heating unit 21 is turned off or a notification is sent from the alarm unit 11 (step S720).

[0073] In other words, even if no abnormal temperature is detected, if it determines that the fire has been left unattended for a long period of time, it will automatically extinguish the fire (stop output) or send a notification. Since the fire will be automatically extinguished if the heated object is left unattended for a certain period of time, it prevents forgetting to turn it off and further improves the safety of the heating system.

[0074] Sixth Embodiment. The heating system according to the sixth embodiment will be described in the case where a stove, which is a cooking device, is used as the heating device. Figures 19 and 20 are intended to explain the configuration and operation of the heating system according to the sixth embodiment. Figure 19 is a side view illustrating the situation when a user is cooking while standing in front of a cooking device (heating device) using a stove, and Figure 20 is a block diagram showing the configuration of a heating system configured using a heating device using a stove and an overheating prevention device. Note that in the sixth embodiment, the basic configuration of each device constituting the heating system is the same as in the first to fifth embodiments, and Figures 3 to 4, 6 to 9, and 13 to 18 are also used.

[0075] When the heating system is applied to a home stove, the overheating prevention device 100 described in the first to fifth embodiments may be incorporated into a ventilation device 600, as shown in Figures 19 and 20. The ventilation section 60 of the ventilation device 600 is a so-called range hood, and the other devices corresponding to the overheating prevention device 100 in the first to fifth embodiments have reference numerals with the second digit "6" removed. The heating section 21 of the heating device 200 is a cooking appliance such as a gas stove or an induction heater.

[0076] By utilizing the thermal image acquired by the infrared imaging device 300 and the operation information of the heating device 200, it is possible to simultaneously determine the temperature of the object to be heated and whether or not a user is in front of the cooking appliance. This improves the safety of the cooking appliance by preventing forgetting to turn off the flame, boiling over, and abnormal heating of oil without compromising operability.

[0077] In addition, by measuring and controlling the temperature of the contents in the cooking container, it is possible to reduce cooking labor and improve the taste of the food. Furthermore, by configuring it to adjust the ventilation air volume to the optimum level according to the temperature of the heated food, it is possible to reduce the energy consumption of the ventilation device.

[0078] In particular, by controlling the heating power to be automatically adjusted only when a user is not in front of the cooking appliance, it is possible to prevent the heating power from being adjusted against the user's intention, thereby improving the convenience of the heating system. Furthermore, by incorporating the overheating prevention device into the ventilation device 600, the equipment configuration is simplified, making it possible to reduce the size of the heating system and the number of parts.

[0079] Although various exemplary embodiments and examples are described in this application, the various features, aspects, and functions described in one or more embodiments are not limited to the application of a particular embodiment, but may be applied to the embodiments alone or in various combinations. Therefore, countless modifications not illustrated are contemplated within the scope of the technology disclosed in this specification. For example, this includes cases where at least one component is modified, added, or omitted, or where at least one component is extracted and combined with components of another embodiment.

[0080] For example, although the present application is described assuming a cooking device, the present invention is not limited to this. For example, the present invention can also be applied to devices that perform industrial heating or laboratory heating. Therefore, the recipes used for automatic adjustment are not limited to cooking, but may also be specifications for industrial or experimental heat treatment.

[0081] As described above, the overheating prevention device 100 of the present application includes a communication unit 4 that communicates with the heating device 200, a heating unit 21 that heats the object to be heated in the heating device 200, an infrared imaging device 300 that is installed at a position above the heating unit 21 so that the user operating the heating device 200 is within the imaging range, a temperature calculation unit 7 that calculates the temperature of the object to be heated based on a thermal image obtained from the infrared imaging device 300, a human detection unit 6 that detects the presence of the user based on the thermal image, and a control unit 2 that controls the operation of the heating unit 21 via the communication unit 4 based on information about the user's operation obtained from the heating device 200 via the communication unit 4, the user detection result obtained from the human detection unit 6, and the temperature information about the object to be heated obtained from the temperature calculation unit 7. This makes it possible to accurately determine whether the user is performing cooking operations, thereby preventing overheating without impairing user convenience.

[0082] The human detection unit 6 has a function of determining the orientation of the detected user from the thermal image, and even if the control unit 2 receives information that the temperature of the heated object is within the normal range and that a user is present, if it determines that the user is facing away from the heating device, it adjusts the output of the heating unit 21 based on the recipe information set by the user for the heating device 200. This makes it possible to more accurately determine whether the user is performing cooking operations, thereby preventing excessive heating without impairing user convenience.

[0083] The device includes a memory unit 8 that stores an AI model for identifying whether a detected user is an adult or a child, and the human detection unit 6 has the function of determining whether the detected user is an adult or a child using the AI ​​model. Even if the temperature of the heated object is within the normal range and information indicating the presence of a user is received, the control unit 2 stops the output of the heating unit 21 or issues an alarm if it determines that the user is a child. This allows accurate determination of whether the user is actually performing cooking operations, preventing overheating without compromising user convenience. The alarm also allows adults to take appropriate action.

[0084] If the human detection unit 6 is configured to detect the presence of a user within a pre-set area (human detection area) in the thermal image, it is possible to prevent misidentifying something other than a human or an unrelated person as a user.

[0085] By providing an image processing unit (thermal image generating unit 5) in which upper and lower limits for brightness values ​​in a thermal image are set in advance and which performs a filter process to rewrite the brightness value of pixels that deviate from the upper or lower limit of the thermal image to the upper or lower limit, the brightness values ​​of people and the background can be made to stand out, making it possible to determine whether a user is present or not.

[0086] The human detection unit 6 has a function of determining whether the continuous time the user is absent exceeds a set time, and when the control unit 2 determines that the continuous time is absent exceeds the set time, it stops reducing the output of the heating unit 21 or issues an alarm, thereby preventing excessive heating even if the user forgets that they are cooking without impairing user convenience. The alarm can also make the user aware that cooking is in progress.

[0087] By providing an infrared-transmitting protective member 10 in front of the infrared-transmitting lens 31 of the infrared imaging device 300, contamination due to smoke, oil splashes, and the like can be prevented.

[0088] The system can be made compact by incorporating it into the ventilation device 600 provided above the heating device 200. Furthermore, by coordinating the operation of the ventilation unit 60, the air volume can be optimized, enabling the necessary ventilation with the minimum amount of energy consumption.

[0089] The human detection unit 55 may be located at a location separate from the control unit 2 and may be configured in a server 500 that is connected to the control unit 2 by communication. In particular, when AI is used, it is easy to perform large calculations, and update data can be easily obtained from outside.

[0090] Furthermore, the heating system of the present application is equipped with the above-mentioned overheating prevention device 100 and heating device 200, and the overheating prevention device 100 and heating device 200 operate in conjunction with each other via communication, thereby ensuring user convenience and preventing overheating.

[0091] 100: Overheating prevention device, 1: Operation unit, 2: Control unit, 4: Communication unit, 5: Thermal image generation unit, 6: Human detection unit, 7: Temperature calculation unit, 8: Memory unit, 9: Light source, 10: Protective member, 11: Alarm unit, 200: Heating device, 21: Heating unit, 22: Memory unit, 23: Control unit, 24: Operation unit, 25: Communication unit, 300: Infrared imaging device, 500: Server, 51: Setting unit, 52: Thermal image generation unit, 53: Communication unit, 54: Memory unit, 55: Human detection unit, 600: Ventilation device, 60: Ventilation unit.

Claims

1. An overheating prevention device comprising: a communication unit that communicates with a heating device; an infrared imaging device that is installed at a position above and away from the heating unit so that the heating unit heats an object to be heated by the heating device and the user operating the heating device are within the imaging range; a temperature calculation unit that calculates the temperature of the object to be heated based on a thermal image obtained from the infrared imaging device; a human detection unit that detects the presence of the user based on the thermal image; and a control unit that controls the operation of the heating unit via the communication unit based on information regarding the user's operation obtained from the heating device via the communication unit, the user detection result obtained from the human detection unit, and temperature information of the object to be heated obtained from the temperature calculation unit.

2. The overheating prevention device described in claim 1, characterized in that the human detection unit has a function of determining the orientation of the detected user from the thermal image, and when the control unit determines that the user is facing away from the heating device even if the temperature of the heated object is within the normal range and information is obtained that the user is present, it adjusts the output of the heating unit based on recipe information set by the user for the heating device.

3. An overheating prevention device as described in claim 1 or 2, characterized in that it is equipped with a memory unit in which an AI model for identifying whether the detected user is an adult or a child is stored, the human detection unit has a function of determining whether the detected user is an adult or a child using the AI ​​model, and the control unit stops the output of the heating unit or issues an alarm when it obtains a determination result that the user is a child, even if the temperature of the heated object is within the normal range and information is obtained that the user is present.

4. An overheating prevention device as described in any one of claims 1 to 3, characterized in that the human detection unit detects the presence of the user within a predetermined area in the thermal image.

5. An overheating prevention device as described in any one of claims 1 to 4, characterized in that an upper and lower limit values ​​for the brightness value in the thermal image are set in advance, and an image processing unit is provided which performs a filter process for rewriting the brightness value of a pixel in the thermal image that deviates from the upper limit value or the lower limit value to the upper limit value or the lower limit value.

6. The overheating prevention device described in any one of claims 1 to 5, characterized in that the human detection unit has a function of determining whether the time during which the user is continuously absent exceeds a set time, and when the control unit obtains a determination result that the time during which the user is continuously absent exceeds the set time, it stops the reduction in the output of the heating unit or issues an alarm.

7. An excessive heating prevention device as claimed in any one of claims 1 to 6, characterized in that an infrared-transparent protective member is provided in front of the infrared-transparent lens of the infrared imaging device.

8. An overheating prevention device as claimed in any one of claims 1 to 7, characterized in that it is built into a ventilation device provided above the heating device.

9. An overheating prevention device as described in any one of claims 1 to 7, characterized in that the human detection unit is located at a location away from the control unit and is constructed on a server connected to the control unit via communication.

10. A heating system comprising an overheating prevention device according to any one of claims 1 to 9 and a heating device, wherein the overheating prevention device and the heating device operate in cooperation with each other through communication.

Citation Information

Patent Citations

  • Heating cooker

    JP2012097913A

  • Heating cooker

    JP2015068542A

  • Cooking support method and system

    JP2017224171A

  • Safety Cooking Device and Method

    US20180253953A1

  • Welding guiding system providing high-quality images

    US20200368840A1