Intelligent range hood and stove linkage control method and device based on dual-light fusion and electronic equipment

Abstract

The invention provides an intelligent range hood and stove linkage control method and device based on dual-light fusion and electronic equipment, and relates to the technical field of kitchen electric appliance intelligent control, and the method comprises the steps: carrying out the continuous thermal signal monitoring of a stove region through an infrared array sensor, and when the thermal signal monitored by the infrared array sensor meets a preset ignition triggering condition, starting the infrared array sensor; starting a visible light camera to obtain a visible light image of the stove area; based on the recognition result of the attributes of the cookware and the pot cover, emissivity self-adaptive correction is carried out on the temperature measurement data of the infrared array sensor; and fusing the corrected temperature data with the visible light image information, and executing at least one operation of intelligent adjustment of the air volume of the range hood, fire operation leaving monitoring, pot overflow risk judgment and dry burning risk judgment. According to the invention, high-precision non-contact temperature measurement and full-scene perception are realized, emissivity self-adaptive correction is carried out by utilizing pot cover material identification, and the accuracy of temperature monitoring is remarkably improved.

Description

A method, device, and electronic device for intelligent range hood and stove linkage control based on dual-light fusion. Technical Field

[0001] This invention relates to the field of intelligent control technology for kitchen appliances, and in particular to an intelligent range hood and stove linkage control method, device, and electronic device based on dual-light fusion. Background Technology

[0002] With the development of smart homes, the intelligent upgrade of traditional kitchen appliances has become a trend. Existing smart stoves or range hood linkage solutions have the following limitations: (1) The temperature measurement method is singular and the accuracy is insufficient: Traditional solutions mostly use contact thermocouples or single-point infrared sensors. Contact sensors are easily contaminated by oil stains, have a short lifespan, and can only obtain the temperature at a single point, which cannot reflect the temperature field distribution of the entire pot and cooking area. Single-point infrared temperature measurement is greatly affected by the emissivity of the object surface, especially for pot lids made of different materials such as glass and ceramic. If emissivity correction is not performed, the temperature measurement error is significant.

[0003] (2) Weak scene perception capability: Most systems lack effective visual recognition capabilities and cannot automatically identify the presence or absence of pots, their location, the state of the lid (covered / uncovered), and the material of the lid. This results in the system being unable to adaptively control according to the actual cooking scenario (such as stir-frying, stewing, frying). The so-called "anti-dry burning" and "anti-overflow" functions are mostly based on simple temperature or time thresholds, resulting in a high misjudgment rate and low reliability.

[0004] (3) Low level of system linkage intelligence: The existing linkage between range hood and stove is mostly based on the stove's firepower level (judged by current) or simple temperature signal linkage, which cannot sense the actual boiling and oil fume generation state in the pot, resulting in inaccurate adjustment of the range hood's air volume. Either the suction power is insufficient, causing the oil fume to spread, or the suction power is too large, causing energy waste and noise pollution.

[0005] (4) Incomplete safety protection: There is a lack of effective means of detecting "unattended cooking", or the presence of cookware is determined solely by gravity and pressure sensors, which cannot determine whether personnel are watching the stove. Safety intervention measures (such as turning off the stove) are difficult to implement, especially for renovated houses, where modifying gas pipeline valves involves cumbersome approval procedures and has low feasibility.

[0006] Therefore, a method, device, and electronic device for intelligent range hood and stove linkage control based on dual-light fusion are proposed. Summary of the Invention

[0007] This manual provides a method, device, and electronic device for intelligent range hood and stove linkage control based on dual-light fusion, which achieves high-precision non-contact temperature measurement and full-scene perception. It utilizes pot lid material recognition for emissivity adaptive correction, significantly improving the accuracy of temperature monitoring.

[0008] This specification provides a smart range hood and cooktop linkage control method based on dual-light fusion, comprising: continuously monitoring the heat signal of the cooktop area using an infrared array sensor; when the heat signal detected by the infrared array sensor meets a preset ignition trigger condition, activating a visible light camera to acquire a visible light image of the cooktop area; based on the visible light image, identifying the cookware and determining the attributes of the lid, at least identifying the presence status of the cookware and the material type of the lid; based on the identification results of the cookware and lid attributes, adaptively correcting the emissivity of the temperature measurement data from the infrared array sensor; fusing the corrected temperature data with the visible light image information, and performing at least one of the following operations: intelligent adjustment of the range hood airflow, monitoring of cooking without human intervention, assessment of overflow risk, and assessment of dry burning risk.

[0009] Optionally, the fused and corrected temperature data and the visible light image information perform at least one of the following operations: intelligent adjustment of the range hood airflow, monitoring of cooking fires and people leaving the premises, judgment of overflow risk, and judgment of dry burning risk. This includes: dynamically matching a preset adjustment model based on the cookware size information, the pot lid material information, and the temperature distribution and temperature rise rate data inside the pot obtained by the infrared array sensor, and outputting a control signal to adjust the operating level of the range hood.

[0010] Optionally, the fused and corrected temperature data and the visible light image information perform at least one of the following operations: intelligent adjustment of the range hood air volume, monitoring of people leaving the stove while cooking, judgment of overflow risk, and judgment of dry burning risk. This includes: performing moving target analysis and behavior recognition on the continuous image sequence acquired by the visible light camera; if no effective human activity characteristics are identified in front of the stove within a preset continuous time period, it is determined to be a state of people leaving the stove while cooking, and a safety alarm is triggered.

[0011] Optionally, the fusion and correction of the temperature data and the visible light image information shall perform at least one of the following operations: intelligent adjustment of the range hood air volume, monitoring of open flame and absence of personnel, judgment of overflow risk, and judgment of dry burning risk. This includes: analyzing the emissivity-corrected infrared temperature data, focusing on monitoring the temperature of the edge of the cookware or the center of the lid; when the temperature value of the monitoring point exceeds the first safety threshold and its temperature rise curve conforms to the preset overflow characteristic model, it is determined to be an overflow risk.

[0012] Optionally, the fused and corrected temperature data and the visible light image information perform at least one of the following operations: intelligent adjustment of the range hood airflow, monitoring of open flames and people leaving the area, judgment of overflow risk, and judgment of dry burning risk. This includes: analyzing the temperature distribution data of the entire field of view acquired by the infrared array sensor; if a potless state is detected, or if the pot lid is determined to be covered based on the identification results of the pot and lid attributes and the temperature data, and if the temperature in the central area of ​​the pot exceeds the second safety threshold and the temperature difference between the central area and the edge of the pot tends to disappear, or if the overall temperature rise rate is abnormal, then a dry burning risk is determined.

[0013] Optionally, it also includes: when a safety risk event is identified, performing corresponding safety intervention and alarm operations, specifically: the safety intervention and alarm operations include at least triggering an audible and visual alarm, sending alarm information to the user terminal through a wireless communication unit; and, when it is determined that there is a risk of dry burning or that the timeout period for leaving a person unattended while using a hot appliance has expired, outputting a control command to a gas valve control actuator to drive it to close the gas valve.

[0014] Optionally, the thermal signal detected by the infrared array sensor meets the preset ignition triggering conditions, including: detecting that the area temperature rises from the ambient temperature and exceeds the ignition threshold, and that its temperature rise rate is greater than the preset rate threshold.

[0015] This specification provides an intelligent range hood and cooktop linkage control device based on dual-light fusion, comprising: a monitoring module for continuously monitoring the heat signal of the cooktop area using an infrared array sensor; when the heat signal detected by the infrared array sensor meets preset ignition trigger conditions, activating a visible light camera to acquire a visible light image of the cooktop area; a judgment module for identifying the cookware and judging the attributes of the lid based on the visible light image, at least identifying the presence status of the cookware and the material type of the lid; a correction module for adaptively correcting the emissivity of the temperature measurement data from the infrared array sensor based on the identification results of the cookware and lid attributes; and an execution module for fusing the corrected temperature data with the visible light image information to perform at least one of the following operations: intelligent adjustment of the range hood airflow, monitoring of unattended cooking, judgment of overflow risk, and judgment of dry burning risk.

[0016] Optionally, the execution module includes: dynamically matching a preset adjustment model based on the cookware size information, the pot lid material information, and the temperature distribution and temperature rise rate data inside the pot obtained by the infrared array sensor, and outputting a control signal to adjust the operating level of the range hood.

[0017] Optionally, the fused and corrected temperature data and the visible light image information perform at least one of the following operations: intelligent adjustment of the range hood air volume, monitoring of people leaving the stove while cooking, judgment of overflow risk, and judgment of dry burning risk. This includes: performing moving target analysis and behavior recognition on the continuous image sequence acquired by the visible light camera; if no effective human activity characteristics are identified in front of the stove within a preset continuous time period, it is determined to be a state of people leaving the stove while cooking, and a safety alarm is triggered.

[0018] Optionally, the execution module includes: analyzing the emissivity-corrected infrared temperature data, focusing on monitoring the temperature at the edge of the cookware or the center of the lid; when the temperature value at the monitoring point exceeds a first safety threshold and its temperature rise curve conforms to a preset overflow characteristic model, it is determined to be at risk of overflow.

[0019] Optionally, the execution module includes: analyzing the temperature distribution data of the entire field of view acquired by the infrared array sensor; if the pot is not detected, or if the pot lid is determined to be covered by combining the identification results of the pot and lid attributes with the temperature data, and if the temperature of the central area of ​​the pot exceeds the second safety threshold and the temperature difference between it and the edge of the pot tends to disappear, or the overall temperature rise rate is abnormal, then it is determined to be a risk of dry burning.

[0020] Optionally, it also includes: when a safety risk event is identified, performing corresponding safety intervention and alarm operations, specifically: the safety intervention and alarm operations include at least triggering an audible and visual alarm, sending alarm information to the user terminal through a wireless communication unit; and, when it is determined that there is a risk of dry burning or that the timeout period for leaving a person unattended while using a hot appliance has expired, outputting a control command to a gas valve control actuator to drive it to close the gas valve.

[0021] Optionally, the thermal signal detected by the infrared array sensor meets the preset ignition triggering conditions, including: detecting that the area temperature rises from the ambient temperature and exceeds the ignition threshold, and that its temperature rise rate is greater than the preset rate threshold.

[0022] This specification also provides an electronic device comprising: a processor; and a memory storing computer-executable instructions, which, when executed, cause the processor to perform any of the methods described above.

[0023] This specification also provides a computer-readable storage medium that stores one or more programs that, when executed by a processor, implement any of the methods described above.

[0024] In this invention, high-precision non-contact temperature measurement and all-scene perception are achieved through dual-light fusion of infrared array sensors and visible light cameras. Emissivity adaptive correction is performed using pot lid material recognition, significantly improving the accuracy of temperature monitoring. Furthermore, by integrating information on pot attributes, temperature distribution, and trends, the system dynamically adjusts the range hood's airflow, achieving intelligent and precise linkage tailored to actual cooking conditions. Simultaneously, by combining visual behavior recognition and infrared temperature field analysis, a multi-layered active safety protection system covering human absence, overflow, and dry burning is constructed. It can also cut off the gas supply through a non-invasive actuator, forming a safety closed loop. In addition, a graded power consumption strategy and modular design ensure all-weather monitoring while also balancing low energy consumption and easy installation, comprehensively improving the safety, intelligence, and energy efficiency of kitchen cooking. Attached Figure Description

[0025] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0026] Figure 1 is a schematic diagram of the principle of an intelligent range hood and stove linkage control method based on dual-light fusion provided in an embodiment of this specification; Figure 2 is a schematic diagram of the hardware architecture provided in an embodiment of this specification; Figure 3 is a schematic diagram of the structure of an intelligent range hood and stove linkage control device based on dual-light fusion provided in an embodiment of this specification; Figure 4 is a schematic diagram of the structure of an electronic device provided in an embodiment of this specification; Figure 5 is a schematic diagram of the principle of a computer-readable medium provided in an embodiment of this specification. Detailed Implementation

[0027] The following description is intended to disclose the present invention and enable those skilled in the art to implement it. The preferred embodiments described below are merely examples, and other obvious variations will occur to those skilled in the art. The basic principles of the invention defined in the following description can be applied to other embodiments, modifications, improvements, equivalents, and other technical solutions that do not depart from the spirit and scope of the invention.

[0028] Exemplary embodiments of the present invention are described more fully below with reference to Figures 1-5. However, these exemplary embodiments can be implemented in many forms and should not be construed as limiting the invention to the embodiments set forth herein. Rather, these exemplary embodiments are provided to make the invention more comprehensive and complete, and to facilitate a full communication of the inventive concept to those skilled in the art. The same reference numerals in the figures denote the same or similar elements, components, or parts, and therefore repeated descriptions of them are omitted.

[0029] Subject to the technical concept of this invention, the features, structures, characteristics or other details described in a particular embodiment may be combined in one or more other embodiments in a suitable manner.

[0030] In the description of specific embodiments, the features, structures, characteristics, or other details described in this invention are intended to enable those skilled in the art to fully understand the embodiments. However, it is not excluded that those skilled in the art can practice the technical solutions of this invention without one or more of the specific features, structures, characteristics, or other details.

[0031] The flowcharts shown in the accompanying drawings are merely illustrative and do not necessarily include all content and operations / steps, nor do they necessarily have to be performed in the described order. For example, some operations / steps can be broken down, while others can be combined or partially combined; therefore, the actual execution order may change depending on the specific circumstances.

[0032] The block diagrams shown in the accompanying drawings are merely functional entities and do not necessarily correspond to physically independent entities. That is, these functional entities can be implemented in software, in one or more hardware modules or integrated circuits, or in different network and / or processor devices and / or microcontroller devices.

[0033] The terms “and / or” or “and / or” include all combinations of any one or more of the listed items.

[0034] Figure 1 is a schematic diagram of a smart range hood and cooktop linkage control method based on dual-light fusion provided in an embodiment of this specification. This method may include: S110: Continuously monitoring the heat signal of the cooktop area using an infrared array sensor. When the heat signal detected by the infrared array sensor meets preset ignition trigger conditions, a visible light camera is activated to obtain a visible light image of the cooktop area. In a specific embodiment of this specification, the hardware architecture of the system is shown in Figure 2. Its core is a main controller (e.g., using an ARM Cortex-M series MCU), to which the dual-light fusion sensing module, range hood speed control module, sound and light alarm module, communication unit (Wi-Fi / Bluetooth), button unit, and lighting unit are all connected. The dual-light fusion sensing module is physically a compact module integrating an 8x8 resolution infrared array sensor and a 320x240 pixel visible light camera. Through a common optical window and mechanical calibration, the fields of view of both are completely overlapped on the cooktop plane. A gas valve control actuator (pipeline manipulator), as an optional slave unit, can also receive commands from the main controller via wired or wireless means.

[0035] After power-on, the system enters a low-power standby mode. In this mode, the main controller shuts down the high-power visible light camera, allowing only the extremely low-power 8x8 resolution infrared array sensor to operate at a low frame rate (e.g., 1Hz) to continuously scan the cooktop, keeping the overall standby power consumption at an extremely low level (e.g., <5mW). When the sensor detects that the average temperature of a certain focused area (corresponding to one burner) exceeds 150℃ and the temperature rise rate is greater than 10℃ / second, it determines that ignition is successful, and then wakes up the system and activates the 320x240 pixel visible light camera.

[0036] Furthermore, the dual-light fusion module establishes a precise mapping relationship in data processing: the visible light image is divided into 64 (8x8) logical grids, each grid covering 40x30 visible light pixels, and each grid corresponds one-to-one with a temperature pixel in the infrared array, providing a spatial alignment basis for subsequent fusion judgment.

[0037] Optionally, S110 includes: detecting that the area temperature rises from the ambient temperature and exceeds the ignition threshold, and that the temperature rise rate is greater than a preset rate threshold.

[0038] In the specific implementation described in this specification, after the system is powered on, the infrared array sensor continuously monitors the background temperature (approximately 25-40°C) of four preset areas (corresponding to two burners) on the cooktop. When the average pixel temperature of any area rises by more than 100°C within 2 seconds (e.g., from 30°C to 135°C), and the calculated instantaneous temperature rise rate is greater than 8°C / second, the main controller confirms that the burner has been ignited, thereby triggering the subsequent camera startup and recognition process. This dual judgment based on "temperature threshold + temperature rise rate" effectively avoids false triggering by ambient heat sources (such as sunlight).

[0039] S120: Based on the visible light image, identify the cookware and determine the attributes of the lid, at least identifying the presence of the cookware and the material type of the lid; in the specific implementation of this specification, after the visible light camera is started, it captures an image, and the main controller calls the trained convolutional neural network (CNN) image recognition model to analyze the image, determine whether there is a cookware on the stove and whether the lid is on, and identify whether the lid is made of glass, metal or ceramic, etc., and at the same time, it can estimate the approximate size of the cookware.

[0040] S130: Based on the identification results of the pot and lid attributes, the emissivity adaptive correction is performed on the temperature measurement data of the infrared array sensor. In the specific embodiment of this specification, the main controller calls the corresponding emissivity parameter from the built-in parameter table according to the identified pot lid material. For example, when the pot lid is identified as glass, an emissivity of 0.88 is called; when the pot lid is identified as metal, an emissivity of 0.25-0.30 (depending on the specific metal type) is called. This is used to perform overall correction on the raw surface temperature data measured by the infrared sensor, greatly improving the accuracy of temperature measurement.

[0041] Optionally, if the identification result is "uncovered pot lid", the system uses the default emissivity parameter (e.g., 0.95, suitable for common metal pot bodies) to correct the temperature data.

[0042] S140: Integrate the corrected temperature data with the visible light image information, and perform at least one of the following operations: intelligent adjustment of the range hood air volume, monitoring of hot work and absence of personnel, judgment of overflow risk, and judgment of dry burning risk.

[0043] In the specific implementation of this specification, the system performs multiple intelligent control and safety monitoring tasks in parallel based on this spatially aligned and calibrated "visual scene-temperature field" fused information map.

[0044] Optionally, S140 includes: dynamically matching a preset adjustment model based on the cookware size information, the lid material information, and the temperature distribution and temperature rise rate data inside the cookware obtained by the infrared array sensor, and outputting a control signal to adjust the operating level of the range hood.

[0045] In the specific implementation of this manual, when the system detects a 30cm diameter cast iron pot without a lid, and the infrared data shows that the temperature in the center of the pot reaches 200℃ and continues to rise rapidly, the main controller determines it to be a stir-fry scenario. The system calls the built-in stir-fry wind power model and outputs a PWM signal to control the brushless DC motor of the range hood to run at high speed, automatically adjusting the airflow to the highest level. Conversely, if a small earthenware pot with a ceramic lid is detected, and the temperature inside the pot is uniformly maintained at around 98℃, the system calls the simmering model, adjusting the range hood to a low-speed or intermittent operation mode to achieve energy saving and noise reduction.

[0046] Furthermore, the adjustment model is obtained by collecting a large amount of data from typical cooking scenarios and training it through machine learning. For example, the key triggering parameters of the "stir-fry" model include a pan center temperature >180℃ and a temperature rise rate >15℃ / s.

[0047] Optionally, S140 includes: performing motion target analysis and behavior recognition on the continuous image sequence acquired by the visible light camera; if no effective human activity characteristics are identified in front of the stove within a preset continuous time period, it is determined to be a state of being away from the stove while cooking, and a safety alarm is triggered.

[0048] In the specific implementation described in this manual, the visible light camera captures images at a frequency of 5 frames per second, and the main controller runs background subtraction and human contour recognition algorithms. If the algorithm fails to detect a moving target matching human characteristics within a safe area of ​​approximately 1 meter in front of the stove for 60 consecutive seconds (duration adjustable), it is determined to be a "cooking without human presence" state. At this time, the main controller will mark this state as true, providing a more stringent judgment condition for subsequent dry burning detection, and may trigger an audible reminder: "Please pay attention to stove safety."

[0049] Optionally, S140 includes: analyzing the emissivity-corrected infrared temperature data, focusing on monitoring the temperature at the edge of the cookware or the center of the lid; when the temperature value at the monitoring point exceeds a first safety threshold and its temperature rise curve conforms to a preset overflow characteristic model, it is determined to be at risk of overflow.

[0050] In the specific implementation of this specification, after calibrating the infrared data, the system continuously monitors the temperature of the pot's edge (the pixel area corresponding to the pot's outline in the infrared image). During stewing, if the pot's edge temperature rises sharply from 100°C to 110°C within a short period (e.g., within 3 seconds), and the temperature rise curve exhibits a "plateau-jump" characteristic due to the rising of liquid foam, the main controller determines that overflow is imminent. The system immediately triggers a high-frequency audible and visual alarm and simultaneously sends a command to the range hood, forcing it to switch to its maximum fan speed to quickly remove the overflowing steam and foam.

[0051] Optionally, S140 includes: analyzing the temperature distribution data of the entire field of view acquired by the infrared array sensor; if the pot is not detected, or if the pot lid is determined to be covered by combining the identification results of the pot and lid attributes with the temperature data, and if the temperature of the central area of ​​the pot exceeds the second safety threshold and the temperature difference between it and the edge of the pot tends to disappear, or the overall temperature rise rate is abnormal, then it is determined to be a risk of dry burning.

[0052] In the specific implementation of this specification, the system continuously analyzes the distribution of the infrared temperature field. Scenario 1: Visual recognition indicates no pot, but the infrared display shows the temperature at the center of the burner consistently above 280°C with concentrated heat, inconsistent with normal dry-burning. Scenario 2: Visual recognition indicates a covered pot (metal lid), but the infrared data shows the temperature difference between the center and edge of the lid is less than 5°C and the overall temperature exceeds 250°C, indicating that the pot is dry and has entered a dry-burning state. Once either of the preset dry-burning models is met, a dry-burning alarm is triggered.

[0053] Furthermore, the dry-burning judgment logic also incorporates energy accumulation estimation. It calculates the heat energy input to the pot body through integration and estimates the theoretical time for moisture to evaporate by combining the pot material. This is then compared with the actual temperature trend to provide an early warning.

[0054] Optionally, it also includes: when a safety risk event is identified, performing corresponding safety intervention and alarm operations, specifically: the safety intervention and alarm operations include at least triggering an audible and visual alarm, sending alarm information to the user terminal through a wireless communication unit; and, when it is determined that there is a risk of dry burning or that the timeout period for leaving a person unattended while using a hot appliance has expired, outputting a control command to a gas valve control actuator to drive it to close the gas valve.

[0055] In the specific implementation described in this manual, when dry burning or prolonged absence (e.g., more than 3 minutes) is detected, the main controller performs a three-level intervention: First, the red light on the control panel flashes and an urgent alarm sounds; second, an alarm message, "Emergency! The stove may be dry burning; the valve has been automatically shut off!" is pushed to the user's mobile app via the Wi-Fi module; third, a command is sent to a stepper motor module (pipeline manipulator) mounted on the gas valve knob. This manipulator is an independent slave module, non-intrusively mounted on the existing valve using adaptive grippers. Upon receiving the command, it drives the knob to rotate 90 degrees, physically closing the gas valve and cutting off the flame source. This design requires no modification to the gas pipeline, is easy to install, and offers high safety.

[0056] In this invention, high-precision non-contact temperature measurement and all-scene perception are achieved through dual-light fusion of infrared array sensors and visible light cameras. Emissivity adaptive correction is performed using pot lid material recognition, significantly improving the accuracy of temperature monitoring. Furthermore, by integrating information on pot attributes, temperature distribution, and trends, the system dynamically adjusts the range hood's airflow, achieving intelligent and precise linkage tailored to actual cooking conditions. Simultaneously, by combining visual behavior recognition and infrared temperature field analysis, a multi-layered active safety protection system covering human absence, overflow, and dry burning is constructed. It can also cut off the gas supply through a non-invasive actuator, forming a safety closed loop. In addition, a graded power consumption strategy and modular design ensure all-weather monitoring while also balancing low energy consumption and easy installation, comprehensively improving the safety, intelligence, and energy efficiency of kitchen cooking.

[0057] Figure 3 is a schematic diagram of a smart range hood and cooktop linkage control device based on dual-light fusion provided in an embodiment of this specification. The device may include: a monitoring module 10, used to continuously monitor the heat signal of the cooktop area through an infrared array sensor, and when the heat signal monitored by the infrared array sensor meets the preset ignition trigger conditions, a visible light camera is activated to obtain a visible light image of the cooktop area; a judgment module 20, used to identify the cookware and determine the attributes of the lid based on the visible light image, at least identifying the presence status of the cookware and the material type of the lid; a correction module 30, used to perform adaptive emissivity correction on the temperature measurement data of the infrared array sensor based on the identification results of the cookware and lid attributes; and an execution module 40, used to fuse the corrected temperature data with the visible light image information to perform at least one of the following operations: intelligent adjustment of the range hood airflow, monitoring of unattended cooking, judgment of overflow risk, and judgment of dry burning risk.

[0058] Optionally, the execution module 40 includes: dynamically matching a preset adjustment model based on the cookware size information, the pot lid material information, and the temperature distribution and temperature rise rate data inside the pot obtained by the infrared array sensor, and outputting a control signal to adjust the operating level of the range hood.

[0059] Optionally, the fused and corrected temperature data and the visible light image information perform at least one of the following operations: intelligent adjustment of the range hood air volume, monitoring of people leaving the stove while cooking, judgment of overflow risk, and judgment of dry burning risk. This includes: performing moving target analysis and behavior recognition on the continuous image sequence acquired by the visible light camera; if no effective human activity characteristics are identified in front of the stove within a preset continuous time period, it is determined to be a state of people leaving the stove while cooking, and a safety alarm is triggered.

[0060] Optionally, the execution module 40 includes: analyzing the emissivity-corrected infrared temperature data, focusing on monitoring the temperature at the edge of the cookware or the center of the lid; when the temperature value at the monitoring point exceeds a first safety threshold and its temperature rise curve conforms to a preset overflow characteristic model, it is determined to be at risk of overflow.

[0061] Optionally, the execution module 40 includes: analyzing the temperature distribution data of the entire field of view acquired by the infrared array sensor; if the pot is not detected, or if the pot lid is determined to be covered by combining the identification results of the pot and lid attributes with the temperature data, and if the temperature of the central area of ​​the pot exceeds the second safety threshold and the temperature difference between it and the edge of the pot tends to disappear, or the overall temperature rise rate is abnormal, then it is determined to be a risk of dry burning.

[0062] Optionally, it also includes: when a safety risk event is identified, performing corresponding safety intervention and alarm operations, specifically: the safety intervention and alarm operations include at least triggering an audible and visual alarm, sending alarm information to the user terminal through a wireless communication unit; and, when it is determined that there is a risk of dry burning or that the timeout period for leaving a person unattended while using a hot appliance has expired, outputting a control command to a gas valve control actuator to drive it to close the gas valve.

[0063] Optionally, the monitoring module 10 includes: detecting that the area temperature rises from the ambient temperature and exceeds the ignition threshold, and that its temperature rise rate is greater than a preset rate threshold.

[0064] The functions of the apparatus in this embodiment have been described in the above method embodiments. Therefore, for any parts not detailed in this embodiment, please refer to the relevant descriptions in the foregoing embodiments, which will not be repeated here.

[0065] Based on the same inventive concept, embodiments of this specification also provide an electronic device.

[0066] The following describes embodiments of the electronic device of the present invention, which can be considered as specific implementations of the methods and apparatus embodiments of the present invention described above. Details described in the embodiments of the electronic device of the present invention should be considered as supplements to the methods or apparatus embodiments described above; details not disclosed in the embodiments of the electronic device of the present invention can be implemented with reference to the methods or apparatus embodiments described above.

[0067] Figure 4 is a schematic diagram of the structure of an electronic device provided in an embodiment of this specification. The electronic device 300 according to this embodiment of the present invention will now be described with reference to Figure 4. The electronic device 300 shown in Figure 4 is merely an example and should not impose any limitation on the functionality and scope of use of the embodiments of the present invention.

[0068] As shown in Figure 4, the electronic device 300 is presented in the form of a general-purpose computing device. The components of the electronic device 300 may include, but are not limited to: at least one processing unit 310, at least one storage unit 320, a bus 330 connecting different system components (including storage unit 320 and processing unit 310), a display unit 340, etc.

[0069] The storage unit stores program code that can be executed by the processing unit 310, causing the processing unit 310 to perform the steps described in the processing method section of this specification according to various exemplary embodiments of the present invention. For example, the processing unit 310 can perform the steps shown in FIG1.

[0070] The storage unit 320 may include a readable medium in the form of a volatile storage unit, such as a random access memory unit (RAM) 3201 and / or a cache storage unit 3202, and may further include a read-only memory unit (ROM) 3203.

[0071] The storage unit 320 may also include a program / utility 3204 having a set (at least one) program module 3205, such program module 3205 including but not limited to: an operating system, one or more application programs, other program modules and program data, each or some combination of these examples may include an implementation of a network environment.

[0072] Bus 330 can represent one or more of several types of bus structures, including a memory cell bus or memory cell controller, a peripheral bus, a graphics acceleration port, a processing unit, or a local bus using any of the various bus structures.

[0073] Electronic device 300 can also communicate with one or more external devices 400 (e.g., keyboard, pointing device, Bluetooth device, etc.), and with one or more devices that enable viewers to interact with electronic device 300, and / or with any device that enables electronic device 300 to communicate with one or more other computing devices (e.g., router, modem, etc.). This communication can be performed via input / output (I / O) interface 350. Furthermore, electronic device 300 can also communicate with one or more networks (e.g., local area network (LAN), wide area network (WAN), and / or public networks, such as the Internet) via network adapter 360. Network adapter 360 can communicate with other modules of electronic device 300 via bus 330. It should be understood that, although not shown in Figure 4, other hardware and / or software modules can be used in conjunction with electronic device 300, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0074] Through the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described in this invention can be implemented by software or by combining software with necessary hardware. Therefore, the technical solutions according to the embodiments of this invention can be embodied in the form of a software product, which can be stored in a computer-readable storage medium (such as a CD-ROM, USB flash drive, external hard drive, etc.) or on a network, including several instructions to cause a computing device (such as a personal computer, server, or network device, etc.) to execute the method described above according to this invention. When the computer program is executed by a data processing device, it enables the computer-readable medium to implement the method described above, i.e., the method shown in FIG1.

[0075] Figure 5 is a schematic diagram of a computer-readable medium provided in an embodiment of this specification.

[0076] A computer program implementing the method shown in Figure 1 can be stored on one or more computer-readable media. The computer-readable medium can be a readable signal medium or a readable storage medium. A readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of readable storage media (a non-exhaustive list) include: an electrical connection having one or more wires, a portable disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof.

[0077] The computer-readable storage medium may include data signals propagated in baseband or as part of a carrier wave, carrying readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. The readable storage medium may also be any readable medium other than a readable storage medium, capable of transmitting, propagating, or transmitting programs for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the readable storage medium may be transmitted using any suitable medium, including but not limited to wireless, wired, optical fiber, RF, etc., or any suitable combination thereof.

[0078] Program code for performing the operations of this invention can be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java and C++, and conventional procedural programming languages ​​such as C or similar languages. The program code can execute entirely on the audience's computing device, partially on the audience's device, as a standalone software package, partially on the audience's computing device and partially on a remote computing device, or entirely on a remote computing device or server. In cases involving remote computing devices, the remote computing device can be connected to the audience's computing device via any type of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computing device (e.g., via the Internet using an Internet service provider).

[0079] In summary, the present invention can be implemented in hardware, or as software modules running on one or more processors, or a combination thereof. Those skilled in the art will understand that in practice, general-purpose data processing devices such as microprocessors or digital signal processors (DSPs) can be used to implement some or all of the functions of some or all of the components according to the embodiments of the present invention. The present invention can also be implemented as a device or apparatus program (e.g., a computer program and computer program product) for performing part or all of the methods described herein. Such programs implementing the present invention can be stored on a computer-readable medium or can be in the form of one or more signals. Such signals can be downloaded from an Internet website, provided on a carrier signal, or provided in any other form.

[0080] The specific embodiments described above further illustrate the purpose, technical solution, and beneficial effects of the present invention. It should be understood that the present invention is not inherently related to any specific computer, virtual device, or electronic device, and various general-purpose devices can also implement the present invention. The above descriptions are merely specific embodiments of the present invention and are not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the protection scope of the present invention.

[0081] The various embodiments in this specification are described in a progressive manner. The same or similar parts between the various embodiments can be referred to each other. Each embodiment focuses on describing the differences from other embodiments.

[0082] The above description is merely an embodiment of this application and is not intended to limit the scope of this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the scope of the claims of this application.

Claims

1. A method for intelligent range hood and cooktop linkage control based on dual-light fusion, characterized in that, include: The stove area is continuously monitored by an infrared array sensor. When the thermal signal detected by the infrared array sensor meets the preset ignition triggering conditions, a visible light camera is activated to obtain a visible light image of the stove area. Based on the visible light image, cookware identification and lid attribute determination are performed, at least identifying the state of the cookware and the material type of the lid. Based on the identification results of the attributes of the cookware and lid, the emissivity adaptive correction is performed on the temperature measurement data of the infrared array sensor; the corrected temperature data is fused with the visible light image information, and at least one of the following operations is performed: intelligent adjustment of the range hood air volume, monitoring of cooking when people are away, judgment of overflow risk, and judgment of dry burning risk.

2. The intelligent range hood and cooktop linkage control method based on dual-light fusion as described in claim 1, characterized in that, The fused and corrected temperature data and the visible light image information are used to perform at least one of the following operations: intelligent adjustment of the range hood airflow, monitoring of open flames and absence of personnel, judgment of overflow risk, and judgment of dry burning risk. This includes: dynamically matching a preset adjustment model based on the cookware size information, the pot lid material information, and the temperature distribution and temperature rise rate data inside the pot obtained by the infrared array sensor, and outputting a control signal to adjust the operating level of the range hood.

3. The intelligent range hood and cooktop linkage control method based on dual-light fusion as described in claim 1, characterized in that, The fused and corrected temperature data and the visible light image information are used to perform at least one of the following operations: intelligent adjustment of the range hood air volume, monitoring of people leaving the stove while cooking, judgment of overflow risk, and judgment of dry burning risk. This includes: performing moving target analysis and behavior recognition on the continuous image sequence acquired by the visible light camera; if no effective human activity characteristics are detected in front of the stove within a preset continuous time period, it is determined to be a state of people leaving the stove while cooking, and a safety alarm is triggered.

4. The intelligent range hood and stove linkage control method based on dual-light fusion as described in claim 1, characterized in that, The fused and corrected temperature data and the visible light image information are used to perform at least one of the following operations: intelligent adjustment of the range hood air volume, monitoring of open flame and absence of personnel, judgment of overflow risk, and judgment of dry burning risk. This includes: analyzing the emissivity-corrected infrared temperature data, focusing on monitoring the temperature of the edge of the pot or the center of the lid; when the temperature value of the monitoring point exceeds the first safety threshold and its temperature rise curve conforms to the preset overflow characteristic model, it is determined to be an overflow risk.

5. The intelligent range hood and stove linkage control method based on dual-light fusion as described in claim 1, characterized in that, The fused and corrected temperature data, together with the visible light image information, performs at least one of the following operations: intelligent adjustment of the range hood airflow, monitoring of open flames and absence of personnel, judgment of overflow risk, and judgment of dry burning risk. This includes: analyzing the temperature distribution data of the entire field of view acquired by the infrared array sensor; if a potless state is detected, or if the pot lid is determined to be covered based on the identification results of the pot and lid attributes and the temperature data, and if the temperature in the central area of ​​the pot exceeds the second safety threshold and the temperature difference between the central area and the edge of the pot tends to disappear, or if the overall temperature rise rate is abnormal, then a dry burning risk is determined.

6. The intelligent range hood and stove linkage control method based on dual-light fusion as described in claim 1, characterized in that, Also includes: When a safety risk event is identified, corresponding safety intervention and alarm operations are performed. Specifically, the safety intervention and alarm operations include at least triggering an audible and visual alarm, sending alarm information to the user terminal via a wireless communication unit, and, when it is determined that there is a risk of dry burning or that the timeout period for leaving a person unattended while using a hot appliance has expired, outputting a control command to a gas valve control actuator to drive it to close the gas valve.

7. The intelligent range hood and stove linkage control method based on dual-light fusion as described in claim 1, characterized in that, The thermal signal detected by the infrared array sensor meets the preset ignition triggering conditions, including: detecting that the area temperature rises from the ambient temperature and exceeds the ignition threshold, and that the temperature rise rate is greater than the preset rate threshold.

8. A smart range hood and stove linkage control device based on dual-light fusion, characterized in that, include: The monitoring module continuously monitors the heat signal of the stove area using an infrared array sensor. When the heat signal detected by the infrared array sensor meets the preset ignition trigger conditions, a visible light camera is activated to acquire a visible light image of the stove area. The judgment module identifies the cookware and determines the attributes of the lid based on the visible light image, at least identifying the presence of the cookware and the material type of the lid. The correction module adaptively corrects the emissivity of the temperature measurement data from the infrared array sensor based on the identification results of the cookware and lid attributes. The execution module fuses the corrected temperature data with the visible light image information to perform at least one of the following operations: intelligent adjustment of the range hood airflow, monitoring of unattended cooking, judgment of overflow risk, and judgment of dry burning risk.

9. An electronic device, wherein, The electronic device includes: a processor; and a memory storing computer-executable instructions, which, when executed, cause the processor to perform the method according to any one of claims 1-7.

10. A computer-readable storage medium, wherein, The computer-readable storage medium stores one or more programs that, when executed by a processor, implement the method of any one of claims 1-7.

Images