Refrigerator intelligent control method and device based on infrared array scanning and electronic equipment
By generating a panoramic temperature field for the refrigerator using infrared array scanning technology, the shortcomings of refrigerator temperature sensing and refrigeration control are solved, realizing full-area temperature monitoring and precise refrigeration, reducing energy consumption and improving preservation effect.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- SHANGHAI SUNSHINE TECH CO LTD
- Filing Date
- 2026-03-04
- Publication Date
- 2026-04-10
AI Technical Summary
Existing refrigerators have deficiencies in temperature sensing and refrigeration control, and cannot accurately obtain the three-dimensional spatial temperature distribution inside the refrigerator compartment, resulting in high energy consumption, frequent compressor start-stop, low cooling efficiency, and inability to quickly identify local hot spots.
Using infrared array scanning technology, the refrigerator acquires temperature data from multiple angles inside by rotating and scanning infrared array sensors, generating a panoramic temperature field, identifying the door's open/closed status and user behavior, and achieving precise control of directional airflow and the compressor.
It achieves full-area temperature monitoring and modeling inside the refrigerator, optimizes the compressor's start-stop logic, reduces energy consumption, extends compressor life, improves preservation effect, simplifies hardware structure, and improves cooling efficiency.
Smart Images
Figure CN121829028A_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of intelligent control technology for kitchen appliances, and in particular to an intelligent control method, device, and electronic device for refrigerators based on infrared array scanning. Background Technology
[0002] As the mainstream food preservation equipment in modern households, the intelligent features and energy efficiency of air-cooled refrigerators are the core directions of technological development. However, existing technologies have significant shortcomings in temperature sensing and refrigeration control.
[0003] Firstly, in terms of temperature sensing, current refrigerators generally use negative temperature coefficient thermistors (NTCs) as temperature sensors. NTCs are point sensors, only able to acquire the local temperature near the installation point, unable to sense the overall temperature distribution within the three-dimensional space of the refrigerator compartment. This limited temperature information makes it difficult for the control system to accurately assess the overall heat load, forcing it to make decisions based on limited data. As a result, to compensate for localized temperature rises, the compressor often starts and stops frequently. This "over-control" not only increases overall energy consumption and shortens compressor lifespan but also makes it difficult to ensure all storage areas are at their optimal preservation temperature, affecting food quality.
[0004] Secondly, in terms of cooling distribution, traditional air-cooled refrigerators use fixed air ducts to distribute air evenly, lacking specificity. When a user places warm food (creating a localized "hot spot"), the system cannot quickly identify and focus cooling on that area. Instead, it can only indirectly eliminate the hot spot by lowering the temperature of the entire compartment, resulting in low cooling efficiency, high energy consumption, and unnecessary temperature fluctuations.
[0005] In addition, existing solutions for status detection typically rely on independent door switch sensors and other components, which have limited functionality and increase the hardware cost and structural complexity of the system.
[0006] Infrared array sensors can acquire temperature distribution information on a two-dimensional plane, providing a new approach to solving the aforementioned problems. However, their physical field of view is limited; a single sensor, when fixedly installed, cannot cover the entire three-dimensional space inside the refrigerator, resulting in blind spots. Achieving full coverage by stacking multiple sensors would significantly increase costs, hindering commercial applications.
[0007] Therefore, a method, device, and electronic device for intelligent control of refrigerators based on infrared array scanning are proposed. Summary of the Invention
[0008] This manual provides a refrigerator intelligent control method, device, and electronic equipment based on infrared array scanning, which realizes dynamic monitoring and modeling of the temperature field throughout the refrigerator, provides accurate load data for the compressor, and optimizes its start-stop logic to achieve energy saving, life extension, and improved preservation effect.
[0009] This specification provides a method for intelligent control of a refrigerator based on infrared array scanning, including: Temperature data from several angles inside the refrigerator is obtained by rotating and scanning an infrared array sensor. Temperature data from several angles inside the refrigerator are fused together to generate a panoramic temperature field of the interior space. Based on the panoramic temperature field analysis, the spatiotemporal variation characteristics of temperature data are analyzed, and the opening and closing status of the refrigerator door and the user's food placement behavior events are identified. Based on the identified behavioral events and the specific high-temperature area located in the panoramic temperature field, the airflow adjustment device is controlled to direct airflow towards the specific high-temperature area, and the refrigeration compressor is controlled in conjunction with it.
[0010] Optionally, identifying the open / closed state of the refrigerator door includes: Monitor the changes in ambient temperature within the panoramic temperature field; When the ambient temperature rises to a first multiple of the original ambient temperature within a first preset time, it is determined that a door opening event has occurred; When the ambient temperature drops from its high level when the door is open to near its original ambient temperature within a second preset time, a door closing event is determined to have occurred.
[0011] Optionally, the method of identifying the open / closed state of the refrigerator door further includes: The field of view of the infrared array sensor is divided into a left logic region and a right logic region along the center. If the temperature rise slope of the right logic region is greater than the first slope threshold, and the temperature rise slope of the left logic region is greater than the second slope threshold, then it is determined that the right door is open only; wherein, the second slope threshold is less than the first slope threshold. If the overall temperature of the panoramic temperature field rises uniformly within a third preset time period and the slope is greater than the third slope threshold, it is determined to be a double door.
[0012] Optionally, the identification of the user's action of putting food in also includes: After being identified as a single-door opening state, if the temperature of more than one-third of the field of view in the panoramic temperature field is detected to rise above the first high temperature threshold within a fourth preset time and then drop below the first low temperature threshold, it is determined that an insertion action has occurred.
[0013] Optionally, locating a specific high-temperature region in the panoramic temperature field includes: After recognizing the door closing event, delay for a fifth preset time to obtain the panoramic temperature field after the door closes; The panoramic temperature field after the door is closed is compared with the pre-stored baseline panoramic temperature field before the door is opened. The region is determined to be the specific high-temperature region when any of the following conditions are met: The difference between the highest temperature in the corresponding area after the door is closed and the highest temperature of the reference before the door is opened is greater than or equal to the first temperature difference threshold. The ratio of the average temperature of the corresponding area after the door is closed to the average temperature of the baseline before the door is opened is greater than or equal to the ratio threshold. The difference between the highest temperature in the corresponding area after the door is closed and the current ambient temperature is greater than or equal to the second temperature difference threshold.
[0014] Optionally, the method of identifying the open / closed state of the refrigerator door further includes: If the event is determined to be an open door event, and the duration of the open door state exceeds a certain time threshold, an open door timeout alarm signal will be generated.
[0015] Optionally, the step of acquiring temperature data at several angles inside the refrigerator via a rotating scanning infrared array sensor includes: The control servo drives the infrared array sensor to rotate in 1° step angles; Within a total rotation range of 90°, one frame of 8×8 pixel temperature data is acquired at each angle.
[0016] This specification provides a refrigerator intelligent control device based on infrared array scanning, including: The acquisition module is used to acquire temperature data at several angles inside the refrigerator through a rotating scanning infrared array sensor. The fusion module is used to fuse temperature data from several angles inside the refrigerator to generate a panoramic temperature field of the interior space. The identification module is used to analyze the spatiotemporal variation characteristics of temperature data based on the panoramic temperature field, and to identify the opening and closing status of the refrigerator door and the user's behavior of putting food in. The control module is used to control the airflow adjustment device to direct airflow towards the specific high-temperature area based on the identified behavioral events and the specific high-temperature area located in the panoramic temperature field, and to control the refrigeration compressor in conjunction with the adjustment.
[0017] Optionally, identifying the open / closed state of the refrigerator door includes: Monitor the changes in ambient temperature within the panoramic temperature field; When the ambient temperature rises to a first multiple of the original ambient temperature within a first preset time, it is determined that a door opening event has occurred; When the ambient temperature drops from its high level when the door is open to near its original ambient temperature within a second preset time, a door closing event is determined to have occurred.
[0018] Optionally, the method of identifying the open / closed state of the refrigerator door further includes: The field of view of the infrared array sensor is divided into a left logic region and a right logic region along the center. If the temperature rise slope of the right logic region is greater than the first slope threshold, and the temperature rise slope of the left logic region is greater than the second slope threshold, then it is determined that the right door is open only; wherein, the second slope threshold is less than the first slope threshold. If the overall temperature of the panoramic temperature field rises uniformly within a third preset time period and the slope is greater than the third slope threshold, it is determined to be a double door.
[0019] Optionally, the identification of the user's action of putting food in also includes: After being identified as a single-door opening state, if the temperature of more than one-third of the field of view in the panoramic temperature field is detected to rise above the first high temperature threshold within a fourth preset time and then drop below the first low temperature threshold, it is determined that an insertion action has occurred.
[0020] Optionally, locating a specific high-temperature region in the panoramic temperature field includes: After recognizing the door closing event, delay for a fifth preset time to obtain the panoramic temperature field after the door closes; The panoramic temperature field after the door is closed is compared with the pre-stored baseline panoramic temperature field before the door is opened. The region is determined to be the specific high-temperature region when any of the following conditions are met: The difference between the highest temperature in the corresponding area after the door is closed and the highest temperature of the reference before the door is opened is greater than or equal to the first temperature difference threshold. The ratio of the average temperature of the corresponding area after the door is closed to the average temperature of the baseline before the door is opened is greater than or equal to the ratio threshold. The difference between the highest temperature in the corresponding area after the door is closed and the current ambient temperature is greater than or equal to the second temperature difference threshold.
[0021] Optionally, the method of identifying the open / closed state of the refrigerator door further includes: If the event is determined to be an open door event, and the duration of the open door state exceeds a certain time threshold, an open door timeout alarm signal will be generated.
[0022] Optionally, the step of acquiring temperature data at several angles inside the refrigerator via a rotating scanning infrared array sensor includes: The control servo drives the infrared array sensor to rotate in 1° step angles; Within a total rotation range of 90°, one frame of 8×8 pixel temperature data is acquired at each angle.
[0023] This specification also provides an electronic device, wherein the electronic device includes: A processor; and a memory storing computer-executable instructions, which, when executed, cause the processor to perform any of the methods described above.
[0024] This specification also provides a computer-readable storage medium that stores one or more programs that, when executed by a processor, implement any of the methods described above.
[0025] This invention achieves dynamic monitoring and modeling of the entire internal temperature field of a refrigerator, providing accurate load data for the compressor and optimizing its start-stop logic to achieve energy saving, extended lifespan, and improved preservation. A single infrared array sensor integrates multiple functions such as door opening / closing status and user hand gestures, replacing traditional dedicated sensors, simplifying the hardware structure, and reducing costs. By identifying localized high-temperature hotspots, the air duct system is driven to deliver directional and precise airflow, achieving efficient and rapid elimination of heat load and improving cooling efficiency and system energy efficiency. A servo steering mechanism drives the sensor to scan, overcoming the physical field-of-view limitations with minimal hardware cost, achieving comprehensive, blind-spot-free temperature monitoring of the entire storage space. Attached Figure Description
[0026] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0027] Figure 1 A schematic diagram illustrating the principle of an intelligent refrigerator control method based on infrared array scanning, provided in the embodiments of this specification; Figure 2 This is a schematic diagram of the structure of the refrigeration compartment of a frost-free refrigerator provided in the embodiments of this specification; Figure 3 A schematic diagram of the structure of a refrigerator intelligent control device based on infrared array scanning provided in the embodiments of this specification; Figure 4 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this specification; Figure 5 This is a schematic diagram of a computer-readable medium provided for embodiments of this specification. Detailed Implementation
[0028] The following description is intended to disclose the present invention and enable those skilled in the art to implement it. The preferred embodiments described below are merely examples, and other obvious variations will occur to those skilled in the art. The basic principles of the invention defined in the following description can be applied to other embodiments, modifications, improvements, equivalents, and other technical solutions that do not depart from the spirit and scope of the invention.
[0029] The following is in conjunction with the appendix Figure 1-5 Exemplary embodiments of the invention will be described more fully here. However, exemplary embodiments can be implemented in many forms and should not be construed as limiting the invention to the embodiments set forth herein. Rather, these exemplary embodiments are provided to make the invention more comprehensive and complete, and to facilitate a full communication of the inventive concept to those skilled in the art. The same reference numerals in the figures denote the same or similar elements, components, or parts, and therefore repeated descriptions of them are omitted.
[0030] Subject to the technical concept of this invention, the features, structures, characteristics or other details described in a particular embodiment may be combined in one or more other embodiments in a suitable manner.
[0031] In the description of specific embodiments, the features, structures, characteristics, or other details described in this invention are intended to enable those skilled in the art to fully understand the embodiments. However, it is not excluded that those skilled in the art can practice the technical solutions of this invention without one or more of the specific features, structures, characteristics, or other details.
[0032] The flowcharts shown in the accompanying drawings are merely illustrative and do not necessarily include all content and operations / steps, nor do they necessarily have to be performed in the described order. For example, some operations / steps can be broken down, while others can be combined or partially combined; therefore, the actual execution order may change depending on the specific circumstances.
[0033] The block diagrams shown in the accompanying drawings are merely functional entities and do not necessarily correspond to physically independent entities. That is, these functional entities can be implemented in software, in one or more hardware modules or integrated circuits, or in different network and / or processor devices and / or microcontroller devices.
[0034] The terms “and / or” or “and / or” include all combinations of any one or more of the listed items.
[0035] Figure 1 This specification provides a schematic diagram of a refrigerator intelligent control method based on infrared array scanning, which may include: S110: Acquires temperature data from several angles inside the refrigerator via a rotating scanning infrared array sensor; In the specific implementation of this specification, after power-on initialization, an infrared array sensor (preferably with a resolution of 8×8 and a field of view of 54°) is driven by a first servo motor to perform rotational scanning, thereby acquiring temperature data of the refrigerator's interior from multiple angles.
[0036] Optionally, S110 includes: The control servo drives the infrared array sensor to rotate in 1° step angles; Within a total rotation range of 90°, one frame of 8×8 pixel temperature data is acquired at each angle.
[0037] In the specific implementation of this specification, such as Figure 2 As shown, the first servo motor precisely drives the bracket, which is fixed with an infrared array sensor, to rotate in 1° increments. The total rotational stroke of the servo motor is 90°. At each discrete angular position (e.g., from 0° to 90°, a total of 91 positions), the servo motor pauses, and the infrared array sensor acquires a frame of 8×8 pixel local temperature data. After completing all angular scans, the system obtains a total of 91 frames (8×8) of raw data. Through the fusion algorithm built into the temperature acquisition module, these data are stitched and interpolated according to their spatial angular relationships at the time of acquisition, ultimately synthesizing a panoramic temperature field with extremely high spatial resolution. Calculated at 64 pixels per frame, this scanning and synthesis process can theoretically obtain up to 5760 (64×90) effective temperature data points, improving the spatial resolution by approximately 90 times, achieving a fundamental leap from point temperature measurement to field temperature measurement.
[0038] S120: The temperature data from several angles inside the refrigerator are fused together to generate a panoramic temperature field of the interior space; In the specific implementation described in this specification, these discrete temperature data from different angles are uploaded to the temperature acquisition module. This module, through coordinate transformation and data fusion algorithms, generates a high-resolution panoramic temperature field covering the entire target space inside the refrigerator. This panoramic temperature field serves as the data foundation for all subsequent intelligent analyses.
[0039] S130: Analyze the spatiotemporal variation characteristics of temperature data based on the panoramic temperature field, and identify the opening and closing status of the refrigerator door and the user's food placement behavior events; In the specific implementation of this specification, the core processing unit (including the temperature acquisition module and the refrigerator main control module) continuously analyzes the spatiotemporal variation characteristics of this panoramic temperature field data sequence, and intelligently identifies the opening and closing status of the refrigerator door (such as open, closed, single / double door) and the user's behavior of putting food in.
[0040] S140: Based on the identified behavioral events and the specific high-temperature area located in the panoramic temperature field, control the airflow adjustment device to direct airflow towards the specific high-temperature area and control the refrigeration compressor in conjunction.
[0041] In the specific implementation of this specification, when the system recognizes that the user has placed food and thereby locates a specific high-temperature area (i.e., "hot spot") in the panoramic temperature field, the refrigerator's main control module will generate control commands: on the one hand, start the refrigeration compressor, and on the other hand, control a second servo motor to drive the air direction adjustment device (such as a deflector) to rotate precisely, so that the cold air outlet is directed to the specific high-temperature area for directional air delivery, thereby achieving rapid, efficient, and precise local cooling.
[0042] Optionally, identifying the open / closed state of the refrigerator door includes: Monitor the changes in ambient temperature within the panoramic temperature field; When the ambient temperature rises to a first multiple of the original ambient temperature within a first preset time, it is determined that a door opening event has occurred; When the ambient temperature drops from its high level when the door is open to near its original ambient temperature within a second preset time, a door closing event is determined to have occurred.
[0043] In the specific implementation of this specification, when identifying the refrigerator door's open / closed state, the system continuously monitors and calculates the average ambient temperature reflected in the panoramic temperature field in cycles of approximately 5 seconds. When the system detects that the average ambient temperature rises to 1.1 times the original ambient temperature value within one cycle (for example, if the original temperature is 7°C, the trigger threshold is 7.7°C), an opening event is determined to have occurred. After determining that the door is open, the system continuously monitors the ambient temperature. When it detects that the temperature begins to drop from its high point after the door is opened and returns to a level close to the original ambient temperature before the door was opened within a certain period of time, a closing event is determined to have been completed.
[0044] Optionally, the method of identifying the open / closed state of the refrigerator door further includes: The field of view of the infrared array sensor is divided into a left logic region and a right logic region along the center. If the temperature rise slope of the right logic region is greater than the first slope threshold, and the temperature rise slope of the left logic region is greater than the second slope threshold, then it is determined that the right door is open only; wherein, the second slope threshold is less than the first slope threshold. If the overall temperature of the panoramic temperature field rises uniformly within a third preset time period and the slope is greater than the third slope threshold, it is determined to be a double door.
[0045] In the specific implementation of this specification, to further distinguish between single-door and double-door refrigerators, the system performs spatial region analysis on the panoramic temperature field. The original field of view (or the fused temperature field logical partition) of the infrared array sensor is divided into a left logical region and a right logical region along the vertical center line, corresponding to the left and right door regions of the refrigerator, respectively. When the influx of external hot air is mainly caused by the opening of the right door, the temperature in the right logical region will rise sharply, and its temperature rise slope (e.g., temperature rise per unit time) will be greater than a high first slope threshold (e.g., slope > 2). At the same time, due to air convection, the left logical region will also experience a temperature rise, but the slope is relatively low, greater than a small second slope threshold (e.g., slope > 1.2). When this condition is met, the system determines that the right door is single-door open. Conversely, it determines that the left door is single-door open. When both doors of the refrigerator are opened at the same time, hot air from outside rushes into the entire compartment evenly and quickly, causing the overall temperature field to rise evenly and rapidly in a short period of time (e.g., within 3 seconds). If the overall temperature rise slope is greater than a higher third slope threshold (e.g., slope > 2.5), the system will determine it as a double-door event.
[0046] Optionally, the identification of the user's action of putting food in also includes: After being identified as a single-door opening state, if the temperature of more than one-third of the field of view in the panoramic temperature field is detected to rise above the first high temperature threshold within a fourth preset time and then drop below the first low temperature threshold, it is determined that an insertion action has occurred.
[0047] In the specific implementation of this specification, after recognizing a single-door opening state, the system further monitors the user's action of placing food inside the refrigerator. This action is manifested as the user's hand carrying warm food into the refrigerator and then withdrawing it. The system captures this action by analyzing the dynamic changes in the panoramic temperature field: if the system detects that the temperature of more than one-third of the pixels in the field of view rapidly rises to above a first high-temperature threshold (e.g., 20°C) within a short period of time (e.g., within 5 seconds), and then rapidly drops below a first low-temperature threshold (e.g., 10°C), the system determines that the user has completed a food placement action. This recognition is only performed in the single-door opening state to improve accuracy.
[0048] Optionally, locating a specific high-temperature region in the panoramic temperature field includes: After recognizing the door closing event, delay for a fifth preset time to obtain the panoramic temperature field after the door closes; The panoramic temperature field after the door is closed is compared with the pre-stored baseline panoramic temperature field before the door is opened. The region is determined to be the specific high-temperature region when any of the following conditions are met: The difference between the highest temperature in the corresponding area after the door is closed and the highest temperature of the reference before the door is opened is greater than or equal to the first temperature difference threshold. The ratio of the average temperature of the corresponding area after the door is closed to the average temperature of the baseline before the door is opened is greater than or equal to the ratio threshold. The difference between the highest temperature in the corresponding area after the door is closed and the current ambient temperature is greater than or equal to the second temperature difference threshold.
[0049] In the specific implementation of this specification, in order to locate a specific high-temperature area (i.e., the location where newly placed food is placed), the system does not immediately compare after recognizing a door closing event, but delays for a fifth preset time to allow the internal air disturbance to initially subside before acquiring the panoramic temperature field after the door is closed. Subsequently, the system compares the temperature field after the door is closed with the baseline panoramic temperature field before the door is opened, stored in the memory, region by region or pixel by pixel. The comparison criteria are multi-faceted. The comparison area can be determined as a specific high-temperature area that needs to be cooled if any of the following conditions are met: (1) the difference between the highest temperature of the area after the door is closed and the highest temperature of the baseline before the door is opened is greater than or equal to a first temperature difference threshold (e.g., 4°C); (2) the ratio of the average temperature of the area after the door is closed to the average temperature of the baseline before the door is opened is greater than or equal to a ratio threshold (e.g., 2); (3) the difference between the highest temperature of the area after the door is closed and the current average ambient temperature inside the refrigerator is greater than or equal to a second temperature difference threshold (e.g., 2°C).
[0050] To more accurately locate food, the system's fifth preset time is not a fixed value but is intelligently adjusted based on the type of door opening. In a single-door scenario, where thermal disturbance is relatively localized, the system begins scanning and comparison after a 5-second delay following door closing. In a double-door scenario, where internal thermal disturbance is more widespread and subsides more slowly, the system performs a 10-second delay before conducting a panoramic scan and comparison. This strategy ensures a relatively stable temperature field during comparison, resulting in more accurate positioning results.
[0051] Optionally, the method of identifying the open / closed state of the refrigerator door further includes: If the event is determined to be an open door event, and the duration of the open door state exceeds a certain time threshold, an open door timeout alarm signal will be generated.
[0052] In the specific implementation of this specification, the system also has a door opening / closing status recognition function with door opening timeout judgment and alarm function. Once a door opening event is determined, the system starts timing. If the door opening status lasts for more than a set time threshold (e.g., 30 seconds) and the temperature change slope remains positive (indicating continuous heat inflow), the temperature acquisition module will send a "door opening time too long" command to the refrigerator main control module. The main control module will then drive the alarm buzzer to sound a warning sound or display a prompt message on the display operation module to remind the user to close the door and avoid cold loss and increased energy consumption.
[0053] After directional airflow is initiated, the system does not cease operation. The second servo motor continuously directs the air outlet towards the identified high-temperature area, while the system continuously updates the panoramic temperature field at short intervals, monitoring the temperature feedback in that area in real time. Only when the temperature in that area has decreased and stabilized within the preset normal storage temperature range does the system control the second servo motor to return to its original position and adjust or shut down the compressor based on the overall temperature situation, forming a complete closed-loop control process of "sensing-positioning-execution-feedback-stopping," achieving rapid cooling while avoiding overcooling and energy waste.
[0054] By integrating the functions of multiple NTC temperature sensors and door switch sensors required in traditional solutions through a single infrared array sensor and its scanning mechanism, the hardware structure is significantly simplified, reducing material costs and assembly complexity. Simultaneously, complex image processing and pattern recognition algorithms are centralized in a dedicated temperature acquisition module, reducing the computational burden on the refrigerator's main control module and improving the overall system response efficiency.
[0055] This invention achieves dynamic monitoring and modeling of the entire internal temperature field of a refrigerator, providing accurate load data for the compressor and optimizing its start-stop logic to achieve energy saving, extended lifespan, and improved preservation. A single infrared array sensor integrates multiple functions such as door opening / closing status and user hand gestures, replacing traditional dedicated sensors, simplifying the hardware structure, and reducing costs. By identifying localized high-temperature hotspots, the air duct system is driven to deliver directional and precise airflow, achieving efficient and rapid elimination of heat load and improving cooling efficiency and system energy efficiency. A servo steering mechanism drives the sensor to scan, overcoming the physical field-of-view limitations with minimal hardware cost, achieving comprehensive, blind-spot-free temperature monitoring of the entire storage space.
[0056] Figure 3 This specification provides a schematic diagram of a refrigerator intelligent control device based on infrared array scanning, which may include: The acquisition module 10 is used to acquire temperature data at several angles inside the refrigerator through a rotating scanning infrared array sensor; The fusion module 20 is used to fuse temperature data from several angles inside the refrigerator to generate a panoramic temperature field of the interior space. The identification module 30 is used to analyze the spatiotemporal variation characteristics of temperature data based on the panoramic temperature field, and to identify the opening and closing status of the refrigerator door and the user's food placement behavior events. The control module 40 is used to control the airflow adjustment device to direct airflow towards the specific high-temperature area based on the identified behavioral events and the specific high-temperature area located in the panoramic temperature field, and to control the refrigeration compressor in conjunction with the operation.
[0057] Optionally, identifying the open / closed state of the refrigerator door includes: Monitor the changes in ambient temperature within the panoramic temperature field; When the ambient temperature rises to a first multiple of the original ambient temperature within a first preset time, it is determined that a door opening event has occurred; When the ambient temperature drops from its high level when the door is open to near its original ambient temperature within a second preset time, a door closing event is determined to have occurred.
[0058] Optionally, the method of identifying the open / closed state of the refrigerator door further includes: The field of view of the infrared array sensor is divided into a left logic region and a right logic region along the center. If the temperature rise slope of the right logic region is greater than the first slope threshold, and the temperature rise slope of the left logic region is greater than the second slope threshold, then it is determined that the right door is open only; wherein, the second slope threshold is less than the first slope threshold. If the overall temperature of the panoramic temperature field rises uniformly within a third preset time period and the slope is greater than the third slope threshold, it is determined to be a double door.
[0059] Optionally, the identification of the user's action of putting food in also includes: After being identified as a single-door opening state, if the temperature of more than one-third of the field of view in the panoramic temperature field is detected to rise above the first high temperature threshold within a fourth preset time and then drop below the first low temperature threshold, it is determined that an insertion action has occurred.
[0060] Optionally, locating a specific high-temperature region in the panoramic temperature field includes: After recognizing the door closing event, delay for a fifth preset time to obtain the panoramic temperature field after the door closes; The panoramic temperature field after the door is closed is compared with the pre-stored baseline panoramic temperature field before the door is opened. The region is determined to be the specific high-temperature region when any of the following conditions are met: The difference between the highest temperature in the corresponding area after the door is closed and the highest temperature of the reference before the door is opened is greater than or equal to the first temperature difference threshold. The ratio of the average temperature of the corresponding area after the door is closed to the average temperature of the baseline before the door is opened is greater than or equal to the ratio threshold. The difference between the highest temperature in the corresponding area after the door is closed and the current ambient temperature is greater than or equal to the second temperature difference threshold.
[0061] Optionally, the method of identifying the open / closed state of the refrigerator door further includes: If the event is determined to be an open door event, and the duration of the open door state exceeds a certain time threshold, an open door timeout alarm signal will be generated.
[0062] Optionally, the step of acquiring temperature data at several angles inside the refrigerator via a rotating scanning infrared array sensor includes: The control servo drives the infrared array sensor to rotate in 1° step angles; Within a total rotation range of 90°, one frame of 8×8 pixel temperature data is acquired at each angle.
[0063] The functions of the apparatus in this embodiment have been described in the above method embodiments. Therefore, for any parts not detailed in this embodiment, please refer to the relevant descriptions in the foregoing embodiments, which will not be repeated here.
[0064] Based on the same inventive concept, embodiments of this specification also provide an electronic device.
[0065] The following describes embodiments of the electronic device of the present invention, which can be considered as specific implementations of the methods and apparatus embodiments of the present invention described above. Details described in the embodiments of the electronic device of the present invention should be considered as supplements to the methods or apparatus embodiments described above; details not disclosed in the embodiments of the electronic device of the present invention can be implemented with reference to the methods or apparatus embodiments described above.
[0066] Figure 4 This is a schematic diagram of an electronic device provided as an embodiment of this specification. Refer to the following... Figure 4 The electronic device 300 according to this embodiment of the present invention will be described. Figure 4 The electronic device 300 shown is merely an example and should not impose any limitations on the functionality and scope of use of the embodiments of the present invention.
[0067] like Figure 4 As shown, the electronic device 300 is presented in the form of a general-purpose computing device. The components of the electronic device 300 may include, but are not limited to: at least one processing unit 310, at least one storage unit 320, a bus 330 connecting different system components (including storage unit 320 and processing unit 310), a display unit 340, etc.
[0068] The storage unit stores program code that can be executed by the processing unit 310, causing the processing unit 310 to perform the steps described in the processing method section of this specification according to various exemplary embodiments of the present invention. For example, the processing unit 310 can perform, for example... Figure 1 The steps are shown.
[0069] The storage unit 320 may include a readable medium in the form of a volatile storage unit, such as a random access memory unit (RAM) 3201 and / or a cache storage unit 3202, and may further include a read-only memory unit (ROM) 3203.
[0070] The storage unit 320 may also include a program / utility 3204 having a set (at least one) program module 3205, such program module 3205 including but not limited to: an operating system, one or more application programs, other program modules and program data, each or some combination of these examples may include an implementation of a network environment.
[0071] Bus 330 can represent one or more of several types of bus structures, including a memory cell bus or memory cell controller, a peripheral bus, a graphics acceleration port, a processing unit, or a local bus using any of the various bus structures.
[0072] Electronic device 300 can also communicate with one or more external devices 400 (e.g., keyboard, pointing device, Bluetooth device, etc.), and with one or more devices that enable viewers to interact with electronic device 300, and / or with any device that enables electronic device 300 to communicate with one or more other computing devices (e.g., router, modem, etc.). This communication can be performed via input / output (I / O) interface 350. Furthermore, electronic device 300 can also communicate with one or more networks (e.g., local area network (LAN), wide area network (WAN), and / or public networks, such as the Internet) via network adapter 360. Network adapter 360 can communicate with other modules of electronic device 300 via bus 330. It should be understood that, although... Figure 4 As not shown, other hardware and / or software modules may be used in conjunction with electronic device 300, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.
[0073] Through the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described in this invention can be implemented by software or by combining software with necessary hardware. Therefore, the technical solutions according to the embodiments of this invention can be embodied in the form of a software product, which can be stored in a computer-readable storage medium (such as a CD-ROM, USB flash drive, external hard drive, etc.) or on a network, including several instructions to cause a computing device (such as a personal computer, server, or network device, etc.) to execute the method described above according to this invention. When the computer program is executed by a data processing device, it enables the computer-readable medium to implement the method described above, i.e.: as... Figure 1 The method shown.
[0074] Figure 5 This is a schematic diagram of a computer-readable medium provided for embodiments of this specification.
[0075] accomplish Figure 1 The computer program of the method shown can be stored on one or more computer-readable media. A computer-readable medium can be a readable signal medium or a readable storage medium. A readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of readable storage media (a non-exhaustive list) include: an electrical connection having one or more wires, a portable disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof.
[0076] The computer-readable storage medium may include data signals propagated in baseband or as part of a carrier wave, carrying readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. The readable storage medium may also be any readable medium other than a readable storage medium, capable of transmitting, propagating, or transmitting programs for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the readable storage medium may be transmitted using any suitable medium, including but not limited to wireless, wired, optical fiber, RF, etc., or any suitable combination thereof.
[0077] Program code for performing the operations of this invention can be written in any combination of one or more programming languages, including object-oriented programming languages such as Java and C++, and conventional procedural programming languages such as C or similar languages. The program code can execute entirely on the audience's computing device, partially on the audience's device, as a standalone software package, partially on the audience's computing device and partially on a remote computing device, or entirely on a remote computing device or server. In cases involving remote computing devices, the remote computing device can be connected to the audience's computing device via any type of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computing device (e.g., via the Internet using an Internet service provider).
[0078] In summary, the present invention can be implemented in hardware, or as software modules running on one or more processors, or a combination thereof. Those skilled in the art will understand that in practice, general-purpose data processing devices such as microprocessors or digital signal processors (DSPs) can be used to implement some or all of the functions of some or all of the components according to the embodiments of the present invention. The present invention can also be implemented as a device or apparatus program (e.g., a computer program and computer program product) for performing part or all of the methods described herein. Such programs implementing the present invention can be stored on a computer-readable medium or can be in the form of one or more signals. Such signals can be downloaded from an Internet website, provided on a carrier signal, or provided in any other form.
[0079] The specific embodiments described above further illustrate the purpose, technical solution, and beneficial effects of the present invention. It should be understood that the present invention is not inherently related to any specific computer, virtual device, or electronic device, and various general-purpose devices can also implement the present invention. The above descriptions are merely specific embodiments of the present invention and are not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the protection scope of the present invention.
[0080] The various embodiments in this specification are described in a progressive manner. The same or similar parts between the various embodiments can be referred to each other. Each embodiment focuses on describing the differences from other embodiments.
[0081] The above description is merely an embodiment of this application and is not intended to limit the scope of this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the scope of the claims of this application.
Claims
1. A method for intelligent control of a refrigerator based on infrared array scanning, characterized in that, include: Temperature data from several angles inside the refrigerator is obtained by rotating and scanning an infrared array sensor. Temperature data from several angles inside the refrigerator are fused together to generate a panoramic temperature field of the interior space. Based on the panoramic temperature field analysis, the spatiotemporal variation characteristics of temperature data are analyzed, and the opening and closing status of the refrigerator door and the user's food placement behavior events are identified. Based on the identified behavioral events and the specific high-temperature area located in the panoramic temperature field, the airflow adjustment device is controlled to direct airflow towards the specific high-temperature area, and the refrigeration compressor is controlled in conjunction with it.
2. The refrigerator intelligent control method based on infrared array scanning as described in claim 1, characterized in that, The identification of the refrigerator door's open / closed state includes: Monitor the changes in ambient temperature within the panoramic temperature field; When the ambient temperature rises to a first multiple of the original ambient temperature within a first preset time, it is determined that a door opening event has occurred; When the ambient temperature drops from its high level when the door is open to near its original ambient temperature within a second preset time, a door closing event is determined to have occurred.
3. The refrigerator intelligent control method based on infrared array scanning as described in claim 2, characterized in that, The method of identifying the open / closed state of the refrigerator door also includes: The field of view of the infrared array sensor is divided into a left logic region and a right logic region along the center. If the temperature rise slope of the right logic region is greater than the first slope threshold, and the temperature rise slope of the left logic region is greater than the second slope threshold, then it is determined that the right door is open only; wherein, the second slope threshold is less than the first slope threshold. If the overall temperature of the panoramic temperature field rises uniformly within a third preset time period and the slope is greater than the third slope threshold, it is determined to be a double door.
4. The refrigerator intelligent control method based on infrared array scanning as described in claim 1, characterized in that, The method of recognizing the user's action of putting food in also includes: After being identified as a single-door opening state, if the temperature of more than one-third of the field of view in the panoramic temperature field is detected to rise above the first high temperature threshold within a fourth preset time and then drop below the first low temperature threshold, it is determined that an insertion action has occurred.
5. The refrigerator intelligent control method based on infrared array scanning as described in claim 1 or 4, characterized in that, Locating specific high-temperature regions within the panoramic temperature field includes: After recognizing the door closing event, delay for a fifth preset time to obtain the panoramic temperature field after the door closes; The panoramic temperature field after the door is closed is compared with the pre-stored baseline panoramic temperature field before the door is opened. The region is determined to be the specific high-temperature region when any of the following conditions are met: The difference between the highest temperature in the corresponding area after the door is closed and the highest temperature of the reference before the door is opened is greater than or equal to the first temperature difference threshold. The ratio of the average temperature of the corresponding area after the door is closed to the average temperature of the baseline before the door is opened is greater than or equal to the ratio threshold. The difference between the highest temperature in the corresponding area after the door is closed and the current ambient temperature is greater than or equal to the second temperature difference threshold.
6. The refrigerator intelligent control method based on infrared array scanning as described in claim 2 or 3, characterized in that, The method of identifying the open / closed state of the refrigerator door also includes: If the event is determined to be an open door event, and the duration of the open door state exceeds a certain time threshold, an open door timeout alarm signal will be generated.
7. The refrigerator intelligent control method based on infrared array scanning as described in claim 1, characterized in that, The method of acquiring temperature data at several angles inside the refrigerator using a rotating scanning infrared array sensor includes: The control servo drives the infrared array sensor to rotate in 1° step angles; Within a total rotation range of 90°, one frame of 8×8 pixel temperature data is acquired at each angle.
8. A refrigerator intelligent control device based on infrared array scanning, characterized in that, include: The acquisition module is used to acquire temperature data at several angles inside the refrigerator through a rotating scanning infrared array sensor. The fusion module is used to fuse temperature data from several angles inside the refrigerator to generate a panoramic temperature field of the interior space. The identification module is used to analyze the spatiotemporal variation characteristics of temperature data based on the panoramic temperature field, and to identify the opening and closing status of the refrigerator door and the user's behavior of putting food in. The control module is used to control the airflow adjustment device to direct airflow towards the specific high-temperature area based on the identified behavioral events and the specific high-temperature area located in the panoramic temperature field, and to control the refrigeration compressor in conjunction with the adjustment.
9. An electronic device, wherein, The electronic device includes: A processor; and a memory storing computer-executable instructions, which, when executed, cause the processor to perform the method according to any one of claims 1-7.
10. A computer-readable storage medium, wherein, The computer-readable storage medium stores one or more programs that, when executed by a processor, implement the method of any one of claims 1-7.