A cooking device door opening control method and device, a cooking device, and a storage medium

Abstract

The application provides a cooking equipment door opening control method and device, cooking equipment and a storage medium. The method comprises: acquiring an internal temperature of the equipment, and acquiring image information and position information of a user; determining posture information corresponding to the user according to the image information, wherein the posture information is used to represent whether the user has a door opening action and whether the user wears a protective device; determining a corresponding door opening state according to the posture information and the position information; determining a corresponding door opening strategy according to the internal temperature and the door opening state; and controlling the equipment to perform a corresponding door opening action according to the door opening strategy. Through the scheme, intelligent control of the equipment door can be realized according to the position, posture and internal temperature of the user, so that the user can be prevented from being scalded by steam due to opening of the door, and the use safety is improved.

Description

Technical Field

[0001] This application relates to the field of smart home technology, and in particular to a method, device, cooking equipment and storage medium for controlling the opening of a cooking appliance door. Background Technology

[0002] With the improvement of people's living standards and the rapid development of smart home technology, the variety of appliances in the kitchen is gradually increasing. Among them, the intelligence level of appliances such as microwave ovens and ovens that cook food at high temperatures is also constantly improving. Traditional microwave ovens and ovens usually require users to manually open the door to remove the food after cooking. Because the internal temperature of these appliances is still high after cooking, there are safety hazards such as burns and hot steam hitting the face when manually removing the food.

[0003] Therefore, there is an urgent need for a technical solution that can enable intelligent door opening for such devices. Summary of the Invention

[0004] This application provides a method, device, cooking equipment, and storage medium for controlling the opening of a cooking device, in order to solve the problem that in the prior art, after cooking, microwave ovens, ovens, and other equipment usually require users to manually open the door to remove the food. Because the internal temperature of such equipment is high after cooking, there are safety hazards such as burns and hot steam hitting the face when manually removing the food.

[0005] In a first aspect, this application provides a method for controlling the opening of a cooking appliance door, including:

[0006] It acquires the device's internal temperature, as well as the user's image and location information;

[0007] The user's posture information is determined based on the image information, wherein the posture information is used to characterize whether the user is performing a door-opening action and whether the user is wearing protective gear;

[0008] Based on the posture information and the position information, the corresponding door opening state is determined;

[0009] Based on the internal temperature and the door opening status, determine the corresponding door opening strategy;

[0010] The device is controlled to perform the corresponding door opening action according to the door opening strategy.

[0011] In one possible implementation, determining the corresponding door opening state based on the posture information and the position information includes:

[0012] Determine whether the user is in the door-opening area based on the location information;

[0013] If the user is within the door opening area, the user is performing a door opening action, and the user is wearing protective gear, then the door opening state corresponding to the user is determined to be a safe door opening state.

[0014] If the user is in the door opening area, the user is opening the door, and the user is not wearing protective gear, the door opening state corresponding to the user is determined to be a dangerous door opening state.

[0015] If the user is outside the door opening area, or if the user does not perform any door opening action, the door opening state corresponding to the user is determined to be the closed door state.

[0016] In one possible implementation, determining the corresponding door opening strategy based on the internal temperature and the door opening state includes:

[0017] If the internal temperature is higher than a preset threshold and the door opening state is a safe opening state, the corresponding door opening strategy is determined to control the device to open the device door at a preset angle, which is less than the angle of fully opening the device door, and if the user continues to approach the device and the internal temperature is not higher than the preset threshold, the device is controlled to fully open the device door.

[0018] If the internal temperature is higher than a preset threshold and the door opening state is a dangerous door opening state, the corresponding door opening strategy is determined to be to control the device door to lock, and / or to prompt the user to wear protective gear.

[0019] If the internal temperature is higher than a preset threshold and the door is in the closed state, the corresponding door opening strategy is determined to keep the device door closed.

[0020] In one possible implementation, determining the user's pose information based on the image information includes:

[0021] Identify the hand region containing the user's hand from the image information;

[0022] Extract a screenshot of the area containing the hand region from the image information;

[0023] The screenshot of the area is identified, and if the screenshot of the area contains protective gear, it is determined that the user is wearing protective gear; if the screenshot of the area does not contain protective gear, it is determined that the user is not wearing protective gear.

[0024] In one possible implementation, determining the user's pose information based on the image information includes:

[0025] Identify human joint points from the image information;

[0026] Extract the joint feature information between each of the human body joints;

[0027] The joint point feature information is compared with preset feature information, wherein the preset feature information is the feature information between the joint points corresponding to when the user opens the door;

[0028] If the key feature information matches the preset feature information, it is determined that the user has performed a door opening action;

[0029] If the key feature information does not match the preset feature information, it is determined that the user has not performed a door opening action.

[0030] In one possible implementation, obtaining the user's image information includes:

[0031] Point cloud data of the user is acquired by a position sensor installed on the device, and image data of the user is acquired by a camera installed on the device;

[0032] For each pixel in the image data, determine the distance information corresponding to the pixel from the point cloud data;

[0033] The image data and the distance information of all pixels are synthesized to obtain the corresponding three-dimensional image data, and the three-dimensional image data is determined as the image information.

[0034] In one possible implementation, after controlling the device to perform the corresponding door opening action according to the door opening strategy, the method further includes:

[0035] During the process of the device performing the corresponding door opening action, the actual door opening action of the user is monitored;

[0036] Obtain the real-time temperature, real-time attitude information, and real-time location information of the device corresponding to the actual door opening action;

[0037] The door opening strategy is adjusted based on the device's real-time temperature, real-time attitude information, and real-time location information.

[0038] Secondly, this application provides a cooking equipment door opening control device, comprising:

[0039] The acquisition module is used to acquire the internal temperature of the device, as well as the user's image and location information;

[0040] The first determining module is used to determine the posture information corresponding to the user based on the image information, wherein the posture information is used to characterize whether the user has an opening action and whether the user is wearing protective gear;

[0041] The second determining module is used to determine the corresponding door opening state based on the posture information and the position information;

[0042] The third determining module is used to determine the corresponding door opening strategy based on the internal temperature and the door opening status;

[0043] The control module is used to control the device to perform corresponding door opening actions according to the door opening strategy.

[0044] In one possible implementation, the second determining module is specifically used for:

[0045] Determine whether the user is in the door-opening area based on the location information;

[0046] If the user is within the door opening area, the user is performing a door opening action, and the user is wearing protective gear, then the door opening state corresponding to the user is determined to be a safe door opening state.

[0047] If the user is in the door opening area, the user is opening the door, and the user is not wearing protective gear, the door opening state corresponding to the user is determined to be a dangerous door opening state.

[0048] If the user is outside the door opening area, or if the user does not perform any door opening action, the door opening state corresponding to the user is determined to be the closed door state.

[0049] In one possible implementation, the third determining module is specifically used for:

[0050] If the internal temperature is higher than a preset threshold and the door opening state is a safe opening state, the corresponding door opening strategy is determined to control the device to open the device door at a preset angle, which is less than the angle of fully opening the device door, and if the user continues to approach the device and the internal temperature is not higher than the preset threshold, the device is controlled to fully open the device door.

[0051] If the internal temperature is higher than a preset threshold and the door opening state is a dangerous door opening state, the corresponding door opening strategy is determined to be to control the device door to lock, and / or to prompt the user to wear protective gear.

[0052] If the internal temperature is higher than a preset threshold and the door is in the closed state, the corresponding door opening strategy is determined to keep the device door closed.

[0053] In one possible implementation, the first determining module is specifically used for:

[0054] Identify the hand region containing the user's hand from the image information;

[0055] Extract a screenshot of the area containing the hand region from the image information;

[0056] The screenshot of the area is identified, and if the screenshot of the area contains protective gear, it is determined that the user is wearing protective gear; if the screenshot of the area does not contain protective gear, it is determined that the user is not wearing protective gear.

[0057] In one possible implementation, the first determining module is further configured to:

[0058] Identify human joint points from the image information;

[0059] Extract the joint feature information between each of the human body joints;

[0060] The joint point feature information is compared with preset feature information, wherein the preset feature information is the feature information between the joint points corresponding to when the user opens the door;

[0061] If the key feature information matches the preset feature information, it is determined that the user has performed a door opening action;

[0062] If the key feature information does not match the preset feature information, it is determined that the user has not performed a door opening action.

[0063] In one possible implementation, the acquisition module is specifically used for:

[0064] Point cloud data of the user is acquired by a position sensor installed on the device, and image data of the user is acquired by a camera installed on the device;

[0065] For each pixel in the image data, determine the distance information corresponding to the pixel from the point cloud data;

[0066] The image data and the distance information of all pixels are synthesized to obtain the corresponding three-dimensional image data, and the three-dimensional image data is determined as the image information.

[0067] In one possible implementation, the device further includes an adjustment module for:

[0068] During the process of the device performing the corresponding door opening action, the actual door opening action of the user is monitored;

[0069] Obtain the real-time temperature, real-time attitude information, and real-time location information of the device corresponding to the actual door opening action;

[0070] The door opening strategy is adjusted based on the device's real-time temperature, real-time attitude information, and real-time location information.

[0071] Thirdly, this application provides a cooking device, including a processor and a memory, wherein the processor is configured to execute a device door opening control program stored in the memory to implement the device door opening control method described in any one of the first aspects.

[0072] Fourthly, this application provides a storage medium storing one or more programs that can be executed by one or more processors to implement the device door opening control method described in any one aspect.

[0073] Compared with the prior art, the technical solution provided in this application has the following advantages: The method provided in this application, when the device has finished cooking, firstly acquires the internal temperature of the device, and then acquires the user's image and location information. Next, it determines the user's posture information based on the image information, wherein the posture information indicates whether the user is performing an opening action and whether the user is wearing protective gear. Based on the posture and location information, it determines the corresponding opening state. Then, based on the internal temperature and the opening state, it determines the corresponding opening strategy. Finally, it controls the device to perform the corresponding opening action based on the opening strategy. Through this solution, intelligent control of the device door can be achieved based on the user's position, posture, and the device's internal temperature, thereby preventing users from being scalded by steam when opening the door and improving user safety. Attached Figure Description

[0074] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0075] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0076] One or more embodiments are illustrated by way of example with reference numerals in the accompanying drawings. These illustrations do not constitute a limitation on the embodiments. Elements with the same reference numerals in the drawings are denoted as similar elements. Unless otherwise stated, the figures in the drawings are not to be limited by scale.

[0077] Figure 1 A flowchart illustrating an embodiment of a cooking equipment door opening control method provided in this application;

[0078] Figure 2 A flowchart illustrating an embodiment of determining user pose information based on image information provided in this application;

[0079] Figure 3 A flowchart illustrating another embodiment of determining user pose information based on image information provided in this application;

[0080] Figure 4 A flowchart illustrating an embodiment of another cooking device door opening control method provided in this application;

[0081] Figure 5 A block diagram illustrating an embodiment of a cooking equipment door opening control device provided in this application;

[0082] Figure 6 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0083] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0084] The following disclosure provides numerous different embodiments or examples for implementing various structures of this application. To simplify the disclosure, specific examples of components and arrangements are described below. These are merely examples and are not intended to limit the scope of this application. Furthermore, reference numerals and / or letters may be repeated in different examples. Such repetition is for simplification and clarity and does not in itself indicate a relationship between the various embodiments and / or arrangements discussed.

[0085] To address the technical problem that in existing microwave ovens, ovens, and other appliances, users typically need to manually open the door to remove food after cooking, which poses safety hazards such as burns and hot steam splattering during manual food removal due to the high residual temperature inside these appliances, this application provides a method for controlling the opening of cooking appliances. This method enables intelligent control of the appliance door based on the user's position, posture, and the internal temperature of the appliance, thereby preventing users from being burned by steam when opening the door and improving user safety.

[0086] Figure 1This is a flowchart illustrating an embodiment of a cooking appliance door opening control method provided in this application. In one embodiment, the method is applied to an appliance, such as an oven or microwave oven.

[0087] like Figure 1 As shown, the method includes the following steps:

[0088] Step 101: Obtain the internal temperature of the device, and obtain the user's image information and location information.

[0089] The aforementioned equipment is used to characterize devices that heat food at high temperatures, such as ovens, microwave ovens, and steam ovens.

[0090] Internal temperature refers to the temperature inside the equipment, which can be detected by a temperature sensor installed inside the equipment.

[0091] Image information refers to 3D image data collected by the user;

[0092] In one embodiment, obtaining a user's image information may include the following steps:

[0093] The system collects point cloud data of the user through a position sensor installed on the device, and image data of the user through a camera installed on the device; for each pixel in the image data, it determines the distance information corresponding to the pixel from the point cloud data; it synthesizes the image data and the distance information of all pixels to obtain the corresponding three-dimensional image data, and determines the three-dimensional image data as the image information.

[0094] In this solution, the user's real-time location data and image data can be collected through the position sensors and cameras installed on the device, and the location data and image data can be combined into a 3D image for subsequent analysis of the user's posture, thereby improving the accuracy of the subsequent analysis.

[0095] Location information refers to the user's distance and direction relative to the device. In applications, this information can be collected by location sensors (such as infrared, millimeter-wave radar, etc.) installed on the device.

[0096] In applications, the door of a cooking device is usually locked during the cooking process. Therefore, in one embodiment, step 101 can be executed after the device has finished cooking, thereby reducing unnecessary calculations and saving computing resources.

[0097] Step 102: Determine the user's posture information based on the image information, wherein the posture information is used to characterize whether the user is performing a door-opening action and whether the user is wearing protective gear.

[0098] The action of opening a door is used to represent the action of intending to open the door of a device.

[0099] In this embodiment of the application, the user's current posture information can be determined by recognizing and analyzing the image information, that is, whether the user is opening the door and whether the user is wearing protective gear.

[0100] The specific method for determining the user's posture information based on the image information will be explained in detail in the following embodiments, and will not be elaborated here.

[0101] Step 103: Determine the corresponding door opening state based on the posture information and the position information.

[0102] The above-mentioned door opening states include safe door opening state, dangerous door opening state, and no door opening state.

[0103] In this embodiment of the application, step 103 may specifically include the following steps:

[0104] Step A1: Determine whether the user is in the door opening area based on the location information;

[0105] Step A2: When the user is in the door opening area, the user is opening the door, and the user is wearing protective gear, determine the door opening state corresponding to the user as a safe door opening state.

[0106] Step A3: When the user is in the door opening area, the user is opening the door, and the user is not wearing protective gear, the door opening state corresponding to the user is determined to be a dangerous door opening state.

[0107] Step A4: If the user is outside the door opening area, or if the user does not perform a door opening action, determine that the user's corresponding door opening state is a closed door state.

[0108] The aforementioned door opening area refers to a region near the equipment door where the door may open if the user is within this area. This area can be defined based on the user's historical door opening data or can be manually set by the user.

[0109] The above method can determine whether a user is currently opening the door and whether it is safe to do so based on the user's location and posture.

[0110] Step 104: Determine the corresponding door opening strategy based on the internal temperature and the door opening status.

[0111] Step 105: Control the device to perform the corresponding door opening action according to the door opening strategy.

[0112] For ease of understanding, steps 104 and 105 will be explained uniformly below:

[0113] In this embodiment of the application, step 104 may specifically include the following steps:

[0114] Step B1: When the internal temperature is higher than a preset threshold and the door opening state is a safe door opening state, determine the corresponding door opening strategy as controlling the device to open the device door at a preset angle, the preset angle being less than the angle of fully opening the device door, and controlling the device to fully open the device door when the user continues to approach the device and the internal temperature is not higher than the preset threshold.

[0115] Step B2: When the internal temperature is higher than a preset threshold and the door opening state is a dangerous door opening state, determine the corresponding door opening strategy as controlling the device door to lock and / or prompting the user to wear protective gear.

[0116] Step B3: When the internal temperature is higher than a preset threshold and the door is in the closed state, determine the corresponding door opening strategy as keeping the equipment door closed.

[0117] The preset threshold is used to determine whether the internal temperature of the device is likely to burn the user. That is, when the internal temperature is higher than the preset threshold, it means that the temperature exceeds the safe range and will burn the user; otherwise, the temperature is within the safe range and will not burn the user.

[0118] In this scheme, when the internal temperature exceeds a preset threshold, if a user is detected approaching the equipment, preparing to open the door, and wearing protective gear (i.e., safe opening state), it means the user is preparing to open the door. At this time, the control device will open the equipment door slightly, and after the user gets closer to the equipment (meaning the user is sure to open the door) and the internal temperature drops below the preset threshold, the oven door will be fully opened. If the internal temperature exceeds the preset threshold, if a user is detected making an opening gesture but not wearing protective gear (i.e., dangerous opening state), it means the user is likely to be burned if they open the door. At this time, the control device will lock the door and prompt the user to wear protective gear. When the user is not nearby or the user is not making an opening gesture, it means the user does not currently intend to open the door, and the equipment door will remain closed.

[0119] In practical applications, the parameters in the above door opening strategy can be customized and adjusted by the user according to the actual usage situation. For example, when the device door is opened at a preset angle, whether the door gap opens in a fixed direction or avoids the user, the distance to fully open the device door, whether the door opening gesture judgment is enabled, and the lowest temperature of the oven when the protective detection function is enabled.

[0120] After determining the door opening strategy using the above method, the device is controlled to perform the corresponding door opening action according to this strategy. In this way, the device can be controlled to perform the appropriate door opening action based on the internal temperature of the equipment and the user's desired door opening status, ensuring that the door is opened according to the user's needs and that the user is safe during the opening process.

[0121] The technical solution provided in this application, after the device has finished cooking, firstly acquires the internal temperature of the device, and then acquires the user's image and location information. Next, based on the image information, it determines the user's corresponding posture information, wherein the posture information indicates whether the user has attempted to open the door and whether the user is wearing protective gear. Based on the posture and location information, it determines the corresponding door-opening state. Then, based on the internal temperature and the door-opening state, it determines a corresponding door-opening strategy. Finally, it controls the device to perform the corresponding door-opening action according to the door-opening strategy. This solution enables intelligent control of the device door based on the user's position, posture, and the device's internal temperature, thereby preventing users from being scalded by steam when opening the door and improving user safety.

[0122] Figure 2 This is a flowchart illustrating an embodiment of determining the user's posture information based on the image information provided in this application. Figure 2 The process shown is in Figure 1 Based on the illustrated process, the following steps are included:

[0123] Step 201: Identify the hand region containing the user's hand from the image information;

[0124] Step 202: Extract a screenshot of the area containing the hand region from the image information;

[0125] Step 203: Identify the area screenshot, and if the area screenshot contains protective gear, determine that the user is wearing protective gear; if the area screenshot does not contain protective gear, determine that the user is not wearing protective gear.

[0126] For ease of understanding, steps 201-203 will be explained uniformly below:

[0127] In this embodiment of the application, the user's hand area can be identified from the image information by an image target detection algorithm. Then, the user can be identified from the screenshot containing the hand area by the image target detection algorithm to determine whether the user is wearing protective gear and the location of the protective gear. If the protective gear is identified and the location is correct, it is determined that the user is wearing protective gear; otherwise, it is determined that the user is not wearing protective gear.

[0128] pass Figure 2The process shown can identify and analyze images of the hand area to determine whether the user is wearing protective gear. Compared to directly identifying the entire image, this avoids interference from other areas and improves recognition accuracy.

[0129] Figure 3 A flowchart illustrating another embodiment of determining the user's posture information based on the image information provided in this application. Figure 3 The process shown is in Figure 1 Based on the illustrated process, the following steps are included:

[0130] Step 301: Identify human joint points from the image information;

[0131] Step 302: Extract the joint feature information between each of the human body joints;

[0132] Step 303: Compare the joint point feature information with preset feature information, wherein the preset feature information is the feature information between the joint points corresponding to when the user opens the door;

[0133] Step 304: If the key feature information matches the preset feature information, determine that the user has performed a door opening action;

[0134] Step 305: If the joint feature information does not match the preset feature information, determine that the user has not performed a door opening action.

[0135] For ease of understanding, steps 301-305 will be explained uniformly below:

[0136] In this embodiment, firstly, a convolutional neural network is used to identify and locate the joints of the human body, processing the acquired image data into joint information. This joint information can represent the skeletal structure, body parts, and joint angles of the human body. After identifying the joints, the distances, angles, velocities, and accelerations between these joints are extracted as joint feature information. This joint feature information can reflect the human body's motion state and posture changes. Finally, by comparing the joint feature information with preset feature information between the joints corresponding to when the user opens the door, it is determined whether the user is preparing to open the door, i.e., whether there is a door-opening action.

[0137] Figure 3 The process shown can intelligently analyze whether a user is attempting to open a door by identifying the features of human joints from image information.

[0138] Figure 4 A flowchart illustrating an embodiment of another cooking device door opening control method provided in this application. Figure 4 As shown, it includes the following steps:

[0139] Step 401: During the process of the device performing the corresponding door opening action, monitor the user's actual door opening action;

[0140] Step 402: Obtain the real-time temperature, real-time posture information, and real-time position information of the device corresponding to the actual door opening action;

[0141] Step 403: Adjust the door opening strategy based on the real-time temperature of the device, the real-time attitude information, and the real-time location information.

[0142] For ease of understanding, steps 401-403 will be explained uniformly below:

[0143] The actual door opening action refers to the action of the user manually opening the device door.

[0144] The real-time temperature of the equipment refers to the temperature inside the equipment when the user actually opens the equipment door manually.

[0145] Real-time posture information refers to the user's posture information when the user actually opens the device door manually, such as the posture of opening the door and the status of wearing protective gear.

[0146] Real-time location information refers to the user's location information when the user actually opens the device door manually, including the user's distance and direction relative to the device.

[0147] In this embodiment of the application, if the user's manual door opening action is detected during the device's execution of the corresponding door opening action, the device's real-time temperature, real-time posture information, and real-time location information are obtained at this time. The parameters in the current door opening strategy are optimized based on the device's real-time temperature, real-time posture information, and real-time location information, such as changes in door opening posture, setting of door opening area, and setting of internal temperature.

[0148] Figure 4 The process shown can optimize the door opening strategy based on information from when the user manually opens the door, making the strategy more in line with user habits.

[0149] Figure 5 This is a block diagram illustrating an embodiment of a cooking equipment door opening control device provided in this application. Figure 5 As shown, the device includes:

[0150] The acquisition module 51 is used to acquire the internal temperature of the device, as well as the user's image information and location information;

[0151] The first determining module 52 is used to determine the posture information corresponding to the user based on the image information, wherein the posture information is used to characterize whether the user has an opening action and whether the user is wearing protective gear.

[0152] The second determining module 53 is used to determine the corresponding door opening state based on the posture information and the position information;

[0153] The third determining module 54 is used to determine the corresponding door opening strategy based on the internal temperature and the door opening state;

[0154] The control module 55 is used to control the device to perform corresponding door opening actions according to the door opening strategy.

[0155] In one possible implementation, the second determining module is specifically used for:

[0156] Determine whether the user is in the door-opening area based on the location information;

[0157] If the user is within the door opening area, the user is performing a door opening action, and the user is wearing protective gear, then the door opening state corresponding to the user is determined to be a safe door opening state.

[0158] If the user is in the door opening area, the user is opening the door, and the user is not wearing protective gear, the door opening state corresponding to the user is determined to be a dangerous door opening state.

[0159] If the user is outside the door opening area, or if the user does not perform any door opening action, the door opening state corresponding to the user is determined to be the closed door state.

[0160] In one possible implementation, the third determining module is specifically used for:

[0161] If the internal temperature is higher than a preset threshold and the door opening state is a safe opening state, the corresponding door opening strategy is determined to control the device to open the device door at a preset angle, which is less than the angle of fully opening the device door, and if the user continues to approach the device and the internal temperature is not higher than the preset threshold, the device is controlled to fully open the device door.

[0162] If the internal temperature is higher than a preset threshold and the door opening state is a dangerous door opening state, the corresponding door opening strategy is determined to be to control the device door to lock, and / or to prompt the user to wear protective gear.

[0163] If the internal temperature is higher than a preset threshold and the door is in the closed state, the corresponding door opening strategy is determined to keep the device door closed.

[0164] In one possible implementation, the first determining module is specifically used for:

[0165] Identify the hand region containing the user's hand from the image information;

[0166] Extract a screenshot of the area containing the hand region from the image information;

[0167] The screenshot of the area is identified, and if the screenshot of the area contains protective gear, it is determined that the user is wearing protective gear; if the screenshot of the area does not contain protective gear, it is determined that the user is not wearing protective gear.

[0168] In one possible implementation, the first determining module is further configured to:

[0169] Identify human joint points from the image information;

[0170] Extract the joint feature information between each of the human body joints;

[0171] The joint point feature information is compared with preset feature information, wherein the preset feature information is the feature information between the joint points corresponding to when the user opens the door;

[0172] If the key feature information matches the preset feature information, it is determined that the user has performed a door opening action;

[0173] If the key feature information does not match the preset feature information, it is determined that the user has not performed a door opening action.

[0174] In one possible implementation, the acquisition module is specifically used for:

[0175] Point cloud data of the user is acquired by a position sensor installed on the device, and image data of the user is acquired by a camera installed on the device;

[0176] For each pixel in the image data, determine the distance information corresponding to the pixel from the point cloud data;

[0177] The image data and the distance information of all pixels are synthesized to obtain the corresponding three-dimensional image data, and the three-dimensional image data is determined as the image information.

[0178] In one possible implementation, the device further includes an adjustment module for:

[0179] During the process of the device performing the corresponding door opening action, the actual door opening action of the user is monitored;

[0180] Obtain the real-time temperature, real-time attitude information, and real-time location information of the device corresponding to the actual door opening action;

[0181] The door opening strategy is adjusted based on the device's real-time temperature, real-time attitude information, and real-time location information.

[0182] like Figure 6 As shown in the figure, this application embodiment provides a cooking device, including a processor 111, a communication interface 112, a memory 113, and a communication bus 114, wherein the processor 111, the communication interface 112, and the memory 113 communicate with each other through the communication bus 114.

[0183] Memory 113 is used to store computer programs;

[0184] In one embodiment of this application, when the processor 111 executes the program stored in the memory 113, it implements the device door opening control method provided in any of the foregoing method embodiments, including:

[0185] It acquires the device's internal temperature, as well as the user's image and location information;

[0186] The user's posture information is determined based on the image information, wherein the posture information is used to characterize whether the user is performing a door-opening action and whether the user is wearing protective gear;

[0187] Based on the posture information and the position information, the corresponding door opening state is determined;

[0188] Based on the internal temperature and the door opening status, determine the corresponding door opening strategy;

[0189] The device is controlled to perform the corresponding door opening action according to the door opening strategy.

[0190] This application also provides a computer-readable storage medium storing a computer program thereon, which, when executed by a processor, implements the steps of the device door opening control method provided in any of the foregoing method embodiments.

[0191] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs.

[0192] Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented using software plus a general-purpose hardware platform, or of course, using hardware. Based on this understanding, the above technical solutions, in essence or the parts that contribute to the related technology, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in the various embodiments or some parts of the embodiments.

[0193] It should be understood that the terminology used herein is for the purpose of describing particular exemplary embodiments only and is not intended to be limiting. Unless the context clearly indicates otherwise, the singular forms “a,” “an,” and “described” as used herein may also include the plural forms. The terms “comprising,” “including,” “containing,” and “having” are inclusive and therefore indicate the presence of the stated features, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, steps, operations, elements, components, and / or combinations thereof. The method steps, processes, and operations described herein are not construed as requiring them to be performed in a particular order described or illustrated unless the order of performance is explicitly indicated. It should also be understood that additional or alternative steps may be used.

[0194] The above description is merely a specific embodiment of this application, enabling those skilled in the art to understand or implement this application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of this application. Therefore, this application is not to be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features claimed herein.

Claims

1. A method for controlling the opening of a cooking appliance door, characterized in that, The method includes: It acquires the device's internal temperature, as well as the user's image and location information; The user's posture information is determined based on the image information, wherein the posture information is used to characterize whether the user is performing a door-opening action and whether the user is wearing protective gear; Based on the posture information and the position information, the corresponding door opening state is determined; Based on the internal temperature and the door opening status, determine the corresponding door opening strategy; The device is controlled to perform the corresponding door opening action according to the door opening strategy.

2. The method according to claim 1, characterized in that, Determining the corresponding door opening state based on the posture information and the position information includes: Determine whether the user is in the door-opening area based on the location information; If the user is within the door opening area, the user is performing a door opening action, and the user is wearing protective gear, then the door opening state corresponding to the user is determined to be a safe door opening state. If the user is in the door opening area, the user is opening the door, and the user is not wearing protective gear, the door opening state corresponding to the user is determined to be a dangerous door opening state. If the user is outside the door opening area, or if the user does not perform any door opening action, the door opening state corresponding to the user is determined to be the closed door state.

3. The method according to claim 2, characterized in that, The step of determining the corresponding door opening strategy based on the internal temperature and the door opening status includes: If the internal temperature is higher than a preset threshold and the door opening state is a safe opening state, the corresponding door opening strategy is determined to control the device to open the device door at a preset angle, which is less than the angle of fully opening the device door, and if the user continues to approach the device and the internal temperature is not higher than the preset threshold, the device is controlled to fully open the device door. If the internal temperature is higher than a preset threshold and the door opening state is a dangerous door opening state, the corresponding door opening strategy is determined to be to control the device door to lock, and / or to prompt the user to wear protective gear. If the internal temperature is higher than a preset threshold and the door is in the closed state, the corresponding door opening strategy is determined to keep the device door closed.

4. The method according to claim 1, characterized in that, Determining the user's pose information based on the image information includes: Identify the hand region containing the user's hand from the image information; Extract a screenshot of the area containing the hand region from the image information; The screenshot of the area is identified, and if the screenshot of the area contains protective gear, it is determined that the user is wearing protective gear; if the screenshot of the area does not contain protective gear, it is determined that the user is not wearing protective gear.

5. The method according to claim 1, characterized in that, Determining the user's pose information based on the image information includes: Identify human joint points from the image information; Extract the joint feature information between each of the human body joints; The joint point feature information is compared with preset feature information, wherein the preset feature information is the feature information between the joint points corresponding to when the user opens the door; If the key feature information matches the preset feature information, it is determined that the user has performed a door opening action; If the key feature information does not match the preset feature information, it is determined that the user has not performed a door opening action.

6. The method according to claim 1, characterized in that, The acquisition of the user's image information includes: Point cloud data of the user is acquired by a position sensor installed on the device, and image data of the user is acquired by a camera installed on the device; For each pixel in the image data, determine the distance information corresponding to the pixel from the point cloud data; The image data and the distance information of all pixels are synthesized to obtain the corresponding three-dimensional image data, and the three-dimensional image data is determined as the image information.

7. The method according to claim 1, characterized in that, After controlling the device to perform the corresponding door opening action according to the door opening strategy, the method further includes: During the process of the device performing the corresponding door opening action, the actual door opening action of the user is monitored; Obtain the real-time temperature, real-time attitude information, and real-time location information of the device corresponding to the actual door opening action; The door opening strategy is adjusted based on the device's real-time temperature, real-time attitude information, and real-time location information.

8. A door opening control device for a cooking appliance, characterized in that, The device includes: The acquisition module is used to acquire the internal temperature of the device, as well as the user's image and location information; The first determining module is used to determine the posture information corresponding to the user based on the image information, wherein the posture information is used to characterize whether the user has an opening action and whether the user is wearing protective gear; The second determining module is used to determine the corresponding door opening state based on the posture information and the position information; The third determining module is used to determine the corresponding door opening strategy based on the internal temperature and the door opening status; The control module is used to control the device to perform corresponding door opening actions according to the door opening strategy.

9. A cooking device, characterized in that, include: A processor and a memory, the processor being configured to execute a device door opening control program stored in the memory to implement the device door opening control method according to any one of claims 1-7.

10. A storage medium, characterized in that, The storage medium stores one or more programs, which can be executed by one or more processors to implement the device door opening control method according to any one of claims 1-7.

Images