Cooking equipment door opening control method and device, cooking equipment and storage medium

Abstract

The invention provides a cooking equipment door opening control method and device, cooking equipment and a storage medium, and the method comprises the steps: obtaining the internal temperature of the equipment, and obtaining the image information and position information of a user; according to the image information, posture information corresponding to the user is determined, and the posture information is used for representing whether the user has a door opening action or not and whether the user wears protection or not; according to the posture information and the position information, a corresponding door opening state is determined; determining a corresponding door opening strategy according to the internal temperature and the door opening state; and controlling the equipment to execute a corresponding door opening action according to the door opening strategy. Through the scheme, intelligent control of the equipment door can be realized according to the position and posture of the user and the internal temperature of the equipment, so that the user can be prevented from being scalded by steam when opening the door, and the use safety is improved.

Description

Technical Field

[0001] The present application relates to the field of smart home technology, and in particular to a cooking device door opening control method, device, cooking device and storage medium. Background Art

[0002] With the improvement of people's living standards and the rapid development of smart home technology, the number of various electrical appliances in the kitchen has gradually increased. Among them, the intelligence level of equipment such as microwave ovens and ovens that cook food at high temperatures is also constantly improving. After cooking, traditional microwave ovens, ovens and other equipment usually require users to manually open the door to take out the food. Since the residual temperature inside these devices is high after cooking, there are safety hazards such as scalding and hot steam blowing in the face when manually taking out food.

[0003] Therefore, there is an urgent need for a technical solution that can realize intelligent door opening for such devices. Summary of the invention

[0004] The present application provides a cooking device door opening control method, device, cooking device and storage medium to solve the problem in the prior art that after cooking, microwave ovens, ovens and other devices usually require users to manually open the door to take out food. Since the residual temperature inside such devices after cooking is high, there are safety hazards such as scalding and hot steam blowing in the face during manual food removal.

[0005] In a first aspect, the present application provides a cooking device door opening control method, comprising:

[0006] Obtaining the internal temperature of the device, and obtaining the image information and location information of the user;

[0007] Determining the posture information corresponding to the user according to the image information, wherein the posture information is used to indicate whether the user has a door opening action and whether the user is wearing protective clothing;

[0008] Determining a corresponding door opening state according to the posture information and the position information;

[0009] Determining a corresponding door opening strategy according to the internal temperature and the door opening state;

[0010] The device is controlled to perform corresponding door opening actions according to the door opening strategy.

[0011] In a possible implementation, determining the corresponding door opening state according to the posture information and the position information includes:

[0012] Determining whether the user is in a door opening area according to the location information;

[0013] When the user is in the door opening area, the user performs a door opening action, and the user wears protective clothing, determining that the door opening state corresponding to the user is a safe door opening state;

[0014] When the user is in the door opening area, the user has a door opening action, and the user is not wearing protective clothing, determining that the door opening state corresponding to the user is a dangerous door opening state;

[0015] When the user is outside the door opening area, or the user does not take any door opening action, it is determined that the door opening state corresponding to the user is a non-door opening state.

[0016] In a possible implementation manner, determining a corresponding door opening strategy according to the internal temperature and the door opening state includes:

[0017] When the internal temperature is higher than a preset threshold and the door opening state is a safe door opening state, determining a corresponding door opening strategy to control the device to open the device door at a preset angle, the preset angle being smaller than an angle for fully opening the device door, and when the user continues to approach the device and the internal temperature is not higher than the preset threshold, controlling the device to fully open the device door;

[0018] When the internal temperature is higher than a preset threshold and the door opening state is a dangerous door opening state, determining the corresponding door opening strategy to control the device door to be locked and / or to prompt the user to wear protective gear;

[0019] When the internal temperature is higher than a preset threshold and the door opening state is not to open the door, the corresponding door opening strategy is determined to keep the device door closed.

[0020] In a possible implementation, determining the posture information corresponding to the user according to the image information includes:

[0021] identifying a hand region including a user's hand from the image information;

[0022] Capturing a screenshot of a region including the hand region from the image information;

[0023] The area screenshot is identified, and when it is identified that the area screenshot contains protective gear, it is determined that the user is wearing protection; when it is not identified that the area screenshot contains protective gear, it is determined that the user is not wearing protection.

[0024] In a possible implementation, determining the posture information corresponding to the user according to the image information includes:

[0025] Identifying human body joints from the image information;

[0026] Extracting joint feature information between each of the human body joints;

[0027] Compare the joint point feature information with preset feature information, wherein the preset feature information is feature information between the joint points corresponding to when the user opens the door;

[0028] When the joint feature information matches the preset feature information, determining that the user has a door opening action;

[0029] When the joint point feature information does not match the preset feature information, it is determined that the user does not have a door opening action.

[0030] In a possible implementation, the acquiring the user's image information includes:

[0031] Collecting point cloud data of the user through a position sensor installed on the device, and collecting image data of the user through a camera installed on the device;

[0032] For each pixel in the image data, determining distance information corresponding to the pixel from the point cloud data;

[0033] The image data and distance information of all pixels are synthesized to obtain corresponding three-dimensional image data, and the three-dimensional image data is determined as the image information.

[0034] In a possible implementation manner, after controlling the device to perform a corresponding door opening action according to the door opening strategy, the method further includes:

[0035] During the process of the device performing the corresponding door opening action, monitoring the actual door opening action of the user;

[0036] Obtaining the real-time temperature, real-time posture information and real-time location information of the device corresponding to the actual door opening action;

[0037] The door opening strategy is adjusted according to the real-time temperature of the device, the real-time posture information and the real-time location information.

[0038] In a second aspect, the present application provides a cooking device door opening control device, comprising:

[0039] An acquisition module, used to acquire the internal temperature of the device, and to acquire the image information and location information of the user;

[0040] A first determination module is used to determine the posture information corresponding to the user according to the image information, wherein the posture information is used to indicate whether the user has a door opening action and whether the user is wearing protective clothing;

[0041] A second determination module, used to determine a corresponding door opening state according to the posture information and the position information;

[0042] A third determination module, configured to determine a corresponding door opening strategy according to the internal temperature and the door opening state;

[0043] A control module is used to control the device to perform a corresponding door opening action according to the door opening strategy.

[0044] In a possible implementation manner, the second determining module is specifically configured to:

[0045] Determining whether the user is in a door opening area according to the location information;

[0046] When the user is in the door opening area, the user performs a door opening action, and the user wears protective clothing, determining that the door opening state corresponding to the user is a safe door opening state;

[0047] When the user is in the door opening area, the user has a door opening action, and the user is not wearing protective clothing, determining that the door opening state corresponding to the user is a dangerous door opening state;

[0048] When the user is outside the door opening area, or the user does not take any door opening action, it is determined that the door opening state corresponding to the user is a non-door opening state.

[0049] In a possible implementation manner, the third determining module is specifically configured to:

[0050] When the internal temperature is higher than a preset threshold and the door opening state is a safe door opening state, determining a corresponding door opening strategy to control the device to open the device door at a preset angle, the preset angle being smaller than an angle for fully opening the device door, and when the user continues to approach the device and the internal temperature is not higher than the preset threshold, controlling the device to fully open the device door;

[0051] When the internal temperature is higher than a preset threshold and the door opening state is a dangerous door opening state, determining the corresponding door opening strategy to control the device door to be locked and / or to prompt the user to wear protective gear;

[0052] When the internal temperature is higher than a preset threshold and the door opening state is not to open the door, the corresponding door opening strategy is determined to keep the device door closed.

[0053] In a possible implementation manner, the first determining module is specifically configured to:

[0054] identifying a hand region including a user's hand from the image information;

[0055] Capturing a screenshot of a region including the hand region from the image information;

[0056] The area screenshot is identified, and when it is identified that the area screenshot contains protective gear, it is determined that the user is wearing protection; when it is not identified that the area screenshot contains protective gear, it is determined that the user is not wearing protection.

[0057] In a possible implementation manner, the first determining module is further configured to:

[0058] Identifying human body joints from the image information;

[0059] Extracting joint feature information between each of the human body joints;

[0060] Compare the joint point feature information with preset feature information, wherein the preset feature information is feature information between the joint points corresponding to when the user opens the door;

[0061] When the joint feature information matches the preset feature information, determining that the user has a door opening action;

[0062] When the joint point feature information does not match the preset feature information, it is determined that the user does not have a door opening action.

[0063] In a possible implementation, the acquisition module is specifically configured to:

[0064] Collecting point cloud data of the user through a position sensor installed on the device, and collecting image data of the user through a camera installed on the device;

[0065] For each pixel in the image data, determining distance information corresponding to the pixel from the point cloud data;

[0066] The image data and distance information of all pixels are synthesized to obtain corresponding three-dimensional image data, and the three-dimensional image data is determined as the image information.

[0067] In a possible implementation, the device further includes an adjustment module, configured to:

[0068] During the process of the device performing the corresponding door opening action, monitoring the actual door opening action of the user;

[0069] Obtaining the real-time temperature, real-time posture information and real-time location information of the device corresponding to the actual door opening action;

[0070] The door opening strategy is adjusted according to the real-time temperature of the device, the real-time posture information and the real-time location information.

[0071] In a third aspect, the present application provides a cooking device, comprising: a processor and a memory, wherein the processor is used to execute a device door opening control program stored in the memory to implement the device door opening control method described in any one of the first aspects.

[0072] In a fourth aspect, the present application provides a storage medium storing one or more programs, and the one or more programs can be executed by one or more processors to implement the device door opening control method described in any one of the first aspects.

[0073] The above technical solution provided by the embodiment of the present application has the following advantages over the prior art: the method provided by the embodiment of the present application, when the device completes cooking, first obtains the internal temperature of the device, and obtains the image information and position information of the user, and then determines the posture information corresponding to the user based on the image information, wherein the posture information is used to characterize whether the user has a door opening action, and whether the user wears protection, and determines the corresponding door opening state based on the posture information and the position information, and then determines the corresponding door opening strategy based on the internal temperature and the door opening state, and finally controls the device to perform the corresponding door opening action based on the door opening strategy. Through this solution, intelligent control of the device door can be achieved based on the user's position, posture and internal temperature of the device, thereby preventing the user from being scalded by steam due to opening the door and improving the safety of use. BRIEF DESCRIPTION OF THE DRAWINGS

[0074] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0075] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0076] One or more embodiments are exemplarily described by pictures in the corresponding drawings, and these exemplified descriptions do not constitute limitations on the embodiments. Elements with the same reference numerals in the drawings represent similar elements, and unless otherwise stated, the figures in the drawings do not constitute proportional limitations.

[0077] Figure 1 A flow chart of an embodiment of a cooking device door opening control method provided in an embodiment of the present application;

[0078] Figure 2 A flowchart of an embodiment of determining posture information corresponding to a user according to image information provided in an embodiment of the present application;

[0079] Figure 3 A flowchart of another embodiment of determining the posture information corresponding to the user according to the image information provided in the embodiment of the present application;

[0080] Figure 4 A flowchart of another cooking device door opening control method provided in an embodiment of the present application;

[0081] Figure 5 A block diagram of an embodiment of a cooking device door opening control device provided in an embodiment of the present application;

[0082] Figure 6 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0083] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

[0084] The disclosure below provides many different embodiments or examples to implement the different structures of the present application. In order to simplify the disclosure of the present application, the parts and settings of specific examples are described below. Of course, they are only examples, and the purpose is not to limit the present application. In addition, the present application can repeat reference numbers and / or letters in different examples. This repetition is for the purpose of simplification and clarity, and does not itself indicate the relationship between the various embodiments and / or settings discussed.

[0085] In order to solve the technical problem that in the prior art, after cooking, microwave ovens, ovens and other devices usually require users to manually open the door to take out food. Since the residual temperature inside such devices is high after cooking, there are safety hazards such as scalding and hot steam blowing in the face during manual food removal. The present application provides a cooking device door opening control method, which can realize intelligent control of the device door according to the user's position, posture and internal temperature of the device, thereby preventing users from being scalded by steam when opening the door and improving safety of use.

[0086] Figure 1The present invention provides a flow chart of an embodiment of a cooking device door opening control method. In one embodiment, the method is applied to a device such as an oven, a microwave oven, etc.

[0087] like Figure 1 As shown, the method comprises the following steps:

[0088] Step 101: Acquire the internal temperature of the device, and acquire the image information and location information of the user.

[0089] The above equipment is used to characterize equipment that heats food at high temperatures, such as ovens, microwave ovens, and steam-bake machines.

[0090] Internal temperature refers to the temperature inside the device, which can be detected by a temperature sensor installed inside the device.

[0091] Image information refers to 3D image data collected from the user;

[0092] In one embodiment, obtaining the user's image information may include the following steps:

[0093] The user's point cloud data is collected by a position sensor installed on the device, and the user's image data is collected by a camera installed on the device; for each pixel in the image data, the distance information corresponding to the pixel is determined from the point cloud data; the image data and the distance information of all pixels are synthesized to obtain corresponding three-dimensional image data, and the three-dimensional image data is determined as the image information.

[0094] In this solution, the user's real-time location data and image data can be collected through the location sensors and cameras installed on the device, and the location data and image data can be combined into a 3D image for subsequent analysis of the user's posture, thereby improving the accuracy of subsequent analysis.

[0095] Location information refers to the distance and direction of the user relative to the device. In applications, it can be collected through location sensors (such as infrared, millimeter-wave radar, etc.) installed on the device.

[0096] In the application, when the cooking device is in the cooking process, the device door is generally locked. Therefore, in one embodiment, step 101 can be executed when the device has completed cooking, thereby reducing unnecessary calculations and saving computing resources.

[0097] Step 102: Determine the posture information corresponding to the user based on the image information, wherein the posture information is used to indicate whether the user has a door opening action and whether the user is wearing protective clothing.

[0098] Door opening action, used to represent the action of intending to open the device door.

[0099] In the embodiment of the present application, the user's current posture information, that is, whether the user has opened the door and whether the user is wearing protective clothing, can be determined by identifying and analyzing the image information.

[0100] As for how to determine the posture information corresponding to the user according to the image information, it will be described in detail through the embodiments below and will not be described in detail here.

[0101] Step 103: Determine a corresponding door opening state according to the posture information and the position information.

[0102] The above-mentioned door opening status includes a safe door opening status, a dangerous door opening status and a non-door opening status.

[0103] In the embodiment of the present application, step 103 may specifically include the following steps:

[0104] Step A1: determining whether the user is in a door opening area according to the location information;

[0105] Step A2: when the user is in the door opening area, the user has a door opening action, and the user is wearing protective clothing, determining that the door opening state corresponding to the user is a safe door opening state;

[0106] Step A3: when the user is in the door opening area, the user has a door opening action, and the user is not wearing protective clothing, determining that the door opening state corresponding to the user is a dangerous door opening state;

[0107] Step A4: when the user is outside the door opening area, or the user does not take any door opening action, determine that the door opening state corresponding to the user is a non-door opening state.

[0108] The door opening area is an area near the device door. When the user is within the area, there is a possibility of door opening. The area can be defined based on the user's historical door opening data or can be set manually by the user.

[0109] Through the above solution, it can be determined whether the user is currently opening the door and whether it is safe to open the door based on the user's position and user posture.

[0110] Step 104: Determine a corresponding door opening strategy according to the internal temperature and the door opening state.

[0111] Step 105: Control the device to perform a corresponding door opening action according to the door opening strategy.

[0112] For ease of understanding, step 104 and step 105 are described uniformly below:

[0113] In the embodiment of the present application, step 104 may specifically include the following steps:

[0114] Step B1, when the internal temperature is higher than a preset threshold and the door opening state is a safe door opening state, determining a corresponding door opening strategy to control the device to open the device door at a preset angle, the preset angle being smaller than an angle for fully opening the device door, and when the user continues to approach the device and the internal temperature is not higher than the preset threshold, controlling the device to fully open the device door;

[0115] Step B2: when the internal temperature is higher than a preset threshold and the door opening state is a dangerous door opening state, determining a corresponding door opening strategy to control the device door to be locked and / or to prompt the user to wear protective gear;

[0116] Step B3: when the internal temperature is higher than a preset threshold and the door opening state is not to open the door, determine the corresponding door opening strategy to keep the device door closed.

[0117] The preset threshold is used to determine whether the internal temperature of the device is likely to scald the user. That is, when the internal temperature is higher than the preset threshold, it means that the temperature exceeds the safe range and will scald the user. Otherwise, the temperature is within the safe range and will not scald the user.

[0118] In this scheme, when the internal temperature exceeds a preset threshold, it is detected that the user is close to the device, is ready to open the door and is wearing protection (i.e., safe door opening state), which means that the user is ready to open the door. At this time, the control device is determined to open the device door by a small angle, and the oven door is fully opened after the user approaches the device further (which means that the user is sure to open the door) and the internal temperature drops below the preset threshold. When the internal temperature exceeds the preset threshold, it is detected that the user is making a door opening gesture but is not wearing protection (i.e., dangerous door opening state), which means that the user may be easily scalded if he opens the door. At this time, the control device door is determined to be locked and the user is prompted to wear protection. When the user is not nearby or the user does not make a door opening gesture, it means that the user does not currently want to open the door and the device door remains closed.

[0119] In actual applications, the parameters in the above door opening strategy can be customized and adjusted by the user according to actual usage. For example, when opening the device door at a preset angle, whether the door opening direction is fixed or avoiding the user, the distance setting for fully opening the device door, whether the door opening gesture judgment is enabled, the minimum temperature of the oven when the wearing protection detection function is turned on, etc.

[0120] After the door opening strategy is determined through the above scheme, the device is controlled to perform the corresponding door opening action according to the door opening strategy. In this way, the device can be controlled to perform the corresponding door opening action according to the internal temperature of the device and the corresponding door opening state of the user, so as to ensure that the door is opened according to the user's needs and the user's safety when opening the door.

[0121] The technical solution provided by the embodiment of the present application is that when the device completes cooking, first, the internal temperature of the device is obtained, and the image information and position information of the user are obtained, and then the posture information corresponding to the user is determined based on the image information, wherein the posture information is used to characterize whether the user has a door opening action, and whether the user is wearing protection, and the corresponding door opening state is determined based on the posture information and the position information, and then the corresponding door opening strategy is determined based on the internal temperature and the door opening state, and finally, the device is controlled to perform the corresponding door opening action based on the door opening strategy. Through this solution, the intelligent control of the device door can be achieved based on the user's position, posture and internal temperature of the device, thereby preventing the user from being scalded by steam due to opening the door and improving the safety of use.

[0122] Figure 2 A flowchart of an embodiment of the present application for determining the posture information corresponding to the user according to the image information. Figure 2 The process shown in Figure 1 Based on the process shown, the following steps are included:

[0123] Step 201: identifying a hand region including a user's hand from the image information;

[0124] Step 202: capturing a screenshot of a region including the hand region from the image information;

[0125] Step 203: Identify the area screenshot, and if it is identified that the area screenshot contains protective gear, determine that the user is wearing protection; if it is not identified that the area screenshot contains protective gear, determine that the user is not wearing protection.

[0126] For ease of understanding, steps 201 to 203 are described in a unified manner as follows:

[0127] In an embodiment of the present application, an image target detection algorithm can be used to identify the user's hand area from the image information, and then, an image target detection algorithm can be used to identify whether the user is wearing protective gear and the position of the protective gear from a screenshot of the area containing the hand area. If the protective gear is identified and the position is correct, it is determined that the user is wearing protection; otherwise, it is determined that the user is not wearing protection.

[0128] pass Figure 2The process shown can perform recognition analysis based on the screenshot of the hand area to determine whether the user is wearing protection. Compared with directly recognizing the entire image, it can avoid interference from other areas and improve recognition accuracy.

[0129] Figure 3 A flowchart of another embodiment of the present application for determining the posture information corresponding to the user based on the image information. Figure 3 The process shown in Figure 1 Based on the process shown, the following steps are included:

[0130] Step 301, identifying human body joints from the image information;

[0131] Step 302: extracting joint feature information between each of the human body joints;

[0132] Step 303: Compare the joint point feature information with preset feature information, wherein the preset feature information is feature information between the joint points corresponding to when the user opens the door;

[0133] Step 304: when the joint feature information matches the preset feature information, determining that the user has a door opening action;

[0134] Step 305: When the joint feature information does not match the preset feature information, determine that the user does not have a door opening action.

[0135] For ease of understanding, steps 301 to 305 are described in a unified manner as follows:

[0136] In the embodiment of the present application, first, a convolutional neural network is used to identify and locate the joints of the human body, and the collected image data is processed into the joint information of the human body. These joint information can represent the skeleton structure, part position and joint angle of the human body. After the joints of the human body are identified, the distance, angle, speed and acceleration between these joints are extracted as joint feature information. These joint feature information can reflect the motion state and posture changes of the human body. Finally, by comparing the joint feature information with the preset feature information between the corresponding joints when the user opens the door, it is determined whether the user is ready to open the door, that is, whether there is a door opening action.

[0137] Figure 3 The process shown can realize intelligent analysis of whether the user has opened the door by identifying the features of the human body joints from the image information.

[0138] Figure 4 This is a flow chart of another cooking device door opening control method provided in the present application. Figure 4 As shown, the following steps are included:

[0139] Step 401: During the process of the device executing the corresponding door opening action, monitoring the actual door opening action of the user;

[0140] Step 402: obtaining the real-time temperature, real-time posture information and real-time location information of the device corresponding to the actual door opening action;

[0141] Step 403: Adjust the door opening strategy according to the real-time temperature of the device, the real-time posture information and the real-time position information.

[0142] For ease of understanding, steps 401 to 403 are described in a unified manner as follows:

[0143] The actual door opening action refers to the action of the user manually opening the device door.

[0144] The real-time temperature of the device refers to the temperature inside the device when the user manually opens the device door.

[0145] Real-time posture information refers to the user's posture information when the user actually manually opens the device door, such as the posture of opening the door, the condition of wearing protective equipment, etc.

[0146] Real-time location information refers to the user's location information when the user actually manually opens the device door, including the distance and direction of the user relative to the device.

[0147] In an embodiment of the present application, during the process of the device executing a corresponding door opening action, if the user's manual door opening action is detected, the real-time temperature, real-time posture information and real-time location information of the device at this time are obtained, and the parameters in the current door opening strategy are optimized according to the real-time temperature, real-time posture information and real-time location information of the device, for example, changes in door opening posture, settings of door opening areas, settings of internal temperatures, etc.

[0148] Figure 4 The process shown can optimize the door opening strategy based on the information when the user manually opens the door, so that the door opening strategy is more in line with user habits.

[0149] Figure 5 This is a block diagram of an embodiment of a cooking device door opening control device provided in an embodiment of the present application. Figure 5 As shown, the device comprises:

[0150] An acquisition module 51 is used to acquire the internal temperature of the device, and to acquire the image information and location information of the user;

[0151] A first determination module 52 is used to determine the posture information corresponding to the user according to the image information, wherein the posture information is used to indicate whether the user has a door opening action and whether the user is wearing protective clothing;

[0152] A second determination module 53, used to determine a corresponding door opening state according to the posture information and the position information;

[0153] A third determination module 54, configured to determine a corresponding door opening strategy according to the internal temperature and the door opening state;

[0154] The control module 55 is used to control the device to perform a corresponding door opening action according to the door opening strategy.

[0155] In a possible implementation manner, the second determining module is specifically configured to:

[0156] Determining whether the user is in a door opening area according to the location information;

[0157] When the user is in the door opening area, the user performs a door opening action, and the user wears protective clothing, determining that the door opening state corresponding to the user is a safe door opening state;

[0158] When the user is in the door opening area, the user has a door opening action, and the user is not wearing protective clothing, determining that the door opening state corresponding to the user is a dangerous door opening state;

[0159] When the user is outside the door opening area, or the user does not take any door opening action, it is determined that the door opening state corresponding to the user is a non-door opening state.

[0160] In a possible implementation manner, the third determining module is specifically configured to:

[0161] When the internal temperature is higher than a preset threshold and the door opening state is a safe door opening state, determining a corresponding door opening strategy to control the device to open the device door at a preset angle, the preset angle being smaller than an angle for fully opening the device door, and when the user continues to approach the device and the internal temperature is not higher than the preset threshold, controlling the device to fully open the device door;

[0162] When the internal temperature is higher than a preset threshold and the door opening state is a dangerous door opening state, determining the corresponding door opening strategy to control the device door to be locked and / or to prompt the user to wear protective gear;

[0163] When the internal temperature is higher than a preset threshold and the door opening state is not to open the door, the corresponding door opening strategy is determined to keep the device door closed.

[0164] In a possible implementation manner, the first determining module is specifically configured to:

[0165] identifying a hand region including a user's hand from the image information;

[0166] Capturing a screenshot of a region including the hand region from the image information;

[0167] The area screenshot is identified, and when it is identified that the area screenshot contains protective gear, it is determined that the user is wearing protection; when it is not identified that the area screenshot contains protective gear, it is determined that the user is not wearing protection.

[0168] In a possible implementation manner, the first determining module is further configured to:

[0169] Identifying human body joints from the image information;

[0170] Extracting joint feature information between each of the human body joints;

[0171] Compare the joint point feature information with preset feature information, wherein the preset feature information is feature information between the joint points corresponding to when the user opens the door;

[0172] When the joint feature information matches the preset feature information, determining that the user has a door opening action;

[0173] When the joint point feature information does not match the preset feature information, it is determined that the user does not have a door opening action.

[0174] In a possible implementation, the acquisition module is specifically configured to:

[0175] Collecting point cloud data of the user through a position sensor installed on the device, and collecting image data of the user through a camera installed on the device;

[0176] For each pixel in the image data, determining distance information corresponding to the pixel from the point cloud data;

[0177] The image data and distance information of all pixels are synthesized to obtain corresponding three-dimensional image data, and the three-dimensional image data is determined as the image information.

[0178] In a possible implementation, the device further includes an adjustment module, configured to:

[0179] During the process of the device performing the corresponding door opening action, monitoring the actual door opening action of the user;

[0180] Obtaining the real-time temperature, real-time posture information and real-time location information of the device corresponding to the actual door opening action;

[0181] The door opening strategy is adjusted according to the real-time temperature of the device, the real-time posture information and the real-time location information.

[0182] like Figure 6 As shown, an embodiment of the present application provides a cooking device, including a processor 111, a communication interface 112, a memory 113 and a communication bus 114, wherein the processor 111, the communication interface 112, and the memory 113 communicate with each other through the communication bus 114.

[0183] Memory 113, used for storing computer programs;

[0184] In one embodiment of the present application, the processor 111 is used to execute the program stored in the memory 113 to implement the device door opening control method provided by any of the above method embodiments, including:

[0185] Obtaining the internal temperature of the device, and obtaining the image information and location information of the user;

[0186] Determining the posture information corresponding to the user according to the image information, wherein the posture information is used to indicate whether the user has a door opening action and whether the user is wearing protective clothing;

[0187] Determining a corresponding door opening state according to the posture information and the position information;

[0188] Determining a corresponding door opening strategy according to the internal temperature and the door opening state;

[0189] The device is controlled to perform corresponding door opening actions according to the door opening strategy.

[0190] An embodiment of the present application also provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the steps of the device door opening control method provided in any of the aforementioned method embodiments are implemented.

[0191] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0192] Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a general hardware platform, and of course, by hardware. Based on this understanding, the above technical solution is essentially or the part that contributes to the relevant technology can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0193] It should be understood that the terms used herein are only for the purpose of describing specific example embodiments and are not intended to be limiting. Unless the context clearly indicates otherwise, the singular forms "one", "an" and "said" as used herein may also be meant to include plural forms. The terms "include", "comprise", "contain", and "have" are inclusive, and therefore specify the existence of stated features, steps, operations, elements and / or parts, but do not exclude the existence or addition of one or more other features, steps, operations, elements, parts, and / or combinations thereof. The method steps, processes, and operations described herein are not interpreted as necessarily requiring them to be performed in the specific order described or illustrated, unless the execution order is clearly indicated. It should also be understood that additional or alternative steps may be used.

[0194] The above description is only a specific implementation of the present application, so that those skilled in the art can understand or implement the present application. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to the embodiments shown herein, but will conform to the widest range consistent with the principles and novel features applied for herein.

Claims

1. A cooking device door opening control method, characterized in that: The method comprises: Obtaining the internal temperature of the device, and obtaining the image information and location information of the user; Determining the posture information corresponding to the user according to the image information, wherein the posture information is used to indicate whether the user has a door opening action and whether the user is wearing protective clothing; Determine a corresponding door opening state according to the posture information and the position information; Determining a corresponding door opening strategy according to the internal temperature and the door opening state; The device is controlled to perform corresponding door opening actions according to the door opening strategy.

2. The method according to claim 1, characterized in that: The determining the corresponding door opening state according to the posture information and the position information includes: Determining whether the user is in a door opening area according to the location information; When the user is in the door opening area, the user performs a door opening action, and the user wears protective clothing, determining that the door opening state corresponding to the user is a safe door opening state; When the user is in the door opening area, the user has a door opening action, and the user is not wearing protective clothing, determining that the door opening state corresponding to the user is a dangerous door opening state; When the user is outside the door opening area, or the user does not take any door opening action, it is determined that the door opening state corresponding to the user is a non-door opening state.

3. The method according to claim 2, characterized in that The determining a corresponding door opening strategy according to the internal temperature and the door opening state includes: When the internal temperature is higher than a preset threshold and the door opening state is a safe door opening state, determining a corresponding door opening strategy to control the device to open the device door at a preset angle, the preset angle being smaller than an angle for fully opening the device door, and when the user continues to approach the device and the internal temperature is not higher than the preset threshold, controlling the device to fully open the device door; When the internal temperature is higher than a preset threshold and the door opening state is a dangerous door opening state, determining the corresponding door opening strategy to control the device door to be locked and / or to prompt the user to wear protective gear; When the internal temperature is higher than a preset threshold and the door opening state is not to open the door, the corresponding door opening strategy is determined to keep the device door closed.

4. The method according to claim 1, characterized in that: The determining the posture information corresponding to the user according to the image information includes: identifying a hand region including a user's hand from the image information; Capturing a screenshot of a region including the hand region from the image information; The area screenshot is identified, and when it is identified that the area screenshot contains protective gear, it is determined that the user is wearing protection; when it is not identified that the area screenshot contains protective gear, it is determined that the user is not wearing protection.

5. The method according to claim 1, characterized in that The determining the posture information corresponding to the user according to the image information includes: Identifying human body joints from the image information; Extracting joint feature information between each of the human body joints; Compare the joint point feature information with preset feature information, wherein the preset feature information is feature information between the joint points corresponding to when the user opens the door; When the joint point feature information matches the preset feature information, determining that the user has a door opening action; When the joint point feature information does not match the preset feature information, it is determined that the user does not have a door opening action.

6. The method according to claim 1, characterized in that The obtaining of the user's image information includes: Collecting point cloud data of the user through a position sensor installed on the device, and collecting image data of the user through a camera installed on the device; For each pixel in the image data, determining distance information corresponding to the pixel from the point cloud data; The image data and distance information of all pixels are synthesized to obtain corresponding three-dimensional image data, and the three-dimensional image data is determined as the image information.

7. The method according to claim 1, characterized in that After controlling the device to perform a corresponding door opening action according to the door opening strategy, the method further includes: During the process of the device performing the corresponding door opening action, monitoring the actual door opening action of the user; Obtaining the real-time temperature, real-time posture information and real-time location information of the device corresponding to the actual door opening action; The door opening strategy is adjusted according to the real-time temperature of the device, the real-time posture information and the real-time location information.

8. A cooking equipment door opening control device, characterized in that: The device comprises: An acquisition module, used to acquire the internal temperature of the device, and to acquire the image information and location information of the user; A first determination module is used to determine the posture information corresponding to the user according to the image information, wherein the posture information is used to indicate whether the user has a door opening action and whether the user is wearing protective clothing; A second determination module, used to determine a corresponding door opening state according to the posture information and the position information; A third determination module, configured to determine a corresponding door opening strategy according to the internal temperature and the door opening state; A control module is used to control the device to perform a corresponding door opening action according to the door opening strategy.

9. A cooking device, characterized in that: include: A processor and a memory, wherein the processor is used to execute a device door opening control program stored in the memory to implement the device door opening control method described in any one of claims 1 to 7.

10. A storage medium, characterized in that: The storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the device door opening control method described in any one of claims 1-7.

Images