Control method and device of steam oven, electronic equipment and storage medium

Abstract

Embodiments of the present application provide a control method and device of a steam oven, electronic equipment and storage medium, and relate to the technical field of intelligent household appliances. The method comprises: in response to a closing signal of a steam oven door body, collecting an image in a cavity of the steam oven, and based on the image in the cavity, identifying an accessory type of an accessory in the cavity of the steam oven, a confidence degree of the accessory type, and an article placement state, and then in the case that the confidence degree meets a preset condition and the article placement state indicates that an article is placed on the accessory, controlling the steam oven to execute a program matched with the accessory type. The method realizes automatic identification of the accessory type and automatic matching of the program, reduces the case of user misselection of the program, and improves the operation efficiency of the steam oven by automatically controlling the steam oven to execute the matched program.

Description

Technical Field

[0001] This application relates to the field of smart home appliance technology, and in particular to a control method, device, electronic device and storage medium for a steam oven. Background Technology

[0002] With the development of smart home appliance technology, steam ovens are becoming increasingly versatile, offering functions such as grilling, steaming, and sterilization. Different functions come with different accessories; for example, the grilling function is accompanied by a baking tray, while sterilization is represented by a dish rack.

[0003] In existing technologies, users typically place the accessories into the steam oven and then select the corresponding function program on the panel or touch interface to enable the steam oven to complete steaming, baking, sterilization and other processes.

[0004] However, this method relies heavily on user judgment and manual selection, resulting in low operational efficiency. Furthermore, when attachment types are similar, program selection bias is prone to occur, leading to a high risk of misoperation. Summary of the Invention

[0005] This application provides a control method, device, electronic device, and storage medium for a steam oven. Based on the type of accessories placed in the steam oven by the user, the corresponding program is automatically matched to reduce the reliance on manual judgment and selection by the user, improve the automation and accuracy of matching accessory types with programs, and thus improve operating efficiency.

[0006] In a first aspect, embodiments of this application provide a control for a steam oven, including:

[0007] In response to the closing signal of the steam oven door, an image of the inside of the steam oven cavity is acquired;

[0008] Based on the cavity images, identify the attachment types, confidence levels of attachment types, and placement status of items inside the steam oven cavity;

[0009] If the confidence level meets the preset conditions and the item placement status indicator shows that an item is placed on the accessory, control the steam oven to execute a program that matches the accessory type.

[0010] In one possible embodiment, based on intracavity images, the type of attachment inside the steam oven cavity, the confidence level of the attachment type, and the placement status of the items are identified, including:

[0011] The intracavitary image is input into a pre-trained intelligent decision-making model, which performs multi-task reasoning on the intracavitary image to obtain the attachment type, the confidence level of the attachment type, and the placement status of the item.

[0012] The item placement status indicates whether an item is placed on the attachment.

[0013] In one possible embodiment, when the confidence level meets a preset condition and the item placement status indicates that an item is placed on the accessory, the steam oven is controlled to execute a program matching the accessory type, including:

[0014] When the confidence level meets the preset conditions and the item placement status indicates that an item is placed on the attachment, the intelligent decision-making model outputs the program identifier of the program that matches the attachment type.

[0015] Control the steam oven to execute the program corresponding to the program identifier.

[0016] In one possible embodiment, the method further includes:

[0017] The program interface is displayed on the oven's screen. The program interface includes at least the program's execution mode and program parameters.

[0018] In one possible embodiment, before controlling the steam oven to execute a program matching the accessory type, the program interface also includes a start countdown; the start countdown is used to prompt the program to be executed to start after a preset time.

[0019] In one possible embodiment, controlling the steam oven to execute a program matching the accessory type includes:

[0020] When the preset time is reached, the control unit of the steam oven executes the program based on the program parameters;

[0021] Alternatively, before the preset duration is reached, in response to a countdown cancellation operation, the countdown can be stopped; in response to a modification of program parameters, the program can be executed based on the modified program parameters.

[0022] In one possible embodiment, controlling the steam oven to execute a corresponding program according to a program identifier includes:

[0023] Retrieve the basic parameters corresponding to the program identifier;

[0024] Identify the properties of items placed on the accessory from intracavitary images;

[0025] Generate parameter correction values ​​based on the item's attributes;

[0026] Based on the parameter correction values, the basic parameters are updated to obtain the program parameters.

[0027] In one possible embodiment, the method further includes:

[0028] If the accessory type is not identified or the confidence level does not meet the preset conditions, a manual selection interface is displayed on the oven's screen; the manual selection interface includes at least one program that the user can manually select.

[0029] In one possible embodiment, the method further includes:

[0030] If no attachment is detected or no items are placed on the attachment, control the steam oven to enter sleep mode.

[0031] Secondly, embodiments of this application provide a control device for a steam oven, comprising:

[0032] The acquisition module is used to acquire images inside the steam oven cavity in response to the closing signal of the steam oven door;

[0033] The identification module is used to identify the attachment type, confidence level of the attachment type, and placement status of items inside the steam oven cavity based on the cavity image.

[0034] The control module is used to control the steam oven to execute a program that matches the attachment type when the confidence level meets the preset conditions and the item placement status indicator shows that an item is placed on the attachment.

[0035] In one possible embodiment, the above-described apparatus further includes: an input module;

[0036] The input module is used to input intracavitary images into a pre-trained intelligent decision-making model. The intelligent decision-making model performs multi-task reasoning on the intracavitary images to obtain the attachment type, the confidence level of the attachment type, and the placement status of the item.

[0037] The item placement status indicates whether an item is placed on the attachment.

[0038] In one possible embodiment, the above-described apparatus further includes: an output module;

[0039] The output module is used to output a program identifier that matches the attachment type when the confidence level meets the preset conditions and the item placement status indicates that an item is placed on the attachment, via the intelligent decision model.

[0040] The control module is specifically used to control the steam oven to execute the program corresponding to the program identifier.

[0041] In one possible embodiment, the above-described apparatus further includes: a display module;

[0042] The display module is used to display the program interface on the display screen of the steam oven. The program interface includes at least the program execution mode and program parameters.

[0043] In one possible embodiment, before controlling the steam oven to execute a program matching the accessory type, the program interface also includes a start countdown; the start countdown is used to prompt the program to be executed to start after a preset time.

[0044] In one possible embodiment, the control module is further configured to control the steam oven to execute a program based on program parameters when a preset time is reached;

[0045] Alternatively, before the preset time is reached, in response to a countdown cancellation operation, the countdown can be stopped; in response to a modification of the program parameters, the steam oven can be controlled to execute the program based on the modified program parameters.

[0046] In one possible embodiment, the above-described apparatus further includes: a retrieval module, a generation module, and an update module;

[0047] The retrieval module is used to retrieve the basic parameters corresponding to the program identifier;

[0048] The recognition module is also used to identify the properties of items placed on the accessory from intracavitary images;

[0049] The generation module is used to generate parameter correction values ​​based on the item's attributes;

[0050] The update module is used to update the basic parameters based on the parameter correction values ​​to obtain the program parameters.

[0051] In one possible embodiment, the display module is further configured to display a manual selection interface on the display screen of the steam oven when the accessory type is not identified or the confidence level does not meet a preset condition; the manual selection interface includes at least one program that can be manually selected by the user.

[0052] In one possible embodiment, the control module is also configured to control the steam oven to enter a sleep state if no accessory is detected or no items are placed on the accessory.

[0053] Thirdly, embodiments of this application provide an electronic device, including: a memory and a processor;

[0054] The memory stores computer-executed instructions;

[0055] The processor executes computer execution instructions stored in the memory, causing the processor to perform the first aspect and / or various possible implementations of the first aspect as described above.

[0056] Fourthly, embodiments of this application provide a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, are used to implement the first aspect and / or various possible implementations of the first aspect.

[0057] Fifthly, embodiments of this application provide a computer program product, including a computer program that, when executed by a processor, implements the first aspect and / or various possible implementations of the first aspect.

[0058] The control method, apparatus, electronic device, and storage medium for a steam oven provided in this application embodiment acquire an image of the oven cavity in response to the closing of the oven door. Based on this image, the method identifies the attachment type, confidence level of the attachment type, and the placement status of the items inside the oven cavity. Then, when the confidence level meets a preset condition and the placement status indicates that items are placed on the attachment, the method controls the steam oven to execute a program matching the attachment type. This method not only achieves automatic identification of attachment types and automatic program matching, reducing the possibility of users mistakenly selecting programs, but also improves the operating efficiency of the steam oven by automatically controlling it to execute the matched program. Attached Figure Description

[0059] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0060] Figure 1 Flowchart of the control method for the steam oven provided in this application Figure 1 ;

[0061] Figure 2 Flowchart of the control method for the steam oven provided in this application Figure 2 ;

[0062] Figure 3 Flowchart of the control method for the steam oven provided in this application Figure 3 ;

[0063] Figure 4 A schematic diagram of the control device for the steam oven provided in this application;

[0064] Figure 5 A schematic diagram of the structure of the electronic device provided in this application.

[0065] The accompanying drawings illustrate specific embodiments of this application, which will be described in more detail below. These drawings and descriptions are not intended to limit the scope of the concept in any way, but rather to illustrate the concept of this application to those skilled in the art through reference to particular embodiments. Detailed Implementation

[0066] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application.

[0067] With the rapid development of smart home technology, steam ovens, as kitchen appliances that integrate multiple cooking functions such as steaming, baking, and stewing, have become a core piece of equipment widely used in modern family kitchens. Steam ovens are usually equipped with a variety of detachable accessories, such as baking racks and baking trays.

[0068] Different functions of a steam oven correspond to different accessories. For example, the accessory for the grilling function is a baking tray, and the accessory for the sterilization function is a dish rack.

[0069] Existing steam ovens generally operate by having the user first place the accessories into the cavity and then manually select the function program through the panel or touch interface. That is, the user determines whether to start the steaming program, baking program or sterilization program based on the type of accessory and the purpose of use.

[0070] The solution relies on manual identification of attachment categories and manual matching of programs. However, in actual use, different attachments may have similar appearances, and users may easily select the wrong program due to lack of experience, hasty operation, or judgment errors, resulting in insufficient compatibility between attachments and programs.

[0071] Therefore, existing technologies suffer from low operational efficiency and are prone to program selection bias when the types of attachments are similar, leading to a high risk of misoperation.

[0072] The control method for the steam oven provided in this application acquires images inside the cavity when triggered by a door closing signal, identifies the attachment type, the confidence level of the attachment type, and the placement status of the items based on the images inside the cavity, and controls the steam oven to execute a program that matches the attachment type when the confidence level meets preset conditions and the placement status indicates that items are placed on the attachment, thereby improving the accuracy of program selection and increasing the operating efficiency of the steam oven.

[0073] The technical solution of this application and how the technical solution of this application solves the above-mentioned technical problems are described in detail below with specific embodiments. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments. The embodiments of this application will now be described with reference to the accompanying drawings.

[0074] Figure 1 Flowchart of the control method for the steam oven provided in this application Figure 1 ,like Figure 1 As shown, the method includes:

[0075] S101. In response to the closing signal of the oven door, acquire the image inside the oven cavity.

[0076] It should be noted that the steam oven has an internal cavity to accommodate accessories and food. This cavity is typically equipped with lighting and image acquisition devices (such as cameras) to capture images of the interior. The steam oven also features a door sensor to detect the door's open / closed state and generate a closing signal when the door is closed. The closing signal indicates that the oven door is closed, while the internal image represents the accessories and their contents inside the cavity after the door is closed.

[0077] Optionally, the image acquisition device can use a wide-angle camera to ensure that the main area inside the cavity is covered, while a lighting device can be used to provide sufficient illumination to ensure that the quality of the acquired intracavity images meets the requirements of subsequent recognition and processing.

[0078] Specifically, the control unit of the steam oven is electrically connected to the door sensor. When the user closes the door, the door sensor detects the door switching from an open to a closed state, generates a closing signal, and sends this signal to the control unit. When the control unit receives the closing signal, it triggers the image acquisition device to acquire an image of the cavity. The door sensor can be, for example, a Hall sensor or a microswitch.

[0079] Understandably, intracavitary images contain complete visual information about the attachments within the cavity, including but not limited to the shape, texture, installation location of the attachments, and whether any items are placed on the attachments.

[0080] After acquiring the intracavitary images, preprocessing operations can be performed on them to improve the accuracy of subsequent model recognition and inference. These preprocessing operations include, but are not limited to, denoising, brightness adjustment, and contrast enhancement.

[0081] S102. Based on the cavity image, identify the attachment type, confidence level of the attachment type, and placement status of the items inside the steam oven cavity.

[0082] The attachment refers to the object placed inside the steam oven cavity and corresponding to different programs. The attachment type characterizes which category the attachment belongs to: bowl rack, baking tray, steaming tray, proofing basket, rotisserie rack, air fryer basket, or other preset categories. The confidence level characterizes the reliability of the attachment type identification result, and this confidence level can range from, for example, 0 to 1.

[0083] In addition, the item placement status is used to indicate whether there are items to be processed on the accessories inside the steam oven cavity.

[0084] In practice, the intracavitary images are identified and analyzed to obtain the classification results of accessory types and their corresponding confidence levels, and further to identify whether there are items placed on the accessories, thus obtaining the placement status of the items.

[0085] S103. When the confidence level meets the preset conditions and the item placement status indicator shows that an item is placed on the attachment, control the steam oven to execute a program that matches the attachment type.

[0086] The preset condition is used to limit the confidence level to meet the requirements of executable control. For example, the preset condition can be that the confidence level is greater than a confidence threshold.

[0087] The confidence threshold can be a fixed threshold, such as 0.80 or 0.85. The specific value of the confidence threshold in this application is not limited and can be determined and adjusted according to actual needs. In addition, different confidence thresholds can be set for different accessory types. For example, a higher threshold can be used for accessories with small appearance differences, and a relatively lower threshold can be used for accessories with significant structural differences.

[0088] For example, when the appearance features of two or more types of attachments are relatively similar, a higher confidence threshold is determined for the corresponding two or more attachment types; when the appearance features of an attachment are significantly different from those of other attachments, a lower confidence threshold is determined for the attachment type of that attachment.

[0089] Specifically, based on pre-stored preset conditions, the confidence level is determined to see if it meets the preset conditions, and whether the item placement status indicates that there are items to be processed on the attachment. Subsequently, if the confidence level meets the preset conditions and the item placement status indicates that there are items to be processed on the attachment, a program matching the attachment type is determined, and then the corresponding program parameters are called to control the steam oven to execute the matched program based on the program parameters.

[0090] In some embodiments, the storage module of the steam oven pre-stores a mapping table between accessory types and program identifiers. This mapping table records the program identifier corresponding to each accessory type. After an accessory type is identified, the mapping table is queried to obtain the program identifier of the program matching the identified accessory type. For example, if the accessory type is a bowl rack, the matching program is a baking program; if the accessory type is a steamer, the matching program is a steam cooking program.

[0091] Optionally, the mapping relationship between accessory type and program identifier can be preset at the factory according to the product configuration, depending on the product model and program type of the steam oven.

[0092] Understandably, the mapping table will be updated and expanded in subsequent use through firmware upgrades or cloud distribution to support new attachment types and programs.

[0093] In this step, the automatic startup of the program depends on the attachment type, the confidence level of the attachment type, and the identification result of whether there are items placed on the attachment. This effectively avoids starting the program when the identification is uncertain or when the oven is empty, thereby improving the safety of the steam oven operation. This method solves the problem of improper program startup caused by users manually judging the attachment category and ignoring whether the attachment carries items.

[0094] The control method for a steam oven provided in this application embodiment, in response to a closing signal of the steam oven door, acquires an image of the cavity inside the steam oven, and based on this image, identifies the attachment type, the confidence level of the attachment type, and the placement status of the items inside the steam oven cavity. Then, when the confidence level meets a preset condition and the item placement status indicates that items are placed on the attachment, the method controls the steam oven to execute a program matching the attachment type. This method, through comprehensive analysis of the confidence level of the attachment type and the identification results of whether items are placed on the attachment, ensures that the identification results of the attachment type are reliable and that the attachment is not empty. It further determines a program matching the attachment type, achieving automated confirmation and execution of the program, thereby avoiding manual judgment and selection of programs, improving the matching accuracy between the program and the attachment type, and increasing the operating efficiency of the steam oven.

[0095] Figure 2 Flowchart of the control method for the steam oven provided in this application Figure 2 ,like Figure 2 As shown, in this embodiment... Figure 1 Based on the embodiments, a method for performing multi-task reasoning based on a pre-trained intelligent decision-making model to obtain a program matching the attachment type and executing the program is described in detail. The method includes:

[0096] S201. Input the intracavitary image into the pre-trained intelligent decision-making model. The intelligent decision-making model performs multi-task reasoning on the intracavitary image to obtain the attachment type, the confidence level of the attachment type, and the placement status of the item.

[0097] The item placement status indicates whether an item is placed on the attachment.

[0098] After acquiring the intracavitary image, it is preprocessed to obtain image data that meets the input specifications of the intelligent decision-making model. Subsequently, the preprocessed intracavitary image is input into the pre-trained intelligent decision-making model. The feature extraction network layer of the intelligent decision-making model extracts features from the preprocessed intracavitary image to obtain the intracavitary image features.

[0099] The feature extraction network layer can employ architectures such as Deep Residual Network (ResNet), Efficient Net, or Visual Transformer to extract intracavitary image features from the preprocessed intracavitary image through multi-layer convolution or self-attention operations. These intracavitary image features contain both global shape and structural information of the appendages and local texture and detail information, providing a sufficient data foundation for subsequent multi-task inference.

[0100] Furthermore, the intelligent decision-making model also includes a first branch network and a second branch network. The first branch network comprises a fully connected layer and a Softmax activation function. This first branch network receives the intracavity image features output from the feature extraction network layer and, through its fully connected layer and Softmax activation function, outputs the probability distribution of each preset accessory type. It also outputs the category label corresponding to the preset accessory category with the highest probability, as well as the probability corresponding to that preset accessory category. This preset accessory category represents the accessory type identified in the steam oven, and its probability is the confidence level.

[0101] The second branch network includes a binary classifier. This second branch network receives the intracavity image features output from the feature extraction network layer and uses the binary classifier to determine whether there are items such as food or utensils in the attachment area, thus outputting an item placement status of "item present" or "item absent." The item placement status includes a first item placement status and a second item placement status. The first item placement status indicates that there are items to be processed on the attachment, while the second item placement status indicates that there are no items on the attachment.

[0102] The intelligent decision-making model may also include a third branch network, which is used to further calibrate and evaluate the probability distribution output by the first branch network, using confidence calibration techniques such as temperature scaling or ordinal-preserving regression to output more accurate and reliable confidence values.

[0103] Understandably, the three branches share the underlying feature extraction network and achieve feature sharing through a multi-task joint training strategy, which reduces the number of model parameters and computational overhead, and improves the inference accuracy of each task.

[0104] It should be noted that the intelligent decision-making model is trained based on pre-collected historical cavity image samples. The historical cavity image samples are labeled with the type of attachment and the placement status of the item, so that the intelligent decision-making model can learn the correspondence between the outlines, surface structures and features of different attachments and the target object.

[0105] In practical applications, the intelligent decision-making model can also choose other network structures, and this application does not limit it.

[0106] For example, after the intracavitary image is input into the intelligent decision-making model, the intelligent decision-making model first extracts features from the appearance area of ​​the accessory, then combines the accessory edge, surface texture and local salient areas to determine the accessory type, and simultaneously calculates the confidence level of the determination result. At the same time, it outputs the item placement status based on whether the accessory surface has an image area that matches the placed object.

[0107] In this step, the accessory type, confidence level, and item placement status can be simultaneously identified under the same image input, reducing reliance on manual judgment and enabling subsequent program selection to be based on more complete intracavity status information, thereby improving the completeness of accessory identification results and the consistency of control execution.

[0108] S202. When the confidence level meets the preset conditions and the item placement status indicates that an item is placed on the attachment, the intelligent decision-making model outputs the program identifier of the program that matches the attachment type.

[0109] Specifically, the intelligent decision-making model determines whether the confidence level meets preset conditions and whether the item placement status is the first item placement status. The first item placement status indicates that there are items to be processed placed on the attachment.

[0110] When the confidence level meets the preset conditions and the item placement state is the first item placement state, the intelligent decision-making model, through its output layer, searches the pre-established mapping table between the identified attachment type and the cooking program, determines the program that matches the attachment type, and outputs the program identifier of the program to the controller of the steam oven.

[0111] For example, when the accessory type is identified as "grill", the corresponding grilling mode program identifier is output; when the accessory type is identified as "steamer", the corresponding steam mode program identifier is output.

[0112] S203, Control the steam oven to execute the program corresponding to the program identifier.

[0113] Specifically, the intelligent decision-making model determines whether the confidence level meets preset conditions and whether the item placement status is the first item placement status. The first item placement status indicates that there are items to be processed placed on the attachment.

[0114] When the confidence level meets the preset conditions and the item placement state is the first item placement state, the intelligent decision-making model, through its output layer, searches the pre-established mapping table between the identified attachment type and the cooking program, determines the program that matches the attachment type, and outputs the program identifier of the program to the controller of the steam oven.

[0115] For example, when the accessory type is identified as "grill", the corresponding grilling mode program identifier is output; when the accessory type is identified as "steamer", the corresponding steam mode program identifier is output.

[0116] The controller of the steam oven retrieves the corresponding program parameters based on the received program identifier, and controls the steam generator, heating element, fan, or circulation control unit of the steam oven to start and operate according to the aforementioned program parameters, thereby executing the corresponding program. The program parameters include, but are not limited to, cooking mode, target temperature, and cooking time.

[0117] Understandably, the preset program mapping table is stored in the non-volatile memory of the steam oven. The table entries include, but are not limited to, program type, heating power, upper temperature limit, duration, and fan speed parameters.

[0118] Optionally, the controller retrieves the corresponding program parameters from a preset program mapping table based on the received program identifier.

[0119] In this step, assuming the identification result of the internal attachments is reliable and items are indeed placed on them, the intelligent decision-making model directly outputs a program identifier to the controller of the steam oven. The controller then drives the corresponding program to run. This process ensures that the control is constrained by the identification result, the item placement status, and the program mapping relationship, thereby achieving automatic matching and execution of the attachments and the program. This allows the steam oven to complete program association confirmation before operation, achieving automated control and reducing program selection bias.

[0120] The steam oven control method provided in this application involves inputting an image of the oven cavity into a pre-trained intelligent decision-making model. The model performs multi-task reasoning on the image to obtain the attachment type, its confidence level, and the item placement status. Then, when the confidence level meets preset conditions and the item placement status indicates that an item is placed on the attachment, the model outputs a program identifier matching the attachment type, thereby controlling the steam oven to execute the program corresponding to that program identifier. This method completes attachment identification and program matching in one step through end-to-end reasoning of the intelligent decision-making model. The entire process requires no manual selection by the user, achieving intelligent and automated control of the steam oven, thus improving the accuracy of program matching and the operating efficiency of the steam oven.

[0121] In one possible implementation, after the identification is completed in step S102 or S201, if no accessory type is identified or the confidence level does not meet the preset conditions, a manual selection interface is displayed on the oven's screen. This manual selection interface includes at least one program that can be manually selected by the user.

[0122] Understandably, failure to identify an attachment type may occur if the attachment type is not within the preset attachment types covered by the intelligent decision model training. A confidence level that does not meet the preset conditions indicates insufficient reliability of the current identification result.

[0123] The display screen of the steam oven can be a touch screen or an LCD screen that works with touch operation components. The specific configuration can be determined according to actual needs, and this application does not impose any restrictions on it.

[0124] Specifically, if the accessory type is not identified or the confidence level does not meet the preset conditions, the steam oven will not automatically start any program, but will instead display a manual selection interface on the screen. This manual selection interface lists at least one program that the user can manually select, allowing the user to choose the appropriate program according to the actual situation.

[0125] For example, the manual selection interface includes a program list, program descriptions, and icon buttons for each program. Users complete program settings by touching the selection area, confirming with a button, or selecting with a knob. The program list can be sorted by usage frequency or by recommended order based on recent cooking history. Program descriptions may include, for example, applicable ingredients and estimated cooking time, to help users make more informed program selections.

[0126] In addition, the manual selection interface may also include a first prompt message, which indicates that the recognition result does not meet the conditions for automatic execution.

[0127] After receiving the program identifier selected by the user, the controller maps the selected program identifier to the corresponding execution instruction, and drives the heating component, steam generating component or fan assembly into the operating state according to the execution instruction.

[0128] This method does not directly enter the automatic matching program control when the attachment type cannot be identified or the confidence level does not meet the preset conditions. Instead, it displays a manual selection interface on the screen and guides the user to make a manual selection. This allows the user to complete the program selection based on the actual attachment and the purpose of use, which not only ensures the flexibility of operation but also avoids incorrect cooking caused by misidentification, thereby improving the continuity of the control process and the stability of equipment use.

[0129] In some embodiments, after the identification is completed in step S102 or S201, if no accessory is identified or no item is placed on the accessory, the steam oven is controlled to enter a sleep state.

[0130] Understandably, this could occur if an accessory is not detected, for example, because the user did not place an accessory. It could also occur if no item is placed on the accessory, for example, because an accessory is placed inside the steam oven cavity but is empty.

[0131] Specifically, after the identification is completed in step S102 or S201, the identification result is sent to the controller. After receiving the identification result, the controller determines whether the attachment has been identified and whether there are any items on the attachment.

[0132] If the identification result indicates that there are no accessories in the cavity, or if accessories are present but no items are detected on them, a sleep control signal is generated, causing the heating module, steam generation module, and interface interaction module related to program execution to enter a low-power standby state, while maintaining monitoring of the door status, wake-up command, or re-identification signal.

[0133] The hibernation state can be achieved by the main control chip of the steam oven sending a power reduction command to the power management circuit, or by the control program switching the execution thread to a paused state while maintaining necessary sensor sampling and wake-up response. In practical applications, this control method can also be implemented in other equivalent ways, which are not limited in this application.

[0134] Once in sleep mode, the steam oven turns off the cavity lighting, reduces the brightness of the display screen, and stops unnecessary background processes to reduce energy consumption. In sleep mode, the steam oven's door sensor remains active. When the user opens the door again to place food or accessories and then closes the door again, the steam oven can be reawakened and the image acquisition and recognition process described above will be executed again.

[0135] This method controls the steam oven to enter a sleep state when no attachments are detected or no items are placed on the attachments. This prevents the steam oven from starting its program without attachments or a suitable load, ensuring that the program execution conditions match the actual state inside the cavity. This reduces the probability of accidental starts, idling, and unnecessary energy consumption, thereby improving the safety of the steam oven's operation. The sleep mechanism effectively avoids energy waste when the steam oven is not in use.

[0136] In one possible implementation, after obtaining the program identifier of the program that matches the attachment type of the attachment in the steam oven, the program interface can also be displayed on the display screen of the steam oven before the program is executed.

[0137] The program interface is the interactive interface through which the steam oven displays information about the program to be executed to the user. The program interface includes at least the program's execution mode and program parameters.

[0138] Understandably, the execution mode can be, for example, steam mode, grill mode, fan grill mode, bottom heating mode, or a combination mode. Program parameters refer to the operating parameters of each component of the steam oven when the program is executed, including but not limited to cooking temperature, cooking time, preheating temperature, steam volume, and fan speed.

[0139] In practical implementation, when the confidence level of the identified accessory type meets the preset conditions, and the item placement status indicates that an item is placed on the accessory, the controller invokes the program information corresponding to the aforementioned accessory type. This program information includes the program's execution mode and program parameters. Further, the program's execution mode and program parameters are organized into interface data and output to the display screen.

[0140] The program interface automatically pops up after the recognition results are generated and remains displayed until the user confirms or the program finishes starting, allowing the user to know the specific content of the program to be executed before execution.

[0141] In some embodiments, the execution mode of the program interface includes a target execution mode and other executable modes. Specifically, the program information corresponding to the program identifier has a preset default execution mode, which is displayed in the program interface as the target execution mode.

[0142] The default execution mode is pre-configured at the factory based on the mapping relationship between accessory types and programs. For example, when the accessory type is a dish rack, the default execution mode corresponding to the matching program identifier is steam sterilization mode; when the accessory type is a baking tray, the default execution mode corresponding to the matching program identifier is fan baking mode. When the steam oven retrieves the program information corresponding to the program identifier, it displays the default execution mode as the target execution mode in the program interface.

[0143] Furthermore, the aforementioned program identifier corresponds to at least one other executable mode, which can be displayed in a list format on the program interface. Additionally, a first control can be displayed on the program interface; triggering this first control will display the list of other executable modes.

[0144] In this method, the program interface displays the above program information in a clear and intuitive way, enabling users to fully understand the program to be executed before it is officially executed.

[0145] In some embodiments, the program interface described above also includes a startup countdown timer. This startup countdown timer is used to prompt the program to start after a preset duration.

[0146] The preset duration can be set according to actual needs, such as 30 seconds, 60 seconds or 120 seconds.

[0147] The purpose of starting the countdown is to provide users with a sufficient time window so that they can confirm or modify their actions before the program is officially executed.

[0148] In practice, the program interface can display the execution mode and program parameters of the program to be executed while overlaying a countdown timer, allowing users to confirm, cancel, or modify the current program before it officially starts.

[0149] Optionally, the preset duration can be stored in a parameter table and associated with the program corresponding to the attachment type. For example, different attachment types correspond to different startup countdown lengths to adapt to the confirmation requirements before program startup. This preset duration can also be adjusted by the user within a preset range.

[0150] During the countdown, the controller continuously receives user input. When a program cancellation command is detected, the program to be executed is aborted. If no cancellation command is received, the program to be executed will automatically start after a preset time.

[0151] By adopting the above method, the program has a clear buffer period before execution, the program interface can provide users with confirmation information before startup, and automatically switch to the actual running state after the startup countdown ends. This makes the startup process of the program that matches the attachment type more controllable, and makes it easy to complete confirmation, cancellation or modification operations directly on the display interface.

[0152] For example, during the program interface display period, i.e. during the start countdown, the user can select the target execution mode from multiple execution modes supported by the program information by touching the display screen or using physical buttons.

[0153] Specifically, in addition to the default execution mode, the program information also stores a list of alternative execution modes supported by the program. For example, for the sterilization program corresponding to the dish rack, the list of alternative execution modes may include steam sterilization mode, ultraviolet sterilization mode, and combined sterilization mode. The program interface displays these execution mode options in the form of toggleable tabs or drop-down menus, and users can switch execution modes by clicking the corresponding tabs.

[0154] When the user switches execution modes during the countdown, the system updates the execution mode displayed on the program interface to the selected target execution mode in response to the user's switch, and simultaneously retrieves and displays the program parameters corresponding to that target execution mode. If the user does not switch modes when the countdown ends, the controller retains the default execution mode.

[0155] Understandably, during the countdown, the following scenarios may occur: when the preset time is reached, the oven is controlled to execute the program based on the program parameters; or, before the preset time is reached, in response to a countdown cancellation operation, the countdown is stopped, and in response to a modification operation of the program parameters, the oven is controlled to execute the program based on the modified program parameters.

[0156] In practice, after the control unit identifies the attachment type and generates a matching program, it will output a program interface containing the execution mode and program parameters on the display screen, and simultaneously start the countdown display.

[0157] During the countdown, users can issue a cancellation command via the touchscreen, knob, or physical button. Upon receiving the cancellation command, the controller will stop the countdown and return to the program interface.

[0158] After returning to the program interface, the program receives the user's program parameter modification operation, and after the program parameter modification is completed, a countdown begins. Then, when the preset time is reached, the corresponding program is executed according to the modified program parameters.

[0159] If the countdown is neither canceled nor modified during the start-up countdown, the program will automatically start and execute according to the current program parameters after the preset time is reached. That is, if the user does not perform any operation when the preset time is reached, the steam oven will automatically execute the program based on the program parameters.

[0160] For example, if the user triggers a countdown cancellation operation before the preset time is reached, such as by clicking the cancel button on the display screen, the steam oven will immediately stop starting the countdown, cancel the automatic execution of this program, and can return to the program interface or display the main interface, waiting for the user's next operation command.

[0161] If the user modifies the program parameters at this time (e.g., adjusts the cooking temperature, changes the cooking time, switches the execution mode, etc.), the steam oven responds to the user's modification and obtains the modified program parameters. Upon subsequent startup, the steam oven executes the program based on the modified program parameters.

[0162] This method allows users to adjust program parameters based on personal preferences and actual needs, building upon intelligent recommendations. It balances intelligence and personalization, and makes program execution more aligned with attachment status and user needs, thereby helping to reduce repeated interruptions and resets after preset programs are directly activated.

[0163] Figure 3 Flowchart of the control method for the steam oven provided in this application Figure 3 ,like Figure 3 As shown, in this embodiment... Figure 1-2 Based on the embodiments, a method for controlling a steam oven to execute a corresponding program according to a program identifier is described in detail. The method includes:

[0164] S301, Retrieve the basic parameters corresponding to the program identifier.

[0165] Specifically, after the intelligent decision-making model outputs the program identifier of the program that matches the attachment type, the steam oven retrieves the basic parameters corresponding to that program identifier from its local memory. The basic parameters are the default parameter configurations of the program under standard conditions, which are recommended values ​​preset based on a large amount of experimental data.

[0166] For example, for the "Grill-Barbecue Mode" program, basic parameters may include grilling temperature of 200 degrees Celsius, cooking time of 25 minutes, preheating temperature of 200 degrees Celsius, and fan speed at medium.

[0167] S302. Identify the attributes of items placed on the accessory from the intracavitary image.

[0168] The attributes of an item include, but are not limited to, the type of item, the size of the item, the shape of the item, the color of the item, and the quantity of the item.

[0169] For example, the types of items include meat, vegetables, pasta, and pasta. The size of an item can be estimated, for example, by the pixel area it occupies in an image. The shape of an item can be, for example, blocky, sheet-like, or strip-like. The color of an item is used to determine its surface condition or the doneness of the food.

[0170] Specifically, after obtaining the intracavitary image and confirming that an item is placed on the attachment, the intelligent decision-making model further performs attribute analysis on the item area in the intracavitary image to obtain the item's attributes.

[0171] In some embodiments, the intelligent decision-making model further includes a fourth branch network after the feature extraction network layer. This fourth branch network utilizes techniques such as object detection and semantic segmentation to extract multidimensional attribute information of the object from the intracavitary image, and determines the object's attributes based on this multidimensional attribute information. The multidimensional attribute information includes, but is not limited to, the contour, texture, and color features of the area where the object is located.

[0172] S303. Generate parameter correction values ​​based on the item's attributes.

[0173] Based on the item's attributes and a pre-defined parameter correction rule, parameter correction values ​​are generated. The parameter correction rule defines the influence of different item attributes on program parameters.

[0174] For example, when the type of item is "thick-cut steak", the parameter correction rule indicates that the cooking temperature should be increased by 10 degrees Celsius and the cooking time should be extended by 5 minutes; when the item is large in size (i.e., it occupies a high proportion of the attached area), the parameter correction rule indicates that the amount of steam should be increased or the preheating time should be extended; when the quantity of items is large, the parameter correction rule indicates that the sterilization time should be appropriately extended to ensure uniform heating.

[0175] In this step, the generation process of parameter correction values ​​takes into account the thermodynamic properties of the ingredients and the principles of heat transfer, ensuring that the corrected parameters are physically reasonable.

[0176] S304. Based on the parameter correction value, update the basic parameters to obtain the program parameters.

[0177] The parameter correction values ​​generated in step S303 are merged and updated with the basic parameters obtained in step S301 to obtain the final program parameters.

[0178] For example, the update process uses an overlay or overwrite approach. Specifically, for temperature parameters, the correction value is overlaid on the base value; for example, a base temperature of 200 degrees Celsius plus a correction value of 10 degrees Celsius results in a final temperature of 210 degrees Celsius. For time parameters, the correction value is overlaid on the base value; for example, a base time of 25 minutes plus a correction value of 5 minutes results in a final time of 30 minutes. For mode parameters, if the correction rule suggests switching the execution mode, the corrected mode overrides the original mode.

[0179] The updated program parameters will be used as the actual execution parameters of the matched program and displayed in the program interface for users to view and confirm.

[0180] This step utilizes a dynamic parameter adjustment mechanism, enabling the steam oven to automatically optimize program parameters based on the properties of the food being placed inside, thereby achieving better processing results.

[0181] The control method for a steam oven provided in this application retrieves the basic parameters corresponding to the program identifier and identifies the attributes of items placed on the attachment from an image inside the cavity. Based on these attributes, parameter correction values ​​are generated, and the basic parameters are updated to obtain the program parameters. This method automatically generates parameter correction values ​​by identifying the attributes of items placed on the attachment and combining them with preset parameter correction rules. This intelligently corrects the basic program parameters, allowing the steam oven's cooking program to adapt and optimize based on the actual characteristics of the items, rather than being limited to fixed parameter configurations. This improves the steam oven's processing effect and user satisfaction.

[0182] Figure 4 This is a schematic diagram of the control device for the steam oven provided in this application, as shown below. Figure 4 As shown, the control device 40 of the steam oven provided in this embodiment includes:

[0183] The acquisition module 401 is used to acquire images inside the steam oven cavity in response to the closing signal of the steam oven door;

[0184] The identification module 402 is used to identify the attachment type, confidence level of the attachment type, and placement status of the items in the cavity of the steam oven based on the cavity image.

[0185] The control module 403 is used to control the steam oven to execute a program that matches the type of the attachment when the confidence level meets the preset conditions and the item placement status indicator shows that an item is placed on the attachment.

[0186] In one possible embodiment, the above-described apparatus further includes: an input module 404;

[0187] The input module 404 is used to input the intracavitary image into a pre-trained intelligent decision-making model, and the intelligent decision-making model performs multi-task reasoning on the intracavitary image to obtain the attachment type, the confidence level of the attachment type, and the placement status of the item.

[0188] The item placement status indicates whether an item is placed on the attachment.

[0189] In one possible embodiment, the above-described apparatus further includes: an output module 405;

[0190] The output module 405 is used to output a program identifier that matches the attachment type when the confidence level meets the preset conditions and the item placement status indicates that an item is placed on the attachment, via the intelligent decision model.

[0191] The control module 403 is specifically used to control the steam oven to execute the program corresponding to the program identifier.

[0192] In one possible embodiment, the above-described device further includes: a display module 406;

[0193] Display module 406 is used to display the program interface on the display screen of the steam oven. The program interface includes at least the program execution mode and program parameters.

[0194] In one possible embodiment, before controlling the steam oven to execute a program matching the accessory type, the program interface also includes a start countdown; the start countdown is used to prompt the program to be executed to start after a preset time.

[0195] In one possible embodiment, the control module 403 is further configured to control the steam oven to execute a program based on program parameters when a preset time is reached.

[0196] Alternatively, before the preset time is reached, in response to a countdown cancellation operation, the countdown can be stopped; in response to a modification of the program parameters, the steam oven can be controlled to execute the program based on the modified program parameters.

[0197] In one possible embodiment, the above-described apparatus further includes: a retrieval module 407, a generation module 408, and an update module 409;

[0198] Module 407 is used to retrieve the basic parameters corresponding to the program identifier;

[0199] The recognition module 402 is also used to identify the attributes of an item placed on the accessory from the intracavitary image;

[0200] Generation module 408 is used to generate parameter correction values ​​based on the item's attributes;

[0201] The update module 409 is used to update the basic parameters based on the parameter correction value to obtain the program parameters.

[0202] In one possible embodiment, the display module 406 is further configured to display a manual selection interface on the display screen of the steam oven when the accessory type is not identified or the confidence level does not meet the preset conditions; the manual selection interface includes at least one program that can be manually selected by the user.

[0203] In one possible embodiment, the control module 403 is also configured to control the steam oven to enter a sleep state if no accessory is detected or no items are placed on the accessory.

[0204] The control device for the steam oven provided in this embodiment can execute the method provided in the above-described method embodiment. Its implementation principle and technical effect are similar, and will not be described in detail here.

[0205] Figure 5 A schematic diagram of the structure of the electronic device provided in this application. Figure 5 As shown, the electronic device 50 provided in this embodiment includes at least one processor 501 and a memory 502. Optionally, the electronic device 50 further includes a communication component 503. The processor 501, memory 502, and communication component 503 are connected via a bus 504.

[0206] In the specific implementation process, at least one processor 501 executes computer execution instructions stored in memory 502, causing at least one processor 501 to execute the above-described control method for the steam oven.

[0207] The specific implementation process of processor 501 can be found in the above method embodiments, and its implementation principle and technical effect are similar. It will not be repeated here.

[0208] In the above embodiments, it should be understood that the processor can be a Central Processing Unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), etc. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the method disclosed in this invention can be directly implemented by a hardware processor, or implemented by a combination of hardware and software modules within the processor.

[0209] The memory may include random access memory (RAM) and may also include non-volatile memory (NVM), such as at least one disk storage device.

[0210] The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. Buses can be categorized as address buses, data buses, control buses, etc. For ease of illustration, the buses shown in the accompanying drawings are not limited to a single bus or a single type of bus.

[0211] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the above-described control method for a steam oven.

[0212] This application also provides a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, implement the aforementioned control method for a steam oven.

[0213] The aforementioned readable storage medium can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk. The readable storage medium can be any available medium accessible to a general-purpose or special-purpose computer.

[0214] An exemplary readable storage medium is coupled to a processor, enabling the processor to read information from and write information to the readable storage medium. Of course, the readable storage medium can also be a component of the processor. The processor and the readable storage medium can reside in an Application Specific Integrated Circuit (ASIC). Alternatively, the processor and the readable storage medium can exist as discrete components in the device.

[0215] The division of units is merely a logical functional division; in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be indirect coupling or communication connection through some interfaces, devices, or units, and may be electrical, mechanical, or other forms.

[0216] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0217] In addition, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0218] If a function is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this invention, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of the various embodiments of this invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0219] Those skilled in the art will understand that all or part of the steps of the above-described method embodiments can be implemented by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When executed, the program performs the steps of the above-described method embodiments; and the aforementioned storage medium includes various media capable of storing program code, such as ROM, RAM, magnetic disks, or optical disks.

[0220] Finally, it should be noted that other embodiments of the invention will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This invention is intended to cover any variations, uses, or adaptations of the invention that follow the general principles of the invention and include common knowledge or customary techniques in the art not disclosed herein, and is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope.

Claims

1. A control method for a steam oven, characterized in that, include: In response to the closing signal of the oven door, an image of the interior of the oven is acquired; Based on the cavity image, identify the attachment type, confidence level of the attachment type, and placement status of the items inside the steam oven cavity; When the confidence level meets the preset conditions and the item placement status indicates that an item is placed on the accessory, the steam oven is controlled to execute a program that matches the accessory type.

2. The method according to claim 1, characterized in that, The step of identifying the attachment type, the confidence level of the attachment type, and the placement status of the items within the steam oven cavity based on the cavity image includes: The intracavitary image is input into a pre-trained intelligent decision-making model, which performs multi-task reasoning on the intracavitary image to obtain the attachment type, the confidence level of the attachment type, and the placement status of the item. The item placement status is used to indicate whether an item is placed on the accessory.

3. The method according to claim 2, characterized in that, When the confidence level meets a preset condition and the item placement status indicates that an item is placed on the accessory, controlling the steam oven to execute a program matching the accessory type includes: When the confidence level meets the preset conditions and the item placement status indicates that an item is placed on the accessory, the intelligent decision-making model outputs a program identifier that matches the accessory type. Control the steam oven to execute the program corresponding to the program identifier.

4. The method according to any one of claims 1-3, characterized in that, The method further includes: The program interface of the program is displayed on the screen of the steam oven. The program interface includes at least the program execution mode and program parameters.

5. The method according to claim 4, characterized in that, Before the control of the steam oven to execute a program matching the accessory type, the program interface also includes a start countdown; the start countdown is used to prompt the program to start after a preset time.

6. The method according to claim 5, characterized in that, The control of the steam oven to execute a program matching the accessory type includes: When the preset time is reached, the steam oven is controlled to execute the program based on the program parameters; Alternatively, before the preset duration is reached, in response to a countdown cancellation operation, the countdown is stopped, and in response to a modification operation of the program parameters, the steam oven is controlled to execute the program based on the modified program parameters.

7. The method according to claim 3, characterized in that, The control of the steam oven to execute the corresponding program according to the program identifier includes: Retrieve the basic parameters corresponding to the program identifier; Identify the properties of the item placed on the accessory from the intracavitary image; Based on the attributes of the item, generate parameter correction values; Based on the parameter correction value, the basic parameters are updated to obtain the program parameters.

8. The method according to any one of claims 1-3, characterized in that, The method further includes: If the accessory type is not identified or the confidence level does not meet the preset conditions, a manual selection interface is displayed on the display screen of the steam oven; the manual selection interface includes at least one program that can be manually selected by the user.

9. The method according to any one of claims 1-3, characterized in that, The method further includes: If no attachment is detected or no items are placed on the attachment, the steam oven is controlled to enter a sleep state.

10. A control device for a steam oven, characterized in that, include: The acquisition module is used to acquire images inside the steam oven cavity in response to the closing signal of the oven door; The identification module is used to identify the attachment type, the confidence level of the attachment type, and the placement status of the items in the cavity of the steam oven based on the cavity image. The control module is used to control the steam oven to execute a program that matches the type of the accessory when the confidence level meets a preset condition and the item placement status indicates that an item is placed on the accessory.

11. An electronic device, characterized in that, include: Memory, processor; The memory stores computer-executed instructions; The processor executes computer execution instructions stored in the memory, causing the processor to perform the method as described in any one of claims 1-9.

12. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer-executable instructions, which, when executed by a processor, are used to implement the method as described in any one of claims 1-9.

Images