Menu recommendation method and device, electronic equipment and readable storage medium

Abstract

The invention provides a menu recommendation method and device, electronic equipment and a readable storage medium, the method is applied to a central control screen, and the method comprises the following steps: in response to a first trigger operation, determining existing household appliance kitchen ware information, food material information and the number of diners of the cooking; determining at least one recommended menu according to the diner number, the food material information and the household appliance kitchen ware information; displaying the at least one recommended menu and dining suggestions and menu matching suggestions associated with the at least one recommended menu; in response to the second trigger operation, determining cooking steps of the selected recommended menu and sequentially displaying the cooking steps; in the cooking process of the user, the current cooking step of the user is recognized, first voice prompt information is output, and the first voice prompt information is used for prompting the notes of the current cooking step and the next cooking step. According to the invention, detailed and efficient cooking guidance can be provided for the user, and the smart home experience is improved.

Description

Technical Field

[0001] The present invention belongs to the field of smart home technology, and in particular relates to a recipe recommendation method, device, electronic device and readable storage medium. Background Art

[0002] With the widespread popularity of the Internet of Things and smart home devices, people's demand for kitchen intelligence is getting higher and higher, and various kitchen equipment is becoming increasingly intelligent.

[0003] Current recipe recommendation programs usually retrieve health data and food data, and analyze these data to find recipes and appropriate foods suitable for each user in the family.

[0004] However, this method requires users to manually check what ingredients are available at home to determine what dishes to cook, and only start cooking after looking up tutorials, so it has a low level of intelligence. Summary of the invention

[0005] The embodiments of the present invention provide a recipe recommendation method, device, electronic device and readable storage medium, which can solve the problem that the existing recipe method has a low degree of intelligence and requires manual participation of users.

[0006] In a first aspect, the present application provides a recipe recommendation method, which is applied to a central control screen, and the method comprises:

[0007] In response to the first trigger operation, determining the existing household appliances and kitchenware information, food information and the number of diners for this cooking;

[0008] Determine at least one recommended recipe according to the number of diners, the food information and the home appliance and kitchenware information;

[0009] Displaying the at least one recommended recipe and dining suggestions and recipe pairing suggestions associated with the at least one recommended recipe;

[0010] In response to a second trigger operation, determining the cooking steps of the selected recommended recipe and displaying them in sequence;

[0011] During the cooking process of the user, the current cooking step of the user is identified and a first voice prompt information is output, wherein the first voice prompt information is used to prompt the precautions of the current cooking step and the next cooking step.

[0012] Optionally, the food information includes the type, quantity and shelf life of existing food, and the determining of existing home appliance kitchenware information, food information and the number of diners for this cooking in response to the first trigger operation includes:

[0013] In response to the first trigger operation, determining the home appliance information according to the home appliance information sent by the smart kitchen appliance and the preset non-smart kitchenware;

[0014] Determine the type, quantity and shelf life of the existing food based on the image of the existing food sent by the smart refrigerator;

[0015] The number of diners for the cooking is determined by a preset sensor.

[0016] Optionally, the food information includes the type, quantity and shelf life of existing food, and determining at least one recommended recipe according to the number of diners, the food information and the home appliance and kitchenware information includes:

[0017] Determine a plurality of optional recipes according to the number of diners, the types and quantities of the existing ingredients, and the information of the home appliances and kitchenware;

[0018] Determining cooking complexity, cleaning difficulty, and shelf life of ingredients required for cooking the plurality of optional recipes;

[0019] At least one optional recipe with a lower cooking complexity, a lower cleaning difficulty, and a shorter shelf life of ingredients required for cooking is used as the at least one recommended recipe.

[0020] Optionally, determining the cooking complexity, cleaning difficulty and shelf life of the ingredients of the plurality of optional recipes includes:

[0021] Determining the cooking complexity according to the cooking time and the number of cooking steps corresponding to the multiple optional recipes;

[0022] Determining the cleaning difficulty according to the number of kitchen utensils that need to be cleaned after cooking corresponding to the multiple optional recipes;

[0023] The shelf life of the ingredients required for cooking is determined according to the shelf life and storage time of each type of existing ingredients in the multiple optional recipes.

[0024] Optionally, the displaying of the at least one recommended recipe and dining suggestions and recipe pairing suggestions associated with the at least one recommended recipe includes:

[0025] Displaying the finished product picture, dish name, ingredients and seasonings required for cooking, and cooking time of the at least one recommended recipe through a first control on the first display interface;

[0026] Determine the meal suggestion and the recipe pairing suggestion according to the current time and the user's health condition acquired in advance;

[0027] The dining suggestion and the recipe pairing suggestion are displayed on the first display interface through a second control, and the second control is arranged around the first control.

[0028] Optionally, in response to the second trigger operation, determining the cooking steps of the selected recommended recipe and displaying them in sequence includes:

[0029] In response to the second triggering operation, determining the number of the selected recommended recipes;

[0030] When the number of the recipes is at least two, the display order of the selected recommended recipes is determined according to the cooking time of the selected recommended recipes.

[0031] Optionally, during the cooking process of the user, identifying the current cooking step of the user and outputting voice prompt information includes:

[0032] According to the user's actions and the state of the ingredients, identifying the user's current cooking step;

[0033] The precautions for the current cooking step and the next cooking step are outputted through the first voice prompt information.

[0034] Optionally, during the cooking process of the user, after identifying the cooking progress of the user and outputting voice prompt information, the method further includes:

[0035] When the user finishes the meal, a second voice prompt message is outputted, wherein the second voice prompt message is used to prompt the user to wash the household appliances that cannot be washed by the dishwasher or the household appliances that are not frequently used.

[0036] Optionally, before determining at least one recommended recipe according to the number of diners, the food information and the home appliance and kitchenware information, the method further includes:

[0037] Display preset special ingredients and output inquiry information, the special ingredients include ingredients that are prone to allergies or have special odors, and the inquiry information is used to determine whether there are any food taboos for diners;

[0038] In the case that a diner has a dietary restriction, an association relationship between the special food and the diner is generated.

[0039] In a second aspect, the present application provides a recipe recommendation device, which is applied to a central control screen, and the device includes:

[0040] A first determination module, configured to determine, in response to a first trigger operation, existing household appliances and kitchenware information, food material information, and the number of diners for this cooking;

[0041] A second determination module is used to determine at least one recommended recipe according to the number of diners, the food information and the home appliance and kitchenware information;

[0042] A display module, used for displaying the at least one recommended recipe and dining suggestions and recipe pairing suggestions associated with the at least one recommended recipe;

[0043] a third determining module, configured to determine, in response to the second triggering operation, the cooking steps of the selected recommended recipe and display them in sequence;

[0044] The processing module is used to identify the current cooking step of the user and output the first voice prompt information during the cooking process of the user, wherein the first voice prompt information is used to prompt the precautions of the current cooking step and the next cooking step.

[0045] In a third aspect, the present application provides an electronic device, comprising: a processor, a memory, and a computer program stored in the memory and executable on the processor, wherein the processor implements the above-mentioned recipe recommendation method when executing the program.

[0046] In a fourth aspect, the present application provides a readable storage medium, which, when instructions in the readable storage medium are executed by a processor of an electronic device, enables the electronic device to perform the above-mentioned recipe recommendation method.

[0047] In the embodiment of the present application, first, in response to the first trigger operation, the existing household appliance kitchenware information, ingredient information and the number of diners for this cooking are determined; secondly, at least one recommended recipe is determined based on the number of diners, ingredient information and household appliance kitchenware information; thirdly, at least one recommended recipe and at least one dining suggestion and recipe pairing suggestion associated with the recommended recipe are displayed; then, in response to the second trigger operation, the cooking steps of the selected recommended recipe are determined and displayed in sequence; finally, during the user's cooking process, the user's current cooking step is identified and the first voice prompt information is output, and the first voice prompt information is used to prompt the precautions of the current cooking step and the next cooking step. Through the above technical solution, recipes are recommended to users and the steps are broken down based on the number of diners, ingredient information and household appliance kitchenware information, so as to provide users with detailed and efficient cooking guidance without the need for manual operation by the user, thereby improving the smart home experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, a brief introduction will be given below to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0049] Figure 1 is a flowchart of the steps of a recipe recommendation method provided in an embodiment of the present application;

[0050] Figure 2 It is a flowchart of the specific steps of a recipe recommendation method provided in an embodiment of the present application;

[0051] Figure 3 is a schematic diagram of a display interface provided in an embodiment of the present application;

[0052] Figure 4 is a schematic diagram of another display interface provided in an embodiment of the present application;

[0053] Figure 5 is a flowchart of another recipe recommendation method provided by an embodiment of the present application;

[0054] Figure 6 is a structural diagram of a recipe recommendation device provided in an embodiment of the present application;

[0055] Figure 7 is a structural diagram of an electronic device provided in an embodiment of the present application;

[0056] Figure 8 It is a structural diagram of another electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0057] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0058] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0059] In the description of the present disclosure, unless otherwise specified, "multiple" means two or more than two, and other quantifiers are similar thereto; "at least one item", "one item or multiple items" or similar expressions refer to any combination of these items, including any combination of single items or plural items. For example, at least one item a can represent any number of a; for another example, one item or multiple items among a, b and c can represent: a, b, c, ab, ac, bc, or abc, where a, b, c can be single or multiple; "and / or" is a kind of description of the association relationship of associated objects, indicating that there can be three kinds of relationships, for example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " indicates that the associated objects before and after are in an "or" relationship.

[0060] Although operations or steps are described in a specific order in the drawings in the embodiments of the present disclosure, it should not be understood that it is required to perform these operations or steps in the specific order shown or in a serial order, or to perform all the operations or steps shown to obtain the desired results. In the embodiments of the present disclosure, these operations or steps can be performed in series; these operations or steps can also be performed in parallel; or some of these operations or steps can be performed.

[0061] With the development of science and technology, smart devices are becoming more and more popular in people's lives. In order to control smart devices, each smart device is usually equipped with a corresponding smart home centralized control panel. When the user's home is large and there are many smart devices in the home, in order to control multiple smart devices, multiple control panels need to be equipped accordingly. However, there is a problem that the control panels of different smart devices are scattered and their functions are not centralized. In order to solve this problem, each room needs to be installed with a central control screen for controlling multiple smart devices.

[0062] For example, the central control screen can be applied to the Internet of Things in application scenarios such as smart home (home automation), smart home, smart home device ecology, and smart residential ecology.

[0063] For example, the central control screen can be a 4-inch voice-activated smart screen.

[0064] Exemplarily, the multiple smart devices controlled by the central control screen may include: smart air conditioners, smart range hoods, smart refrigerators, smart ovens, smart stoves, smart water heaters, smart dishwashers, smart TVs, smart sockets, smart steamers, smart microwave ovens, smart kitchen treasures, smart purifiers, smart water dispensers, smart cameras, etc.

[0065] Current recipe recommendation programs usually retrieve health data, weather data, and food data, and analyze these data to come up with recipes and appropriate foods suitable for each user in the family.

[0066] However, in a busy working life, users need to check the ingredients in the refrigerator when they get home from get off work every day to decide what dishes to cook, and only start cooking after looking up tutorials. If they encounter unfamiliar recipes, it will take longer and they will have to eat very late.

[0067] Therefore, the smart central control combined with the refrigerator can automatically generate recipes by reading ingredients and learning user preferences, and break down the cooking process for users, merge repetitive preparation and ingredient processing steps, simplify the cooking process, and allow users to calmly and quickly prepare a delicious meal.

[0068] In order to solve the above technical problems, the present application provides a recipe recommendation method, device, electronic device and readable storage medium, which recommend recipes and break down the steps for users based on the number of diners, food information and household appliance and kitchenware information, provide users with detailed and efficient cooking guidance without the need for manual operation by the user, and enhance the smart home experience.

[0069] Figure 1 is a flowchart of a recipe recommendation method provided in an embodiment of the present application, and the recipe recommendation method is applied to a central control screen, such as Figure 1 As shown, the method may include:

[0070] Step 101: In response to a first trigger operation, determine existing household appliance and kitchenware information, food information, and the number of diners for this cooking.

[0071] In the embodiment of the present application, the first trigger operation may be a click operation, or the first trigger operation may be a touch operation, and the present application does not make any specific limitation on this.

[0072] In the embodiment of the present application, the existing household appliances and kitchenware information may include: existing intelligent kitchen appliances and existing non-intelligent kitchen appliances. For example, intelligent kitchen appliances may include: intelligent ovens, intelligent stoves, intelligent steamers, intelligent microwave ovens, intelligent kitchen appliances, etc.

[0073] In an embodiment of the present application, the existing food information may include: the type, quantity and shelf life of the existing food.

[0074] In an embodiment of the present application, the number of diners for this cooking can be determined by a human body sensor pre-set on the central control screen, or the number of diners for this cooking can be manually input by the user.

[0075] Step 102: Determine at least one recommended recipe based on the number of diners, food information, and home appliance and kitchenware information.

[0076] It is understandable that there is a corresponding relationship between the number of diners and the amount of food in the recommended menu. Considering the different dining situations of different families, it is necessary to determine the amount of food to be planned for each meal according to the number of diners. In some embodiments, step 102 may include: determining the recommended amount of food according to the number of diners, and determining at least one recommended menu according to the recommended amount of food. Through the above technical solution, when making a recipe recommendation, the number of specifically recommended recipes can be limited to the recommended amount of food, so that the recipe recommendation can be more in line with the actual situation of the family, avoiding waste caused by insufficient or excessive amounts of food.

[0077] Optionally, the number of diners can be set in advance by the user, the number of diners can be obtained through a human body sensor built into the central control screen, or the number of diners can be manually input by the user on the central control screen.

[0078] In other embodiments, step 102 may also include: determining at least one recommended recipe based on the number of diners, the personal appetite selected by the user, the food information, and the home appliance and kitchenware information. The personal appetite can be used to reflect the appetite of each person who needs to dine, and the personal appetite can be obtained by the user clicking on the preset appetite size option on the central control screen. For example, the central control screen can display the appetite size options such as "small", "normal", and "large", and determine the personal appetite of different diners in response to the user's click operation.

[0079] For example, some families may have three people, two adults and one child, and dinner may generally consist of two to three dishes; some families may have four generations living together, with a large number of people, and dinner may require three meat dishes, two vegetable dishes and a large pot of soup; some users may live alone, and only need a combination of meat and vegetables. For those in the family with larger or smaller appetites, the amount of each meal can be adjusted as appropriate based on the amount determined according to the number of diners.

[0080] It can be understood that there is a corresponding relationship between the home appliance kitchen utensil information and the cooking method of the recipe. For example, for the steamed crab recipe, the steamer has the equipment capability to complete the steamed crab recipe, while the frying pan does not have the equipment capability to execute the steamed crab recipe, that is, the steamed crab recipe and the steamer are in a corresponding relationship. In addition, the corresponding relationship between the home appliance kitchen utensil information and the cooking method of the recipe can also be understood as the recipe can be executed by the home appliance kitchen utensil information corresponding to the recipe to complete the cooking. For example, the vegetable recipe can be cooked using the frying pan home appliance kitchen utensil information when stir-frying.

[0081] In other embodiments, step 102 may also include: determining a plurality of optional recipes according to the number of diners, food information, and household appliance and kitchenware information; and selecting at least one recommended recipe from the plurality of optional recipes according to the priorities of the plurality of optional recipes.

[0082] Optionally, the priorities of the multiple optional recipes may be obtained based on cooking complexity, cleaning difficulty, and shelf life of the ingredients used.

[0083] Step 103: display at least one recommended recipe and dining suggestions and recipe pairing suggestions associated with at least one recommended recipe.

[0084] In the embodiment of the present application, the recommended recipes are associated with the dining suggestions and the recipe pairing suggestions, respectively, and the associations may be pre-set.

[0085] In some embodiments, step 103 may include: determining dining suggestions and recipe pairing suggestions based on the current time, the current season, the user, and the pre-acquired user's physical health status.

[0086] In an embodiment of the present application, dining suggestions and recipe pairing suggestions may be obtained through a cloud server, dining suggestions and recipe pairing suggestions may also be obtained from other devices, and dining suggestions and recipe pairing suggestions may also be obtained by analyzing the ingredients and seasonings required for cooking.

[0087] In some embodiments, the meal suggestion is used to indicate the nutritional components of the recommended recipes, and the recipe pairing suggestion is used to indicate the dietary taboo information of the recommended recipes. Optionally, the nutritional components include protein, fat, carbohydrates, sodium, calcium, etc., and the dietary taboo information includes dietary taboo ingredients.

[0088] In other embodiments, the meal suggestion is used to indicate the season when the recommended recipe is suitable for consumption, and the recipe pairing suggestion is used to indicate the ingredients that pair with the recommended recipe.

[0089] Step 104: In response to the second trigger operation, the cooking steps of the selected recommended recipe are determined and displayed in sequence.

[0090] In the embodiment of the present application, the second trigger operation may be a click operation, or a touch operation, and the present application does not make any specific limitation on this.

[0091] In the embodiment of the present application, each cooking step can be broken down according to the selected refinement, and the processing methods and cooking forms of the ingredients that need to be prepared for all recipes can be displayed in sequence.

[0092] In some embodiments, step 104 may include: in response to the second trigger operation, determining a selected recommended recipe; splitting the cooking step sequence of the selected recommended recipe and displaying each cooking step in sequence.

[0093] Optionally, the cooking steps also include preparation steps, and step 104 may further include: combining and displaying the preparation steps for the same type of ingredients in different selected recommended recipes.

[0094] Step 105: During the cooking process of the user, identify the user's current cooking step and output a first voice prompt message.

[0095] In an embodiment of the present application, the first voice prompt information is used to prompt the precautions for the current cooking step and the next cooking step.

[0096] In a possible implementation, a camera is provided on the central control screen, and the identification of the user's current cooking step in step 105 can be obtained based on a pre-trained video recognition model. For example, the video recognition model is a deep learning model, which recognizes the user's actions and behaviors in combination with the appearance changes of the food. For another example, the video recognition model is an artificial intelligence (AI) model, based on which it can be determined whether the food is in a certain cooking stage, and then the current cooking step can be identified.

[0097] In another possible implementation, identifying the user's current cooking step in step 105 may include: estimating the approximate time required for each cooking step based on the characteristics of the ingredients used in each cooking step in the recipe and the video data of the camera.

[0098] In some embodiments, the first voice prompt information may include specific operation notes for the current cooking step in the recommended recipe. For example, the first voice prompt information is: Note that the kelp needs to be boiled and then removed and shredded.

[0099] In some embodiments, the first voice prompt information may also include specific operation content of the next cooking step. For example, the first voice prompt information is: add shredded winter melon and cook until the winter melon becomes transparent, add salt and sprinkle with chopped green onions.

[0100] In summary, the recipe recommendation method in the embodiment of the present application firstly determines the existing household appliance kitchenware information, ingredient information and the number of diners for this cooking in response to the first trigger operation; secondly, determines at least one recommended recipe based on the number of diners, ingredient information and household appliance kitchenware information; thirdly, displays at least one recommended recipe and dining suggestions and recipe pairing suggestions associated with at least one recommended recipe; then, in response to the second trigger operation, determines the cooking steps of the selected recommended recipe and displays them in sequence; finally, during the user's cooking process, identifies the user's current cooking step and outputs a first voice prompt message, which is used to prompt the precautions for the current cooking step and the next cooking step. Through the above technical solution, recipes are recommended to users and the steps are broken down based on the number of diners, ingredient information and household appliance kitchenware information, so as to provide users with detailed and efficient cooking guidance without the need for manual operation by the user, thereby improving the smart home experience.

[0101] Figure 2 is a flowchart of the specific steps of a recipe recommendation method provided in an embodiment of the present application. The recipe recommendation method is applied to the central control screen, such as Figure 2 As shown, the method may include:

[0102] Step 201: In response to a first trigger operation, determine existing household appliance and kitchenware information, food information, and the number of diners for this cooking.

[0103] The method of this step has been described in the aforementioned step 101 and will not be repeated here.

[0104] Optionally, step 201 includes:

[0105] Sub-step 2011, in response to the first trigger operation, the home appliance information sent by the smart kitchen appliance and the preset non-smart kitchenware, determining the home appliance and kitchenware information;

[0106] Sub-step 2012: determining the type, quantity and shelf life of the existing food according to the image of the existing food sent by the smart refrigerator;

[0107] Sub-step 2013: determining the number of diners for this cooking session through a preset sensor.

[0108] In some embodiments, sub-step 2011 may include: in response to the first trigger operation, the central control screen obtains the data of smart devices in the whole house, and the data of smart devices in the whole house is obtained after all smart appliances in the house are connected to the network through the home host; kitchen appliance information is extracted from the data of smart devices in the whole house to obtain smart kitchen appliances.

[0109] Optionally, users can input purchased smart kitchen appliances or non-smart kitchen appliances through the central control screen.

[0110] In some embodiments, the recipe recommendation method may further include: if the selected recipe requires a cookware that is not saved in the home appliance kitchenware information, outputting a prompt message, the prompt message being used to remind the user whether to add the unsaved cookware to the home appliance kitchenware information.

[0111] Optionally, the non-intelligent kitchenware can be assumed to be available at home by the user, the non-intelligent kitchenware can also be obtained by improving the recipes selected by the user, or the non-intelligent kitchenware can be pre-set by the user. For example, the non-intelligent kitchenware includes a wok, a steamer, etc., which are assumed to be available at home by the user; for another example, the non-intelligent kitchenware includes special pots such as a casserole pot, which can be improved according to the recipes selected by the user later.

[0112] In some embodiments, before sub-step 2012, the above-mentioned recipe recommendation method may also include: the smart refrigerator reads the current food image through the built-in camera and uploads it to the central control screen; correspondingly, sub-step 2011 may include: the central control screen recognizes the type of food according to the image; calculates the volume of the food according to the size of the drawers and shelves in the smart refrigerator; estimates the amount of the food according to the type and density of the food, wherein the size of the drawers and shelves in the smart refrigerator is sent to the central control screen by the smart refrigerator.

[0113] In other embodiments, before sub-step 2012, the above-mentioned recipe recommendation method may also include: the smart refrigerator recognizes the type of ingredients through images using a camera; and notes the shelf life according to the type of ingredients.

[0114] In some embodiments, sub-step 2013 may include: determining the number of diners for this cooking session through a human body sensor built into the central control screen.

[0115] Optionally, the number of diners for this cooking may be a common number of diners preset by the user, or the number of diners for this cooking may be manually input by the user.

[0116] Step 202: Determine a plurality of optional recipes based on the number of diners, types and quantities of existing ingredients, and information about home appliances and kitchenware.

[0117] In some embodiments, step 102 may include: determining the recommended amount of food based on the number of diners, and determining a first recipe that matches the recommended amount of food based on the recommended amount of food; determining a second recipe that matches the cooking method based on the correspondence between the home appliance kitchenware information and the cooking method of the recipe; determining a matching third recipe based on the type and amount of existing ingredients; and using the intersection of the first recipe, the second recipe, and the third recipe as multiple optional recipes.

[0118] In an embodiment of the present application, multiple optional recipes can also be determined based on user preferences, and the user preferences are obtained by inputting historical recipe data into a pre-trained deep learning model.

[0119] In some embodiments, step 102 may include: determining a plurality of user preferred recipes based on historical recipe data, and selecting a plurality of optional recipes from the plurality of user preferred recipes based on the number of diners, types and quantities of existing ingredients, and information about home appliances and kitchenware.

[0120] In a possible implementation, historical recipe data can be obtained in the following way:

[0121] Obtain historical recipe data for each time period, wherein the historical recipe data includes the diners and the selected recipes for each cooking session. Based on the historical recipe data, obtain the number of diners and recipe selection preferences corresponding to a specified time node, wherein the specified time node includes special holidays or weekends.

[0122] In other embodiments, the historical recipe data also includes the user's cooking techniques and cuisine preferences, and the above-mentioned recipe recommendation method may also include: inputting the cooking techniques and cuisine preferences into the deep learning model to obtain at least one recommended recipe as output, wherein the cooking techniques and cuisine preferences include less seasoning, simpler steps to save time, or a preference for steaming or stir-frying.

[0123] Optionally, before step 202, the recipe recommendation method further includes:

[0124] Sub-step A1: displaying preset special ingredients and outputting inquiry information;

[0125] Sub-step A2: in the case where there are diners who have dietary taboos, generating an association relationship between special ingredients and diners.

[0126] In an embodiment of the present application, special ingredients include ingredients that are prone to allergies or have special odors, for example, special ingredients include coriander, onions, etc.

[0127] In the embodiment of the present application, the inquiry information is used to determine whether the diners have dietary taboos. For example, the inquiry information may be a voice inquiry information of "Excuse me, do you not eat coriander?"

[0128] In a possible implementation, the above-mentioned recipe recommendation method also includes: assigning an identity ID to the diner, and sub-step A2 may include: in the event that the diner has a dietary aversion, recording the special ingredients in the diner's dietary information, and generating an association relationship between the special ingredients and the diner's ID.

[0129] Step 203: Determine the cooking complexity, cleaning difficulty and shelf life of ingredients required for cooking of multiple optional recipes.

[0130] In the embodiment of the present application, the recipe recommendation priority conditions can be set, and recipes with lower cooking complexity have higher priority, recipes with lower cleaning difficulty have higher priority, and recipes with shorter shelf life of ingredients required for cooking have higher priority.

[0131] Understandably, priority is given to recipes that are quicker and easier to cook, recipes that are easier to clean appliances, pots, and cutlery after cooking, and ingredients that can be stored longer and have a shorter shelf life.

[0132] In a possible implementation, the cleaning difficulty may be determined based on whether the utensils can be cleaned in a dishwasher. Step 203 may include: dividing the kitchen utensils that need to be cleaned after cooking into dishwasher cleaning and manual cleaning; the greater the proportion of dishwasher cleaning, the lower the cleaning difficulty.

[0133] Exemplarily, all appliances that can be put into a dishwasher for cleaning are considered to have the lowest cleaning difficulty, and the cleaning difficulty is then increased in sequence according to the difficulty and number of kitchen appliances and utensils that need to be cleaned manually.

[0134] In another possible implementation, the cleaning difficulty also needs to take into account the capacity of the dishwasher, and a recipe in which the number of kitchen utensils to be washed after cooking is less than or equal to the capacity of the dishwasher has a higher priority than a recipe in which the number of kitchen utensils to be washed after cooking is greater than the capacity of the dishwasher.

[0135] Optionally, step 203 includes:

[0136] Sub-step 2031: determining the cooking complexity according to the cooking time and the number of cooking steps corresponding to the multiple optional recipes;

[0137] Sub-step 2032: determining the cleaning difficulty according to the number of kitchen utensils that need to be cleaned after cooking corresponding to the multiple optional recipes;

[0138] Sub-step 2033: Determine the shelf life of the ingredients required for cooking according to the shelf life and storage time of each type of existing ingredients in the multiple optional recipes.

[0139] For example, the shorter the cooking time, the fewer the number of cooking steps, and the lower the cooking complexity; the fewer kitchen utensils that need to be cleaned after cooking, and the easier it is to clean; the shorter the shelf life of each type of existing ingredients, the longer the storage time, and the shorter the shelf life of the ingredients needed for cooking.

[0140] Step 204: select at least one optional recipe with a lower cooking complexity, a lower cleaning difficulty, and a shorter shelf life of ingredients required for cooking as at least one recommended recipe.

[0141] Exemplarily, the recipe with the shortest cooking time and the least number of cooking steps is selected from multiple optional recipes as the first recommended recipe; the recipe with the least number of kitchen utensils to be cleaned after cooking is selected from the first recommended recipe as the second recommended recipe; and the recipe with the shorter shelf life and the longer storage time of each type of existing ingredients is selected from the first recommended recipe as at least one recommended recipe.

[0142] Step 205: Displaying a finished product picture, dish name, ingredients required for cooking, seasonings, and cooking time of at least one recommended recipe on the first display interface through a first control.

[0143] In an embodiment of the present application, the finished product picture, dish name, ingredients required for cooking, seasoning and cooking time of the recommended recipe may be pre-stored in the memory of the central control screen.

[0144] For example, see Figure 3 When the recommended recipe is grilled yellow eel, the first display interface displays the product picture and dish name through the first control, and displays the ingredients required for cooking as wild yellow eel, onion, pepper, ginger, garlic, and the seasonings as oyster sauce, lard, dark soy sauce, and salad oil, and the cooking time is 30 minutes.

[0145] Step 206: Determine meal suggestions and recipe pairing suggestions based on the current time and the user's health status acquired in advance.

[0146] In an embodiment of the present application, dining suggestions and recipe pairing suggestions may be obtained through a cloud server, dining suggestions and recipe pairing suggestions may also be obtained from other devices, and dining suggestions and recipe pairing suggestions may also be obtained by analyzing the ingredients and seasonings required for cooking.

[0147] In some embodiments, the meal suggestion is used to indicate the nutritional components of the recommended recipes, and the recipe pairing suggestion is used to indicate the dietary taboo information of the recommended recipes. Optionally, the nutritional components include protein, fat, carbohydrates, sodium, calcium, etc., and the dietary taboo information includes dietary taboo ingredients.

[0148] For example, see Figure 3 When the recommended recipe is grilled eel, the dining suggestion can be high in purine, and the recipe pairing suggestion can be do not eat it with spinach.

[0149] In other embodiments, the meal suggestion is used to indicate the season when the recommended recipe is suitable for consumption, and the recipe pairing suggestion is used to indicate the ingredients that pair with the recommended recipe.

[0150] For example, see Figure 4 When the recommended recipe is beef stew with potatoes, the recipe pairing suggestion may be to recommend eating it with rice. When the recommended recipe is Tremella and Lotus Seed Soup, the meal suggestion may be that it is suitable for autumn consumption.

[0151] Step 207: Display dining suggestions and recipe pairing suggestions on the first display interface through a second control.

[0152] For example, see Figure 3 When the recommended recipe is grilled yellow eel, the second control is used to display on the first display interface that the meal suggestion is high in purine, and the recipe pairing suggestion is not to eat it with spinach.

[0153] Step 208: In response to the second trigger operation, the cooking steps of the selected recommended recipe are determined and displayed in sequence.

[0154] In the embodiment of the present application, each cooking step can be broken down according to the selected refinement, and the processing methods and cooking forms of the ingredients that need to be prepared for all recipes can be displayed in sequence.

[0155] Optionally, the cooking steps also include preparation steps, and step 208 may include: combining and displaying the preparation steps for the same type of ingredients in different selected recommended recipes.

[0156] Optionally, after step 207, the recipe recommendation method further includes:

[0157] Sub-step 2081: In response to the second trigger operation, determining the number of selected recommended recipes;

[0158] Sub-step 2082: When there are at least two recipes, determine the display order of the selected recommended recipes according to the cooking time of the selected recommended recipes.

[0159] Optionally, sub-step 2082 includes: when the number of recipes is at least two, first displaying the recommended recipes with longer cooking times, and then displaying the recommended recipes with shorter cooking times.

[0160] It is understandable that you should cook the time-consuming dishes first, put the dishes that can be made simply and quickly at the end, and arrange the preparations for the next dish during the long waiting period. This can arrange time reasonably and efficiently, merge and simplify repetitive steps, and gradually plan all processes and sequences.

[0161] Step 209: During the cooking process of the user, identify the user's current cooking step and output voice prompt information.

[0162] In the embodiment of the present application, the voice prompt is used to prompt the precautions of the current cooking step and the next cooking step.

[0163] In an embodiment of the present application, the user's current cooking step can be identified through the camera built into the central control screen.

[0164] Optionally, step 209 includes:

[0165] Sub-step 2091: identifying the user's current cooking step according to the user's action and the state of the food;

[0166] Sub-step 2092: outputting the precautions for the current cooking step and the next cooking step through the first voice prompt information.

[0167] In one possible implementation, sub-step 2091 includes: acquiring the user's operation video stream in real time, and identifying the user's actions and food status based on the video stream, wherein the user's actions include cutting vegetables, stir-frying, boiling, etc., and the food status includes softening vegetables, color changes of ingredients, and the liquid status in the pot.

[0168] Optionally, the AI ​​model can identify the user's actions and behaviors through a deep learning model, combined with the changes in the appearance of the food, to determine whether the food is in a specific cooking stage. For example, the deep learning model is a model that combines a deep neural network model (Convolutional Neural Networks, CNN) with a recurrent neural network (Recurrent Neural Network, RNN), and the specific cooking stage can be heating, stir-frying, boiling, stewing, etc.

[0169] Optionally, the approximate time required for each cooking step is estimated based on the characteristics of the ingredients used in each cooking step in the recipe and the video data from the camera.

[0170] In a possible implementation, after sub-step 2091, the recipe recommendation method may further include: sending a control instruction to the smart kitchen appliance in the kitchen according to the current cooking step of the user, where the control instruction is obtained according to the next cooking step. For example, after the user finishes preparing the food, the range hood and kitchen air conditioner are turned on in advance, and the countertop lighting is adjusted.

[0171] In a possible implementation, after sub-step 2092, the recipe recommendation method may further include: when it is identified that the ingredients are not turned over in time and are overcooked, outputting a third voice prompt message, wherein the third voice prompt message is used to suggest the user to adjust the firepower or action.

[0172] Optionally, after step 209, the recipe recommendation method further includes:

[0173] Sub-step 210: When the user has finished eating, output a second voice prompt message.

[0174] In the embodiment of the present application, the second voice prompt information is used to prompt the user to clean household appliances that cannot be cleaned by a dishwasher or household appliances that are not frequently used.

[0175] Exemplarily, the usage frequency of home appliances is calculated based on the recipes selected by the user, and home appliances with a usage frequency below a frequency threshold are set as infrequently used home appliances. The frequency threshold may be once a week or once a month and can be adjusted as needed.

[0176] In some embodiments, after step 209, the recipe recommendation method further includes: when cooking is completed, updating the historical recipe data according to the diners of the cooking and the selected recommended recipes.

[0177] It is understandable that the above recipe recommendation method simplifies or improves the recipes according to the user's cooking proficiency and time consumption.

[0178] For example, as more user data and use cases are accumulated, the model can be continuously optimized and updated to make the recognition more accurate and adapt to different kitchen environments, ingredients and user habits. Combining the visual information of the camera with the data of sensors such as temperature and humidity can more accurately identify the progress of food. The cooking progress can be fed back to the user in real time through voice assistants, mobile applications (Application, App), smart displays, etc. Users can also customize recipes through the smart home platform, adjust the progress according to the user's settings, and continuously adjust the cooking process based on visual and sensor data.

[0179] To sum up, the recipe recommendation method in the embodiment of the present application combines a refrigerator and various kitchen appliances to form a home smart cooking system. According to the existing ingredients and household kitchen appliances, various recipes are generated for users to choose from, and each cooking step is broken down into details, and repeated and redundant steps are combined and simplified to provide users with detailed and efficient cooking guidance.

[0180] Figure 5 is a flowchart of another recipe recommendation method provided in an embodiment of the present application. Figure 5 As shown, the method may include:

[0181] Step 301: Generate an intelligent cooking system based on existing household appliances and kitchenware information.

[0182] Step 302: Determine the type and quantity of the existing ingredients based on the ingredient pictures.

[0183] Step 303: In response to the user clicking on the "Smart Kitchen" card on the homepage of the central control screen, the smart kitchen page is displayed.

[0184] Step 304: In response to the user selecting “recipe recommendation”, at least one recommended recipe is determined and displayed based on the number of diners, ingredient information, and user preference.

[0185] Step 305: In response to the user selecting a recipe, the cooking steps of the selected recommended recipe are determined and displayed in sequence.

[0186] Step 306: During the cooking process of the user, identify the current cooking step of the user and output a first voice prompt message.

[0187] In an embodiment of the present application, the first voice prompt information is used to prompt the precautions for the current cooking step and the next cooking step.

[0188] Step 307: When cooking is completed, update the user preference according to the historical recipe data.

[0189] To sum up, the recipe recommendation method in the embodiment of the present application collects information on ingredients, home appliances, cookware, etc. in the home, and aggregates it to the central control to form a home smart cooking system. At the same time, it learns the user's dietary and cooking preferences, recommends recipes to the user and breaks down the steps, simplifies the recipe tutorial, and allows users to complete cooking more quickly and efficiently and enjoy delicious food, providing a more convenient smart home experience that is more in line with user preferences.

[0190] Figure 6 is a structural diagram of a recipe recommendation device provided in an embodiment of the present application. The recipe recommendation device 500 is applied to a central control screen. The recipe recommendation device 500 may include:

[0191] The first determination module 501 is used to determine the existing home appliance kitchenware information, food information and the number of diners for this cooking in response to the first trigger operation;

[0192] The second determining module 502 is used to determine at least one recommended recipe according to the number of diners, food information and home appliance and kitchenware information;

[0193] A display module 503, for displaying at least one recommended recipe and dining suggestions and recipe pairing suggestions associated with at least one recommended recipe;

[0194] A third determining module 504, for determining the cooking steps of the selected recommended recipe and displaying them in sequence in response to the second triggering operation;

[0195] The processing module 505 is used to identify the user's current cooking step and output a first voice prompt message during the user's cooking process. The first voice prompt message is used to prompt the precautions of the current cooking step and the next cooking step.

[0196] Optionally, the food information includes the type, quantity and shelf life of the existing food. The first determination module 501 includes:

[0197] A first determination submodule, configured to determine the home appliance and kitchenware information in response to a first trigger operation according to the home appliance information sent by the smart kitchen appliance and the preset non-smart kitchenware;

[0198] The second determination submodule is used to determine the type, quantity and shelf life of the existing food according to the existing food image sent by the smart refrigerator;

[0199] The third determination submodule is used to determine the number of diners for this cooking through a preset sensor.

[0200] Optionally, the food information includes the type, quantity and shelf life of the existing food. The second determination module 502 includes:

[0201] The fourth determination submodule is used to determine a plurality of optional recipes according to the number of diners, the types and quantities of existing ingredients, and information about home appliances and kitchen utensils;

[0202] A fifth determination submodule, for determining the cooking complexity, cleaning difficulty and shelf life of ingredients required for cooking of a plurality of optional recipes;

[0203] The recipe selection submodule is used to select at least one optional recipe with lower cooking complexity, lower cleaning difficulty and shorter shelf life of ingredients required for cooking as at least one recommended recipe.

[0204] Optionally, the fifth determining submodule includes:

[0205] A first determining unit, configured to determine a cooking complexity according to a cooking time and a number of cooking steps corresponding to a plurality of optional recipes;

[0206] A second determining unit is used to determine the cleaning difficulty according to the number of kitchen utensils that need to be cleaned after cooking corresponding to the multiple optional recipes;

[0207] The third determining unit is used to determine the shelf life of the ingredients required for cooking according to the shelf life and storage time of each type of existing ingredients in the multiple optional recipes.

[0208] Optionally, the display module 503 includes:

[0209] A first display submodule, configured to display a finished product image, dish name, ingredients required for cooking, seasonings, and cooking time of at least one recommended recipe through a first control on a first display interface;

[0210] Determine meal suggestions and recipe pairing suggestions based on the current time and the user's health status acquired in advance;

[0211] The second display submodule is used to display dining suggestions and recipe pairing suggestions through a second control on the first display interface, and the second control is arranged around the first control.

[0212] Optionally, the third determining module 504 includes:

[0213] a sixth determining submodule, configured to determine the number of selected recommended recipes in response to the second triggering operation;

[0214] The seventh determination submodule is used to determine the display order of the selected recommended recipes according to the cooking time of the recommended recipes when the number of recipes is at least two.

[0215] Optionally, the processing module 505 includes:

[0216] The recognition submodule is used to recognize the user's current cooking step according to the user's actions and the state of the ingredients;

[0217] The output submodule is used to output the precautions of the current cooking step and the next cooking step through the first voice prompt information.

[0218] Optionally, the recipe recommendation device 500 further includes:

[0219] The prompt module is used to output a second voice prompt message when the user has finished eating. The second voice prompt message is used to prompt the user to clean household appliances that cannot be cleaned by a dishwasher or household appliances that are not often used.

[0220] Optionally, the recipe recommendation device 500 further includes:

[0221] The inquiry module is used to display preset special ingredients and output inquiry information. Special ingredients include ingredients that are prone to allergies or have special odors. The inquiry information is used to determine whether there are any food taboos for diners;

[0222] The generation module is used to generate the association relationship between special ingredients and diners when there are diners who have dietary taboos.

[0223] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0224] The present application also provides an electronic device, see Figure 7 , the electronic device 700 may include one or more of the following components: a processing component 702 , a memory 704 , a power component 706 , a multimedia component 708 , an audio component 710 , an input / output (I / O) interface 712 , a sensor component 714 , and a communication component 716 .

[0225] The processing component 702 generally controls the overall operation of the electronic device 700, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 702 may include one or more processors 720 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 702 may include one or more modules to facilitate the interaction between the processing component 702 and other components. For example, the processing component 702 may include a multimedia module to facilitate the interaction between the multimedia component 708 and the processing component 702.

[0226] The memory 704 is used to store various types of data to support operations on the electronic device 700. Examples of such data include instructions for any application or method operating on the electronic device 700, contact data, phone book data, messages, pictures, multimedia, etc. The memory 704 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0227] The power supply component 706 provides power to the various components of the electronic device 700. The power supply component 706 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device 700.

[0228] The multimedia component 708 includes an interface that provides an output interface between the electronic device 700 and the user. In some embodiments, the interface may include a liquid crystal display (LCD) and a touch panel (TP). If the interface includes a touch panel, the interface may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 708 includes a front camera and / or a rear camera. When the electronic device 700 is in an operating mode, such as a shooting mode or a multimedia mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0229] The audio component 710 is used to output and / or input audio signals. For example, the audio component 710 includes a microphone (MIC), and when the electronic device 700 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is used to receive an external audio signal. The received audio signal can be further stored in the memory 704 or sent via the communication component 716. In some embodiments, the audio component 710 also includes a speaker for outputting audio signals.

[0230] The input / output I / O interface 712 provides an interface between the processing component 702 and the peripheral interface module, which may be a keyboard, a click wheel, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0231] The sensor assembly 714 includes one or more sensors for providing various aspects of status assessment for the electronic device 700. For example, the sensor assembly 714 can detect the open / closed state of the electronic device 700, the relative positioning of components, such as the display and keypad of the electronic device 700, and the sensor assembly 714 can also detect the position change of the electronic device 700 or a component of the electronic device 700, the presence or absence of user contact with the electronic device 700, the orientation or acceleration / deceleration of the electronic device 700, and the temperature change of the electronic device 700. The sensor assembly 714 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 714 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 714 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0232] The communication component 716 is used to facilitate wired or wireless communication between the electronic device 700 and other devices. The electronic device 700 can access a wireless network based on a communication standard, such as WiFi, a carrier network (such as 2G, 3G, 7G or 7G), or a combination thereof. In an exemplary embodiment, the communication component 716 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 716 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0233] In an exemplary embodiment, the electronic device 700 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to implement a recipe recommendation method provided in an embodiment of the present application.

[0234] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 704 including instructions, and the instructions can be executed by a processor 720 of an electronic device 700 to perform the above method. For example, the non-transitory storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0235] Figure 8 8 is a block diagram of an electronic device 800 according to another embodiment of the present invention. For example, the electronic device 800 may be provided as a server. Figure 8 The electronic device 800 includes a processing component 822, which further includes one or more processors, and a memory resource represented by a memory 832 for storing instructions executable by the processing component 822, such as an application. The application stored in the memory 832 may include one or more modules, each corresponding to a set of instructions. In addition, the processing component 822 is configured to execute instructions to perform a recipe recommendation method provided in an embodiment of the present application.

[0236] The electronic device 800 may also include a power supply component 826 configured to perform power management of the electronic device 800, a wired or wireless network interface 850 configured to connect the electronic device 800 to a network, and an input / output (I / O) interface 858. The electronic device 800 may operate based on an operating system stored in the memory 832, such as Windows Server TM, Mac OS X TM, Unix TM, Linux TM, Free BSD TM or the like.

[0237] In an embodiment of the present application, the memory 832 may be used to store software programs and various data. The memory 832 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instruction required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 832 may include a volatile memory or a non-volatile memory, or the memory 832 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 832 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0238] The processor may include one or more processing units; optionally, the processor integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to the operating system, user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor.

[0239] The present application also provides a readable storage medium. When the instructions in the readable storage medium are executed by a processor of an electronic device, the electronic device can execute the recipe recommendation method of the aforementioned embodiment.

[0240] An embodiment of the present application also provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned recipe recommendation method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0241] It should be noted that the various information and data obtained in the embodiments of the present application are obtained with the authorization of the information / data holder. All actions of obtaining signals, information or data in the present application are carried out in compliance with the relevant data protection laws and policies of the country of residence and with the authorization of the corresponding device owner.

[0242] The algorithm and display provided herein are not inherently related to any particular computer, virtual system or other device. Various general purpose systems can also be used together with the teachings based on this. According to the above description, it is obvious that the structure required for constructing such systems. In addition, the application is not directed to any specific programming language either. It should be understood that various programming languages ​​can be utilized to realize the content of the application described herein, and the description of the specific language above is for the purpose of disclosing the best mode of implementation of the application.

[0243] In the description provided herein, a large number of specific details are described. However, it is understood that the embodiments of the present application can be practiced without these specific details. In some instances, well-known methods, structures and techniques are not shown in detail so as not to obscure the understanding of this description.

[0244] Similarly, it should be understood that in order to streamline the present application and help understand one or more of the various inventive aspects, in the above description of the exemplary embodiments of the present application, the various features of the present application are sometimes grouped together into a single embodiment, figure, or description thereof. However, the disclosed method should not be interpreted as reflecting the following intention: the claimed application requires more features than the features clearly stated in each claim. More specifically, as reflected in the claims below, the inventive aspects are less than all the features of the single embodiment disclosed above. Therefore, the claims following the specific embodiment are hereby expressly incorporated into the specific embodiment, wherein each claim itself serves as a separate embodiment of the present application.

[0245] Those skilled in the art will appreciate that the modules in the devices in the embodiments may be adaptively changed and arranged in one or more devices different from the embodiments. The modules or units or components in the embodiments may be combined into one module or unit or component, and in addition they may be divided into a plurality of submodules or subunits or subcomponents. Except that at least some of such features and / or processes or units are mutually exclusive, all features disclosed in this specification (including the accompanying claims, abstracts and drawings) and all processes or units of any method or device disclosed in this manner may be combined in any combination. Unless otherwise expressly stated, each feature disclosed in this specification (including the accompanying claims, abstracts and drawings) may be replaced by an alternative feature providing the same, equivalent or similar purpose.

[0246] The various component embodiments of the present application can be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. It should be understood by those skilled in the art that a microprocessor or digital signal processor (DSP) can be used in practice to implement some or all functions of some or all components in the sorting device according to the present application. The present application can also be implemented as a device or apparatus program for executing part or all of the methods described herein. Such a program implementing the present application can be stored on a computer-readable medium, or can have the form of one or more signals. Such a signal can be downloaded from an Internet website, or provided on a carrier signal, or provided in any other form.

[0247] It should be noted that the above embodiments illustrate the present application rather than limit the present application, and that those skilled in the art may design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference symbol between brackets should not be constructed as a limitation to the claims. The word "comprising" does not exclude the presence of elements or steps not listed in the claims. The word "one" or "an" preceding an element does not exclude the presence of multiple such elements. The present application may be implemented by means of hardware including several different elements and by means of a suitably programmed computer. In a unit claim that lists several devices, several of these devices may be embodied by the same hardware item. The use of the words first, second, and third, etc. does not indicate any order. These words may be interpreted as names.

[0248] The user information (including but not limited to the user's device information, user personal information, etc.) and related data involved in this application are all information authorized by the user or by all parties.

[0249] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0250] The above is only a preferred embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present application shall be included in the protection scope of the present application. The above is only a specific implementation method of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be based on the protection scope of the claims.

Claims

1. A recipe recommendation method, characterized in that: Applied to the central control screen, the method includes: In response to the first trigger operation, determining existing household appliances and kitchenware information, food information, and the number of diners for this cooking; Determine at least one recommended recipe according to the number of diners, the food information and the home appliance and kitchenware information; Displaying the at least one recommended recipe and dining suggestions and recipe pairing suggestions associated with the at least one recommended recipe; In response to a second trigger operation, determining the cooking steps of the selected recommended recipe and displaying them in sequence; During the cooking process of the user, the current cooking step of the user is identified and a first voice prompt information is output, wherein the first voice prompt information is used to prompt the precautions of the current cooking step and the next cooking step.

2. The method according to claim 1, characterized in that The food information includes the type, quantity and shelf life of the existing food. The determining of the existing home appliance and kitchenware information, food information and the number of diners for this cooking in response to the first trigger operation includes: In response to the first trigger operation, determining the home appliance information according to the home appliance information sent by the smart kitchen appliance and the preset non-smart kitchenware; Determine the type, quantity and shelf life of the existing food based on the image of the existing food sent by the smart refrigerator; The number of diners for the cooking is determined by a preset sensor.

3. The method according to claim 1, characterized in that The food information includes the type, quantity and shelf life of the existing food. The determining of at least one recommended recipe according to the number of diners, the food information and the home appliance and kitchenware information includes: Determine a plurality of optional recipes according to the number of diners, the types and quantities of the existing ingredients, and the information of the home appliances and kitchenware; Determining cooking complexity, cleaning difficulty, and shelf life of ingredients required for cooking the plurality of optional recipes; At least one optional recipe with a lower cooking complexity, a lower cleaning difficulty, and a shorter shelf life of ingredients required for cooking is used as the at least one recommended recipe.

4. The method according to claim 3, characterized in that The determining of the cooking complexity, cleaning difficulty and shelf life of the ingredients of the plurality of optional recipes comprises: Determining the cooking complexity according to the cooking time and the number of cooking steps corresponding to the multiple optional recipes; Determining the cleaning difficulty according to the number of kitchen utensils that need to be cleaned after cooking corresponding to the multiple optional recipes; The shelf life of the ingredients required for cooking is determined according to the shelf life and storage time of each type of existing ingredients in the multiple optional recipes.

5. The method according to claim 1, characterized in that The displaying of the at least one recommended recipe and the dining suggestion and recipe pairing suggestion associated with the at least one recommended recipe includes: Displaying the finished product picture, dish name, ingredients and seasonings required for cooking, and cooking time of the at least one recommended recipe through a first control on the first display interface; Determine the meal suggestion and the recipe pairing suggestion according to the current time and the user's health condition acquired in advance; The dining suggestion and the recipe pairing suggestion are displayed on the first display interface through a second control, and the second control is arranged around the first control.

6. The method according to claim 1, characterized in that In response to the second trigger operation, determining the cooking steps of the selected recommended recipe and displaying them in sequence includes: In response to the second triggering operation, determining the number of the selected recommended recipes; When the number of the recipes is at least two, the display order of the selected recommended recipes is determined according to the cooking time of the selected recommended recipes.

7. The method according to claim 1, characterized in that During the cooking process of the user, identifying the current cooking step of the user and outputting voice prompt information includes: According to the user's actions and the state of the ingredients, identifying the user's current cooking step; The precautions for the current cooking step and the next cooking step are outputted through the first voice prompt information.

8. The method according to claim 1, characterized in that During the cooking process of the user, after identifying the cooking progress of the user and outputting voice prompt information, the method further includes: When the user finishes the meal, a second voice prompt message is outputted, wherein the second voice prompt message is used to prompt the user to wash the household appliances that cannot be washed by the dishwasher or the household appliances that are not frequently used.

9. The method according to claim 1, characterized in that: Before determining at least one recommended recipe according to the number of diners, the food information and the home appliance and kitchenware information, the method further includes: Display preset special ingredients and output inquiry information, the special ingredients include ingredients that are prone to allergies or have special odors, and the inquiry information is used to determine whether there are any food taboos for diners; In the case that a diner has a dietary restriction, an association relationship between the special food and the diner is generated.

10. A recipe recommendation device, characterized in that: Applied to the central control screen, the device includes: A first determination module, configured to determine, in response to a first trigger operation, existing household appliances and kitchenware information, food material information, and the number of diners for this cooking; A second determination module is used to determine at least one recommended recipe according to the number of diners, the food information and the home appliance and kitchenware information; A display module, used for displaying the at least one recommended recipe and dining suggestions and recipe pairing suggestions associated with the at least one recommended recipe; a third determining module, configured to determine, in response to the second triggering operation, the cooking steps of the selected recommended recipe and display them in sequence; The processing module is used to identify the current cooking step of the user and output the first voice prompt information during the cooking process of the user, wherein the first voice prompt information is used to prompt the precautions of the current cooking step and the next cooking step.

11. An electronic device, characterized in that: include: A processor, a memory, and a computer program stored in the memory and executable on the processor, wherein the processor implements the recipe recommendation method as described in any one of claims 1 to 9 when executing the program.

12. A readable storage medium, characterized in that: When the instructions or transactions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the recipe recommendation method according to any one of claims 1 to 9.

Images