Recipe management method and device, storage medium and electronic device

Abstract

This application discloses a recipe management method and device, storage medium, and electronic device, relating to the field of smart home technology. The recipe management method includes: upon determining that a custom recipe mode of a cooking device is enabled, identifying a target ingredient in the cooking device and receiving a cooking mode corresponding to the target ingredient from multiple cooking modes of the cooking device; during operation of the cooking mode, collecting first image information within the cooking device and determining cooking environment information collected by a sensor of a household appliance associated with the cooking device; and generating a target custom recipe and control parameters based on the target ingredient, the cooking mode, the first image information, and the cooking environment information. The above technical solution solves the problem of being unable to manage target custom recipes that are not preset recipes for cooking devices.

Description

Technical Field

[0001] The present application relates to the field of smart home technology, and more specifically, to a recipe management method and device, a storage medium, and an electronic device. Background Art

[0002] With the maturity and development of Internet of Things technology, smart cooking devices will recommend preset recipes to users based on their gender, age, region and other information. For dishes that users cook frequently, the order and weight of adding ingredients and seasonings cannot be exactly the same each time, resulting in a dish with multiple flavors, which is not a good user experience. In addition, current smart cooking devices cannot effectively record users' customized recipes or the personalization of certain recipes. As a result, smart cooking devices can only manage recipes preset by device manufacturers on the cooking device cloud server, and there is no management method for user-defined recipes.

[0003] With respect to the problem in the related art that target customized recipes for non-cooking equipment preset recipes cannot be managed, no effective solution has been proposed so far.

[0004] Therefore, it is necessary to improve the related technology to overcome the above-mentioned defects in the related technology. Summary of the Invention

[0005] Embodiments of the present invention provide a recipe management method and device, a storage medium, and an electronic device to at least solve the problem that target custom recipes that are not preset recipes for cooking equipment cannot be managed.

[0006] According to one aspect of an embodiment of the present invention, a recipe management method is provided, comprising: upon determining that a custom recipe mode for a cooking device is enabled, identifying a target ingredient in the cooking device and receiving a cooking mode corresponding to the target ingredient from among multiple cooking modes of the cooking device; during operation of the cooking mode, collecting first image information within the cooking device and determining cooking environment information collected by a sensor of a household appliance associated with the cooking device; and generating a target custom recipe and control parameters based on the target ingredient, the cooking mode, the first image information, and the cooking environment information.

[0007] According to another aspect of an embodiment of the present invention, a recipe management device is also provided, including: a determination module for identifying target ingredients in the cooking device and receiving a cooking mode corresponding to the target ingredients determined from multiple cooking modes of the cooking device when the custom recipe mode of the cooking device is enabled; an acquisition module for acquiring first image information in the cooking device and determining cooking environment information acquired by a sensor of a household appliance associated with the cooking device during the operation of the cooking mode; and a generation module for generating a target custom recipe and control parameters based on the target ingredients, the cooking mode, the first image information, and the cooking environment information.

[0008] According to another aspect of the embodiments of the present invention, a computer-readable storage medium is provided, in which a computer program is stored. The computer program is configured to execute the above-mentioned recipe management method when running.

[0009] According to another aspect of an embodiment of the present invention, an electronic device is provided, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the recipe management method through the computer program.

[0010] According to the present invention, when a custom recipe mode of a cooking device is determined to be enabled, a target ingredient in the cooking device is identified, and a cooking mode corresponding to the target ingredient is received from a plurality of cooking modes of the cooking device. During the operation of the cooking mode, first image information within the cooking device is collected, and cooking environment information collected by a sensor of a household appliance associated with the cooking device is determined. A target custom recipe and control parameters are generated based on the target ingredient, the cooking mode, the first image information, and the cooking environment information. Specifically, when the cooking device is controlled by a target subject to perform the custom recipe mode, the corresponding information is collected to generate a target custom recipe unique to the target subject. This allows the cooking device to effectively collect the recipe and production process of the target custom recipe created by the target subject using the cooking device, and further instruct the target subject to repeatedly implement the target custom recipe. The above technical solution improves the management capabilities of custom recipes other than preset recipes, and solves the problem of being unable to manage target custom recipes that are not preset in the cooking device. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0012] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0013] Figure 1 Schematic diagram of the hardware environment of a recipe management method according to an embodiment of the present application;

[0014] Figure 2 is a flowchart of a recipe management method according to an embodiment of the present invention;

[0015] Figure 3 is a schematic structural diagram of an optional intelligent recipe management system according to an embodiment of the present application;

[0016] Figure 4 This is an interactive diagram corresponding to an optional intelligent recipe management method according to an embodiment of the present application;

[0017] Figure 5 is a schematic diagram of an optional display screen working interface according to an embodiment of the present application;

[0018] Figure 6 4 is a structural block diagram of a recipe management device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0019] In order to enable those skilled in the art to better understand the present invention, the following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments in the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts should fall within the scope of protection of this application.

[0020] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequential order. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in a sequence other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0021] According to one aspect of the embodiment of the present application, a recipe management method is provided. The recipe management method is widely used in smart home (Smart Home), smart home, smart home device ecology, smart home (IntelligenceHouse) ecology and other whole-house intelligent digital control application scenarios. Optionally, in this embodiment, the above recipe management method can be applied to Figure 1 In the hardware environment shown in FIG. 1 , which is composed of a terminal device 102 and a server 104. Figure 1 As shown, the server 104 is connected to the terminal device 102 via a network, and can be used to provide services (such as application services, etc.) for the terminal or the client installed on the terminal. A database can be set up on the server or independently of the server to provide data storage services for the server 104. Cloud computing and / or edge computing services can be configured on the server or independently of the server to provide data computing services for the server 104.

[0022] The aforementioned network may include, but is not limited to, at least one of the following: a wired network and a wireless network. The aforementioned wired network may include, but is not limited to, at least one of the following: a wide area network, a metropolitan area network, and a local area network. The aforementioned wireless network may include, but is not limited to, at least one of the following: Wi-Fi (Wireless Fidelity) and Bluetooth. The terminal device 102 may be, but is not limited to, a PC, a mobile phone, a tablet computer, a smart air conditioner, a smart range hood, a smart refrigerator, a smart oven, a smart stove, a smart washing machine, a smart water heater, a smart washing machine, a smart dishwasher, a smart projection device, a smart TV, a smart clothes drying rack, smart curtains, smart audio and video, a smart socket, a smart speaker, a smart fresh air device, smart kitchen and bathroom equipment, smart bathroom equipment, a smart sweeping robot, a smart window cleaning robot, a smart mopping robot, a smart air purifier, a smart steamer, a smart microwave oven, a smart kitchen treasure, a smart purifier, a smart water dispenser, a smart door lock, etc.

[0023] In order to solve the above problems, a recipe management method is provided in this embodiment, including but not limited to application in a cloud server or cooking equipment.

[0024] It should be noted that if the cooking device has chip computing capabilities, storage space and other configurations, that is, the cooking device can detect the production of the target custom recipe, and then the technical solution of the embodiment of the present application can be applied to the cooking device. If the configuration of the cooking device is low and does not have the ability to detect the production of the target custom recipe, then the technical solution of the embodiment of the present application can be applied to the cloud server. The cloud server detects and determines the status of the cooking device by obtaining the operating information in the cooking device in real time. When it is determined that the cooking device is in the custom recipe mode, it is necessary to notify the cooking device to turn off the voice selection mode function, and at the same time instruct the cooking device to respond to the interaction results of the cloud server; when it is determined that the custom recipe mode is in progress, it is necessary to continue to collect data, record the target ingredients, cooking mode, first image information, and cooking environment information to generate the target custom recipe.

[0025] Specifically, Figure 2 4 is a flowchart of a recipe management method according to an embodiment of the present invention, the process comprising the following steps:

[0026] Step S202: When it is determined that the custom recipe mode of the cooking device is enabled, identifying a target ingredient in the cooking device, and receiving a cooking mode corresponding to the target ingredient from a plurality of cooking modes of the cooking device;

[0027] In an exemplary embodiment, step S202 can be implemented as follows: obtaining second image information corresponding to each main ingredient and ingredient added by the target subject to the cooking device; determining the main ingredient name and ingredient name corresponding to the second image information based on a preset recipe ingredient image database; obtaining weight change information on the cooking device's scale after each main ingredient name and each ingredient is added; matching the main ingredient name with the ingredient name and weight change information to determine the target ingredient added by the target subject to the cooking device. Upon determining that the target subject has stopped adding the target ingredient and the cooking device is sealed, obtaining a setting instruction triggered by the target subject on the cooking device's operating interface; determining a first cooking mode from multiple cooking modes corresponding to the cooking device based on the setting instruction; and receiving a cooking parameter adjustment instruction for the first cooking mode to obtain a cooking mode for cooking the target ingredient.

[0028] It should be noted that the number of the aforementioned second image information is one or more, and the preset time interval of the preset number of information needs to be less than a preset threshold. By comparing the second image information with the standard images corresponding to multiple known recipe ingredients in the recipe ingredient image database for image similarity, basic information about the recipe ingredients placed by the target object can be quickly determined, such as the name of the recipe ingredient, the common preparation method of the recipe ingredient, and the contraindications for the use of the recipe ingredient. In addition, by matching the ingredient name with the weight change information, the amount of the recipe ingredient used in the current preparation process can be confirmed, providing a standard for the amount of recipe ingredients used when the target custom recipe is subsequently implemented.

[0029] It is understandable that different firepower settings for the same cooking mode will ultimately have different cooking effects on the recipe ingredients added to the cooking equipment. Therefore, it is necessary to collect the firepower settings of the target object in the cooking equipment.

[0030] In a preferred embodiment, the preset number is 1, that is, image detection is performed on the second image information obtained within the preset time interval at every preset time interval. It should be noted that for the same second image information, by repeatedly obtaining images multiple times, the information of the determined recipe ingredients can be used more accurately.

[0031] Step S204: During the operation of the cooking mode, first image information in the cooking device is collected and cooking environment information collected by a sensor of a household appliance associated with the cooking device is determined;

[0032] It should be noted that step S202 and step S204 are executed asynchronously. In an exemplary embodiment, step S204 can be implemented as follows: an image recognizer disposed within the cooking device is used to collect image information within the cooking device, and first image information clearly showing the liquid volume within the cooking device is recorded. Furthermore, to ensure the cleanliness of the external space of the cooking device during the cooking process, the cooking device is associated with other household appliances to assist in the cooking process. For example, the cooking device is associated with a range hood, and the smoke or steam value generated during a cooking operation is detected by the smoke sensor and steam sensor carried by the range hood itself. When the real-time smoke or steam value generated by the cooking device is greater than the target smoke or steam value currently provided by the range hood, the cooking device can instruct the range hood to adjust to keep the processing effect consistent with the real-time smoke or steam value.

[0033] Step S206: generating a target custom recipe and control parameters based on the target ingredients, the cooking mode, the first image information, and the cooking environment information;

[0034] Optionally, the above control parameters are used to indicate the fire power, time, etc. for cooking the target ingredients.

[0035] Through the above steps, when the custom recipe mode of the cooking device is determined to be enabled, the target ingredient in the cooking device is identified, and a cooking mode corresponding to the target ingredient is received from multiple cooking modes of the cooking device; during the operation of the cooking mode, first image information within the cooking device is collected, and cooking environment information collected by a sensor of a household appliance associated with the cooking device is determined; and a target custom recipe and control parameters are generated based on the target ingredient, the cooking mode, the first image information, and the cooking environment information. Specifically, when the cooking device is controlled by a target subject to perform the custom recipe mode, a target custom recipe unique to the target subject is generated by collecting the corresponding information. This allows the cooking device to effectively collect the recipe and production process of the target custom recipe created by the target subject using the cooking device, and further instruct the target subject to repeatedly implement the target custom recipe. The above technical solution improves the management capabilities of custom recipes other than preset recipes, and solves the problem of being unable to manage target custom recipes that are not preset recipes for the cooking device.

[0036] In an exemplary embodiment, the generating of target custom recipes and control parameters based on the target ingredients, the cooking mode, the first image information, and the cooking environment information includes: upon receiving a cooking completion instruction from the cooking device, obtaining feedback information of the target object on the finished dish, wherein the feedback information is used to indicate the target object's evaluation information on the current finished dish, and the feedback information is obtained based on a voice module of the cooking device and / or a household appliance associated with the cooking device; the feedback information includes at least one of the following: the degree of liking for the finished dish, the taste index of the finished dish, and the finished quality of the finished dish; generating target custom recipes and control parameters based on the feedback information, the target ingredients, the cooking mode, the first image information, and the cooking environment information.

[0037] In other words, before generating a target custom recipe, a target satisfaction index corresponding to the feedback information can be determined; the feedback information indicates the target subject's evaluation of the finished dish prepared by the cooking device using the target ingredients. If the target satisfaction index is greater than or equal to a preset satisfaction index, the target ingredients, the cooking mode, the image information, and the cooking environment information are displayed on the display interface of the cooking device. A custom recipe is generated based on the target name input by the target subject, and the control parameters used during the recipe creation process are displayed accordingly.

[0038] It should be noted that in order to allow the target object to have a preliminary understanding of the target custom recipe before the target custom recipe is generated, the relevant control parameter information in a cooking step can be displayed on the display screen corresponding to the cooking device, including cooking method, fire power, cooking time, smoke value or steam value, air volume intensity, air volume working mode duration, name and weight of ingredients and condiments, and the voice module in the cooking device can be used to play the words, asking the target object "whether cooking is completed", the target object confirms that cooking is completed, and names the custom recipe, and the voice module feeds back the recognition result of the custom recipe name to the display screen.

[0039] Optionally, before identifying the target ingredients in the cooking device and receiving the cooking mode corresponding to the target ingredients determined from multiple cooking modes of the cooking device, the method also includes: determining the account information for logging into the cooking device; determining the permission information of the target object currently using the cooking device based on the account information; and when it is determined based on the permission information that the target object has the permission to update recipes, obtaining the operation data of the target object using the cooking device collected by the cooking device, so as to determine whether the target object needs to create a target custom recipe based on the operation data.

[0040] To ensure the validity of the target object creation, during actual operation, the user logs in to their personal account on the cooking device's display. The cooking device verifies that the logged-in personal account matches the pre-configured object account in the database and determines whether the current user has permission to create the target custom recipe. If permission is confirmed, the user says, "I want to make a secret recipe." The cooking device's voice module recognizes the user's intention to customize the recipe and sends the custom recipe instruction to the display, causing the cooking device's display to activate custom recipe recording mode.

[0041] Optionally, receiving the cooking mode corresponding to the target ingredient determined from multiple cooking modes of the cooking device includes: obtaining a setting instruction triggered by the target object on the operation interface of the cooking device; determining a first cooking mode from multiple cooking modes corresponding to the cooking device according to the setting instruction; receiving a cooking parameter adjustment instruction for the first cooking mode to obtain a cooking mode for cooking the target ingredient.

[0042] Optionally, during the operation of the cooking mode, after collecting the first image information in the cooking device, the method further includes: performing image detection on the first image information; determining the current liquid remaining amount in the cooking device based on the detection result of the image detection; when the current liquid remaining amount is less than or equal to the preset liquid remaining amount corresponding to the cooking mode, sending an alarm prompt to the target object through the cooking device, wherein the alarm prompt is used to prompt the target object that the current real-time liquid remaining amount cannot complete the corresponding cooking mode; when the current liquid remaining amount is greater than the preset liquid remaining amount corresponding to the cooking mode, determining the difference between the real-time liquid remaining amount and the preset liquid remaining amount, and determining the sustainable duration of the cooking mode based on the remaining amount difference.

[0043] For example, when the cooking mode is one or more of the following modes, such as stewing, boiling, braising, and steaming, the image recognizer in the cooking device will automatically turn on the detection mode. In the detection mode, the image recognizer can detect the remaining liquid in the cooking device in real time. When there is no obvious liquid in the cooking device, but the stewing, boiling, braising, and steaming modes are still in effect, the image recognizer will feedback a dry pot reminder to the display screen and voice module. The voice module will broadcast a dry pot abnormality reminder, and a pop-up window on the display screen will display a dry pot abnormality message. At the same time, the current working mode of the cooking device will be automatically turned off to prevent various dangers caused by user carelessness. After the current liquid remaining amount is greater than the preset liquid remaining amount corresponding to the cooking mode, the difference between the real-time liquid remaining amount and the preset liquid remaining amount can be determined. By dividing the remaining amount difference by the liquid consumption rate corresponding to the different cooking modes, the allowable cooking time before the remaining amount difference becomes no obvious liquid can be determined.

[0044] In an exemplary embodiment, after determining the cooking environment information collected by the sensor of the household appliance associated with the cooking device, the method further includes: determining the smoke value corresponding to the cooking device determined by the household appliance based on the cooking environment information; calculating a first air volume corresponding to the smoke value; and sending an air volume adjustment instruction to the household appliance when the first air volume is greater than the second air volume currently provided by the household appliance, wherein the air volume adjustment instruction includes the control parameter.

[0045] For example, the cooking device is associated with the range hood, and the smoke value or steam value generated during a cooking operation is detected by the smoke sensor and steam sensor carried by the range hood itself. When the real-time smoke value or steam value generated by the cooking device is greater than the processing effect of the target smoke value or steam value currently provided by the range hood, the cooking device can instruct the range hood to make adjustments to keep the processing effect consistent with the real-time smoke value or steam value. Through the association between devices, the target object's experience of using the cooking device is improved.

[0046] Obviously, the above-described embodiment is only a part of the embodiment of the present invention, not all of the embodiments. In order to better understand the above-mentioned method for determining the detail page, the above process is described below in conjunction with an embodiment, but it is not intended to limit the technical solution of the embodiment of the present invention. Specifically:

[0047] The following combination Figure 3 Describe the solution of the embodiment. Figure 3 is a schematic structural diagram of an optional intelligent recipe management system according to an embodiment of the present application, such as Figure 3 Shown, including:

[0048] Cooking equipment: A cooking tool that supports multiple cooking methods and heat levels, including but not limited to Chinese cooking methods (stir-frying, frying, deep-frying, stewing, boiling, braising, and steaming), Western cooking methods (roasting, steaming, and baking), and other cooking methods.

[0049] Display screen: An interactive display device with a screen that displays the recipe name, recipe preparation steps, and the type, name, and weight of ingredients and condiments in a graphic and text format.

[0050] Voice module: A voice interaction device used to announce the recipe name; the type, name, and weight of ingredients and condiments.

[0051] Image Recognizer: An interactive image recognition device used to take photos and identify the types of ingredients and condiments.

[0052] Scale: A microgravity sensor used to weigh the weight of each ingredient and seasoning during the cooking process.

[0053] Optionally, the above-mentioned intelligent recipe management system may further include:

[0054] Recipe Management System: A system that stores and manages user-created recipes (equivalent to the custom recipes in the above embodiment), associates and manages the created recipes with user accounts. It also stores pre-set smart recipes and supports voice module queries for popular recipes and the sending of recipe information.

[0055] Range hood: An independent smart device used to detect oil smoke or steam, which transmits the oil smoke or steam value to the display screen through wireless communication protocol.

[0056] Optional, Figure 4 This is an interactive diagram corresponding to an optional intelligent recipe management method according to an embodiment of the present application.

[0057] Step 1: The user logs in to their personal account on the cooking device display screen;

[0058] Step 2: The user says "I want to make a secret dish";

[0059] Step 3: The voice module recognizes the user's intention to create a recipe;

[0060] Step 4: The voice module sends the self-created recipe instruction to the display screen;

[0061] Step 5: The display screen starts the self-created recipe recording mode;

[0062] Step 6: The user adds ingredients and seasonings to the cooking device according to personal cooking habits;

[0063] Step 7. Click the cooking mode button on the display (such as Figure 5 Select your favorite cooking method, slide the plus button on the display left or right (as shown) Figure 5 ) Adjust the heat of cooking equipment;

[0064] Optional, Figure 5 This is a schematic diagram of an optional display screen working interface according to an embodiment of the present application.

[0065] Step 8: The smoke sensor and steam sensor carried by the range hood detect the smoke value or steam value generated during a cooking operation;

[0066] Step 9: Send different wind volume instructions to the range hood according to the smoke value or steam value, and the range hood automatically starts the corresponding wind volume working mode and adjusts the wind volume intensity;

[0067] Step 10: After the range hood ends one air volume working mode, the range hood transmits the smoke value or steam value, air volume intensity, and air volume working mode duration to the display screen.

[0068] Step 11: The image recognizer recognizes the ingredients or condiments added by the user in one operation;

[0069] Step 12: The weighing device senses and weighs the weight of the ingredients or condiments added at that time;

[0070] Step 13: The image recognizer feeds back the name of the recognized ingredient or condiment to the display screen.

[0071] Step 14: The weighing device feeds back weight information to the display screen.

[0072] Step 15: When the cooking method is stewing, boiling, braising, steaming, etc., the image recognizer will automatically turn on the detection mode. In the detection mode, the image recognizer can detect the liquid level in the cooking equipment in real time;

[0073] Step 16: When there is no obvious liquid in the cooking device, but the cooking mode such as stewing, boiling, braising, or steaming is still in progress, the image recognizer will provide a dry pot reminder to the display screen;

[0074] Step 17: The image recognizer will send a dry pot reminder to the voice module;

[0075] Step 18: The voice module broadcasts a dry pot abnormality reminder;

[0076] Step 19: A pop-up window will appear on the display screen to display a dry pot abnormality message, and the current working mode of the cooking device will be automatically shut down to prevent various dangers caused by user carelessness.

[0077] Step 20: The display screen displays relevant information of a cooking step, including cooking method, fire power, cooking time, smoke value or steam value, air volume intensity, air volume working mode duration, and the name and weight of ingredients and condiments.

[0078] Step 21: The user completes the cooking process of the self-created recipe and turns off the cooking device.

[0079] Step 22: The cooking device feeds back a cooking completion instruction to the voice module.

[0080] Step 23: The voice module plays a message and asks the user whether the cooking is complete.

[0081] Step 24: The user confirms that the cooking is complete and names the self-created recipe;

[0082] Step 25: The voice module feeds back the recognition result of the self-created recipe name to the display screen.

[0083] Step 26: The display screen shows the name and complete step information of the user-created recipe.

[0084] Step 27: The user tastes the cooking to see if it suits the user's taste;

[0085] Step 28. Click "Generate Self-Created Recipe" on the display screen;

[0086] Step 29: The display screen uploads the user account, the name of the self-created recipe, and the complete step information to the recipe management system, and the recipe management system saves the self-created recipe information corresponding to the user account.

[0087] Step 30: Save the user-created recipe information;

[0088] Furthermore, in the subsequent use process, the following steps may be included after the above steps:

[0089] Step 31: The next time the user cooks, he or she can ask how to cook according to the name of the self-created recipe;

[0090] Step 32: The voice module feeds back the recognition result of the self-created recipe to the display screen;

[0091] Step 33: The display screen queries the recipe management system to see if the self-created recipe exists in the cloud;

[0092] Step 34: The recipe management system feeds back the query results.

[0093] Step 35: Display the self-created recipe information; if the self-created recipe information exists in the recipe management system, the system sends the self-created recipe information to the display screen, and the display screen displays the recipe information to guide the user to complete the cooking;

[0094] Step 36: If the self-created recipe information does not exist in the recipe management system, the display screen will feed back the query result "self-created recipe does not exist" to the voice module;

[0095] Step 37: Ask the user whether to start the recipe creation process;

[0096] Step 38: If the user replies to the voice module "Start creating your own recipe";

[0097] Step 39: The voice module sends a self-created recipe instruction to the display screen;

[0098] Step 40: The display screen completes the self-created recipe working mode according to the above description.

[0099] Step 41: If the user replies to the voice module, “No need to create your own recipe”;

[0100] Step 42: The voice module asks the user whether he needs a recipe recommendation.

[0101] Step 43: Reply "Need recipe recommendation". If the user agrees to the recipe recommendation, the voice module searches for popular cooking recipes from the recipe management system and recommends them.

[0102] Step 44: query popular cooking recipe information;

[0103] Step 45: The recipe management system sends out popular cooking recipe information;

[0104] Step 46: Play popular recipe information;

[0105] Step 47: If the user disagrees with the recommended recipe;

[0106] Step 48: The voice module plays the phrase "OK, call me if you need anything", completing and exiting the interaction.

[0107] In summary, through the above embodiments, without adding other detection units, and through software innovation, the cooking device supports user-created recipes and accurately records the steps of these recipes. Furthermore, the cooking device supports user-created recipes and displays the recipe steps, guiding users to quickly cook. This allows users to quickly and conveniently enjoy authentic "grandmother's dishes," enhancing their cooking experience.

[0108] Through the description of the above embodiments, those skilled in the art can clearly understand that the method according to the above embodiment can be implemented by means of software plus the necessary general hardware platform, and of course it can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), and includes a number of instructions for enabling a terminal device (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods of various embodiments of the present invention.

[0109] This embodiment also provides a recipe management device for implementing the above-mentioned embodiments and preferred embodiments. Details already described will not be repeated here. As used below, the term "module" may refer to a combination of software and / or hardware that implements a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, implementation using hardware, or a combination of software and hardware, is also possible and contemplated.

[0110] Figure 6 1 is a structural block diagram of a recipe management device according to an embodiment of the present invention, the device comprising:

[0111] a determination module 62 for, when it is determined that the custom recipe mode of the cooking device is enabled, identifying a target ingredient in the cooking device and receiving a cooking mode corresponding to the target ingredient from a plurality of cooking modes of the cooking device;

[0112] a collection module 64 for collecting first image information within the cooking device and determining cooking environment information collected by a sensor of a household appliance associated with the cooking device during operation of the cooking mode;

[0113] The generating module 66 is configured to generate a target customized recipe and control parameters based on the target ingredients, the cooking mode, the first image information, and the cooking environment information.

[0114] The above-described apparatus, when determining that a custom recipe mode of a cooking device is enabled, identifies a target ingredient in the cooking device and receives a cooking mode corresponding to the target ingredient from among a plurality of cooking modes of the cooking device. During the operation of the cooking mode, first image information within the cooking device and cooking environment information collected by a sensor of a household appliance associated with the cooking device are collected. A target custom recipe and control parameters are generated based on the target ingredient, the cooking mode, the first image information, and the cooking environment information. Specifically, when the cooking device is controlled by a target subject to perform the custom recipe mode, the corresponding information is collected to generate a target custom recipe unique to the target subject. This allows the cooking device to effectively collect the recipe and production process of the target custom recipe created by the target subject using the cooking device, and further instruct the target subject to repeatedly implement the target custom recipe. The above-described technical solution improves the management capabilities of custom recipes other than preset recipes, and solves the problem of being unable to manage target custom recipes that are not preset in the cooking device.

[0115] In an exemplary embodiment, the above-mentioned device also includes: an acquisition module, which is used to obtain feedback information of the target object on the finished dish when receiving the cooking completion instruction of the cooking device, wherein the feedback information is used to indicate the target object's evaluation information on the current finished dish, and the feedback information is obtained based on the voice module of the cooking device and / or the household appliance associated with the cooking device; the feedback information includes at least one of the following: the degree of liking of the finished dish, the taste index of the finished dish, and the finished quality of the finished dish; and the target custom recipe and control parameters are generated based on the feedback information, the target ingredients, the cooking mode, the first image information and the cooking environment information.

[0116] In other words, before generating a target custom recipe, a target satisfaction index corresponding to the feedback information can be determined; the feedback information indicates the target subject's evaluation of the finished dish prepared by the cooking device using the target ingredients. If the target satisfaction index is greater than or equal to a preset satisfaction index, the target ingredients, the cooking mode, the image information, and the cooking environment information are displayed on the display interface of the cooking device. A custom recipe is generated based on the target name input by the target subject, and the control parameters used during the recipe creation process are displayed accordingly.

[0117] It should be noted that in order to allow the target subject to gain a preliminary understanding of the target custom recipe before the target custom recipe is generated, the custom recipe may include information such as the name and weight of the ingredients and condiments in the target ingredients, the cooking method, the fire power, and the cooking time. For example, the relevant control parameters of a cooking step, including the smoke value or steam value, the air volume intensity, and the duration of the air volume working mode, can be displayed on the display screen corresponding to the cooking device. The voice module in the cooking device can then play a voice message asking the target subject "Are you done cooking?" The target subject confirms that cooking is complete and names the custom recipe. The voice module then feeds back the recognition result of the custom recipe name to the display screen.

[0118] In an exemplary embodiment, the above-mentioned device also includes: a permission module, which is used to determine the account information for logging into the cooking device; determine the permission information of the target object currently using the cooking device based on the account information; and when it is determined based on the permission information that the target object has the permission to update recipes, obtain the operation data of the target object using the cooking device collected by the cooking device, so as to determine whether the target object needs to create a target custom recipe based on the operation data.

[0119] To ensure the validity of the target object creation, during actual operation, the user logs in to their personal account on the cooking device's display. The cooking device verifies that the logged-in personal account matches the pre-configured object account in the database and determines whether the current user has permission to create the target custom recipe. If permission is confirmed, the user says, "I want to make a secret recipe." The cooking device's voice module recognizes the user's intention to customize the recipe and sends the custom recipe instruction to the display, causing the cooking device's display to activate custom recipe recording mode.

[0120] In an exemplary embodiment, the determination module 62 is further used to obtain second image information of each main ingredient and each ingredient included in the target ingredients added by the target object in the cooking device; determine the main ingredient name and the ingredient name corresponding to the second image information based on a preset recipe ingredient image database; obtain weight change information of the weighing device of the cooking device when adding each main ingredient and each ingredient; match the main ingredient name and the ingredient name with the weight change information to determine the target ingredient added by the target object in the cooking device.

[0121] In an exemplary embodiment, the determination module 62 is also used to obtain the setting instructions triggered by the target object on the operation interface of the cooking device; determine the first cooking mode from the multiple cooking modes corresponding to the cooking device according to the setting instructions; receive the cooking parameter adjustment instructions for the first cooking mode, and obtain the cooking mode for cooking the target ingredients.

[0122] In an exemplary embodiment, the above-mentioned device also includes: a detection module for performing image detection on the first image information; determining the current liquid remaining amount in the cooking device based on the detection result of the image detection; when the current liquid remaining amount is less than or equal to the preset liquid remaining amount corresponding to the cooking mode, sending an alarm prompt to the target object through the cooking device, wherein the alarm prompt is used to prompt the target object that the current real-time liquid remaining amount cannot complete the corresponding cooking mode; when the current liquid remaining amount is greater than the preset liquid remaining amount corresponding to the cooking mode, determining the difference between the real-time liquid remaining amount and the preset liquid remaining amount, and determining the sustainable duration of the cooking mode based on the remaining amount difference.

[0123] For example, when the cooking mode is one or more of the following modes, such as stewing, boiling, braising, and steaming, the image recognizer in the cooking device will automatically turn on the detection mode. In the detection mode, the image recognizer can detect the remaining liquid in the cooking device in real time. When there is no obvious liquid in the cooking device, but the stewing, boiling, braising, and steaming modes are still in effect, the image recognizer will feedback a dry pot reminder to the display screen and voice module. The voice module will broadcast a dry pot abnormality reminder, and a pop-up window on the display screen will display a dry pot abnormality message. At the same time, the current working mode of the cooking device will be automatically turned off to prevent various dangers caused by user carelessness. After the current liquid remaining amount is greater than the preset liquid remaining amount corresponding to the cooking mode, the difference between the real-time liquid remaining amount and the preset liquid remaining amount can be determined. By dividing the remaining amount difference by the liquid consumption rate corresponding to the different cooking modes, the allowable cooking time before the remaining amount difference becomes no obvious liquid can be determined.

[0124] In an exemplary embodiment, the above-mentioned detection module also includes: an adjustment unit, used to determine the smoke value corresponding to the cooking device determined by the household appliance based on the cooking environment information; calculate the first air volume corresponding to the smoke value; when the first air volume is greater than the second air volume currently provided by the household appliance, send an air volume adjustment instruction to the household appliance, and the air volume adjustment instruction includes the control parameter.

[0125] For example, the cooking device is associated with the range hood, and the smoke value or steam value generated during a cooking operation is detected by the smoke sensor and steam sensor carried by the range hood itself. When the real-time smoke value or steam value generated by the cooking device is greater than the processing effect of the target smoke value or steam value currently provided by the range hood, the cooking device can instruct the range hood to make adjustments to keep the processing effect consistent with the real-time smoke value or steam value. Through the association between devices, the target object's experience of using the cooking device is improved.

[0126] An embodiment of the present invention further provides a computer-readable storage medium, in which a computer program is stored. The computer program is configured to execute the steps of any one of the above method embodiments when running.

[0127] Optionally, in this embodiment, the storage medium may be configured to store a computer program for performing the following steps:

[0128] S1, in the case where it is determined that a custom recipe mode of a cooking device is enabled, identifying a target ingredient in the cooking device, and receiving a cooking mode corresponding to the target ingredient determined from a plurality of cooking modes of the cooking device;

[0129] S2, during the operation of the cooking mode, collecting first image information within the cooking device and determining cooking environment information collected by a sensor of a household appliance associated with the cooking device;

[0130] S3, generating a target customized recipe and control parameters based on the target ingredients, the cooking mode, the first image information, and the cooking environment information.

[0131] In an exemplary embodiment, the computer-readable storage medium may include, but is not limited to, various media that can store computer programs, such as a USB flash drive, a read-only memory (ROM), a random access memory (RAM), a mobile hard disk, a magnetic disk, or an optical disk.

[0132] For specific examples in this embodiment, reference may be made to the examples described in the above embodiments and exemplary implementation modes, and this embodiment will not be described in detail here.

[0133] An embodiment of the present invention further provides an electronic device, comprising a memory and a processor, wherein the memory stores a computer program, and the processor is configured to run the computer program to execute the steps in any one of the above method embodiments.

[0134] Optionally, in this embodiment, the processor may be configured to execute the following steps through a computer program:

[0135] S1, in the case where it is determined that a custom recipe mode of a cooking device is enabled, identifying a target ingredient in the cooking device, and receiving a cooking mode corresponding to the target ingredient determined from a plurality of cooking modes of the cooking device;

[0136] S2, during the operation of the cooking mode, collecting first image information within the cooking device and determining cooking environment information collected by a sensor of a household appliance associated with the cooking device;

[0137] S3, generating a target customized recipe and control parameters based on the target ingredients, the cooking mode, the first image information, and the cooking environment information.

[0138] In an exemplary embodiment, the electronic device may further include a transmission device and an input / output device, wherein the transmission device is connected to the processor, and the input / output device is connected to the processor.

[0139] For specific examples in this embodiment, reference may be made to the examples described in the above embodiments and exemplary implementation modes, and this embodiment will not be described in detail here.

[0140] Obviously, those skilled in the art will appreciate that the various modules or steps of the present invention described above can be implemented using a general-purpose computing device, can be centralized on a single computing device, or can be distributed across a network of multiple computing devices. They can be implemented using program code executable by the computing device, and thus, can be stored in a storage device and executed by the computing device. In some cases, the steps shown or described herein can be performed in a different order than that shown, or can be fabricated as separate integrated circuit modules, or multiple modules or steps can be fabricated as a single integrated circuit module. Thus, the present invention is not limited to any particular combination of hardware and software.

[0141] The above is only a preferred embodiment of the present application. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present application. These improvements and modifications should also be regarded as the scope of protection of the present application.

Claims

1. A recipe management method, characterized in that: include: In a case where it is determined that the custom recipe mode of the cooking device is enabled, identifying a target ingredient in the cooking device, and receiving a cooking mode corresponding to the target ingredient determined from a plurality of cooking modes of the cooking device; During operation of the cooking mode, collecting first image information within the cooking device and determining cooking environment information collected by a sensor of a household appliance associated with the cooking device; Generating a target customized recipe and control parameters based on the target ingredients, the cooking mode, the first image information, and the cooking environment information, wherein generating a target customized recipe and control parameters based on the target ingredients, the cooking mode, the first image information, and the cooking environment information includes: Upon receiving a cooking completion instruction from the cooking device, obtaining feedback information from the target subject on the finished dish; determining a target satisfaction index based on the feedback information; When the target satisfaction index is greater than or equal to a preset satisfaction index, a target custom recipe and control parameters are generated, wherein the target custom recipe includes: the target ingredients, the cooking mode, the first image information, and the cooking environment information; the control parameters include the parameter settings of the cooking equipment during the process of cooking the target ingredients in the cooking mode under the cooking environment information.

2. The method according to claim 1, characterized in that The feedback information is used to indicate the target object's evaluation information on the current finished dish, and the feedback information is obtained based on the voice module of the cooking device and / or the household appliance associated with the cooking device; the feedback information includes at least one of the following: the degree of liking of the finished dish, the taste index of the finished dish, and the finished quality of the finished dish.

3. The method according to claim 1 or 2, characterized in that Before identifying a target ingredient in the cooking device and receiving a cooking mode corresponding to the target ingredient determined from a plurality of cooking modes of the cooking device, the method further includes: Determine the account information for logging into the cooking device; determining permission information of a target object currently using the cooking device based on the account information; When it is determined according to the permission information that the target object has the permission to update recipes, the operation data of the target object using the cooking device collected by the cooking device is obtained to determine whether the target object needs to create a target custom recipe based on the operation data.

4. The method according to claim 1 or 2, characterized in that Identifying target ingredients in the cooking device, including: Acquire second image information of each main ingredient and each ingredient included in the target ingredients added by the target object in the cooking device; Determining the main ingredient name and ingredient name corresponding to the second image information based on a preset recipe ingredient image database; Obtaining weight change information of a weighing device of the cooking device when adding each main ingredient and each ingredient; The main ingredient name and the ingredient name are matched with the weight change information to determine the target ingredient added by the target object in the cooking device.

5. The method according to claim 1 or 2, characterized in that Receiving a cooking mode corresponding to the target ingredient determined from a plurality of cooking modes of the cooking device, comprising: Obtaining the setting instructions triggered by the target object on the operation interface of the cooking device; determining a first cooking mode from a plurality of cooking modes corresponding to the cooking device according to the setting instruction; A cooking parameter adjustment instruction for the first cooking mode is received to obtain a cooking mode for cooking the target food.

6. The method according to claim 1 or 2, characterized in that During the operation of the cooking mode, after collecting first image information within the cooking device, the method further includes: performing image detection on the first image information; determining a current amount of liquid remaining in the cooking device according to a detection result of the image detection; When the current liquid remaining amount is less than or equal to the preset liquid remaining amount corresponding to the cooking mode, sending an alarm prompt to the target object through the cooking device, wherein the alarm prompt is used to prompt the target object that the current real-time liquid remaining amount cannot complete the corresponding cooking mode; When the current liquid remaining amount is greater than the preset liquid remaining amount corresponding to the cooking mode, the remaining amount difference between the real-time liquid remaining amount and the preset liquid remaining amount is determined, and the sustainable duration of the cooking mode is determined based on the remaining amount difference.

7. The method according to claim 1 or 2, characterized in that After determining the cooking environment information collected by the sensor of the home appliance associated with the cooking device, the method further includes: determining a smoke value corresponding to the cooking device determined by the household appliance according to the cooking environment information; Calculating a first air volume corresponding to the smoke value; In a case where the first air volume is greater than a second air volume currently provided by the household appliance, an air volume adjustment instruction is sent to the household appliance, where the air volume adjustment instruction includes the control parameter.

8. A recipe management device, characterized in that: include: a determination module, configured to, when it is determined that the custom recipe mode of the cooking device is enabled, identify a target ingredient in the cooking device and receive a cooking mode corresponding to the target ingredient determined from a plurality of cooking modes of the cooking device; a collection module, configured to collect first image information within the cooking device and determine cooking environment information collected by a sensor of a household appliance associated with the cooking device during operation of the cooking mode; A generation module is used to generate a target custom recipe and control parameters based on the target ingredients, the cooking mode, the first image information, and the cooking environment information, wherein the target custom recipe and control parameters are generated based on the target ingredients, the cooking mode, the first image information, and the cooking environment information, including: upon receiving a cooking completion instruction from the cooking device, obtaining feedback information from the target object on the finished dish; determining a target satisfaction index based on the feedback information; and generating a target custom recipe and control parameters when the target satisfaction index is greater than or equal to a preset satisfaction index, wherein the target custom recipe includes: the target ingredients, the cooking mode, the first image information, and the cooking environment information, and the control parameters include parameter settings of the cooking device during cooking the target ingredients in the cooking mode under the cooking environment information.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes a stored program, wherein the program executes the method according to any one of claims 1 to 7 when executed.

10. An electronic device comprising a memory and a processor, characterized in that: A computer program is stored in the memory, and the processor is configured to execute the method according to any one of claims 1 to 7 through the computer program.

Images