Cooking appliance and control method, system and server thereof

Through image and weight data recognition technology, the ingredients in the cooking utensils are automatically identified and the cooking parameters are returned, which solves the problems of complex and poor control of cooking utensils in the existing technology, and realizes automatic cooking and user experience improvement.

CN109124293BActive Publication Date: 2024-12-24ZHEJIANG SHAOXING SUPOR DOMESTIC ELECTRICAL APPLIANCE CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN201710503954.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2017-06-27
Publication Date
2024-12-24
Estimated Expiration
2037-06-27

AI Technical Summary

Technical Problem

The control methods of existing cooking utensils are complex and have poor cooking effects, so they cannot accurately identify the category of cooking objects before boiling, resulting in difficult to achieve ideal cooking time and effect.

Method used

The image acquisition module collects the food materials in the pot, combines weight data, and uses the server to perform image recognition and data processing, automatically identify the reference cooking object and return the corresponding cooking parameters, realizing the automatic cooking operation of the cooking utensils.

Benefits of technology

Simplifies the cooking process and improves the cooking effect. Users do not need to set parameters manually, and do not need to increase heating time after boiling to identify the food categories, which improves the user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN109124293B_ABST
    Figure CN109124293B_ABST
Patent Text Reader

Abstract

The present invention discloses a cooking appliance and a control method, system and server thereof. The method comprises: receiving image data sent by the cooking appliance, wherein the image data comprises: images of multiple cooking objects contained in the pot of the cooking appliance, and collecting the image data by an image acquisition module arranged on the cooking appliance; identifying the image data and determining multiple cooking objects; judging a reference cooking object that meets a preset condition from the multiple cooking objects; returning a first cooking parameter corresponding to the reference cooking object to the cooking appliance, so that the cooking appliance performs a cooking operation according to the first cooking parameter. The present invention solves the technical problems in the prior art that the control method of the cooking appliance is complicated and the cooking effect is poor.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of household appliances, and in particular to a cooking appliance and a control method, system and server thereof. Background Art

[0002] When users use cooking utensils to cook, they always hope to obtain ideal cooking effects. For cooking utensils that do not have the automatic recognition function, users are required to put the cooking objects in according to the recipe and set the cooking parameters. The whole cooking process is complicated. If the user does not put the cooking objects in correctly according to the recipe or the weight error of the cooking objects is large, the cooking effect will be affected. For cooking utensils with automatic recognition function, an anti-overflow probe is installed on the top of the cooking utensils. The type of cooking object can be judged by factors such as the size and frequency of bubbles generated during the boiling process of the cooking object, so as to perform relevant controls and realize the automatic cooking of the cooking utensils. However, the anti-overflow probe can only judge the type of cooking object after boiling. Therefore, the ideal cooking time and cooking effect cannot be achieved.

[0003] With regard to the problems that the control method of the cooking appliance in the prior art is complicated and the cooking effect is poor, no effective solution has been proposed yet. Summary of the invention

[0004] The embodiments of the present invention provide a cooking appliance and a control method, system, and server thereof, so as to at least solve the technical problems in the prior art that the control method of the cooking appliance is complicated and has poor cooking effect.

[0005] According to one aspect of an embodiment of the present invention, a method for controlling a cooking appliance is provided, comprising: receiving image data sent by the cooking appliance, wherein the image data comprises: images of a plurality of cooking objects contained in a pot of the cooking appliance, and acquiring the image data by an image acquisition module provided on the cooking appliance; recognizing the image data to determine a plurality of cooking objects; judging a reference cooking object that meets a preset condition from among the plurality of cooking objects; and returning a first cooking parameter corresponding to the reference cooking object to the cooking appliance, so that the cooking appliance performs a cooking operation according to the first cooking parameter.

[0006] Furthermore, judging a benchmark cooking object that meets preset conditions from among a plurality of cooking objects includes: obtaining a display area of ​​each cooking object in the image data; identifying the display area of ​​each cooking object in the image data through a preset recognition algorithm, and determining the cooking object corresponding to the largest area as the benchmark cooking object.

[0007] Furthermore, in the process of the cooking appliance performing a cooking operation according to the first cooking parameter, the above method also includes: obtaining a cooking level of the cooking parameter corresponding to each cooking object, wherein the cooking level is used to characterize the complexity of the cooking operation performed by the cooking appliance according to the cooking parameter; comparing the cooking level of the cooking parameter corresponding to each cooking object; determining a second cooking parameter corresponding to the highest cooking level; matching the second cooking parameter with the first cooking parameter; if the second cooking parameter fails to match the first cooking parameter, returning the second cooking parameter to the cooking appliance so that the cooking appliance performs the cooking operation according to the second cooking parameter.

[0008] Furthermore, determining a reference cooking object that meets preset conditions from among a plurality of cooking objects includes: acquiring a cooking level of a cooking parameter corresponding to each cooking object; comparing the cooking levels of the cooking parameters corresponding to each cooking object; and determining a cooking object corresponding to the highest cooking level as the reference cooking object.

[0009] Furthermore, before returning the first cooking parameter corresponding to the reference cooking object to the cooking appliance, the method further includes: acquiring the first cooking parameter corresponding to the reference cooking object from a first database.

[0010] Furthermore, while receiving the image data sent by the cooking utensil, weight data of multiple cooking objects sent by the cooking utensil is received, and the weight data is collected by a weight collection module arranged inside the pot body, wherein, while identifying the image data and determining the multiple cooking objects, the above method also includes: identifying the image data and determining the water level line inside the pot body, wherein the image data also includes: an image of a ruler inside the pot body; obtaining the ratio of solid ingredients to liquid ingredients based on the water level line and the weight data inside the pot body, wherein the multiple cooking objects include: solid ingredients and liquid ingredients; calculating third cooking parameters corresponding to the multiple cooking objects based on the multiple cooking objects and the ratio of solid ingredients to liquid ingredients; and returning the third cooking parameters corresponding to the multiple cooking objects to the cooking utensil, so that the cooking utensil performs cooking operations according to the third cooking parameters.

[0011] Furthermore, based on the water level line and weight data inside the pot body, the ratio of solid ingredients to liquid ingredients is obtained, including: based on the preset size of the pot body, obtaining the volume data of multiple cooking objects located below the water level line; based on the volume data and the weight data, determining the ratio of solid ingredients to liquid ingredients, wherein the volume data includes: the volume relationship between the solid ingredients and the liquid ingredients, and the weight data includes: the weight relationship between the solid ingredients and the liquid ingredients.

[0012] Furthermore, based on the multiple cooking objects and the ratio of solid ingredients to liquid ingredients, third cooking parameters corresponding to the multiple cooking objects are calculated, including: obtaining a display area of ​​each cooking object in the image data; obtaining a fourth cooking parameter from the second database based on the multiple cooking objects and the display area of ​​each cooking object in the image data; and calculating the third cooking parameter based on the fourth cooking parameter and the ratio of solid ingredients to liquid ingredients.

[0013] Furthermore, after identifying the image data and determining a plurality of cooking objects, the method further comprises: generating prompt information according to the plurality of cooking objects, wherein the prompt information is used to prompt the order in which each cooking object is added to the cooking utensil.

[0014] Furthermore, the image acquisition module is arranged on the top of the cover of the cooking utensil.

[0015] According to another aspect of an embodiment of the present invention, a control method for a cooking appliance is also provided, the cooking appliance comprising: an image acquisition module, wherein the method comprises: receiving image data acquired by the image acquisition module, wherein the image data comprises: images of multiple cooking objects placed in a pot of the cooking appliance; sending the image data to a server, and receiving a first cooking parameter returned by the server, wherein the first cooking parameter corresponds to a baseline cooking object among the multiple cooking objects that meets a preset condition; and performing a cooking operation according to the first cooking parameter.

[0016] Furthermore, in the process of performing a cooking operation according to a first cooking parameter, the above method also includes: receiving a second cooking parameter returned by the server, wherein the second cooking parameter is a cooking parameter corresponding to a highest cooking level among the cooking parameters corresponding to multiple cooking objects, and the cooking level is used to characterize the complexity of the cooking operation performed by the cooking utensil according to the cooking parameter; and performing the cooking operation according to the second cooking parameter.

[0017] Furthermore, the cooking appliance also includes: a weight acquisition module arranged inside the pot body, wherein, while receiving the image data acquired by the image acquisition module, the above method also includes: receiving weight data of multiple cooking objects acquired by the weight acquisition module; sending the image data and the weight data to the server, and receiving a third cooking parameter returned by the server, wherein the third cooking parameter corresponds to the image data and the weight data, and the image data also includes: an image of a scale inside the pot body; and performing cooking operations according to the third cooking parameter.

[0018] According to another aspect of an embodiment of the present invention, a control system for a cooking appliance is provided, comprising: a cooking appliance, comprising: an image acquisition module, for acquiring image data, wherein the image data comprises: images of a plurality of cooking objects contained in a pot of the cooking appliance; a server, which has a communication relationship with the cooking appliance, for identifying the image data, determining a plurality of cooking objects, judging a baseline cooking object that meets a preset condition from among the plurality of cooking objects, and returning a first cooking parameter corresponding to the baseline cooking object to the cooking appliance; the cooking appliance is further used to perform a cooking operation according to the first cooking parameter.

[0019] Furthermore, the cooking appliance also includes: a weight collection module, which is arranged inside the pot body and is used to collect weight data of multiple cooking objects; the server is also used to identify the image data, determine the water level line inside the pot body, obtain the ratio of solid ingredients to liquid ingredients according to the water level line and the weight data inside the pot body, and calculate the second cooking parameters corresponding to the multiple cooking objects according to the multiple cooking objects and the ratio of solid ingredients to liquid ingredients, wherein the image data also includes: an image of a ruler inside the pot body, and the multiple cooking objects include: solid ingredients and liquid ingredients; the cooking appliance is also used to perform cooking operations according to the second cooking parameters.

[0020] According to another aspect of an embodiment of the present invention, a server is also provided, comprising: a communication device for receiving image data sent by a cooking utensil, wherein the image data comprises: images of a plurality of cooking objects contained in a pot of the cooking utensil, the image data being acquired by an image acquisition module provided on the cooking utensil; an image recognition device connected to the communication device, for recognizing the image data and determining a plurality of cooking objects; a first discrimination device connected to the image recognition device, for judging a reference cooking object that meets a preset condition from among the plurality of cooking objects; and a communication device connected to the discrimination device, for returning a first cooking parameter corresponding to the reference cooking object to the cooking utensil, so that the cooking utensil performs a cooking operation according to the first cooking parameter.

[0021] Furthermore, the communication device is also used to receive weight data of multiple cooking objects sent by the cooking utensil, wherein the weight data is collected by a weight collection module arranged inside the pot body; the image recognition device is also used to identify the image data and determine the water level line inside the pot body, wherein the image data also includes: an image of a scale inside the pot body; the server also includes: a processor, connected to the communication device and the image recognition device, and used to obtain the ratio of solid ingredients to liquid ingredients based on the water level line and weight data inside the pot body, wherein the multiple cooking objects include: solid ingredients and liquid ingredients; a second discrimination device, connected to the processor and the image recognition device, and used to calculate second cooking parameters corresponding to the multiple cooking objects based on the multiple cooking objects and the ratio of solid ingredients to liquid ingredients; the communication device, connected to the second discrimination device, is also used to return the second cooking parameters corresponding to the multiple cooking objects to the cooking utensil, so that the cooking utensil performs cooking operations according to the second cooking parameters.

[0022] According to another aspect of an embodiment of the present invention, a cooking utensil is provided, characterized in that it includes: a pot body, used to hold a plurality of cooking objects; a cover body, covered on the pot body; an image acquisition module, used to acquire image data, wherein the image data includes: images of a plurality of cooking objects held in the pot body; a communication device, connected to the image acquisition module, used to send the image data to a server, and receive a first cooking parameter returned by the server, wherein the first cooking parameter corresponds to a benchmark cooking object among the plurality of cooking objects that meets a preset condition; and an execution module, connected to the communication device, used to execute a cooking operation according to the first cooking parameter.

[0023] Furthermore, the cooking appliance also includes: a weight acquisition module, arranged inside the pot body, for collecting weight data of multiple cooking objects; a communication device, connected to the weight acquisition module, for sending image data and weight data to a server, and receiving a second cooking parameter returned by the server, wherein the second cooking parameter corresponds to the image data and weight data, and the image data also includes: an image of a scale inside the pot body; and the execution module is also used to perform cooking operations according to the second cooking parameters.

[0024] According to another aspect of the embodiments of the present invention, a storage medium is provided. The storage medium includes a stored program. When the program is executed, the device where the storage medium is located is controlled to execute the control method of the cooking appliance in the above embodiment.

[0025] According to another aspect of the embodiments of the present invention, a processor is further provided, and the processor is used to run a program, wherein the control method of the cooking appliance in the above embodiment is executed when the program is run.

[0026] In an embodiment of the present invention, image data sent by a cooking appliance is received, the image data is identified, a plurality of cooking objects are determined, a reference cooking object that meets a preset condition is determined from the plurality of cooking objects, and a first cooking parameter corresponding to the reference cooking object is returned to the cooking appliance, so that the cooking appliance performs a cooking operation according to the first cooking parameter, thereby realizing automatic cooking of the cooking appliance. It is easy to notice that after the first cooking parameter is obtained, the cooking appliance starts the cooking operation. Compared with the prior art, there is no need to manually set the cooking parameter, and there is no need to identify the category of the cooking object after boiling, that is, there is no need to identify multiple cooking ingredients by adding additional heating time, thereby solving the technical problem that the control method of the cooking appliance in the prior art is complicated and the cooking effect is poor. Therefore, the technical solution determined by the above-mentioned embodiment of the present invention can achieve the technical effect of simplifying the cooking process, improving the cooking effect, and enhancing the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] The drawings described herein are used to provide a further understanding of the present invention and constitute a part of this application. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation of the present invention. In the drawings:

[0028] Figure 1 is a flow chart of a method for controlling a cooking appliance according to an embodiment of the present invention;

[0029] Figure 2 is a flow chart of another method for controlling a cooking appliance according to an embodiment of the present invention;

[0030] Figure 3 is a schematic diagram of a control system of a cooking appliance according to an embodiment of the present invention;

[0031] Figure 4 is a schematic diagram of a control system of another cooking appliance according to an embodiment of the present invention;

[0032] Figure 5 is a schematic diagram of an optional control system of a cooking appliance according to an embodiment of the present invention;

[0033] Figure 6 is a schematic diagram of another optional control system of a cooking appliance according to an embodiment of the present invention;

[0034] Figure 7 is a schematic diagram of a server according to an embodiment of the present invention;

[0035] Figure 8 is a schematic diagram of another server according to an embodiment of the present invention;

[0036] Fig. 9is a schematic diagram of a cooking appliance according to an embodiment of the present invention; and

[0037] Fig.10 is a schematic diagram of another cooking appliance according to an embodiment of the present invention. DETAILED DESCRIPTION

[0038] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0039] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0040] Example 1

[0041] According to an embodiment of the present invention, an embodiment of a control method for a cooking appliance is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0042] Figure 1 is a flow chart of a control method of a cooking appliance according to an embodiment of the present invention. Figure 1 As shown, the method comprises the following steps:

[0043] Step S102, receiving image data sent by the cooking utensil, wherein the image data includes: images of a plurality of cooking objects placed in a pot of the cooking utensil, and the image data is collected by an image collection module provided on the cooking utensil.

[0044] Optionally, the image acquisition module is arranged on the top of the cover of the cooking utensil.

[0045] Specifically, the above-mentioned cooking utensil can be an electric pressure cooker, an electric rice cooker or other cooking utensil, and the present invention does not make any specific limitation on this; the above-mentioned image acquisition module can be a camera installed on the top of the cover of the cooking utensil, so as to capture images of all cooking objects placed inside the pot; the above-mentioned cooking objects can be ingredients placed inside the cooking utensil, including: solid ingredients such as vegetables and rice, and liquid ingredients such as oil and water, and the present invention does not make any specific limitation on this.

[0046] Step S104: identifying the image data and determining a plurality of cooking objects.

[0047] Step S106, determining a reference cooking object that meets a preset condition from among the multiple cooking objects.

[0048] Specifically, the above-mentioned reference cooking object can be the main ingredient among all the ingredients placed in the pot; the above-mentioned preset conditions can determine whether the cooking object is the condition of the reference cooking object, that is, the condition for determining the main ingredient placed in the pot. For example, the main ingredient can be the ingredient with the largest proportion among the multiple ingredients, or it can be the ingredient that is the most difficult to cook among the multiple ingredients.

[0049] Step S108: returning the first cooking parameter corresponding to the reference cooking object to the cooking appliance, so that the cooking appliance performs the cooking operation according to the first cooking parameter.

[0050] Specifically, different ingredients correspond to different cooking parameters, and the cooking parameters may include: cooking time, cooking pressure, heating power, etc.

[0051] In an optional solution, before the cooker performs cooking operations, the cooking utensil can capture images of all the ingredients placed inside the pot body through a camera disposed on the top of the cover of the cooking utensil, and upload the images to a cloud server through a network. After receiving the images of all the ingredients uploaded by the cooking utensil, the cloud server can perform image recognition on the images of all the ingredients, identify the name of each ingredient in the image, and then determine the main ingredient based on the proportion of each ingredient and the difficulty of cooking, and read the corresponding first cooking parameter, and return the first cooking parameter to the cooking utensil through the network, so that the cooking utensil can perform cooking operations on all the ingredients placed in the pot body according to the first cooking parameter.

[0052] It should be noted that in order to ensure that images of all ingredients are captured before the cooking appliance is used for cooking, the user can close the cover after putting in all the ingredients needed for cooking, so that the camera disposed on the top of the cover can capture images of all the ingredients.

[0053] For example, if a user needs to make corn and pork ribs soup, the user can put corn, pork ribs and water into the cooking appliance and close the lid. The camera on the top of the lid can capture images of the corn, pork ribs and water, and send them to the cloud server through the network. After receiving the images of the corn, pork ribs and water, the cloud server identifies each ingredient through the image recognition module, namely, the ingredient "corn", the ingredient "pork ribs" and the ingredient "water", and further determines that the main ingredient is pork ribs. The cooking parameters corresponding to the pork ribs are read and returned to the cooking appliance, so that the cooking appliance can perform cooking operations according to the cooking parameters corresponding to the pork ribs to cook corn and pork ribs soup.

[0054] According to the above embodiment of the present invention, the image data sent by the cooking appliance is received, the image data is identified, a plurality of cooking objects are determined, a reference cooking object that meets the preset conditions is determined from the plurality of cooking objects, and a first cooking parameter corresponding to the reference cooking object is returned to the cooking appliance, so that the cooking appliance performs the cooking operation according to the first cooking parameter, thereby realizing the automatic cooking work of the cooking appliance. It is easy to notice that after the first cooking parameter is obtained, the cooking appliance starts the cooking operation. Compared with the prior art, there is no need to manually set the cooking parameter, and there is no need to identify the category of the cooking object after boiling, that is, there is no need to identify multiple cooking ingredients by adding additional heating time, thereby solving the technical problem that the control method of the cooking appliance in the prior art is complicated and the cooking effect is poor. Therefore, the technical solution determined by the above embodiment of the present invention can achieve the technical effect of simplifying the cooking process, improving the cooking effect, and enhancing the user experience.

[0055] Optionally, step S106, determining a benchmark cooking object that meets preset conditions from multiple cooking objects, includes: obtaining a display area of ​​each cooking object in the image data; identifying the display area of ​​each cooking object in the image data through a preset recognition algorithm, and determining the cooking object corresponding to the largest display area as the benchmark cooking object.

[0056] Specifically, the above-mentioned preset recognition algorithm may be a fuzzy recognition algorithm, which has the advantages of a simple recognition process and a high recognition rate.

[0057] In an optional solution, after performing image recognition on images of all ingredients and identifying the name of each ingredient in the image, the cloud server can calculate the display area of ​​each ingredient in the image, and identify them through a fuzzy recognition algorithm. The display areas of all ingredients are compared to determine that the ingredient corresponding to the largest display area is the main ingredient.

[0058] For example, after receiving the images of corn, spare ribs and water and identifying the ingredients "corn", "spare ribs" and "water", the cloud server can calculate the display areas of the three ingredients, and obtain the display area S1 of the ingredient "corn", the display area S2 of the ingredient "spare ribs" and the display area S3 of the ingredient "water". Through the fuzzy recognition algorithm, it is determined that the maximum display area is S2, thereby determining that the ingredient "spare ribs" is the main ingredient.

[0059] Through the above solution, the cloud server can identify the area of ​​each ingredient through the fuzzy recognition algorithm and determine the main ingredient, which can simplify the recognition process and improve the recognition accuracy.

[0060] Optionally, in step S108, when the cooking appliance performs a cooking operation according to the first cooking parameter, the method further includes the following steps: obtaining a cooking level of the cooking parameter corresponding to each cooking object, wherein the cooking level is used to characterize the complexity of the cooking operation performed by the cooking appliance according to the cooking parameter; comparing the cooking level of the cooking parameter corresponding to each cooking object; determining a second cooking parameter corresponding to the highest cooking level; matching the second cooking parameter with the first cooking parameter; and if the second cooking parameter fails to match the first cooking parameter, returning the second cooking parameter to the cooking appliance so that the cooking appliance performs the cooking operation according to the second cooking parameter.

[0061] Specifically, the above cooking level can represent the difficulty of cooking the ingredients, that is, the complexity of cooking the ingredients. The higher the cooking level, the higher the cooking difficulty, the more difficult the ingredients are to cook, the longer the cooking time required, the greater the cooking pressure, and the higher the heating power.

[0062] In an optional solution, after determining the main ingredient by judging the display area, the cloud server can return the first cooking parameter corresponding to the main ingredient to the cooking utensil, and the cooking utensil can perform cooking operations according to the first cooking parameter corresponding to the main ingredient, and during the cooking process, further obtain the second cooking parameter corresponding to the ingredient with the highest cooking difficulty according to the cooking difficulty of the ingredient, and match the first cooking parameter with the second cooking parameter. If the first cooking parameter fails to match the second cooking parameter, for example, the cooking time in the first cooking parameter is significantly different from the cooking time in the second cooking parameter, it is determined that cooking according to the current first cooking parameter cannot cook all the ingredients, and the second cooking parameter can be returned to the cooking utensil, so that the cooking utensil can automatically switch to the second cooking parameter for cooking operations.

[0063] For example, after the cloud server receives images of corn, pork ribs and water, and identifies the ingredients "corn", "pork ribs" and "water", since a large amount of corn is put in, it can be determined that the ingredient "corn" is the main ingredient based on the display area of ​​the three ingredients, and the cooking appliance operates according to the cooking parameters corresponding to the ingredient "corn". During the operation, the cloud server continues to obtain the cooking levels of the three ingredients, that is, obtains the cooking difficulty of the three ingredients, and obtains cooking level A for ingredient "corn", cooking level B for ingredient "pork ribs" and cooking level C for ingredient "water". It is determined that the highest cooking level is B, then the second cooking parameter corresponding to the ingredient "pork ribs" is obtained, and the first cooking parameter currently executed by the cooking appliance is matched with the second cooking parameter. If the match fails, that is, it is determined that the ingredients "corn", "pork ribs" and "water" cannot be cooked under the current cooking parameters, then the second cooking parameters can be returned to the cooking appliance, and the cooking appliance performs cooking operations according to the second cooking parameters, thereby ensuring that all ingredients can be cooked.

[0064] Through the above scheme, the cloud server can combine multiple judgment methods to determine the main ingredients, and determine the optimal cooking parameters based on the cooking parameters corresponding to the main ingredients obtained by different methods, and control the cooking utensils to perform cooking operations according to the optimal cooking parameters, thereby further improving the cooking effect and enhancing the user experience.

[0065] Optionally, step S106, determining a benchmark cooking object that meets preset conditions from multiple cooking objects, includes: obtaining the cooking level of the cooking parameters corresponding to each cooking object; comparing the cooking levels of the cooking parameters corresponding to each cooking object; and determining the cooking object corresponding to the highest cooking level as the benchmark cooking object.

[0066] In an optional solution, after performing image recognition on images of all ingredients and identifying the name of each ingredient in the image, the cloud server can obtain the cooking difficulty of each ingredient, compare the cooking difficulties of all ingredients, and determine the ingredient with the highest cooking difficulty as the main ingredient.

[0067] For example, after receiving the images of corn, pork ribs and water and identifying the ingredients "corn", "pork ribs" and "water", the cloud server obtains the cooking levels of the three ingredients, that is, the cooking difficulty of the three ingredients, and obtains the cooking level A of the ingredient "corn", the cooking level B of the ingredient "pork ribs" and the cooking level C of the ingredient "water", and determines that the highest cooking level is B, thereby determining that the ingredient "pork ribs" is the main ingredient.

[0068] Through the above scheme, the cloud server can use the cooking object corresponding to the highest cooking level as the benchmark cooking object, that is, the cooking object with the greatest cooking difficulty as the benchmark cooking object, thereby realizing the automatic cooking work of the cooking utensils and achieving the effect of improving the cooking effect.

[0069] Optionally, before returning the first cooking parameter corresponding to the reference cooking object to the cooking appliance at step S108, the method further comprises the following step: acquiring the first cooking parameter corresponding to the reference cooking object from a first database.

[0070] Specifically, the first database mentioned above may be a food material database, and the corresponding relationship between food materials and cooking parameters may be pre-stored in the database.

[0071] In an optional solution, after determining the benchmark cooking object, that is, the main ingredient, the cloud server can query the first database to obtain the first cooking parameter corresponding to the main ingredient, and return the first cooking parameter to the cooking utensil. The cooking utensil can perform the cooking operation according to the first cooking parameter, thereby realizing automatic cooking of the cooking utensil.

[0072] Optionally, in step S102, while receiving the image data sent by the cooking utensil, weight data of multiple cooking objects sent by the cooking utensil are received, and the weight data is collected by a weight collection module arranged inside the pot body, wherein, in step S104, while identifying the image data and determining the multiple cooking objects, the method also includes the following steps: identifying the image data and determining the water level line inside the pot body, wherein the image data also includes: an image of a ruler inside the pot body; obtaining the ratio of solid ingredients to liquid ingredients based on the water level line and the weight data inside the pot body, wherein the multiple cooking objects include: solid ingredients and liquid ingredients; calculating third cooking parameters corresponding to the multiple cooking objects based on the multiple cooking objects and the ratio of solid ingredients to liquid ingredients; and returning the third cooking parameters corresponding to the multiple cooking objects to the cooking utensil, so that the cooking utensil performs cooking operations according to the third cooking parameters.

[0073] Specifically, the weight collection module mentioned above may be a weighing module arranged at the bottom of the pot body.

[0074] In an optional solution, when the benchmark cooking object cannot be determined only by the display area or the cooking level, a weighing module is added to the bottom of the pot of the cooking utensil to weigh the total weight of all the ingredients, that is, to collect weight data, and send the total weight of all the ingredients to the cloud server. The camera arranged on the top of the cover can capture images of all the ingredients inside the pot and images of the ruler, and send the images of all the ingredients and images of the ruler to the cloud server. The cloud server can identify the water level line inside the pot according to the image of the ruler through the image recognition module, thereby obtaining the total volume of all the ingredients. According to the total volume of all the ingredients and the total weight of all the ingredients, the ratio of solid ingredients to water can be obtained, and the corresponding recipe name can be further determined. The appropriate cooking parameters are calculated according to the recipe name and returned to the cooking utensil, and the cooking operation is performed by the cooking utensil.

[0075] For example, if a user needs to make rice, the user can put rice and water into the cooking appliance and close the lid. The camera on the top of the lid can capture images of the rice and water and send them to the cloud server through the network. After receiving the images of the rice and water, the cloud server can identify the ingredients "rice" and "water", and further obtain the total weight of the rice and water through the weighing module, determine the water level according to the image of the ruler, and thus determine the total volume of the ingredients "rice" and "water", and further determine the ratio of rice to water, calculate the appropriate cooking parameters, and return them to the cooking appliance, which then performs the cooking operation.

[0076] Through the above scheme, before the cooking utensil performs the cooking operation, the cooking utensil can collect weight data through the weight acquisition module and collect image data through the image acquisition module. The cloud server can identify the image data, determine multiple cooking objects and water levels, and obtain a third cooking parameter in combination with the weight data. The cooking utensil performs the cooking operation according to the third cooking parameter. Compared with the prior art, there is no need to manually set the cooking parameters, and there is no need to identify the category of the cooking object after boiling, that is, there is no need to identify multiple cooking ingredients by increasing additional heating time, thereby further simplifying the cooking process, improving the cooking effect, and enhancing the user experience.

[0077] Optionally, the ratio of solid ingredients to liquid ingredients is obtained based on the water level line and weight data inside the pot body, including: according to the preset size of the pot body, obtaining the volume data of multiple cooking objects located below the water level line; according to the volume data and the weight data, determining the ratio of solid ingredients to liquid ingredients, wherein the volume data includes: the volume relationship between the solid ingredients and the liquid ingredients, and the weight data includes: the weight relationship between the solid ingredients and the liquid ingredients.

[0078] Specifically, the above-mentioned preset size may be a geometric size of the pot body.

[0079] In an optional solution, after receiving the image data and weight data sent by the cooking utensil, the cloud server can identify the image data, identify the water level, and calculate the volume below the water level based on the geometric dimensions of the pot, thereby obtaining the total volume of all ingredients. The total weight can be expressed as a function f1(w,i), and the total volume can be expressed as a function f2(w,i). By jointly calculating the two functions, w and i can be obtained, and then the ratio of ingredients to water (i / w) can be calculated.

[0080] Through the above scheme, the cloud server can calculate the volume data of the cooking object below the water level according to the preset size of the pot body, and further combine the weight data to obtain the ratio of solid ingredients to liquid ingredients, thereby determining the third cooking parameter and realizing automatic cooking of the cooking appliance.

[0081] Optionally, third cooking parameters corresponding to multiple cooking objects are calculated based on multiple cooking objects and the ratio of solid ingredients to liquid ingredients, including: obtaining a display area of ​​each cooking object in the image data; obtaining a fourth cooking parameter from a second database based on the multiple cooking objects and the display area of ​​each cooking object in the image data; and calculating a third cooking parameter based on the fourth cooking parameter and the ratio of solid ingredients to liquid ingredients.

[0082] Specifically, the second database mentioned above may be a recipe database, in which correspondences between different recipes and cooking parameters are pre-stored, and each recipe includes a variety of ingredients.

[0083] In an optional solution, the cloud server can determine the ingredients with the largest display area and the corresponding recipe names based on the display area of ​​each ingredient, so that it can query the second database to obtain the fourth cooking parameter corresponding to the recipe, and adjust the fourth cooking parameter according to the ratio of solid ingredients to liquid ingredients to calculate the third cooking parameter, and return it to the cooking utensil, and the cooking utensil performs the cooking operation according to the third cooking parameter.

[0084] Through the above scheme, different recipes can be pre-stored in the second database, and the recipes include multiple cooking objects and corresponding cooking parameters. The cloud server can calculate the display area of ​​each cooking object in the image data, and query the corresponding fourth cooking parameter from the second database. Combined with the fourth cooking parameter and the ratio of solid ingredients to liquid ingredients, the cloud server calculates the optimal third cooking parameter, thereby realizing automatic cooking of the cooking appliance.

[0085] Optionally, in step S104, after identifying the image data and determining a plurality of cooking objects, the method further comprises the following step: generating prompt information according to the plurality of cooking objects, wherein the prompt information is used to prompt the order in which each cooking object is added to the cooking utensil.

[0086] In an optional solution, prompts can be given based on the cooking difficulty of all the ingredients placed in the cooking utensil. For example, the user can be prompted to add ingredients that are difficult to cook first, and then add ingredients that are easier to cook after cooking for a while, thereby ensuring that ingredients of different cooking difficulties can all be cooked and the entire cooking process can be completed.

[0087] For example, after the cloud service identifies the ingredients "corn", "pork ribs", and "water", it may generate a prompt message, prompting the user to put the ingredients into the cooking utensil in the order of "water", "corn", and "pork ribs".

[0088] Through the above scheme, after identifying multiple cooking objects, the cloud server can generate prompt information indicating the order of adding each cooking object, so that the user can add multiple cooking objects to the cooking utensil according to the prompt information, thereby simplifying the cooking process, improving the cooking effect, and enhancing the user experience.

[0089] Example 2

[0090] According to an embodiment of the present invention, an embodiment of a control method for a cooking appliance is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0091] Figure 2 is a flow chart of another method for controlling a cooking appliance according to an embodiment of the present invention. Figure 2 As shown, the method comprises the following steps:

[0092] Step S202: receiving image data acquired by an image acquisition module, wherein the image data includes images of a plurality of cooking objects placed in a pot of a cooking utensil.

[0093] Optionally, the image acquisition module is arranged on the top of the cover of the cooking utensil.

[0094] Specifically, the above-mentioned image acquisition module can be a camera installed on the top of the cover of the cooking utensil, so that images of all cooking objects placed inside the pot can be captured; the above-mentioned cooking objects can be ingredients placed inside the cooking utensil, including: solid ingredients such as vegetables and rice, and liquid ingredients such as oil and water, and the present invention does not make specific limitations on this.

[0095] Step S204: sending the image data to the server, and receiving a first cooking parameter returned by the server, wherein the first cooking parameter corresponds to a reference cooking object that meets a preset condition among the plurality of cooking objects.

[0096] Specifically, the above-mentioned server can be a cloud server, which is specially used to identify image data and determine the first cooking parameter; the above-mentioned reference cooking object can be the main ingredient among all the ingredients placed in the pot; the above-mentioned preset conditions can determine whether the cooking object is the reference cooking object, that is, the conditions for determining the main ingredient placed in the pot, for example, the main ingredient can be the ingredient with the largest proportion among a variety of ingredients, or it can be the most difficult ingredient to cook among a variety of ingredients; different ingredients correspond to different cooking parameters, and the cooking parameters may include: cooking time, cooking pressure, heating power, etc.

[0097] Step S206: performing a cooking operation according to the first cooking parameter.

[0098] In an optional solution, before the cooker performs cooking operations, the cooking utensil can capture images of all the ingredients placed inside the pot body through a camera disposed on the top of the cover of the cooking utensil, and upload the images to a cloud server through a network. After receiving the images of all the ingredients uploaded by the cooking utensil, the cloud server can perform image recognition on the images of all the ingredients, identify the name of each ingredient in the image, and then determine the main ingredient based on the proportion of each ingredient and the difficulty of cooking, and read the corresponding first cooking parameter, and return the first cooking parameter to the cooking utensil through the network, so that the cooking utensil can perform cooking operations on all the ingredients placed in the pot body according to the first cooking parameter.

[0099] It should be noted that in order to ensure that images of all ingredients are captured before the cooking appliance is used for cooking, the user can close the cover after putting in all the ingredients needed for cooking, so that the camera disposed on the top of the cover can capture images of all the ingredients.

[0100] For example, if a user needs to make corn and pork ribs soup, the user can put corn, pork ribs and water into the cooking appliance and close the lid. The camera on the top of the lid can capture images of the corn, pork ribs and water, and send them to the cloud server through the network. After receiving the images of the corn, pork ribs and water, the cloud server identifies each ingredient through the image recognition module, namely, the ingredient "corn", the ingredient "pork ribs" and the ingredient "water", and further determines that the main ingredient is pork ribs. The cooking parameters corresponding to the pork ribs are read and returned to the cooking appliance, so that the cooking appliance can perform cooking operations according to the cooking parameters corresponding to the pork ribs to cook corn and pork ribs soup.

[0101] According to the above embodiment of the present invention, the image data collected by the image acquisition module is received, the image data is sent to the server, and the first cooking parameter returned by the server is received, and the cooking operation is performed according to the first cooking parameter, thereby realizing the automatic cooking work of the cooking appliance. It is easy to notice that after the first cooking parameter is obtained, the cooking appliance starts the cooking operation. Compared with the prior art, there is no need to manually set the cooking parameters, and there is no need to identify the category of the cooking object after boiling, that is, there is no need to identify multiple cooking ingredients by adding additional heating time, thereby solving the technical problem of the complicated control method of the cooking appliance in the prior art and the poor cooking effect. Therefore, the technical solution determined by the above embodiment of the present invention can achieve the technical effect of simplifying the cooking process, improving the cooking effect, and enhancing the user experience.

[0102] Optionally, in step S206, during the process of performing the cooking operation according to the first cooking parameter, the method further includes the following steps: receiving a second cooking parameter returned by the server, wherein the second cooking parameter is a cooking parameter corresponding to the highest cooking level among the cooking parameters corresponding to multiple cooking objects, and the cooking level is used to characterize the complexity of the cooking operation performed by the cooking utensil according to the cooking parameter; and performing the cooking operation according to the second cooking parameter.

[0103] Specifically, the above cooking level can represent the difficulty of cooking the ingredients, that is, the complexity of cooking the ingredients. The higher the cooking level, the higher the cooking difficulty, the more difficult the ingredients are to cook, the longer the cooking time required, the greater the cooking pressure, and the higher the heating power.

[0104] In an optional solution, after determining the main ingredient by judging the display area, the cloud server can return the first cooking parameter corresponding to the main ingredient to the cooking utensil, and the cooking utensil can perform cooking operations according to the first cooking parameter corresponding to the main ingredient, and during the cooking process, further obtain the second cooking parameter corresponding to the ingredient with the highest cooking difficulty according to the cooking difficulty of the ingredient, and match the first cooking parameter with the second cooking parameter. If the first cooking parameter fails to match the second cooking parameter, for example, the cooking time in the first cooking parameter is significantly different from the cooking time in the second cooking parameter, it is determined that cooking according to the current first cooking parameter cannot cook all the ingredients, and the second cooking parameter can be returned to the cooking utensil, so that the cooking utensil can automatically switch to the second cooking parameter for cooking operations.

[0105] For example, after the cloud server receives images of corn, pork ribs and water, and identifies the ingredients "corn", "pork ribs" and "water", since a large amount of corn is put in, it can be determined that the ingredient "corn" is the main ingredient based on the display area of ​​the three ingredients, and the cooking appliance operates according to the cooking parameters corresponding to the ingredient "corn". During the operation, the cloud server continues to obtain the cooking levels of the three ingredients, that is, obtains the cooking difficulty of the three ingredients, and obtains cooking level A for ingredient "corn", cooking level B for ingredient "pork ribs" and cooking level C for ingredient "water". It is determined that the highest cooking level is B, then the second cooking parameter corresponding to the ingredient "pork ribs" is obtained, and the first cooking parameter currently executed by the cooking appliance is matched with the second cooking parameter. If the match fails, that is, it is determined that the ingredients "corn", "pork ribs" and "water" cannot be cooked under the current cooking parameters, then the second cooking parameters can be returned to the cooking appliance, and the cooking appliance performs cooking operations according to the second cooking parameters, thereby ensuring that all ingredients can be cooked.

[0106] Through the above scheme, the cloud server can combine multiple judgment methods to determine the main ingredients, and determine the optimal cooking parameters based on the cooking parameters corresponding to the main ingredients obtained by different methods, and control the cooking utensils to perform cooking operations according to the optimal cooking parameters, thereby further improving the cooking effect and enhancing the user experience.

[0107] Optionally, the cooking appliance also includes: a weight acquisition module arranged inside the pot body, wherein, in step S202, while receiving the image data acquired by the image acquisition module, the method also includes the following steps: receiving the weight data of multiple cooking objects acquired by the weight acquisition module; sending the image data and the weight data to a server, and receiving a third cooking parameter returned by the server, wherein the third cooking parameter corresponds to the image data and the weight data, and the image data also includes: an image of a scale inside the pot body; and performing cooking operations according to the third cooking parameter.

[0108] Specifically, the weight collection module mentioned above may be a weighing module arranged at the bottom of the pot body.

[0109] In an optional solution, when the benchmark cooking object cannot be determined only by the display area or the cooking level, a weighing module is added to the bottom of the pot of the cooking utensil to weigh the total weight of all the ingredients, that is, to collect weight data, and send the total weight of all the ingredients to the cloud server. The camera arranged on the top of the cover can capture images of all the ingredients inside the pot and images of the ruler, and send the images of all the ingredients and images of the ruler to the cloud server. The cloud server can identify the water level line inside the pot according to the image of the ruler through the image recognition module, thereby obtaining the total volume of all the ingredients. According to the total volume of all the ingredients and the total weight of all the ingredients, the ratio of solid ingredients to water can be obtained, and the corresponding recipe name can be further determined. The appropriate cooking parameters are calculated according to the recipe name and returned to the cooking utensil, and the cooking operation is performed by the cooking utensil.

[0110] For example, if a user needs to make rice, the user can put rice and water into the cooking appliance and close the lid. The camera on the top of the lid can capture images of the rice and water and send them to the cloud server through the network. After receiving the images of the rice and water, the cloud server can identify the ingredients "rice" and "water", and further obtain the total weight of the rice and water through the weighing module, determine the water level according to the image of the ruler, and thus determine the total volume of the ingredients "rice" and "water", and further determine the ratio of rice to water, calculate the appropriate cooking parameters, and return them to the cooking appliance, which then performs the cooking operation.

[0111] Through the above scheme, before the cooking utensil performs the cooking operation, the cooking utensil can collect weight data through the weight acquisition module and collect image data through the image acquisition module. The cloud server can identify the image data, determine multiple cooking objects and water levels, and obtain a third cooking parameter in combination with the weight data. The cooking utensil performs the cooking operation according to the third cooking parameter. Compared with the prior art, there is no need to manually set the cooking parameters, and there is no need to identify the category of the cooking object after boiling, that is, there is no need to identify multiple cooking ingredients by increasing additional heating time, thereby further simplifying the cooking process, improving the cooking effect, and enhancing the user experience.

[0112] Example 3

[0113] According to an embodiment of the present invention, an embodiment of a control system for a cooking appliance is provided.

[0114] Figure 3 is a schematic diagram of a control system of a cooking appliance according to an embodiment of the present invention, such as Figure 3As shown, the system includes: a cooking utensil 10 and a server 20, wherein the cooking utensil 10 includes: an image acquisition module 11 for acquiring image data, the image data including: images of multiple cooking objects placed in a pot of the cooking utensil 10; the server 20 has a communication relationship with the cooking utensil 10, and is used to identify the image data, determine multiple cooking objects, determine a reference cooking object that meets a preset condition from the multiple cooking objects, and return a first cooking parameter corresponding to the reference cooking object to the cooking utensil 10; the cooking utensil 10 is also used to perform a cooking operation according to the first cooking parameter.

[0115] Optionally, the image acquisition module is arranged on the top of the cover of the cooking utensil.

[0116] Specifically, the above-mentioned cooking utensil may be an electric pressure cooker, an electric rice cooker or other cooking utensil, and the present invention does not make any specific limitation on this; the above-mentioned image acquisition module may be a camera installed on the top of the cover of the cooking utensil, so as to capture images of all cooking objects placed inside the pot body; the above-mentioned cooking objects may be ingredients placed inside the cooking utensil, including: solid ingredients such as vegetables and rice, and liquid ingredients such as oil and water, and the present invention does not make any specific limitation on this; the above-mentioned reference cooking object may be the main ingredient among all the ingredients placed in the pot body; the above-mentioned preset conditions may be used to determine whether the cooking object is a reference cooking object, that is, to determine the main ingredient placed inside the pot body, for example, the main ingredient may be the ingredient that accounts for the largest proportion among a plurality of ingredients, or may be the most difficult ingredient to cook among a plurality of ingredients; different ingredients correspond to different cooking parameters, and the cooking parameters may include: cooking time, cooking pressure, heating power, etc.

[0117] In an optional solution, before the cooker performs cooking operations, the cooking utensil can capture images of all the ingredients placed inside the pot body through a camera disposed on the top of the cover of the cooking utensil, and upload the images to a cloud server through a network. After receiving the images of all the ingredients uploaded by the cooking utensil, the cloud server can perform image recognition on the images of all the ingredients, identify the name of each ingredient in the image, and then determine the main ingredient based on the proportion of each ingredient and the difficulty of cooking, and read the corresponding first cooking parameter, and return the first cooking parameter to the cooking utensil through the network, so that the cooking utensil can perform cooking operations on all the ingredients placed in the pot body according to the first cooking parameter.

[0118] It should be noted that in order to ensure that images of all ingredients are captured before the cooking appliance is used for cooking, the user can close the cover after putting in all the ingredients needed for cooking, so that the camera disposed on the top of the cover can capture images of all the ingredients.

[0119] For example, if a user needs to make corn and pork ribs soup, the user can put corn, pork ribs and water into the cooking appliance and close the lid. The camera on the top of the lid can capture images of the corn, pork ribs and water, and send them to the cloud server through the network. After receiving the images of the corn, pork ribs and water, the cloud server identifies each ingredient through the image recognition module, namely, the ingredient "corn", the ingredient "pork ribs" and the ingredient "water", and further determines that the main ingredient is pork ribs. The cooking parameters corresponding to the pork ribs are read and returned to the cooking appliance, so that the cooking appliance can perform cooking operations according to the cooking parameters corresponding to the pork ribs to cook corn and pork ribs soup.

[0120] According to the above embodiment of the present invention, the cooking appliance collects image data through the image acquisition module, the server identifies the image data, determines multiple cooking objects, determines the reference cooking object that meets the preset conditions from the multiple cooking objects, and returns the first cooking parameter corresponding to the reference cooking object to the cooking appliance. The cooking appliance performs the cooking operation according to the first cooking parameter, thereby realizing the automatic cooking work of the cooking appliance. It is easy to notice that after obtaining the first cooking parameter, the cooking appliance starts the cooking operation. Compared with the prior art, there is no need to manually set the cooking parameter, and there is no need to identify the category of the cooking object after boiling, that is, there is no need to identify multiple cooking ingredients by adding additional heating time, thereby solving the technical problem of the complicated control method of the cooking appliance in the prior art and the poor cooking effect. Therefore, the technical solution determined by the above embodiment of the present invention can achieve the technical effect of simplifying the cooking process, improving the cooking effect, and enhancing the user experience.

[0121] Optionally, the server 20 is further used to obtain the display area of ​​each cooking object in the image data; identify the display area of ​​each cooking object in the image data through a preset recognition algorithm, and determine the cooking object corresponding to the largest display area as the benchmark cooking object.

[0122] Optionally, the server 20 is further used to obtain the cooking level of the cooking parameter corresponding to each cooking object, wherein the cooking level is used to characterize the complexity of the cooking operation performed by the cooking utensil according to the cooking parameter; compare the cooking levels of the cooking parameters corresponding to each cooking object; determine the second cooking parameter corresponding to the highest cooking level; match the second cooking parameter with the first cooking parameter; if the second cooking parameter fails to match the first cooking parameter, return the second cooking parameter to the cooking utensil, so that the cooking utensil performs the cooking operation according to the second cooking parameter.

[0123] Optionally, the server 20 is further configured to obtain a cooking level of a cooking parameter corresponding to each cooking object; compare the cooking levels of the cooking parameters corresponding to each cooking object; and determine a cooking object corresponding to the highest cooking level as a reference cooking object.

[0124] Optionally, the server 20 is further configured to obtain a first cooking parameter corresponding to the reference cooking object from the first database.

[0125] Optionally, Figure 4 is a schematic diagram of a control system of another cooking appliance according to an embodiment of the present invention, Figure 4 As shown, the cooking appliance 10 further includes: a weight collection module 12. The weight collection module 12 is arranged inside the pot body and is used to collect weight data of multiple cooking objects; the server 20 is also used to identify the image data, determine the water level inside the pot body, obtain the ratio of solid food to liquid food according to the water level inside the pot body and the weight data, and calculate the second cooking parameters corresponding to the multiple cooking objects according to the multiple cooking objects and the ratio of solid food to liquid food, wherein the image data also includes: an image of a scale inside the pot body, and the multiple cooking objects include: solid food and liquid food; the cooking appliance 10 is also used to perform cooking operations according to the second cooking parameters.

[0126] Specifically, the weight collection module mentioned above may be a weighing module arranged at the bottom of the pot body.

[0127] In an optional solution, when the benchmark cooking object cannot be determined only by the display area or the cooking level, a weighing module is added to the bottom of the pot of the cooking utensil to weigh the total weight of all the ingredients, that is, to collect weight data, and send the total weight of all the ingredients to the cloud server. The camera arranged on the top of the cover can capture images of all the ingredients inside the pot and images of the ruler, and send the images of all the ingredients and images of the ruler to the cloud server. The cloud server can identify the water level line inside the pot according to the image of the ruler through the image recognition module, thereby obtaining the total volume of all the ingredients. According to the total volume of all the ingredients and the total weight of all the ingredients, the ratio of solid ingredients to water can be obtained, and the corresponding recipe name can be further determined. The appropriate cooking parameters are calculated according to the recipe name and returned to the cooking utensil, and the cooking operation is performed by the cooking utensil.

[0128] For example, if a user needs to make rice, the user can put rice and water into the cooking appliance and close the lid. The camera on the top of the lid can capture images of the rice and water and send them to the cloud server through the network. After receiving the images of the rice and water, the cloud server can identify the ingredients "rice" and "water", and further obtain the total weight of the rice and water through the weighing module, determine the water level according to the image of the ruler, and thus determine the total volume of the ingredients "rice" and "water", and further determine the ratio of rice to water, calculate the appropriate cooking parameters, and return them to the cooking appliance, which then performs the cooking operation.

[0129] Through the above scheme, before the cooking utensil performs the cooking operation, the cooking utensil can collect weight data through the weight acquisition module and collect image data through the image acquisition module. The cloud server can identify the image data, determine multiple cooking objects and water levels, and obtain a third cooking parameter in combination with the weight data. The cooking utensil performs the cooking operation according to the third cooking parameter. Compared with the prior art, there is no need to manually set the cooking parameters, and there is no need to identify the category of the cooking object after boiling, that is, there is no need to identify multiple cooking ingredients by increasing additional heating time, thereby further simplifying the cooking process, improving the cooking effect, and enhancing the user experience.

[0130] Optionally, the server 20 is also used to obtain volume data of multiple cooking objects located below the water level line according to a preset size of the pot body; determine the ratio of solid ingredients to liquid ingredients according to the volume data and weight data, wherein the volume data includes: the volume relationship between the solid ingredients and the liquid ingredients, and the weight data includes: the weight relationship between the solid ingredients and the liquid ingredients.

[0131] Optionally, the server 20 is also used to obtain the display area of ​​each cooking object in the image data; obtain a fourth cooking parameter from the second database based on multiple cooking objects and the display area of ​​each cooking object in the image data; and calculate a third cooking parameter based on the fourth cooking parameter and the ratio of solid ingredients to liquid ingredients.

[0132] Optionally, the server 20 is further configured to generate prompt information according to the multiple cooking objects, wherein the prompt information is used to prompt the order in which each cooking object is added to the cooking utensil.

[0133] Figure 5 is a schematic diagram of an optional control system of a cooking appliance according to an embodiment of the present invention, Figure 6 is a schematic diagram of another optional control system of a cooking appliance according to an embodiment of the present invention, Figure 5 and Figure 6 A preferred embodiment of the present invention is described in detail.

[0134] like Figure 5As shown, the cooking utensil may include an image acquisition module, a communication module and an execution module, and the server may include an image recognition module, a main ingredient identification module and an ingredient database, wherein the cooking utensil and the server have a communication relationship. A plurality of ingredients are placed in the cooking utensil, and the cover is closed. At this time, the image acquisition module placed on the top of the cover collects images of all the ingredients, obtains digital images, and sends them to the server through the communication module; after receiving the digital images, the server may perform image recognition through the image recognition module, determine the names of all the ingredients placed in the cooking utensil, and calculate the area of ​​each ingredient in the digital image, and feed back the ingredient names and areas to the main ingredient identification module, obtain the main ingredient through the pattern recognition algorithm, and query the cooking parameters corresponding to the main ingredient through the first database, and return them to the execution module of the cooking utensil, and the execution module performs cooking operations according to the cooking parameters corresponding to the main ingredient.

[0135] like Figure 6 As shown, the cooking utensil includes an image acquisition module, a weighing module, a communication module and an execution module, and the server includes an image recognition module, a recipe identification module, a calculation module and a recipe database, wherein the cooking utensil and the server have a communication relationship. A variety of ingredients are put into the cooking utensil, and the cover is closed. At this time, the image acquisition module placed on the top of the cover collects images of all ingredients and the scale in the pot to obtain a digital image. At the same time, the total weight of all ingredients is obtained through the weighing module, and the digital image and the total weight are transmitted to the server through the communication module; after receiving the digital image, the server can identify the name of all ingredients and the area of ​​each ingredient in the digital image through the image recognition module, and determine the water level line in combination with the geometric size of the pot body, and transmit the height of the water level line and the total weight of all ingredients to the calculation module, and the calculation module calculates the ratio of solid ingredients to liquid ingredients, and feeds back the ingredient name, the ingredient area and the ratio of solid ingredients to liquid ingredients to the recipe identification module, determines the corresponding recipe name, and calculates the appropriate cooking parameters, and returns the appropriate cooking parameters to the execution module of the cooking utensil for cooking operation.

[0136] Through the above scheme, image recognition technology is used to determine the type of ingredients in the cooking utensil, and the main ingredients are determined. The cooking method is further determined in combination with weight data, and automatic cooking of the cooking utensil is realized. The cooking method can be determined before the cooking utensil starts cooking and returned to the cooking utensil for execution, without the need to increase additional heating time to determine the type of ingredients.

[0137] Example 4

[0138] According to an embodiment of the present invention, an embodiment of a server is provided.

[0139] Figure 7 is a schematic diagram of a server according to an embodiment of the present invention, such as Figure 7 As shown, the server includes: a communication device 21, an image recognition device 22 and a first discrimination device 23. The communication device 21 is used to receive image data sent by the cooking utensil, wherein the image data includes: images of multiple cooking objects placed in the pot of the cooking utensil, and the image data is collected by an image acquisition module arranged on the cooking utensil; the image recognition device 22 is connected to the communication device 21, and is used to recognize the image data and determine the multiple cooking objects; the first discrimination device 23 is connected to the image recognition device 22, and is used to determine the reference cooking object that meets the preset conditions from the multiple cooking objects; the communication device 21 is connected to the first discrimination device 23, and is used to return the first cooking parameter corresponding to the reference cooking object to the cooking utensil, so that the cooking utensil performs the cooking operation according to the first cooking parameter.

[0140] Optionally, the image acquisition module is arranged on the top of the cover of the cooking utensil.

[0141] Specifically, the above-mentioned cooking utensil may be an electric pressure cooker, an electric rice cooker or other cooking utensil, which is not specifically limited in the present invention; the above-mentioned image acquisition module may be a camera installed on the top of the cover of the cooking utensil, so as to capture images of all cooking objects placed inside the pot body; the above-mentioned cooking objects may be ingredients placed inside the cooking utensil, including: solid ingredients such as vegetables and rice, and liquid ingredients such as oil and water, which is not specifically limited in the present invention; the above-mentioned reference cooking object may be the main ingredient among all the ingredients placed in the pot body; the above-mentioned preset conditions may be used to determine whether the cooking object is a reference cooking object, that is, to determine the main ingredient placed in the pot body, for example, the main ingredient may be the ingredient with the largest proportion among a variety of ingredients, or the ingredient that is the most difficult to cook among a variety of ingredients; different ingredients correspond to different cooking parameters, and the cooking parameters may include: cooking time, cooking pressure, heating power, etc.; the above-mentioned communication device 21 may be a wireless communication device, for example, a WIFI communication module, a 3G wireless communication module, which is not specifically limited in the present invention; the above-mentioned image recognition device 22 may be such as Figure 5 The image recognition module shown; the first discrimination device 23 may be as follows Figure 5 The main ingredient identification module shown.

[0142] In an optional solution, before the cooker performs cooking operations, the cooking utensil can capture images of all the ingredients placed inside the pot body through a camera disposed on the top of the cover of the cooking utensil, and upload the images to a cloud server through a network. After receiving the images of all the ingredients uploaded by the cooking utensil, the cloud server can perform image recognition on the images of all the ingredients, identify the name of each ingredient in the image, and then determine the main ingredient based on the proportion of each ingredient and the difficulty of cooking, and read the corresponding first cooking parameter, and return the first cooking parameter to the cooking utensil through the network, so that the cooking utensil can perform cooking operations on all the ingredients placed in the pot body according to the first cooking parameter.

[0143] It should be noted that in order to ensure that images of all ingredients are captured before the cooking appliance is used for cooking, the user can close the cover after putting in all the ingredients needed for cooking, so that the camera disposed on the top of the cover can capture images of all the ingredients.

[0144] For example, if a user needs to make corn and pork ribs soup, the user can put corn, pork ribs and water into the cooking appliance and close the lid. The camera on the top of the lid can capture images of the corn, pork ribs and water, and send them to the cloud server through the network. After receiving the images of the corn, pork ribs and water, the cloud server identifies each ingredient through the image recognition module, namely, the ingredient "corn", the ingredient "pork ribs" and the ingredient "water", and further determines that the main ingredient is pork ribs. The cooking parameters corresponding to the pork ribs are read and returned to the cooking appliance, so that the cooking appliance can perform cooking operations according to the cooking parameters corresponding to the pork ribs to cook corn and pork ribs soup.

[0145] According to the above embodiment of the present invention, the image data sent by the cooking appliance is received by the communication device 21, the image data is identified by the identification device 22, a plurality of cooking objects are determined, the reference cooking object that meets the preset conditions is determined from the plurality of cooking objects by the first discrimination device 23, and the first cooking parameter corresponding to the reference cooking object is returned to the cooking appliance by the communication device 21, so that the cooking appliance performs the cooking operation according to the first cooking parameter, thereby realizing the automatic cooking work of the cooking appliance. It is easy to notice that after the first cooking parameter is obtained, the cooking appliance starts the cooking operation. Compared with the prior art, there is no need to manually set the cooking parameter, and there is no need to identify the category of the cooking object after boiling, that is, there is no need to identify multiple cooking ingredients by adding additional heating time, thereby solving the technical problem that the control method of the cooking appliance in the prior art is complicated and the cooking effect is poor. Therefore, the technical solution determined by the above embodiment of the present invention can achieve the technical effect of simplifying the cooking process, improving the cooking effect, and enhancing the user experience.

[0146] Optionally, the server further includes: a first database, wherein the first database is connected to the first identification device 23 and is used to store the corresponding relationship between the target cooking object and the first cooking parameter.

[0147] Optionally, Figure 8 is a schematic diagram of another server according to an embodiment of the present invention, such as Figure 8 As shown, the communication device 21 is also used to receive the weight data of multiple cooking objects sent by the cooking utensil, wherein the weight data is collected by the weight collection module arranged inside the pot body; the image recognition device 22 is also used to recognize the image data and determine the water level line inside the pot body, wherein the image data also includes: the image of the scale inside the pot body; the server also includes: a processor 24 and a second discrimination device 25. The processor 24 is connected to the communication device 21 and the image recognition device 22, and is used to obtain the ratio of solid food to liquid food according to the water level line and weight data inside the pot body, wherein the multiple cooking objects include: solid food and liquid food; the second discrimination device 25 is connected to the processor 24 and the image recognition device 22, and is used to calculate the second cooking parameters corresponding to the multiple cooking objects according to the multiple cooking objects and the ratio of solid food to liquid food; the communication device 21 is connected to the second discrimination device 25, and is also used to return the second cooking parameters corresponding to the multiple cooking objects to the cooking utensil, so that the cooking utensil performs the cooking operation according to the second cooking parameters.

[0148] Specifically, the weight collection module may be a weighing module disposed at the bottom of the pot body; the processor may be Figure 6 The calculation module shown; the second determination device mentioned above can be as follows Figure 6 The recipe identification module shown.

[0149] In an optional solution, when the benchmark cooking object cannot be determined only by the display area or the cooking level, a weighing module is added to the bottom of the pot of the cooking utensil to weigh the total weight of all the ingredients, that is, to collect weight data, and send the total weight of all the ingredients to the cloud server. The camera arranged on the top of the cover can capture images of all the ingredients inside the pot and images of the ruler, and send the images of all the ingredients and images of the ruler to the cloud server. The cloud server can identify the water level line inside the pot according to the image of the ruler through the image recognition module, thereby obtaining the total volume of all the ingredients. According to the total volume of all the ingredients and the total weight of all the ingredients, the ratio of solid ingredients to water can be obtained, and the corresponding recipe name can be further determined. The appropriate cooking parameters are calculated according to the recipe name and returned to the cooking utensil, and the cooking operation is performed by the cooking utensil.

[0150] For example, if a user needs to make rice, the user can put rice and water into the cooking appliance and close the lid. The camera on the top of the lid can capture images of the rice and water and send them to the cloud server through the network. After receiving the images of the rice and water, the cloud server can identify the ingredients "rice" and "water", and further obtain the total weight of the rice and water through the weighing module, determine the water level according to the image of the ruler, and thus determine the total volume of the ingredients "rice" and "water", and further determine the ratio of rice to water, calculate the appropriate cooking parameters, and return them to the cooking appliance, which then performs the cooking operation.

[0151] Through the above scheme, before the cooking utensil performs the cooking operation, the cooking utensil can collect weight data through the weight acquisition module and collect image data through the image acquisition module. The cloud server can identify the image data, determine multiple cooking objects and water levels, and obtain second cooking parameters in combination with the weight data. The cooking utensil performs the cooking operation according to the second cooking parameters. Compared with the prior art, there is no need to manually set the cooking parameters, and there is no need to identify the category of the cooking object after boiling, that is, there is no need to identify multiple cooking ingredients by increasing additional heating time, thereby further simplifying the cooking process, improving the cooking effect, and enhancing the user experience.

[0152] Optionally, the server further includes: a second database for storing the correspondence between a plurality of cooking objects and the third cooking parameter; and a second identification device 25 connected to the second database for calculating the second cooking parameter according to the third cooking parameter and the ratio of the solid food material to the liquid food material.

[0153] Optionally, the server further comprises: a prompt device, wherein the prompt device is connected to the image recognition device 22 and is used to generate prompt information according to a plurality of cooking objects.

[0154] Example 5

[0155] According to an embodiment of the present invention, an embodiment of a cooking appliance is provided.

[0156] Fig. 9 is a schematic diagram of a cooking appliance according to an embodiment of the present invention, such as Fig. 9As shown, the cooking appliance includes: a pot body, a cover body, an image acquisition module 11, a communication module 13 and an execution module 15. The pot body is used to hold multiple cooking objects; the cover body is set on the pot body; the image acquisition module 11 is used to collect image data, wherein the image data includes: images of multiple cooking objects held in the pot body; the communication module 13 is connected to the image acquisition module 11, and is used to send the image data to the server and receive the first cooking parameter returned by the server, wherein the first cooking parameter corresponds to the reference cooking object that meets the preset conditions among the multiple cooking objects; the execution module 15 is connected to the communication module 13, and is used to perform the cooking operation according to the first cooking parameter.

[0157] Optionally, the image acquisition module is arranged on the top of the cover of the cooking utensil.

[0158] Specifically, the above-mentioned image acquisition module can be a camera installed on the top of the cover of the cooking utensil, so that images of all cooking objects placed inside the pot can be captured; the above-mentioned cooking objects can be ingredients placed inside the cooking utensil, including: solid ingredients such as vegetables and rice, and liquid ingredients such as oil and water, and the present invention does not make specific limitations on this; the above-mentioned server can be a cloud server, which is specifically used to identify image data and determine the first cooking parameter; the above-mentioned reference cooking object can be the main ingredient among all the ingredients placed in the pot; the above-mentioned preset conditions can determine whether the cooking object is a condition for the reference cooking object, that is, the condition for determining the main ingredient placed in the pot, for example, the main ingredient can be the ingredient with the largest proportion among a variety of ingredients, or it can be the most difficult ingredient to cook among a variety of ingredients; different ingredients correspond to different cooking parameters, and the cooking parameters can include: cooking time, cooking pressure, heating power, etc.; the above-mentioned communication module can be a wireless communication module, for example, a WIFI communication module, a 3G wireless communication module, etc., and the present invention does not make specific limitations on this.

[0159] In an optional solution, before the cooker performs cooking operations, the cooking utensil can capture images of all the ingredients placed inside the pot body through a camera disposed on the top of the cover of the cooking utensil, and upload the images to a cloud server through a network. After receiving the images of all the ingredients uploaded by the cooking utensil, the cloud server can perform image recognition on the images of all the ingredients, identify the name of each ingredient in the image, and then determine the main ingredient based on the proportion of each ingredient and the difficulty of cooking, and read the corresponding first cooking parameter, and return the first cooking parameter to the cooking utensil through the network, so that the cooking utensil can perform cooking operations on all the ingredients placed in the pot body according to the first cooking parameter.

[0160] It should be noted that in order to ensure that images of all ingredients are captured before the cooking appliance is used for cooking, the user can close the cover after putting in all the ingredients needed for cooking, so that the camera disposed on the top of the cover can capture images of all the ingredients.

[0161] For example, if a user needs to make corn and pork ribs soup, the user can put corn, pork ribs and water into the cooking appliance and close the lid. The camera on the top of the lid can capture images of the corn, pork ribs and water, and send them to the cloud server through the network. After receiving the images of the corn, pork ribs and water, the cloud server identifies each ingredient through the image recognition module, namely, the ingredient "corn", the ingredient "pork ribs" and the ingredient "water", and further determines that the main ingredient is pork ribs. The cooking parameters corresponding to the pork ribs are read and returned to the cooking appliance, so that the cooking appliance can perform cooking operations according to the cooking parameters corresponding to the pork ribs to cook corn and pork ribs soup.

[0162] According to the above embodiment of the present invention, the cooking appliance collects image data through the image acquisition module 11, sends the image data to the server through the communication module 13, and receives the first cooking parameter returned by the server, and executes the cooking operation according to the first cooking parameter through the execution module 15, thereby realizing the automatic cooking work of the cooking appliance. It is easy to notice that after obtaining the first cooking parameter, the cooking appliance starts the cooking operation. Compared with the prior art, there is no need to manually set the cooking parameter, and there is no need to identify the category of the cooking object after boiling, that is, there is no need to identify multiple cooking ingredients by adding additional heating time, thereby solving the technical problem of the complicated control method of the cooking appliance in the prior art and the poor cooking effect. Therefore, the technical solution determined by the above embodiment of the present invention can achieve the technical effect of simplifying the cooking process, improving the cooking effect, and enhancing the user experience.

[0163] Optionally, Fig.10 is a schematic diagram of another cooking appliance according to an embodiment of the present invention, Fig.10 As shown, the cooking appliance further includes: a weight collection module 12. The weight collection module 12 is arranged inside the pot body and is used to collect weight data of multiple cooking objects; a communication module 13 is connected to the weight collection module 12 and is used to send image data and weight data to a server and receive a second cooking parameter returned by the server, wherein the second cooking parameter corresponds to the image data and weight data, and the image data further includes: an image of a scale inside the pot body; and an execution module 15 is further used to execute a cooking operation according to the second cooking parameter.

[0164] Specifically, the weight collection module mentioned above may be a weighing module arranged at the bottom of the pot body.

[0165] In an optional solution, when the benchmark cooking object cannot be determined only by the display area or the cooking level, a weighing module is added to the bottom of the pot of the cooking utensil to weigh the total weight of all the ingredients, that is, to collect weight data, and send the total weight of all the ingredients to the cloud server. The camera arranged on the top of the cover can capture images of all the ingredients inside the pot and images of the ruler, and send the images of all the ingredients and images of the ruler to the cloud server. The cloud server can identify the water level line inside the pot according to the image of the ruler through the image recognition module, thereby obtaining the total volume of all the ingredients. According to the total volume of all the ingredients and the total weight of all the ingredients, the ratio of solid ingredients to water can be obtained, and the corresponding recipe name can be further determined. The appropriate cooking parameters are calculated according to the recipe name and returned to the cooking utensil, and the cooking operation is performed by the cooking utensil.

[0166] For example, if a user needs to make rice, the user can put rice and water into the cooking appliance and close the lid. The camera on the top of the lid can capture images of the rice and water and send them to the cloud server through the network. After receiving the images of the rice and water, the cloud server can identify the ingredients "rice" and "water", and further obtain the total weight of the rice and water through the weighing module, determine the water level according to the image of the ruler, and thus determine the total volume of the ingredients "rice" and "water", and further determine the ratio of rice to water, calculate the appropriate cooking parameters, and return them to the cooking appliance, which then performs the cooking operation.

[0167] Through the above scheme, before the cooking utensil performs the cooking operation, the cooking utensil can collect weight data through the weight acquisition module and collect image data through the image acquisition module. The cloud server can identify the image data, determine multiple cooking objects and water levels, and obtain second cooking parameters in combination with the weight data. The cooking utensil performs the cooking operation according to the second cooking parameters. Compared with the prior art, there is no need to manually set the cooking parameters, and there is no need to identify the category of the cooking object after boiling, that is, there is no need to identify multiple cooking ingredients by increasing additional heating time, thereby further simplifying the cooking process, improving the cooking effect, and enhancing the user experience.

[0168] Example 6

[0169] According to an embodiment of the present invention, an embodiment of a storage medium is provided, wherein the storage medium includes a stored program, wherein when the program is executed, the device where the storage medium is located is controlled to execute the cooking appliance control method in the above-mentioned embodiments 1 and 2.

[0170] Example 7

[0171] According to an embodiment of the present invention, an embodiment of a processor is provided, and the processor is used to run a program, wherein the control method of the cooking appliance in the above-mentioned embodiments 1 and 2 is executed when the program is run.

[0172] The serial numbers of the above embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.

[0173] In the above embodiments of the present invention, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0174] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. Among them, the device embodiments described above are only schematic. For example, the division of the units can be a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of units or modules, which can be electrical or other forms.

[0175] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple units. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0176] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0177] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, magnetic disk or optical disk and other media that can store program codes.

[0178] The above is only a preferred embodiment of the present invention. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principle of the present invention. These improvements and modifications should also be regarded as the scope of protection of the present invention.

Claims

1. A method for controlling a cooking appliance, characterized in that: include: Receiving image data sent by a cooking utensil, wherein the image data includes: images of a plurality of cooking objects contained in a pot of the cooking utensil, the image data being collected by an image collection module disposed on the cooking utensil; Recognizing the image data to determine a plurality of cooking objects; Determining a reference cooking object that meets a preset condition from among the plurality of cooking objects; returning a first cooking parameter corresponding to the reference cooking object to the cooking appliance, so that the cooking appliance performs a cooking operation according to the first cooking parameter; Among them, determining a benchmark cooking object that meets preset conditions from a plurality of the cooking objects includes: obtaining a display area of ​​each of the cooking objects in the image data, identifying the display area of ​​each of the cooking objects in the image data by a preset recognition algorithm, and determining that the cooking object corresponding to the largest display area is the benchmark cooking object; or, obtaining a cooking level of a cooking parameter corresponding to each of the cooking objects, comparing the cooking levels of the cooking parameters corresponding to each of the cooking objects, and determining that the cooking object corresponding to the highest cooking level is the benchmark cooking object.

2. The method according to claim 1, characterized in that During the process in which the cooking appliance performs a cooking operation according to the first cooking parameter, the method further includes: Acquire a cooking level of the cooking parameter corresponding to each cooking object, wherein the cooking level is used to represent the complexity of the cooking operation performed by the cooking utensil according to the cooking parameter; comparing the cooking levels of the cooking parameters corresponding to each of the cooking objects; determining a second cooking parameter corresponding to the highest cooking level; matching the second cooking parameter with the first cooking parameter; If the second cooking parameter fails to match the first cooking parameter, the second cooking parameter is returned to the cooking appliance, so that the cooking appliance performs a cooking operation according to the second cooking parameter.

3. The method according to claim 1, characterized in that Before returning the first cooking parameter corresponding to the reference cooking object to the cooking appliance, the method further includes: A first cooking parameter corresponding to the reference cooking object is obtained from a first database.

4. The method according to any one of claims 1 to 3, characterized in that While receiving the image data sent by the cooking utensil, receiving the weight data of the plurality of cooking objects sent by the cooking utensil, and collecting the weight data by a weight collection module disposed inside the pot body, wherein while recognizing the image data and determining the plurality of cooking objects, the method further includes: Identify the image data to determine the water level inside the pot body, wherein the image data further includes: an image of a scale inside the pot body; According to the water level line inside the pot body and the weight data, the ratio of solid food to liquid food is obtained, wherein the plurality of cooking objects include: the solid food and the liquid food; Calculating and obtaining third cooking parameters corresponding to the plurality of cooking objects according to the plurality of cooking objects and the ratio of the solid food material to the liquid food material; The third cooking parameters corresponding to the plurality of cooking objects are returned to the cooking appliance, so that the cooking appliance performs a cooking operation according to the third cooking parameters.

5. The method according to claim 4, characterized in that Obtaining the ratio of solid food to liquid food according to the water level line inside the pot body and the weight data, including: According to the preset size of the pot body, obtaining volume data of a plurality of the cooking objects located below the water level line; The ratio of the solid food material to the liquid food material is determined according to the volume data and the weight data, wherein the volume data includes: the volume relationship between the solid food material and the liquid food material, and the weight data includes: the weight relationship between the solid food material and the liquid food material.

6. The method according to claim 4, characterized in that Calculating the third cooking parameters corresponding to the plurality of cooking objects according to the plurality of cooking objects and the ratio of the solid food to the liquid food includes: acquiring a display area of ​​each of the cooking objects in the image data; acquiring a fourth cooking parameter from a second database according to the plurality of cooking objects and a display area of ​​each cooking object in the image data; The third cooking parameter is calculated according to the fourth cooking parameter and the ratio of the solid food material to the liquid food material.

7. The method according to claim 1 or 2, characterized in that: After identifying the image data and determining the plurality of cooking objects, the method further includes: Prompt information is generated according to the plurality of cooking objects, wherein the prompt information is used to prompt the order in which each cooking object is added to the cooking utensil.

8. The method according to any one of claims 1 to 2, characterized in that: The image acquisition module is arranged on the top of the cover of the cooking utensil.

9. A method for controlling a cooking appliance, characterized in that: Cooking utensils include: Image acquisition module, wherein the method comprises: receiving image data acquired by the image acquisition module, wherein the image data includes: images of a plurality of cooking objects contained in the pot of the cooking utensil; sending the image data to a server, and receiving a first cooking parameter returned by the server, wherein the first cooking parameter corresponds to a reference cooking object that meets a preset condition among the plurality of cooking objects; performing a cooking operation according to the first cooking parameter; The reference cooking object is to identify the display area of ​​each cooking object in the image data through a preset recognition algorithm, and determine the cooking object corresponding to the maximum display area, where the display area is the display area of ​​each cooking object obtained in the image data; or, the reference cooking object is to compare the cooking levels of the cooking parameters corresponding to each cooking object, and determine the cooking object corresponding to the highest cooking level, where the cooking level is the cooking level in the cooking parameters corresponding to each cooking object.

10. The method according to claim 9, characterized in that In the process of performing the cooking operation according to the first cooking parameter, the method further includes: receiving a second cooking parameter returned by the server, wherein the second cooking parameter is a cooking parameter corresponding to a highest cooking level among the cooking parameters corresponding to the plurality of cooking objects, and the cooking level is used to indicate the complexity of the cooking operation performed by the cooking utensil according to the cooking parameter; The cooking operation is performed according to the second cooking parameter.

11. The method according to claim 9, characterized in that The cooking appliance further comprises: a weight acquisition module disposed inside the pot body, wherein while receiving the image data acquired by the image acquisition module, the method further comprises: receiving weight data of the plurality of cooking objects collected by the weight collection module; sending the image data and the weight data to the server, and receiving a third cooking parameter returned by the server, wherein the third cooking parameter corresponds to the image data and the weight data, and the image data further includes: an image of a scale inside the pot body; The cooking operation is performed according to the third cooking parameter.

12. A control system for a cooking appliance, characterized in that: include: A cooking utensil (10) comprising: an image acquisition module (11) for acquiring image data, wherein the image data comprises: images of a plurality of cooking objects contained in a pot of the cooking utensil (10); A server (20) is in communication with the cooking utensil (10), and is used to identify the image data, determine a plurality of cooking objects, determine a reference cooking object that meets a preset condition from the plurality of cooking objects, and return a first cooking parameter corresponding to the reference cooking object to the cooking utensil (10); The cooking appliance (10) is also used to perform a cooking operation according to the first cooking parameter; The server (20) is further configured to obtain a display area of ​​each cooking object in the image data, identify the display area of ​​each cooking object in the image data using a preset recognition algorithm, and determine that the cooking object corresponding to the largest display area is the reference cooking object; or, obtain a cooking level of a cooking parameter corresponding to each cooking object, compare the cooking levels of the cooking parameters corresponding to each cooking object, and determine that the cooking object corresponding to the highest cooking level is the reference cooking object.

13. The system according to claim 12, characterized in that The cooking appliance (10) further comprises: a weight collection module (12), arranged inside the pot body, and used for collecting weight data of a plurality of cooking objects; The server (20) is further used to identify the image data, determine the water level inside the pot body, obtain the ratio of solid food to liquid food according to the water level inside the pot body and the weight data, and calculate the second cooking parameters corresponding to the plurality of cooking objects according to the plurality of cooking objects and the ratio of the solid food to the liquid food, wherein the image data further includes: an image of a scale inside the pot body, and the plurality of cooking objects include: the solid food and the liquid food; The cooking appliance (10) is also used to perform a cooking operation according to the second cooking parameters.

14. A server, characterized in that: include: A communication device (21) for receiving image data sent by a cooking utensil, wherein the image data comprises: images of a plurality of cooking objects contained in a pot of the cooking utensil, the image data being collected by an image collection module arranged on the cooking utensil; An image recognition device (22) connected to the communication device (21) and used to recognize the image data and determine a plurality of cooking objects; A first judging device (23), connected to the image recognition device (22), for judging a reference cooking object that meets a preset condition from among the plurality of cooking objects; The communication device (21) is connected to the first determination device (23) and is used to return the first cooking parameter corresponding to the reference cooking object to the cooking utensil, so that the cooking utensil performs a cooking operation according to the first cooking parameter; The first identification device (23) is further used to obtain the display area of ​​each cooking object in the image data, identify the display area of ​​each cooking object in the image data through a preset identification algorithm, and determine that the cooking object corresponding to the largest display area is the reference cooking object; or, obtain the cooking level of the cooking parameter corresponding to each cooking object, compare the cooking level of the cooking parameter corresponding to each cooking object, and determine that the cooking object corresponding to the highest cooking level is the reference cooking object.

15. The server according to claim 14, characterized in that: The communication device (21) is also used to receive weight data of a plurality of cooking objects sent by the cooking utensil, wherein the weight data is collected by a weight collection module arranged inside the pot body; The image recognition device (22) is also used to recognize the image data to determine the water level inside the pot body, wherein the image data also includes: an image of a scale inside the pot body; The server further comprises: a processor (24), connected to the communication device (21) and the image recognition device (22), and configured to obtain a ratio of solid food materials to liquid food materials according to a water level line inside the pot body and the weight data, wherein the plurality of cooking objects comprises: the solid food materials and the liquid food materials; A second identification device (25) is connected to the processor (24) and the image recognition device (22), and is used to calculate and obtain second cooking parameters corresponding to the plurality of cooking objects according to the plurality of cooking objects and the ratio of the solid food material to the liquid food material; The communication device (21) is connected to the second determination device (25), and is also used to return the second cooking parameters corresponding to the plurality of cooking objects to the cooking utensil, so that the cooking utensil performs the cooking operation according to the second cooking parameters.

16. A cooking utensil, characterized in that: include: A pot body, used for holding a plurality of cooking objects; A cover body, which is arranged on the pot body; An image acquisition module (11) is used to acquire image data, wherein the image data includes: images of a plurality of cooking objects contained in the pot; a communication module (13), connected to the image acquisition module (11), and configured to send the image data to a server and receive a first cooking parameter returned by the server, wherein the first cooking parameter corresponds to a reference cooking object that meets a preset condition among the plurality of cooking objects; an execution module (15), connected to the communication module (13), and configured to execute a cooking operation according to the first cooking parameter; The reference cooking object is to identify the display area of ​​each cooking object in the image data through a preset recognition algorithm, and determine the cooking object corresponding to the maximum display area, where the display area is the display area of ​​each cooking object obtained in the image data; or, the reference cooking object is to compare the cooking levels of the cooking parameters corresponding to each cooking object, and determine the cooking object corresponding to the highest cooking level, where the cooking level is the cooking level in the cooking parameters corresponding to each cooking object.

17. The cooking appliance according to claim 16, characterized in that The cooking appliance further comprises: A weight collection module (12), arranged inside the pot body, for collecting weight data of a plurality of cooking objects; The communication module (13) is connected to the weight acquisition module (12), and is used to send the image data and the weight data to the server, and receive a second cooking parameter returned by the server, wherein the second cooking parameter corresponds to the image data and the weight data, and the image data further includes: an image of a scale inside the pot body; The execution module (15) is also used to execute the cooking operation according to the second cooking parameter.

18. A storage medium, characterized in that: The storage medium includes a stored program, wherein when the program is executed, the device where the storage medium is located is controlled to execute the cooking appliance control method according to any one of claims 1 to 11.

19. A processor, characterized in that: The processor is used to run a program, wherein the program, when running, executes the cooking appliance control method according to any one of claims 1 to 11.

Citation Information

Patent Citations

  • Cooking data test system and control method thereof

    CN103984248A

  • Intelligent cooking control method

    CN106773859A

  • Intelligent cooking system

    CN205447921U

  • Cooking appliance control system and cooker integrated control device

    JP2007132567A