Large ai model-based cooking method and smart cooking device using same

Abstract

The present invention relates to a large AI model-based cooking method and a smart cooking device using same, which are characterized by being applied to smart cooking devices. The smart cooking device is provided with an information collection module, a processor and a wireless communication module, the information collection module and the wireless communication module being electrically connected to the processor. The information collection module is used for receiving cooking demand information input by a user in the form of voices, videos, texts, pictures or 3D models, and pushing the cooking demand information to a large cooking AI model at a cloud. The large cooking AI model analyzes the cooking demand information and generates a new cooking method. The processor executes the new cooking method generated by the large cooking AI model and provides the user with guidance on cooking. The present invention achieves the application of large AI large models in the field of cooking. The smart cooking device can autonomously generate cooking methods meeting individual demands of users in the form of voices, videos, texts, pictures or 3D models, so as to cook meals meeting different demands.

Description

A cooking method based on AI large model and intelligent cooking device thereof Technical Field

[0001] The present invention relates to a cooking device and method, and in particular to a cooking method based on an AI large model and an intelligent cooking device thereof. Background Art

[0002] With the development of science and technology and the accelerated pace of life, smart cooking devices have emerged, which can realize automated cooking.

[0003] Regarding the combination of AI big models and smart cooking devices, the latest existing technologies include patent application number CN 116843510 A, published on October 3, 2023, entitled "Smart Cooking Machine Cloud Platform Data Management System and Method Based on AI Big Model," and application number 202310784823.7;

[0004] This invention application discloses a cloud platform data management system and method for intelligent cooking machines based on an AI big model, which relates to the technical field of data management systems. The management method includes the following steps: various parameter data of the cooking process are collected through the collection end, and the parameter data are transmitted to the cloud platform through the network to ensure real-time and stability. The processing end analyzes the stored parameter data through the AI ​​big model to analyze whether there is any abnormality in the intelligent cooking machine during the cooking process. When the intelligent cooking machine is analyzed to have an abnormality, it is judged that there is a deviation in the taste of the dish based on the analysis result, and the management system sends a warning signal. At this time, other intelligent cooking machines are replaced for cooking. The invention can judge whether there is a deviation in the taste of the dish cooked this time based on the operating status of the intelligent cooking machine, so as to be able to issue a timely warning to ensure the quality and taste of the dish.

[0005] The role of applying AI big models to smart cooking machines in the existing technology is only for the processing end to analyze the stored parameter data through the AI ​​big model to analyze whether there is any abnormality in the smart cooking machine during the cooking process. When the smart cooking machine is analyzed to have an abnormality, it is judged based on the analysis results that there is a deviation in the taste of the dish, and it is necessary to replace other smart cooking machines to ensure the quality and taste of the dish. In fact, replacing other smart cooking machines for cooking may not necessarily ensure the quality and taste of the dish, because the other replaced smart cooking machines may also have abnormalities. In this way, users need to constantly replace smart cooking machines to ensure the quality and taste of the dish.

[0006] The present invention provides a cooking method based on an AI big model and an intelligent cooking device thereof. The method uses a third-party AI big model to perform fine-tuning training on a massive cooking data set. After the training is completed, a cooking AI big model with all relevant data of the cooking method is generated. The user inputs cooking requirement information through voice, video, text, picture or 3D model format, and a new cooking method is generated by calling the cooking AI big model. The intelligent cooking device executes the new cooking method generated by the cooking AI big model called by the user to cook food that meets the user's needs. Technical issues

[0007] The role of applying AI big models to smart cooking machines in the existing technology is only for the processing end to analyze the stored parameter data through the AI ​​big model to analyze whether there is any abnormality in the smart cooking machine during the cooking process. When the smart cooking machine is analyzed to have an abnormality, it is judged based on the analysis results that there is a deviation in the taste of the dish, and it is necessary to replace other smart cooking machines to ensure the quality and taste of the dish. In fact, replacing other smart cooking machines for cooking may not necessarily ensure the quality and taste of the dish, because the other replaced smart cooking machines may also have abnormalities. In this way, users need to constantly replace smart cooking machines to ensure the quality and taste of the dish. Technical Solutions

[0008] In order to solve the above-mentioned problems of the prior art, the present invention provides a cooking method based on an AI big model, which is characterized in that it is applied to an intelligent cooking device, and the intelligent cooking device is provided with an information collection module, a processor and a wireless communication module, and the information collection module and the wireless communication module are electrically connected to the processor, and the information collection module is used to receive cooking demand information input by the user in the form of voice, video, text, picture or 3D model, and push this cooking demand information to the cooking AI big model in the cloud, and the cooking AI big model analyzes the cooking demand information and generates a new cooking method, and sends the new cooking method to the user's mobile terminal and the wireless communication module of the intelligent cooking device through the cloud platform, and the new cooking method includes the intelligent cooking device station, cooking work steps, cooking parameters or required The cooking operation instructions cooperated with the user, the cooking AI big model generates a new cooking method, which includes two steps: building a cooking AI big model and calling the cooking AI big model. The building of the cooking AI big model includes six steps: collecting cooking data, preprocessing cooking data, selecting an AI big model that can be applied to cooking, training the cooking AI big model, verifying and testing the cooking AI big model, and deploying and maintaining the cooking AI big model in the cloud. The cooking requirement information input by the user in the format of voice, video, text, picture or 3D model is generated by calling the cooking AI big model to generate a new cooking method. The calling of the cooking AI big model includes assembling query statements, the AI ​​big model performing reasoning operations and the AI ​​big model returning results. The new cooking method is sent to the user's mobile terminal and the smart cooking device through the cloud platform after the reasoning operation of the cooking AI big model is completed.

[0009] As an improvement to the cooking method based on the AI ​​big model of the present invention, the construction of the cooking AI big model includes:

[0010] Step 1: Collect cooking data: Collect all information about cooking methods of ingredients presented through voice, video, text, pictures or 3D models;

[0011] Step 2: Preprocessing cooking data: All collected information about cooking methods is processed to ensure its integrity and usability. This includes converting information in different formats into text and editing the text according to a specific format to facilitate subsequent training of the AI ​​model.

[0012] Step 3: Select AI models applicable to cooking: Select domestic and international third-party AI models, and measure them using accuracy, response speed, and diversity indicators;

[0013] Step 4: Train the cooking AI model: After organizing the cooking dataset in step 2, fine-tune the cooking dataset using a third-party AI model. After training, a cooking AI model containing all relevant data about cooking methods is generated.

[0014] Step 5: Verify and test the cooking AI model: Perform a task-specific performance test on the cooking AI model generated in step 4. If the performance fails, repeat steps 1, 2, 3, and 4, retraining the model until the performance passes. Generate a cooking AI model and store it on the cloud platform.

[0015] Step 6: Deploy and maintain the cooking AI model: Deploy the newly generated AI model to the cloud and continuously maintain and update it. Regularly update the data to ensure its timeliness and accuracy.

[0016] As an improvement to the AI ​​large model-based cooking method of the present invention, the third step selects an AI large model applicable to cooking. The selected AI large model is the Baichuan2-13B AI large model. The AI ​​large model parameters are as follows: hidden layer dimension: 5,120, number of layers: 40, number of attention heads: 40, vocabulary size: 64,000, total number of parameters: 13,264,901,120, training data (tokens): 1.4 trillion, position encoding: ALiBi, maximum length: 4,096;

[0017] As an improvement to the cooking method based on the AI ​​large model of the present invention, the training process of the fourth step of training the cooking AI large model is as follows: first, download the model weights of baichuan13b from huggingface, then download the belle dataset train_0.5M_CN to the local computer and put it in the dataset folder under the project directory, and finally run the sft_lora.py script. Then, quantize Baichuan LLM using qlora's nf4 and double quantization methods. Finally, use lora to fine-tune the instructions.

[0018] As an improvement to the cooking method based on the AI ​​big model of the present invention, calling the cooking AI big model specifically includes the following steps:

[0019] The first step is to assemble the query statement;

[0020] The second step is for the AI ​​big model to perform inference operations: The query statement is passed to the AI ​​big model, which then performs inference operations. This involves the following steps:

[0021] 1) Understanding the input: Distributed semantic parsing first receives a text sequence and converts it into word vectors. This process is based on the distributed semantics assumption that the meaning of a word is determined by its context.

[0022] 2) Parameter association: context-focus chaining, inputting these word vectors into the Transformer Encoder to generate context representation;

[0023] 3) Generate Answers: Generative probabilistic modeling: The model initializes the Transformer's decoder and feeds the encoder output and the current output sequence into the decoder. The decoder generates a probability distribution for the next word and selects the word with the highest probability or another set probability distribution as the output. This word is then appended to the output sequence.

[0024] 4) Select the most appropriate answer: Dynamic word string evolution, repeat the above steps, adding new words to the output sequence each time, until a complete output sequence is generated;

[0025] Step 3: The AI ​​big model returns the result: After the cooking AI big model completes the inference operation, it returns the information related to the new cooking method and the new cooking method operation instructions, including content provided to the user in text, image, audio, video or 3D model format;

[0026] In order to solve the above-mentioned problems of the prior art, the present invention provides an intelligent cooking device that executes a cooking method based on an AI large model, characterized in that it is provided with an information collection module, a processor and a wireless communication module. The information collection module is used to collect all information about cooking methods of ingredients input by the user through voice, video, text, picture or 3D model format. The processor is connected to the cloud platform and the user's mobile terminal through the wireless communication module. The processor is used to execute the new cooking method generated by the cooking AI large model in claim 1 and prompt the user to cook.

[0027] As an improvement to the intelligent cooking device of the present invention, the intelligent cooking device is provided with intelligent cooking device stations for frying, baking, boiling, air frying, braising, stewing, baking, steaming, or stir-frying. Each of the intelligent cooking device stations for frying, baking, boiling, air frying, braising, stewing, baking, steaming, or stir-frying is provided with a corresponding operation detection and feedback system. The operation detection and feedback system is used to detect whether the cooking operation performed by the user on the intelligent cooking device meets the requirements of the cooking method based on the AI ​​large model;

[0028] As an improvement of the intelligent cooking device of the present invention, the intelligent cooking device is provided with a human-computer interaction system, which is used for information exchange between the intelligent cooking device and the user, including the user operating the user mobile terminal to confirm cooking parameters and start cooking operation instructions. Beneficial effects

[0029] The present invention provides a cooking method based on an AI big model and an intelligent cooking device thereof, which have the following beneficial effects: the present invention provides a cooking method based on an AI big model and an intelligent cooking device thereof, which collects all information on cooking methods of ingredients from people of all countries and regions, all races, and all ages around the world presented through voice, video, text, pictures or 3D models, even including the cooking methods of various foods that a specific individual has been accustomed to or fond of in the past, and uses a third-party AI big model for fine-tuning training. After the training is completed, a cooking AI big model with all relevant data of massive cooking methods is generated. The user inputs cooking requirement information through voice, video, text, pictures or 3D model format, and the intelligent cooking device executes the new cooking method generated by the cooking AI big model called by the user to cook food that meets the different needs of different users, and even cooks food that meets the different needs of the same user. In this way, not only the different needs of different users can be met, but also the different needs of the same user at different times and in different environments can be met. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] FIG1 is a flowchart of constructing a cooking AI big model according to a preferred embodiment of the cooking method based on the AI ​​big model and its intelligent cooking device of the present invention.

[0031] FIG2 is a flowchart of calling the cooking AI big model in a preferred embodiment of the cooking method based on the AI ​​big model and the intelligent cooking device thereof according to the present invention.

[0032] FIG3 is a workflow diagram of a preferred embodiment of the cooking method based on the AI ​​large model and the intelligent cooking device thereof according to the present invention.

[0033] FIG4 is a workflow diagram of one of other embodiments of the cooking method based on the AI ​​large model and the intelligent cooking device thereof according to the present invention.

[0034] FIG5 is a workflow diagram of another embodiment of the cooking method and intelligent cooking device based on the AI ​​large model of the present invention.

[0035] FIG6 is a workflow diagram of another embodiment of the cooking method and intelligent cooking device based on the AI ​​large model of the present invention.

[0036] FIG7 is a workflow diagram of another fourth embodiment of the cooking method and intelligent cooking device based on the AI ​​large model of the present invention.

[0037] FIG8 is a flowchart of the fifth embodiment of the cooking method based on the AI ​​big model and the intelligent cooking device thereof according to the present invention. Best Mode for Carrying Out the Invention

[0038] The present invention is further described below in conjunction with Figures 1-8 and specific implementation methods and other embodiments. It should be noted that, under the premise of no conflict, the various technical features described below can be arbitrarily combined to form new embodiments.

[0039] In a preferred embodiment, referring to Figures 1-3 , the present invention provides a cooking method based on an AI large model, characterized in that it is applied to an intelligent cooking device, wherein the intelligent cooking device is provided with an information collection module 6, a processor 7, and a wireless communication module 8, wherein the information collection module 6 and the wireless communication module 8 are electrically connected to the processor 7;

[0040] In a preferred embodiment, the new cooking method includes intelligent cooking device stations, cooking work steps, cooking parameters, or cooking operation instructions that require user cooperation;

[0041] With reference to FIG2 , in a preferred embodiment, the process of constructing the cooking AI big model 1 of the cooking method based on the AI ​​big model of the present invention is as follows:

[0042] 201. Collect cooking data: Collect all information about cooking methods of ingredients presented through voice, video, text, pictures or 3D models;

[0043] 202. Preprocessing cooking data: Process all collected information about cooking methods to ensure its integrity and usability. This includes converting information in different formats into text and editing the text according to a specific format to facilitate subsequent training of the AI ​​model.

[0044] 203. Select AI big models that can be applied to cooking: Select domestic and foreign third-party AI big models and measure them using accuracy, response speed, and diversity indicators;

[0045] 204. Training the cooking AI model: After the cooking dataset is organized in step 2, fine-tuning the cooking dataset using a third-party AI model is performed. After training, a cooking AI model containing all relevant data on cooking methods is generated.

[0046] 205. Verify and test the cooking AI model: Perform task-specific performance evaluation on the cooking AI model generated in step 4. If the performance fails, repeat steps 1, 2, 3, and 4, retraining until the performance evaluation passes. Generate a cooking AI model and store it on the cloud platform.

[0047] 206. Deploy and maintain the cooking AI big model: Deploy the newly generated AI big model to the cloud and continuously maintain and update it. Regularly update the data to ensure its timeliness and accuracy.

[0048] In this embodiment, in the process of constructing the cooking AI big model 1 of the cooking method based on the AI ​​big model of the present invention, the AI ​​big model selected for cooking in step 203 is specifically the Baichuan2-13B AI big model. The parameters of the AI ​​big model are as follows: hidden layer dimension: 5,120, number of layers: 40, number of attention heads: 40, vocabulary size: 64,000, total number of parameters: 13,264,901,120, training data (tokens): 1.4 trillion, position encoding: ALiBi, maximum length: 4,096;

[0049] In this embodiment, the training process of the cooking AI big model in 204 of the process of constructing the cooking AI big model 1 of the cooking method based on the AI ​​big model of the present invention is as follows: first, download the model weights of baichuan13b from huggingface, then download the belle dataset train_0.5M_CN to the local and put it in the dataset folder under the project directory, and finally run the sft_lora.py script. Then, quantize Baichuan LLM using qlora's nf4 and double quantization methods, and finally, use lora to fine-tune the instructions.

[0050] In a preferred embodiment, when the user uses the APP of the user mobile terminal 5 or the information collection module 6 of the intelligent cooking device to send the cooking demand information, the cooking demand information is received by the cloud platform 4 and transmitted to the cooking AI big model in the cloud. The cooking AI big model will analyze the cooking demand information and generate a new cooking method, and then send the new cooking method to the APP of the user mobile terminal 5 of the user through the cloud platform 4. When the user confirms to cook on the APP, the cooking AI big model will send the new cooking method from the cloud platform 4 to the wireless communication module 8 of the intelligent cooking device, and the wireless communication module 8 will send the new cooking method to the user. The cooking method is transmitted to the processor 7. The new cooking method has related workstations, cooking steps, cooking parameters or cooking operation instructions that require user cooperation. The processor 7 first determines the workstation of the intelligent cooking device according to the new cooking method, and then sets the relevant parameters for the workstation of the intelligent cooking device, and then controls the workstation of the intelligent cooking device to cook. During this cooking process, when some steps require user cooperation, the processor 7 will send information to the user on the APP of the user mobile terminal 5 through the wireless communication module 8. When cooking is completed, the processor 7 will control the workstation of the intelligent cooking device to perform a self-cleaning operation.

[0051] In a preferred embodiment, when the user needs to cook the dish "Hot and Sour Potato Shreds", the user uses the APP of the user mobile terminal 5 to send the cooking requirement information, which includes the following contents: the spiciness of the dish, such as mild, medium, and strong; the saltiness of the dish, such as light, medium, and salty; the acidity of the dish, such as mild, medium, and strong; the portion of the dish, such as large, medium, and small; if the user wants to add some of his own innovations, he can also add some side dishes, such as sausage, eggs, and meatballs. The user can freely match the existing ingredients on the APP interface, and then submit this requirement on the APP. This cooking requirement information is received by the cloud platform 4 and transmitted to the cooking AI big model in the cloud. The cooking AI big model will analyze the cooking requirement information and generate a new cooking method, and then send the new cooking method to the user's mobile terminal 5 APP through the cloud platform 4. When the user confirms to cook on the APP, the cooking AI big model will send the new cooking method from the cloud platform to the wireless communication module 8 of the smart cooking device. The wireless communication module 8 transmits the new cooking method to the processor 7. The new cooking method includes the following contents: cooking device station, cooking work steps, cooking parameters, including cooking work steps; smart cooking device station to be activated for each step; cooking parameters including working time setting, power setting, temperature setting and water volume setting; cooking operation instructions that require user cooperation, which are specifically implemented as follows:

[0052] Step 1: Heat the pot: The processor 7 sets the working parameters of the intelligent cooking device station stir-fry 12 to 3000W power and heats to 200 degrees and maintains it according to the new cooking method. After the parameters are set, the intelligent cooking device station stir-fry 12 is started to work;

[0053] Step 2: Add oil with the user's cooperation: While the first step is being carried out, the processor 7 has synchronously sent a message to the APP of the user's mobile terminal 5 according to the new cooking method, reminding the user to remove the oil package and add a certain amount of oil to the pot after hearing the prompt tone. At the same time, the processor 7 detects whether the user has performed the required operation through the operation detection feedback system 15;

[0054] Step 3: User cooperates with adding food: After the processor 7 detects that the pot temperature has reached 200 degrees, the processor 7 sends a message to the APP of the user's mobile terminal 5 according to the new cooking method, reminding the user to remove the packaging of the ingredients. After hearing the prompt tone, the user pours the predetermined amount of food into the pot. At the same time, the processor 7 detects whether the user has performed the required operation through the operation detection feedback system 15;

[0055] Step 4: Cooking: The processor 7 adjusts the working parameters of the intelligent cooking device station 12 to 3000W power according to the new cooking method, heats to 200 degrees and maintains it, starts flipping and cooking for 5 minutes, and simultaneously sends a message to the APP of the user's mobile terminal 5, reminding the user to remove the vinegar material package and pour a certain amount of vinegar into the pot after hearing the prompt tone. At the same time, the processor 7 detects whether the user has performed the required operation through the operation detection feedback system 15;

[0056] Step 4: Add seasoning: The processor 7 adjusts the working parameters of the stir-frying station 12 of the intelligent cooking device to 2000W power according to the new cooking method, heats to 200 degrees and maintains it, starts flipping and cooking for 1 minute, and simultaneously sends a message to the APP of the user's mobile terminal 5, reminding the user to remove the seasoning package. After hearing the prompt tone, pour the predetermined amount of seasoning into the pot. At the same time, the processor 7 detects whether the user has performed the required operation through the operation detection feedback system 15;

[0057] Step 5: Serving the dish: The processor 7 sends a message to the APP of the user's mobile terminal 5 according to the new cooking method, reminding the user to put the dish plate on the designated position of the wok 12 of the intelligent cooking device. After the operation detection feedback system 15 detects that the user has operated as required, the processor controls the wok 12 of the intelligent cooking device to flip over and pour the dish onto the dish plate, and reminds the user to take the dish.

[0058] Step 6: Cleaning: The processor 7 controls the intelligent cooking device station frying 12 to perform a self-cleaning operation according to the new cooking method, and then enters a standby state.

[0059] The above is just an example of the operation process of one dish. When it is implemented, it can be more intelligent and personalized according to user needs. The cooking AI model can customize a variety of cooking methods according to user needs for user selection.

[0060] Referring to FIG. 3 , in this embodiment, the AI ​​big model-based cooking method of the present invention specifically includes the following steps:

[0061] 301. Assemble query statements;

[0062] 302. AI big model performs reasoning operations: The query statement is passed to the AI ​​big model, which performs reasoning operations. This includes the following four steps:

[0063] 302-1. Understanding Input: Distributed semantic parsing first receives a text sequence and converts it into a word vector. This process is based on the distributed semantics assumption that the meaning of a word is determined by its use in context.

[0064] 302-2. Parameter association: context-focus chaining, inputting these word vectors into the Transformer Encoder to generate context representation;

[0065] 302-3. Generate answers: Generative probabilistic modeling. The model initializes the decoder part of the Transformer and inputs the encoder output and the current output sequence into the decoder. The decoder generates a probability distribution for the next word and selects the word with the highest probability or other set probability distribution as the output. This word will be added to the output sequence.

[0066] 302-4. Choose the most appropriate answer: Dynamic word string evolution, repeating the above steps, adding new words to the output sequence each time, until a complete output sequence is generated;

[0067] 303. AI Big Model Return Result: After the cooking AI Big Model completes the inference operation, it returns information related to the new cooking method and the new cooking method operation instructions, including content provided to the user in text, image, audio, video or 3D model format;

[0068] In a preferred embodiment, referring to FIG4 , the present invention provides an intelligent cooking device for executing a cooking method based on an AI large model, characterized in that it is provided with an information collection module 6, the processor 7 and a wireless communication module 8, the information collection module 6 is used to collect all information about cooking methods of ingredients input by the user in the form of voice, video, text, picture or 3D model, the processor 7 is connected to the cloud platform 4 and the user mobile terminal 5 via the wireless communication module 8, the processor 7 is used to execute the new cooking method generated by the cooking AI large model in claim 1 and prompt the user to cook, the information collection module 6 has information input ports such as voice, video, text, picture and 3D model, the user can input cooking requirement information through these information input ports, or the information collection module 6 is connected to the user mobile terminal 5 through the wireless communication module 8 to receive cooking requirement information, the wireless communication module 8 connects the processor 7 with the cloud platform 4 and the user mobile terminal 5, and is used for communication between the three. The cooking AI big model is deployed on the cloud platform 4, and the transmission of the cooking AI big model information is completed through the cloud platform 4. The processor 7 can set the working parameters of the intelligent cooking device stations of frying 9, baking 10, boiling 11, air frying 13, steaming 14 and stir-frying 12 of the intelligent cooking device, and control each intelligent cooking device station to execute relevant instructions, such as standby, start, stop, cleaning and other working instructions. When the user's cooking demand information is transmitted to the cooking AI big model of the cloud platform 4 via the wireless communication module 8, the cooking AI big model analyzes and generates a new cooking method, which is then sent to the user mobile terminal 5 by the wireless communication module 8. After the user confirms it, the cooking AI big model will send the new cooking method to the processor 7. This cooking method includes specific cooking data information. The processor 7 will set parameters for the relevant intelligent cooking device stations of frying 9, baking 10, boiling 11, air frying 13, steaming 14 and stir-frying 12 according to the cooking data information and control them to execute relevant instructions.

[0069] In this embodiment, the intelligent cooking device stations of the present invention, namely, frying 9, baking 10, boiling 11, air frying 13, steaming 14, and stir-frying 12, are equipped with a common operation detection and feedback system 15. The operation detection and feedback system 15 includes detection devices such as a camera, infrared detection, radar detection, magnetic detection, and weight detection, and is used to detect whether the cooking operation performed by the user on the intelligent cooking device complies with the requirements of the cooking method based on the AI ​​large model. For example, at the frying intelligent cooking device station, the intelligent cooking device requires the user to place the ingredients to be fried on the station, but the user fails to place them or places them in the wrong location. At this time, the operation detection and feedback system detects this through the camera and feeds this information back to the processor 7 of the intelligent cooking device. The processor 7 controls the intelligent cooking device station to pause the next operation and sends a message to the user for correction. After the user corrects the error, the operation detection and feedback system detects this through the camera and feeds this information back to the processor 7. The processor 7 then controls the intelligent cooking device station to proceed with the next operation. The above is just an example. Infrared detection, radar detection, magnetic detection, and weight detection can also be used alone or in combination for detection.

[0070] In another embodiment 1, referring to FIG. 4 , the intelligent cooking device stations of frying 9, baking 10, boiling 11, air frying 13, and steaming 14 of the intelligent cooking device of the present invention are provided with a common operation detection feedback system 15, and the rest are the same as the preferred embodiment of the present invention;

[0071] In another embodiment 2, referring to FIG. 5 , the intelligent cooking device stations of the baking 10, boiling 11, air frying 13, and steaming 14 of the intelligent cooking device of the present invention are provided with a common operation detection feedback system 15, and the rest are the same as the preferred embodiment of the present invention;

[0072] In another third embodiment, referring to FIG. 6 , the cooking 11 and stir-fry 12 stations of the intelligent cooking device of the present invention are provided with a common operation detection feedback system 15 , and the rest are the same as those of the preferred embodiment of the present invention;

[0073] In another fourth embodiment, referring to FIG. 7 , the intelligent cooking device station 12 of the intelligent cooking device of the present invention is provided with an operation detection feedback system 15 , and the rest is the same as the preferred embodiment of the present invention;

[0074] In another fifth embodiment, referring to FIG8 , the intelligent cooking device of the present invention is not provided with a user mobile terminal 5 , and the rest is the same as the preferred embodiment of the present invention;

[0075] In other embodiments, the smart cooking device is one or a combination of a cooker, an air fryer, an induction cooker, a microwave oven, an oven, a steam oven, an electric rice cooker, an electric pressure cooker, an electric stew pot, an integrated stove or a frying pan, and one or more smart cooking devices include one or more cooking functions of stir-frying, air frying, baking, frying, braising, stewing, steaming, boiling or baking to cook ingredients.

[0076] In other embodiments, the smart cooking device prompts the user to place different ingredients on different workstations on the smart cooking device for cooking. For example, the cooking position of stir-frying is different from that of steaming, air frying, and frying in the smart cooking device, and the user needs to be prompted to cook at the corresponding workstation of the smart cooking device; the cooking work steps include the cooking steps that the smart cooking device prompts the user to perform when cooking different ingredients; the cooking parameters include the cooking time, cooking temperature, and cooking power of the ingredients; the cooking operation instructions that require user cooperation include confirming the cooking parameters on the mobile terminal or confirming that the operation of the smart cooking device workstation and cooking work steps has been completed.

[0077] In other embodiments, the smart cooking device is an integrated body of multiple cooking functions including stir-frying, air frying, baking, frying, braising, stewing, steaming, boiling or baking. For example, the smart cooking device is a cooking utensil that integrates functions such as air frying, baking, frying, and steaming, or a cooking utensil that integrates functions such as stir-frying, air frying, braising, stewing, and boiling, etc.

[0078] In other embodiments, the intelligent cooking device is provided with multiple cooking functions including one or more cooking functions of stir-frying, sautéing, deep-frying, cooking, frying, sticking, roasting, braising, stewing, steaming, blanching, boiling, stewing, sautéing, mixing, marinating, roasting, braising, freezing, candied food, honey sauce, smoking, rolling, sliding or baking. For example, the intelligent cooking device is a cooking utensil that integrates functions such as honey sauce, roasting, frying and steaming, or a cooking utensil that integrates functions such as stir-frying, air frying, braising, stewing and boiling, etc.

[0079] In this embodiment, the intelligent cooking device of the present invention is provided with a human-computer interaction system 16, which includes a touch screen, a sound input and output unit, an image input unit and a camera device. The human-computer interaction system 16 is electrically connected to the processor 7 for information interaction between the intelligent cooking device and the user 3. The user 3 can input cooking demand information in the form of voice, video, text, picture or 3D model through the human-computer interaction system 16. The human-computer interaction system 16 sends the cooking demand information to the processor 7. The processor 7 sends the cooking demand information to the cloud platform 4 via the wireless communication module 8. The cooking demand information is received by the cloud platform 4 and transmitted to the cooking AI big model in the cloud. The cooking AI model will analyze the cooking demand information and generate a new cooking method, and then send the new cooking method to the processor 7 through the cloud platform 4. The processor 7 will send this information to the user 3 for confirmation through the human-computer interaction system 16 in the form of images, voice or text. After the user 3 confirms through gestures or voice, the processor 7 will first determine the work station of the intelligent cooking device according to the new cooking method, and then set the relevant parameters for the work station of the intelligent cooking device, and then control the work station of the intelligent cooking device to cook. During this cooking process, when some steps require the cooperation of the user 3, the processor 7 will send the information to the user 3 through the human-computer interaction system 16 in the form of images, voice or text.

[0080] The specific implementation steps of the AI ​​large model-based cooking method and its intelligent cooking device for cooking are as follows:

[0081] The specific implementation of the cooking data preprocessing process 202 of the AI ​​macro-model-based cooking method of the present invention is as follows: all collected information is processed to ensure its integrity and usability. This includes converting information in different formats into text and editing the text information according to a specific format to facilitate subsequent training of the AI ​​macro-model.

[0082] The data format is as follows:

[0083] instruction: Task instruction, cannot be empty.

[0084] input: Task input, can be empty. If not empty, when processing training data within the project, instruction and input will be concatenated together as the input of the task.

[0085] output: task output, cannot be empty

[0086] The data example is as follows:

[0087] {

[0088] "instruction": "Sweet and Sour Spare Ribs Pre-prepared Dish Cooking Method",

[0089] "input": "",

[0090] "output": "1. Pour the pre-cooked spareribs into the pan and fry them over medium heat. Heat the oil to 60% and fry slowly. 2. Fry for 3 minutes until the spareribs are slightly browned and drain the oil. 3. Leave a small amount of oil in the pan, add the sweet and sour sauce, and bring to a boil over high heat. 4. Add the fried spareribs to the sweet and sour sauce and stir-fry evenly.

[0091] }

[0092] The specific implementation process of step 303 of the process of calling the cooking AI big model 2 in the cooking method based on the AI ​​big model of the present invention is as follows: after the cooking AI big model completes the inference operation, it returns the relevant information of the new cooking method and the new cooking method operation instructions, including the content provided to the user in text, picture, audio, video or 3D model format, and returns the content in Jason format as follows:

[0093] {

[0094] “recipeName”:recipeName / / cooking method name,

[0095] "recipeText":text / / cooking method information,

[0096] "recipePic":pic_url / / Url of the picture of cooking method information,

[0097] "recipeAudio": audio_url / / audio URL of cooking method information,

[0098] "recipeVideo": video_url / / Video URL of cooking method information,

[0099] "recipe3D":3D_url / / 3D model URL of cooking method information,

[0100] “recipeCommand”:recipeCommand / / cooking method operation instructions

[0101] }

[0102] The cooking method based on the AI ​​large model and the intelligent cooking device thereof for cooking sweet and sour spare ribs are specifically operated as follows:

[0103] 1. The request for cooking sweet and sour spare ribs is sent to the cooking AI model;

[0104] 2. Call the cooking AI big model through the Prompt query statement, and the cooking AI big model performs inference operations.

[0105] 3. After the inference operation, the cooking AI model returns the following results:

[0106] {

[0107] "recipeName":"Sweet and Sour Spare Ribs Cooking Method" / / Cooking method name,

[0108] "recipeText":"1. Pour the pre-cooked spareribs into the pan and fry them when the oil temperature reaches 60%. Keep frying over medium heat. 2. Fry for 3 minutes. When the spareribs are slightly browned, remove them and drain the oil. 3. Leave a little oil in the pan, add the sweet and sour sauce, and bring to a boil over high heat. 4. Add the fried spareribs into the sweet and sour sauce and stir-fry evenly." / / Cooking method information,

[0109] "recipePic": "None" / / None,

[0110] "recipeAudio": "https: / / www.ixigua.com / 7289152022341747234?logTag=43fb2a078d33289b226 b" / / Audio URL for cooking method information,

[0111] "recipeVideo": "https: / / www.ixigua.com / 7289152022341747234?logTag=43fb2a078d33289b226b" / / Video URL for cooking method information,

[0112] "recipe3D":3D_url / / 3D model URL of cooking method information,

[0113] "recipeCommand": "Fry for 30 seconds, adjust the temperature to 100 degrees, stir-fry for 20 seconds, steam for 2 minutes, and then finish the operation" / / Cooking method operation instructions

[0114] }

[0115] The present invention provides a cooking method based on an AI big model and an intelligent cooking device thereof, which have the following beneficial effects: the present invention provides a cooking method based on an AI big model and an intelligent cooking device thereof, which collects all information on cooking methods of ingredients from people of all countries and regions, all races, and all ages around the world presented through voice, video, text, pictures or 3D models, even including the cooking methods of various foods that a specific individual has been accustomed to or fond of in the past, and uses a third-party AI big model for fine-tuning training. After the training is completed, a cooking AI big model with all relevant data of massive cooking methods is generated. The user inputs cooking requirement information through voice, video, text, pictures or 3D model format, and the intelligent cooking device executes the new cooking method generated by the cooking AI big model called by the user to cook food that meets the different needs of different users, and even cooks food that meets the different needs of the same user. In this way, not only the different needs of different users can be met, but also the different needs of the same user at different times and in different environments can be met.

[0116] The present invention has been described in detail above. The above description is only a preferred embodiment of the present invention and should not limit the scope of implementation of the present invention. That is, all equivalent changes and modifications made within the scope of this application should still fall within the scope of the present invention.

[0117]

Claims

1. A cooking method based on AI big model, characterized in that: Applied to an intelligent cooking device, the intelligent cooking device is provided with an information collection module, a processor and a wireless communication module, the information collection module and the wireless communication module are electrically connected to the processor, the information collection module is used to receive cooking demand information input by a user in the form of voice, video, text, picture or 3D model, and push the cooking demand information to a cooking AI big model in the cloud, the cooking AI big model analyzes the cooking demand information and generates a new cooking method, and sends the new cooking method to the user mobile terminal and the wireless communication module of the intelligent cooking device through the cloud platform, the new cooking method includes a workstation of the intelligent cooking device, cooking work steps, cooking parameters or cooking operation instructions that require user cooperation, the cooking AI big model Generating a new cooking method includes two steps: building a cooking AI big model and calling the cooking AI big model. The building of the cooking AI big model includes six steps: collecting cooking data, preprocessing cooking data, selecting an AI big model that can be applied to cooking, training the cooking AI big model, verifying and testing the cooking AI big model, and deploying and maintaining the cooking AI big model in the cloud. The cooking requirement information input by the user in the format of voice, video, text, picture or 3D model is used to generate a new cooking method by calling the cooking AI big model. The calling of the cooking AI big model includes assembling query statements, the AI ​​big model performing reasoning operations and the AI ​​big model returning results. The new cooking method is sent to the user's mobile terminal and the smart cooking device through the cloud platform after the reasoning operation of the cooking AI big model is completed.

2. The cooking method based on AI big model according to claim 1, characterized in that: The construction of the cooking AI big model includes: Step 1: Collect cooking data: Collect all information about cooking methods of ingredients presented through voice, video, text, pictures or 3D models; Step 2: Preprocess cooking data: process all collected information about cooking methods to ensure the integrity and availability of the information, including converting information in different formats into text and editing the text information in a certain format to facilitate subsequent training of the AI ​​model. Step 3: Select AI big models that can be applied to cooking: Select domestic and foreign third-party AI big models, and measure them by accuracy, response speed, and diversity indicators; Step 4: Train the cooking AI big model: After the cooking data set is sorted out in step 2, the cooking data set is fine-tuned using a third-party AI big model. After the training is completed, a cooking AI big model with all relevant data of the cooking method is generated; Step 5: Verify and test the cooking AI big model: Perform a specific task effect test and evaluation on the cooking AI big model generated in step 4. If the evaluation effect fails, continue to repeat the steps of step 1, step 2, step 3, and step 4, retrain until the effect evaluation passes, generate the cooking AI big model and store it on the cloud platform; Step 6: Deploy and maintain the cooking AI big model: Deploy the newly generated AI big model to the cloud and continuously maintain and update it. Update the data regularly to ensure the timeliness and accuracy of the data.

3. The cooking method based on AI big model according to claim 2 is characterized in that: The third step selects an AI big model that can be applied to cooking. The selected AI big model is Baichuan2-13B. The parameters of the AI ​​big model are as follows: hidden layer dimension: 5,120, number of layers: 40, number of attention heads: 40, vocabulary size: 64,000, total number of parameters: 13,264,901,120, training data (tokens): 1.4 trillion, Positional encoding: ALiBi, Maximum length: 4,096.

4. The cooking method based on AI big model according to claim 3 is characterized in that: The training process of the fourth step of training the cooking AI large model is as follows: first, download the model weights of baichuan13b from huggingface, then download the belle dataset train_0.5M_CN to the local and put it in the dataset folder under the project directory, and finally run the sft_lora.py script. Next, quantize Baichuan LLM using qlora's nf4 and double quantization methods, and finally, use lora to fine-tune the instructions.

5. The cooking method based on AI big model according to claim 1, characterized in that: The calling of the cooking AI big model specifically includes the following steps: The first step is to assemble the query statement; The second step is that the AI ​​big model performs reasoning operations: the query statement is passed to the AI ​​big model, which performs reasoning operations. This includes the following processes: 1) Understanding input: Distributed semantic parsing first receives a text sequence and converts it into a word vector. This process is based on the distributed semantics assumption that the meaning of a word is determined by its use in context. 2) Parameter association: context focus linkage, input these word vectors into the Transformer Encoder to generate context representation; 3) Generate answers: Generative probability modeling. The model initializes the decoder part of the Transformer and inputs the encoder output and the current output sequence into the decoder. The decoder generates the probability distribution of the next word and selects the word with the largest probability or other set probability distribution as the output. This word will be added to the output sequence. 4) Select the most appropriate answer: Dynamic word string evolution, repeat the above steps, adding new words to the output sequence each time until a complete output sequence is generated; Step 3. The AI ​​big model returns the result: After the cooking AI big model completes the inference operation, it returns the information related to the new cooking method and the operation instructions of the new cooking method, including providing the user with content in text, picture, audio, video or 3D model format.

6. An intelligent cooking device, characterized in that: An information collection module, a processor and a wireless communication module are provided. The information collection module is used to collect all information about cooking methods of ingredients input by users in voice, video, text, picture or 3D model format. The processor is connected to the cloud platform and the user's mobile terminal through the wireless communication module. The processor is used to execute the new cooking method generated by the cooking AI large model in claim 1 and prompt the user to cook.

7. The intelligent cooking device according to claim 6, characterized in that: There are intelligent cooking device stations for frying, baking, boiling, air frying, braising, stewing, baking, steaming or stir-frying. The intelligent cooking device stations for frying, baking, boiling, air frying, braising, stewing, baking, steaming or stir-frying are provided with corresponding operation detection feedback systems. The operation detection feedback system is used to detect whether the cooking operations performed by the user on the intelligent cooking device meet the requirements of the cooking method based on the AI ​​large model.

8. The intelligent cooking device according to claim 6, characterized in that: A human-computer interaction system is provided, and the human-computer interaction system is used for information interaction between the intelligent cooking device and the user, including the user operating the user mobile terminal to confirm cooking parameters and start cooking operation instructions.

Images