Intelligent cooking method, system, storage medium and device based on augmented reality
By combining augmented reality technology with the actual environment, the cooking process and the status of ingredients are displayed in real time, solving the problems of unclear seasoning ratios, hands-free cooking, and heat control in existing cooking learning, thus improving the cooking experience and the quality of dishes.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- HAIER YOUJIA INTELLIGENT TECH (BEIJING) CO LTD
- Filing Date
- 2022-12-29
- Publication Date
- 2026-05-19
AI Technical Summary
In existing cooking learning methods, the proportions of seasonings are not clear, making it difficult for users to operate simultaneously, as their hands are occupied, and it is difficult to control the heat, resulting in the failure of cooking dishes.
Using augmented reality technology, the cooking process is displayed in real time by combining the augmented reality environment with the real physical environment. The system intelligently analyzes the state of the ingredients and generates delicious and appealing target dishes.
It improves the user's cooking experience, ensures the quality of dishes, and solves problems such as unclear seasoning ratios, hands-free cooking, and heat control.
Smart Images

Figure CN116166117B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of smart home technology, and in particular to an augmented reality-based smart cooking method, system, storage medium, and device. Background Technology
[0002] In smart homes, many people want to learn how to cook various dishes. Currently, the main way to learn cooking is through cooking apps that provide text or video tutorials. Users can follow the steps provided in the cooking app to perform the cooking process.
[0003] However, at least the following problems exist in this learning process: First, many instructional texts or videos do not clearly describe the proportions of seasonings, causing users to often be unable to synchronize with the video when preparing ingredients in their own kitchens; Second, in actual operation, users' hands are often occupied, making it difficult to smoothly execute the previous step, next step, and other operations in the text or video instructions; Third, controlling the heat is an important step in cooking dishes, but neither text nor video instructions can guide users on the degree of cooking of heat and ingredients based on actual operation, thus leading to the failure of dish preparation.
[0004] Therefore, how to achieve intelligent cooking in a smart home is a pressing technical problem that needs to be solved. Summary of the Invention
[0005] In view of this, this application provides an augmented reality-based intelligent cooking method, system, storage medium, and device, which, based on augmented reality technology, combines the augmented reality environment with the real physical environment, enabling users to complete each cooking step according to the cooking process displayed on the augmented reality display interface, and intelligently analyzes the status information of the ingredients in real time during the cooking process, thereby generating a delicious and palatable target dish and improving the user experience.
[0006] In a first aspect, this application provides an augmented reality-based intelligent cooking method applied to an augmented reality device, the method comprising:
[0007] Retrieve information on dishes to be cooked for a pre-defined user;
[0008] Construct an augmented reality environment, and generate a cooking process query request corresponding to the information of the dish to be cooked based on the information of the dish to be cooked and the augmented reality environment;
[0009] Based on the dish cooking process query request and the preset dish cooking process query strategy, a dish cooking process corresponding to the dish cooking process query request is generated, and the dish cooking process is imported into the augmented reality environment so as to display the dish cooking process on the augmented reality display interface of the augmented reality environment;
[0010] Based on the cooking process of the dish displayed on the augmented reality display interface, the preset user can cook the cooking ingredients corresponding to the dish information to be cooked according to the cooking steps of the cooking process, obtain dish status information, record the dish status information of the cooking ingredients in real time, and display the dish status information of the cooking ingredients in real time on the augmented reality display interface.
[0011] Based on the dish status information displayed in real time on the augmented reality display interface, target cooking dish operation information corresponding to the dish information to be cooked is generated in real time.
[0012] Preferably, according to the augmented reality-based intelligent cooking method provided in this application,
[0013] The step of generating a cooking process corresponding to the cooking process query request based on the cooking process query request and a preset cooking process query strategy includes:
[0014] When a query request for the cooking process of the dish is generated, the preset user is authenticated to obtain the authentication result;
[0015] Based on the authentication result, query the status of the smart stove corresponding to the preset user;
[0016] When the smart stove is in a normal state, the cooking process query strategy is used to process the cooking process query request to obtain the cooking process corresponding to the cooking process query request.
[0017] Preferably, according to the augmented reality-based intelligent cooking method provided in this application, the strategy for querying the cooking process of a dish includes at least: a first query strategy and a second query strategy;
[0018] The step of processing the dish cooking process query request using the aforementioned strategy to obtain the dish cooking process corresponding to the query request includes:
[0019] Using the first query strategy, the system queries a preset recipe knowledge base for the cooking process corresponding to the requested cooking process. If a matching cooking process is found in the recipe knowledge base, the system retrieves the cooking process.
[0020] Using the second query strategy, a cooking expert is assigned to correspond with the dish cooking process query request, and the dish cooking process corresponding to the dish cooking process query request is obtained based on the cooking expert.
[0021] Preferably, according to the augmented reality-based intelligent cooking method provided in this application,
[0022] The cooking steps include at least: the step of preparing seasonings;
[0023] The cooking process of the dish displayed on the augmented reality display interface enables the preset user to cook the ingredients corresponding to the dish information according to the cooking steps of the cooking process, and obtain dish status information, including:
[0024] Based on the cooking process of the dish displayed on the augmented reality display interface, the preset user uses a preset smart seasoning spoon to mix food ingredients according to the seasoning steps of the cooking process, obtains food ingredient information corresponding to the food ingredients, sends the food ingredient information corresponding to the food ingredients to the augmented reality environment, and displays the food ingredient information on the augmented reality display interface.
[0025] When the food ingredient information is displayed on the augmented reality display interface, the cooking ingredients corresponding to the dish information to be cooked are cooked to obtain the dish status information.
[0026] Preferably, according to the augmented reality-based intelligent cooking method provided in this application, the cooking steps include at least: a fire-starting step;
[0027] When the food ingredient information is displayed on the augmented reality display interface, the cooking ingredients corresponding to the dish to be cooked are cooked to obtain the dish status information, including:
[0028] When the food ingredient information is displayed on the augmented reality display interface, the smart stove is used to start the fire based on the guidance information of the fire-starting step in the cooking process of the dish, and the fire data is sent to the augmented reality environment in real time and displayed on the augmented reality display interface.
[0029] When the stove fire data is displayed on the augmented reality display interface, the cooking ingredients corresponding to the dish information to be cooked are cooked to obtain the dish status information.
[0030] Preferably, according to the augmented reality-based intelligent cooking method provided in this application, the step of generating target cooking operation information corresponding to the information of the dish to be cooked in real time based on the dish status information displayed in real time on the augmented reality display interface includes:
[0031] Based on the dish status information displayed in real time on the augmented reality display interface, when it is determined that the dish status information has reached the preset status conditions, an alarm message indicating that the dish cooking is complete is generated.
[0032] Based on the alarm information indicating that the cooking of the dish is complete, target cooking operation information corresponding to the information of the dish to be cooked is generated in real time.
[0033] Preferably, according to the augmented reality-based intelligent cooking method provided in this application,
[0034] After the step of generating target cooking dish operation information corresponding to the information of the dish to be cooked in real time based on the dish status information displayed in real time on the augmented reality display interface, the method further includes:
[0035] When the preset user cooks the corresponding target dish according to the target dish operation information and tastes the target dish, a cooking guidance evaluation of the target dish is generated;
[0036] The cooking guidance evaluation is input into the augmented reality environment and displayed on the augmented reality display interface.
[0037] Secondly, this application also provides an augmented reality-based intelligent cooking system for use in augmented reality devices, the system comprising:
[0038] The module for obtaining information on dishes to be cooked is used to obtain information on dishes to be cooked from preset users;
[0039] A module for generating a dish cooking process query request is used to construct an augmented reality environment and generate a dish cooking process query request corresponding to the dish information to be cooked based on the dish information to be cooked and the augmented reality environment.
[0040] A recipe cooking process generation module is used to generate a recipe cooking process corresponding to the recipe cooking process query request based on the recipe cooking process query request and a preset recipe cooking process query strategy, and import the recipe cooking process into the augmented reality environment so as to display the recipe cooking process on the augmented reality display interface of the augmented reality environment;
[0041] The dish status information display module is used to display the dish cooking process based on the augmented reality display interface, so that the preset user can cook the cooking ingredients corresponding to the dish information to be cooked according to the cooking steps of the dish cooking process, obtain dish status information, record the dish status information of the cooking ingredients in real time, and display the dish status information of the cooking ingredients in real time on the augmented reality display interface.
[0042] The module for generating target cooking dish operation information is used to generate target cooking dish operation information corresponding to the information of the dish to be cooked in real time, based on the dish status information displayed in real time on the augmented reality display interface.
[0043] Thirdly, this application also provides an electronic device including a memory and a processor, wherein the memory stores a computer program and the processor is configured to execute the computer program to implement any of the above-described augmented reality-based intelligent cooking methods.
[0044] Fourthly, this application also provides a computer-readable storage medium comprising a stored program, wherein the program, when executed, implements the augmented reality-based intelligent cooking method as described above.
[0045] Fifthly, this application also provides a computer program product, including a computer program that, when executed by a processor, implements the augmented reality-based intelligent cooking method as described above.
[0046] This application provides an augmented reality-based intelligent cooking method, system, storage medium, and device, applied to augmented reality devices. The method involves: acquiring information about a dish to be cooked from a preset user; constructing an augmented reality environment; generating a cooking process query request corresponding to the dish information based on the dish information and the augmented reality environment; generating a cooking process corresponding to the query request based on the query request and a preset cooking process query strategy; importing the cooking process into the augmented reality environment and displaying it on an augmented reality display interface; enabling the preset user to cook ingredients corresponding to the dish information according to the cooking steps of the cooking process, obtaining dish status information, recording the dish status information in real time, and displaying the dish status information in real time on the augmented reality display interface; and generating target cooking operation information corresponding to the dish information in real time based on the dish status information displayed in real time on the augmented reality display interface. Based on augmented reality technology, by combining the augmented reality environment with the real physical environment, it enables users to complete each cooking step by following the cooking process displayed on the augmented reality interface. It also provides real-time intelligent analysis of the status information of the ingredients during the cooking process, thereby generating delicious and palatable target dishes and improving the user experience. Attached Figure Description
[0047] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.
[0048] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0049] Figure 1 This is a schematic diagram of the hardware environment for the augmented reality-based intelligent cooking method provided in this application;
[0050] Figure 2 This is a flowchart illustrating the augmented reality-based intelligent cooking method provided in this application;
[0051] Figure 3 This is one of the structural schematic diagrams of the augmented reality-based intelligent cooking system provided in this application;
[0052] Figure 4 This is the second schematic diagram of the structure of the augmented reality-based intelligent cooking system provided in this application;
[0053] Figure 5 This is a schematic diagram of the electronic device provided in this application. Detailed Implementation
[0054] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present application, and not all embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative effort should fall within the scope of protection of the present application.
[0055] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.
[0056] First, let's explain the technical terms used in this application:
[0057] Augmented Reality (AR) technology can visually expand physical space and, through the acquisition, dynamic tracking, and modeling of 3D images, interact with, process, and analyze data with smart home service platforms to achieve new spatial interaction methods that are real-time, personalized, intelligent, human-centered, and privacy-preserving. This technology combines virtual objects with the real world by overlaying images onto the real world and using holographic images.
[0058] The following is combined Figures 1-5 This application describes an augmented reality-based intelligent cooking method, system, storage medium, and apparatus. Through the embodiments provided in this application, it is possible to combine augmented reality technology with the real physical environment, enabling users to complete each cooking step according to the cooking process displayed on the augmented reality display interface. It also provides real-time intelligent analysis of the status information of the ingredients during the cooking process, thereby generating a delicious and palatable target dish and improving the user experience.
[0059] According to one aspect of the embodiments of this application, an augmented reality-based intelligent cooking method is provided. This augmented reality-based intelligent cooking method is widely applicable to whole-house intelligent digital control application scenarios such as smart homes, smart home ecosystems, smart home device ecosystems, and intelligence house ecosystems. Optionally, in this embodiment, the above-mentioned augmented reality-based intelligent cooking method can be applied to, for example... Figure 1 The hardware environment shown consists of terminal device 102 and server 104. For example... Figure 1 As shown, server 104 is connected to terminal device 102 via a network and can be used to provide services (such as application services) to the terminal or clients installed on the terminal. A database can be set up on the server or independently of the server to provide data storage services for server 104. Cloud computing and / or edge computing services can be configured on the server or independently of the server to provide data processing services for server 104.
[0060] The aforementioned network may include, but is not limited to, at least one of the following: wired network, wireless network. The aforementioned wired network may include, but is not limited to, at least one of the following: wide area network, metropolitan area network, local area network. The aforementioned wireless network may include, but is not limited to, at least one of the following: Wi-Fi (Wireless Fidelity), Bluetooth. The terminal device 102 may not be limited to PC, mobile phone, tablet computer, smart air conditioner, smart range hood, smart refrigerator, smart oven, smart stove, smart washing machine, smart water heater, smart washing equipment, smart dishwasher, smart projector, smart TV, smart clothes rack, smart curtains, smart audio-visual equipment, smart socket, smart speaker, smart speaker box, smart fresh air equipment, smart kitchen and bathroom equipment, smart bathroom equipment, smart robot vacuum cleaner, smart window cleaning robot, smart mopping robot, smart air purifier, smart steam oven, smart microwave oven, smart water heater, smart air purifier, smart water dispenser, smart door lock, etc.
[0061] like Figure 2 As shown, it is a schematic diagram of the implementation process of the augmented reality-based smart cooking method provided in the embodiments of this application. The augmented reality-based smart cooking method may include, but is not limited to, steps S100 to S500.
[0062] S100: Obtain information on dishes to be cooked from a preset user;
[0063] S200, construct an augmented reality environment, and generate a dish cooking process query request corresponding to the dish information based on the dish information to be cooked and the augmented reality environment;
[0064] S300: Based on the dish cooking process query request and the preset dish cooking process query strategy, generate a dish cooking process corresponding to the dish cooking process query request, and import the dish cooking process into the augmented reality environment so as to display the dish cooking process on the augmented reality display interface of the augmented reality environment;
[0065] S400, based on the cooking process of the dish displayed on the augmented reality display interface, the preset user cooks the cooking ingredients corresponding to the information of the dish to be cooked according to the cooking steps of the cooking process, obtains the dish status information, records the dish status information of the cooking ingredients in real time, and displays the dish status information of the cooking ingredients in real time on the augmented reality display interface.
[0066] S500: Based on the dish status information displayed in real time on the augmented reality display interface, target cooking dish operation information corresponding to the dish information to be cooked is generated in real time.
[0067] In step S100 of some embodiments, information about the dishes to be cooked by a preset user is obtained.
[0068] Understandably, the server obtains information about the dishes to be cooked from smart devices, such as the screen of a smart refrigerator or a smartphone app, based on the user's desired cooking recipes.
[0069] When the server retrieves information about the dishes to be cooked, it is assumed that the user will simultaneously prepare the ingredients to be cooked and perform tasks such as washing the ingredients.
[0070] In step S200 of some embodiments, an augmented reality environment is constructed, and a cooking process query request corresponding to the information of the dish to be cooked is generated based on the information of the dish to be cooked and the augmented reality environment.
[0071] Understandably, after the server completes step S100 to obtain the information about the dishes to be cooked from the preset user, its specific execution steps can be as follows: construct an augmented reality environment using a preset augmented reality device. More specifically, the preset user enters the kitchen, wears the augmented reality (AR) device, opens the cooking interactive guidance interface through the AR device, and wakes up the interactive interface through voice and gestures, thereby successfully constructing the augmented reality environment.
[0072] After constructing the augmented reality environment, a cooking process query request corresponding to the information of the dish to be cooked is generated based on the information of the dish to be cooked and the augmented reality environment.
[0073] In step S300 of some embodiments, based on the dish cooking process query request and a preset dish cooking process query strategy, a dish cooking process corresponding to the dish cooking process query request is generated, and the dish cooking process is imported into the augmented reality environment so as to display the dish cooking process on the augmented reality display interface of the augmented reality environment.
[0074] It is understandable that after completing step S200 of constructing an augmented reality environment and generating a cooking process query request corresponding to the information of the dish to be cooked based on the information of the dish to be cooked and the augmented reality environment, the specific execution steps can be as follows: when the server generates the cooking process query request, it authenticates the preset user, obtains the authentication result, and queries the stove status of the smart stove corresponding to the preset user based on the authentication result.
[0075] When the smart stove is in a normal state, the cooking process query strategy is used to process the cooking process query request to obtain the cooking process corresponding to the cooking process query request.
[0076] First, it should be noted that the strategy for querying the cooking process of a dish includes at least two strategies: a first query strategy and a second query strategy.
[0077] More specifically: using the first query strategy, query the recipe knowledge base for the cooking process corresponding to the recipe cooking process query request, and if the recipe knowledge base finds the corresponding cooking process, retrieve the cooking process.
[0078] Using the second query strategy, a cooking expert is assigned to correspond with the dish cooking process query request, and the dish cooking process corresponding to the dish cooking process query request is obtained based on the cooking expert.
[0079] In step S400 of some embodiments, based on the cooking process of the dish displayed on the augmented reality display interface, the preset user cooks the cooking ingredients corresponding to the information of the dish to be cooked according to the cooking steps of the cooking process, obtains dish status information, records the dish status information of the cooking ingredients in real time, and displays the dish status information of the cooking ingredients in real time on the augmented reality display interface.
[0080] It is understandable that after step S300 is executed, the specific execution steps can be as follows: The server first, based on the cooking process of the dish displayed on the augmented reality display interface, enables the preset user to use a preset smart seasoning spoon to mix food ingredients according to the seasoning steps of the cooking process, obtain food ingredient information corresponding to the food ingredients, send the food ingredient information corresponding to the food ingredients to the augmented reality environment, and display the food ingredient information on the augmented reality display interface.
[0081] Secondly, when the server displays the food ingredient information on the augmented reality display interface, it uses the smart stove to start the fire based on the guidance information of the fire-starting step in the cooking process of the dish, and sends the fire data to the augmented reality environment in real time, and displays the fire data on the augmented reality display interface.
[0082] Finally, with the stove fire data displayed on the augmented reality display interface, the server cooks the ingredients corresponding to the dish to be cooked, obtaining the dish status information. The server also records the dish status information of the cooking ingredients in real time and displays it on the augmented reality display interface.
[0083] In step S500 of some embodiments, target cooking dish operation information corresponding to the information of the dish to be cooked is generated in real time based on the dish status information displayed in real time on the augmented reality display interface.
[0084] It is understandable that after step S400 is executed, the specific execution steps can be as follows: the server first generates an alarm message indicating that the cooking of the dish is complete based on the dish status information displayed in real time on the augmented reality display interface, and then generates target cooking operation information corresponding to the information of the dish to be cooked in real time based on the alarm message indicating that the cooking of the dish is complete.
[0085] The system is designed to allow users to cook the target dish based on the information displayed on the augmented reality interface.
[0086] In some embodiments of this application, generating a cooking process corresponding to the cooking process query request based on the cooking process query request and a preset cooking process query strategy includes:
[0087] When a query request for the cooking process of the dish is generated, the preset user is authenticated to obtain the authentication result;
[0088] Based on the authentication result, query the status of the smart stove corresponding to the preset user;
[0089] When the smart stove is in a normal state, the cooking process query strategy is used to process the cooking process query request to obtain the cooking process corresponding to the cooking process query request.
[0090] It is understandable that when the server generates the query request for the cooking process of the dish, it uses the server's user management module to authenticate the preset user and obtain the authentication result.
[0091] It should be noted that the identity verification result includes at least the first result and the second result;
[0092] When the identity information corresponding to the preset user is found in the user management database, the first result of successful identity verification is obtained.
[0093] Conversely, if no identity information corresponding to the preset user is found in the user management database, the second result of authentication failure is obtained.
[0094] Based on the first result, the status of the smart stove corresponding to the preset user is queried, and the status of the smart seasoning spoon corresponding to the preset user is also queried.
[0095] Only when both the smart stove and the smart seasoning spoon are in normal condition will the cooking process query strategy be used to process the cooking process query request and obtain the cooking process corresponding to the cooking process query request.
[0096] It should be noted that, based on the second result of failed authentication, the main user needs to authorize the user's identity information to be entered into the user management database. After that, the user can be authenticated again to obtain the first result of successful authentication.
[0097] In some embodiments of this application, the strategy for querying the cooking process of a dish includes at least: a first query strategy and a second query strategy;
[0098] The step of processing the dish cooking process query request using the aforementioned strategy to obtain the dish cooking process corresponding to the query request includes:
[0099] Using the first query strategy, the system queries a preset recipe knowledge base for the cooking process corresponding to the requested cooking process. If a matching cooking process is found in the recipe knowledge base, the system retrieves the cooking process.
[0100] Using the second query strategy, a cooking expert is assigned to correspond with the dish cooking process query request, and the dish cooking process corresponding to the dish cooking process query request is obtained based on the cooking expert.
[0101] It is understandable that when processing the dish cooking process query request using the first query strategy, the first step is to query the dish cooking process corresponding to the query request from the preset recipe knowledge base.
[0102] If the corresponding cooking process for the dish is found in the recipe knowledge base, the cooking process is retrieved using a preset retrieval algorithm.
[0103] It should be noted that the cooking process of the dish is imported into the augmented reality environment and displayed on the augmented reality display interface of the augmented reality environment.
[0104] Furthermore, using the second query strategy, the dish cooking process query request is processed, a cooking expert corresponding to the dish cooking process query request is assigned from the cooking expert database, and the dish cooking process corresponding to the dish cooking process query request is obtained according to the cooking expert.
[0105] It should be noted that the cooking process of the dishes obtained through cooking experts will be imported into the augmented reality environment, and the cooking process will be displayed on the augmented reality display interface of the augmented reality environment.
[0106] Furthermore, cooking experts are also integrated into the augmented reality environment, allowing them to view the augmented reality environment in real time through their expert devices, confirm user actions in real time, and provide timely cooking guidance and suggestions.
[0107] In some embodiments of this application, the cooking step includes at least: a seasoning preparation step;
[0108] The cooking process of the dish displayed on the augmented reality display interface enables the preset user to cook the ingredients corresponding to the dish information according to the cooking steps of the cooking process, and obtain dish status information, including:
[0109] Based on the cooking process of the dish displayed on the augmented reality display interface, the preset user uses a preset smart seasoning spoon to mix food ingredients according to the seasoning steps of the cooking process, obtains food ingredient information corresponding to the food ingredients, sends the food ingredient information corresponding to the food ingredients to the augmented reality environment, and displays the food ingredient information on the augmented reality display interface.
[0110] When the food ingredient information is displayed on the augmented reality display interface, the cooking ingredients corresponding to the dish information to be cooked are cooked to obtain the dish status information.
[0111] Understandably, the server displays the cooking process of the dish based on the augmented reality display interface, enabling the user to first prepare the ingredients according to the cooking steps of the dish cooking process, and then use the preset smart seasoning spoon to mix the food ingredients according to the seasoning steps displayed on the augmented reality display interface, thereby obtaining the food ingredient information corresponding to the food ingredients.
[0112] It should be noted that the smart seasoning spoon is used to prepare food ingredients, and the volume is controlled by the smart seasoning spoon when each ingredient is added.
[0113] The food ingredient information corresponding to the food ingredients is sent to the augmented reality environment. The server or expert confirms the food ingredient information. If the confirmation is correct, the food ingredient information is displayed on the augmented reality display interface.
[0114] If the food ingredient information is confirmed to be insufficient or in the wrong proportions, the preset user will be notified via voice or text to adjust the food ingredients in a timely manner. After adjustment, the food ingredient information will be sent to the augmented reality environment so that the server or expert can reconfirm the food ingredient information until it is confirmed to be correct, and then the food ingredient information will be displayed on the augmented reality display interface.
[0115] When the food ingredient information is displayed on the augmented reality display interface, the smart stove is used to start the fire based on the guidance information of the fire-starting step in the cooking process of the dish, and the fire data is sent to the augmented reality environment in real time. The fire data is then displayed on the augmented reality display interface. When the fire data is displayed on the augmented reality display interface, the cooking ingredients corresponding to the dish information are cooked to obtain the dish status information.
[0116] In some embodiments of this application, the cooking step includes at least: a fire-starting step;
[0117] When the food ingredient information is displayed on the augmented reality display interface, the cooking ingredients corresponding to the dish to be cooked are cooked to obtain the dish status information, including:
[0118] When the food ingredient information is displayed on the augmented reality display interface, the smart stove is used to start the fire based on the guidance information of the fire-starting step in the cooking process of the dish, and the fire data is sent to the augmented reality environment in real time and displayed on the augmented reality display interface.
[0119] When the stove fire data is displayed on the augmented reality display interface, the cooking ingredients corresponding to the dish information to be cooked are cooked to obtain the dish status information.
[0120] It is understandable that when the server displays the food ingredient information on the augmented reality display interface, it indicates that the seasoning steps have been completed according to the instructions of the cooking process. Now, based on the guidance information of the cooking process of the dish displayed on the augmented reality display interface, the server uses the smart stove to start the fire and sends the stove fire data to the augmented reality environment in real time.
[0121] The server or expert verifies the stove fire data a second time. If the verification is successful, the stove fire data is displayed on the augmented reality display interface.
[0122] It should be noted that cooking experts will conduct a second verification of the stove's heat data. If there are any problems, the heat of the smart stove can be directly controlled through the server, or the operation can be guided to the preset user through video.
[0123] When culinary experts directly control the heat of a smart stove via a server, they first adjust a virtual stove in the augmented reality environment, and then control the virtual stove to adjust the heat of the real smart stove.
[0124] When the stove fire data is displayed on the augmented reality display interface, the cooking ingredients corresponding to the dish information to be cooked are cooked to obtain the dish status information.
[0125] In some embodiments of this application, the step of generating target cooking dish operation information corresponding to the dish information to be cooked in real time based on the dish status information displayed in real time on the augmented reality display interface includes:
[0126] Based on the dish status information displayed in real time on the augmented reality display interface, when it is determined that the dish status information has reached the preset status conditions, an alarm message indicating that the dish cooking is complete is generated.
[0127] Based on the alarm information indicating that the cooking of the dish is complete, target cooking operation information corresponding to the information of the dish to be cooked is generated in real time.
[0128] It is understood that the server displays the dish status information in real time on the augmented reality display interface. Specifically, during the cooking process, the user transmits the dish status to the server in real time through an AR camera, which is then analyzed by the server's data processing module and displayed in real time on the augmented reality display interface.
[0129] The server or expert analyzes and judges the status information of the dishes displayed on the augmented reality display interface. If the status information of the dishes meets the preset status conditions, an alarm message indicating that the cooking of the dishes is complete is generated and displayed on the augmented reality display interface to remind the user that the target dishes have been cooked and can be taken out of the pot, thereby turning off the smart stove.
[0130] The preset state condition is a set of dish state conditions preset by the server, or a condition for cooking experts on the expert side to measure whether the cooked dish has reached the target cooked dish.
[0131] The alarm message can be a voice alarm or a video alarm, informing the preset user that the food is cooked and should not be cooked any further to avoid overcooking.
[0132] In some embodiments of this application, after the step of generating target cooking dish operation information corresponding to the information of the dish to be cooked in real time based on the dish status information displayed in real time on the augmented reality display interface, the method further includes:
[0133] When the preset user cooks the corresponding target dish according to the target dish operation information and tastes the target dish, a cooking guidance evaluation of the target dish is generated;
[0134] The cooking guidance evaluation is input into the augmented reality environment and displayed on the augmented reality display interface.
[0135] Understandably, after the steps of generating target cooking operation information corresponding to the information of the dish to be cooked in real time based on the dish status information displayed in real time on the augmented reality display interface, the user first cooks the corresponding target dish according to the target cooking operation information displayed on the augmented reality display interface. After the user tastes the target dish, a cooking guidance evaluation of the target dish is generated using a smartphone APP or smart AR device. After receiving the cooking guidance evaluation, the server analyzes the evaluation. If it is positive, the evaluation is input into the augmented reality environment and displayed along with the dish cooking process, so that the next user can have more confidence in the dish cooking process displayed on the augmented reality display interface.
[0136] When the cooking guidance receives a negative review, the key suggestions are extracted and the reasons are analyzed to further optimize the cooking steps of the dish.
[0137] like Figure 3 The diagram shown is one of the structural schematics of the augmented reality-based intelligent cooking system provided in this application. The augmented reality-based intelligent cooking system mainly includes a real kitchen scene composed of augmented reality (AR) devices, smart stoves, and smart seasoning spoons; an augmented reality environment composed of a virtual stove and virtual seasoning spoon control system; a cooking platform composed of a user management module, a data processing module, a business platform module, and a food knowledge base; and an online chef professional guidance system provided by the platform or a third-party cooking application.
[0138] Real-world kitchen scenario: The real-world kitchen scenario includes smart cooktops, which can control the heat of the real cooktop through a digital twin virtual cooktop generated by the server; smart seasoning spoons include a set of commonly used seasoning spoons with different capacity markings, which can communicate with the server through capacity sensing to ensure the amount of seasoning used; augmented reality devices are mainly implemented by AR cameras, which can provide a complete cooking interactive guidance interface on a visual interface parallel to the user's.
[0139] Augmented Reality Environment: The augmented reality environment mainly includes a digital twin virtual stove generated by the server, a module for analyzing user behavior data, and an interactive interface providing guidance information using an AR camera.
[0140] Server-side: The server-side mainly consists of two parts. One part is intelligent guidance, which is composed of a recipe knowledge base and a business platform module, providing users with enhanced cooking guidance. The other part consists of a data processing module, a user management module, and an expert terminal, providing users with more professional online guidance.
[0141] The augmented reality-based intelligent cooking method, system, storage medium, and device provided in this application acquire information about the dish to be cooked from a preset user; construct an augmented reality environment using a preset augmented reality device; and generate a cooking process query request corresponding to the dish information based on the dish information and the augmented reality environment; generate a cooking process corresponding to the query request based on the query request and a preset cooking process query strategy, and import the cooking process into the augmented reality environment to display it on an augmented reality display interface; based on the cooking process displayed on the augmented reality display interface, the preset user cooks the ingredients corresponding to the dish information according to the cooking steps of the cooking process, obtains dish status information, records the dish status information in real time, and displays the dish status information in real time on the augmented reality display interface; and generates target cooking operation information corresponding to the dish information in real time based on the dish status information displayed in real time on the augmented reality display interface. Based on augmented reality technology, by combining the augmented reality environment with the real physical environment, it enables users to complete each cooking step by following the cooking process displayed on the augmented reality interface. It also provides real-time intelligent analysis of the status information of the ingredients during the cooking process, thereby generating delicious and palatable target dishes and improving the user experience.
[0142] The augmented reality-based intelligent cooking system provided in this application is described below. The augmented reality-based intelligent cooking system described below can be referred to in correspondence with the augmented reality-based intelligent cooking method described above.
[0143] like Figure 4 The image shown is a second structural schematic diagram of the augmented reality-based intelligent cooking system provided in this application. An augmented reality-based intelligent cooking system includes:
[0144] The module 410 for obtaining information on dishes to be cooked is used to obtain information on dishes to be cooked from a preset user.
[0145] The module 420 for generating a dish cooking process query request is used to construct an augmented reality environment and generate a dish cooking process query request corresponding to the dish information to be cooked based on the dish information to be cooked and the augmented reality environment.
[0146] The recipe cooking process generation module 430 is used to generate a recipe cooking process corresponding to the recipe cooking process query request based on the recipe cooking process query request and a preset recipe cooking process query strategy, and import the recipe cooking process into the augmented reality environment so as to display the recipe cooking process on the augmented reality display interface of the augmented reality environment.
[0147] The dish status information display module 440 is used to display the dish cooking process based on the augmented reality display interface, so that the preset user cooks the cooking ingredients corresponding to the dish information to be cooked according to the cooking steps of the dish cooking process, obtains dish status information, records the dish status information of the cooking ingredients in real time, and displays the dish status information of the cooking ingredients in real time on the augmented reality display interface.
[0148] The target cooking dish operation information generation module 450 is used to generate target cooking dish operation information corresponding to the information of the dish to be cooked in real time based on the dish status information displayed in real time on the augmented reality display interface.
[0149] Preferably, according to the augmented reality-based intelligent cooking system provided in this application, a dish cooking process generation module 430 is used to authenticate the preset user and obtain the authentication result when the dish cooking process query request is generated;
[0150] Based on the authentication result, query the status of the smart stove corresponding to the preset user;
[0151] When the smart stove is in a normal state, the cooking process query strategy is used to process the cooking process query request to obtain the cooking process corresponding to the cooking process query request.
[0152] Preferably, according to the augmented reality-based intelligent cooking system provided in this application, the strategy for querying the cooking process of a dish includes at least: a first query strategy, a second query strategy, and a cooking process generation module 430, used to use the first query strategy to query a cooking process corresponding to the cooking process query request from a preset recipe knowledge base, and, if the corresponding cooking process is found in the recipe knowledge base, to retrieve the cooking process; and
[0153] Using the second query strategy, a cooking expert is assigned to correspond with the dish cooking process query request, and the dish cooking process corresponding to the dish cooking process query request is obtained based on the cooking expert.
[0154] Preferably, according to the augmented reality-based intelligent cooking system provided in this application, the cooking steps include at least: a seasoning preparation step. A dish status information display module 440 is used to display the dish cooking process based on the augmented reality display interface, so that the preset user prepares food ingredients using a preset intelligent seasoning spoon according to the seasoning preparation step of the dish cooking process, obtains food ingredient information corresponding to the food ingredients, sends the food ingredient information corresponding to the food ingredients to the augmented reality environment, and displays the food ingredient information on the augmented reality display interface.
[0155] When the food ingredient information is displayed on the augmented reality display interface, the cooking ingredients corresponding to the dish information to be cooked are cooked to obtain the dish status information.
[0156] Preferably, according to the augmented reality-based intelligent cooking system provided in this application, the cooking steps include at least: a cooking step, and a dish status information display module 440, which is used to start the fire using the intelligent stove based on the guidance information of the cooking step of the dish cooking process when the food ingredient information is displayed on the augmented reality display interface, and to send the stove fire data to the augmented reality environment in real time, and display the stove fire data on the augmented reality display interface;
[0157] When the stove fire data is displayed on the augmented reality display interface, the cooking ingredients corresponding to the dish information to be cooked are cooked to obtain the dish status information.
[0158] Preferably, according to the augmented reality-based intelligent cooking system provided in this application, a target cooking dish operation information generation module 450 is used to generate an alarm message indicating that the cooking of the dish is completed when the dish status information is determined to have reached a preset state condition, based on the dish status information displayed in real time on the augmented reality display interface.
[0159] Based on the alarm information indicating that the cooking of the dish is complete, target cooking operation information corresponding to the information of the dish to be cooked is generated in real time.
[0160] Preferably, the augmented reality-based intelligent cooking system provided in this application is further configured to generate a cooking guidance evaluation of the target cooking dish when the preset user cooks the corresponding target cooking dish according to the target cooking dish operation information and tastes the target cooking dish;
[0161] The cooking guidance evaluation is input into the augmented reality environment and displayed on the augmented reality display interface.
[0162] The augmented reality-based intelligent cooking method, system, storage medium, and device provided in this application acquire information about the dish to be cooked from a preset user; construct an augmented reality environment using a preset augmented reality device; and generate a cooking process query request corresponding to the dish information based on the dish information and the augmented reality environment; generate a cooking process corresponding to the query request based on the query request and a preset cooking process query strategy, and import the cooking process into the augmented reality environment to display it on an augmented reality display interface; based on the cooking process displayed on the augmented reality display interface, the preset user cooks the ingredients corresponding to the dish information according to the cooking steps of the cooking process, obtains dish status information, records the dish status information in real time, and displays the dish status information in real time on the augmented reality display interface; and generates target cooking operation information corresponding to the dish information in real time based on the dish status information displayed in real time on the augmented reality display interface. Based on augmented reality technology, by combining the augmented reality environment with the real physical environment, it enables users to complete each cooking step by following the cooking process displayed on the augmented reality interface. It also provides real-time intelligent analysis of the status information of the ingredients during the cooking process, thereby generating delicious and palatable target dishes and improving the user experience.
[0163] Figure 5 An example is a schematic diagram of the physical structure of an electronic device, such as... Figure 5As shown, the electronic device may include a processor 510, a communication interface 520, a memory 530, and a communication bus 540, wherein the processor 510, the communication interface 520, and the memory 530 communicate with each other via the communication bus 540. The processor 510 can call logical instructions in the memory 530 to execute an augmented reality-based intelligent cooking method. This method includes: acquiring information about a dish to be cooked from a preset user; constructing an augmented reality environment using a preset augmented reality device; generating a cooking process query request corresponding to the dish information based on the dish information and the augmented reality environment; generating a cooking process corresponding to the cooking process query request based on the cooking process query request and a preset cooking process query strategy; and importing the cooking process into the augmented reality environment to cook the dish. The cooking process is displayed on the augmented reality display interface in the augmented reality environment. Based on the cooking process displayed on the augmented reality display interface, the preset user cooks the ingredients corresponding to the dish information according to the cooking steps of the cooking process, obtains dish status information, records the dish status information of the ingredients in real time, and displays the dish status information of the ingredients in real time on the augmented reality display interface. Based on the dish status information displayed in real time on the augmented reality display interface, target cooking operation information corresponding to the dish information is generated in real time.
[0164] Furthermore, the logical instructions in the aforementioned memory 530 can be implemented as software functional units and, when sold or used as independent products, can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.
[0165] On the other hand, this application also provides a computer program product, which includes a computer program that can be stored on a computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the augmented reality-based intelligent cooking method provided by the above methods. This method includes: acquiring information about a dish to be cooked from a preset user; constructing an augmented reality environment and generating a cooking process query request corresponding to the dish information based on the dish information and the augmented reality environment; generating a cooking process corresponding to the cooking process query request based on the cooking process query request and a preset cooking process query strategy, and then... The cooking process is imported into the augmented reality environment to be displayed on the augmented reality display interface. Based on the cooking process displayed on the augmented reality display interface, the preset user cooks the ingredients corresponding to the dish information according to the cooking steps of the cooking process, obtains dish status information, records the dish status information in real time, and displays the dish status information in real time on the augmented reality display interface. Based on the dish status information displayed in real time on the augmented reality display interface, target cooking operation information corresponding to the dish information is generated in real time.
[0166] Furthermore, this application also provides a computer-readable storage medium, comprising a stored program, wherein the program, when executed, performs the augmented reality-based intelligent cooking method provided by the methods described above. This method includes: acquiring information about a dish to be cooked from a preset user; constructing an augmented reality environment using a preset augmented reality device, and generating a cooking process query request corresponding to the dish information based on the dish information and the augmented reality environment; generating a cooking process corresponding to the cooking process query request based on the cooking process query request and a preset cooking process query strategy, and storing the cooking process... The process is imported into the augmented reality environment to display the cooking process of the dish on the augmented reality display interface. Based on the cooking process displayed on the augmented reality display interface, the preset user cooks the ingredients corresponding to the dish information to be cooked according to the cooking steps of the cooking process, obtains dish status information, records the dish status information of the ingredients in real time, and displays the dish status information of the ingredients in real time on the augmented reality display interface. Based on the dish status information displayed in real time on the augmented reality display interface, target cooking operation information corresponding to the dish information to be cooked is generated in real time.
[0167] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.
[0168] Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus necessary general-purpose hardware platforms, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solutions, in essence or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in the various embodiments or some parts of the embodiments.
[0169] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application.
Claims
1. An intelligent cooking method based on augmented reality, characterized in that, An augmented reality device is used to provide an interactive cooking guidance interface on a visual interface parallel to the user's; the augmented reality device is deployed in a real kitchen scene, which includes a smart stove and a smart seasoning spoon, and the smart stove controls the heat of the real stove through a digital twin virtual stove generated by the server. The smart seasoning spoon includes a set of seasoning spoons with different capacity markings, used to communicate with the server via capacity sensing to ensure the amount of seasoning used; the method includes: Retrieve information on dishes to be cooked for a pre-defined user; Construct an augmented reality environment, and generate a cooking process query request corresponding to the information of the dish to be cooked based on the information of the dish to be cooked and the augmented reality environment; Based on the dish cooking process query request and the preset dish cooking process query strategy, a dish cooking process corresponding to the dish cooking process query request is generated, and the dish cooking process is imported into the augmented reality environment so as to display the dish cooking process on the augmented reality display interface of the augmented reality environment; Based on the cooking process displayed on the augmented reality display interface, the preset user cooks the ingredients corresponding to the dish information according to the cooking steps of the cooking process, obtains dish status information, and records the dish status information of the cooking ingredients in real time, and displays the dish status information of the cooking ingredients in real time on the augmented reality display interface; wherein, the cooking steps include at least: a seasoning preparation step; the process of cooking the ingredients corresponding to the dish information according to the cooking steps of the cooking process displayed on the augmented reality display interface to obtain dish status information includes: based on the cooking process displayed on the augmented reality display interface, the preset user cooks the ingredients corresponding to the dish information according to the cooking steps of the cooking process, obtains dish status information, and records the dish status information of the cooking ingredients in real time on the augmented reality display interface. The seasoning step in the cooking process involves using a preset smart seasoning spoon to mix food ingredients, obtaining food ingredient information corresponding to the ingredients, sending the food ingredient information to the augmented reality environment, and displaying the food ingredient information on the augmented reality display interface. The cooking process also includes a cooking step; with the food ingredient information displayed on the augmented reality display interface, based on the guidance information of the cooking step, the smart stove is used to start the fire, and the stove fire data is sent to the augmented reality environment in real time and displayed on the augmented reality display interface; with the stove fire data displayed on the augmented reality interface, the ingredients corresponding to the dish to be cooked are cooked to obtain the dish status information. Based on the dish status information displayed in real time on the augmented reality display interface, target cooking dish operation information corresponding to the dish information to be cooked is generated in real time.
2. The augmented reality-based intelligent cooking method according to claim 1, characterized in that, The step of generating a cooking process corresponding to the cooking process query request based on the cooking process query request and a preset cooking process query strategy includes: When a query request for the cooking process of the dish is generated, the preset user is authenticated to obtain the authentication result; Based on the authentication result, query the status of the smart stove corresponding to the preset user; When the smart stove is in a normal state, the cooking process query strategy is used to process the cooking process query request to obtain the cooking process corresponding to the cooking process query request.
3. The augmented reality-based intelligent cooking method according to claim 2, characterized in that, The strategy for querying the cooking process of a dish should include at least: a first query strategy and a second query strategy; The step of processing the dish cooking process query request using the aforementioned strategy to obtain the dish cooking process corresponding to the query request includes: Using the first query strategy, the system queries a preset recipe knowledge base for the cooking process corresponding to the requested cooking process. If a matching cooking process is found in the recipe knowledge base, the system retrieves the cooking process. Using the second query strategy, a cooking expert is assigned to correspond with the dish cooking process query request, and the dish cooking process corresponding to the dish cooking process query request is obtained based on the cooking expert.
4. The intelligent cooking method based on augmented reality according to claim 1, characterized in that, The step of generating target cooking operation information corresponding to the information of the dish to be cooked in real time based on the dish status information displayed in real time on the augmented reality display interface includes: Based on the dish status information displayed in real time on the augmented reality display interface, when it is determined that the dish status information has reached the preset status conditions, an alarm message indicating that the dish cooking is complete is generated. Based on the alarm information indicating that the cooking of the dish is complete, target cooking operation information corresponding to the information of the dish to be cooked is generated in real time.
5. The augmented reality-based intelligent cooking method according to any one of claims 1 to 4, characterized in that, After the step of generating target cooking dish operation information corresponding to the information of the dish to be cooked in real time based on the dish status information displayed in real time on the augmented reality display interface, the method further includes: When the preset user cooks the corresponding target dish according to the target dish operation information and tastes the target dish, a cooking guidance evaluation of the target dish is generated; The cooking guidance evaluation is input into the augmented reality environment and displayed on the augmented reality display interface.
6. An augmented reality-based intelligent cooking system, characterized in that, An augmented reality device is used to provide an interactive cooking guidance interface on a visual interface parallel to the user's; the augmented reality device is deployed in a real kitchen scene, which includes a smart stove and a smart seasoning spoon, and the smart stove controls the heat of the real stove through a digital twin virtual stove generated by the server. The smart seasoning spoon includes a set of seasoning spoons with different capacity markings, used to communicate with the server via capacity sensing to ensure the correct amount of seasoning is used; the system includes: The module for obtaining information on dishes to be cooked is used to obtain information on dishes to be cooked from preset users; A module for generating a dish cooking process query request is used to construct an augmented reality environment and generate a dish cooking process query request corresponding to the dish information to be cooked based on the dish information to be cooked and the augmented reality environment. A recipe cooking process generation module is used to generate a recipe cooking process corresponding to the recipe cooking process query request based on the recipe cooking process query request and a preset recipe cooking process query strategy, and import the recipe cooking process into the augmented reality environment so as to display the recipe cooking process on the augmented reality display interface of the augmented reality environment; The dish status information display module is used to display the dish cooking process based on the augmented reality display interface, enabling the preset user to cook the ingredients corresponding to the dish information to be cooked according to the cooking steps of the dish cooking process, obtain dish status information, and record the dish status information of the cooking ingredients in real time, and display the dish status information of the cooking ingredients in real time on the augmented reality display interface; wherein, the cooking steps include at least: a seasoning preparation step; the dish cooking process displayed on the augmented reality display interface, enabling the preset user to cook the ingredients corresponding to the dish information to be cooked according to the cooking steps of the dish cooking process, and obtain dish status information, includes: the dish cooking process displayed on the augmented reality display interface, enabling the preset user to cook the ingredients corresponding to the dish information to be cooked according to the cooking steps of the dish cooking process, obtain dish status information, including: the dish cooking process displayed on the augmented reality display interface, enabling the preset user to cook the ingredients corresponding to the dish information to be cooked, and obtain dish status information, including: the dish cooking process displayed on the augmented reality display interface, enabling the preset user to cook the ingredients corresponding to the dish information to be cooked according to the cooking steps of the dish cooking process, and obtain dish status information, including: the dish cooking process displayed on the augmented reality display interface, enabling the preset user to cook the ingredients corresponding to the dish information to be cooked, and obtain dish status information, including the dish cooking process to be cooked according to the cooking steps of the dish cooking process, and displaying the dish status information on the augmented reality display interface ... According to the seasoning steps in the cooking process, food ingredients are prepared using a preset smart seasoning spoon to obtain food ingredient information corresponding to the ingredients. This food ingredient information is then sent to the augmented reality environment and displayed on the augmented reality display interface. The cooking process also includes a ignition step. With the food ingredient information displayed on the augmented reality display interface, the smart stove is ignited based on the guidance information from the ignition step in the cooking process. The stove flame data is sent to the augmented reality environment in real time and displayed on the augmented reality display interface. With the stove flame data displayed on the augmented reality display interface, the ingredients corresponding to the dish to be cooked are cooked to obtain the dish status information. The module for generating target cooking dish operation information is used to generate target cooking dish operation information corresponding to the information of the dish to be cooked in real time, based on the dish status information displayed in real time on the augmented reality display interface.
7. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes a stored program, wherein the program, when executed, performs the method of any one of claims 1 to 5.
8. An electronic device comprising a memory and a processor, characterized in that, The memory stores a computer program, and the processor is configured to execute the method of any one of claims 1 to 5 through the computer program.