Menu generation method and device, electronic equipment and storage medium
By playing cooking videos on the user terminal and automatically generating an editing interface, users can edit and generate recipes that can be recognized by the cooking robot, solving the limitations of recording cooking robot videos in the existing technology, and achieving flexible homemade and high applicability of the recipes.
Patent Information
- Application Number
- CN202411221741.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-02
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2044-09-02
AI Technical Summary
When generating recipes from cooking robots, users need to record videos and equipment parameters of cooking robots, and cooking robots need to be open, which limits the flexibility and popularity of users' homemade recipes, especially for users with low cooking skills. For example, it is difficult to generate recipes that suit personal tastes.
By obtaining videos with a complete cooking time series, including cooking operation step screen information and sound information, an editing interface is automatically generated at the user terminal. Users can edit recipes based on the video information and generate recipes that can be recognized by the cooking robot without recording the cooking robot video.
It reduces the difficulty of editing recipes and improves the flexibility and applicability of users' homemade recipes. Users can record videos on ordinary pots and utensils to generate recipes, which is suitable for all kinds of users, especially users with low cooking skills.
Smart Images

Figure CN119071410A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of recipe generation, and in particular to a recipe generation method, device, electronic device and storage medium. Background Art
[0002] With the development of science and technology, cooking robots have gradually appeared in people's vision. In addition to being used in the commercial field, more and more individual users have begun to use cooking robots to cook. However, existing cooking robots can generally only work according to pre-set recipes, and the recipes are usually preset, so the number is limited, and the types and quantity are gradually unable to meet the needs of users. In this regard, some existing technologies have proposed recipe generation methods and recipe sharing methods for cooking robots.
[0003] Recipe sharing usually involves users sharing their own recipes, allowing other users to download the shared recipes to a cooking robot through the Internet, and finally allowing the cooking robot to cook according to the downloaded recipes. However, this method often results in users having different tastes, resulting in users being unable to make dishes that suit their tastes after downloading other users' recipes.
[0004] Therefore, for users, the preferred way is to make their own recipes. The advantage of making your own recipes is that you can make them completely according to your own taste, and finally make the dishes cooked by the cooking robot meet your taste to the greatest extent, which can bring a better experience in the process of using the cooking robot. However, it is very difficult for users to make their own recipes and make recipes that can be recognized and executed by the cooking robot. In order to make a recipe that can be recognized and executed by the cooking robot, it is usually necessary to input a lot of cooking parameters, which are very abstract for ordinary users, and the cooking skills of users who use cooking robots are generally low, so it is difficult for them to make their own recipes.
[0005] In this regard, with the development of intelligent technology, some existing technologies have proposed some automatic recipe generation methods for cooking robots.
[0006] For example, the Chinese invention patent with application number 201911086129.8 proposes a recipe making method, device and cooking machine, which obtains the cooking video stream and cooking temperature data of the cooking process, and automatically extracts the ingredient addition timing and the ingredient addition category corresponding to each ingredient addition point from the cooking video stream, and automatically records this information into a recipe template in a standard format to automatically generate a corresponding cooking recipe. There is no need to manually record the cooking process data, which reduces the complexity of the recipe making process and improves the recipe making efficiency.
[0007] For example, the Chinese invention patent with application number 202310877558.7 proposes a method, device, system and medium for automatically making video recipes. The obtained cooking video is intercepted and integrated based on the operation prompt node according to the working time of the cooking equipment, and the control instructions of the cooking equipment are added. This allows users to let the cooking equipment read the control instructions while watching the video recipe. Users do not need to manually adjust the cooking equipment, which reduces the user's cooking labor and pressure and improves the user experience.
[0008] For example, the Chinese invention patent with application number 202311317039.1 proposes a method, device and storage medium for automatically generating cloud recipes. The device status information of the cooking equipment involved in the cooking work in the kitchen is obtained through the pre-set Internet of Things; the cooking data stream is then analyzed and the user's cooking behavior is determined. A simplified cooking process is generated based on the user's cooking behavior and the device status information. The part of the content that requires human participation is analyzed through video, and the part of the content that requires the participation of the equipment is determined through the device status information, so as to facilitate the step analysis of the cooking work of human-machine integration; the simplified cooking process is sent to the user and the correction information fed back by the user is obtained. Finally, a recipe is generated based on the correction information and the simplified cooking process and shared to the cloud platform. Thus, the function of semi-automatic recording of the recipe is realized, which can effectively reduce the user's compilation work on the recipe under the premise of ensuring that the recipe content fully meets the user's needs, and the introduced device status information can accurately meet the cooking needs, so as to facilitate the perfect reproduction of the step process of the cloud recipe on other devices.
[0009] In the above-mentioned prior arts, it is necessary to use a cooking robot to cook in advance, and generate a recipe by obtaining the video of the cooking robot's cooking process and the equipment parameters of the cooking robot during the corresponding process. That is, the user needs to first use the cooking robot to cook according to his own taste style, record the cooking video and obtain the equipment parameters of the cooking robot in this process. Only in this way can a recipe be generated. However, in this process, there are some relatively closed cooking robots, such as a pocket-sized fully automatic cooking machine disclosed in the applicant's prior application No. 202222334287.4 and a fully automatic cooking robot disclosed in Application No. 202123025058.6. The wok is in a relatively closed environment, which is not suitable for users to cook by themselves. It is also difficult to record the cooking process of the cooking robot. In this case, the above-mentioned prior arts cannot be used to generate recipes. Therefore, the prior art has the disadvantage of a small scope of application.
[0010] In view of the above problems, the present application proposes a new technical solution. Summary of the invention
[0011] The purpose of the present application is to provide a recipe generation method, device, electronic device and storage medium, which have the advantages of being convenient for users to make recipes and having high applicability.
[0012] In the first aspect, the present application provides a recipe generation method, and the technical solution is as follows: include: Only the cooking videos with complete cooking time sequence and containing cooking operation step picture information and / or cooking operation step sound information are obtained; Play the cooking video on the user terminal and automatically generate an editing interface at a time node corresponding to the cooking time sequence according to the cooking operation step screen information and / or the cooking operation step sound information, the editing interface at least including an input area and a label area, the label area is provided with an identification label, and the identification label at least includes an ingredient label, a seasoning label, a heat label, and a portion label; Acquire the identification tag and corresponding text information from the tag area input by the user in the input area; Adding the identification tag together with the corresponding text information to the cooking time sequence to obtain cooking process information; A recipe that can be recognized and executed by a cooking robot is generated according to the cooking process information.
[0013] By playing a cooking video with a complete cooking time sequence and containing screen information of cooking operation steps and / or sound information of cooking operation steps on a user terminal, and then during the playback process, an editing interface is automatically generated at the corresponding time node for the user to perform editing operations, so that the user can edit according to the screen information of the cooking operation steps and / or the sound information of the cooking operation steps during the editing process, thereby convenient for the user to edit and generate recipes, and in this process, the recording of the cooking video does not need to use a cooking robot to cook, but a video of cooking with an ordinary wok can be shot. Since the cooking video has a complete cooking time sequence and contains screen information of the cooking operation steps and / or sound information of the cooking operation steps, the user does not need to use the parameter information of the cooking robot during the cooking process when editing and generating the recipe, so there is no need to shoot a specific video for the cooking robot to cook, but a video of cooking with ordinary pots can be shot, which has the beneficial effect of facilitating users to make recipes and high applicability.
[0014] Further, in the present application, the step of playing the cooking video on the user terminal and automatically generating an editing interface at a time node corresponding to the cooking time sequence according to the cooking operation step screen information and / or the cooking operation step sound information includes: Get playback request information; Play the cooking video on the user terminal according to the play request information; Calculating a first standard value of the cooking operation step picture information and a second standard value of the cooking operation step sound information at a time node corresponding to the cooking time sequence; When the first standard value is greater than a first preset value, the cooking operation step screen information is reduced and the editing interface is generated, so that the cooking operation step screen information and the editing interface are on the same display screen, and the cooking operation step screen information within a set range before and after the time node corresponding to the cooking time sequence that has been slowed down is played in a loop on the editing interface; When the second standard value is greater than the second preset value, the editing interface is generated, and the cooking operation step sound information that has been slowed down and noise reduced within a set range before and after the time node corresponding to the cooking time sequence is played in a loop on the editing interface.
[0015] Further, in the present application, the step of calculating the first standard value of the cooking operation step picture information and the second standard value of the cooking operation step sound information at the time node corresponding to the cooking time sequence includes: Extracting a first image frame in the cooking operation step screen information or a first keyword in the cooking operation step sound information to generate a time node corresponding to the cooking time sequence; Acquire a second image frame and a second keyword corresponding to a set range before and after the time node corresponding to the cooking time sequence; Calculating the first standard value according to the second image frame; Calculate the second standard value according to the second keyword; The first standard value refers to the degree of image change in the cooking operation step screen information; The second standard value refers to the degree of voice recognition in the cooking operation step sound information.
[0016] Furthermore, the present application also includes: The first preset value is adjusted or the second preset value is adjusted.
[0017] Further, in the present application, the step of adjusting the first preset value or adjusting the second preset value includes: Calculate a first difference between the first standard value and the first preset value; Calculate a second difference between the second standard value and the second preset value; Comparing the first difference with the second difference to obtain a comparison result, and adjusting the first preset value or the second preset value according to the comparison result; The step of adjusting the first preset value or the second preset value according to the comparison result comprises: When the first difference is greater than the second difference, adjusting the second preset value; When the second difference is greater than the first difference, adjusting the first preset value; The step of adjusting the second preset value comprises: When the first standard value is greater than the first preset value, reducing the second preset value; The step of adjusting the first preset value comprises: When the second standard value is greater than the second preset value, the first preset value is reduced.
[0018] Further, in the present application, when the first difference is greater than the second difference, the step of adjusting the second preset value includes: When the first difference is greater than the second difference, determining whether the second standard value is greater than a fourth preset value, and the fourth preset value is less than the second preset value; When the second standard value is greater than the fourth preset value, adjusting the second preset value, and the adjusted second preset value is not less than the fourth preset value; When the second difference is greater than the first difference, the step of adjusting the first preset value comprises: When the second difference is greater than the first difference, determining whether the first standard value is greater than a third preset value, and the third preset value is less than the first preset value; When the first standard value is greater than the third preset value, the first preset value is adjusted, and the adjusted first preset value is not less than the third preset value.
[0019] Furthermore, in the present application, the step of obtaining a cooking video having a complete cooking time sequence and containing cooking operation step picture information and / or cooking operation step sound information includes: Sending request information to the second software terminal through the first software terminal; The second software terminal retrieves the camera permission of the user terminal according to the request information to shoot a video, and obtains the cooking video having the complete cooking time sequence and including the cooking operation step screen information and / or the cooking operation step sound information; sending the cooking video to a server; The first software terminal or the second software terminal accesses the server to obtain the cooking video having the complete cooking time sequence and including the cooking operation step screen information and / or the cooking operation step sound information.
[0020] In a second aspect, the present application further provides a recipe generation device, which is used to execute the above-mentioned recipe generation method, comprising: The first module is used to obtain only the cooking video with a complete cooking time sequence and containing cooking operation step picture information and / or cooking operation step sound information; The second module is used to play the cooking video on the user terminal and automatically generate an editing interface at a time node corresponding to the cooking time sequence according to the cooking operation step screen information and / or the cooking operation step sound information, wherein the editing interface at least includes an input area and a label area, and the label area is provided with an identification label, and the identification label at least includes an ingredient label, a seasoning label, a heat label, and a portion label; A third module is used to obtain the identification label and corresponding text information from the label area input by the user in the input area; A fourth module is used to add the identification tag and the corresponding text information to the cooking time sequence to obtain cooking process information; The fifth module is used to generate a recipe that can be recognized and executed by the cooking robot according to the cooking process information.
[0021] In a third aspect, the present application further provides an electronic device, comprising a processor and a memory, wherein the memory stores computer-readable instructions, and when the computer-readable instructions are executed by the processor, the steps in the above method are executed.
[0022] In a fourth aspect, the present application further provides a storage medium on which a computer program is stored, and when the computer program is executed by a processor, the steps in the above method are executed.
[0023] As can be seen from the above, the present application provides a recipe generation method, device, electronic device and storage medium, which plays a cooking video with a complete cooking time sequence and containing cooking operation step screen information and / or cooking operation step sound information on a user terminal, and then automatically generates an editing interface at the corresponding time node during the playback process for the user to perform editing operations, so that the user can edit according to the cooking operation step screen information and / or cooking operation step sound information during the editing process, thereby convenient for the user to edit and generate recipes, and in this process, the recording of the cooking video does not require the use of a cooking robot to cook, but a video of cooking using an ordinary wok can be shot. Since the cooking video has a complete cooking time sequence and contains cooking operation step screen information and / or cooking operation step sound information, the user does not need to use the parameter information of the cooking robot during the cooking process in the process of editing and generating the recipe, so there is no need to shoot a specific video for the cooking robot to cook, but a video of cooking using ordinary pots can be shot, which has the beneficial effect of facilitating users to make recipes and high applicability. BRIEF DESCRIPTION OF THE DRAWINGS
[0024] Figure 1 A flowchart of a recipe generation method provided in this application.
[0025] Figure 2 A schematic diagram of the structure of a recipe generation device provided in this application.
[0026] Figure 3 A schematic diagram of the structure of an electronic device provided in this application.
[0027] Figure 4 This is a schematic diagram of the structure of the cooking robot targeted by the method of this application.
[0028] In the figure: 210, first module; 220, second module; 230, third module; 240, fourth module; 250, fifth module; 310, processor; 320, memory; 400, cookware; 500, housing. DETAILED DESCRIPTION
[0029] The technical solutions in the present application will be clearly and completely described below in conjunction with the drawings in the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. The components of the present application generally described and shown in the drawings here can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present application provided in the drawings is not intended to limit the scope of the present application for protection, but merely represents the selected embodiments of the present application. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without making creative work belong to the scope of protection of the present application.
[0030] It should be noted that similar reference numerals and letters represent similar items in the following drawings, so once an item is defined in one drawing, it does not need to be further defined and explained in subsequent drawings. At the same time, in the description of this application, the terms "first", "second", etc. are only used to distinguish the description and cannot be understood as indicating or implying relative importance.
[0031] Usually, when making a recipe, the user is generally required to have a very good understanding of the entire dish production process, and then record the entire dish production process to form a recipe. In this process, the user can manually record each operation step during the cooking process. This method is complicated and cumbersome to operate. The user needs to record while cooking, that is, the recipe cannot be edited anytime and anywhere.
[0032] In this regard, the user can record the cooking process by shooting a video, so that the recipe can be edited at the appropriate time anytime and anywhere. However, this method requires the user to constantly press the pause button while watching the recorded video, and then record manually. The operation is still inconvenient and has many shortcomings, which will greatly affect the user's enthusiasm for making their own recipes.
[0033] With the development of automation technology, more and more cooking robot products have emerged. Cooking robots can replace manual control to achieve automatic cooking. During the working process, cooking robots need to perform corresponding operations according to recipes, and there is a big difference between traditional recipes and cooking robot recipes. Cooking robots can only recognize and perform corresponding operations according to accurate specific parameters, such as adding a grams of seasoning, heating at b temperature for c time, etc., and these parameters are abstract and non-intuitive for users. Therefore, it becomes very difficult for users to make recipes for cooking robots, especially for users with low cooking skills. It is extremely difficult to make recipes for cooking robots. This leads to users with low cooking skills often only using the original preset recipes or recipes shared by other users, which often cannot fully suit their tastes, resulting in a low user experience. In addition, users who use cooking robots often have low cooking skills, which leads to a very small number of recipes actually shared, greatly limiting the user experience.
[0034] In this regard, some existing technologies have proposed methods for automatically generating recipes for cooking robots, such as the solutions recorded in Chinese invention patent applications with application numbers 201911086129.8, 202310877558.7, and 202311317039.1. In these existing solutions, it is necessary to shoot a video of the cooking robot cooking, and in this process, synchronously obtain the equipment parameters or control instructions of the cooking robot, and automatically generate a recipe by combining the captured video images.
[0035] The above-mentioned existing technology has indeed solved the problem of difficulty for users in making recipes. It can automatically generate recipes through video images combined with equipment parameters. Users only need to cook on the cooking robot and record the cooking process. There is no need for users to perform additional recipe editing operations.
[0036] However, the above-mentioned prior art has limitations. First, most users of cooking robots are not good at cooking. Even if the user operates the cooking robot to cook and records the whole process, the final recipe may not meet the user's taste. This is a problem caused by the user's own cooking skills. Second, the cooking robot needs to be in an open environment, which is convenient for users to manually operate the cooking robot and also for recording the cooking process. If the cooking robot's pot is in a relatively closed environment, it is difficult for users to operate it and record the video, which will greatly affect the difficulty of making the final recipe.
[0037] In this regard, if the above-mentioned existing technology is adopted, in order to finally obtain a satisfactory recipe, the user himself needs to have good cooking skills, or the user needs to find a person with high cooking skills to use the cooking robot to cook. At the same time, the cooking robot needs to be in an open state for easy operation and video recording, which has very large limitations. Through user surveys and market research, it can be known that users who use cooking robots are generally people who work away from home and have low cooking skills. The tastes that such users like are often the cooking tastes of their parents at home. However, since the user's own cooking skills are not high, it is impossible to make the taste he likes. Even if the cooking robot is operated to cook and the recipe is made through video recording, the user cannot get a recipe that satisfies the user in the end. This means that in some specific scenarios, if the user wants to make a satisfactory recipe, it is often necessary for the user's parents to come from other places to use the cooking robot to cook, and then record the cooking process and finally generate a recipe. Obviously, this has huge limitations and is not convenient to operate.
[0038] Moreover, among the existing cooking robots, although there are cooking robot products in an open state, the degree of automation of such products is relatively low, and their safety and working stability will fluctuate greatly. As for the scheme recorded in the Chinese invention patent applications with application numbers 202222334287.4 and 202123025058.6 previously applied by the applicant, the pot is in a relatively closed environment, so it has better safety and working stability. However, since the pot of such cooking robot products is in a relatively closed environment, it is difficult for users to observe the changing process of the dishes in the pot, which makes manual operation very difficult. At the same time, it is also difficult to record the cooking process through a camera. If a camera is installed inside the cooking robot, smoke and steam will be generated during the cooking process, which will block the camera, so there is also the problem of difficulty in video recording.
[0039] Because of this, the automatic recipe generation method for cooking robots in the existing technology has great limitations and is difficult to be truly promoted in the commercial market.
[0040] In this regard, the present application proposes a new solution for making recipes for cooking robots. Since the fully automated recipe generation method in the above-mentioned prior art has very great limitations, the solution provided by the present application abandons the solution of fully automatic recipe generation, and instead adopts the idea of assisting users in making recipes. By allowing users to participate in the editing and making process of recipes, the many limitations brought about by fully automatic recipe generation are reduced. At the same time, assistance is provided to users in the process of editing and making recipes, reducing the difficulty of users in the process of making recipes, so that even if users need to participate in the editing and making of recipes themselves, there will not be too many difficulties. At the same time, the limitations of the above-mentioned prior art are eliminated, so that users can finally easily make recipes that suit their taste and let the cooking robot make dishes that suit their taste according to the recipes.
[0041] For details, please refer to Figure 1 , this application proposes a recipe generation method, and the technical solution specifically includes: S110, only obtaining cooking videos having a complete cooking time sequence and containing cooking operation step picture information and / or cooking operation step sound information; S120, playing a cooking video on a user terminal and automatically generating an editing interface at a time node corresponding to a cooking time sequence according to the cooking operation step screen information and / or the cooking operation step sound information, the editing interface comprising at least an input area and a label area, the label area being provided with identification labels, the identification labels comprising at least an ingredient label, a seasoning label, a heat label, and a portion label; S130, obtaining the identification tag from the tag area and the corresponding text information input by the user in the input area; S140, adding the identification tag and the corresponding text information to the cooking time sequence to obtain cooking process information; S150: Generate a recipe that can be recognized and executed by the cooking robot based on the cooking process information.
[0042] Preferably, the cooking robot proposed in this application is Figure 4 As shown, the pot 400 of the cooking robot is surrounded by an outer shell 500, and the outer shell 500 forms a shield on the top of the pot 400, so that the pot 400 is in a relatively sealed state. The specific structure can refer to the scheme recorded in the applicant's prior Chinese invention patent applications with application numbers 202222334287.4 and 202123025058.6. Since the cooking robot is not the focus of this application, its specific structure will not be described again.
[0043] The complete cooking time sequence refers to a complete and continuous process from the start to the end of cooking, that is, a cooking video with a complete cooking time sequence refers to an unedited video containing the complete process from the start to the end of cooking.
[0044] The cooking operation step screen information refers to the image screen of cooking performed manually, and specifically, may include the image screen of the operation steps performed by the operator such as adding ingredients, adding seasonings, adjusting the heat, etc.
[0045] Among them, the cooking operation step sound information refers to the sound information of manual cooking. Specifically, it can include the sound information of operation steps such as adding ingredients, adding seasonings, adjusting the heat, etc. emitted by the operator. Preferably, the operator can say the relevant operation steps when performing the relevant operation steps, and the sound emitted by the operation steps spoken by the operator is used as the cooking operation step sound information.
[0046] The cooking video may be shot through a user terminal, which may specifically be a smart phone, camera or other device with video shooting capability.
[0047] Among them, the cooking video does not need to be recorded while cooking on a cooking robot, but can be recorded while cooking on ordinary pots. Its core purpose is to obtain the picture information of the cooking operation steps and / or the sound information of the cooking operation steps and the complete cooking time sequence.
[0048] After the cooking video is captured, it can be sent and downloaded. In some specific application scenarios, users can ask their parents to record a cooking video while cooking on an ordinary pot, and then send the cooking video to the user.
[0049] The cooking video is played on the user terminal. Specifically, a software corresponding to the cooking robot can be provided. After the user downloads or shoots the cooking video, the user imports the cooking video into the software for playback.
[0050] When the software corresponding to the cooking robot plays the cooking video, it automatically generates an editing interface at the time node corresponding to the cooking time sequence through image recognition technology and / or sound recognition technology according to the cooking operation step screen information and / or cooking operation step sound information, allowing users to edit in the editing interface.
[0051] The editing interface includes an input area and a label area. The label area is provided with identification labels. The identification labels include at least ingredient labels, seasoning labels, heat labels, and quantity labels. During the editing process, the user can slide and drag the identification label from the label area to the input area, and then enter the corresponding text information in the identification label. For example, the ingredient label is dragged into the input area, and then the specific ingredient name such as eggs is entered. The seasoning label is then dragged into the input area, and then the specific seasoning such as soy sauce is entered. The quantity label is then dragged into the input area, and then the specific quantity such as 20g is entered. The heat label is then dragged into the input area, and then the specific heat information such as low heat is entered. The specific parameters corresponding to the cooking robot recognition corresponding to the commonly used spoken operation steps can be established in advance, such as the heating temperature corresponding to micro heat is 20 to 40 degrees Celsius, the heating temperature corresponding to low heat is 40 to 60 degrees Celsius, the temperature corresponding to medium heat is 60 to 80 degrees Celsius, and the heating temperature corresponding to high heat is above 80 degrees Celsius. One tablespoon can also correspond to 15 milliliters or different grams can be corresponding to different specific seasonings.
[0052] That is, the user edits in the editing interface generated at the corresponding time node according to the cooking operation step screen information and / or the cooking operation step sound information. In this process, since the cooking video has the cooking operation step screen information and / or the cooking operation step sound information, when the user edits in the editing interface, he can edit according to the cooking operation step screen information and / or the cooking operation step sound information received during the playing of the cooking video, instead of directly editing the abstract cooking parameters based on imagination, thereby greatly reducing the difficulty of editing the recipe. In addition, in this process, the editing interface is generated at the time node corresponding to the cooking time sequence, therefore, the user does not need to consider the corresponding time required for each cooking step during the editing process. Compared with the original recipe making method, the user does not need to record each operation step during the cooking process, nor does he need to face various abstract cooking parameters, thereby greatly reducing the difficulty of editing the recipe. Compared with the existing method for automatically generating recipes for cooking robots, the cooking video shot by the solution of the present application does not need to be recorded when cooking on the cooking robot, and the video can be recorded when cooking with ordinary pots, thereby removing the restrictions on the cooking robot.
[0053] When the user completes editing in each editing interface, he / she can obtain the cooking process information, and then send the cooking process information to the server. The server compiles the cooking process information to obtain a recipe that can be recognized and executed by the cooking robot. The obtained recipe can be loaded into the corresponding cooking robot through data download.
[0054] The core inventive concept of the present application is to play a cooking video with a complete cooking time sequence and containing cooking operation step screen information and / or cooking operation step sound information on a user terminal. During this process, an editing interface is automatically generated at the corresponding time node based on image recognition or sound recognition technology, so that the user can edit the recipe on the editing interface, and during the user's editing process, the editing operation can be completed according to the cooking operation step screen information and / or cooking operation step sound information received during the cooking video playback. During this process, the user is not directly facing abstract cooking parameters, but completes the editing work under the guidance of the cooking operation step screen information and / or cooking operation step sound information. When the user completes the editing work in all editing interfaces, the cooking process information is obtained, and then a recipe recognized and executed by the cooking robot is generated according to the cooking process information.
[0055] Compared with the existing solutions for automatically generating recipes for cooking robots, the present application adopts a different technical route. The present application adopts a technical concept of assisting users in editing and making recipes. Therefore, an editing interface will be automatically generated at the time node corresponding to the cooking time sequence, and the editing interface includes an input area and a label area, which can facilitate users to edit recipes.
[0056] In summary, the present application plays a cooking video with a complete cooking time sequence and containing screen information of cooking operation steps and / or sound information of cooking operation steps on a user terminal, and then automatically generates an editing interface at the corresponding time node during the playback process for the user to perform editing operations, so that the user can edit according to the screen information of the cooking operation steps and / or the sound information of the cooking operation steps during the editing process, thereby convenient for the user to edit and generate recipes, and, in this process, the recording of the cooking video does not require the use of a cooking robot to cook, but a video of cooking using an ordinary wok can be shot. Since the cooking video has a complete cooking time sequence and contains screen information of the cooking operation steps and / or sound information of the cooking operation steps, the user does not need to use the parameter information of the cooking robot during the cooking process when editing and generating the recipe, so there is no need to shoot a specific video for the cooking robot to cook, but a video of cooking using ordinary pots can be shot, which has the beneficial effect of facilitating users to make recipes and high applicability.
[0057] Specifically, in some embodiments, the method provided by the present application can be implemented based on a software terminal installed on a user's user terminal. The software terminal can be installed on user terminals of different users, and the software terminals installed by different users can establish a connection relationship through a network. For example, a user installs a first software terminal on his own user terminal, and the user's parents or relatives and friends install a second software terminal on their user terminals. The first software terminal and the second software terminal can establish a connection relationship. The first software terminal can send a cooking video shooting request information to the second software terminal. After other users find the request information on the second software terminal, they can retrieve the camera authority of the user terminal through the second software terminal to shoot the video and obtain the cooking video. The shot cooking video can be directly uploaded to the server. At this time, the server automatically generates an editing interface at the time node corresponding to the cooking time sequence according to the cooking operation step screen information and / or the cooking operation step sound information in the cooking video. After uploading the cooking video to the server, the user can access the cooking video on the server on the first software terminal. After issuing a play request, the cooking video can be played on the user terminal, and the generated editing interface is displayed when the cooking video is played, so that the user can perform editing operations through the editing interface.
[0058] During this process, the user of the second software terminal can also access the server through the second software terminal and perform editing operations in the editing interface of the cooking video.
[0059] In some specific embodiments, when a user edits on a first software terminal, the corresponding editing operation will be saved on a cloud server, and the user of the first software terminal can send a help message to the user of the second software terminal to enable the user of the second software terminal to help complete the editing work.
[0060] In addition, in some specific implementations, the user can select a specified time node in the cooking time sequence when playing the cooking video, and then generate an editing interface at the specified time node.
[0061] Furthermore, in some specific implementations, the user may manually cancel the editing interface.
[0062] Through the above settings, the user can correct the situation where an editing interface is incorrectly generated and an editing interface is not generated at an appropriate location.
[0063] Among them, in some of the above embodiments, when the user edits the recipe in the editing interface, he can also do it through voice input.
[0064] In addition, after all the editing is completed, the edited video can be saved and stored on the server. The server parses the edited video and generates a recipe that can be recognized and executed by the cooking robot based on the editing operations on the cooking time series.
[0065] At the same time, since the edited video is saved separately, the user can operate the edited video when accessing the server through the first software terminal. For example, the operation of adding flavors can be performed separately, such as spicy, salty, sweet, etc. After adding the flavor, the recipe can be regenerated separately, and in the newly generated recipe, the use of seasonings will be adjusted according to the selected flavor. In this process, the user can perform the operation of adding flavors by voice input.
[0066] In the scheme of the present application, the user can shoot a cooking video through a software terminal. After shooting a video with a complete cooking time sequence, the video will be uploaded to a server. The server analyzes the cooking video based on image recognition technology and / or sound recognition technology to automatically find the time node corresponding to the cooking operation in the cooking time sequence. When the user terminal plays the cooking video, an editing interface will be generated at the corresponding time node. After the editing is completed, the edited video can also be saved in the server, and the automatic adjustment operation of adding flavor can be completed separately later. Among them, the saved video can be named with the corresponding dish name. When the user accesses the server, the flavor can be directly added by voice to generate a new recipe. For example, a video of green pepper and shredded pork edited by the user is saved on the server. After the user accesses the server and enters the corresponding interface, the user can input "green pepper and shredded pork, the taste is salty" by voice or text. At this time, the server will adjust the taste of the original saved edited video and automatically generate a new recipe that can be recognized and executed by the cooking robot. Specifically, the server can adjust the amount and / or type of seasoning separately according to the user's input.
[0067] Furthermore, in some of the embodiments, the step of playing the cooking video on the user terminal and automatically generating an editing interface at a time node corresponding to the cooking time sequence according to the cooking operation step screen information and / or the cooking operation step sound information includes: Get playback request information; Play the cooking video on the user terminal according to the play request information; Calculating a first standard value of the cooking operation step picture information and a second standard value of the cooking operation step sound information at a time node corresponding to the cooking time sequence; When the first standard value is greater than the first preset value, the cooking operation step screen information is reduced and an editing interface is automatically generated, so that the cooking operation step screen information and the editing interface are on the same display screen, and the cooking operation step screen information within a set range before and after the time node corresponding to the cooking time sequence processed by the slowing-down process is played in a loop on the editing interface; When the second standard value is greater than the second preset value, an editing interface is automatically generated, and the cooking operation step sound information that has been slowed down and noise-reduced within a set range before and after the time node corresponding to the cooking time sequence is played in a loop on the editing interface.
[0068] Since the present application adopts a technical concept different from the prior art and is intended to assist users in editing and making recipes, the cooking video is played on the user terminal, which may specifically refer to a smart phone or other smart terminal. During the playing of the cooking video, an editing interface is automatically generated at the corresponding time node for the user to edit.
[0069] On this basis, the present application further proposes to calculate the first standard value of the cooking operation step screen information and the second standard value of the cooking operation step sound information at the corresponding time node, wherein the first standard value refers to the degree of image change in the cooking operation step screen information, and the second standard value refers to the degree of voice recognition in the cooking operation step sound information.
[0070] An editing interface is automatically generated through comparison results of the first standard value and the first preset value, and comparison results of the second standard value and the second preset value, so as to better assist the user in editing and making recipes in the editing interface.
[0071] Specifically, when the first standard value is greater than the first preset value, the cooking operation step screen information is reduced and an editing interface is automatically generated, so that the cooking operation step screen information and the editing interface are on the same display screen, and the cooking operation step screen information within a set range before and after the time node corresponding to the cooking time sequence that has been slowed down is played in a loop on the editing interface.
[0072] When the first standard value is greater than the first preset value, it indicates that the image changes significantly, which means that the user can receive clear information from the cooking operation step screen information to edit the recipe. Therefore, in this case, the cooking operation step screen information can be reduced and displayed in the same display screen as the editing interface, that is, at this time, the screen of the user terminal is divided into two display areas, one of which displays the cooking video, and the other displays the editing interface for the user to edit. In this way, the user can watch the cooking video while editing, which makes it more convenient for the user to edit. In addition, in this process, when the cooking video and the editing interface are displayed on the same screen, the cooking operation step screen information within the set range before and after the corresponding time node is played in a loop, so that the user can clearly understand the operation steps to be performed at the corresponding time node through the cooking operation step screen information, which is beneficial for the user to edit and make recipes. In addition, the cooking operation step screen information that is played in a loop can also be slowed down, so that the user can more easily obtain the corresponding operation information from the cooking operation step screen information, which is more beneficial for the user to edit and make recipes.
[0073] In the scheme of the present application, the cooking operation step screen information and the cooking operation step sound information are used to allow users to obtain sufficient information to determine the operation steps performed at the corresponding time node, wherein, the user can rely solely on the cooking operation step screen information or solely on the cooking operation step sound information, or can also rely on the cooking operation step screen information and the cooking operation step sound information at the same time to assist the user in editing and making recipes.
[0074] When the first standard value is greater than the first preset value, since the first standard value is calculated at the corresponding time node, it indicates that the cooking operation step screen information has undergone significant changes. Generally speaking, the user can obtain specific operation steps from the image that has undergone significant changes, thereby completing the editing and production of the recipe. Therefore, when the first standard value is greater than the first preset value, it usually means that the user can complete the editing and production of the recipe only by relying on the cooking operation step screen information, so the cooking operation step screen information will be reduced and the editing interface will be automatically generated so that the cooking operation step screen information and the editing interface are on the same display screen, and the cooking operation step screen information within the set range before and after the time node corresponding to the cooking time sequence that has been slowed down will be played in a loop on the editing interface, so that the user can complete the editing and production of the recipe.
[0075] The editing and making of the recipe mentioned above may specifically be the editing and making of a certain step in the recipe.
[0076] In addition, when the second standard value is greater than the second preset value, an editing interface is automatically generated, and the cooking operation step sound information that has been slowed down and noise reduced within a set range before and after the time node corresponding to the cooking time sequence is played in a loop on the editing interface.
[0077] When the second standard value is greater than the second preset value, it indicates that the degree of voice recognition in the cooking operation step sound information is high, which means that the user can receive clear information from the cooking operation step sound information to edit the recipe. Therefore, in this case, the cooking operation step sound information that has been slowed down and noise reduced within a set range before and after the time node corresponding to the cooking time sequence is played in a loop on the editing interface so that the user can complete the editing and production of the recipe more easily.
[0078] In addition, in some preferred embodiments, if the first standard value is greater than the first preset value and the second standard value is greater than the second preset value, the above method can be executed simultaneously, that is, after reducing the cooking operation step screen information so that the editing interface and the cooking video are on the same display screen, the cooking operation step screen information that has been slowed down and the corresponding cooking operation step sound information that has been slowed down and noise reduced are played in a loop.
[0079] In addition, in some preferred embodiments, when the first standard value is not greater than the first preset value and the second standard value is not greater than the second preset value, a suggestion message to reshoot the cooking video is sent to the user.
[0080] In some of the above-mentioned embodiments, the present application proposes that a cooking video can be shot through a first software terminal and a second software terminal. After a suggestion message for reshooting the cooking video is sent to the user, a reshoot option is generated on the first software terminal or the second software terminal. When the user selects the reshoot option to shoot, a reminder suggestion mode is triggered. In the reminder suggestion mode, a voice or text suggestion message is generated to remind the user to shoot.
[0081] Preferably, in the reminder suggestion mode, the smoke in the captured image is detected in real time, and when the amount of smoke reaches a set value, the user is reminded to remove the smoke.
[0082] Preferably, in the reminder suggestion mode, the background noise during the shooting process is detected in real time, and when the background noise reaches a set value, the user is reminded to raise the speaking voice.
[0083] Preferably, in the reminder suggestion mode, the cooking operation step picture information and the cooking operation step sound information during the shooting process are detected and compared in real time; When it is detected that there is cooking operation step picture information in the shooting picture but there is no cooking operation step sound information, reminding the user to send the cooking operation step sound information; When the cooking operation step sound information is detected but the cooking operation step picture information does not exist, the user is reminded to take a correct picture.
[0084] In addition, when the user sends out the cooking operation step sound information or takes the correct picture under the reminder, the cooking operation step sound information or cooking operation step picture information obtained therefrom has a certain lag, so a lag label can be generated at the corresponding position.
[0085] When the editing interface is automatically generated at the time node corresponding to the cooking time sequence based on the cooking operation step screen information and / or the cooking operation step sound information, it is determined whether there is a lag tag. When there is a lag tag, the editing interface is automatically generated at the time node corresponding to the cooking time sequence based on the lag tag and the cooking operation step screen information and / or the cooking operation step sound information.
[0086] That is, in some specific embodiments, when automatically generating an editing interface, if there is a lagging tag, when two adjacent editing interfaces are generated separately based on the cooking operation step screen information and the cooking operation step sound information, the subsequent editing interface can be cancelled.
[0087] In addition, in the above scheme, since the obtained cooking operation step sound information or cooking operation step screen information has a certain lag, when there is a lag tag, the set range in the cooking operation step screen information within the set range before and after the time node corresponding to the cooking time sequence that has been slowed down and played in a loop in the editing interface can be adjusted to extend the set range.
[0088] When there is a lagging tag, the set range of the cooking operation step sound information that has been slowed down and noise-reduced and played back in a loop in the editing interface within a set range before and after the time node corresponding to the cooking time sequence can be adjusted to extend the set range.
[0089] Further, in some embodiments, the step of calculating the first standard value of the cooking operation step picture information and the second standard value of the cooking operation step sound information at the time node corresponding to the cooking time sequence includes: Extracting the first image frame in the cooking operation step screen information or the first keyword in the cooking operation step sound information to generate a time node corresponding to the cooking time sequence; Acquire a second image frame and a second keyword corresponding to a set range before and after a time node corresponding to the cooking time sequence; Calculating a first standard value according to the second image frame; A second standard value is calculated according to the second keyword.
[0090] The time node corresponding to the cooking time sequence is generated by extracting the first image frame in the cooking operation step screen information or the first keyword in the cooking operation step sound information. The corresponding time node indicates that the cooking operation step exists at the time node, which is determined based on the image recognition technology or the voice recognition technology. For example, in the previous image frame, the operator does not have the seasoning bottle in his hand, but in the next image frame, that is, the first image frame, the operator holds the seasoning bottle in his hand. Then, the time node corresponding to the cooking time sequence can be generated at the first image frame. In addition, the voice recognition technology can also be used for judgment. For example, when recording a video, the operator is required to say each operation step. Based on the extraction of keywords, such as extracting keywords such as "put in", "add", and "join", the time node corresponding to the cooking time sequence is generated at the corresponding position.
[0091] After generating the time node corresponding to the cooking time sequence, the second image frame and the second keyword corresponding to the set range before and after the time node corresponding to the cooking time sequence are obtained, and the first standard value is calculated through the second image frame, and the second standard value is calculated through the second keyword, wherein the second image frame may include the first image frame, and the second keyword may include the first keyword, and the first standard value and the second standard value are calculated corresponding to the second image frame and the second keyword to determine whether the user can obtain clear operating steps according to the second image frame or the second keyword to edit and make the recipe.
[0092] It is worth noting that, in the scheme of the present application, the time node corresponding to the cooking time sequence is the time point at which the cooking operation occurred based on the image recognition technology or the voice recognition technology. On this basis, since the technical concept of the present application is to provide assistance to users to help them edit and make recipes, the present application proposes to play a cooking video with cooking operation step screen information and / or cooking operation step sound information on the user terminal, and automatically generate an editing interface for users to edit at the time node corresponding to the cooking time sequence, so that users can edit after receiving the cooking operation step screen information and / or cooking operation step sound information, thereby reducing the difficulty of editing. During the cooking process, since the user needs to obtain information through the cooking operation step screen information and / or the cooking operation step sound information, if the cooking operation step screen information and / or the cooking operation step sound information cannot allow the user to obtain the information accurately and clearly, it will cause trouble for the user to edit and make the recipe. At this time, the user may be suggested to re-shoot the cooking video, that is, when the first standard value is less than or equal to the first preset value, and the second standard value is less than or equal to the second preset value, a suggestion message to re-shoot the cooking video is sent to the user to avoid the user from editing and making the recipe when the user cannot clearly and accurately obtain the operation steps, which not only wastes the user's time and energy, but also the final recipe may not satisfy the user.
[0093] Therefore, in the scheme of the present application, the first standard value is calculated based on the second image frame, and the second standard value is calculated based on the second keyword. The purpose is to ensure that the user can clearly and accurately obtain the cooking operation steps from the cooking operation step screen information and / or the cooking operation step sound information.
[0094] Furthermore, in some embodiments, it also includes: The first preset value is adjusted or the second preset value is adjusted.
[0095] In some of the above-mentioned embodiments, the present application proposes to measure whether the user can clearly and accurately obtain the cooking operation steps from the cooking operation step screen information and / or the cooking operation step sound information by calculating the first standard value and the second standard value. When the first standard value is greater than the first preset value, it means that the user can clearly and accurately obtain the cooking operation steps from the cooking operation step screen information. When the second standard value is greater than the second preset value, it means that the user can clearly and accurately obtain the cooking operation steps from the cooking operation step sound information. As a preferred method, the user should obtain the cooking operation steps from both the cooking operation step screen information and the cooking operation step sound information.
[0096] When the first standard value is greater than the first preset value and the second standard value is not greater than the second preset value, the user will only be able to obtain the cooking operation steps through the cooking operation step screen information. However, in this case, the user can already clearly and accurately obtain the cooking operation steps based on the cooking operation step screen information. At this time, even if the voice recognition level of the cooking operation step sound information is low, combining the cooking operation step screen information can allow the user to obtain the cooking operation steps more clearly and accurately. Therefore, in this case, the second preset value can be lowered so that the user can obtain the cooking operation steps based on both the cooking operation step screen information and the cooking operation step sound information.
[0097] Similarly, when the second standard value is greater than the second preset value and the first standard value is not greater than the first preset value, the user will only be able to obtain the cooking operation steps through the cooking operation step sound information. However, in this case, the user can already clearly and accurately obtain the cooking operation steps based on the cooking operation step sound information. At this time, even if the degree of change in the cooking operation step screen information is low, combined with the cooking operation step sound information, the user can obtain the cooking operation steps more clearly and accurately. Therefore, in this case, the first preset value can be lowered so that the user can obtain the cooking operation steps based on both the cooking operation step screen information and the cooking operation step sound information.
[0098] Specifically, the step of adjusting the first preset value or adjusting the second preset value includes: Calculate a first difference between the first standard value and the first preset value; Calculate a second difference between the second standard value and the second preset value; Comparing the first difference and the second difference to obtain a comparison result, and adjusting the first preset value or the second preset value according to the comparison result; The step of adjusting the first preset value or the second preset value according to the comparison result comprises: When the first difference is greater than the second difference, adjusting the second preset value; When the second difference is greater than the first difference, adjusting the first preset value; The step of adjusting the second preset value includes: When the first standard value is greater than the first preset value, lowering the second preset value; The step of adjusting the first preset value includes: When the second standard value is greater than the second preset value, the first preset value is reduced.
[0099] In some of the above embodiments, in order to make it easier for users to edit recipes in the editing interface, it is proposed to adjust the first preset value or the second preset value. As for whether to adjust the first preset value or the second preset value, this embodiment proposes to calculate the first difference between the first standard value and the first preset value and the second difference between the second standard value and the second preset value, wherein the first difference and the second difference can be negative numbers. When the first difference is a negative number, it indicates that the first standard value is less than the first preset value. When the second difference is a negative number, it indicates that the second standard value is less than the second preset value. When the first difference is greater than the second difference, it indicates that the image change degree in the cooking operation step screen information is higher, and the user can mainly obtain the cooking operation steps through the cooking operation step screen information, so the second preset value can be adjusted. When the second difference is greater than the first difference, it indicates that the voice recognition degree in the cooking operation step sound information is higher, and the user can mainly obtain the cooking operation steps through the cooking operation step sound information, so the first preset value can be adjusted.
[0100] Further, in some embodiments, when the first difference is greater than the second difference, the step of adjusting the second preset value includes: When the first difference is greater than the second difference, determining whether the second standard value is greater than a fourth preset value, and the fourth preset value is less than the second preset value; When the second standard value is greater than the fourth preset value, the second preset value is adjusted, and the adjusted second preset value is not less than the fourth preset value; When the second difference is greater than the first difference, the step of adjusting the first preset value includes: When the second difference is greater than the first difference, determining whether the first standard value is greater than a third preset value, and the third preset value is less than the first preset value; When the first standard value is greater than the third preset value, the first preset value is adjusted, and the adjusted first preset value is not less than the third preset value.
[0101] In some of the above-mentioned embodiments, the present application proposes to allow users to obtain the cooking operation steps based on the cooking operation step screen information and the cooking operation step sound information as much as possible. However, in this process, if the first difference is greater than the second difference, it means that the user can mainly obtain the cooking operation steps through the cooking operation step screen information. At this time, the second preset value can be appropriately lowered to allow the user to receive the cooking operation step sound information as much as possible. However, if the second standard value is too small, less than or equal to the fourth preset value, at this time, it is considered that it is difficult for the user to obtain useful information from the cooking operation step sound information. At this time, the cooking operation step sound information will not help the user, but may bring obstacles. For example, the sound emitted during the actual cooking process will cover the cooking operation step sound information spoken by the operator. In this case, the sound information can be regarded as a kind of noise, which will not only fail to provide help to the user, but also have a bad impact on the user and distract the user's attention. Therefore, only when the second standard value is greater than the fourth preset value, the second preset value will be adjusted, and the adjusted second preset value will not be less than the fourth preset value.
[0102] Similarly, the first preset value is adjusted only when the first standard value is greater than the third preset value, and the adjusted first preset value is not less than the third preset value.
[0103] That is, the present application sets the third preset value and the fourth preset value as the lower limits of the first standard value and the second standard value respectively, so as to avoid displaying the cooking operation step screen information to the user when the first standard value is equal to or lower than the third preset value, and avoids displaying the cooking operation step sound information to the user when the second standard value is equal to or lower than the fourth preset value. When the first standard value is equal to or lower than the third preset value, the cooking operation step screen information may interfere with the user. In this case, not displaying the cooking operation step screen information may allow the user to concentrate on the cooking operation step sound information. When the second standard value is equal to or lower than the fourth preset value, the cooking operation step sound information may interfere with the user. In this case, not displaying the cooking operation step sound information may allow the user to concentrate on the cooking operation step screen information. In the above manner, users can better complete the editing and production of recipes.
[0104] Furthermore, in some embodiments, after the step of adding the identification tag together with the corresponding text information to the cooking time sequence to obtain the cooking process information, the step further includes: Play a cooking video with cooking process information and display identification labels along with the cooking time sequence during playback.
[0105] By playing a cooking video with cooking process information and displaying identification labels, users can double-check whether there are any omissions or errors in the entire cooking process, thereby avoiding the final generation of an incorrect recipe.
[0106] Once the user confirms that everything is correct, the cooking process information can be uploaded to the server, which will automatically compile and generate a recipe that can be recognized and executed by the cooking robot.
[0107] Second, refer to Figure 2 The present application also provides a recipe generation device for executing the above-mentioned recipe generation method, comprising: The first module 210 is used to obtain a cooking video having a complete cooking time sequence and including cooking operation step picture information and / or cooking operation step sound information; The second module 220 is used to play the cooking video on the user terminal and automatically generate an editing interface at a time node corresponding to the cooking time sequence according to the cooking operation step screen information and / or the cooking operation step sound information, wherein the editing interface at least includes an input area and a label area, wherein the label area is provided with an identification label, and the identification label at least includes an ingredient label, a seasoning label, a heat label, and a portion label; The third module 230 is used to obtain the identification label and corresponding text information from the label area input by the user in the input area; The fourth module 240 is used to add the identification tag and the corresponding text information to the cooking time sequence to obtain the cooking process information; The fifth module 250 is used to generate a recipe that can be recognized and executed by the cooking robot based on the cooking process information.
[0108] By playing a cooking video with a complete cooking time sequence and containing screen information of cooking operation steps and / or sound information of cooking operation steps on a user terminal, and then during the playback process, an editing interface is automatically generated at the corresponding time node for the user to perform editing operations, so that the user can edit according to the screen information of the cooking operation steps and / or the sound information of the cooking operation steps during the editing process, thereby convenient for the user to edit and generate recipes, and in this process, the recording of the cooking video does not need to use a cooking robot to cook, but a video of cooking with an ordinary wok can be shot. Since the cooking video has a complete cooking time sequence and contains screen information of the cooking operation steps and / or sound information of the cooking operation steps, the user does not need to use the parameter information of the cooking robot during the cooking process when editing and generating the recipe, so there is no need to shoot a specific video for the cooking robot to cook, but a video of cooking with ordinary pots can be shot, which has the beneficial effect of facilitating users to make recipes and high applicability.
[0109] In addition, in some preferred embodiments, a recipe generation device proposed in the present application can perform any step of the above method.
[0110] Thirdly, refer to Figure 3 The present application also provides an electronic device, including a processor 310 and a memory 320, wherein the memory 320 stores computer-readable instructions. When the computer-readable instructions are executed by the processor 310, the steps in the above method are executed.
[0111] Through the above technical solution, the processor 310 and the memory 320 are interconnected and communicate with each other through a communication bus and / or other forms of connection mechanisms (not shown), and the memory 320 stores computer-readable instructions executable by the processor 310. When the electronic device is running, the processor 310 executes the computer-readable instructions to execute the method in any optional implementation of the above embodiment to achieve the following functions: obtaining a cooking video with a complete cooking time sequence and containing cooking operation step screen information and / or cooking operation step sound information; playing the cooking video on the user terminal and automatically generating an editing interface at a time node corresponding to the cooking time sequence according to the cooking operation step screen information and / or the cooking operation step sound information, the editing interface at least including an input area and a label area, the label area is placed with an identification label, and the identification label at least includes an ingredient label, a seasoning label, a heat label and a portion label; obtaining an identification label from the label area and corresponding text information entered by the user in the input area; adding the identification label together with the corresponding text information to the cooking time sequence to obtain cooking process information; generating a recipe that can be recognized and executed by the cooking robot according to the cooking process information.
[0112] In a fourth aspect, the present application also provides a storage medium on which a computer program is stored. When the computer program is executed by a processor, the steps in the above method are executed.
[0113] Through the above technical solution, when the computer program is executed by the processor, the method in any optional implementation method of the above embodiment is executed to achieve the following functions: obtaining a cooking video with a complete cooking time sequence and containing cooking operation step screen information and / or cooking operation step sound information; playing the cooking video on the user terminal and automatically generating an editing interface at a time node corresponding to the cooking time sequence according to the cooking operation step screen information and / or the cooking operation step sound information, the editing interface at least including an input area and a label area, the label area is placed with an identification label, the identification label at least includes an ingredient label, a seasoning label, a heat label and a portion label; obtaining an identification label from the label area and the corresponding text information entered by the user in the input area; adding the identification label together with the corresponding text information to the cooking time sequence to obtain the cooking process information; generating a recipe that can be recognized and executed by the cooking robot according to the cooking process information.
[0114] Among them, the storage medium can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable red-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk or optical disk.
[0115] In the embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some communication interfaces, and the indirect coupling or communication connection of devices or units can be electrical, mechanical or other forms.
[0116] In addition, the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0117] Furthermore, the functional modules in the various embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.
[0118] The above description is only an embodiment of the present application and is not intended to limit the scope of protection of the present application. For those skilled in the art, the present application may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the scope of protection of the present application.
Claims
1. A recipe generation method, It is characterized in that include: Only the cooking videos with complete cooking time sequence and containing cooking operation step picture information and / or cooking operation step sound information are obtained; Play the cooking video on the user terminal and automatically generate an editing interface at a time node corresponding to the cooking time sequence according to the cooking operation step screen information and / or the cooking operation step sound information, the editing interface at least including an input area and a label area, the label area is provided with an identification label, and the identification label at least includes an ingredient label, a seasoning label, a heat label, and a portion label; Acquire the identification tag and corresponding text information from the tag area input by the user in the input area; Adding the identification tag together with the corresponding text information to the cooking time sequence to obtain cooking process information; A recipe that can be recognized and executed by a cooking robot is generated according to the cooking process information.
2. A recipe generation method according to claim 1, It is characterized in that The step of playing the cooking video on the user terminal and automatically generating an editing interface at a time node corresponding to the cooking time sequence according to the cooking operation step screen information and / or the cooking operation step sound information comprises: Get playback request information; Play the cooking video on the user terminal according to the play request information; Calculating a first standard value of the cooking operation step picture information and a second standard value of the cooking operation step sound information at a time node corresponding to the cooking time sequence; When the first standard value is greater than a first preset value, the cooking operation step screen information is reduced and the editing interface is generated, so that the cooking operation step screen information and the editing interface are on the same display screen, and the cooking operation step screen information within a set range before and after the time node corresponding to the cooking time sequence that has been slowed down is played in a loop on the editing interface; When the second standard value is greater than the second preset value, the editing interface is generated, and the cooking operation step sound information that has been slowed down and noise reduced within a set range before and after the time node corresponding to the cooking time sequence is played in a loop on the editing interface.
3. A recipe generation method according to claim 2, It is characterized in that The step of calculating the first standard value of the cooking operation step picture information and the second standard value of the cooking operation step sound information at the time node corresponding to the cooking time sequence comprises: Extracting a first image frame in the cooking operation step screen information or a first keyword in the cooking operation step sound information to generate a time node corresponding to the cooking time sequence; Acquire a second image frame and a second keyword corresponding to a set range before and after the time node corresponding to the cooking time sequence; Calculating the first standard value according to the second image frame; Calculate the second standard value according to the second keyword; The first standard value refers to the degree of image change in the cooking operation step screen information; The second standard value refers to the degree of voice recognition in the cooking operation step sound information.
4. A recipe generation method according to claim 3, It is characterized in that Also includes: The first preset value is adjusted or the second preset value is adjusted.
5. A recipe generation method according to claim 4, It is characterized in that The step of adjusting the first preset value or adjusting the second preset value comprises: Calculate a first difference between the first standard value and the first preset value; Calculate a second difference between the second standard value and the second preset value; Comparing the first difference with the second difference to obtain a comparison result, and adjusting the first preset value or the second preset value according to the comparison result; The step of adjusting the first preset value or the second preset value according to the comparison result comprises: When the first difference is greater than the second difference, adjusting the second preset value; When the second difference is greater than the first difference, adjusting the first preset value; The step of adjusting the second preset value comprises: When the first standard value is greater than the first preset value, reducing the second preset value; The step of adjusting the first preset value comprises: When the second standard value is greater than the second preset value, the first preset value is reduced.
6. A recipe generation method according to claim 5, It is characterized in that When the first difference is greater than the second difference, the step of adjusting the second preset value comprises: When the first difference is greater than the second difference, determining whether the second standard value is greater than a fourth preset value, and the fourth preset value is less than the second preset value; When the second standard value is greater than the fourth preset value, adjusting the second preset value, and the adjusted second preset value is not less than the fourth preset value; When the second difference is greater than the first difference, the step of adjusting the first preset value comprises: When the second difference is greater than the first difference, determining whether the first standard value is greater than a third preset value, and the third preset value is less than the first preset value; When the first standard value is greater than the third preset value, the first preset value is adjusted, and the adjusted first preset value is not less than the third preset value.
7. A recipe generation method according to claim 1, It is characterized in that The step of obtaining a cooking video having a complete cooking time sequence and containing cooking operation step picture information and / or cooking operation step sound information comprises: Sending request information to the second software terminal through the first software terminal; The second software terminal retrieves the camera permission of the user terminal according to the request information to shoot a video, and obtains the cooking video having the complete cooking time sequence and including the cooking operation step screen information and / or the cooking operation step sound information; sending the cooking video to a server; The first software terminal or the second software terminal accesses the server to obtain the cooking video having the complete cooking time sequence and including the cooking operation step screen information and / or the cooking operation step sound information.
8. A recipe generating device, It is characterized in that The method for executing the recipe generation method according to any one of claims 1 to 7 comprises: The first module is used to obtain only the cooking video with a complete cooking time sequence and containing cooking operation step picture information and / or cooking operation step sound information; The second module is used to play the cooking video on the user terminal and automatically generate an editing interface at a time node corresponding to the cooking time sequence according to the cooking operation step screen information and / or the cooking operation step sound information, wherein the editing interface at least includes an input area and a label area, and the label area is provided with an identification label, and the identification label at least includes an ingredient label, a seasoning label, a heat label, and a portion label; A third module is used to obtain the identification label and corresponding text information from the label area input by the user in the input area; A fourth module is used to add the identification tag and the corresponding text information to the cooking time sequence to obtain cooking process information; The fifth module is used to generate a recipe that can be recognized and executed by the cooking robot according to the cooking process information.
9. An electronic device, It is characterized in that The method comprises a processor and a memory, wherein the memory stores computer-readable instructions. When the computer-readable instructions are executed by the processor, the steps in the method according to any one of claims 1 to 7 are executed.
10. A storage medium having a computer program stored thereon, It is characterized in that When the computer program is executed by a processor, the steps in the method according to any one of claims 1 to 7 are executed.
Citation Information
Patent Citations
Cooking error correction system based on big data and working method of system
CN112100488A
Menu making method and device and cooking machine
CN112784640A
Menu generation method and cooking method
CN115708021A
Electronic menu generation method, electronic equipment, cooking equipment and display equipment
CN116414264A
Interaction method and device based on menu, equipment and storage medium
CN117319745A
