Auxiliary cooking method and system based on image recognition
By obtaining user identity and providing personalized recipes and teaching videos, monitoring the cooking status of novice users and cooking analysis of experienced users, the problem of the inability to distinguish user identity in the existing technology is solved, and efficient and accurate cooking assistance is achieved, improving User experience and cooking efficiency.
Patent Information
- Application Number
- CN202411256590.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-09
- Publication Date
- 2024-11-26
- Estimated Expiration
- 2044-09-09
AI Technical Summary
Existing auxiliary cooking methods based on image recognition cannot distinguish the user's cooking identity, resulting in the inability to provide precise cooking assistance for novices or experienced users, reducing the user's cooking experience and efficiency.
By obtaining the user's login information, novice users can obtain recipes and preparatory teaching videos, monitor cooking status and provide adjustment methods; experience users generate new dishes, analyze taste and taste coefficients, remind cooking precautions, and cook in novice users. Issue an early warning when it is unsafe.
It realizes precise assistance for different cooking identities, improves the cooking safety of novices and the cooking efficiency of experienced users, meets the cooking needs of users, and solves the problems of novices' helplessness and experienced users' cooking skills.
Smart Images

Figure CN118781591B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of image recognition, and in particular to an auxiliary cooking method and system based on image recognition. Background Art
[0002] In today's life, more and more people are trying to cook by themselves, but due to lack of cooking experience, they are unable to accurately find a cooking method that suits them. However, with the emergence of image recognition, users can find their own position more accurately. By asking users to fill in registration information, users are divided into corresponding categories, and then auxiliary distinction between novice users and experienced users' corresponding cooking identities is achieved, ensuring the cooking safety of novice users and reminding experienced users of cooking precautions, thereby meeting users' cooking needs.
[0003] Prior art, such as the invention patent application with announcement number CN116189174A, discloses an auxiliary cooking method, device, equipment and storage medium based on image recognition. The auxiliary cooking method based on image recognition includes obtaining a target ingredient image corresponding to the target ingredient through an image acquisition device, and determining the type of the target ingredient according to the target ingredient image; determining the target recipe corresponding to the target ingredient based on the type of the target ingredient and a preset standard recipe library; judging the maturity of the target ingredient through a preset ingredient heating model, and issuing a voice prompt based on the maturity and the target recipe to assist the user in completing the cooking of the target ingredient. After obtaining the target ingredient image through an image acquisition device, the present application further determines the type of the target ingredient, and determines the target recipe through a preset recipe and the type of the target ingredient. When the target recipe is determined, the maturity corresponding to the target ingredient is obtained through a pre-trained ingredient heating model, and a voice prompt is issued according to the maturity to assist the user in completing the cooking process corresponding to the target recipe, thereby improving the user experience and solving the technical problem of poor user experience of the user for the auxiliary cooking device during the auxiliary cooking process.
[0004] In response to the above scheme, the applicant of the present invention found that the above technical problems exist in at least the following technical problems: the above invention mainly determines the target recipe and issues voice prompts according to the maturity to assist the user to complete the cooking process corresponding to the target recipe, but does not distinguish the user's corresponding cooking identity positioning, and is unable to know the user's corresponding cooking level, and thus cannot provide the user with accurate cooking assistance methods when corresponding to the novice identity or the experienced identity, and cannot meet the user's corresponding cooking needs when they are in the novice identity or the experienced identity, thereby reducing the user's cooking experience and cooking efficiency. Summary of the invention
[0005] In view of the above-mentioned technical deficiencies, an object of the present invention is to provide an auxiliary cooking method and system based on image recognition.
[0006] In order to solve the above technical problems, the present invention adopts the following technical solutions: The present invention provides an auxiliary cooking method based on image recognition, including: Step 1, user information acquisition: acquiring the login information corresponding to the user, and dividing the identity corresponding to the user.
[0007] Step 2, obtaining novice cooking information: obtain the dish requirements corresponding to the novice user, and then screen the recipes corresponding to the novice user. When the novice user is monitored to have prepared the dishes on the corresponding recipes, obtain the cooking information corresponding to the novice user, generate a dish preparation teaching video corresponding to the novice user, monitor the dish preparation completion image corresponding to the novice user, and then analyze to obtain the cooking adjustment method corresponding to the novice user. At the same time, monitor the cooking information of the recipes corresponding to the novice user in the time period, analyze to obtain the cooking coefficient of the recipes corresponding to the novice user, and then determine the cooking status of the recipes corresponding to the novice user.
[0008] Step 3. Cooking adjustment by experienced users: Generate new dishes corresponding to the experienced users based on the categories of ingredients and taste requirements uploaded by the experienced users, obtain historical operation information of the dishes made by the experienced users, analyze the taste coefficient and mouthfeel coefficient of the new dishes made by the experienced users, and analyze the cooking precautions for the new dishes made by the experienced users.
[0009] Step 4: Early warning: When the cooking status of a recipe corresponding to a novice user is unsafe, an early warning will be issued.
[0010] Step 5: Result display: Display the cooking precautions for the experienced user to prepare the new dishes.
[0011] In a second aspect, the present invention provides an auxiliary cooking system based on image recognition, comprising: a user information acquisition module, used to acquire login information corresponding to a user, and divide and obtain the identity corresponding to the user.
[0012] The novice cooking information acquisition module is used to filter and obtain recipes corresponding to novice users, generate and obtain dish preparation instruction videos corresponding to novice users, analyze and obtain cooking adjustment methods corresponding to novice users, and determine and obtain the cooking status of recipes corresponding to novice users.
[0013] The experienced user cooking adjustment module is used to generate new dishes corresponding to the experienced users, analyze the taste coefficient and mouthfeel coefficient of the new dishes made by the experienced users, and analyze the cooking precautions for the new dishes made by the experienced users.
[0014] The early warning terminal is used to issue an early warning prompt when the cooking status of the corresponding recipe of the novice user is unsafe.
[0015] The display terminal is used to display cooking precautions for experienced users to prepare new dishes.
[0016] Compared with the prior art, the beneficial effects of the present invention are as follows: the present invention provides an auxiliary cooking method and system based on image recognition, firstly, users are divided into corresponding identities, and then cooking assistance for the corresponding identities of the users is performed, the recipes corresponding to the novice users are obtained by screening, and then the novice users are monitored accordingly, the cooking status of the corresponding recipes of the novice users is judged, and at the same time, new dishes corresponding to the experienced users are generated, and the historical operation information of the corresponding dishes made by the experienced users is monitored, so as to analyze and obtain the cooking precautions for the experienced users to make the corresponding new dishes, and realize accurate cooking assistance for the users corresponding to each cooking identity, help users find the cooking method suitable for themselves, maintain the cooking safety of novice users and remind the cooking precautions of experienced users, solve the deficiencies in the current technology, realize efficient and accurate auxiliary services for users based on image recognition technology, help users save time and energy, improve cooking efficiency, meet the corresponding cooking needs of users, solve the helplessness of novice cooks for the first time, solve the problem of sluggish cooking skills of experienced users, and realize efficient auxiliary cooking services. BRIEF DESCRIPTION OF THE DRAWINGS
[0017] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0018] Figure 1 The present invention is a schematic flow chart of the steps for implementing the method.
[0019] Figure 2 It is a schematic diagram of the system structure connection of the present invention. DETAILED DESCRIPTION
[0020] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0021] See also Figure 1 As shown, the present invention provides an auxiliary cooking method based on image recognition, including: step one, user information acquisition: acquiring the login information corresponding to the user, and dividing and obtaining the identity corresponding to the user.
[0022] It should be noted that the login information includes name, gender, region, preferences and cooking age, and the login information corresponding to each user is obtained from the registration form corresponding to the user.
[0023] It should also be noted that by pre-setting the corresponding cooking age threshold, the user's corresponding cooking age is compared with the preset cooking age threshold. If the user's corresponding cooking age is less than the preset cooking age threshold, the user is judged to be a novice user, otherwise the user is an experienced user, and the user's corresponding identity is obtained in this way.
[0024] Step 2, obtaining novice cooking information: obtain the dish requirements corresponding to the novice user, and then screen the recipes corresponding to the novice user. When the novice user is monitored to have prepared the dishes on the corresponding recipes, obtain the cooking information corresponding to the novice user, generate a dish preparation teaching video corresponding to the novice user, monitor the dish preparation completion image corresponding to the novice user, and then analyze to obtain the cooking adjustment method corresponding to the novice user. At the same time, monitor the cooking information of the recipes corresponding to the novice user in the time period, analyze to obtain the cooking coefficient of the recipes corresponding to the novice user, and then determine the cooking status of the recipes corresponding to the novice user.
[0025] It should be noted that dish requirements include recipe processing difficulty, recipe operation time and dish types. Image recognition technology is used to identify the text demands uploaded by novice users and extract demand keywords to obtain the dish requirements corresponding to novice users.
[0026] It should be noted that cooking information includes the number of times the user has cooked and the fluency of cooking. The number of times the user has cooked is obtained from the database, and image recognition technology is used to scan the cooking scene pictures uploaded by the novice user. The cleanliness of the environment and the area of stains in the cooking scene pictures of the novice user are extracted to obtain the cooking fluency of the novice user.
[0027] It should be noted that the initial meal preparation teaching video is a teaching guidance video generated for novice users based on the fact that they have never cooked before, including how to cut vegetables, precautions for cutting vegetables, the amount of seasoning to add, and precautions for putting food into the pot. The orderly meal preparation teaching video is a teaching guidance video generated for novice users based on the fact that they have cooked before, including the meal preparation process, the placement of dishes, the placement of seasonings, and the time to add dishes and seasonings.
[0028] It should also be noted that, assuming that the dish cooked by a novice user is shredded potatoes, and the novice user cuts the shredded potatoes short and thick when preparing the dish following the preparation instruction video, then the cooking method of the shredded potatoes must be adjusted accordingly. For example, if the original cooking time is 10 minutes, the amount of salt is 3 grams, the amount of water is 50 ml, and the dish is stir-fried continuously, the novice user's current information about the shredded potatoes is uploaded, and then the corresponding cooking adjustment measures are searched and generated. The adjusted cooking measures are cooking time of 15 minutes, amount of salt is 5 grams, the amount of water is 100 ml, and the dish is stewed and stir-fried indirectly.
[0029] It should also be noted that the user logs in to the software and selects the interactive mode option in the software to enable the corresponding camera shooting permission under the interactive mode option, and then places the camera in the kitchen to obtain cooking images of corresponding recipes of novice users in different time periods. Image recognition technology is used to analyze the visual characteristics of oil smoke, including color and shape, and then the corresponding oil fume concentration is monitored. The corresponding distance between the fire source and the flammable material is obtained by locating the corresponding position of the fire source and the flammable material, and using target detection algorithms such as YOLO or FasterR-CNN, the corresponding distance between the fire source and the flammable material is obtained. Based on the interactive mode option, the bubbling image of the sesame oil in the pot is monitored, the number and duration of bubbles are observed, and the bubbles are substituted into the rate calculation formula, and the duration is divided by the number to obtain the corresponding sesame oil bubbling rate.
[0030] As an optional implementation manner, the screening obtains recipes corresponding to novice users, and the specific screening process is as follows: the difficulty of processing the recipes corresponding to the needs of the novice users is compared with the sets of recipe types stored in the database, and the recipe operation time and dish types corresponding to the needs of the novice users are also compared with the sets of recipe type stored in the database. If the difficulty of processing the recipes corresponding to the needs of the novice users is within a certain recipe type set stored in the database, and the recipe operation time and dish types corresponding to the needs of the novice users are within the recipe type set stored in the database, then the recipe is used as the recipe corresponding to the novice user, so as to obtain the recipes corresponding to the novice user through screening.
[0031] As an optional implementation manner, the generation of a food preparation teaching video corresponding to a novice user has the following specific generation process: obtaining the number of times the novice user cooks and the cooking fluency corresponding to the novice user, comparing the number of times the novice user cooks with a preset cooking number threshold, and also comparing the cooking fluency corresponding to the novice user with the preset cooking fluency; if the number of times the novice user cooks is less than the preset cooking number threshold, and the cooking fluency corresponding to the novice user is less than the preset cooking fluency, then an initial food preparation teaching video is generated for the novice user; if the number of times the novice user cooks is greater than the preset cooking number threshold, and the cooking fluency corresponding to the novice user is greater than the preset cooking fluency, then an orderly food preparation teaching video is generated for the novice user, thereby comprehensively generating a food preparation teaching video corresponding to the novice user.
[0032] As an optional implementation manner, the analysis obtains the cooking adjustment method corresponding to the novice user, and the specific analysis process is as follows: when the novice user follows the corresponding preparation teaching video to prepare the corresponding food, the novice user can choose to start the corresponding interactive mode of the software, and then execute the corresponding preparation monitoring, and turn on the camera's permission during the preparation period, and use image recognition technology to monitor to obtain the corresponding preparation completion image of the novice user, and compare the corresponding preparation completion image of the novice user with the corresponding preparation teaching video result image of the novice user. If the corresponding preparation completion image of the novice user is inconsistent with the corresponding preparation teaching video result image of the novice user, then perform image recognition on the preparation image corresponding to the novice user, extract data information inconsistent with the preparation teaching video result image, including dish thickness and dish length, compare the corresponding dish thickness and dish shape of the novice user with each dish state interval corresponding to the cooking method stored in the database, if the corresponding dish thickness and dish shape of the novice user are within a dish state interval corresponding to the cooking method stored in the database, then the cooking method is used as the cooking adjustment of the novice user, and the cooking adjustment method corresponding to the novice user is obtained by analysis.
[0033] As an optional implementation, the analysis obtains the cooking coefficient of the recipe corresponding to the novice user, and then determines the cooking safety of the recipe corresponding to the novice user. The specific analysis process is as follows: by calculating the formula: ,Analyze and get the cooking coefficient of the corresponding recipe for novice users , is the number of each time period, , is any integer greater than 2, is the set reference oil smoke concentration, is the distance between the reference fire source and the flammable items. is the reference sesame oil bubbling rate, For the The fume concentration of the recipes for novice users in each time period, For the The distance between the fire source and flammable items in the recipes of novice users in each time period. For the The bubbling rate of sesame oil in the corresponding recipes for novice users in each time period, , and The weight factor of the set oil smoke concentration, the weight factor of the distance between the fire source and the flammable items, and the weight factor of the sesame oil bubbling rate, , , .
[0034] It should also be noted that the weight factors of oil fume concentration, the distance between the fire source and flammable items, and the weight factors of sesame oil bubbling rate are obtained through factor analysis. The information of oil fume concentration, the distance between the fire source and flammable items, and the sesame oil bubbling rate is first condensed, and then the corresponding variance explanation rate is obtained, and then divided by the variance explanation rate to get the corresponding weight.
[0035] It is important to note again that information condensation refers to condensing multiple analysis items into several key summary indicators, and the variance explanation rate refers to the contribution of each principal component or factor to the overall variance, usually expressed as a percentage, indicating how much information the factor contains about the original data.
[0036] The cooking coefficient of the recipe corresponding to the novice user is compared with the preset cooking coefficient threshold. If the cooking coefficient of the recipe corresponding to the novice user is greater than the preset cooking coefficient threshold, the cooking state of the recipe corresponding to the novice user is determined to be unsafe; if the cooking coefficient of the recipe corresponding to the novice user is less than the preset cooking coefficient threshold, the cooking state of the recipe corresponding to the novice user is determined to be safe. In this way, the cooking state of the recipe corresponding to the novice user is determined.
[0037] Step 3. Cooking adjustment by experienced users: Generate new dishes corresponding to the experienced users based on the categories of ingredients and taste requirements uploaded by the experienced users, obtain historical operation information of the dishes made by the experienced users, analyze the taste coefficient and mouthfeel coefficient of the new dishes made by the experienced users, and analyze the cooking precautions for the new dishes made by the experienced users.
[0038] It should be noted that the image recognition technology is used to extract the food category corresponding to the experienced user, and the corresponding taste requirements uploaded by the experienced user are obtained from the database.
[0039] It should be noted that the historical operation information includes taste information and taste information, wherein the taste information includes the seasoning dosage, seasoning times and water volume, and the taste information includes cooking time and firepower. The historical operation information of the corresponding dishes made by the experienced users is obtained from the database.
[0040] As an optional implementation, the novel dishes corresponding to the experienced users are generated, and the specific generation process is as follows: the ingredient categories uploaded by the experienced users are compared with the dish type sets stored in the database, and the taste requirements uploaded by the experienced users are also compared with the dish type taste sets stored in the database. If the ingredient categories uploaded by the experienced users are within a dish type set stored in the database, and the taste requirements uploaded by the experienced users are within the dish type taste set stored in the database, then the dish type is obtained, and the dish is compared with the collection of dishes that the experienced users have completed making and stored in the database. If the dish is not within the collection of dishes that the experienced users have completed making and stored in the database, then the dish is used as the novel dish corresponding to the experienced user, thereby generating the novel dishes corresponding to the experienced user.
[0041] As an optional implementation, the analysis obtains the taste coefficient of the corresponding innovative dishes made by the experienced user, and the specific monitoring process is as follows: the historical seasoning dosage of the corresponding dishes made by the experienced user is compared with the preset seasoning dosage interval required for the innovative dishes, and the historical seasoning times and water volume of the corresponding dishes made by the experienced user are compared with the preset seasoning times interval and water volume interval required for the innovative dishes. If the historical seasoning dosage of the corresponding dishes made by the experienced user is within the preset seasoning dosage interval required for the innovative dishes, and the historical seasoning times and water volume of the corresponding dishes made by the experienced user are within the preset seasoning times interval and water volume interval required for the innovative dishes, then the taste qualification coefficient of the corresponding innovative dishes made by the experienced user is recorded as , otherwise it is recorded as , so as to obtain the taste coefficient of the experienced user's corresponding new dishes ,in The value is or ,and , , is a natural number.
[0042] As an optional implementation manner, the analysis obtains the taste coefficient of the corresponding innovative dish made by the experienced user, and the specific analysis process is as follows: the historical cooking time of the corresponding dish made by the experienced user is compared with the preset cooking time interval required for the innovative dish, and the historical firepower of the corresponding dish made by the experienced user is compared with the preset firepower interval required for the innovative dish. If the historical cooking time of the corresponding dish made by the experienced user is within the preset cooking time interval required for the innovative dish, and the historical firepower of the corresponding dish made by the experienced user is within the preset firepower interval required for the innovative dish, then the taste qualification coefficient of the corresponding innovative dish made by the experienced user is recorded as , otherwise it is recorded as , so as to obtain the taste coefficient of the new dishes made by the experienced users ,in The value is or ,and , , is a natural number.
[0043] As an optional implementation, the analysis obtains cooking precautions for experienced users for making novel dishes, and the specific analysis process is as follows: the taste coefficient of the experienced user for making novel dishes is compared with the taste coefficient corresponding to the seasoning addition method for generating novel dishes stored in the database. If the taste coefficient of the experienced user for making novel dishes is the same as the taste coefficient corresponding to the seasoning addition method for generating novel dishes stored in the database, then the seasoning addition method for generating novel dishes will be used as the cooking taste precautions for the experienced user for making novel dishes.
[0044] The taste coefficient of the novel dish made by the experienced user is compared with the taste coefficient corresponding to the cooking method of the novel dish stored in the database. If the taste coefficient of the novel dish made by the experienced user is the same as the taste coefficient corresponding to the cooking method of the novel dish stored in the database, the cooking method of the novel dish will be used as the cooking taste precautions for the experienced user to make the novel dish. Based on the above, the cooking precautions for the experienced user to make the novel dish are obtained.
[0045] Step 4: Early warning: When the cooking status of a recipe corresponding to a novice user is unsafe, an early warning will be issued.
[0046] Step 5: Result display: Display the cooking precautions for the experienced user to prepare the new dishes.
[0047] See also Figure 2 As shown, the present invention provides an auxiliary cooking system based on image recognition, including a user information acquisition module, a novice cooking information acquisition module, an experienced user cooking adjustment module, an early warning terminal and a display terminal.
[0048] The novice cooking information acquisition module is connected to the user information acquisition module and the early warning terminal respectively, and the experienced user cooking adjustment module is connected to the user information acquisition module and the display terminal respectively.
[0049] The user information acquisition module is used to obtain the login information corresponding to the user and obtain the identity corresponding to the user.
[0050] The novice cooking information acquisition module is used to filter and obtain recipes corresponding to novice users, generate and obtain dish preparation instruction videos corresponding to novice users, analyze and obtain cooking adjustment methods corresponding to novice users, and determine and obtain the cooking status of recipes corresponding to novice users.
[0051] The experienced user cooking adjustment module is used to generate new dishes corresponding to the experienced users, analyze the taste coefficient and mouthfeel coefficient of the new dishes made by the experienced users, and analyze the cooking precautions for the new dishes made by the experienced users.
[0052] The early warning terminal is used to issue an early warning prompt when the cooking status of the corresponding recipe of the novice user is unsafe.
[0053] The display terminal is used to display cooking precautions for experienced users to prepare new dishes.
[0054] In the embodiment of the present invention, users are first divided into corresponding identities, and then cooking assistance for the users' corresponding identities is performed. Recipes corresponding to novice users are obtained by screening, and then corresponding monitoring is performed on the novice users to determine the cooking status of the recipes corresponding to the novice users. At the same time, novel dishes corresponding to experienced users are generated, and historical operation information of the corresponding dishes made by the experienced users is monitored. Based on this, cooking precautions for the experienced users to make novel dishes are obtained through analysis, and accurate cooking assistance for users' corresponding cooking identities is implemented to help users find cooking methods that suit them, maintain cooking safety for novice users, and remind experienced users of cooking precautions. The deficiencies in the current technology are resolved, and efficient and accurate assistance services for users are implemented based on image recognition technology, which helps users save time and energy, improve cooking efficiency, meet users' corresponding cooking needs, resolve the helplessness of novice cooks when they first try, and solve the problem of sluggish cooking skills for experienced users, thereby implementing efficient auxiliary cooking services.
[0055] The above contents are merely examples and explanations of the concept of the present invention. Those skilled in the art may make various modifications or additions to the specific embodiments described or replace them in a similar manner. As long as they do not deviate from the concept of the invention or exceed the scope defined in this specification, they shall all fall within the protection scope of the present invention.
Claims
1. An auxiliary cooking method based on image recognition, It is characterized in that include: Step 1: Obtain user information: Obtain the user's corresponding login information and divide it into the user's corresponding identity; Step 2, obtaining novice cooking information: obtaining the dish requirements corresponding to the novice user, and then screening the recipes corresponding to the novice user. When the novice user is monitored to have prepared the dishes on the corresponding recipes, the cooking information corresponding to the novice user is obtained, and a dish preparation teaching video corresponding to the novice user is generated. The dish preparation completion image corresponding to the novice user is monitored, and then the cooking adjustment method corresponding to the novice user is analyzed. At the same time, the cooking information of the novice user's corresponding recipes in the monitoring time period is analyzed to obtain the cooking coefficient of the novice user's corresponding recipes, and then the cooking status of the novice user's corresponding recipes is determined; The analysis obtains the cooking coefficient of the recipe corresponding to the novice user, and then determines the cooking safety of the recipe corresponding to the novice user. The specific analysis process is as follows: By calculation formula: ,Analyze and get the cooking coefficient of the corresponding recipe for novice users , is the number of each time period, , is any integer greater than 2, is the set reference oil smoke concentration, is the distance between the reference fire source and the flammable items. is the reference sesame oil bubbling rate, For the The fume concentration of the recipes for novice users in each time period, For the The distance between the fire source and flammable items in the recipes of novice users in each time period. For the The bubbling rate of sesame oil in the corresponding recipes for novice users in each time period, , and The weight factor of the set oil smoke concentration, the weight factor of the distance between the fire source and the flammable items, and the weight factor of the sesame oil bubbling rate, , , ; The cooking coefficient of the recipe corresponding to the novice user is compared with a preset cooking coefficient threshold. If the cooking coefficient of the recipe corresponding to the novice user is greater than the preset cooking coefficient threshold, it is determined that the cooking state of the recipe corresponding to the novice user is unsafe. If the cooking coefficient of the recipe corresponding to the novice user is less than the preset cooking coefficient threshold, it is determined that the cooking state of the recipe corresponding to the novice user is safe, thereby determining the cooking state of the recipe corresponding to the novice user; Step 3: Experienced user cooking adjustment: Generate new dishes corresponding to the experienced user based on the food category and taste requirements uploaded by the experienced user, obtain historical operation information of the dishes made by the experienced user, analyze and obtain the taste coefficient and taste coefficient of the new dishes made by the experienced user, and analyze and obtain cooking precautions for the new dishes made by the experienced user; The novel dishes corresponding to the experienced users are generated, and the specific generation process is as follows: Compare the corresponding ingredient category uploaded by the experienced user with the set of dish types stored in the database, and also compare the corresponding taste requirement uploaded by the experienced user with the set of tastes of each dish type stored in the database. If the corresponding ingredient category uploaded by the experienced user is within a set of dish types stored in the database, and the corresponding taste requirement uploaded by the experienced user is within the set of tastes of the dish type stored in the database, then obtain the dish type, and compare the dish with the set of dishes that the experienced user has completed making and stored in the database. If the dish is not within the set of dishes that the experienced user has completed making and stored in the database, then use the dish as the novel dish corresponding to the experienced user, thereby generating a novel dish corresponding to the experienced user; The analysis obtains the taste coefficient of the corresponding novel dishes made by the experienced user. The specific monitoring process is as follows: The historical seasoning dosage of the dishes made by the experienced user is compared with the preset seasoning dosage range required for the new dishes. At the same time, the historical seasoning times and water volume of the dishes made by the experienced user are compared with the preset seasoning frequency range and water volume range required for the new dishes. If the historical seasoning dosage of the dishes made by the experienced user is within the preset seasoning dosage range required for the new dishes, and the historical seasoning times and water volume of the dishes made by the experienced user are within the preset seasoning frequency range and water volume range required for the new dishes, then the taste qualification coefficient of the new dishes made by the experienced user is recorded as , otherwise it is recorded as , so as to obtain the taste coefficient of the experienced user's corresponding new dishes ,in The value is or ,and , , is a natural number; The analysis obtains the taste coefficient of the novel dishes prepared by the experienced users. The specific analysis process is as follows: The historical cooking time of the dishes made by the experienced user is compared with the preset cooking time interval of the new dishes, and the historical firepower of the dishes made by the experienced user is compared with the preset firepower interval of the new dishes. If the historical cooking time of the dishes made by the experienced user is within the preset cooking time interval of the new dishes, and the historical firepower of the dishes made by the experienced user is within the preset firepower interval of the new dishes, then the taste qualification coefficient of the new dishes made by the experienced user is recorded as , otherwise it is recorded as , so as to obtain the taste coefficient of the new dishes made by the experienced users ,in The value is or ,and , , is a natural number; The analysis obtains the cooking precautions of the experienced users for making innovative dishes. The specific analysis process is as follows: Compare the taste coefficient of the new dish prepared by the experienced user with the taste coefficient corresponding to the seasoning adding method for the new dish stored in the database; if the taste coefficient of the new dish prepared by the experienced user is the same as the taste coefficient corresponding to the seasoning adding method for the new dish stored in the database, then use the seasoning adding method for the new dish as the cooking taste precautions for the new dish prepared by the experienced user; Compare the taste coefficient of the novel dish prepared by the experienced user with the taste coefficient corresponding to the cooking method of the novel dish stored in the database. If the taste coefficient of the novel dish prepared by the experienced user is the same as the taste coefficient corresponding to the cooking method of the novel dish stored in the database, the cooking method of the novel dish is used as the cooking taste precautions for the experienced user to prepare the novel dish. Combining the above, the cooking precautions for the experienced user to prepare the novel dish are obtained. Step 4: Early warning: When the cooking status of the recipe of the novice user is unsafe, an early warning will be given; Step 5: Result display: Display the cooking precautions for the experienced user to prepare the new dishes.
2. The image recognition-based cooking assisting method according to claim 1, It is characterized in that The filtering obtains recipes corresponding to novice users, and the specific filtering process is as follows: The difficulty of recipe processing corresponding to the needs of novice users is compared with the sets of recipe types stored in the database. At the same time, the recipe operation time and dish types corresponding to the needs of novice users are also compared with the sets of recipe type stored in the database. If the difficulty of recipe processing corresponding to the needs of novice users is within a certain recipe type set stored in the database, and the recipe operation time and dish types corresponding to the needs of novice users are within the recipe type set stored in the database, then the recipe is used as the recipe corresponding to the novice user, so as to screen and obtain the recipe corresponding to the novice user.
3. The image recognition-based cooking assisting method according to claim 1, It is characterized in that The above-mentioned generation obtains a dish preparation teaching video corresponding to a novice user, and the specific generation process is as follows: The number of times the novice user cooks and the cooking fluency corresponding to the novice user are obtained, and the number of times the novice user cooks is compared with a preset cooking number threshold, and the cooking fluency corresponding to the novice user is also compared with the preset cooking fluency. If the number of times the novice user cooks is less than the preset cooking number threshold, and the cooking fluency corresponding to the novice user is less than the preset cooking fluency, then an initial food preparation teaching video is generated for the novice user; if the number of times the novice user cooks is greater than the preset cooking number threshold, and the cooking fluency corresponding to the novice user is greater than the preset cooking fluency, then an orderly food preparation teaching video is generated for the novice user, so as to comprehensively generate the food preparation teaching video corresponding to the novice user.
4. The image recognition-based cooking assisting method according to claim 1, It is characterized in that The analysis obtains the cooking adjustment method corresponding to the novice user, and the specific analysis process is as follows: When the novice user prepares the corresponding dishes following the corresponding dish preparation teaching video, the novice user can choose to start the corresponding interactive mode of the software, and then execute the corresponding dish preparation monitoring, and turn on the camera's permission to shoot the dish preparation period, use image recognition technology to monitor and obtain the dish preparation completion image corresponding to the novice user, and compare the dish preparation completion image corresponding to the novice user with the dish preparation teaching video result image corresponding to the novice user. If the dish preparation completion image corresponding to the novice user is inconsistent with the dish preparation teaching video result image corresponding to the novice user, image recognition is performed on the dish preparation image corresponding to the novice user, and data information inconsistent with the dish preparation teaching video result image is extracted, including the dish thickness and the dish length, and the dish thickness and the dish shape corresponding to the novice user are compared with each dish status interval corresponding to the cooking method stored in the database. If the dish thickness and the dish shape corresponding to the novice user are within a dish status interval corresponding to a cooking method stored in the database, the cooking method is used as the cooking adjustment of the novice user, and the cooking adjustment method corresponding to the novice user is obtained by analysis.
5. An auxiliary cooking system for executing the auxiliary cooking method based on image recognition according to any one of claims 1 to 4, It is characterized in that include: The user information acquisition module is used to obtain the login information corresponding to the user and divide the corresponding identity of the user; A novice cooking information acquisition module is used to filter and obtain recipes corresponding to novice users, generate and obtain a dish preparation teaching video corresponding to the novice user, analyze and obtain a cooking adjustment method corresponding to the novice user, and determine and obtain a cooking status of the recipe corresponding to the novice user; The experienced user cooking adjustment module is used to generate the new dishes corresponding to the experienced user, analyze the taste coefficient and mouthfeel coefficient of the new dishes made by the experienced user, and analyze the cooking precautions of the new dishes made by the experienced user; An early warning terminal is used to issue an early warning prompt when the cooking status of a recipe corresponding to a novice user is unsafe; The display terminal is used to display cooking precautions for experienced users to prepare new dishes.
Citation Information
Patent Citations
Auxiliary cooking method and device based on image recognition, equipment and storage medium
CN116189174A
Recipe system
CN107851397A
Method and device for generating menus
CN110853729A
Menu recommendation method and device, computer readable storage medium and processor
CN114203280A
Cooking system
CN115086357A
