Method and system for making scientific diet through AR-assisted family collocation

Abstract

The invention relates to the technical field of dietary nutrition intervention and management, in particular to a method and system for making scientific diet through AR-assisted family collocation, and the system comprises main equipment, an intelligent chopping board interacting with the main equipment, and AR glasses interacting with the main equipment. According to the system, personalized healthy diet management is provided by taking a family as a unit, and the family diet preference is taken as an important factor during diet matching, so that a diet matching result is more easily accepted by a user, and the practicability of diet matching is improved; the AR technology and food cooking are combined, more humanized diet preference tracking, scientific diet nutrition calculation and diet matching and concrete cooking guidance can be achieved, family diet becomes personalized, healthy and scientific, accurate control over food materials and seasonings can be achieved through cooperative use of the intelligent chopping board, and the intelligent chopping board is more intelligent. Therefore, the requirement of a user for making low-diabetes-risk diet is met.

Description

Technical Field

[0001] The present invention relates to the technical field of dietary nutrition intervention and management, and in particular to a method and system for AR-assisted families in preparing scientific meals. Background Art

[0002] Studies have found that type 2 diabetes has a certain familial clustering. The reason for this phenomenon is, on the one hand, caused by family genes, and on the other hand, it is closely related to the family's life and eating habits. Family members will influence each other. Diet will be affected by the dietary preferences of family members. If a family member likes a high-sugar diet, other members will also consume more sugar; exercise habits will be affected by the family's daily activities. Family members do not develop the habit of regular exercise, such as only eating or watching TV after returning home. Over time, it will affect other family members. At the same time, factors such as family atmosphere and sleep quality will also have a certain impact.

[0003] Therefore, it is an effective way to conduct diabetes prevention education on a family basis. It is more scientific and feasible to advocate a low diabetes risk diet on a family basis. Through humanized dietary preference tracking, scientific dietary nutrition calculation and matching, and concrete cooking guidance, family diets are personalized, healthy, and scientific.

[0004] Diabetes is a chronic disease, and the dietary research for diabetic patients is mainly based on conventional nutrition theory. At present, the dietary matching theories for diabetic patients mainly include: food exchange method (the core of this theory is: replace foods with the same calories to achieve energy stability), dietary pyramid method (the core of this theory is: starting from the perspective of nutritional needs, giving suggestions on the types and quantities of food intake), advocating diabetic patients to choose low GI and / or low-carb foods (the core of this theory is: control food intake to avoid blood sugar fluctuations), etc.

[0005] However, the above-mentioned dietary matching theories have some shortcomings in practical application. On the one hand, daily diet has a great impact on personal happiness in life. If the nutritious food mentioned in the dietary matching theory cannot meet the patient's taste needs, it will lead to a decline in the patient's long-term dietary management compliance and even aversion to healthy diet. On the other hand, for ordinary people who are accustomed to Chinese diet, diet is also an important part of social interaction with friends and family relationships. It is difficult to separate the patient's diet for personalized management in daily life, resulting in poor operability of dietary management for the majority of patients in actual life relying solely on dietary matching theory. Therefore, how to carry out personalized healthy dietary management from the perspective of actual dining scenes, personalized tastes, etc. is a technical problem that needs to be solved urgently.

[0006] For this reason, the present invention provides a method and system for making a scientific diet with AR-assisted home matching. Summary of the Invention

[0007] Based on this, it is necessary to provide a method and system for making a scientific diet with AR-assisted home matching for the above technical problems.

[0008] In order to achieve the above object, the technical solution of the present invention is as follows.

[0009] According to one aspect of the present invention, there is provided a method for AR-assisted home collocation to make a scientific diet, which is applied to a system for AR-assisted home collocation to make a scientific diet. The system includes a main device, an intelligent cutting board interacting with the main device, and an AR glasses interacting with the main device, and includes: obtaining the basic information of family members, the food ingredient image feature library, the basic food ingredient data, the initial food ingredient collocation preference weight value, and the basic seasoning data through the main device, calculating the total daily energy information required for the corresponding family member and the nutritional information required for each meal based on the basic information of the family member, and storing the basic information of the family member, the total daily energy information required for the corresponding family member, the nutritional information required for each meal, the food ingredient image feature library, the basic food ingredient data, the initial food ingredient collocation preference weight value, and the basic seasoning data in the information storage; before cooking each meal, the main device receives the food ingredient image data in the ingredient preparation stage and the food ingredient collocation image data in the cooking stage sent by the AR glasses, compares the food ingredient image data in the ingredient preparation stage with the food ingredient feature image data in the food ingredient image feature library to obtain the corresponding food ingredient type name information and food ingredient serial number information, compares the food ingredient collocation image data in the cooking stage with the food ingredient feature image data in the food ingredient image feature library to obtain the corresponding food ingredient type collocation information and food ingredient collocation number information, based on the food ingredient collocation number information, retrieves the corresponding initial food ingredient collocation preference weight value, updates the initial food ingredient collocation preference weight value to obtain the updated food ingredient collocation preference weight value, and stores the updated food ingredient collocation preference weight value in the information storage; before cooking each meal, based on the main device, enter the meal information for this meal and calculate the nutritional requirement data for this meal; based on the food ingredient type name information of the expected food ingredients for this meal entered by the main device, the existing food ingredient image data sent by the AR glasses, and the existing food ingredient weight information sent by the intelligent cutting board, calculate the food ingredient nutrition data of the selected food ingredients; determine whether the food ingredient nutrition data of the selected food ingredients meets the nutritional requirement data for this meal. If not, adjust the selected food ingredient type and / or the selected food ingredient weight and / or remove the selected food ingredients until the nutritional requirement data for this meal is met. If so, make a preliminary collocation of the existing food ingredients according to the user preference, place the preliminarily collocated food ingredients in the dish area, place the food ingredients with uncertain collocation in the pending area, and make a first combination collocation of the food ingredients in the pending area according to the corresponding food ingredient collocation preference weight value, and place the food ingredients after the first combination collocation in the dish area. If there are still food ingredients with uncertain collocation in the pending area, make a second combination collocation of the food ingredients in the pending area by adding new food ingredients, and place the food ingredients after the second combination collocation in the dish area, and calculate the dish nutrition data in the current dish area;Determine whether the nutritional data of the dishes in the current dish area meets the nutritional requirement data of this meal. If not, adjust the dishes and / or the weights of the ingredients until the nutritional requirement data of this meal is met. If it is met, use the dishes in the current dish area as the recipe for this meal and complete the dietary cooking process. The recipe for this meal includes the information of the names of the ingredient types, the weights of the corresponding ingredients, the information of the names of the seasoning types, and the weights of the corresponding seasonings.;

[0010] Optionally, calculating the total daily energy requirement information and the nutritional requirement information for each meal corresponding to the family member based on the basic information of the family member specifically includes: based on the basic information of the family member, the basic information of the family member includes the name information, gender information, age information, height information, weight information, labor intensity information, basic chronic disease information, food restriction information, allergic food information, and the number of meals per day information of the family member; obtain the BMI index value of the corresponding family member according to the height information and the weight information, based on the BMI index value and the labor intensity information, refer to the "Daily Energy Supply Scale" to obtain the calorie value required per kilogram of body weight of the corresponding family member, and calculate the total daily energy requirement information of the corresponding family member. The calculation formula is: total daily energy requirement information = (height information - 110) × calorie value required per kilogram of body weight. According to the number of meals per day information of the corresponding family member, allocate the energy required for each meal to obtain the energy value required for each meal of the corresponding family member, and based on the preset information of the required proportion of the three major nutrients per day, the daily oil intake information, the daily salt intake information, and the daily vitamin intake information, calculate the nutritional requirement information for each meal.

[0011] Optionally, the basic ingredient data includes the information of the names of the ingredient types, the ingredient serial number information, the ingredient combination number information, the weight information of the conventional amount used in one meal, the calorie information contained in 100g of the edible part, the content information of the three major nutrients in 100g of the edible part, the vitamin content information in 100g of the edible part, the glycemic index information, and the glycemic load information. The ingredient combination number information is matched with the corresponding initial ingredient combination preference weight value.

[0012] Optionally, the main device receives the ingredient image data in the ingredient preparation stage and the ingredient combination image data in the cooking stage sent by the AR glasses, compares the ingredient image data in the ingredient preparation stage with the ingredient feature image data in the ingredient image feature library to obtain the corresponding ingredient type name information and ingredient serial number information, and compares the ingredient combination image data in the cooking stage with the ingredient feature image data in the ingredient image feature library to obtain the corresponding ingredient type combination information and ingredient combination number information. Based on the ingredient combination number information, the corresponding initial ingredient combination preference weight value is retrieved, and the initial ingredient combination preference weight value is updated to obtain the updated ingredient combination preference weight value. Specifically, it includes: obtaining the ingredient image data in the ingredient preparation stage and the ingredient combination image data in the cooking stage through the AR glasses, and sending the ingredient image data in the ingredient preparation stage and the ingredient combination image data in the cooking stage to the main device. The main device compares the received ingredient image data in the ingredient preparation stage with the ingredient feature image data in the ingredient image feature library to obtain the corresponding ingredient type name information and ingredient serial number information, and compares the ingredient combination image data in the cooking stage with the ingredient feature image data in the ingredient image feature library to obtain the corresponding ingredient type combination information and ingredient combination number information. Based on the ingredient combination number information, the corresponding initial ingredient combination preference weight value is retrieved, the ingredient combination number information is marked to obtain the ingredient preference combination number information, and according to the preset ingredient preference combination bonus rule, the initial ingredient combination preference weight value corresponding to the ingredient preference combination number information is added to obtain the ingredient combination preference weight value after the addition process, and the ingredient combination preference weight value after the addition process is used as the updated ingredient combination preference weight value.

[0013] Optionally, the main device enters the dining information of this meal and calculates the nutritional requirement data of this meal. Specifically, it includes: entering the dining information of this meal based on the main device, where the dining information of this meal includes the dining time and the family members having the meal. The main device retrieves the nutritional information required for each meal of the corresponding dining time of the family members and accumulates and sums up the nutritional information required for each meal of all the family members having the meal in this meal to obtain the nutritional requirement data of this meal.

[0014] Optionally, calculating the food nutrition data of the selected ingredients based on the information on the names of the types of food ingredients expected for this meal entered by the main device, receiving the existing food ingredient image data sent by the AR glasses, and receiving the information on the weights of the existing food ingredients sent by the intelligent cutting board, specifically including: based on the information on the names of the food ingredients expected for this meal entered by the main device, retrieving, through the main device, the ingredient serial number information, the weight information of a regular meal serving, the calorie content per 100g of edible portion, the content information of the three major nutrients per 100g of edible portion, and the vitamin content per 100g of edible portion of the food ingredient with the name information, and calculating the food nutrition data of the food ingredients expected for this meal according to the weight information of a regular meal serving; the main device receiving the existing food ingredient image data sent by the AR glasses and the information on the weights of the existing food ingredients sent by the intelligent cutting board, comparing the existing food ingredient image data with the food ingredient feature image data in the food ingredient image feature library to obtain the corresponding information on the names of the types of food ingredients, retrieving, through the main device, the ingredient serial number information, the calorie content per 100g of edible portion, the content information of the three major nutrients per 100g of edible portion, and the vitamin content per 100g of edible portion of the food ingredient, and calculating the food nutrition data of the existing food ingredients according to the information on the weights of the existing food ingredients; adding and summing up the food nutrition data of the food ingredients expected for this meal and the food nutrition data of the existing food ingredients to obtain the food nutrition data of the selected ingredients.

[0015] Optionally, initially combining and matching the food ingredients in the pending area according to the corresponding food ingredient combination preference weight values, and placing the initially combined and matched food ingredients in the dish area, specifically including: retrieving, through the main device, the food ingredient combination number information and the food ingredient combination preference weight values of the food ingredients in the pending area, sorting the food ingredient combination number information from high to low, and determining whether the food ingredient combination preference weight value corresponding to the food ingredient combination number information meets the preset food ingredient combination preference weight threshold. If it does not meet the threshold, filtering out the corresponding food ingredient combination number information and ending the initial combination and matching operation of the food ingredients in the pending area. If it meets the threshold, selecting the corresponding food ingredient combination number information whose food ingredient combination preference weight value meets the preset food ingredient combination preference weight threshold, constructing an initial combination and matching data set, selecting, from the initial combination and matching data set, the food ingredient combination number information with the highest food ingredient combination preference weight value, and placing the food ingredient corresponding to the food ingredient combination number information in the dish area; performing the initial combination and matching operation on all the food ingredients in the pending area until the initial combination and matching operation on all the food ingredients in the pending area is completed.

[0016] Optionally, if there are still ingredients with uncertain combinations in the to-be-determined area, new ingredients are added for secondary combination with the ingredients in the to-be-determined area, and the ingredients after secondary combination are placed in the dish area, which specifically includes: the main device retrieves the ingredient combination number information and the ingredient combination preference weight value of the ingredients in the to-be-determined area, sorts the ingredient combination preference weight values from high to low, selects the top three ingredient combination number information with the highest ingredient combination preference weight values, and performs secondary combination selection on the top three ingredient combination number information with the highest ingredient combination preference weight values according to the user's preference to obtain the ingredient combination number information after secondary combination, and places the ingredients corresponding to the ingredient combination number information in the dish area.

[0017] Optionally, the dietary cooking process specifically includes: in the ingredient preparation stage, the main device receives the ingredient image data in the ingredient preparation stage sent by the AR glasses, compares the ingredient image data in the ingredient preparation stage with the ingredient feature image data in the ingredient image feature library to obtain the corresponding ingredient type name information, and sends the corresponding ingredient type name information to the AR glasses for display. After the user determines the corresponding ingredient type name information, the user performs a cutting operation on the ingredients, places the cut ingredients on the intelligent cutting board to obtain the weight information of the cut ingredients, and sends the weight information of the cut ingredients to the main device. After receiving the weight information of the cut ingredients, the main device sends the weight information of the cut ingredients to the AR glasses for display. When the weight information of the cut ingredients reaches the weight information of the corresponding ingredient, it is displayed and prompted through the AR glasses to end the ingredient preparation operation for the corresponding ingredient, and the ingredient preparation operation is performed on all the ingredients included in the recipe for this meal until the ingredient preparation operation for all the ingredients included in the recipe for this meal is completed; in the dietary cooking stage, the recipe for this meal and the cooking step prompts corresponding to the recipe for this meal are displayed through the AR glasses for dietary cooking. During cooking, the main device receives the condiment image data sent by the AR glasses, compares the condiment image data with the condiment feature image data in the basic condiment data to obtain the corresponding condiment type name information, places the corresponding condiment on the intelligent cutting board, obtains the weight information of the condiment before use and the weight information of the condiment after use, and sends the weight information of the condiment before use and the weight information of the condiment after use to the main device. The main device receives the weight information of the condiment before use and the weight information of the condiment after use sent by the intelligent cutting board, calculates the current condiment usage information, and based on the current condiment usage information, the corresponding condiment type name information, and the corresponding condiment formula information, obtains the actual salt intake information and the actual oil intake information, and sends the actual salt intake information and the actual oil intake information to the AR glasses for display and prompt, and the user completes the dietary cooking process according to the prompt.

[0018] According to the second aspect of the present invention, there is provided a system for AR-assisted home collocation to make scientific meals, which executes the method for AR-assisted home collocation to make scientific meals. The system includes a main device, a smart cutting board interacting with the main device, and AR glasses interacting with the main device. The main device includes a touch display screen, a data processor, a smart image recognition module, an information storage, a first signal receiver, and a first signal transmitter. The touch display screen is used to obtain basic information of family members, a food ingredient image feature library, basic food ingredient data, an initial food ingredient collocation preference weight value, basic condiment data, input the meal information of this meal and the food ingredient type name information of the desired food ingredients for this meal, and prompt and guide the user to complete the preliminary collocation operation, the initial combination collocation operation, and the secondary combination collocation operation. The smart image recognition module is used to compare the food ingredient image data in the food preparation stage and the food ingredient collocation image data in the cooking stage with the food ingredient feature image data in the food ingredient image feature library to respectively obtain the corresponding food ingredient type name information and food ingredient serial number information, as well as the corresponding food ingredient type collocation information and food ingredient collocation number information, and compare the condiment image data with the condiment feature image data in the basic condiment data to obtain the corresponding condiment type name information. The information storage is used to store basic information of family members, the total daily energy requirement information corresponding to family members, the nutritional information required for each meal, the food ingredient image feature library, basic food ingredient data, the initial food ingredient collocation preference weight value, basic condiment data, and the updated food ingredient collocation preference weight value. The first signal receiver is used to receive the food ingredient image data in the food preparation stage, the food ingredient collocation image data in the cooking stage, the existing food ingredient image data, and the condiment image data sent by the AR glasses, and receive the existing food ingredient weight information, the cut food ingredient weight information, the pre-use condiment weight information, and the post-use condiment weight information sent by the smart cutting board. The data processor is used to calculate the total daily energy requirement information corresponding to family members, calculate the nutritional information required for each meal, calculate the nutritional requirement data for this meal, calculate the food ingredient nutritional data of the selected food ingredients, calculate the nutritional data of the dishes in the current dish area, calculate the current condiment dosage information, calculate the actual salt intake information, and calculate the actual oil intake information, judge whether the food ingredient nutritional data of the selected food ingredients meets the nutritional requirement data for this meal, judge whether the nutritional data of the dishes in the current dish area meets the nutritional requirement data for this meal, update the initial food ingredient collocation preference weight value to obtain the updated food ingredient collocation preference weight value, and execute the preliminary collocation operation, the initial combination collocation operation, and the secondary combination collocation operation. The first signal transmitter is used to send the nutritional requirement data for this meal, the food ingredient nutritional data of the selected food ingredients, the nutritional data of the dishes, the judgment result of whether the food ingredient nutritional data of the selected food ingredients meets the nutritional requirement data for this meal, the judgment result of whether the nutritional data of the dishes in the current dish area meets the nutritional requirement data for this meal, the recipe for this meal, the actual salt intake information, the actual oil intake information, and the cut food ingredient weight information to the AR glasses.The intelligent cutting board includes a first weight weighing module, a second weight weighing module, a third weight weighing module, and a second signal transmitter; the first weight weighing module is used to weigh the weight information of existing ingredients; the second weight weighing module is used to weigh the weight information of cut ingredients; the third weight weighing module is used to weigh the weight information of seasonings before use and after use; the second signal transmitter is used to send the weight information of existing ingredients, the weight information of cut ingredients, the weight information of seasonings before use and after use to the first signal receiver; the AR glasses include a camera, a transmissive screen, a third signal transmitter, and a second signal receiver; the camera is used to collect the image data of ingredients in the ingredient preparation stage, the image data of ingredient combinations in the cooking stage, the image data of existing ingredients, and the image data of seasonings; the transmissive screen is used to generate corresponding AR images from the collected image data of ingredients in the ingredient preparation stage, the image data of ingredient combinations in the cooking stage, the image data of existing ingredients, and the image data of seasonings, and project the AR images onto the transmissive screen for display and prompting to the user. The transmissive screen displays the image data of ingredients in the ingredient preparation stage, the image data of ingredient combinations in the cooking stage, the image data of existing ingredients, the image data of seasonings, the nutritional requirements data for this meal, the nutritional data of selected ingredients, the nutritional data of dishes, the judgment result of whether the nutritional data of selected ingredients meet the nutritional requirements data for this meal, the judgment result of whether the nutritional data of dishes in the current dish area meet the nutritional requirements data for this meal, the actual salt intake information, the actual oil intake information, and the weight information of cut ingredients, and selects and determines the preliminary combination, the initial combined combination, and the secondary combined combination, while completing the selection of the recipe for this meal and the dietary cooking process; the third signal transmitter is used to send the image data of ingredients in the ingredient preparation stage, the image data of ingredient combinations in the cooking stage, the image data of existing ingredients, and the image data of seasonings to the first signal receiver; the second signal receiver is used to receive the nutritional requirements data for this meal, the nutritional data of selected ingredients, the nutritional data of dishes, the judgment result of whether the nutritional data of selected ingredients meet the nutritional requirements data for this meal, the judgment result of whether the nutritional data of dishes in the current dish area meet the nutritional requirements data for this meal, the recipe for this meal, receive the actual salt intake information, the actual oil intake information, and the weight information of cut ingredients.;

[0019] The advantages and beneficial effects of the present invention are as follows: A method and system for AR-assisted family-based scientific diet preparation provided by the present invention provides personalized health diet management for families, takes family dietary preferences as an important factor in diet preparation, makes the diet preparation result more acceptable to users, and improves the practicality of diet preparation; by combining AR technology with food cooking, it can achieve more user-friendly tracking of dietary preferences, scientific dietary nutrition calculation and diet preparation, and visualized cooking guidance, making family diets personalized, healthy and scientific, and through collaborative use with an intelligent cutting board, precise control of ingredients and seasonings can be achieved to meet the needs of users to prepare diets with low diabetes risk. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 It is a schematic structural diagram of a method for AR-assisted family-based scientific diet preparation in an embodiment of the present invention.

[0021] Figure 2 It is a schematic structural diagram of a system for AR-assisted family-based scientific diet preparation in an embodiment of the present invention.

[0022] Figure 3 It is a schematic structural diagram of the main device in an embodiment of the present invention.

[0023] Figure 4 It is a schematic structural diagram of the intelligent cutting board in an embodiment of the present invention.

[0024] Figure 5 It is a schematic structural diagram of the AR glasses in an embodiment of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0025] In order to make the objectives, technical solutions and advantages of the present invention clearer and more understandable, the present invention will be further described in detail below through specific embodiments in conjunction with the accompanying drawings. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0026] Embodiment 1

[0027] Referring to Figure 1 , a method for AR-assisted family-based scientific diet preparation, which is applied to a system for AR-assisted family-based scientific diet preparation. The system includes a main device, an intelligent cutting board interacting with the main device, and AR glasses interacting with the main device, and specifically includes the following steps.

[0028] S1. Obtain the basic information of family members, the food ingredient image feature library, basic food ingredient data, the initial food ingredient combination preference weight value, and basic condiment data through the main device. Based on the basic information of family members, calculate the total daily energy requirement information and the nutritional information required for each meal of the corresponding family member, and store the basic information of family members, the total daily energy requirement information of the corresponding family member, the nutritional information required for each meal, the food ingredient image feature library, basic food ingredient data, the initial food ingredient combination preference weight value, and basic condiment data in the information storage device.

[0029] In this embodiment, the basic information of family members includes, but is not limited to, the name information, gender information, age information, height information, weight information, labor intensity information, basic chronic disease information, dietary taboos information, allergic food information, the number of daily meals information, etc. of family members.

[0030] In this embodiment, based on the basic information of family members, calculate the total daily energy requirement information and the nutritional information required for each meal of the corresponding family member, which specifically includes the following steps.

[0031] S101. Obtain the BMI index value of the corresponding family member according to the height information and weight information.

[0032] S102. Based on the BMI index value and labor intensity information, refer to the "Daily Energy Supply Scale" to obtain the calorie value required per kilogram of body weight of the corresponding family member, and calculate the total daily energy requirement information of the corresponding family member.

[0033] Among them, the calculation formula for the total daily energy requirement information is: Total daily energy requirement information = (height information - 110) × calorie value required per kilogram of body weight.

[0034] S103. Allocate the energy required for each meal according to the number of daily meals information of the corresponding family member to obtain the energy value required for each meal of the corresponding family member.

[0035] S104. Calculate the nutritional information required for each meal based on the preset information on the required proportion of the three major nutrients per day, the daily oil intake information, the daily salt intake information, and the daily vitamin intake information.

[0036] Among them, the information on the required proportion of the three major nutrients per day can refer to the recommended proportions in the Dietary Guidelines for Chinese Residents, where carbohydrates account for 50%-65%, protein accounts for 10%-15%, and fat accounts for 20%-30%. The information on the daily oil intake and the daily salt intake can refer to the recommended daily oil intake of 25-30g and the daily salt intake of less than 5g in the Dietary Guidelines for Chinese Residents. The information on the daily vitamin intake can be determined with reference to the Chinese Dietary Reference Intakes. It should be noted here that the information on the daily vitamin intake includes, but is not limited to, the daily vitamin A intake, the daily vitamin D intake, the daily vitamin E intake, the daily vitamin C intake, and the daily vitamin B group intake, etc.

[0037] In this embodiment, the basic ingredient data includes the ingredient type name information, the ingredient serial number information, the ingredient combination number information, the weight information of the regular meal usage, the calorie information contained in 100g of the edible part, the content information of the three major nutrients in 100g of the edible part, the vitamin content information in 100g of the edible part, the glycemic index information, and the glycemic load information. The ingredient combination number information is matched with the corresponding initial ingredient combination preference weight value.

[0038] Among them, each ingredient name corresponds to an ingredient serial number. For example, when the ingredient is a tomato, its corresponding ingredient serial number is 01; when the ingredient is beef, its corresponding ingredient serial number is 02; when the ingredient is a potato, its corresponding ingredient serial number is 03. Taking the tomato as an example, the calorie information contained in 100g of its edible part is 15kcal / 100g. The content information of the three major nutrients in 100g of the edible part includes 2.7g / 100g of carbohydrates, 0.2g / 100g of fat, and 0.7g / 100g of protein. The glycemic index information is GI30, and the glycemic load information is GL1. For the ingredient combination number information, taking the aforementioned tomato, beef, and potato as an example, there are seven ingredient combination numbers: 01, 02, 03, 01-02, 01-03, 02-03, and 01-02-03. Further, in order to reduce the ingredient combination numbers for calculation, it is set that the ingredient combination number does not exceed three ingredient serial numbers at most, and each ingredient combination number information has an initial ingredient combination preference weight value. For the initial ingredient combination preference weight value, the acquisition method is calculated through the frequency of keyword extraction from Internet big data, specifically including: obtaining the possible combinations of ingredients based on Internet big data, and further analyzing the occurrence frequency, positive keywords, and negative keywords of the food combination; counting the scores according to the following rules: one point is counted for each occurrence of a positive keyword, and negative one point is counted for each occurrence of a negative keyword; counting the total score of the food combination and obtaining the initial ingredient combination preference weight value of the corresponding food combination. The higher the total score, the more common the food combination represents.

[0039] Among them, the food ingredient image feature library includes feature images of various food ingredients from multiple angles and in multiple forms, which are used for subsequent food ingredient image recognition operations; the basic condiment data includes condiment type name information, condiment brand information, condiment formula information, and condiment feature image data, which are used for precise control of condiment dosage in the subsequent meal cooking stage.

[0040] S2. Before cooking each meal, the main device receives the food ingredient image data in the ingredient preparation stage and the food ingredient combination image data in the cooking stage sent by the AR glasses, compares the food ingredient image data in the ingredient preparation stage with the food ingredient feature image data in the food ingredient image feature library to obtain the corresponding food ingredient type name information and food ingredient serial number information, and compares the food ingredient combination image data in the cooking stage with the food ingredient feature image data in the food ingredient image feature library to obtain the corresponding food ingredient type combination information and food ingredient combination number information. Based on the food ingredient combination number information, the corresponding initial food ingredient combination preference weight value is retrieved, the initial food ingredient combination preference weight value is updated to obtain the updated food ingredient combination preference weight value, and the updated food ingredient combination preference weight value is stored in the information storage device.

[0041] In this embodiment, step S2 specifically includes: obtaining the food ingredient image data in the ingredient preparation stage and the food ingredient combination image data in the cooking stage through the AR glasses, and sending the food ingredient image data in the ingredient preparation stage and the food ingredient combination image data in the cooking stage to the main device. The main device compares the received food ingredient image data in the ingredient preparation stage with the food ingredient feature image data in the food ingredient image feature library to obtain the corresponding food ingredient type name information and food ingredient serial number information, and compares the food ingredient combination image data in the cooking stage with the food ingredient feature image data in the food ingredient image feature library to obtain the corresponding food ingredient type combination information and food ingredient combination number information. Based on the food ingredient combination number information, the corresponding initial food ingredient combination preference weight value is retrieved, the food ingredient combination number information is marked to obtain the food ingredient preferred combination number information, and according to the preset food ingredient preferred combination bonus rule, the initial food ingredient combination preference weight value corresponding to the food ingredient preferred combination number information is added to obtain the food ingredient combination preference weight value after the addition process, and the food ingredient combination preference weight value after the addition process is used as the updated food ingredient combination preference weight value.

[0042] In this embodiment, in order to obtain and track the family's dietary preferences, before cooking each meal, the dining information of this meal is entered into the touch display screen. The dining information of this meal includes the dining time and the family members having the meal. Subsequently, wear the AR glasses to cook the meal, use the camera on the AR glasses to obtain the ingredient image data in the ingredient preparation stage and the ingredient combination image data in the cooking stage, and send them to the first signal receiver through the third signal transmitter. After the first signal receiver receives the ingredient image data in the ingredient preparation stage and the ingredient combination image data in the cooking stage, use the intelligent image recognition module to respectively identify the ingredient image data in the ingredient preparation stage and the ingredient combination image data in the cooking stage, and respectively identify the corresponding ingredient type name information, ingredient serial number information, corresponding ingredient type combination information, and ingredient combination number information. Subsequently, use the data processor to retrieve the corresponding initial ingredient combination preference weight value based on the ingredient combination number information, mark the ingredient combination number as the ingredient preferred combination number, and according to the preset ingredient preferred combination scoring rule, such as adding 1 point to the initial ingredient combination preference weight value corresponding to the ingredient preferred combination number information, that is, obtain the ingredient combination preference weight value after the scoring process, and use the ingredient combination preference weight value after the scoring process as the updated ingredient combination preference weight value.

[0043] S3. Before cooking each meal, enter the dining information of this meal based on the main device and calculate the nutritional requirement data for this meal; enter the ingredient type name information of the expected ingredients for this meal based on the main device, receive the existing ingredient image data sent by the AR glasses, and receive the existing ingredient weight information sent by the intelligent cutting board, and calculate the nutritional data of the selected ingredients.

[0044] In this embodiment, in order to calculate the nutritional requirement data for this meal. Before cooking each meal, enter the dining information of this meal through the touch display screen. Subsequently, the data processor retrieves the nutritional information required for each meal corresponding to the dining time of each family member of this meal, and accumulates and sums up the nutritional information required for each meal corresponding to the dining time of all family members, then the nutritional requirement data for this meal can be obtained.

[0045] In this embodiment, calculating the nutritional data of the selected ingredients for the existing ingredients, the specific operations include: placing the existing ingredients on the intelligent cutting board to obtain the weight information of the existing ingredients, and at the same time using the camera on the AR glasses to obtain the image data of the existing ingredients, and sending it to the first signal receiver through the third signal transmitter. After the first signal receiver receives the image data of the existing ingredients, the intelligent image recognition module is used to identify the image data of the existing ingredients to obtain the corresponding ingredient type name information. Subsequently, the data processor is used to retrieve the calorie information contained in 100g of edible part, the content information of the three major nutrients in 100g of edible part, and the vitamin content information in 100g of edible part, and calculate the nutritional data of the corresponding existing ingredients according to the weight information of the existing ingredients; calculating the nutritional data of the selected ingredients for the expected ingredients of this meal, the specific operations include: using the touch display screen to enter the ingredient type name information of the expected ingredients of this meal, and then using the data processor to retrieve the weight information of the conventional one-meal dosage of the ingredient, the calorie information contained in 100g of edible part, the content information of the three major nutrients in 100g of edible part, and the vitamin content information in 100g of edible part, and calculate the nutritional data of the expected ingredients of this meal according to the weight information of the conventional one-meal dosage; finally, adding and summing up the nutritional data of the expected ingredients of this meal and the nutritional data of the existing ingredients to obtain the nutritional data of the selected ingredients.

[0046] S4. Determine whether the nutritional data of the selected ingredients meets the nutritional requirement data of this meal. If it does not meet, adjust the types and / or weights of the selected ingredients and / or remove the selected ingredients until the nutritional requirement data of this meal is met. If it meets, make a preliminary combination of the existing ingredients according to the user's preference, place the preliminarily combined ingredients in the dish area, place the ingredients with uncertain combinations in the pending area, and make a first combination of the ingredients in the pending area according to the corresponding ingredient combination preference weight value, and place the ingredients after the first combination in the dish area. If there are still ingredients with uncertain combinations in the pending area, make a second combination of the ingredients in the pending area by adding new ingredients, and place the ingredients after the second combination in the dish area, and calculate the nutritional data of the dishes in the current dish area.

[0047] In this embodiment, by comparing whether the nutritional data of the selected ingredients meet the nutritional requirement data of this meal, the result of whether the nutritional data of the selected ingredients meet the nutritional requirement data of this meal is obtained. Based on this result, the user is prompted to adjust the ingredients. If the total energy in the nutritional data of the selected ingredients exceeds the total energy in the nutritional requirement data of this meal, the user is prompted to delete some ingredients to avoid food waste. For example, if the selected ingredients include potatoes, tomatoes, and beef, and the nutritional data of these three ingredients are calculated, if the total energy in the nutritional data of these three ingredients exceeds the total energy in the nutritional requirement data of this meal, any one of the potatoes, tomatoes, and beef can be deleted to ensure that the nutritional data of the selected ingredients meet the nutritional requirement data of this meal. If a certain item (or several items) among the three items of carbohydrates, proteins, and fats included in the nutritional data exceeds the corresponding item in the nutritional requirement data of this meal, the ingredient with the most exceeded items can be selected, and the user can be prompted to adjust the type and / or weight of this ingredient and / or delete this ingredient.

[0048] In this embodiment, if satisfied, the existing ingredients are initially paired according to the user's preference, and the ingredients after the initial pairing are placed in the dish area, and the ingredients with uncertain pairings are placed in the pending area. The specific operations include: the user initially pairs the above-mentioned existing ingredients according to their own preferences, and using the touch display screen, drag the ingredients that want to be paired together to the dish area, and drag the ingredients with uncertain pairings to the pending area. The dish after this initial pairing will be the basis for subsequent low-diabetes-risk diet pairings.

[0049] In this embodiment, if there are two or more ingredients in the pending area, the ingredients in the pending area are initially combined and paired in combination with the ingredient pairing preference weight value. The specific operation process includes: using the data processor to retrieve the corresponding ingredient pairing number information and ingredient pairing preference weight value according to the ingredients in the pending area, sorting the ingredient pairing number information from high to low, and determining whether the ingredient pairing preference weight value corresponding to the ingredient pairing number information meets the preset ingredient pairing preference weight threshold (for example: a value). If not, the corresponding ingredient pairing number information is removed, and the initial combined pairing operation of the ingredients in the pending area is ended. If satisfied, select the corresponding ingredient pairing number information whose ingredient pairing preference weight value meets the preset ingredient pairing preference weight threshold, construct an initial combined pairing data set, select the ingredient pairing number information with the highest ingredient pairing preference weight value from the initial combined pairing data set, place the ingredients corresponding to the ingredient pairing number information in the dish area, remove the pairing number information including the above ingredients, and continue the initial combined pairing operation of the remaining ingredients in the pending area until there is no ingredient pairing number information that exceeds the ingredient pairing preference weight threshold.

[0050] In this embodiment, if there are still ingredients with uncertain combinations in the to-be-determined area, new ingredients are added to be combined with the ingredients in the to-be-determined area for a secondary combination, and the ingredients after the secondary combination are placed in the dish area. The specific operation process includes: the data processor retrieves the ingredient combination number information and the ingredient combination preference weight value of the ingredients in the to-be-determined area, sorts the ingredient combination preference weight values from high to low, selects the ingredient combination number information of the top three ranked ingredient combination preference weight values for the user to choose, and the user selects one according to their own preference to become the dish and drags it to the dish area.

[0051] Among them, for the weight information of the new ingredient, the weight information of the regular one-meal usage amount corresponding to the ingredient is selected as its weight information, and the ingredient nutrition data is calculated according to this weight information.

[0052] In this embodiment, calculating the dish nutrition data in the current dish area specifically includes: summing up the ingredient nutrition data of all the ingredients in the current dish area to obtain the dish nutrition data in the current dish area.

[0053] S5. Determine whether the dish nutrition data in the current dish area meets the nutrition requirement data of this meal. If not, adjust the dish and / or the ingredient weight until it meets the nutrition requirement data of this meal. If it meets, take the dish in the current dish area as the recipe for this meal and complete the meal cooking process.

[0054] In this embodiment, the recipe for this meal includes the ingredient type name information, the ingredient weight information of the corresponding ingredient, the seasoning type name information, and the seasoning weight information of the corresponding seasoning.

[0055] In this embodiment, by comparing whether the nutritional data of the dishes in the current dish area meets the nutritional requirement data of the meal, the dishes or the amount of ingredients can be adjusted according to the nutritional requirement data of the meal. If one or more of the three major nutrients of carbohydrates, protein, and fat in the selected ingredients exceed the corresponding items of the nutritional requirement data of the meal, it is necessary to reduce the amount of ingredients, select the ingredients with the most exceeded items, adjust the amount of them, and compare again. If it is still not satisfied, continue to select the ingredients with the most exceeded items, and adjust the amount of them again. Repeat the above operation until the three major nutrients of carbohydrates, protein, and fat in the selected ingredients do not exceed the nutritional requirement data of the meal. If one or more of the three major nutrients of carbohydrates, proteins, and fats in the selected ingredients are lower than the corresponding items in the nutritional requirement data of this meal, it is necessary to adjust the weight of the ingredients or add dishes. The method of adjusting the weight of ingredients is similar to the method of adjusting the weight of ingredients, which will not be repeated here. For adding dishes, recommendations are made based on the weight value of the ingredient combination preference and the vacancies in the nutritional requirement data of this meal. The combinations with similar nutritional data of ingredients and the vacancies in the nutritional requirement data of this meal are screened in the information storage device, and the five matching ingredients with the highest preference weight values ​​of ingredients are further screened. The weight of the ingredients in the dishes is adjusted so that the nutritional data corresponding to the ingredients are more matched with the vacancies in the nutritional requirement data of this meal, and then it is handed over to the user for matching selection. At this point, after the adjustment of the dishes is completed, the scientific dietary combination of this meal is completed, and the recipe for this meal is obtained.

[0056] S6. In the food preparation stage, the main device receives the food preparation stage image data sent by the AR glasses, compares the food preparation stage image data with the food feature image data in the food image feature library, obtains the corresponding food type name information, and sends the corresponding food type name information to the AR glasses for display. After determining the corresponding food type name information, the user performs the vegetable cutting operation, places the cut food on the smart cutting board, obtains the weight information of the cut food, and sends the weight information of the cut food to the main device. After receiving the weight information of the cut food, the main device sends the weight information of the cut food to the AR glasses for display. When the weight information of the cut food reaches the weight information of the corresponding food, it is displayed and prompted through the AR glasses, ending the food preparation operation of the corresponding food, and performing the food preparation operation on all the food included in the current meal recipe until the food preparation operation of all the food included in the current meal recipe is completed.

[0057] In this embodiment, during the food preparation stage, the user wears AR glasses, and the types and weights of the ingredients included in this meal are displayed on the light-transmissive screen as food preparation prompts. The ingredients are placed on the intelligent cutting board, and the corresponding ingredient image data is collected by the camera on the AR glasses. The ingredient image data is sent to the first signal receiver through the third signal transmitter. The intelligent image recognition module is used to recognize the received ingredient image data and obtain the corresponding ingredient type name information, which is sent to the light-transmissive screen of the AR glasses for display through the first signal transmitter. After being confirmed by the user, the food preparation operation is carried out. The cut ingredients are placed on the intelligent cutting board to obtain the weight information of the cut ingredients. The weight information of the cut ingredients is sent to the first signal receiver through the third signal transmitter, and then sent to the light-transmissive screen of the AR glasses for display and prompt through the first signal transmitter to end the food preparation operation of the corresponding ingredient. The food preparation operation of all the ingredients included in this meal recipe is continued until the food preparation operation of all the ingredients included in this meal recipe is completed.

[0058] S7. During the meal cooking stage, the recipe of this meal and the cooking step prompts corresponding to the recipe of this meal are displayed through the AR glasses for meal cooking. During cooking, the main device receives the condiment image data sent by the AR glasses, compares the condiment image data with the basic condiment data to obtain the corresponding condiment type name information, places the corresponding condiment on the intelligent cutting board, obtains the weight information of the condiment before use and the weight information of the condiment after use, and sends the weight information of the condiment before use and the weight information of the condiment after use to the main device. The main device receives the weight information of the condiment before use and the weight information of the condiment after use sent by the intelligent cutting board, calculates the current condiment usage information, and based on the current condiment usage information, the corresponding condiment type name information and the corresponding condiment recipe information, obtains the actual salt intake information and the actual oil intake information, and sends the actual salt intake information and the actual oil intake information to the AR glasses for display and prompt. The user completes the meal cooking process according to the prompt.

[0059] In this embodiment, during the meal cooking stage, the recipes for this meal are displayed on a transparent screen. According to the selected ingredients for cooking, guidance on the matching ingredients, the sequence and timing of operation steps is given. The camera on the AR glasses is used to capture the user's action of taking seasonings and obtain seasoning image data. The seasoning image data is sent to the first signal receiver through the third signal transmitter. The intelligent image recognition module is used to recognize the received seasoning image data to obtain the corresponding seasoning type name information. The data processor is used to retrieve the seasoning brand information and seasoning recipe information, place the corresponding seasonings on the intelligent cutting board. The intelligent cutting board is used to obtain the weight information of the seasoning before use and the weight information of the seasoning after use. The weight information of the seasoning before use and the weight information of the seasoning after use are sent to the first signal receiver through the second signal transmitter. The data processor calculates the current seasoning usage information. Based on the current seasoning usage information, the corresponding seasoning type name information and the corresponding seasoning recipe information, the actual salt intake information and the actual oil intake information are obtained, and then sent to the transparent screen of the AR glasses through the first signal transmitter for display and prompt. The user completes the meal cooking process and controls the seasoning usage according to the prompt.

[0060] Embodiment 2

[0061] Based on the above Embodiment 1, this embodiment provides a system for AR-assisted home matching and making of scientific meals. Refer to the appendix Figures 2 - 5 , and execute the method for AR-assisted home matching and making of scientific meals in the above Embodiment 1. The system includes a main device, an intelligent cutting board that interacts with the main device, and AR glasses that interact with the main device.

[0062] In this embodiment, refer to the appendix Figure 3 , the main device includes a touch display screen, a data processor, an intelligent image recognition module, an information storage device, a first signal receiver, and a first signal transmitter.

[0063] Among them, the touch display screen is used to obtain the basic information of family members, the ingredient image feature library, the basic ingredient data, the initial ingredient matching preference weight value, the basic seasoning data, enter the meal information for this meal and the ingredient type name information of the expected ingredients for this meal, and prompt and guide the user to complete the preliminary matching operation, the initial combined matching operation, and the secondary combined matching operation.

[0064] Among them, the intelligent image recognition module is used to compare the ingredient image data in the ingredient preparation stage and the ingredient matching image data in the cooking stage with the ingredient feature image data in the ingredient image feature library to obtain the corresponding ingredient type name information and ingredient serial number information, as well as the corresponding ingredient type matching information and ingredient matching number information, and compare the seasoning image data with the seasoning feature image data in the basic seasoning data to obtain the corresponding seasoning type name information.

[0065] Among them, the information storage device is used to store basic information of family members, total daily energy requirements information for corresponding family members, nutritional information required for each meal, ingredient image feature library, basic ingredient data, initial ingredient combination preference weight values, basic seasoning data, and updated ingredient combination preference weight values.

[0066] Among them, the first signal receiver is used to receive ingredient image data in the ingredient preparation stage, ingredient combination image data in the cooking stage, existing ingredient image data, and seasoning image data sent by the AR glasses, and to receive existing ingredient weight information, cut ingredient weight information, pre-use seasoning weight information, and post-use seasoning weight information sent by the intelligent cutting board.

[0067] Among them, the data processor is used to calculate the total daily energy requirements information for corresponding family members, calculate the nutritional information required for each meal, calculate the nutritional requirement data for this meal, calculate the ingredient nutritional data of the selected ingredients, calculate the dish nutritional data within the current dish area, calculate the current seasoning dosage information, calculate the actual salt intake information and actual oil intake information, determine whether the ingredient nutritional data of the selected ingredients meets the nutritional requirement data for this meal, determine whether the dish nutritional data within the current dish area meets the nutritional requirement data for this meal, update the initial ingredient combination preference weight values to obtain updated ingredient combination preference weight values, and perform preliminary combination operations, initial combined combination operations, and secondary combined combination operations.

[0068] Among them, the first signal transmitter is used to send the nutritional requirement data for this meal, the ingredient nutritional data of the selected ingredients, the dish nutritional data, the judgment result of whether the ingredient nutritional data of the selected ingredients meets the nutritional requirement data for this meal, the judgment result of whether the dish nutritional data within the current dish area meets the nutritional requirement data for this meal, the recipe for this meal, the actual salt intake information, the actual oil intake information, and the cut ingredient weight information to the AR glasses.

[0069] In this embodiment, referring to Appendix Figure 4 , the intelligent cutting board includes a first weight weighing module, a second weight weighing module, a third weight weighing module, and a second signal transmitter.

[0070] Among them, the first weight weighing module is used to weigh the existing ingredient weight information.

[0071] Among them, the second weight weighing module is used to weigh the cut ingredient weight information.

[0072] Among them, the third weight weighing module is used to weigh the pre-use seasoning weight information and the post-use seasoning weight information.

[0073] Among them, the second signal transmitter is used to send the weight information of existing ingredients, the weight information of cut ingredients, the weight information of seasonings before weighing, and the weight information of seasonings after use to the first signal receiver.

[0074] In this embodiment, referring to the attached Figure 5 , the AR glasses include a camera, a transmissive screen, a third signal transmitter, and a second signal receiver.

[0075] Among them, the camera is used to collect the image data of ingredients in the ingredient preparation stage, the image data of ingredient combinations in the cooking stage, the image data of existing ingredients, and the image data of seasonings.

[0076] Among them, the transmissive screen is used to generate corresponding AR images from the collected image data of ingredients in the ingredient preparation stage, the image data of ingredient combinations in the cooking stage, the image data of existing ingredients, and the image data of seasonings, and project the AR images onto the transmissive screen for display and prompt to the user. The transmissive screen displays the image data of ingredients in the ingredient preparation stage, the image data of ingredient combinations in the cooking stage, the image data of existing ingredients, the image data of seasonings, the nutritional requirements data for this meal, the nutritional data of selected ingredients, the nutritional data of dishes, the judgment result of whether the nutritional data of selected ingredients meets the nutritional requirements data for this meal, the judgment result of whether the nutritional data of dishes in the current dish area meets the nutritional requirements data for this meal, the actual salt intake information, the actual oil intake information, and the weight information of cut ingredients, and completes the selection of the recipe for this meal and the dietary cooking process while selecting and determining the preliminary combination, the initial combined combination, and the secondary combined combination.

[0077] Among them, the third signal transmitter is used to send the image data of ingredients in the ingredient preparation stage, the image data of ingredient combinations in the cooking stage, the image data of existing ingredients, and the image data of seasonings to the first signal receiver.

[0078] Among them, the second signal receiver is used to receive the nutritional requirements data for this meal, the nutritional data of selected ingredients, the nutritional data of dishes, the judgment result of whether the nutritional data of selected ingredients meets the nutritional requirements data for this meal, the judgment result of whether the nutritional data of dishes in the current dish area meets the nutritional requirements data for this meal, the recipe for this meal, receive the actual salt intake information, the actual oil intake information, and the weight information of cut ingredients.

[0079] Obviously, those skilled in the art should understand that the above-described implementation manners of the steps of the present invention can be executed in a manner different from that of the present invention. The simulation methods and experimental equipment include but are not limited to the above description. The above-described steps of the present invention can be executed in a sequence different from that here in some cases, and the steps shown or described above can be executed separately. Therefore, the present invention is not limited to any specific combination of hardware and software.

[0080] The above content is a further detailed description of the present invention in combination with specific implementation manners. It cannot be determined that the specific implementation of the present invention is only limited to these descriptions. For those of ordinary skill in the technical field to which the present invention pertains, without departing from the concept of the present invention, several simple deductions or substitutions can be made, which should all be regarded as falling within the protection scope of the present invention.

Claims

1. A method for AR-assisted family preparation of scientific meals, the method is applied to an AR-assisted family preparation of scientific meals system, the system comprising a main device, a smart chopping board interacting with the main device, and AR glasses interacting with the main device, characterized in that: include: Obtaining basic information of family members, a food image feature library, basic food data, initial food pairing preference weight values, and basic seasoning data through a main device, calculating the total energy required daily and the nutritional information required for each meal of the corresponding family members based on the basic information of the family members, and storing the basic information of the family members, the total energy required daily, the nutritional information required for each meal of the corresponding family members, the food image feature library, the basic food data, the initial food pairing preference weight values, and the basic seasoning data in an information storage device; Before cooking each meal, the main device receives the food image data of the preparation stage and the food matching image data of the cooking stage sent by the AR glasses, compares the food image data of the preparation stage with the food feature image data in the food image feature library, obtains the corresponding food type name information and food serial number information, and compares the food matching image data of the cooking stage with the food feature image data in the food image feature library, obtains the corresponding food type matching information and food matching number information, retrieves the corresponding initial food matching preference weight value based on the food matching number information, updates the initial food matching preference weight value, obtains the updated food matching preference weight value, and stores the updated food matching preference weight value in the information storage; Before cooking each meal, the dining information of the meal is entered based on the main device, and the nutritional requirement data of the meal is calculated; the nutritional data of the selected ingredients is calculated based on the name information of the ingredient type of the desired ingredient of the meal entered into the main device, the image data of the existing ingredients sent by the AR glasses, and the weight information of the existing ingredients sent by the smart cutting board; Determine whether the nutritional data of the selected ingredients meet the nutritional requirements of the meal; if not, adjust the types of selected ingredients and / or the weight of selected ingredients and / or remove the selected ingredients until the nutritional requirements of the meal are met; if satisfied, preliminarily match the existing ingredients according to the user's preferences, place the preliminarily matched ingredients in the dish area, place the uncertainly matched ingredients in the pending area, and perform a preliminary combination of the ingredients in the pending area according to the corresponding ingredient matching preference weight values, and place the ingredients after the initial combination in the dish area; if there are still uncertainly matched ingredients in the pending area, add new ingredients to perform a secondary combination with the ingredients in the pending area, and place the ingredients after the secondary combination in the dish area to calculate the nutritional data of the dishes in the current dish area; Determine whether the nutritional data of the dishes in the current dish area meets the nutritional requirement data of the meal. If not, adjust the dishes and / or ingredient weights until the nutritional requirement data of the meal is met. If so, use the dishes in the current dish area as the recipe for the meal and complete the meal cooking process. The recipe for the meal includes ingredient type name information, ingredient weight information of the corresponding ingredients, seasoning type name information, and seasoning weight information of the corresponding seasoning.

2. The method of AR-assisted family preparation of scientific meals according to claim 1, characterized in that: The method of calculating the total energy required daily and the nutritional information required for each meal of the corresponding family members based on the basic information of the family members specifically includes: based on the basic information of the family members, the basic information of the family members includes the name information, gender information, age information, height information, weight information, labor intensity information, basic chronic disease information, dietary taboo information, allergic food information, and number of meals a day of the family members; obtaining the BMI index value of the corresponding family member according to the height information and weight information, obtaining the required calorie value per kilogram of body weight of the corresponding family member based on the BMI index value and the labor intensity information, and calculating the total energy required daily for the corresponding family member according to the daily energy supply table, and the calculation formula is: total energy required daily = (height information - 110) × required calorie value per kilogram of body weight, allocating the energy required for each meal according to the number of meals a day of the corresponding family members, obtaining the required energy value for each meal of the corresponding family members, and calculating the nutritional information required for each meal based on the preset daily required proportion intake information of the three major nutrients, daily oil intake information, daily salt intake information, and daily vitamin intake information.

3. The method of AR-assisted family preparation of scientific meals according to claim 1, characterized in that: The basic ingredient data includes ingredient type name information, ingredient serial number information, ingredient combination number information, regular meal weight information, calorie content information of 100g edible portion, content information of three major nutrients in 100g edible portion, vitamin content information of 100g edible portion, glycemic index information and glycemic load information. The ingredient combination number information matches the corresponding initial ingredient combination preference weight value.

4. The method of AR-assisted family preparation of scientific meals according to claim 3, characterized in that: The main device receives the food image data of the food preparation stage and the food matching image data of the cooking stage sent by the AR glasses, compares the food image data of the food preparation stage with the food feature image data in the food image feature library to obtain the corresponding food type name information and food serial number information, and compares the food matching image data of the cooking stage with the food feature image data in the food image feature library to obtain the corresponding food type matching information and food matching number information, based on the food matching number information, retrieves the corresponding initial food matching preference weight value, updates the initial food matching preference weight value, and obtains the updated food matching preference weight value, specifically including: obtaining the food image data of the food preparation stage and the food matching image data of the cooking stage through the AR glasses, and sending the food image data of the food preparation stage and the food matching image data of the cooking stage to the main device. To the main device, the main device compares the received ingredient image data of the preparation stage with the ingredient feature image data in the ingredient image feature library to obtain corresponding ingredient type name information and ingredient serial number information, and compares the ingredient matching image data of the cooking stage with the ingredient feature image data in the ingredient image feature library to obtain corresponding ingredient type matching information and ingredient matching number information, based on the ingredient matching number information, retrieves the corresponding initial ingredient matching preference weight value, marks the ingredient matching number information to obtain ingredient tendency matching number information, and according to the preset ingredient tendency matching scoring rule, performs scoring processing on the initial ingredient matching preference weight value corresponding to the ingredient tendency matching number information to obtain the ingredient matching preference weight value after scoring processing, and uses the ingredient matching preference weight value after scoring processing as the updated ingredient matching preference weight value.

5. The method of AR-assisted family preparation of scientific diet according to claim 1, characterized in that: The method of entering the dining information of the meal based on the main device and calculating the nutritional requirement data of the meal specifically includes: entering the dining information of the meal based on the main device, the dining information of the meal including the meal time and the family members who have eaten the meal, retrieving the nutritional information required for each meal of the family members corresponding to the meal time through the main device, and accumulating and summing the nutritional information required for each meal of all family members who have eaten the meal to obtain the nutritional requirement data of the meal.

6. The method of AR-assisted family preparation of scientific meals according to claim 3, characterized in that: The method of calculating the nutritional data of the selected ingredients based on the ingredient type name information of the expected ingredients for the meal entered into the main device, the image data of the existing ingredients sent by the AR glasses, and the weight information of the existing ingredients sent by the smart cutting board specifically includes: based on the ingredient name information of the expected ingredients for the meal entered into the main device, the ingredient serial number information, the weight information of a conventional meal usage, the calorie information contained in 100g of the edible part, the content information of the three major nutrients in 100g of the edible part, and the vitamin content information of 100g of the edible part of the ingredient name information are retrieved through the main device, and the nutritional data of the expected ingredients for the meal are calculated according to the weight information of the conventional meal usage; the main device Receive the existing food image data sent by the AR glasses and the existing food weight information sent by the smart cutting board, compare the existing food image data with the food feature image data in the food image feature library, obtain the corresponding food type name information, retrieve the food serial number information, the calorie information contained in 100g of edible part, the three major nutrient content information of 100g of edible part and the vitamin content information of 100g of edible part of the food through the main device, calculate the food nutritional data of the existing food according to the existing food weight information; add and sum the food nutritional data of the expected food for this meal and the food nutritional data of the existing food to obtain the food nutritional data of the selected food.

7. The method of AR-assisted family preparation of scientific meals according to claim 3, characterized in that: The method of performing an initial combination and matching of ingredients in the to-be-determined area according to the corresponding ingredient matching preference weight values, and placing the initially combined and matched ingredients in the dish area specifically includes: retrieving the ingredient matching number information and the ingredient matching preference weight values ​​of the ingredients in the to-be-determined area through the main device, sorting the ingredient matching number information from high to low, judging whether the ingredient matching preference weight values ​​corresponding to the ingredient matching number information meet the preset ingredient matching preference weight threshold value, if not, filtering out the corresponding ingredient matching number information, and ending the initial combination and matching operation of the ingredients in the to-be-determined area; if so, selecting the corresponding ingredient matching number information whose ingredient matching preference weight values ​​meet the preset ingredient matching preference weight threshold value, constructing an initial combination and matching data set, selecting the ingredient matching number information with the highest ingredient matching preference weight value from the initial combination and matching data set, and placing the ingredients corresponding to the ingredient matching number information in the dish area; performing an initial combination and matching operation on all ingredients in the to-be-determined area until the initial combination and matching operation of all ingredients in the to-be-determined area is completed.

8. The method of AR-assisted family preparation of scientific meals according to claim 3, characterized in that: If there are still uncertain ingredients in the to-be-determined area, new ingredients are added to perform secondary combination with the ingredients in the to-be-determined area, and the ingredients after the secondary combination are placed in the dish area, specifically including: retrieving the ingredient matching number information and ingredient matching preference weight values ​​of the ingredients in the to-be-determined area through the main device, sorting the ingredient matching preference weight values ​​from high to low, selecting the ingredient matching number information with the top three ingredient matching preference weight values, performing secondary combination selection on the ingredient matching number information with the top three ingredient matching preference weight values ​​according to user preferences, obtaining the ingredient matching number information after the secondary combination, and placing the ingredients corresponding to the ingredient matching number information in the dish area.

9. The method of AR-assisted family preparation of scientific meals according to claim 1, characterized in that: The meal cooking process specifically includes: In the food preparation stage, the main device receives the food image data of the food preparation stage sent by the AR glasses, compares the food image data of the food preparation stage with the food feature image data in the food image feature library, obtains the corresponding food type name information, and sends the corresponding food type name information to the AR glasses for display. After determining the corresponding food type name information, the user performs a vegetable cutting operation, places the cut food on the smart cutting board, obtains the cut food weight information, and sends the cut food weight information to the main device. After receiving the cut food weight information, the main device sends the cut food weight information to the AR glasses for display. When the cut food weight information reaches the food weight information of the corresponding food, it is displayed and prompted through the AR glasses, ending the food preparation operation of the corresponding food, and performing food preparation operations on all the food included in the current meal recipe until the food preparation operations of all the food included in the current meal recipe are completed; During the meal cooking stage, the AR glasses are used to display the menu and the cooking step prompts corresponding to the menu to perform meal cooking. During cooking, the main device receives the seasoning image data sent by the AR glasses, compares the seasoning image data with the seasoning feature image data in the basic seasoning data, obtains the corresponding seasoning type name information, places the corresponding seasoning on the smart chopping board, obtains the seasoning weight information before use and the seasoning weight information after use, and sends the seasoning weight information before use and the seasoning weight information after use to the main device. The main device receives the seasoning weight information before use and the seasoning weight information after use sent by the smart chopping board, calculates the current seasoning usage information, obtains the actual salt intake information and the actual oil intake information based on the current seasoning usage information, the corresponding seasoning type name information and the corresponding seasoning formula information, and sends the actual salt intake information and the actual oil intake information to the AR glasses for display and prompts, and the user completes the meal cooking process according to the prompts.

10. An AR system that assists families in preparing scientific meals, characterized in that: Executing the method for AR-assisted family preparation of scientific meals as claimed in any one of claims 1 to 9, the system comprising a main device, a smart chopping board interacting with the main device, and AR glasses interacting with the main device; The main device includes a touch screen, a data processor, an intelligent image recognition module, an information storage, a first signal receiver and a first signal transmitter; the touch screen is used to obtain basic information of family members, a food image feature library, basic food data, initial food pairing preference weight values, basic seasoning data, input dining information of the meal and food type name information of the expected food ingredients of the meal, and prompt and guide the user to complete preliminary pairing operations, initial combination pairing operations and secondary combination pairing operations; the intelligent image recognition module is used to compare food image data of the preparation stage and food pairing image data of the cooking stage with food feature image data in the food image feature library. The information storage device is used to store basic information of family members, total energy required daily for corresponding family members, nutritional information required for each meal, food image feature library, basic food data, initial food pairing preference weight value, basic food data and updated food pairing preference weight value; the first signal receiver is used to receive food image data of the preparation stage, cooking stage and other food pairing preference information sent by the AR glasses; The data processor is used to calculate the total daily energy required by the corresponding family members, calculate the nutritional information required for each meal, calculate the nutritional requirement data of the current meal, calculate the nutritional data of the selected ingredients, calculate the nutritional data of the dishes in the current dish area, calculate the current seasoning usage information, calculate the actual salt intake information and the actual oil intake information, determine whether the nutritional data of the selected ingredients meet the nutritional requirement data of the current meal, and determine whether the nutritional data of the selected ingredients meet the nutritional requirement data of the current dish area. whether the nutritional data of dishes in the domain meet the nutritional requirements of this meal, update the initial food combination preference weight value, obtain the updated food combination preference weight value, and perform preliminary combination operation, initial combination operation and secondary combination operation; the first signal transmitter is used to send the nutritional requirements data of this meal, the nutritional data of the selected ingredients, the nutritional data of the dishes, the judgment result of whether the nutritional data of the selected ingredients meet the nutritional requirements of this meal, the judgment result of whether the nutritional data of the dishes in the current dish area meet the nutritional requirements of this meal, the menu of this meal, the actual salt intake information, the actual oil intake information and the weight information of the cut ingredients to the AR glasses; The smart chopping board includes a first weight weighing module, a second weight weighing module, a third weight weighing module and a second signal transmitter; the first weight weighing module is used to weigh the weight information of existing ingredients; the second weight weighing module is used to weigh the weight information of cut ingredients; the third weight weighing module is used to weigh the weight information of seasonings before use and the weight information of seasonings after use; the second signal transmitter is used to send the weight information of existing ingredients, the weight information of cut ingredients, the weight information of seasonings before use and the weight information of seasonings after use to the first signal receiver; The AR glasses include a camera, a light-transmitting screen, a third signal transmitter and a second signal receiver; the camera is used to collect image data of ingredients in a preparation stage, image data of ingredients matching in a cooking stage, image data of existing ingredients and image data of seasonings; the light-transmitting screen is used to generate corresponding AR images from the collected image data of ingredients in a preparation stage, image data of ingredients matching in a cooking stage, image data of existing ingredients and image data of seasonings, and project the AR images onto the light-transmitting screen for display and prompting to a user; the light-transmitting screen displays image data of ingredients in a preparation stage, image data of ingredients matching in a cooking stage, image data of existing ingredients, image data of seasonings, nutritional requirement data of the current meal, nutritional data of selected ingredients, nutritional data of dishes, a judgment result of whether the nutritional data of selected ingredients meet the nutritional requirement data of the current meal, and nutritional data of dishes in a current dish area According to the judgment result of whether the nutritional requirement data of this meal is met, the actual salt intake information, the actual oil intake information and the weight information of the cut ingredients, and while selecting and determining the preliminary combination, the first combination and the second combination, the selection of the menu for this meal and the meal cooking process are completed; the third signal transmitter is used to send the ingredient image data of the preparation stage, the ingredient matching image data of the cooking stage, the existing ingredient image data and the seasoning image data to the first signal receiver; the second signal receiver is used to receive the nutritional requirement data of this meal, the ingredient nutritional data of the selected ingredients, the dish nutritional data, the judgment result of whether the ingredient nutritional data of the selected ingredients meets the nutritional requirement data of this meal, the judgment result of whether the dish nutritional data in the current dish area meets the nutritional requirement data of this meal, the menu of this meal, and receive the actual salt intake information, the actual oil intake information and the weight information of the cut ingredients.

Images