Multilingual cooking professional language practical operation learning system

Abstract

The invention relates to the technical field of cooking, in particular to a multi-language cooking professional language practical operation learning system. The audio collection equipment is used for receiving to-be-tested target language audio input by a target user and transmitting the to-be-tested target language audio to the electronic equipment; the electronic equipment is used for identifying the to-be-tested target language audio, determining a cooking process corresponding to the to-be-tested target language audio and scoring the to-be-tested target language audio; the camera equipment is used for shooting the target user when the target user executes the test action corresponding to the cooking process, generating a cooking process video corresponding to the target user, and transmitting the cooking process video to the electronic equipment; and the electronic equipment is used for identifying the cooking process video, determining a test action corresponding to the target user, and determining a score corresponding to the test action based on the to-be-tested content. Cooking and multilingual combined learning is realized.

Description

Technical Field

[0001] The present invention relates to the field of cooking technology, and in particular to a multilingual cooking professional terminology practical learning system. Background Art

[0002] In the culinary industry, foreign languages ​​are increasingly used. Whether in international hotels and restaurants, or in culinary schools and training institutions, foreign languages ​​have become one of the essential skills.

[0003] At present, the importance of foreign languages ​​is increasing in the culinary industry. Many culinary schools and training institutions have opened foreign language courses to help students improve their foreign language proficiency. At the same time, many international hotels and restaurants also require their employees to have a certain level of foreign language proficiency in order to better communicate and serve international guests.

[0004] However, how to combine cooking and foreign languages ​​to better train the target users' cooking and foreign language skills is still an urgent problem to be solved. At present, although some cooking schools and training institutions have tried to combine cooking and foreign languages, the results are not ideal. Therefore, we need to explore a more effective method to combine cooking and foreign languages ​​to better train the target users' cooking and foreign language skills. Summary of the invention

[0005] In view of this, the present invention provides a multilingual cooking professional terminology practical learning system to solve the problem of how to combine cooking with multilingual learning.

[0006] In a first aspect, the present invention provides a multilingual cooking terminology practical learning system, the multilingual cooking terminology practical learning system comprising: an audio collection device, a camera device and an electronic device, wherein the audio collection device and the camera device are both communicatively connected to the electronic device, wherein:

[0007] An audio collection device, used for receiving the target language audio to be tested input by the target user, and transmitting the target language audio to be tested to the electronic device;

[0008] An electronic device, used for recognizing the target language audio to be tested, determining the cooking process corresponding to the target language audio to be tested, and scoring the target language audio to be tested;

[0009] A camera device, used to shoot the target user when the target user performs a test action corresponding to the cooking process, generate a cooking process video corresponding to the target user, and transmit the cooking process video to the electronic device;

[0010] An electronic device is used to recognize a cooking process video, determine a test action corresponding to a target user, and determine a score corresponding to the test action based on the content to be tested.

[0011] The multilingual cooking professional terminology practical learning system provided by the embodiment of the present application, the audio collection device receives the target language audio to be tested input by the target user, and transmits the target language audio to be tested to the electronic device. The electronic device is used to identify the target language audio to be tested, determine the cooking process corresponding to the target language audio to be tested, and score the target language audio to be tested, so that the accuracy of the target language audio to be tested input by the target user can be detected, which helps to improve the target language level of the target user. When the target user performs the test action corresponding to the cooking process, the camera device shoots the target user, generates a cooking process video corresponding to the target user, and transmits the cooking process video to the electronic device. The electronic device identifies the cooking process video, determines the test action corresponding to the target user, and determines the score corresponding to the test action based on the content to be tested. Thus, the test action of the target user when completing the cooking process can be detected. The cooking professional terminology corresponding to the target language is combined with the cooking process. While detecting the test action of the target user when completing the cooking process, the target language level of the target user is detected, and cooking is combined with multilingual learning.

[0012] In an optional implementation of the present application, the target language audio to be tested includes a target language recipe audio to be tested; wherein:

[0013] An electronic device, used for determining a target recipe corresponding to the target language recipe audio to be tested based on a target audio recognition model;

[0014] The electronic device is also used to determine a cooking process corresponding to the target recipe based on the target recipe.

[0015] The multilingual cooking professional terminology practical learning system provided in the embodiment of the present application is an electronic device used to determine the target recipe corresponding to the target language recipe audio to be tested based on the target audio recognition model, thereby ensuring the accuracy of the determined target recipe. The electronic device is also used to determine the cooking process corresponding to the target recipe based on the target recipe, thereby ensuring the accuracy of the cooking process corresponding to the determined target recipe.

[0016] In an optional implementation of the present application, the electronic device is used to input the target language recipe audio to be tested into the target audio recognition model, the target audio recognition model recognizes the target language recipe audio to be tested, and outputs a backup recipe corresponding to the target language recipe audio to be tested;

[0017] Outputting alternate recipes to target users;

[0018] Receive the answer input by the target user;

[0019] If the answer is yes, the backup recipe is determined as the target recipe.

[0020] In the multilingual cooking professional terminology practical learning system provided by the embodiment of the present application, the electronic device inputs the target language recipe audio to be tested into the target audio recognition model, the target audio recognition model recognizes the target language recipe audio to be tested, and outputs the backup recipe corresponding to the target language recipe audio to be tested, thereby ensuring the accuracy of the backup recipe corresponding to the output target language recipe. The backup recipe is output to the target user, so that the target user can verify the backup recipe. The answer input by the target user is received; if the answer is yes, the backup recipe is determined as the target recipe, thereby ensuring the accuracy of the determined target recipe.

[0021] In an optional implementation of the present application, the target language audio to be tested is a target language recipe audio to be tested, and the electronic device is further used to obtain a preset target language recipe audio corresponding to the target language recipe audio to be tested, calculate the similarity between the target language recipe audio to be tested and the preset target language recipe audio, and score the target language recipe audio to be tested based on the similarity; and when the score corresponding to the target language recipe audio to be tested is lower than a preset score threshold, correct the target language recipe audio to be tested input by the target user.

[0022] In the multilingual cooking professional terminology practical learning system provided by the embodiment of the present application, the electronic device obtains the preset target language recipe audio corresponding to the target language recipe audio to be tested, calculates the similarity between the target language recipe audio to be tested and the preset target language recipe audio, thereby ensuring the accuracy of the calculated similarity between the target language recipe audio to be tested and the preset target language recipe audio. Based on the similarity, the target language recipe audio to be tested is scored, thereby ensuring the accuracy of the scoring of the target language recipe audio to be tested. When the score corresponding to the target language recipe audio to be tested is lower than the preset scoring threshold, the target language recipe audio to be tested input by the target user is corrected, thereby ensuring that the target user learns the standard target language audio.

[0023] In an optional implementation of the present application, the cooking process video is a cooking process video of a target user cooking based on a target recipe; the test action includes a food preparation action and a cooking action; wherein:

[0024] An electronic device, used for identifying the cooking process video, and dividing the cooking process video into a food preparation video and a cooking video according to the identification result;

[0025] Identify the food preparation video, determine the food preparation actions corresponding to the target user, and determine the scores corresponding to the food preparation actions;

[0026] Identify cooking videos, determine the cooking actions corresponding to the target users, and determine the scores corresponding to the cooking actions.

[0027] The multilingual cooking professional terminology practical learning system and electronic device provided in the embodiment of the present application are used to identify cooking process videos, thereby ensuring the accuracy of the obtained recognition results. According to the recognition results, the cooking process videos are divided into food preparation videos and cooking videos; the accuracy of the division into food preparation videos and cooking videos is ensured. The food preparation videos are identified, and the food preparation actions corresponding to the target users are determined, thereby ensuring the accuracy of the food preparation actions corresponding to the determined target users. The scores corresponding to the food preparation actions are determined, thereby ensuring the accuracy of the scores corresponding to the determined food preparation actions. The cooking videos are identified, and the cooking actions corresponding to the target users are determined, thereby ensuring the accuracy of the cooking actions corresponding to the determined target users. The scores corresponding to the cooking actions are determined, thereby ensuring the accuracy of the scores corresponding to the determined cooking actions.

[0028] In an optional embodiment of the present application, the vegetable preparation action includes a vegetable preparation action and a vegetable cutting action; wherein:

[0029] The electronic device is used to identify the action of preparing vegetables, determine the types of spare vegetables prepared by the target user, and compare the types of spare vegetables with the types of target vegetables corresponding to the target recipe; and determine a score corresponding to the action of preparing vegetables according to the comparison result;

[0030] The electronic device is used to identify the action of cutting vegetables, determine the cutting shape of each spare vegetable after the target user cuts it; compare the cutting shape of each spare vegetable with the target shape corresponding to the spare recipe; and determine the score corresponding to the action of cutting vegetables based on the comparison result.

[0031] In the multilingual cooking professional terminology practical learning system provided in the embodiment of the present application, the electronic device recognizes the action of preparing vegetables, determines the types of spare vegetables prepared by the target user, and ensures the accuracy of the types of spare vegetables prepared by the determined target user. The types of spare vegetables are compared with the types of target vegetables corresponding to the target recipe; based on the comparison results, the scores corresponding to the action of preparing vegetables are determined, and the accuracy of the scores corresponding to the determined action of preparing vegetables is ensured. The electronic device recognizes the action of cutting vegetables, determines the cutting shapes of each spare vegetable after the target user cuts it, and ensures the accuracy of the cutting shapes of each spare vegetable after the determined target user cuts it. The cutting shapes of each spare vegetable are compared with the target shapes corresponding to the spare recipes; based on the comparison results, the scores corresponding to the action of cutting vegetables are determined, and the accuracy of the scores corresponding to the determined action of cutting vegetables is ensured.

[0032] In an optional embodiment of the present application, the audio collection device is further used to collect the target language name audio corresponding to each spare vegetable input by the target user when preparing the spare vegetables; and transmit the target language name audio to the electronic device;

[0033] The electronic device is used to recognize the audio of each target language name and determine the score corresponding to each target language name audio; and when the score corresponding to the target language name audio is lower than a preset score threshold, correct the target language name audio input by the target user.

[0034] In the multilingual cooking professional terminology practical learning system provided by the embodiment of the present application, the audio collection device collects the target language name audio corresponding to each spare vegetable input by the target user when preparing the spare vegetables; and transmits each target language name audio to the electronic device. The electronic device recognizes each target language name audio, determines the score corresponding to each target language name audio, and ensures the accuracy of the score corresponding to each target language name audio. When the score corresponding to the target language name audio is lower than the preset score threshold, the target language name audio input by the target user is corrected, so as to ensure that the target user learns the standard target language name audio.

[0035] In an optional implementation of the present application, the audio collection device is further used to collect the target language segmentation process audio input by the target user when segmenting the spare vegetables; and transmit each target language segmentation process audio to the electronic device;

[0036] The electronic device is used to recognize the audio of each target language segmentation process, determine the score corresponding to each target language segmentation process audio; and when the score corresponding to the target language segmentation process audio is lower than a preset score threshold, correct the target language segmentation process audio input by the target user.

[0037] The multilingual cooking professional terminology practical learning system provided in the embodiment of the present application, the audio collection device collects the target language segmentation process audio input by the target user when slicing the spare vegetables; and transmits each target language segmentation process audio to the electronic device, so that the electronic device can receive the target language segmentation process audio input by the target user. The electronic device recognizes each target language segmentation process audio, determines the score corresponding to each target language segmentation process audio, and ensures the accuracy of the score corresponding to the determined target language segmentation process audio. When the score corresponding to the target language segmentation process audio is lower than the preset score threshold, the target language segmentation process audio input by the target user is corrected, so that the target user can learn the standard target language segmentation process audio.

[0038] In an optional embodiment of the present application, the cooking action includes a plurality of test sub-cooking steps; wherein:

[0039] The electronic device is used to identify each test sub-cooking step, compare each test sub-cooking step with a target sub-cooking step corresponding to a target recipe, and determine a score corresponding to each test sub-cooking step based on the comparison result.

[0040] The multilingual cooking professional terminology practical learning system provided in the embodiment of the present application, the electronic device identifies each test sub-cooking step, compares each test sub-cooking step with the target sub-cooking step corresponding to the target recipe, and determines the score corresponding to each test sub-cooking step based on the comparison result, thereby ensuring the accuracy of the scores corresponding to each test sub-cooking step.

[0041] In an optional embodiment of the present application, the audio collection device is further used to collect the target language cooking process audio input by the target user when performing each test sub-cooking step; and transmit each target language cooking process audio to the electronic device;

[0042] The electronic device is used to recognize the audio of the cooking process in each target language, determine the score corresponding to the audio of the cooking process in each target language; and when the score corresponding to the audio of the cooking process in the target language is lower than a preset score threshold, correct the audio of the cooking process in the target language input by the target user.

[0043] In the multilingual cooking professional terminology practical learning system provided by the embodiment of the present application, the audio collection device collects the target language cooking process audio input by the target user when executing each test sub-cooking step; and transmits each target language cooking process audio to the electronic device. The electronic device recognizes each target language cooking process audio, determines the score corresponding to each target language cooking process audio, and ensures the accuracy of the score corresponding to each target language cooking process audio. When the score corresponding to the target language cooking process audio is lower than the preset score threshold, the target language cooking process audio input by the target user is corrected, thereby ensuring that the target user can learn the standard target language cooking process audio. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] In order to more clearly illustrate the specific implementation methods of the present invention or the technical solutions in the prior art, the drawings required for use in the specific implementation methods or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some implementation methods of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0045] Figure 1 is a schematic diagram of the structure of a multilingual cooking professional terminology practical learning system according to an embodiment of the present invention;

[0046] Figure 2 It is a schematic diagram of the hardware structure of the electronic device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0047] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.

[0048] The present application embodiment provides a multilingual cooking professional terminology practical learning system, such as Figure 1 As shown, the multilingual cooking professional terminology practical learning system includes: an audio collection device, a camera device and an electronic device, wherein the audio collection device and the camera device are both communicatively connected with the electronic device, wherein:

[0049] An audio collection device, used for receiving the target language audio to be tested input by the target user, and transmitting the target language audio to be tested to the electronic device;

[0050] An electronic device, used for recognizing the target language audio to be tested, determining the cooking process corresponding to the target language audio to be tested, and scoring the target language audio to be tested;

[0051] A camera device, used to shoot the target user when the target user performs a test action corresponding to the cooking process, generate a cooking process video corresponding to the target user, and transmit the cooking process video to the electronic device;

[0052] An electronic device is used to recognize a cooking process video, determine a test action corresponding to a target user, and determine a score corresponding to the test action based on the content to be tested.

[0053] Specifically, the audio collecting device may first receive the target language audio to be tested input by the target user, and then, based on the communication connection with the electronic device, transmit the received target language audio to be tested to the electronic device.

[0054] The target language may be English, French, Chinese, or Russian, etc. The embodiment of the present application does not specifically limit the target language.

[0055] The electronic device can recognize the target language audio to be tested, and then, based on the recognition result, determine the test content corresponding to the target language audio to be tested, and score the target language audio to be tested.

[0056] The camera device can shoot the target user when the target user performs the test action corresponding to the cooking process, and generate a cooking process video corresponding to the target user. Then, the camera device can transmit the cooking process video to the electronic device based on the communication connection between the camera device and the electronic device.

[0057] The electronic device can recognize the cooking process video and determine the test action corresponding to the target user. Then, the electronic device scores the test action based on the standard action corresponding to the content to be tested.

[0058] The multilingual cooking professional terminology practical learning system provided by the embodiment of the present application, the audio collection device receives the target language audio to be tested input by the target user, and transmits the target language audio to be tested to the electronic device. The electronic device is used to identify the target language audio to be tested, determine the cooking process corresponding to the target language audio to be tested, and score the target language audio to be tested, so that the accuracy of the target language audio to be tested input by the target user can be detected, which helps to improve the target language level of the target user. When the target user performs the test action corresponding to the cooking process, the camera device shoots the target user, generates a cooking process video corresponding to the target user, and transmits the cooking process video to the electronic device. The electronic device identifies the cooking process video, determines the test action corresponding to the target user, and determines the score corresponding to the test action based on the content to be tested. Thus, the test action of the target user when completing the cooking process can be detected. The cooking professional terminology corresponding to the target language is combined with the cooking process. While detecting the test action of the target user when completing the cooking process, the target language level of the target user is detected, and cooking is combined with multilingual learning.

[0059] In an optional implementation of the present application, the target language audio to be tested includes a target language recipe audio to be tested; wherein:

[0060] An electronic device is used to determine a target recipe corresponding to a recipe audio in a target language to be tested based on a target audio recognition model.

[0061] Specifically, the electronic device can input the target language recipe audio to be tested into the target audio recognition model, and the target audio recognition model recognizes the target language recipe audio to be tested, and determines the target recipe according to the recognition result.

[0062] Among them, the target audio recognition model can be a supervised learning model in the machine learning model or a semi-supervised learning model, wherein the supervised learning model can be DNN (Deep Neural Networks), CNN (Convolutional Neural Networks), RNN (Recurrent Neural Network), etc. When the target audio recognition model is CNN, it can be a V-Net model, U-Net model, Generative Adversarial Nets model, etc. The semi-supervised learning model can be self-training (self-training algorithm), generative models (generative probability model), SVMs (semi-supervised support vector machines), graph-based methods (graph-based methods), multiview learning (multi-view algorithm), etc. The embodiment of the present application does not specifically limit the type of the target audio recognition model.

[0063] The electronic device is also used to determine a cooking process corresponding to the target recipe based on the target recipe.

[0064] Specifically, the electronic device may query the cooking process corresponding to the target recipe according to the corresponding relationship between the menu and the cooking process.

[0065] In an optional implementation of the present application, the electronic device is used to input the target language recipe audio to be tested into the target audio recognition model, the target audio recognition model recognizes the target language recipe audio to be tested, and outputs a backup recipe corresponding to the target language recipe audio to be tested;

[0066] Outputting alternate recipes to target users;

[0067] Receive the answer input by the target user;

[0068] If the answer is yes, the backup recipe is determined as the target recipe.

[0069] Specifically, the electronic device can input the target language recipe audio to be tested into the target audio recognition model, and the target audio recognition model recognizes the target language recipe audio to be tested and outputs the backup recipe corresponding to the target language recipe audio to be tested. Then, the electronic device can output the backup recipe.

[0070] Optionally, the electronic device can input the backup recipe into a display component corresponding to the electronic device, and output the backup recipe to the target user based on the display component. Then, the target user can input the answer by touching the display component or by using a mouse or the like. The answer can be "yes" or "no". Thus, the electronic device can receive the answer input by the target user. If the answer is yes, the electronic device determines the backup recipe as the target recipe. Optionally, if the answer is no, the electronic device can receive the correct answer input by the target user, and determine the correct answer as the target recipe.

[0071] Optionally, the electronic device can also input the backup recipe into the audio playback component corresponding to the electronic device, and play the audio corresponding to the backup recipe based on the audio playback component. Then, the target user can input the answer by voice. Among them, the answer can be "yes" or "no". Thus, the electronic device can receive the answer input by the target user. If the answer is yes, the electronic device determines the backup recipe as the target recipe. Optionally, if the answer is no, the electronic device can receive the correct answer input by the target user, and determine the correct answer as the target recipe.

[0072] In the multilingual cooking professional terminology practical learning system provided by the embodiment of the present application, the electronic device inputs the target language recipe audio to be tested into the target audio recognition model, the target audio recognition model recognizes the target language recipe audio to be tested, and outputs the backup recipe corresponding to the target language recipe audio to be tested, thereby ensuring the accuracy of the backup recipe corresponding to the output target language recipe. The backup recipe is output to the target user, so that the target user can verify the backup recipe. The answer input by the target user is received; if the answer is yes, the backup recipe is determined as the target recipe, thereby ensuring the accuracy of the determined target recipe.

[0073] In an optional implementation of the present application, the target language audio to be tested is a target language recipe audio to be tested, and the electronic device is further used to obtain a preset target language recipe audio corresponding to the target language recipe audio to be tested, calculate the similarity between the target language recipe audio to be tested and the preset target language recipe audio, and score the target language recipe audio to be tested based on the similarity; and when the score corresponding to the target language recipe audio to be tested is lower than a preset score threshold, correct the target language recipe audio to be tested input by the target user.

[0074] Specifically, the electronic device can receive the preset target language recipe audio corresponding to the target language recipe audio to be tested input by the target user, and can also receive the preset target language recipe audio corresponding to the target language recipe audio to be tested sent by other devices. The electronic device can also determine the preset target language recipe audio corresponding to the cooking process based on the cooking process corresponding to the target language audio to be tested. The embodiment of the present application does not specifically limit the manner in which the electronic device obtains the preset target language recipe audio. Among them, the preset target language recipe audio can be audio in a professional vocabulary library.

[0075] Then, the electronic device can calculate the similarity between the target language recipe audio to be tested and the preset target language recipe audio. Then, the target language recipe audio to be tested is scored according to the similarity between the target language recipe audio to be tested and the preset target language recipe audio. The similarity between the target language recipe audio to be tested and the preset target language recipe audio is proportional to the score corresponding to the target language recipe audio to be tested.

[0076] Exemplarily, the electronic device may determine the similarity between the target language recipe audio to be tested and the preset target language recipe audio as the score corresponding to the target language recipe audio to be tested, or may multiply the similarity between the target language recipe audio to be tested and the preset target language recipe audio by a preset weight to determine the score corresponding to the target language recipe audio to be tested.

[0077] Then, the electronic device may receive the preset score threshold input by the target user, or may receive the preset score threshold sent by other devices. The embodiment of the present application does not specifically limit the manner in which the electronic device obtains the preset score threshold.

[0078] When the electronic device compares the score corresponding to the target language recipe audio to be tested with the preset score threshold, when the score corresponding to the target language recipe audio to be tested is lower than the preset score threshold, the electronic device outputs the preset target language recipe audio to the target user, thereby correcting the target language recipe audio to be tested input by the target user.

[0079] The preset target language recipe audio may be a standard audio corresponding to the target language recipe.

[0080] In the multilingual cooking professional terminology practical learning system provided by the embodiment of the present application, the electronic device obtains the preset target language recipe audio corresponding to the target language recipe audio to be tested, calculates the similarity between the target language recipe audio to be tested and the preset target language recipe audio, thereby ensuring the accuracy of the calculated similarity between the target language recipe audio to be tested and the preset target language recipe audio. Based on the similarity, the target language recipe audio to be tested is scored, thereby ensuring the accuracy of the scoring of the target language recipe audio to be tested. When the score corresponding to the target language recipe audio to be tested is lower than the preset scoring threshold, the target language recipe audio to be tested input by the target user is corrected, thereby ensuring that the target user learns the standard target language audio.

[0081] In an optional implementation of the present application, the test action includes a food preparation action and a cooking action; wherein:

[0082] An electronic device, used for identifying the cooking process video, and dividing the cooking process video into a food preparation video and a cooking video according to the identification result;

[0083] Identify the food preparation video, determine the food preparation actions corresponding to the target user, and determine the scores corresponding to the food preparation actions;

[0084] Identify cooking videos, determine the cooking actions corresponding to the target users, and determine the scores corresponding to the cooking actions.

[0085] Specifically, the electronic device can input the cooking process video into the first video recognition model, and the first video recognition model recognizes the cooking process video, and divides the cooking process video into a food preparation video and a cooking video according to the recognition result.

[0086] Then, the electronic device can input the meal preparation video into the meal preparation recognition model, and the meal preparation recognition model recognizes the meal preparation video and determines the meal preparation action of the target user. Then, the meal preparation action of the target user is compared with the standard meal preparation action, and the score corresponding to the meal preparation action is determined according to the comparison result.

[0087] In addition, the electronic device can also input the cooking video into the cooking recognition model, which recognizes the cooking video and determines the cooking action of the target user. The cooking action of the target user is then compared with the standard cooking action, and the score corresponding to the cooking action is determined based on the comparison result.

[0088] In an optional embodiment of the present application, the vegetable preparation action includes a vegetable preparation action and a vegetable cutting action; wherein:

[0089] The electronic device is used to identify the action of preparing vegetables, determine the types of spare vegetables prepared by the target user, and compare the types of spare vegetables with the types of target vegetables corresponding to the target recipe; and determine a score corresponding to the action of preparing vegetables according to the comparison result;

[0090] The electronic device is used to identify the action of cutting vegetables, determine the cutting shape of each spare vegetable after the target user cuts it; compare the cutting shape of each spare vegetable with the target shape corresponding to the spare recipe; and determine the score corresponding to the action of cutting vegetables based on the comparison result.

[0091] Specifically, the electronic device can input the food preparation video into the food preparation recognition model, and the food preparation recognition model recognizes the food preparation video and determines the food preparation action of the target user. Then, the electronic device recognizes the food preparation action of the target user and determines the vegetable preparation action and the vegetable cutting action.

[0092] The electronic device identifies the vegetable preparation action to determine the type of spare vegetables prepared by the target user. The electronic device compares the type of spare vegetables with the type of target vegetables corresponding to the target recipe; and determines the score corresponding to the vegetable preparation action based on the comparison result.

[0093] Exemplarily, if the types of spare vegetables are all consistent with the types of target vegetables corresponding to the target recipe, the score corresponding to the action of preparing vegetables is determined to be 100 points; if there are types of spare vegetables that are inconsistent with the types of target vegetables corresponding to the target recipe, the number of types of spare vegetables that are inconsistent with the types of target vegetables is determined, and the score corresponding to the action of preparing vegetables is determined based on the number of types of spare vegetables that are inconsistent with the types of target vegetables.

[0094] In addition, the electronic device recognizes the action of cutting vegetables and determines the cut shapes of each of the standby vegetables after the target user cuts them. The electronic device can obtain the target shapes corresponding to each of the standby recipes, and then compare the cut shapes of each of the standby vegetables with the target shapes corresponding to the standby recipes; and determine the score corresponding to the action of cutting vegetables based on the comparison result.

[0095] Exemplarily, if the cut shapes of the spare vegetables are all consistent with the target shapes corresponding to the spare recipes, the score corresponding to the vegetable cutting action is determined to be 100 points; if there are spare vegetables whose cut shapes are inconsistent with the target shapes corresponding to the spare recipes, the number of types of spare vegetables that are inconsistent with the target shapes is determined, and the score corresponding to the vegetable cutting action is determined based on the number of types of spare vegetables that are inconsistent with the target shapes.

[0096] Then, the electronic device may determine the score of the vegetable preparation action according to the score corresponding to the vegetable preparation action and the score corresponding to the vegetable cutting action.

[0097] Optionally, the electronic device may calculate an average of the scores corresponding to the action of preparing vegetables and the scores corresponding to the action of cutting vegetables, and determine the calculated average as the score of the action of preparing vegetables.

[0098] Optionally, the electronic device may multiply the score corresponding to the action of preparing vegetables and the score corresponding to the action of cutting vegetables by corresponding weight values ​​respectively, and then add the results together, and determine the calculated sum as the score of the action of preparing vegetables.

[0099] The multilingual cooking professional terminology practical learning system and electronic device provided in the embodiment of the present application are used to identify cooking process videos, thereby ensuring the accuracy of the obtained recognition results. According to the recognition results, the cooking process videos are divided into food preparation videos and cooking videos; the accuracy of the division into food preparation videos and cooking videos is ensured. The food preparation videos are identified, and the food preparation actions corresponding to the target users are determined, thereby ensuring the accuracy of the food preparation actions corresponding to the determined target users. The scores corresponding to the food preparation actions are determined, thereby ensuring the accuracy of the scores corresponding to the determined food preparation actions. The cooking videos are identified, and the cooking actions corresponding to the target users are determined, thereby ensuring the accuracy of the cooking actions corresponding to the determined target users. The scores corresponding to the cooking actions are determined, thereby ensuring the accuracy of the scores corresponding to the determined cooking actions.

[0100] Then, the electronic device identifies the action of preparing vegetables, determines the types of spare vegetables prepared by the target user, and ensures the accuracy of the types of spare vegetables prepared by the determined target user. The types of spare vegetables are compared with the types of target vegetables corresponding to the target recipe; based on the comparison results, the score corresponding to the action of preparing vegetables is determined, and the accuracy of the score corresponding to the determined action of preparing vegetables is ensured. The electronic device identifies the action of cutting vegetables, determines the cutting shape of each spare vegetable after the target user cuts it, and ensures the accuracy of the cutting shape of each spare vegetable after the determined target user cuts it. The cutting shape of each spare vegetable is compared with the target shape corresponding to the spare recipe; based on the comparison results, the score corresponding to the action of cutting vegetables is determined, and the accuracy of the score corresponding to the determined action of cutting vegetables is ensured.

[0101] In an optional embodiment of the present application, the audio collection device is further used to collect the target language name audio corresponding to each spare vegetable input by the target user when preparing the spare vegetables; and transmit the target language name audio to the electronic device;

[0102] The electronic device is used to recognize the audio of each target language name and determine the score corresponding to each target language name audio; and when the score corresponding to the target language name audio is lower than a preset score threshold, correct the target language name audio input by the target user.

[0103] Specifically, the audio collection device can collect the target language name audio corresponding to each spare vegetable input by the target user when preparing the spare vegetables; and transmit the target language name audio to the electronic device.

[0104] The electronic device can calculate the similarity between the target language name audio corresponding to each spare vegetable input by the target user and the corresponding standard target language name audio. Then, according to the similarity between the target language name audio corresponding to each spare vegetable and the corresponding standard target language name audio, determine the score corresponding to the target language name audio corresponding to each spare vegetable. The standard target language name audio can be an audio in a professional vocabulary library.

[0105] Then, the electronic device compares the score corresponding to the target language name audio corresponding to each spare vegetable with the preset score threshold. When the score corresponding to the target language name audio is lower than the preset score threshold, the electronic device outputs the standard target language name audio corresponding to the spare vegetable to the target user, thereby correcting the target language name audio input by the target user.

[0106] In the multilingual cooking professional terminology practical learning system provided by the embodiment of the present application, the audio collection device collects the target language name audio corresponding to each spare vegetable input by the target user when preparing the spare vegetables; and transmits each target language name audio to the electronic device. The electronic device recognizes each target language name audio, determines the score corresponding to each target language name audio, and ensures the accuracy of the score corresponding to each target language name audio. When the score corresponding to the target language name audio is lower than the preset score threshold, the target language name audio input by the target user is corrected, so as to ensure that the target user learns the standard target language name audio.

[0107] In an optional implementation of the present application, the audio collection device is further used to collect the target language segmentation process audio input by the target user when segmenting the spare vegetables; and transmit each target language segmentation process audio to the electronic device;

[0108] The electronic device is used to recognize the audio of each target language segmentation process, determine the score corresponding to each target language segmentation process audio; and when the score corresponding to the target language segmentation process audio is lower than a preset score threshold, correct the target language segmentation process audio input by the target user.

[0109] Specifically, the audio collection device can collect the target language segmentation process audio input by the target user when slicing the spare vegetables; and transmit each target language segmentation process audio to the electronic device.

[0110] The electronic device can calculate the similarity between each target language segmentation process audio and the corresponding standard target language segmentation process audio. Then, according to the similarity between each target language segmentation process audio and the corresponding standard target language segmentation process audio, determine the score corresponding to each target language segmentation process audio. Among them, the standard target language segmentation process audio can be an audio in a professional vocabulary library.

[0111] Then, when the score corresponding to the target language segmentation process audio is lower than a preset score threshold, the target language segmentation process audio input by the target user is corrected.

[0112] The multilingual cooking professional terminology practical learning system provided in the embodiment of the present application, the audio collection device collects the target language segmentation process audio input by the target user when slicing the spare vegetables; and transmits each target language segmentation process audio to the electronic device, so that the electronic device can receive the target language segmentation process audio input by the target user. The electronic device recognizes each target language segmentation process audio, determines the score corresponding to each target language segmentation process audio, and ensures the accuracy of the score corresponding to the determined target language segmentation process audio. When the score corresponding to the target language segmentation process audio is lower than the preset score threshold, the target language segmentation process audio input by the target user is corrected, so that the target user can learn the standard target language segmentation process audio.

[0113] In an optional embodiment of the present application, the cooking action includes a plurality of test sub-cooking steps; wherein:

[0114] The electronic device is used to identify each test sub-cooking step, compare each test sub-cooking step with a target sub-cooking step corresponding to a target recipe, and determine a score corresponding to each test sub-cooking step based on the comparison result.

[0115] Specifically, the electronic device may input the cooking action into a cooking action recognition model, recognize the cooking action based on the cooking action recognition model, and divide the cooking action into a plurality of test sub-cooking steps according to the recognition result.

[0116] Exemplarily, the test sub-cooking step may include adding spare vegetables, stir-frying the spare vegetables, adding seasonings, etc. The embodiment of the present application does not specifically limit the test sub-cooking step.

[0117] Specifically, the electronic device may compare each test sub-cooking step with the target sub-cooking step corresponding to the target recipe, and determine the score corresponding to each test sub-cooking step according to the comparison result.

[0118] Then, the electronic device may calculate the score corresponding to the cooking action according to the score corresponding to each test sub-cooking step.

[0119] Optionally, the electronic device may calculate an average value of the scores corresponding to each test sub-cooking step, and determine the calculated average value as the score corresponding to the cooking action.

[0120] Optionally, the electronic device may obtain weight information corresponding to each test sub-cooking step, and then multiply the score corresponding to each test sub-cooking step by the corresponding weight information, add the results, and calculate the score corresponding to the cooking action.

[0121] The multilingual cooking professional terminology practical learning system provided in the embodiment of the present application, the electronic device identifies each test sub-cooking step, compares each test sub-cooking step with the target sub-cooking step corresponding to the target recipe, and determines the score corresponding to each test sub-cooking step based on the comparison result, thereby ensuring the accuracy of the scores corresponding to each test sub-cooking step.

[0122] In an optional embodiment of the present application, the audio collection device is further used to collect the target language cooking process audio input by the target user when performing each test sub-cooking step; and transmit each target language cooking process audio to the electronic device;

[0123] The electronic device is used to recognize the audio of the cooking process in each target language, determine the score corresponding to the audio of the cooking process in each target language; and when the score corresponding to the audio of the cooking process in the target language is lower than a preset score threshold, correct the audio of the cooking process in the target language input by the target user.

[0124] Specifically, the audio collection device can collect the target language cooking process audio input by the target user when performing each test sub-cooking step; and transmit each target language cooking process audio to the electronic device.

[0125] The electronic device can calculate the similarity between the target language cooking process audio input by the target user when executing each test sub-cooking step and the corresponding standard target language cooking process audio. Then, according to the similarity between the target language cooking process audio corresponding to each test sub-cooking step and the corresponding standard target language cooking process audio, the score corresponding to the target language cooking process audio corresponding to each test sub-cooking step is determined. Among them, the standard target language cooking process audio can be an audio in a professional vocabulary library.

[0126] Then, the electronic device compares the score corresponding to each target language cooking process audio with the preset score threshold. When the score corresponding to the target language cooking process audio is lower than the preset score threshold, the electronic device outputs the standard target language cooking process audio corresponding to each test sub-cooking step to the target user, thereby correcting the target language name audio input by the target user.

[0127] In the multilingual cooking professional terminology practical learning system provided by the embodiment of the present application, the audio collection device collects the target language cooking process audio input by the target user when executing each test sub-cooking step; and transmits each target language cooking process audio to the electronic device. The electronic device recognizes each target language cooking process audio, determines the score corresponding to each target language cooking process audio, and ensures the accuracy of the score corresponding to each target language cooking process audio. When the score corresponding to the target language cooking process audio is lower than the preset score threshold, the target language cooking process audio input by the target user is corrected, thereby ensuring that the target user can learn the standard target language cooking process audio.

[0128] See also Figure 2 , Figure 2 is a schematic diagram of the structure of an electronic device provided by an optional embodiment of the present invention, such as Figure 2 As shown, the electronic device includes: one or more processors 10, a memory 20, and interfaces for connecting various components, including high-speed interfaces and low-speed interfaces. The various components are connected to each other using different buses for communication, and can be installed on a common mainboard or installed in other ways as needed. The processor can process instructions executed in the electronic device, including instructions stored in or on the memory to display graphical information of the GUI on an external input / output device (such as a display device coupled to the interface). In some optional embodiments, if necessary, multiple processors and / or multiple buses can be used together with multiple memories and multiple memories. Similarly, multiple electronic devices can be connected, and each device provides some necessary operations (for example, as a server array, a group of blade servers, or a multi-processor system). Figure 2 A processor 10 is taken as an example.

[0129] The processor 10 may be a central processing unit, a network processor or a combination thereof. The processor 10 may further include a hardware chip. The hardware chip may be a dedicated integrated circuit, a programmable logic device or a combination thereof. The programmable logic device may be a complex programmable logic device, a field programmable gate array, a general purpose array logic or any combination thereof.

[0130] The memory 20 stores instructions executable by at least one processor 10, so that at least one processor 10 executes the method shown in the above embodiment.

[0131] The memory 20 may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function; the data storage area may store data created by the use of an electronic device based on the presentation of a small program landing page, etc. In addition, the memory 20 may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some optional embodiments, the memory 20 may optionally include a memory remotely arranged relative to the processor 10, and these remote memories may be connected to the electronic device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0132] The memory 20 may include a volatile memory, such as a random access memory; the memory may also include a non-volatile memory, such as a flash memory, a hard disk or a solid state drive; the memory 20 may also include a combination of the above types of memory.

[0133] The electronic device further comprises a communication interface 30 for the electronic device to communicate with other devices or a communication network.

[0134] The embodiment of the present invention also provides a computer-readable storage medium. The method executed in the electronic device according to the embodiment of the present invention can be implemented in hardware, firmware, or can be implemented as a computer code that can be recorded in a storage medium, or can be downloaded through a network and originally stored in a remote storage medium or a non-temporary machine-readable storage medium and will be stored in a local storage medium, so that the method described herein can be stored in such software processing on a storage medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware. Among them, the storage medium can be a magnetic disk, an optical disk, a read-only storage memory, a random access memory, a flash memory, a hard disk or a solid-state hard disk, etc.; further, the storage medium can also include a combination of the above types of memories. It can be understood that a computer, a processor, a microprocessor controller or programmable hardware includes a storage component that can store or receive software or computer code. When the software or computer code is accessed and executed by a computer, a processor or hardware, the method shown in the above embodiment is implemented.

[0135] Although the embodiments of the present invention have been described in conjunction with the accompanying drawings, those skilled in the art may make various modifications and variations without departing from the spirit and scope of the present invention, and such modifications and variations are all within the scope defined by the appended claims.

Claims

1. A multilingual cooking terminology practical learning system, characterized by: The multilingual cooking professional terminology practical learning system comprises: an audio collection device, a camera device and an electronic device, wherein the audio collection device and the camera device are both communicatively connected to the electronic device, wherein: The audio collection device is used to receive the target language audio to be tested input by the target user, and transmit the target language audio to be tested to the electronic device; The electronic device is used to recognize the target language audio to be tested, determine the cooking process corresponding to the target language audio to be tested, and score the target language audio to be tested; The camera device is used to shoot the target user when the target user performs the test action corresponding to the cooking process, generate a cooking process video corresponding to the target user, and transmit the cooking process video to the electronic device; The electronic device is used to identify the cooking process video, determine the test action corresponding to the target user, and determine the score corresponding to the test action based on the test action.

2. The multilingual cooking terminology practical learning system according to claim 1, characterized in that: The target language audio to be tested includes a recipe audio in the target language to be tested; wherein: The electronic device is used to determine the target recipe corresponding to the target language recipe audio to be tested based on the target audio recognition model; The electronic device is further used to determine the cooking process corresponding to the target recipe based on the target recipe.

3. The multilingual cooking terminology practical learning system according to claim 2, characterized in that: The electronic device is used to input the target language recipe audio to be tested into the target audio recognition model, and the target audio recognition model recognizes the target language recipe audio to be tested and outputs a backup recipe corresponding to the target language recipe audio to be tested; Outputting the backup recipe to the target user; receiving an answer input by the target user; If the answer is yes, the backup recipe is determined as the target recipe.

4. The multilingual cooking professional terminology practical learning system according to any one of claims 1 to 3, characterized in that: The target language audio to be tested is a target language recipe audio to be tested, and the electronic device is further used to obtain a preset target language recipe audio corresponding to the target language recipe audio to be tested, calculate the similarity between the target language recipe audio to be tested and the preset target language recipe audio, and score the target language recipe audio to be tested based on the similarity; When the score corresponding to the target language recipe audio to be tested is lower than a preset score threshold, the target language recipe audio to be tested input by the target user is corrected.

5. The multilingual cooking terminology practical learning system according to claim 2, characterized in that: The test actions include food preparation actions and cooking actions; wherein: The electronic device is used to identify the cooking process video and divide the cooking process video into a food preparation video and a cooking video according to the identification result; Identify the food preparation video, determine the food preparation action corresponding to the target user, and determine the score corresponding to the food preparation action; The cooking video is identified, a cooking action corresponding to the target user is determined, and a score corresponding to the cooking action is determined.

6. The multilingual cooking terminology practical learning system according to claim 5, characterized in that: The vegetable preparation action includes vegetable preparation action and vegetable cutting action; wherein: The electronic device is used to identify the vegetable preparation action, determine the type of the spare vegetables prepared by the target user, compare the type of the spare vegetables with the type of the target vegetables corresponding to the target recipe; and determine the score corresponding to the vegetable preparation action according to the comparison result; The electronic device is used to identify the vegetable cutting action, determine the cutting shape of each of the spare vegetables after being cut by the target user; compare the cutting shape of each of the spare vegetables with the target shape corresponding to the spare recipe; and determine the score corresponding to the vegetable cutting action based on the comparison result.

7. The multilingual cooking terminology practical learning system according to claim 6, characterized in that: The audio collection device is further used to collect the target language name audio corresponding to each of the spare vegetables input by the target user when preparing the spare vegetables; and transmitting the audio of each target language name to the electronic device; The electronic device is used to recognize each target language name audio, determine the score corresponding to each target language name audio; and when the score corresponding to the target language name audio is lower than a preset score threshold, correct the target language name audio input by the target user.

8. The multilingual cooking terminology practical learning system according to claim 6, characterized in that: The audio collection device is further used to collect the target language segmentation process audio input by the target user when slicing the spare vegetables; and transmit each target language segmentation process audio to the electronic device; The electronic device is used to recognize the audio of each target language segmentation process and determine the score corresponding to each target language segmentation process audio; and when the score corresponding to the target language segmentation process audio is lower than a preset score threshold, correct the target language segmentation process audio input by the target user.

9. The multilingual cooking terminology practical learning system according to claim 5, characterized in that: The cooking action includes a plurality of test sub-cooking steps; wherein: The electronic device is used to identify each of the test sub-cooking steps, compare each of the test sub-cooking steps with the target sub-cooking steps corresponding to the target recipe, and determine the score corresponding to each of the test sub-cooking steps according to the comparison result.

10. The multilingual cooking terminology practical learning system according to claim 9, characterized in that: The audio collection device is further used to collect the target language cooking process audio input by the target user when performing each of the test sub-cooking steps; and transmit each of the target language cooking process audio to the electronic device; The electronic device is used to recognize each target language cooking process audio, determine the score corresponding to each target language cooking process audio; and when the score corresponding to the target language cooking process audio is lower than a preset score threshold, correct the target language cooking process audio input by the target user.

Images