Control method and device of intelligent cooking machine, electronic equipment and storage medium

Abstract

The invention relates to the technical field of intelligent cooking, and discloses a control method of an intelligent cooking machine, and the method comprises the steps: responding to an information collection operation, and collecting sound information and image information of a current environment; determining character attribute information in the current environment according to the sound information and the image information; obtaining a menu cooking process; and according to the character attribute information and the menu cooking process, determining a cooking function permission in the cooking process, and according to the menu cooking process and the cooking function permission, controlling the intelligent cooking machine. According to the method, the cooking function authority is determined under the limitation of the character attribute information and the menu cooking process, so that the automatic cooking function of the intelligent cooking machine is limited, the occurrence probability of safety accidents is reduced in the cooking process of the intelligent cooking machine, and the safety of the intelligent cooking machine during use is improved.

Description

Technical Field

[0001] The present application relates to the field of intelligent cooking technology, and in particular to a control method, device and storage medium for an intelligent cooking machine. Background Art

[0002] With the development of technology, smart cooking machines have gradually entered the kitchen and become a part of the kitchen, providing great convenience for people's daily lives.

[0003] However, in actual use, there are still some people with poor learning and comprehension abilities who do not know how to use or use the smart cooking machine incorrectly, such as the elderly and children. As a result, these people are prone to safety accidents due to improper operation (such as not knowing how to turn off the smart cooking machine) when using the smart cooking machine, which in turn leads to lower safety performance of the smart cooking machine. Summary of the invention

[0004] The present application proposes a control method, device, electronic device and storage medium of an intelligent cooking machine, which improve the safety of the intelligent cooking machine when in use during the cooking process of the intelligent cooking machine.

[0005] In a first aspect, a control method for an intelligent cooking machine is provided, the method comprising:

[0006] In response to the information collection operation, collecting sound information and image information of the current environment;

[0007] Determining the character attribute information in the current environment according to the sound information and the image information;

[0008] Get the menu cooking process;

[0009] The cooking function authority in the cooking process is determined according to the character attribute information and the menu cooking process, and the intelligent cooking machine is controlled according to the menu cooking process and the cooking function authority.

[0010] In a second aspect, a control device for an intelligent cooking machine is provided, the device comprising:

[0011] An information collection module, used to collect sound information and image information of the current environment in response to the information collection operation;

[0012] An information determination module, used to determine the character attribute information in the current environment according to the sound information and the image information;

[0013] Process acquisition module, used to obtain menu cooking process;

[0014] The control module is used to determine the cooking function authority during the cooking process according to the character attribute information and the menu cooking process, and control the intelligent cooking machine according to the menu cooking process and the cooking function authority.

[0015] Optionally, in some embodiments of the present application, the control module includes:

[0016] an age determination unit, used to determine the number of characters and the estimated age of each character according to the sound information;

[0017] A behavior characteristic information determination unit, used to perform a characteristic analysis on the image information to determine the behavior characteristic information of each character;

[0018] The character attribute information determination unit is used to use the number of characters, the estimated age and the behavior characteristic information as the character attribute information.

[0019] Optionally, in some embodiments of the present application, the age determination unit includes:

[0020] A speech recognition subunit, used to perform speech recognition on the sound information to obtain the dialogue text content corresponding to the sound information;

[0021] A spectrum analysis subunit, configured to perform spectrum analysis on the sound information to determine a sound spectrum corresponding to the sound information;

[0022] The age determination subunit is used to determine the number of characters and the estimated age of each character according to the content of the dialogue text and the sound spectrum.

[0023] Optionally, in some embodiments of the present application, the control module includes:

[0024] A judgment unit, used for determining whether there are only preset objects in the current environment according to the character attribute information;

[0025] A cooking operation information extraction unit, configured to extract cooking operation information from a menu cooking process if it is determined that only the preset object exists in the current environment;

[0026] The permission determination unit is used to determine the cooking function permission according to the cooking operation information.

[0027] Optionally, in some embodiments of the present application, the control module includes:

[0028] An information extraction unit, used to extract cooking time nodes and text information corresponding to each cooking time node from the menu cooking process;

[0029] A cooking process step generating unit, used for generating a cooking process step according to the cooking time node, the text information and the cooking function authority;

[0030] A control unit is used to control the intelligent cooking machine according to the cooking process.

[0031] Optionally, in some embodiments of the present application, the control unit includes:

[0032] A cooking time node determination subunit, used to determine the current cooking time period according to the current time and the cooking process step;

[0033] The authority determination subunit is used to control the intelligent cooking machine according to the cooking function authority corresponding to the cooking time period.

[0034] Optionally, in some embodiments of the present application, a monitoring module is further included, and the monitoring module is specifically used to:

[0035] Monitoring the control process of the intelligent cooking machine;

[0036] If an abnormal situation is detected during the control process of the intelligent cooking machine, an abnormal reminder message is sent to the associated device.

[0037] In a third aspect, an electronic device is provided, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the control method of the above-mentioned intelligent cooking machine when executing the computer program.

[0038] In a fourth aspect, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the control method of the above-mentioned intelligent cooking machine are implemented.

[0039] As described above, the present application provides a control method, device, electronic device and storage medium for an intelligent cooking machine, which collects sound information and image information of the current environment in response to an information collection operation; determines the character attribute information in the current environment based on the sound information and image information; obtains the menu cooking process; determines the cooking function authority in the cooking process based on the character attribute information and the menu cooking process, and controls the intelligent cooking machine based on the menu cooking process and the cooking function authority. In the control scheme of the intelligent cooking machine provided in the present application, by determining the character attribute information in the current environment, and then determining the cooking function authority under the restriction of the character attribute information and the menu cooking process, the intelligent cooking machine is controlled based on the cooking function authority and the menu cooking process. It can be seen that this scheme can limit the cooking function of the intelligent cooking machine under the restriction of the character attribute information and the menu cooking process, so as to reduce the probability of safety accidents during the cooking process of the intelligent cooking machine and improve the safety of the intelligent cooking machine when in use. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0041] in:

[0042] Figure 1 is an application environment diagram of a control method based on an intelligent cooking machine in one embodiment;

[0043] Figure 2 is a flow chart of a control method based on an intelligent cooking machine in one embodiment;

[0044] Figure 3 A schematic diagram of the structure of a control device based on an intelligent cooking machine in one embodiment

[0045] Figure 4 It is a structural schematic diagram of a control device based on an intelligent cooking machine in another embodiment;

[0046] Figure 5 FIG. 1 is a schematic diagram of the structure of an electronic device in an embodiment. DETAILED DESCRIPTION

[0047] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0048] In the following description, reference is made to “some embodiments”, which describe a subset of all possible embodiments, but it will be understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0049] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein are only for the purpose of describing the embodiments of this application and are not intended to limit this application.

[0050] The present application provides a control method, device, electronic device and storage medium of an intelligent cooking machine.

[0051] The control device of the intelligent cooking machine can be specifically integrated in an electronic device, and the electronic device can be any one of a smart phone, a tablet computer, a laptop computer, a desktop computer or an intelligent cooking machine, but is not limited thereto. The electronic device can be directly or indirectly connected to the server through wired or wireless communication. The server can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms. This application does not limit this.

[0052] For example, see Figure 1 The control device of the intelligent cooking machine is integrated on the intelligent cooking machine 10.

[0053] The smart cooking machine 10 may include a display screen, which can display the automatic cooking function of the smart cooking machine 10. The smart cooking machine 10 responds to the information collection operation to collect sound information and image information of the current environment. The information collection operation can be triggered by the user 20 or automatically triggered within a set time, depending on the actual situation. Then, the smart cooking machine 10 determines the task attribute information in the current environment based on the sound information and image information. Then, the smart cooking machine 10 obtains the menu cooking process. Finally, the smart cooking machine 10 determines the cooking function authority in the cooking process based on the character attribute information and the menu cooking process, and controls the automatic cooking function of the smart cooking machine 10 based on the menu cooking process and the cooking function authority.

[0054] The control method of the smart cooking machine provided in the present application can limit the automatic cooking function of the smart cooking machine under the constraints of character attribute information and menu cooking process, so as to reduce the probability of safety accidents during the cooking process of the smart cooking machine and improve the safety of the smart cooking machine when in use.

[0055] It should be noted that the order of description of the following embodiments is not intended to limit the priority order of the embodiments.

[0056] A control method for an intelligent cooking machine comprises: in response to an information collection operation, collecting sound information and image information of the current environment; determining character attribute information in the current environment based on the sound information and image information; obtaining a menu cooking process; determining cooking function permissions in the cooking process based on the character attribute information and the menu cooking process, and controlling the intelligent cooking machine based on the menu cooking process and the cooking function permissions.

[0057] See also Figure 2 As shown, Figure 2 A flow chart of a control method of an intelligent cooking machine provided in an embodiment of the present application. The specific flow of the control method of the intelligent cooking machine may include the following:

[0058] 101: In response to the information collection operation, collect sound information and image information of the current environment.

[0059] Among them, the information collection operation is used to trigger the smart cooking machine to execute the operation of collecting sound information and image information of the current environment. The information collection operation can be automatically triggered by a preset trigger time, that is, when the smart cooking machine detects that the current time reaches the preset trigger time, it automatically triggers the smart cooking machine to execute the operation of collecting sound information and image information of the current environment; the smart cooking machine can also be triggered to execute the operation of collecting sound information and image information of the current environment by the user interacting with the smart cooking machine. For example, the smart cooking machine can be control-associated with the user's mobile terminal device. When the user believes that the smart cooking machine can be triggered to execute the operation of collecting sound information and image information of the current environment, the virtual trigger button on the smart device is controlled through the mobile terminal device to trigger the smart cooking machine to execute the operation of collecting sound information and image information of the current environment.

[0060] The current environment refers to the whole house environment at the current time, and the current environment may include multiple areas, such as a bedroom, a kitchen, a study, an entertainment room, and a house entrance.

[0061] The sound information may be the sound generated in each area of ​​the current environment within a preset time period. For example, the collection time is preset to 1 minute, the current time is 10:00 a.m. on Wednesday, August 23, 2023, and the preset time period is from 10:00 to 10:01. The current environment includes the bedroom, living room, and kitchen. At this time, the sound information may include the sound of children's cartoons played on TV in the living room during the time period from 10:00 to 10:01, the voices of characters A and B speaking, and the sound of character C singing in the bedroom.

[0062] The image information may be image sequence frames of each area in the current environment within a preset time period. For example, the acquisition time is preset to 1 minute, the current time is 10:00 a.m. on Wednesday, August 23, 2023, and the preset time period is 10:00 to 10:01. The current environment includes a bedroom, a living room, and a kitchen. At this time, the image information may include image sequence frames in the living room, image sequence frames in the bedroom, and image sequence frames in the kitchen during the time period from 10:00 to 10:01.

[0063] Optionally, audio and video stream data can be recorded by smart cameras set in each area of ​​the current environment, the audio and video stream data can be preprocessed to obtain audio stream data and video stream data, sound information can be extracted from the audio stream data, and image information can be extracted from the video stream data.

[0064] 102: Determine the person attribute information in the current environment according to the sound information and the image information.

[0065] Among them, the character attribute information is used to represent the character-related information in the current environment. The character-related information may specifically include the number of characters included in each area in the current environment, the identity, age, and behavioral characteristic information of each character. It should be noted that based on the character's behavioral characteristic information, it can be determined whether the character is a person who can use the smart cooking machine normally. For example, a person who can use the smart cooking machine normally may be a person between the ages of 10 and 55 with healthy limbs. A person who cannot use the smart cooking machine normally may be a child under 10 years old, an elderly person over 55 years old, a disabled person with disabled hands or a disabled person with upper body paralysis, etc.

[0066] Specifically, the sound information and image information can be analyzed by artificial intelligence technology to determine the attribute information of the person in the current environment. Among them, the text content in the sound information can be identified by artificial intelligence technology, and the sound spectrum in the sound information can be extracted, and the number of tasks included in each area, the identity and age of each person can be determined based on the text content and the sound spectrum. The facial features, clothing, behavior posture and body features of the person in the image information can be analyzed by artificial intelligence technology to determine the behavioral feature information.

[0067] 103: Get the menu cooking process.

[0068] The menu cooking process may include a plurality of dishes to be cooked, a cooking recipe for each dish to be cooked, and a cooking order for each dish to be cooked. The menu cooking process may be preset by a user.

[0069] 104: Determine the cooking function authority during the cooking process according to the character attribute information and the menu cooking process, and control the intelligent cooking machine according to the menu cooking process and the cooking function authority.

[0070] Among them, the intelligent cooking machine can include functions such as stir-frying, frying, cooking, deep-frying, blasting, braising, steaming, boiling, baking, stewing, boiling, baking, voice broadcasting, ringtone reminder, cleaning, opening / closing the lid, adjusting temperature, temperature monitoring, water level monitoring, anti-overflow, anti-sticking, anti-dry burning, chopping, grinding, blending, whipping, emulsifying, stirring and kneading. These functions can be displayed on the display screen of the intelligent cooking machine, and can be controlled by the user manually touching the display screen, or can be automatically controlled by the intelligent cooking machine according to the control method in this solution.

[0071] The cooking function permission is used to control the function permission of the intelligent cooking machine during automated cooking. The cooking function permission may include functions that are allowed to be used and functions that are not allowed to be used (ie, disabled).

[0072] Optionally, after determining the character attribute information and the menu cooking process, the character authority level of each character in the current environment can be determined according to the character attribute information (for example, if the character is over 50 years old, is an elderly person, and is determined to have healthy limbs according to the behavioral characteristic information in the character attribute information, and if the character is under 10 years old, is a child, and is determined to have healthy limbs according to the behavioral characteristic information in the character attribute information, then the character authority level of the character is determined to be low; if the character is between 10 and 50 years old, is a middle-aged person, and is determined to have healthy limbs according to the behavioral characteristic information in the character attribute information and is not deaf-mute, then the character authority level of the character is determined to be high; if the character is between 10 and 50 years old, is a middle-aged person, and is determined to have disabled hands according to the behavioral characteristic information in the character attribute information, Then, the person's person authority level is determined to be intermediate); then, the person with the highest person authority level is determined as the target person, and the function usage permission corresponding to the person authority level of the target person is obtained; then, the recommended cooking function corresponding to the menu cooking process is obtained; finally, if the level of function usage permission is low (indicating that the target person will not use the smart cooking machine) or medium (indicating that the target person can use the smart cooking machine, but may not be able to use the smart cooking machine normally due to some special reasons, such as disability of both hands), it is determined as cooking function permission according to the recommended cooking function, that is, the recommended cooking function is allowed to be enabled and other functions are disabled; if the level of function usage permission is high (indicating that the target person can use the smart cooking machine normally), the cooking function of the smart cooking machine is determined as cooking function permission, that is, all functions of the smart cooking machine are allowed to be enabled.

[0073] It should be noted that the target person refers to the person who is responsible for cooking in the current environment. If the current environment includes one person, then the only person is the target person; if the current environment includes at least two people, the target person can be determined by responding to the user's target person selection operation; or, the target person in the person attribute information can be determined based on the experience data of the historical time period.

[0074] For example, assuming that the character attributes include character A and character B, character A is 60 years old, is an old man, and according to the behavioral characteristic information, it is confirmed that character A has all four limbs, character B is 10 years old, is a child, and according to the behavioral characteristic information in the character attribute information, it is determined that character B has all four limbs; the menu cooking process includes 2 dishes to be cooked, the first dish to be cooked is boiled millet porridge, and the second dish to be cooked is steamed yam. The recipe content of millet porridge includes: the first step, prepare ingredients: prepare 120g of millet and 2L of clean water and wash the millet. Ingredients for steaming yam: 20ML of clean water and 600g of yam, peel and wash the yam; the second step is to cook porridge: first, pour 2L of clean water into the smart cooking machine and boil it until boiling. Stir after cooking for 20 minutes to prevent sticking to the bottom. It can be served after cooking for 30 minutes; secondly, clean the smart cooking machine for 10 seconds; the third step is to steam the yam: first, pour 20ML of clean water into the smart cooking machine, put the steamer on it, and put the prepared 600g of yam into the smart cooking machine for steaming. Based on this, the target person in the current environment is determined to be person A according to the person attribute information. Because person A is 60 years old and is an elderly person, and according to the behavioral characteristic information, it is confirmed that person A has all four limbs intact, so person A's function usage permission is low, and is limited to enabling the recommended cooking functions corresponding to the menu cooking process in the functions of the smart cooking machine. The recommended cooking functions corresponding to the menu cooking process include steaming, boiling, automatic cleaning, opening / closing the lid, and temperature monitoring. At this time, disabling other functions in the smart cooking machine except the recommended cooking functions can prevent person A from causing safety accidents due to incorrect use of the smart cooking machine, thereby reducing the probability of safety accidents during the cooking process of the smart cooking machine and improving the safety of the smart cooking machine when in use.

[0075] After collecting the sound information and image information of the current environment, since there may be one or more characters in the current environment, and each character has different corresponding attribute information, in the embodiment of the present application, the number of characters in the current environment, the age of each character, and the behavior characteristic information can be determined by analyzing the sound information and image information, thereby determining the character attribute information in the current environment. That is, optionally, in some embodiments, the step of "determining the character attribute information in the current environment based on the sound information and image information" can specifically include:

[0076] (11) Based on the sound information, determine the number of characters and the estimated age of each character.

[0077] The sound information may include the sound of at least one person.

[0078] A pre-trained character prediction model can be used to extract multiple sound features in the sound information, and each sound feature is classified to obtain character category information for each sound. The character category information is vector information, and the vector information includes the probability value of the character category corresponding to each sound feature, wherein the character category with the largest probability value is used as the character corresponding to the sound feature, thereby predicting the character corresponding to each sound feature, based on which the number of characters can be determined; then, the sound feature corresponding to each character is input into the pre-trained age prediction model for age classification, thereby obtaining age category information, and the age category information is vector information, and the vector information includes the probability value of the age corresponding to the character's sound feature, wherein the age with the largest probability value is used as the estimated age corresponding to the character. The pre-trained character prediction model can be a model obtained based on neural network training, which is used to predict character categories corresponding to multiple sound information in the sound information, such as character A, character B, and character C. The pre-trained age prediction model can be a model obtained based on neural network training, which is used to predict the estimated age corresponding to the voice features corresponding to each character, such as the estimated age corresponding to the voice features of character A is 60, the estimated age corresponding to the voice features of character B is 10, and the estimated age corresponding to the voice features of character C is 30.

[0079] (12) Perform feature analysis on the image information to determine the behavioral feature information of each character.

[0080] Among them, it can be determined based on the behavioral characteristic information whether the person in the current environment is a disabled person who is not convenient to use the smart cooking machine, such as a disabled person with disabled hands or upper body paralysis. The behavioral characteristic information may include facial feature information, wearing feature information, posture feature information and limb feature information corresponding to each person.

[0081] The facial feature analysis, wear feature analysis, posture feature analysis and limb feature analysis of each person in each frame of the image information can be performed by artificial intelligence technology to obtain the facial feature information, wear feature information, posture feature information and limb feature information corresponding to each person, so as to determine whether the person is a disabled person who is inconvenient to use the intelligent cooking machine based on the facial feature information, wear feature information, posture feature information and limb feature information. For example, common symptoms of disabled people with upper body paralysis include upper limb movement disorders, lower limb movement disorders, facial muscle movement disorders and other symptoms. Upper limb movement disorders are mainly manifested as the inability to lift the arms and fingers, and can also be manifested as shoulder, upper arm and forearm movement disorders. In severe cases, finger flexion and abduction dysfunction may also occur. Lower limb movement disorders are mainly manifested as foot muscle movement disorders, and in severe cases, plantar flexion and extension dysfunction may also occur. The main manifestations of facial muscle movement disorders are drooping corners of the mouth, slurred speech, unclear speech and other symptoms; the dressing characteristics are generally as follows: clothes should be loose, simple and soft in style, and it is best to use elastic bands instead of buttons at the waist of the trousers to facilitate patients to put on and pull with one hand, and the trousers should not be too long to avoid dragging on the ground and causing falls; people with facial paralysis and drooling can wrap a small towel under the jaw, or use a bib; the shoes for the paralyzed limbs should be light, soft and non-slip, and slightly larger than the shoes for the healthy feet (because the affected feet are often swollen), and the shoelaces should be tied tightly at the ankle to avoid falling when dragging, so as to determine whether the person is a disabled person with upper body paralysis based on the person's facial feature information, dressing feature information, posture feature information and limb feature information.

[0082] (13) The number of characters, estimated age, and behavioral characteristics are used as character attribute information.

[0083] Optionally, in some embodiments, after the sound information is collected, the number of people and the estimated age of each person may be determined based on the conversation text content and the sound spectrum corresponding to the sound information. That is, the step of "determining the number of people and the estimated age of each person based on the sound information" may specifically include:

[0084] (21) Perform speech recognition on the sound information to obtain the dialogue text content corresponding to the sound information.

[0085] Speech recognition technology is a computer technology that converts a speaker's voice signal into text or other forms. In this application, sound information can be recognized based on speech recognition technology to obtain the conversation text content corresponding to the sound information.

[0086] (22) Performing spectral analysis on the sound information to determine the sound spectrum corresponding to the sound information.

[0087] The sound information may be subjected to spectrum analysis by a pre-trained spectrum analysis model to obtain a sound spectrum corresponding to the sound information. The pre-trained spectrum analysis model may be a model obtained by training a neural network, and is used to perform spectrum analysis on the sound information, thereby determining the sound spectrum corresponding to the sound information.

[0088] (23) Determine the number of characters and the estimated age of each character based on the content of the dialogue text and the sound spectrum.

[0089] The relationship between the characters in the dialogue, such as grandfather-grandson relationship, father-daughter relationship, friend relationship, etc., can be determined by extracting keyword information in the text content of the dialogue, wherein the keyword information includes at least one keyword, and the keywords in the keyword information are used to determine the relationship between the characters in the dialogue, such as grandfather-grandson relationship, father-daughter relationship, and friend relationship; one or more sound spectra corresponding to the sound information are input into a pre-trained spectrum classification prediction model for classification prediction to obtain a classification prediction result, which is used to represent the probability of the estimated age corresponding to the sound spectrum, wherein the estimated age corresponding to the sound spectrum is the estimated age corresponding to the maximum probability value, thereby determining the number of characters and the estimated age corresponding to each character. The spectrum classification prediction model can be a model obtained based on neural network training, which is used to classify and predict the sound spectrum, thereby determining the estimated age corresponding to the sound spectrum according to the classification prediction result.

[0090] For example, assuming that the sound information includes the voice A of character A (Grandpa, what shall we eat for breakfast today) and the voice B of character B (We shall eat millet porridge and yam today), the sound information is recognized by speech recognition technology, and the text conversation content obtained is character A: Grandpa, what shall we eat for breakfast today? Character B: We shall eat millet porridge and yam today. Based on this, the key words extracted from the text conversation content are: Grandpa, then according to "Grandpa" it can be determined that the relationship between the characters in the conversation is a grandfather-grandson relationship; after determining the sound spectrum of voice A and the sound spectrum of voice B, the sound spectrum of voice A and the sound spectrum of voice B can be input into the spectrum classification prediction model for classification prediction, so as to determine that the estimated age corresponding to the sound spectrum of voice A is 9 years old and the estimated age corresponding to the sound spectrum of voice B is 60 years old, thereby determining that the number of characters is 2, and the estimated age of character B is 60 years old and the estimated age of character A is 9 years old.

[0091] Optionally, in some embodiments, after determining the character attribute information, it may be determined whether there is a preset object in the current environment, so as to determine the cooking function authority under the constraint of the preset object, that is, the step of "determining the cooking function authority in the cooking process according to the character attribute information and the menu cooking process" may specifically include:

[0092] (31) Determine whether only preset objects exist in the current environment based on the character attribute information.

[0093] Among them, the preset objects can be disabled people, the elderly, children, etc.

[0094] (32) If it is determined that only preset objects exist in the current environment, the cooking operation information is extracted from the menu cooking process.

[0095] (33) Determine cooking function permissions based on cooking operation information.

[0096] For example, the menu cooking process includes two dishes to be cooked. The first dish to be cooked is millet porridge, and the second dish to be cooked is steamed yam. The process content includes: the first step is to prepare ingredients (this step is manually operated): prepare 120g of millet and 2L of clean water, and wash the millet, and the ingredients for steaming yam: 20ML of clean water and 600g of yam, and peel and wash the yam; the second step is to cook porridge: first, pour 2L of clean water into the smart cooking machine and boil it until boiling. Stir after cooking for 20 minutes to prevent sticking to the bottom. After cooking for 30 minutes, it can be served; secondly, clean the smart cooking machine for 10 seconds; the third step is to steam the yam: first, pour 20ML of clean water into the smart cooking machine, put the steamer on it, and put the prepared 600g of yam into the smart cooking machine for steaming. When it is determined that only preset objects exist in the current environment, the cooking operation information can be extracted from the above menu cooking process according to the preset recipe name (such as cooking porridge, steamed yam), that is, the cooking operation information is: Step 2, cooking porridge: First, pour 2L of clean water into the smart cooking machine and boil it until it is boiling. Stir after boiling for 20 minutes to prevent sticking to the bottom, and it can be served after cooking for 30 minutes; secondly, clean the smart cooking machine for 10 seconds; Step 3, steaming yam: First, pour 20ML of clean water into the smart cooking machine, put a steamer on it, and put the prepared 600g yam into the smart cooking machine for steaming. Based on this, keyword information such as steaming, boiling, automatic cleaning, opening / closing the lid, and temperature monitoring can be extracted from the operation cooking information. According to the keyword information, the cooking function permission is determined, that is, the function corresponding to the keyword in the keyword information is allowed to be used.

[0097] Optionally, in some embodiments, the cooking time nodes and text information can be extracted from the menu cooking process, and further combined with the cooking function permissions to generate the cooking process steps, that is, the step of "controlling the intelligent cooking machine according to the menu cooking process and the cooking function permissions" can specifically include:

[0098] (41) Extract cooking time nodes and text information corresponding to each cooking time node from the menu cooking process.

[0099] (42) Generate cooking process steps based on cooking time nodes, text information and cooking function permissions.

[0100] (43) Control the intelligent cooking machine according to the cooking process.

[0101] For example, the functions allowed by the cooking function permission include steaming, boiling, automatic cleaning, opening / closing the lid, and temperature monitoring. The menu cooking process includes 2 dishes to be cooked. The first dish to be cooked is boiled millet porridge, and the second dish to be cooked is steamed yam. The recipe content of millet porridge includes: the first step, prepare ingredients: prepare 120g of millet and 2L of water, and wash the millet. Ingredients for steaming yam: 20ML of water and 600g of yam, and peel and wash the yam; the second step, cook porridge: first reach the preset cooking time point at the current time, that is, Wednesday, August 23, 2023 At 9:00:00 in the afternoon, pour 2L of clean water into the smart cooking machine and cook for 5 minutes until boiling (that is, 9:05:00), then pour in the washed millet and cook for 20 minutes, then stir to prevent sticking to the bottom (that is, 9:25:00), and it can be served after cooking for 30 minutes (that is, 9:35:00); secondly, clean the smart cooking machine for 10 seconds (that is, 9:35:10); the third step is to steam the yam: first, pour 20ML of clean water into the smart cooking machine, and put the steamer on it, put the prepared 600g of yam into the smart cooking machine and steam it for 20 minutes (9:55:10). Among them, the text information corresponding to the cooking time node 9:00:00 am on Wednesday, August 23, 2023 is the preset cooking time point; the text information corresponding to the cooking time node 9:05:00 is to pour 2L of clean water into the smart cooking machine and boil it for 5 minutes. At this time, the cooking time node includes the cooking function; the text information corresponding to the cooking time node 9:25:00 is to pour in the washed millet and stir it after cooking for 20 minutes to prevent sticking to the bottom. At this time, the cooking time node includes the stirring function; the text information corresponding to the cooking time node 9:35:00 is to wait for 30 minutes before serving. At this time, the The cooking time node includes the functions of boiling and opening / closing the lid; the text information corresponding to the cooking time node 9:35:10 is the second, clean the smart cooking machine for 10 seconds. At this time, the cooking time node includes the function of automatic cleaning; the text information corresponding to the cooking time node 9:55:10 is the third step, steaming yam: first, pour 20ML of clean water into the smart cooking machine, and put the steamer on, put the prepared 600g of yam into the smart cooking machine and steam it for 20 minutes. At this time, the cooking time node includes the function of steaming, based on which the cooking process procedure is generated, and the smart cooking machine is controlled according to the cooking process procedure.

[0102] Optionally, in some embodiments, after the cooking process is generated, it is possible to detect in real time which time period in the cooking process the current time is in, thereby determining the current cooking time period, and controlling the intelligent cooking machine according to the cooking function authority corresponding to the cooking time period, that is, the step of "controlling the intelligent cooking machine according to the cooking process" may specifically include:

[0103] (51) Determine the current cooking time period based on the current time and cooking process steps.

[0104] (52) Control the intelligent cooking machine according to the cooking function permissions corresponding to the cooking time period.

[0105] Specifically, when it is detected that the current time is the same as the first target cooking time node in the cooking process, the next target cooking time node of the first target cooking time node is obtained as the second target cooking time node, so as to determine the current cooking time period according to the first target cooking time node and the second target cooking time node, and obtain the cooking function authority corresponding to the cooking time period, that is, to allow the function corresponding to the current time period to be enabled, and to disable the functions corresponding to other time periods outside the cooking time period, so as to control the intelligent cooking machine. Optionally, the cooking function authority can be determined according to the cooking time sequence of each function in the cooking process, that is, to control the enabling and disabling of each function, so as to control the intelligent cooking machine, so as to further improve the safety of the intelligent cooking machine when in use during the cooking process of the intelligent cooking machine.

[0106] Exemplarily, the cooking process includes: the text information corresponding to the cooking time node 9:00:00 am, Wednesday, August 23, 2023 is the preset cooking time point; the text information corresponding to the cooking time node 9:05:00 is to pour 2L of water into the smart cooking machine and boil it for 5 minutes. At this time, the cooking time node includes the function of cooking; that is, when the current time reaches 9:00:00, the functions that are allowed to be enabled in the cooking time period from 9:00:00 to 9:05:00 include cooking;

[0107] The text information corresponding to the cooking time node 9:25:00 is to pour in the washed millet and cook for 20 minutes and then stir to prevent sticking to the bottom. At this time, the cooking time node includes the functions of cooking and stirring; that is, the functions of the cooking time period from 9:05:00 to 9:25:00 include cooking and stirring;

[0108] The text information corresponding to the cooking time node 9:35:00 is that the food can be served after 30 minutes of cooking. At this time, the cooking time node includes the functions of cooking and opening / closing the lid; that is, the functions corresponding to the cooking time period between 9:25:00 and 9:35:00 include cooking and opening / closing the lid;

[0109] The text information corresponding to the cooking time node 9:35:10 is second, cleaning the intelligent cooking machine for 10 seconds. At this time, the cooking time node includes the function of automatic cleaning; that is, the function corresponding to the cooking time period from 9:35:00 to 9:35:10 includes automatic cleaning;

[0110] The text information corresponding to the cooking time node 9:55:10 is the third step, steaming the yam: first, pour 20ML of water into the smart cooking machine, and put the steamer on it, put the prepared 600g of yam into the smart cooking machine and steam it for 20 minutes. At this time, the cooking time node includes the function of steaming, that is, the function corresponding to the cooking time period from 9:35:10 to 9:55:10 includes steaming.

[0111] Optionally, in some embodiments, the control process of the intelligent cooking machine can be detected and the user can be reminded in time to improve the safety of the intelligent cooking machine during the cooking process of the intelligent cooking machine. That is, in the process of step "controlling the intelligent cooking machine according to the menu cooking process and cooking function authority", the following steps can be specifically included:

[0112] (61) Monitor the control process of the intelligent cooking machine.

[0113] Among them, by receiving feedback information when the functions of the intelligent cooking machine are controlled to be enabled or disabled, it can be verified whether the control process of the intelligent cooking machine has abnormal conditions such as function loss of control and function failure.

[0114] (62) If an abnormal situation is detected during the control process of the intelligent cooking machine, an abnormal reminder message is sent to the associated device.

[0115] The associated device may be a voice broadcast device in a smart home or a user's mobile terminal, which may be set according to the actual application scenario and is not specifically limited here. Abnormal reminder information is generated according to abnormal conditions. For example, when the steaming function of a cooking machine fails to be enabled, abnormal reminder information may be generated according to the information that the steaming function fails to be enabled, so as to remind the person and / or user in the current environment.

[0116] Optionally, the control process of the smart cooking machine can be monitored in real time; if an abnormality is detected in the control process of the smart cooking machine, abnormal reminder information is promptly sent to the associated device to further improve the safety of the smart cooking machine when in use during the cooking process of the smart cooking machine.

[0117] Optionally, the control process of the smart cooking machine can be monitored periodically (such as once a day, three times a week, etc.); if an abnormality is detected in the control process of the smart cooking machine, an abnormal reminder message is promptly sent to the associated device to further improve the safety of the smart cooking machine when in use during the cooking process of the smart cooking machine.

[0118] The above is the control process of the intelligent cooking machine of this application.

[0119] As described above, the present application provides a control method, device, electronic device and storage medium for an intelligent cooking machine, which collects sound information and image information of the current environment in response to an information collection operation; determines the character attribute information in the current environment based on the sound information and image information; obtains the menu cooking process; determines the cooking function authority in the cooking process based on the character attribute information and the menu cooking process, and controls the intelligent cooking machine based on the menu cooking process and the cooking function authority. In the control scheme of the intelligent cooking machine provided in the present application, by determining the character attribute information in the current environment, and then determining the cooking function authority under the restriction of the character attribute information and the menu cooking process, the intelligent cooking machine is controlled based on the cooking function authority and the menu cooking process. It can be seen that this scheme can limit the automatic cooking function of the intelligent cooking machine under the restriction of the character attribute information and the menu cooking process, so as to reduce the probability of safety accidents during the cooking process of the intelligent cooking machine and improve the safety of the intelligent cooking machine when in use.

[0120] In order to facilitate better implementation of the control method of the intelligent cooking machine of the embodiment of the present application, the embodiment of the present invention also provides a control device of the intelligent cooking machine (hereinafter referred to as the control device). The meanings of the terms are the same as those in the control method of the intelligent cooking machine described above, and the specific implementation details can refer to the description in the method embodiment.

[0121] See also Figure 3 , Figure 3 This is a schematic diagram of the structure of the control device of the intelligent cooking machine provided in an embodiment of the present application. The control device of the intelligent cooking machine includes an information collection module 201, an information determination module 202, a process acquisition module 203 and a control module 204. The detailed description of each functional module is as follows:

[0122] The information collection module 201 is used to collect the sound information and image information of the current environment in response to the information collection operation;

[0123] An information determination module 202, for determining the character attribute information in the current environment according to the sound information and the image information;

[0124] A process acquisition module 203 is used to acquire a menu cooking process;

[0125] The control module 204 is used to determine the cooking function authority during the cooking process according to the character attribute information and the menu cooking process, and control the intelligent cooking machine according to the menu cooking process and the cooking function authority.

[0126] Optionally, in some embodiments, the control module 204 of the present application may further include:

[0127] A first determining unit, used to determine the number of characters and the estimated age of each character according to the sound information;

[0128] The second determining unit is used to perform feature analysis on the image information to determine the behavior feature information of each character;

[0129] The third determining unit is used to use the number of characters, estimated age and behavior characteristic information as character attribute information.

[0130] Optionally, in some embodiments, the age determination unit of the present application further includes:

[0131] The recognition subunit is used to perform speech recognition on the sound information to obtain the dialogue text content corresponding to the sound information;

[0132] The analysis subunit is used to perform spectrum analysis on the sound information to determine the sound spectrum corresponding to the sound information;

[0133] The first determination subunit is used to determine the number of characters and the estimated age of each character according to the dialogue text content and the sound spectrum.

[0134] Optionally, in some embodiments, the control module 204 of the present application further includes:

[0135] A judgment unit, used to determine whether there are only preset objects in the current environment according to the character attribute information;

[0136] A cooking operation information extraction unit, configured to extract cooking operation information from a menu cooking process if it is determined that only a preset object exists in the current environment;

[0137] The fourth determining unit is used to determine the cooking function authority according to the cooking operation information.

[0138] Optionally, in some embodiments, the control module 204 of the present application further includes:

[0139] An information extraction unit, used to extract cooking time nodes and text information corresponding to each time node from the menu cooking process;

[0140] A process generation unit, used to generate cooking process steps according to time nodes, text information and cooking function permissions;

[0141] The control unit is used to control the intelligent cooking machine according to the cooking process.

[0142] Optionally, in some embodiments, the control unit further comprises:

[0143] The second determining subunit is used to determine the current cooking time period according to the current time and the cooking process step;

[0144] The third determining subunit is used to control the intelligent cooking machine according to the cooking function authority corresponding to the cooking time period.

[0145] Optionally, in some embodiments, Figure 4 As shown, the control device of the present application further includes a monitoring module 205, which is used to: monitor the control process of the intelligent cooking machine; if an abnormal situation is detected in the control process of the intelligent cooking machine, an abnormal reminder message is sent to the associated device.

[0146] It should be noted that in the embodiment of the present application, if the above method is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the methods of each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a U disk, a mobile hard disk, a read-only memory (ROM, Read Only Memory), a disk or an optical disk. In this way, the embodiment of the present application is not limited to any specific combination of hardware and software.

[0147] Correspondingly, an embodiment of the present application also discloses a storage medium storing a computer program that can be loaded by a processor and execute the above method.

[0148] The present application also discloses an intelligent cooking machine. Figure 5 As shown, it includes a processor 100, at least one communication bus 200, a user interface 300, at least one external communication interface 400 and a memory 500. The processor 100 is used to provide computing and control capabilities, the communication bus 200 is configured to achieve connection and communication between these components, the user interface 300 may include a display screen, the external communication interface 400 may include a standard wired interface and a wireless interface, and the control method of the intelligent cooking machine is stored in the memory 500. The processor 100 is also used to adopt the above method when executing the control method of the intelligent cooking machine stored in the memory 500.

[0149] Optionally, in some embodiments, the processor implements the following steps when executing the computer program:

[0150] In response to the information collection operation, the sound information and image information of the current environment are collected; based on the sound information and image information, the character attribute information in the current environment is determined; the menu cooking process is obtained; based on the character attribute information and the menu cooking process, the cooking function permissions in the cooking process are determined, and the intelligent cooking machine is controlled based on the menu cooking process and the cooking function permissions.

[0151] In an embodiment of the present application, the character attribute information in the current environment can be determined, and then the cooking function authority can be determined under the restriction of the character attribute information and the menu cooking process, so as to control the smart cooking machine based on the cooking function authority and the menu cooking process. It can be seen that this scheme can limit the automatic cooking function of the smart cooking machine under the restriction of the character attribute information and the menu cooking process, so as to reduce the probability of safety accidents during the cooking process of the smart cooking machine and improve the safety of the smart cooking machine when in use.

[0152] It should be understood that "one embodiment" or "some embodiments" mentioned throughout the specification means that specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, "in one embodiment" or "in an embodiment" appearing throughout the specification does not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in various embodiments of the present application, the size of the sequence number of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application. The above-mentioned sequence numbers of the embodiments of the present application are for description only and do not represent the advantages and disadvantages of the embodiments.

[0153] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0154] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are only schematic. For example, the division of units is only a logical function division. There may be other division methods in actual implementation, such as: multiple units or components can be combined, or can be integrated into another system, or some features can be ignored or not executed. In addition, the coupling, direct coupling, or communication connection between the components shown or discussed can be through some interfaces, and the indirect coupling or communication connection of devices or units can be electrical, mechanical or other forms.

[0155] The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units; they may be located in one place or distributed on multiple network units; some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0156] In addition, all functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may be a separate unit, or two or more units may be integrated into one unit; the above-mentioned integrated units may be implemented in the form of hardware or in the form of hardware plus software functional units.

[0157] A person of ordinary skill in the art can understand that: all or part of the steps of implementing the above-mentioned method embodiment can be completed by hardware related to program instructions, and the aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it executes the steps of the above-mentioned method embodiment; and the aforementioned storage medium includes: various media that can store program codes, such as mobile storage devices, ROMs, magnetic disks or optical disks.

[0158] Alternatively, if the above-mentioned integrated unit of the present application is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application can essentially or in other words, the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for a device to execute all or part of the methods of each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as mobile storage devices, ROMs, magnetic disks or optical disks.

[0159] The above disclosure is only the preferred embodiment of the present application, which certainly cannot be used to limit the scope of rights of the present application. Therefore, equivalent changes made according to the claims of the present application are still within the scope covered by the present application.

Claims

1. A control method for an intelligent cooking machine, characterized in that: The method comprises: In response to the information collection operation, collecting sound information and image information of the current environment; Determining the character attribute information in the current environment according to the sound information and the image information; Get the menu cooking process; The cooking function authority in the cooking process is determined according to the character attribute information and the menu cooking process, and the intelligent cooking machine is controlled according to the menu cooking process and the cooking function authority.

2. The control method of the intelligent cooking machine according to claim 1, characterized in that: The determining, according to the sound information and the image information, the character attribute information in the current environment includes: Determine the number of characters and the estimated age of each character according to the sound information; Performing feature analysis on the image information to determine behavioral feature information of each character; The number of characters, the estimated ages and the behavioral characteristic information are used as the character attribute information.

3. The control method of the intelligent cooking machine according to claim 2, characterized in that: Determining the number of characters and the estimated age of each character according to the sound information includes: Performing speech recognition on the sound information to obtain the dialogue text content corresponding to the sound information; Performing spectrum analysis on the sound information to determine a sound spectrum corresponding to the sound information; The number of characters and the estimated age of each character are determined according to the dialogue text content and the sound spectrum.

4. The control method of the intelligent cooking machine according to claim 1, wherein determining the cooking function authority in the cooking process according to the character attribute information and the menu cooking process comprises: Determining whether there are only preset objects in the current environment according to the character attribute information; If it is determined that only the preset object exists in the current environment, extracting cooking operation information from the menu cooking process; The cooking function authority is determined according to the cooking operation information.

5. The control method of the intelligent cooking machine according to claim 1, characterized in that: The controlling of the intelligent cooking machine according to the menu cooking process and the cooking function authority includes: Extracting cooking time nodes and text information corresponding to each cooking time node from the menu cooking process; Generate a cooking process according to the cooking time node, the text information and the cooking function authority; According to the cooking process, the intelligent cooking machine is controlled.

6. The control method of the intelligent cooking machine according to claim 5, characterized in that: The method of controlling the intelligent cooking machine according to the cooking process comprises: Determine the current cooking time period according to the current time and the cooking process step; The intelligent cooking machine is controlled according to the cooking function authority corresponding to the cooking time period.

7. The control method of the intelligent cooking machine according to any one of claims 1 to 6, characterized in that: In the process of controlling the intelligent cooking machine according to the menu cooking process and the cooking function authority, the method further includes: Monitoring the control process of the intelligent cooking machine; If an abnormal situation is detected during the control process of the intelligent cooking machine, an abnormal reminder message is sent to the associated device.

8. A control device for an intelligent cooking machine, characterized in that: The device comprises: An information collection module, used to collect sound information and image information of the current environment in response to the information collection operation; An information determination module, used to determine the character attribute information in the current environment according to the sound information and the image information; Process acquisition module, used to obtain menu cooking process; The control module is used to determine the cooking function authority during the cooking process according to the character attribute information and the menu cooking process, and control the intelligent cooking machine according to the menu cooking process and the cooking function authority.

9. An electronic device, comprising: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the control method of the intelligent cooking machine according to any one of claims 1 to 7 when executing the computer program.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the control method of the intelligent cooking machine according to any one of claims 1 to 7 are implemented.

Images