Method, device and computer readable storage medium for processing interaction information

Abstract

The application discloses a kind of interactive information processing method, equipment and computer readable storage medium, it is related to intelligent kitchen technical field, can be in time to interactive information processing, to improve the expected effect of interactive information.The method comprises the following steps: obtaining the interactive information of kitchen equipment;Monitoring whether the operation object mapped in the preset time length is triggered by the preset interaction action;If not, according to the demand determination result of the interactive information, the interactive information is processed.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of intelligent kitchen, in particular to an interactive information processing method and device and computer readable storage medium. BACKGROUND

[0002] With the continuous improvement of people's living standards, there are more kitchen devices in the kitchen, and they are also more and more intelligent. In the process of using the kitchen device, the kitchen device will push a lot of interactive information, which can be prompt information, and can also be display information or alarm information, etc.

[0003] In the communication case, after the interactive information is pushed, it needs to be effectively fed back. If no effective feedback is obtained, the kitchen device will repeatedly push the interactive reminder, affecting the user's cooking experience, and the user can also confirm the button to execute the user's feedback to the interactive information. However, the behavior triggered by the button will increase the operation burden of the user in the cooking process, and cannot achieve the expected effect of the interactive information. SUMMARY

[0004] Therefore, the present application provides an interactive information processing method, device and computer readable storage medium, which mainly aims to reduce the operation burden of the user in the cooking process to confirm the interactive information in the prior art.

[0005] According to the first aspect of the present application, an interactive information processing method is provided, which comprises:

[0006] Obtaining interactive information of a kitchen device;

[0007] Monitoring whether an operation object mapped by the interactive information triggers a preset interactive action within a preset time period;

[0008] If not, processing the interactive information according to a demand determination result of the interactive information.

[0009] Further, the monitoring whether the operation object mapped by the interactive information triggers the preset interactive action within the preset time period comprises:

[0010] Monitoring, by using a sensing device associated with the operation object, action information triggered by the user to the operation object;

[0011] Determining whether the preset interactive action triggered by the operation object is contained in the action information by analyzing the action information.

[0012] Further, the determining whether the preset interactive action triggered by the operation object is contained in the action information by analyzing the action information comprises:

[0013] The action information is parsed, and the action information is split into an action execution sequence triggered by the user on the operation object and an execution result of the action;

[0014] According to the execution result of the action, it is determined whether the action execution sequence contains a preset interaction action triggered by the operation object.

[0015] Further, according to the execution result of the action, it is determined whether the action execution sequence contains a preset interaction action triggered by the operation object, specifically including:

[0016] According to the execution result of the action, the matching index of the action and the preset interaction action is identified;

[0017] It is determined whether the action execution sequence contains the action whose matching index reaches a preset value;

[0018] If yes, it is determined that the action execution sequence contains a preset interaction action triggered by the operation object.

[0019] Further, after it is determined whether the operation object mapped by the interaction information triggers a preset interaction action within the preset time period, the method further comprises:

[0020] If yes, an execution result parameter associated with the preset interaction action is obtained;

[0021] It is determined whether the execution result parameter reaches a preset interaction result of the kitchen device;

[0022] If yes, the kitchen device is controlled to perform a subsequent cooking operation; otherwise, the interaction information is processed according to a demand determination result of the interaction information.

[0023] Further, the interaction information of the kitchen device is obtained, specifically including:

[0024] The interaction action required by the user to be performed during the cooking process of the kitchen device is obtained;

[0025] According to the interaction action required by the user to be performed, the operation object and the action details of the operation object involved in the interaction action are associated to obtain the interaction information of the kitchen device.

[0026] Further, before the interaction information is processed according to the demand determination result of the interaction information, the method further comprises:

[0027] The interaction information is demand determined by using the participation attribute of the interaction information on the interaction demand to obtain a demand determination result of the interaction information;

[0028] The demand judgment of the interaction information is performed according to the participation attribute of the interaction information on the interaction demand, and a demand judgment result of the interaction information is obtained, and specifically includes:

[0029] The influence degree of the interaction information on the cooking process is obtained according to the participation attribute of the interaction information on the interaction demand.

[0030] According to the influence degree of the interaction information on the cooking process, it is judged whether the interaction information needs a cooking compensation operation.

[0031] If yes, it is judged that the demand judgment result of the interaction information is demand execution information; otherwise, it is judged that the demand judgment result of the interaction information is non-demand execution information.

[0032] Further, the interaction information is processed according to the demand judgment result of the interaction information, and specifically includes:

[0033] If the demand judgment result of the interaction information is demand execution information, the interaction information is generated as interaction prompt information and is pushed and the cooking operation of the subsequent kitchen equipment is adjusted.

[0034] If the demand judgment result of the interaction information is non-demand execution information, the interaction information is skipped.

[0035] Further, the adjustment of the cooking operation of the subsequent kitchen equipment specifically includes:

[0036] The cooking demand information of the interaction information mapping operation object on the preset interaction action is extracted by analyzing the interaction information.

[0037] According to the kitchen equipment associated with the cooking demand information, the cooking operation of the subsequent kitchen equipment is adjusted.

[0038] According to the second aspect of the present application, a processing device of interaction information is provided, and the device includes:

[0039] The first acquisition module is configured to acquire the interaction information of the kitchen equipment.

[0040] The monitoring module is configured to monitor whether the operation object mapped by the interaction information triggers a preset interaction action within a preset time length.

[0041] The processing module is configured to, if no, process the interaction information according to the demand judgment result of the interaction information.

[0042] Further, the monitoring module includes:

[0043] The monitoring unit is configured to monitor the action information triggered by the user on the operation object by using the sensing device associated with the operation object.

[0044] The first judging unit is configured to judge whether the preset interaction action triggered by the operation object is contained in the action information by analyzing the action information.

[0045] Further, the first judging unit comprises:

[0046] The splitting unit is configured to split the action information into an action execution sequence triggered by the operation object and an execution result of the action by analyzing the action information.

[0047] The judging subunit is configured to judge whether the preset interaction action triggered by the operation object is contained in the action execution sequence according to the execution result of the action.

[0048] Further, the judging subunit is specifically configured to identify a matching index of the action and the preset interaction action according to the execution result of the action.

[0049] The judging subunit is specifically configured to further judge whether the action execution sequence contains the action with the matching index reaching a preset value.

[0050] The judging subunit is specifically configured to determine that the action execution sequence contains the preset interaction action triggered by the operation object if yes.

[0051] Further, the device further comprises:

[0052] The second obtaining module is configured to obtain an execution result parameter associated with the preset interaction action if yes after judging whether the operation object mapped by the interaction information triggers the preset interaction action within the preset time length.

[0053] The judging module is configured to judge whether the execution result parameter reaches a preset interaction result of the kitchen device.

[0054] The control module is configured to control the kitchen device to perform a subsequent cooking operation if yes, and to process the interaction information according to a demand determination result of the interaction information if not.

[0055] Further, the first obtaining module comprises:

[0056] The first obtaining unit is configured to obtain an interaction action required to be performed by a user in a cooking process of the kitchen device.

[0057] The association unit is configured to associate an operation object and action details of the operation object involved in the interaction action according to the interaction action required to be performed by the user, to obtain the interaction information of the kitchen device.

[0058] Further, the device further comprises:

[0059] a determination module, configured to, before processing the interaction information according to the determination result of the requirement of the interaction information, determine the requirement of the interaction information according to the participation attribute of the interaction information on the interaction requirement, to obtain a determination result of the requirement of the interaction information;

[0060] The determination module comprises:

[0061] a second acquisition unit, configured to acquire the influence degree of the interaction information on the cooking process according to the participation attribute of the interaction information on the interaction requirement;

[0062] a second judgment unit, configured to judge whether the interaction information needs a cooking compensation operation according to the influence degree of the interaction information on the cooking process;

[0063] a determination unit, configured to, if yes, determine that the determination result of the requirement of the interaction information is requirement execution information; and if not, determine that the determination result of the requirement of the interaction information is non-requirement execution information.

[0064] Further, the processing module is specifically configured to, if the determination result of the requirement of the interaction information is the requirement execution information, generate interaction prompt information from the interaction information, push the interaction prompt information and adjust the cooking operation of the subsequent kitchen equipment.

[0065] The processing module is specifically configured to, if the determination result of the requirement of the interaction information is the non-requirement execution information, skip the execution of the interaction information.

[0066] Further, the processing module is specifically configured to extract the cooking requirement information of the interaction information mapping operation object on the preset interaction action by analyzing the interaction information.

[0067] The processing module is specifically configured to adjust the cooking operation of the subsequent kitchen equipment according to the kitchen equipment associated with the cooking requirement information.

[0068] According to the third aspect of the present application, a device is provided, comprising a memory and a processor, the memory stores a computer program, and the processor implements the steps of the method of the first aspect when executing the computer program.

[0069] According to the fourth aspect of the present application, a readable storage medium is provided, which stores a computer program, and the computer program implements the steps of the method of the first aspect when executed by a processor.

[0070] By means of the technical scheme, the method, device and computer readable storage medium for processing interactive information provided by the application can compare with the feedback mode of the user to the interactive information by triggering confirmation to execute in the prior art, the application acquires the interactive information of the kitchen equipment, and monitors whether the operation object mapped by the interactive information triggers the preset interactive action within the preset time length to determine whether the user executes the interactive action, if not, it indicates that the user does not trigger the interactive confirmation, further, the interactive information is processed according to the demand determination result of the interactive information, the interactive information can be processed in time, the operation burden of the user in the cooking process is reduced, and the expected effect of the interactive information is improved.

[0071] The above description is only a summary of the technical scheme of the application, in order to more clearly understand the technical means of the application, the content of the specification can be implemented, and in order to make the above and other purposes, characteristics and advantages of the application more obvious and easy to understand, the specific embodiments of the application are described below. BRIEF DESCRIPTION OF DRAWINGS

[0072] Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The accompanying drawings are included to provide a description of the preferred embodiments and are not meant to limit the present application. Furthermore, the same reference numerals are intended to identify the same components throughout the various figures. In the drawings:

[0073] Figure 1 A timing sequence diagram of interaction between a client and a server in a processing process of interactive information provided by an embodiment of the application is shown;

[0074] Figure 2 A structural schematic diagram of a processing device of interactive information provided by an embodiment of the application is shown;

[0075] Figure 3 A structural schematic diagram of a processing device of interactive information provided by an embodiment of the application is shown. DETAILED DESCRIPTION

[0076] Exemplary embodiments of the present application will be described herein below with reference to the accompanying drawings. While exemplary embodiments of the present application are shown in the drawings, it is understood that the present application can be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided so that this application will be thoroughly and completely understood as a complete disclosure of the application and will fully convey the scope of the application to those skilled in the art.

[0077] Before the present application is disclosed and described in detail, a simple explanation of the processing process of the interactive information involved in the present application is given. The processing process of the interactive information corresponds to the server of the kitchen equipment and the intelligent equipment used in the cooking process. The server is a server with data processing function, such as data transmission, data determination, etc., which is equivalent to the equipment background or terminal background. In order to facilitate the user to participate in the cooking process, the interactive action involved in the cooking step can be formed into interactive information and pushed to the kitchen equipment or user equipment terminal, so that the user can perform the interactive action according to the interactive information when reaching the corresponding cooking step. For example, in the material cup feeding and material cup homing action of the user in the feeding step, the user performs the spatula stirring action in the stirring step. The interactive information after being pushed often needs to get the effective feedback of the user. Here, the server corresponding to the intelligent equipment and the kitchen equipment can be connected to establish a communication connection, obtain the interactive information of the kitchen equipment, and determine the operation object and the preset interactive action mapped by the interactive information according to the interactive information of the kitchen equipment. Whether the operation object of the operation information mapping triggers the preset interactive action is monitored to determine whether the interactive information after being pushed gets the effective feedback of the user. If the operation object does not trigger the preset interactive action for a long time, it means that the user may give up the step or the user is not near the kitchen equipment. In order to avoid the long time detection and waiting of the kitchen equipment, the unnecessary interactive information can be directly skipped according to the execution demand of the interactive information, and the necessary interactive information can be continued to push and adjust the subsequent cooking operation, so as to improve the flexibility of the interactive information processing.

[0078] The processing method of the interactive information provided by the embodiment of the present application can be applied to the server side of the intelligent kitchen. The method comprises:

[0079] 101、obtain the interactive information of the kitchen equipment.

[0080] Generally, the kitchen equipment needs the support of the electronic recipe in the process of making dishes. The electronic recipe is an electronic program file that can automatically control the implementation of the cooking process, such as controlling the fire, power, temperature, time or ingredients, etc. The electronic recipe can be an electronic version of the recipe for any dish, such as stir-fried dishes, stewed dishes, steamed dishes, for example, scrambled eggs with tomatoes, braised pork, sweet and sour ribs, etc. The kitchen equipment can be composed of multiple cooking devices with different cooking functions, which can specifically include ingredient devices, pots, stoves, etc. The kitchen equipment can also be a cooking device that integrates various cooking functions. In this way, the data transmission time between cooking devices can be saved, and errors or omissions of cooking data in the transmission process can be avoided. It should be noted that although the electronic recipe can achieve automatic control of the cooking process, the cooking process is not a fully intelligent process, and the user still needs to perform interaction for the cooking steps involved in the electronic recipe, for example, the user needs to put the seasoning for making food into the ingredient bottle, the user needs to use the ingredient bottle to perform the feeding action, and the user needs to use the spatula to stir the food, etc.

[0081] Among them, the interaction information of the kitchen equipment can include operation object information, interaction action information and mapping relationship between operation object and interaction action involved in the interaction process performed by the user. Here, the operation object can be a kitchen equipment without automatic cooking function, which needs the user to perform the interaction action, and can also be an auxiliary equipment used in combination with the kitchen equipment, such as a spatula used in combination with a pot, an ingredient cup used in combination with an ingredient device, etc. It can be understood that in order to remind the user to perform the interaction action in time, the kitchen equipment will generally generate interaction information according to the execution time set by the electronic recipe, and push the interaction information to the device terminal or the kitchen equipment in the form of interaction instructions, so that the user can use the operation object to trigger the corresponding interaction action according to the interaction information, for example, the user uses the spatula to stir the food according to the interaction information, and the user uses the ingredient cup to put the seasoning according to the interaction information.

[0082] Specifically in the cooking process, the kitchen device as an execution device can utilize the pre-stored electronic recipe to execute different cooking steps, each of which involves multiple cooking operations. When a cooking operation requires a user to trigger a corresponding interactive action, the kitchen device or the terminal device will issue an interactive instruction to remind the user to perform the corresponding interactive action according to the interactive instruction. The interactive instruction usually corresponds to interactive information, according to which the user can perform the interactive action or adaptively perform the interactive action, for example, the interactive information is to stir-fry for 1 minute, and the user can stir-fry for half a minute according to the state of the food in the pot. It should be noted that the interactive information is set by the kitchen device, and the interactive instruction usually ends when the interactive action reaches the interactive time or the interactive effect, and then jumps to the next cooking operation. If the user adaptively adjusts the interactive action, the next cooking operation can be jumped to in two ways. One is that the user determines the end of the interactive action and triggers the jump button to jump to the next cooking operation. The other is that the kitchen device determines the end of the interactive action and jumps to the next cooking operation, for example, the kitchen device detects that the user stops the interactive action for a preset time length and determines that the interactive action ends, and automatically jumps to the next cooking operation.

[0083] 102. Monitor whether the operation object mapped by the interactive information triggers a preset interactive action within a preset time length.

[0084] When a cooking step requiring interaction is executed in the electronic recipe, the kitchen device and / or the terminal device will issue an interactive instruction, which is equivalent to an interactive reminder to prompt the user to perform the interactive action. The interactive instruction can be any one or a combination of interface prompts, indicator light prompts, or sound prompts. Since the interactive instruction is directly related to the cooking effect of the electronic recipe, in general, if the user performs the interactive action and / or the interactive action reaches the interactive effect, the interactive instruction ends and the next cooking step can be jumped to. If the user does not perform the interactive action, the interactive instruction will continue to be issued until the user performs the interactive action. By monitoring whether the operation object mapped by the interactive information triggers a preset interactive action within a preset time length, the user's action information can be monitored in real time, and whether the interactive action is performed and whether the interactive instruction is ended can be determined. The preset time length can be set by the user according to the actual application scenario, for example, one minute or one and a half minutes, etc. It can also be adaptively adjusted by the kitchen device in combination with the actual cooking effect. If the kitchen device requires the user to perform the interactive action as soon as possible, the preset time length will be shortened accordingly, or the kitchen device will pause the cooking operation, etc., which is not limited here.

[0085] In a specific actual application, the operation object of the interactive information mapping can be the object of the interactive action, for example, the interactive information is to put seasoning salt, the preset interactive action is to put, the operation object is a seasoning container such as a cup and / or a bottle, and for another example, the interactive information is to stir the food material for 1 minute, the preset interactive action is to stir, and the operation object is a stirring tool such as a spatula or a spoon. Here, an inductor can be placed in the operation object to monitor the action details of the operation object, and whether the operation object triggers the preset interactive action is determined according to the action details of the operation object. For example, for the operation of the seasoning container, whether the seasoning container triggers the preset interactive action can be determined according to the action details triggered by the user using the seasoning container. Here, a sensing device for sensing the user action can be arranged on the seasoning container. If the user is sensed to squeeze or aim at the kitchen device, the action details of the seasoning container triggering the preset interactive action are monitored, and it is determined that the seasoning container triggers the preset interactive action. A dispensing button can also be arranged on the bottle body. If the action details of the dispensing button being triggered are sensed, it is determined that the seasoning container triggers the preset interactive action.

[0086] 103. If not, the interactive information is processed according to the requirement determination result of the interactive information.

[0087] It can be understood that if the user is not near the kitchen device or the user does not perceive the reminder of the interactive instruction, the interactive instruction will continue to be initiated, which will also affect the cooking effect. In order to improve the cooking experience of the user, if the preset time is long and the user performing the preset interactive action is not monitored, for the interactive information that does not need to be performed by the user, the next cooking step can be directly jumped to, and the cooking effect can be adjusted through the subsequent cooking step, so as to avoid the long-time detection and waiting of the cooking device. For the interactive information that must be performed by the user, the cooking operation can be paused to wait for the user to perform the preset interactive action, and the reminder strength of the interactive instruction can be increased, for example, information is pushed to the user terminal, the prompt volume or the brightness of the indicator light is increased, and the like.

[0088] The requirement determination result of the specific interactive information can be determined by the type of the cooking step. For the seasoning or stirring interactive information, it is usually required to perform the information, the cooking step of this type needs to be performed by the user, or the seasoning amount is adjusted through the subsequent adjustment, and the execution sequence or the execution content of the subsequent cooking step is not affected. For the food material interactive information or the function interactive information, it is usually non-required to perform the information, and the cooking step of this type usually does not affect the subsequent cooking step, and does not need to be adjusted through the subsequent cooking step.

[0089] The method for processing interactive information provided by the application can timely process the interactive information, reduce the operation burden of the user in the cooking process, and improve the expected effect of the interactive information, compared with the prior art which executes the feedback of the user to the interactive information by triggering confirmation.

[0090] In actual application scenarios, in order to facilitate monitoring whether the operation object triggers the preset interactive action, the operation object or the vicinity of the operation object is provided with a sensing device, for example, a pressure sensor, a displacement sensor, an image sensor, a capacitive sensor, etc. Specifically, the sensing device associated with the operation object can be used to monitor the action information triggered by the user to the operation object, and by analyzing the action information, it can be judged whether the preset interactive action triggered by the operation object is contained in the action information. It can be understood that the user may not perform the preset interactive action or may not reach the expectation of the preset interactive action in the case of triggering the action information to the operation object. For example, a vibration sensor is arranged in the measuring cup, and the vibration sensor can be used to detect whether the measuring cup triggers the action information, that is, if there is a vibration amplitude, it means that the user triggers the action information to the operation object, but whether the action information is a feeding action or whether the feeding action reaches the expectation still needs to be further analyzed by analyzing the action information to judge whether the vibration amplitude reaches a preset value or whether the vibration direction is the direction of the pot. For another example, a capacitive sensor is arranged on the handle of the spatula, and the capacitive sensor can be used to detect whether the spatula triggers the action information, that is, the spatula has an amplitude in the dimensions of angle, vibration, pressure, etc., but whether the action information is a stir-frying action or whether the stir-frying action reaches the expectation still needs to be further analyzed by analyzing the action information to judge whether the vibration amplitude reaches a preset value or whether the angle direction is the stir-frying direction.

[0091] It should be noted that different operation objects may be provided with different preset interactive actions or multiple preset interactive actions, for example, the preset interactive action corresponding to the measuring cup with a feeding button may be triggering the feeding button, and the preset interactive action corresponding to the ordinary measuring cup may include squeezing action, vibration action or docking action, etc. Here, the preset interactive action triggered by the operation object is not limited and can be set according to the actual situation.

[0092] Specifically, in the process of analyzing the action information and determining whether the preset interaction action triggered by the operation object is included in the action information, the action information can be split into the action execution sequence triggered by the operation object and the action execution result according to the action information. According to the action execution result, it is determined whether the preset interaction action triggered by the operation object is included in the action execution sequence. Since the action information includes the action sequence triggered by the operation object in the interaction process, the action sequence may include some unnecessary actions, for example, the action of picking up or putting down the operation object, and the action of moving the operation object to a non-obstacle position. The action execution sequence is usually an action sequence formed according to the operation time. Here, the record of the operation time is usually set according to a preset time interval, and can also be set according to the action characteristics. For the mode of setting according to the preset time interval, the action execution sequence can be: 3 minutes 10 seconds to pick up the cup from the spice rack-3 minutes 12 seconds to move the cup above the pot-3 minutes 14 seconds to trigger the dosing action-3 minutes 16 seconds to trigger the dosing action-3 minutes 18 seconds to move the cup to the spice rack. Here, the preset time interval is 2 seconds, and the action is repeatedly recorded if the action does not change within the preset time interval. This mode can record the action information within each preset time interval. For the mode of setting according to the action characteristics, the action execution sequence can be: 3 minutes 12 seconds to pick up the cup from the spice rack-3 minutes 15 seconds to move the cup above the pot-3 minutes 16 seconds to trigger the dosing action-3 minutes 20 seconds to move the cup to the spice rack. This mode can record the action information when the action changes. Here, the action execution result is equivalent to the determination result of whether the action is successfully executed. For example, the displacement indicates the execution of the moving action, the docking exists, which indicates the execution of the docking action, and the dosing indicates the execution of the dosing action.

[0093] It can be understood that the above action execution sequence can reflect whether the user exists the preset interaction action, but it does not necessarily mean that the operation object triggers the preset interaction action. As a special case, although the action execution sequence exists the discharging action, the discharging action does not reach the trigger condition of opening the discharging, which may be that the vibration amplitude does not reach the threshold, or the discharging port is not docked to the kitchen equipment, and further the execution result of the action is needed to reflect whether the operation object truly triggers the preset interaction action. Specifically, for each action in the action execution sequence, according to the execution result of the action, the matching index of the action and the preset interaction action is identified, it is judged whether the action execution sequence contains an action with a matching index reaching a preset value, if so, it is determined that the action execution sequence contains the preset interaction action triggered by the operation object. For example, the preset interaction action is that the pressure value of the squeezing of the material cup reaches a preset threshold, if the action execution sequence contains the action of squeezing the material cup, but the pressure value of squeezing the material cup does not reach the preset threshold, it means that the matching index of the action and the preset interaction action does not reach the preset value, only when the pressure value of squeezing the material cup reaches the preset value, it means that the action execution sequence contains an action with a matching index reaching a preset value, and it is determined that the operation object triggers the preset interaction action.

[0094] In actual application scenarios, after monitoring that the operation object triggers the preset interaction action, in order to judge the interaction effect of the preset interaction action, the execution parameter associated with triggering the preset interaction action can also be obtained, which is equivalent to the execution information of the action, such as the moving distance of the moving action, the docking degree of the docking action, the discharging speed and discharging time of the discharging action, and other execution information, further judge whether the execution result parameter reaches the preset interaction result of the triggering device, which is equivalent to the condition set for the preset interaction action, which can usually include time condition, measurement condition or effect condition, etc. For example, the discharging amount reaches 10g, the stir-frying time is 1 minute, and the frying is golden yellow on both sides, etc. If the execution result parameter reaches the preset interaction result of the kitchen, the kitchen device is controlled to execute the subsequent cooking operation, for example, the discharging amount reaches 10g, which means that the interaction information of the discharging action is completed, and the subsequent cooking operation is further executed. If the execution result parameter does not reach the preset interaction result of the kitchen, the result is determined according to the demand of the interaction information, and the interaction information is processed, for example, the discharging amount does not reach 10g, which means that although the operation object triggers the discharging action, the discharging amount may be 5g. Of course, this may be the user intentionally set discharging amount, or the user may only complete 5g of discharging amount within the specified time. Since the discharging action is a non-demand execution information, the discharging amount can be adjusted in the subsequent cooking operation, and the subsequent cooking operation can also be selected not to be executed based on the already executed discharging amount. The specific determination can be made according to the actual demand of the user.

[0095] Since the kitchen equipment does not require the user to perform interactive actions for all cooking processes, for example, equipment heat preservation process, equipment self-cleaning process, etc., in the process of obtaining the interactive information of the kitchen equipment, the interactive actions required by the user in the cooking process of the kitchen equipment can be obtained, and the operation object and operation details of the operation object involved in the interactive actions are associated according to the interactive actions required by the user, to obtain the interactive information of the kitchen equipment. Here, the operation details of the operation object can be the action details of the ingredient cup returning to the original position. The placement of the ingredient cup at different positions represents the seasoning adding state. For example, the placement of the ingredient cup at position A represents that the adding action is completed, and the placement of the ingredient cup at position B represents that the seasoning needs to be added. It can also be the action details of adapting to different tastes. For example, if the user prefers sweet, the number or time of adding sugar by the ingredient cup is greater than the standard value. It can also be the action details related to the viscosity of the food material. For example, in the case of a food material with high viscosity, the stirring angle or stirring intensity of the spatula is larger. Interactive determination is made for the cooking process of each cooking step in the electronic recipe in combination with the function of the kitchen equipment. For the kitchen equipment with the function of automatically adjusting the heating temperature, the user does not need to perform interactive actions. For the cooking equipment without the function of automatically adjusting the heating temperature, the cooking process of the cooking step requires the user to perform interactive actions. Further, the operation object and operation details of the operation object involved in the cooking process of the cooking step are associated to form the interactive information of the kitchen equipment. For example, the cooking process of the cooking step is frying until the seasoning is melted into the dish. It can be determined that the operation object is a spatula or a frying spoon and the operation details are related actions such as stirring.

[0096] The determination process of the demand determination result of the interaction information can determine the demand of the interaction information by using the participation attribute of the interaction information on the interaction demand, to obtain the demand determination result of the interaction information. The participation attribute of the interaction information on the interaction demand is equivalent to the influence degree of the interaction information on the cooking process. The influence degree of the interaction information on the cooking process can be obtained by using the participation attribute of the interaction information on the interaction demand. Whether the interaction information needs a cooking compensation operation is further determined according to the influence degree of the interaction information on the cooking process. If yes, it indicates that the interaction information affects the subsequent cooking step, and the demand determination result of the interaction information is determined as demand execution information, which needs to be compensated by the user executing a preset interaction action or adjusting the subsequent cooking step. Otherwise, it indicates that the interaction information does not affect the subsequent cooking step, and the demand determination result of the interaction information is determined as non-demand execution information. If the demand determination result of the interaction information is the demand execution information, the interaction information is generated and pushed to the interaction prompt, and the cooking operation of the subsequent kitchen equipment is adjusted. The user can be reminded to execute the interaction information by pushing the interaction information, and the cooking operation of the subsequent kitchen equipment can be adjusted. The subsequent kitchen equipment can be added to execute the interaction information, or the user can execute the interaction information in the subsequent cooking process. Here, no limitation is made. If the demand determination result of the interaction information is the non-demand execution information, the interaction information is skipped, and no cooking operation needs to be adjusted. For example, the interaction information is 5g of material feeding. If the feeding action of the interaction information is not executed, the dish effect will be affected, and the user needs to execute the feeding operation, or the user compensates the feeding operation of 5g in the subsequent cooking step, or the kitchen equipment is associated with the subsequent ingredient equipment to compensate the feeding operation of 5g, and the like. The interaction information is stir-frying and collecting juice. The stir-frying operation can assist the juice collection effect, but the stir-frying operation does not need subsequent compensation operation. If the stir-frying action of the interaction information is not executed, the dish effect will not be affected.

[0097] Specifically, in the adjustment of the cooking operation process of the subsequent kitchen equipment, the cooking demand information of the operation object of the interaction information on the preset interaction action can be extracted by analyzing the interaction information, and the cooking operation of the subsequent kitchen equipment is adjusted according to the kitchen equipment associated with the cooking demand information. Here, the cooking demand information can be the execution effect and / or execution time of the interaction information on the interaction action, such as frying both sides to golden yellow, frying steak to five minutes, or boiling for 10 minutes, etc. The cooking demand information can be determined by the user himself, and can also be completed by the kitchen equipment with corresponding function, such as determining whether the color condition is met by the kitchen equipment with color detection function, and determining whether the time condition is met by the kitchen equipment with time detection function.

[0098] In the processing process of specific interaction information, the time sequence diagram of the communication between the client and the server for the kitchen equipment and / or the intelligent equipment is as shown in Figure 1 The client can be the display end of the kitchen equipment and / or the intelligent equipment, and the server can be the background end of the kitchen equipment and / or the intelligent equipment. First, the communication connection between the client and the server is established, the interaction information of the interaction action involved in the cooking step is pushed to the client by the server, so that the client prompts the user to execute the interaction action in the cooking process after viewing the interaction information, and the server can determine whether the operation object of the interaction information triggers the preset interaction action within the preset time length. If not, the interaction information is processed according to the demand determination result of the interaction information.

[0099] Further, as a specific implementation of the above method, the embodiment of the present application provides an interaction information processing device, which can be applied to the server end of the intelligent kitchen, as shown in Figure 2 The interaction information processing device comprises a first acquisition module 21, a monitoring module 22 and a processing module 23.

[0100] The first acquisition module 21 can be used to acquire the interaction information of the kitchen equipment.

[0101] The monitoring module 22 can be used to monitor whether the operation object of the interaction information triggers the preset interaction action within the preset time length.

[0102] The processing module 23 can be used to process the interaction information according to the demand determination result of the interaction information if not.

[0103] The processing device of interactive information provided by the application can process the interactive information in time, reduce the operation burden of the user in the cooking process, and improve the expected effect of the interactive information, compared with the prior art which executes the feedback of the user to the interactive information by triggering confirmation.

[0104] In a specific application scenario, the monitoring module 22 comprises:

[0105] The monitoring unit can be configured to monitor action information triggered by the user to the operation object by using a sensing device associated with the operation object.

[0106] The first judging unit can be configured to judge whether the preset interactive action triggered by the operation object is contained in the action information by analyzing the action information.

[0107] In a specific application scenario, the first judging unit comprises:

[0108] The splitting sub-unit can be configured to split the action information into an action execution sequence and an execution result of the action triggered by the user to the operation object by analyzing the action information.

[0109] The judging sub-unit can be configured to judge whether the preset interactive action triggered by the operation object is contained in the action execution sequence according to the execution result of the action.

[0110] In a specific application scenario, the judging sub-unit can be specifically configured to identify a matching index of the action and the preset interactive action according to the execution result of the action.

[0111] The judging sub-unit can be specifically configured to judge whether the action execution sequence contains the action with the matching index reaching a preset value.

[0112] The judging sub-unit can be specifically configured to judge that the action execution sequence contains the preset interactive action triggered by the operation object if yes.

[0113] In a specific application scenario, the device further comprises:

[0114] The second obtaining module can be configured to obtain an execution result parameter associated with the preset interactive action if the operation object mapped by the interactive information triggers the preset interactive action within the preset time period.

[0115] The judgment module can be used to judge whether the execution result parameter reaches a preset interaction result of the kitchen device.

[0116] The control module can be used to control the kitchen device to perform a subsequent cooking operation if yes; otherwise, process the interaction information according to a demand determination result of the interaction information.

[0117] In a specific application scenario, the first obtaining module 21 includes:

[0118] The first obtaining unit can be used to obtain an interaction action required for a user to perform in a cooking process of the kitchen device.

[0119] The association unit can be used to associate an operation object and an operation object action detail involved in the interaction action according to the interaction action required for the user to perform, to obtain interaction information of the kitchen device.

[0120] In a specific application scenario, the apparatus further includes:

[0121] The determination module can be used to determine a demand of the interaction information according to a participation attribute of the interaction information on an interaction demand, to obtain a demand determination result of the interaction information, before processing the interaction information according to the demand determination result of the interaction information.

[0122] The determination module includes:

[0123] The second obtaining unit can be used to obtain an influence degree of the interaction information on the cooking process by using the participation attribute of the interaction information on the interaction demand.

[0124] The second judgment unit can be used to judge whether the interaction information requires a cooking compensation operation according to the influence degree of the interaction information on the cooking process.

[0125] The determination unit can be used to determine that the demand determination result of the interaction information is demand execution information if yes; otherwise, determine that the demand determination result of the interaction information is non-demand execution information.

[0126] In a specific application scenario, the processing module 23 can be specifically used to generate interaction prompt information from the interaction information and push the interaction prompt information and adjust a subsequent cooking operation of the kitchen device if the demand determination result of the interaction information is demand execution information.

[0127] The processing module 23 can be specifically used to skip execution of the interaction information if the demand determination result of the interaction information is non-demand execution information.

[0128] In a specific application scenario, the processing module 23 can be further configured to extract the cooking demand information of the interaction information mapping operation object on the preset interaction action by analyzing the interaction information.

[0129] The processing module 23 can be further configured to adjust the cooking operation of the subsequent kitchen equipment according to the kitchen equipment associated with the cooking demand information.

[0130] In an example embodiment, referring to Figure 3 A device is also provided, which includes a communication bus, a processor, a memory and a communication interface, and can further include an input / output interface and a display device, wherein the communication between the functional units can be completed through the bus. The memory stores a computer program, and the processor is configured to execute the program stored in the memory to execute the processing method of the interaction information in the above embodiment.

[0131] A computer readable storage medium, which stores a computer program, the computer program is executed by a processor to implement the steps of the processing method of the interaction information.

[0132] Through the above description of the embodiments, those skilled in the art can clearly understand that the present application can be implemented by hardware, or by means of software and necessary general hardware platform. Based on such understanding, the technical solutions of the present application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a U disk, a mobile hard disk, etc.), and includes a plurality of instructions to make a computer device (which can be a personal computer, a server, or a network device, etc.) execute the methods described in various embodiments of the present application.

[0133] Those skilled in the art can understand that the drawings are only a schematic of a preferred embodiment, and the modules or processes in the drawings are not necessarily required for implementing the present application.

[0134] Those skilled in the art can understand that the modules in the device in the embodiment can be distributed in the device in the embodiment as described in the embodiment, or can be changed and located in one or more devices different from the embodiment. The modules in the above embodiment can be combined into one module, or can be further split into a plurality of sub-modules.

[0135] The above application number is only for description, not representing the advantages and disadvantages of the embodiment.

[0136] The above disclosure is only a few specific embodiments of the present application, but the present application is not limited thereto, and any changes that can be thought of by those skilled in the art should fall within the protection scope of the present application.

Claims

1. A method of processing interactive information, characterized by, The method comprises the following steps: acquiring interaction information of a kitchen device; monitoring whether an operation object mapped by the interaction information triggers a preset interaction action within a preset time length; if not, performing demand judgment on the interaction information according to a participation attribute of the interaction information on interaction demand, to obtain a demand judgment result of the interaction information; processing the interaction information according to the demand judgment result of the interaction information; the specific process of performing demand judgment on the interaction information according to the participation attribute of the interaction information on interaction demand to obtain a demand judgment result of the interaction information comprises the following steps:

2. The method of claim 1, wherein, acquiring an influence degree of the interaction information on a cooking process according to the participation attribute of the interaction information on interaction demand; judging whether the interaction information needs a cooking compensation operation according to the influence degree of the interaction information on the cooking process; if yes, determining that the demand judgment result of the interaction information is demand execution information; otherwise, determining that the demand judgment result of the interaction information is non-demand execution information. the specific process of monitoring whether an operation object mapped by the interaction information triggers a preset interaction action within a preset time length comprises the following steps:

3. The method of claim 2, wherein, monitoring action information triggered by a user on the operation object by using a sensing device associated with the operation object; judging whether the preset interaction action triggered on the operation object is contained in the action information by analyzing the action information. the specific process of judging whether the preset interaction action triggered on the operation object is contained in the action information by analyzing the action information comprises the following steps:

4. The method of claim 3, wherein, splitting the action information into an action execution sequence and an execution result of the action triggered by the user on the operation object by analyzing the action information; judging whether the preset interaction action triggered on the operation object is contained in the action execution sequence according to the execution result of the action. the specific process of judging whether the preset interaction action triggered on the operation object is contained in the action execution sequence according to the execution result of the action comprises the following steps: identifying a matching index of the action and the preset interaction action according to the execution result of the action; 5. The method of claim 1, wherein, judging whether the action execution sequence contains an action with the matching index reaching a preset value; if yes, determining that the action execution sequence contains the preset interaction action triggered on the operation object. after the step of monitoring whether an operation object mapped by the interaction information triggers a preset interaction action within a preset time length, the method further comprises the following steps: if yes, acquiring an execution result parameter associated with the preset interaction action; 6. The method according to any one of claims 1-5, characterized in that, judging whether the execution result parameter reaches a preset interaction result of the kitchen device; if yes, controlling the kitchen device to perform a subsequent cooking operation; otherwise, processing the interaction information according to the demand judgment result of the interaction information. the specific process of acquiring interaction information of a kitchen device comprises the following steps:

7. The method of claim 1, wherein, acquiring an interaction action that needs to be performed by a user in a cooking process of the kitchen device; associating an operation object and action details of the operation object involved in the interaction action according to the interaction action that needs to be performed by the user, to obtain the interaction information of the kitchen device. the specific process of processing the interaction information according to the demand judgment result of the interaction information comprises the following steps: If the requirement determination result of the interaction information is requirement execution information, the interaction information is generated into interaction prompt information for pushing and adjusting the cooking operation of the subsequent kitchen equipment; If the requirement determination result of the interaction information is non-requirement execution information, the execution of the interaction information is skipped.

8. The method of claim 7, wherein, The adjustment of the cooking operation of the subsequent kitchen equipment specifically includes: By analyzing the interaction information, the cooking requirement information of the interaction information mapping operation object on the preset interaction action is extracted; According to the kitchen equipment associated with the cooking requirement information, the cooking operation of the subsequent kitchen equipment is adjusted.

9. A device comprising a memory and a processor, the memory storing a computer program, characterized in that, The processor executes the computer program to realize the steps of the method in any one of claims 1 to 8.

10. A readable storage medium, having stored thereon a computer program, characterized in that, The computer program is executed by the processor to realize the steps of the method in any one of claims 1 to 8.

Images