Milk preparation control method and system based on multi-source information
By setting multiple sensors on the milk maker to acquire user information and using data prediction algorithms to determine user identity and operating scenarios, and generating component control commands, the problem of insufficient intelligence in existing milk makers is solved, and more efficient and intelligent milk maker control is achieved.
Patent Information
- Application Number
- CN202411109999.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-14
- Publication Date
- 2024-11-05
- Estimated Expiration
- 2044-08-14
AI Technical Summary
Existing formula makers do not make full use of multiple sensor modules to determine user identity or predict operation scenarios, resulting in a lack of intelligent user experience and an inability to effectively provide intelligent formula preparation services.
By setting multiple sensors on the milk maker, various sensory information of the user is obtained. Data prediction algorithms are used to predict the user's identity and operation scenario, and corresponding component control commands are generated to achieve intelligent control.
It improves the automation level and user experience of the milk maker, and achieves more efficient and intelligent control of the milk maker.
Smart Images

Figure CN118642392B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of data processing, and in particular to a milk preparation control method and system based on multi-source information. Background Art
[0002] With the development of data processing technology and the improvement of intelligent algorithm technology, more and more household appliances have begun to introduce intelligent sensors or processors to improve the degree of intelligence, so as to bring better user experience. Among them, milk makers are essential facilities for families with infants and young children to take care of, and some businesses have also begun to introduce intelligent modules to improve their user experience. However, existing milk preparation facilities such as milk makers do not make full use of a variety of sensor modules to determine the identity of the user or predict the user's operation scenario. Most of them still rely on the user's instructions to perform the task of making milk or cleaning after making milk. Users often have the task of taking care of infants and young children while using milk makers. Therefore, the solutions of the prior art cannot effectively provide users with more intelligent milk making services. It can be seen that the prior art has defects that need to be solved urgently. Summary of the invention
[0003] The technical problem to be solved by the present invention is to provide a milk preparation control method and system based on multi-source information, which can achieve more efficient and intelligent milk preparation machine control, improve the automation level of the milk preparation machine, and bring better user experience.
[0004] In order to solve the above technical problems, the first aspect of the present invention discloses a milk preparation control method based on multi-source information, the method comprising:
[0005] Acquire multiple sensor information of the current user through multiple sensors arranged on the milk maker;
[0006] Predicting the user identity and operation scenario of the current user based on the multiple sensing information and a data prediction algorithm;
[0007] Determining a working strategy corresponding to the milk maker according to the user identity and the operation scenario;
[0008] According to the working strategy, a plurality of component control instructions corresponding to the milk maker are generated and sent to the milk maker for execution.
[0009] As an optional implementation, in the first aspect of the present invention, the component control instructions are water outlet control instructions, water pump control instructions, heating control instructions, stirring control instructions and self-cleaning control instructions.
[0010] As an optional implementation, in the first aspect of the present invention, the multiple sensing information includes position sensing information, image sensing information, infrared reflection information and sound information.
[0011] As an optional implementation, in the first aspect of the present invention, predicting the user identity and operation scenario of the current user based on the multiple sensor information and a data prediction algorithm includes:
[0012] Determining the user identity of the current user based on a data prediction neural network according to the image sensing information, the infrared reflection information and the sound information;
[0013] Determining a user area of the current user according to the position sensing information and a correspondence between a preset position and an area;
[0014] According to the user area and the user identity, based on the correspondence between preset areas and identities and scenes, the operation scene of the current user is determined.
[0015] As an optional implementation, in the first aspect of the present invention, determining the user identity of the current user based on the image sensing information, the infrared reflection information and the sound information and based on a data prediction neural network includes:
[0016] Inputting the image sensing information into a trained first recognition neural network to obtain a first predicted user set as an output; the first recognition neural network is trained by a training data set including a plurality of training image information and corresponding user identity labels;
[0017] Inputting the infrared reflection information into a trained second recognition neural network to obtain a second predicted user set as an output; the second recognition neural network is trained by a training data set including a plurality of training infrared reflection information and corresponding user identity labels;
[0018] Inputting the sound information into a trained third recognition neural network to obtain a third predicted user set as an output; the third recognition neural network is trained by a training data set including a plurality of training sound information and corresponding user identity labels;
[0019] An intersection of the first predicted user set, the second predicted user set, and the third predicted user set is calculated to obtain a user identity of the current user.
[0020] As an optional implementation, in the first aspect of the present invention, the operation scene includes at least one of a bedroom milk making scene, a kitchen milk making scene, a morning milk making scene, an evening milk making scene, and a milk supplementation scene.
[0021] As an optional implementation, in the first aspect of the present invention, determining the working strategy corresponding to the milk maker according to the user identity and the operation scenario includes:
[0022] According to the operation scenario and the correspondence between the preset scenario and the milk preparation requirement, the milk preparation requirement corresponding to the operation scenario is determined; the milk preparation requirement includes the milk preparation temperature, the milk preparation concentration and the milk preparation stirring degree;
[0023] According to the user identity and the correspondence between the preset identity and the milk making tendency, the milk making tendency corresponding to the user identity is determined; the milk making tendency includes the milk making time tendency and the washing degree tendency after milk making;
[0024] The milk preparation demand and the milk preparation tendency are determined as a working strategy corresponding to the milk preparation device.
[0025] As an optional implementation, in the first aspect of the present invention, generating a plurality of component control instructions corresponding to the milk maker according to the working strategy includes:
[0026] Determine that the objective function is that the temperature difference, concentration difference, and duration difference corresponding to the milk preparation instruction set are all minimized; the temperature difference is the difference between the milk temperature after the milk preparation instruction set is executed and the milk preparation temperature; the concentration difference is the difference between the milk concentration after the milk preparation instruction set is executed and the milk preparation concentration; the duration difference is the difference between the execution duration of the milk preparation instruction set and the milk preparation duration tendency;
[0027] Determining the restriction conditions includes that the stirring degree corresponding to the stirring control instruction in the milk making instruction set is greater than the milk making stirring degree, the execution order of all instructions in the milk making instruction set conforms to the preset milk making instruction order, and the cleaning degree corresponding to the self-cleaning control instruction in the milk making instruction set is greater than the cleaning degree tendency after milk making;
[0028] Based on the objective function and the constraint conditions, the milk preparation instruction set corresponding to the milk preparation device is repeatedly iterated and calculated according to the particle swarm algorithm, and the milk temperature, milk concentration and execution time corresponding to each generated milk preparation instruction set are predicted by the trained neural network until the optimal milk preparation instruction set is calculated; the trained neural network is trained by a labeled training data set including multiple training instruction sets and corresponding milk temperatures, milk concentrations and execution times after execution;
[0029] All instructions in the optimal milk making instruction set are determined as a plurality of component control instructions corresponding to the milk making machine.
[0030] A second aspect of an embodiment of the present invention discloses a milk preparation control system based on multi-source information, the system comprising:
[0031] An acquisition module, used for acquiring multiple sensor information of the current user through multiple sensors arranged on the milk maker;
[0032] A prediction module, configured to predict the user identity and operation scenario of the current user based on the plurality of sensor information and a data prediction algorithm;
[0033] A determination module, used to determine a working strategy corresponding to the milk maker according to the user identity and operation scenario;
[0034] The control module is used to generate a plurality of component control instructions corresponding to the milk maker according to the working strategy, and send the control instructions to the milk maker for execution.
[0035] As an optional implementation, in the second aspect of the present invention, the component control instructions are water outlet control instructions, water pump control instructions, heating control instructions, stirring control instructions and self-cleaning control instructions.
[0036] As an optional implementation, in the second aspect of the present invention, the multiple sensing information includes position sensing information, image sensing information, infrared reflection information and sound information.
[0037] As an optional implementation, in the second aspect of the present invention, the prediction module predicts the user identity and operation scenario of the current user based on the multiple sensor information and the data prediction algorithm, including:
[0038] Determining the user identity of the current user based on a data prediction neural network according to the image sensing information, the infrared reflection information and the sound information;
[0039] Determining a user area of the current user according to the position sensing information and a correspondence between a preset position and an area;
[0040] According to the user area and the user identity, based on the correspondence between preset areas and identities and scenes, the operation scene of the current user is determined.
[0041] As an optional implementation, in the second aspect of the present invention, the prediction module determines the specific manner of the user identity of the current user based on the data prediction neural network according to the image sensing information, the infrared reflection information and the sound information, including:
[0042] Inputting the image sensing information into a trained first recognition neural network to obtain a first predicted user set as an output; the first recognition neural network is trained by a training data set including a plurality of training image information and corresponding user identity labels;
[0043] Inputting the infrared reflection information into a trained second recognition neural network to obtain a second predicted user set as an output; the second recognition neural network is trained by a training data set including a plurality of training infrared reflection information and corresponding user identity labels;
[0044] Inputting the sound information into a trained third recognition neural network to obtain a third predicted user set as an output; the third recognition neural network is trained by a training data set including a plurality of training sound information and corresponding user identity labels;
[0045] An intersection of the first predicted user set, the second predicted user set, and the third predicted user set is calculated to obtain a user identity of the current user.
[0046] As an optional implementation, in the second aspect of the present invention, the operation scene includes at least one of a bedroom milk making scene, a kitchen milk making scene, a morning milk making scene, an evening milk making scene, and a milk supplementation scene.
[0047] As an optional implementation, in the second aspect of the present invention, the specific manner in which the determination module determines the working strategy corresponding to the milk maker according to the user identity and the operation scenario includes:
[0048] According to the operation scenario and the correspondence between the preset scenario and the milk preparation requirement, the milk preparation requirement corresponding to the operation scenario is determined; the milk preparation requirement includes the milk preparation temperature, the milk preparation concentration and the milk preparation stirring degree;
[0049] According to the user identity and the correspondence between the preset identity and the milk making tendency, the milk making tendency corresponding to the user identity is determined; the milk making tendency includes the milk making time tendency and the washing degree tendency after milk making;
[0050] The milk preparation demand and the milk preparation tendency are determined as a working strategy corresponding to the milk preparation device.
[0051] As an optional implementation, in the second aspect of the present invention, the specific manner in which the control module generates the control instructions for the multiple components corresponding to the milk maker according to the working strategy includes:
[0052] Determine that the objective function is that the temperature difference, concentration difference, and duration difference corresponding to the milk preparation instruction set are all minimized; the temperature difference is the difference between the milk temperature after the milk preparation instruction set is executed and the milk preparation temperature; the concentration difference is the difference between the milk concentration after the milk preparation instruction set is executed and the milk preparation concentration; the duration difference is the difference between the execution duration of the milk preparation instruction set and the milk preparation duration tendency;
[0053] Determining the restriction conditions includes that the stirring degree corresponding to the stirring control instruction in the milk making instruction set is greater than the milk making stirring degree, the execution order of all instructions in the milk making instruction set conforms to the preset milk making instruction order, and the cleaning degree corresponding to the self-cleaning control instruction in the milk making instruction set is greater than the cleaning degree tendency after milk making;
[0054] Based on the objective function and the constraint conditions, the milk preparation instruction set corresponding to the milk preparation device is repeatedly iterated and calculated according to the particle swarm algorithm, and the milk temperature, milk concentration and execution time corresponding to each generated milk preparation instruction set are predicted by the trained neural network until the optimal milk preparation instruction set is calculated; the trained neural network is trained by a labeled training data set including multiple training instruction sets and corresponding milk temperatures, milk concentrations and execution times after execution;
[0055] All instructions in the optimal milk making instruction set are determined as a plurality of component control instructions corresponding to the milk making machine.
[0056] The third aspect of the present invention discloses another milk preparation control system based on multi-source information, the system comprising:
[0057] A memory storing executable program code;
[0058] a processor coupled to the memory;
[0059] The processor calls the executable program code stored in the memory to execute part or all of the steps in the milk preparation control method based on multi-source information disclosed in the first aspect of the present invention.
[0060] The fourth aspect of the present invention discloses a computer storage medium, which stores computer instructions. When the computer instructions are called, they are used to execute some or all steps in the milk preparation control method based on multi-source information disclosed in the first aspect of the present invention.
[0061] Compared with the prior art, the embodiments of the present invention have the following beneficial effects:
[0062] The present invention can predict the user identity and operation scenario based on multiple sensor information of the current user, and then determine the corresponding working strategy of the milk maker based on the user identity and the operation scenario, so as to generate multiple component control instructions corresponding to the milk maker to achieve more intelligent control, thereby achieving more efficient and smarter control of the milk maker, improving the degree of automation of the milk maker, and bringing a better user experience to the user. BRIEF DESCRIPTION OF THE DRAWINGS
[0063] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.
[0064] Figure 1 It is a flow chart of a milk preparation control method based on multi-source information disclosed in an embodiment of the present invention.
[0065] Figure 2 It is a structural schematic diagram of a milk preparation control system based on multi-source information disclosed in an embodiment of the present invention.
[0066] Figure 3 It is a structural schematic diagram of another milk preparation control system based on multi-source information disclosed in an embodiment of the present invention. DETAILED DESCRIPTION
[0067] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0068] The terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, device, product or equipment that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units that are not listed, or may optionally include other steps or units that are inherent to these processes, methods, products or equipment.
[0069] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present invention. The appearance of the phrase in various places in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.
[0070] The present invention discloses a milk preparation control method and system based on multi-source information, which can predict the user identity and operation scenario based on multiple sensor information of the current user, and then determine the working strategy corresponding to the milk preparation machine based on the user identity and the operation scenario, so as to generate multiple component control instructions corresponding to the milk preparation machine to achieve more intelligent control, thereby achieving more efficient and more intelligent milk preparation machine control, improving the automation degree of the milk preparation machine, and bringing better user experience. The following are detailed descriptions.
[0071] Embodiment 1
[0072] See also Figure 1 , Figure 1 : is a flow chart of a milk preparation control method based on multi-source information disclosed in an embodiment of the present invention. Figure 1 The described milk preparation control method based on multi-source information can be applied to a data processing system / data processing device / data processing server (wherein the server includes a local processing server or a cloud processing server). Figure 1 As shown, the milk preparation control method based on multi-source information may include the following operations:
[0073] 101. Acquire multiple sensor information of the current user through multiple sensors arranged on the milk maker.
[0074] 102. According to the multiple sensor information and based on the data prediction algorithm, the user identity and operation scenario of the current user are predicted.
[0075] 103. Determine the corresponding working strategy of the milk maker based on the user identity and operation scenario.
[0076] 104. Generate multiple component control instructions corresponding to the milk maker according to the working strategy, and send them to the milk maker for execution.
[0077] It can be seen that the above-mentioned embodiments of the invention can predict the user identity and operation scenario based on multiple sensor information of the current user, and then determine the corresponding working strategy of the milk maker based on the user identity and the operation scenario, so as to generate multiple component control instructions corresponding to the milk maker to achieve more intelligent control, thereby achieving more efficient and smarter control of the milk maker, improving the degree of automation of the milk maker, and bringing a better user experience to the user.
[0078] As an optional embodiment, in the above steps, the component control instructions are water outlet control instructions, water pump control instructions, heating control instructions, stirring control instructions and self-cleaning control instructions.
[0079] It can be seen that through the above optional embodiments, the types of component control instructions are clarified, which can more comprehensively realize the control of the milk maker, assist in realizing more efficient and intelligent control of the milk maker, improve the degree of automation of the milk maker, and bring better user experience.
[0080] As an optional embodiment, in the above steps, the multiple sensing information includes position sensing information, image sensing information, infrared reflection information and sound information.
[0081] It can be seen that through the above optional embodiments, the type of sensor information is clarified, which can more comprehensively characterize the user situation, improve the accuracy of user identity and operation prediction, assist in achieving more efficient and intelligent control of the milk maker, improve the degree of automation of the milk maker, and bring better user experience.
[0082] As an optional embodiment, in the above steps, predicting the user identity and operation scenario of the current user based on the data prediction algorithm according to the multiple sensor information includes:
[0083] According to the image sensing information, infrared reflection information and sound information, the user identity of the current user is determined based on the data prediction neural network;
[0084] Determine the user area of the current user according to the position sensing information and the correspondence between the preset position and the area;
[0085] According to the user area and user identity, based on the preset correspondence between the area and identity and the scene, the operation scene of the current user is determined.
[0086] It can be seen that through the above-mentioned optional embodiments, the user identity can be predicted based on a variety of sensor information through a neural network algorithm, and then the operation scenario of the current user can be determined by determining the user's location area and the correspondence between the preset area and identity and the scenario, so as to facilitate the subsequent determination of more accurate working strategies and control instructions, assist in achieving more efficient and intelligent control of the milk maker, improve the degree of automation of the milk maker, and bring a better user experience to the user.
[0087] As an optional embodiment, in the above steps, determining the user identity of the current user based on the data prediction neural network according to the image sensing information, the infrared reflection information and the sound information includes:
[0088] Inputting the image sensing information into a trained first recognition neural network to obtain an output first predicted user set; optionally, the first recognition neural network is trained by a training data set including a plurality of training image information and corresponding user identity annotations;
[0089] Inputting the infrared reflection information into a trained second recognition neural network to obtain an output second predicted user set; optionally, the second recognition neural network is trained by a training data set including a plurality of training infrared reflection information and corresponding user identity labels;
[0090] Inputting the sound information into a trained third recognition neural network to obtain a third predicted user set as an output; optionally, the third recognition neural network is trained using a training data set including a plurality of training sound information and corresponding user identity labels;
[0091] The intersection of the first predicted user set, the second predicted user set, and the third predicted user set is calculated to obtain the user identity of the current user.
[0092] It can be seen that through the above-mentioned optional embodiments, the neural network trained by multiple different types of data can predict the possible user sets according to multiple different types of sensor information, and then determine the user identity based on the intersection calculation, so as to facilitate the subsequent determination of more accurate working strategies and control instructions, assist in achieving more efficient and intelligent control of the milk maker, improve the degree of automation of the milk maker, and bring a better user experience to the user.
[0093] As an optional embodiment, in the above steps, the operation scene includes at least one of a bedroom milk making scene, a kitchen milk making scene, a morning milk making scene, an evening milk making scene, and a milk supplement scene.
[0094] It can be seen that through the above optional embodiments, the types of operation scenarios are clarified, which can more comprehensively characterize the characteristics of the user operation scenarios, improve the accuracy of subsequent work strategy determination, assist in achieving more efficient and intelligent milk maker control, improve the degree of automation of the milk maker, and bring better user experience.
[0095] As an optional embodiment, in the above steps, determining the working strategy corresponding to the milk maker according to the user identity and the operation scenario includes:
[0096] According to the operation scenario and the correspondence between the preset scenario and the milk preparation requirement, the milk preparation requirement corresponding to the operation scenario is determined; optionally, the milk preparation requirement includes milk preparation temperature, milk preparation concentration and milk preparation stirring degree;
[0097] According to the user identity and the correspondence between the preset identity and the milk making tendency, the milk making tendency corresponding to the user identity is determined; optionally, the milk making tendency includes the milk making time tendency and the degree of washing after milk making tendency;
[0098] The milk preparation demand and milk preparation tendency are determined as the corresponding working strategy of the milk maker.
[0099] It can be seen that through the above-mentioned optional embodiments, the milk making needs and milk making tendencies corresponding to the milk maker can be determined through the correspondence between the preset scenarios and the milk making needs and the correspondence between the preset identities and the milk making tendencies, so as to accurately guide the work of the milk maker, assist in achieving more efficient and intelligent control of the milk maker, improve the degree of automation of the milk maker, and bring better user experience to users.
[0100] As an optional embodiment, in the above steps, generating multiple component control instructions corresponding to the milk maker according to the working strategy includes:
[0101] Determine that the objective function is that the temperature difference, concentration difference, and time difference corresponding to the milk preparation instruction set are all minimized; optionally, the temperature difference is the difference between the milk temperature after the milk preparation instruction set is executed and the milk preparation temperature; the concentration difference is the difference between the milk concentration after the milk preparation instruction set is executed and the milk preparation concentration; the time difference is the difference between the execution time of the milk preparation instruction set and the milk preparation time tendency;
[0102] Determining the restriction conditions includes that the stirring degree corresponding to the stirring control instruction in the milk preparation instruction set is greater than the stirring degree of milk preparation, the execution order of all instructions in the milk preparation instruction set conforms to the preset milk preparation instruction order, and the cleaning degree corresponding to the self-cleaning control instruction in the milk preparation instruction set is greater than the cleaning degree tendency after milk preparation;
[0103] Based on the objective function and the constraints, according to the particle swarm algorithm, the milk preparation instruction set corresponding to the milk preparation device is repeatedly iterated and calculated, and the milk temperature, milk concentration and execution time corresponding to each generated milk preparation instruction set are predicted through the trained neural network until the optimal milk preparation instruction set is calculated; optionally, the trained neural network is trained by a labeled training data set including multiple training instruction sets and the corresponding milk temperatures, milk concentrations and execution times after execution;
[0104] All instructions in the optimal milk making instruction set are determined as multiple component control instructions corresponding to the milk making machine.
[0105] It can be seen that through the above-mentioned optional embodiments, the objective function and constraint conditions can be determined by analyzing the milk making demand and milk making tendency, and then iterative calculation can be implemented based on the particle swarm algorithm to obtain the optimal set of component control instructions, which can be used to accurately control the operation of the milk maker, achieve more efficient and smarter control of the milk maker, improve the degree of automation of the milk maker, and bring better user experience.
[0106] Embodiment 2
[0107] See also Figure 2 , Figure 2 Schematic diagram of a milk preparation control system based on multi-source information disclosed in an embodiment of the present invention. Figure 2 The described milk preparation control system based on multi-source information can be applied to a data processing system / data processing device / data processing server (wherein the server includes a local processing server or a cloud processing server). Figure 2 As shown, the milk preparation control system based on multi-source information may include:
[0108] The acquisition module 201 is used to acquire multiple sensor information of the current user through multiple sensors arranged on the milk maker.
[0109] The prediction module 202 is used to predict the user identity and operation scenario of the current user based on multiple sensor information and a data prediction algorithm.
[0110] The determination module 203 is used to determine the working strategy corresponding to the milk maker according to the user identity and the operation scenario.
[0111] The control module 204 is used to generate a plurality of component control instructions corresponding to the milk maker according to the working strategy, and send the instructions to the milk maker for execution.
[0112] It can be seen that the above-mentioned embodiments of the invention can predict the user identity and operation scenario based on multiple sensor information of the current user, and then determine the corresponding working strategy of the milk maker based on the user identity and the operation scenario, so as to generate multiple component control instructions corresponding to the milk maker to achieve more intelligent control, thereby achieving more efficient and smarter control of the milk maker, improving the degree of automation of the milk maker, and bringing a better user experience to the user.
[0113] As an optional embodiment, the component control instructions are water outlet control instructions, water pump control instructions, heating control instructions, stirring control instructions and self-cleaning control instructions.
[0114] It can be seen that through the above optional embodiments, the types of component control instructions are clarified, which can more comprehensively realize the control of the milk maker, assist in realizing more efficient and intelligent control of the milk maker, improve the degree of automation of the milk maker, and bring better user experience.
[0115] As an optional embodiment, the multiple sensing information includes position sensing information, image sensing information, infrared reflection information and sound information.
[0116] It can be seen that through the above optional embodiments, the type of sensor information is clarified, which can more comprehensively characterize the user situation, improve the accuracy of user identity and operation prediction, assist in achieving more efficient and intelligent control of the milk maker, improve the degree of automation of the milk maker, and bring better user experience.
[0117] As an optional embodiment, the prediction module predicts the user identity and operation scenario of the current user based on the multiple sensor information and the data prediction algorithm, including:
[0118] According to the image sensing information, infrared reflection information and sound information, the user identity of the current user is determined based on the data prediction neural network;
[0119] Determine the user area of the current user according to the position sensing information and the correspondence between the preset position and the area;
[0120] According to the user area and user identity, based on the preset correspondence between the area and identity and the scene, the operation scene of the current user is determined.
[0121] It can be seen that through the above-mentioned optional embodiments, the user identity can be predicted based on a variety of sensor information through a neural network algorithm, and then the operation scenario of the current user can be determined by determining the user's location area and the correspondence between the preset area and identity and the scenario, so as to facilitate the subsequent determination of more accurate working strategies and control instructions, assist in achieving more efficient and intelligent control of the milk maker, improve the degree of automation of the milk maker, and bring a better user experience to the user.
[0122] As an optional embodiment, the prediction module determines the specific manner of the user identity of the current user based on the data prediction neural network according to the image sensing information, the infrared reflection information and the sound information, including:
[0123] Inputting the image sensing information into a trained first recognition neural network to obtain an output first predicted user set; optionally, the first recognition neural network is trained by a training data set including a plurality of training image information and corresponding user identity annotations;
[0124] Inputting the infrared reflection information into a trained second recognition neural network to obtain an output second predicted user set; optionally, the second recognition neural network is trained by a training data set including a plurality of training infrared reflection information and corresponding user identity labels;
[0125] Inputting the sound information into a trained third recognition neural network to obtain a third predicted user set as an output; optionally, the third recognition neural network is trained using a training data set including a plurality of training sound information and corresponding user identity labels;
[0126] The intersection of the first predicted user set, the second predicted user set, and the third predicted user set is calculated to obtain the user identity of the current user.
[0127] It can be seen that through the above-mentioned optional embodiments, the neural network trained by multiple different types of data can predict the possible user sets according to multiple different types of sensor information, and then determine the user identity based on the intersection calculation, so as to facilitate the subsequent determination of more accurate working strategies and control instructions, assist in achieving more efficient and intelligent control of the milk maker, improve the degree of automation of the milk maker, and bring a better user experience to the user.
[0128] As an optional embodiment, the operation scenario includes at least one of a bedroom milk making scenario, a kitchen milk making scenario, a morning milk making scenario, an evening milk making scenario, and a milk supplement scenario.
[0129] It can be seen that through the above optional embodiments, the types of operation scenarios are clarified, which can more comprehensively characterize the characteristics of the user operation scenarios, improve the accuracy of subsequent work strategy determination, assist in achieving more efficient and intelligent milk maker control, improve the degree of automation of the milk maker, and bring better user experience.
[0130] As an optional embodiment, the determination module determines the specific manner of the working strategy corresponding to the milk maker according to the user identity and the operation scenario, including:
[0131] According to the operation scenario and the correspondence between the preset scenario and the milk preparation requirement, the milk preparation requirement corresponding to the operation scenario is determined; optionally, the milk preparation requirement includes milk preparation temperature, milk preparation concentration and milk preparation stirring degree;
[0132] According to the user identity and the correspondence between the preset identity and the milk making tendency, the milk making tendency corresponding to the user identity is determined; optionally, the milk making tendency includes the milk making time tendency and the degree of washing after milk making tendency;
[0133] The milk preparation demand and milk preparation tendency are determined as the corresponding working strategy of the milk maker.
[0134] It can be seen that through the above-mentioned optional embodiments, the milk making needs and milk making tendencies corresponding to the milk maker can be determined through the correspondence between the preset scenarios and the milk making needs and the correspondence between the preset identities and the milk making tendencies, so as to accurately guide the work of the milk maker, assist in achieving more efficient and intelligent control of the milk maker, improve the degree of automation of the milk maker, and bring better user experience to users.
[0135] As an optional embodiment, the control module generates a specific method of controlling multiple components of the milk maker according to the working strategy, including:
[0136] Determine that the objective function is that the temperature difference, concentration difference, and time difference corresponding to the milk preparation instruction set are all minimized; optionally, the temperature difference is the difference between the milk temperature after the milk preparation instruction set is executed and the milk preparation temperature; the concentration difference is the difference between the milk concentration after the milk preparation instruction set is executed and the milk preparation concentration; the time difference is the difference between the execution time of the milk preparation instruction set and the milk preparation time tendency;
[0137] Determining the restriction conditions includes that the stirring degree corresponding to the stirring control instruction in the milk preparation instruction set is greater than the stirring degree of milk preparation, the execution order of all instructions in the milk preparation instruction set conforms to the preset milk preparation instruction order, and the cleaning degree corresponding to the self-cleaning control instruction in the milk preparation instruction set is greater than the cleaning degree tendency after milk preparation;
[0138] Based on the objective function and the constraints, according to the particle swarm algorithm, the milk preparation instruction set corresponding to the milk preparation device is repeatedly iterated and calculated, and the milk temperature, milk concentration and execution time corresponding to each generated milk preparation instruction set are predicted through the trained neural network until the optimal milk preparation instruction set is calculated; optionally, the trained neural network is trained by a labeled training data set including multiple training instruction sets and the corresponding milk temperatures, milk concentrations and execution times after execution;
[0139] All instructions in the optimal milk making instruction set are determined as multiple component control instructions corresponding to the milk making machine.
[0140] It can be seen that through the above-mentioned optional embodiments, the objective function and constraint conditions can be determined by analyzing the milk making demand and milk making tendency, and then iterative calculation can be implemented based on the particle swarm algorithm to obtain the optimal set of component control instructions, which can be used to accurately control the operation of the milk maker, achieve more efficient and smarter control of the milk maker, improve the degree of automation of the milk maker, and bring better user experience.
[0141] Embodiment 3
[0142] See also Figure 3 , Figure 3 This is another milk preparation control system based on multi-source information disclosed in an embodiment of the present invention. Figure 3 The described milk preparation control system based on multi-source information is applied to a data processing system / data processing device / data processing server (wherein the server includes a local processing server or a cloud processing server). Figure 3 As shown, the milk preparation control system based on multi-source information may include:
[0143] A memory 301 storing executable program codes;
[0144] a processor 302 coupled to the memory 301;
[0145] The processor 302 calls the executable program code stored in the memory 301 to execute the steps of the milk preparation control method based on multi-source information described in the first embodiment.
[0146] Embodiment 4
[0147] An embodiment of the present invention discloses a computer-readable storage medium storing a computer program for electronic data exchange, wherein the computer program enables a computer to execute the steps of the milk preparation control method based on multi-source information described in the first embodiment.
[0148] Embodiment 5
[0149] An embodiment of the present invention discloses a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to enable a computer to execute the steps of the milk preparation control method based on multi-source information described in the first embodiment.
[0150] The above describes specific embodiments of the present specification, and other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the accompanying drawings do not necessarily have to be performed in the specific order or sequential order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.
[0151] The systems, devices, modules or units described in the above embodiments may be implemented by computer chips or entities, or by products with certain functions. A typical implementation device is a computer. Specifically, the computer may be, for example, a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.
[0152] For the convenience of description, the above device is described in various units according to their functions. Of course, when implementing this specification, the functions of each unit can be implemented in the same or multiple software and / or hardware.
[0153] Those skilled in the art will appreciate that the embodiments of this specification may be provided as methods, systems, or computer program products. Therefore, the embodiments of this specification may be in the form of complete hardware embodiments, complete software embodiments, or embodiments in combination with software and hardware. Moreover, the embodiments of this specification may be in the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.
[0154] This specification is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of this specification. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0155] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0156] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.
[0157] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.
[0158] The memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.
[0159] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.
[0160] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.
[0161] This specification may be described in the general context of computer-executable instructions executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform specific tasks or implement specific abstract data types. This specification may also be practiced in distributed computing environments where tasks are performed by remote processing devices connected through a communication network. In a distributed computing environment, program modules may be located in local and remote computer storage media, including storage devices.
[0162] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.
[0163] Finally, it should be noted that the milk preparation control method and system based on multi-source information disclosed in the embodiments of the present invention only disclose the preferred embodiments of the present invention, which are only used to illustrate the technical scheme of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that the technical schemes described in the aforementioned embodiments can still be modified, or some of the technical features can be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical schemes from the spirit and scope of the technical schemes of the embodiments of the present invention.
Claims
1. A milk preparation control method based on multi-source information, characterized in that: The method comprises: Acquire multiple sensor information of the current user through multiple sensors arranged on the milk maker; Predicting the user identity and operation scenario of the current user based on the multiple sensing information and a data prediction algorithm; Determining a working strategy corresponding to the milk maker according to the user identity and the operation scenario includes: According to the operation scenario and the correspondence between the preset scenario and the milk preparation requirement, the milk preparation requirement corresponding to the operation scenario is determined; the milk preparation requirement includes the milk preparation temperature, the milk preparation concentration and the milk preparation stirring degree; According to the user identity and the correspondence between the preset identity and the milk making tendency, the milk making tendency corresponding to the user identity is determined; the milk making tendency includes the milk making time tendency and the washing degree tendency after milk making; Determining the milk preparation demand and the milk preparation tendency as a corresponding working strategy of the milk preparation device; According to the working strategy, a plurality of component control instructions corresponding to the milk maker are generated, including: Determine that the objective function is that the temperature difference, concentration difference, and duration difference corresponding to the milk preparation instruction set are all minimized; the temperature difference is the difference between the milk temperature after the milk preparation instruction set is executed and the milk preparation temperature; the concentration difference is the difference between the milk concentration after the milk preparation instruction set is executed and the milk preparation concentration; the duration difference is the difference between the execution duration of the milk preparation instruction set and the milk preparation duration tendency; Determining the restriction conditions includes that the stirring degree corresponding to the stirring control instruction in the milk making instruction set is greater than the milk making stirring degree, the execution order of all instructions in the milk making instruction set conforms to the preset milk making instruction order, and the cleaning degree corresponding to the self-cleaning control instruction in the milk making instruction set is greater than the cleaning degree tendency after milk making; Based on the objective function and the constraint conditions, the milk preparation instruction set corresponding to the milk preparation device is repeatedly iterated and calculated according to the particle swarm algorithm, and the milk temperature, milk concentration and execution time corresponding to each generated milk preparation instruction set are predicted by the trained neural network until the optimal milk preparation instruction set is calculated; the trained neural network is trained by a labeled training data set including multiple training instruction sets and corresponding milk temperatures, milk concentrations and execution times after execution; All instructions in the optimal milk making instruction set are determined as a plurality of component control instructions corresponding to the milk making machine, and are sent to the milk making machine for execution.
2. The milk preparation control method based on multi-source information according to claim 1, characterized in that: The component control instructions are water outlet control instructions, water pump control instructions, heating control instructions, stirring control instructions and self-cleaning control instructions.
3. The milk preparation control method based on multi-source information according to claim 1, characterized in that: The plurality of sensing information includes position sensing information, image sensing information, infrared reflection information and sound information.
4. The milk preparation control method based on multi-source information according to claim 3, characterized in that: The predicting the user identity and operation scenario of the current user based on the multiple sensor information and a data prediction algorithm includes: Determining the user identity of the current user based on a data prediction neural network according to the image sensing information, the infrared reflection information and the sound information; Determining a user area of the current user according to the position sensing information and a correspondence between a preset position and an area; According to the user area and the user identity, based on the correspondence between the preset area and identity and the scene, the operation scene of the current user is determined.
5. The milk preparation control method based on multi-source information according to claim 4, characterized in that: The determining the user identity of the current user based on the image sensing information, the infrared reflection information and the sound information and based on a data prediction neural network includes: Inputting the image sensing information into a trained first recognition neural network to obtain a first predicted user set as an output; the first recognition neural network is trained by a training data set including a plurality of training image information and corresponding user identity labels; Inputting the infrared reflection information into a trained second recognition neural network to obtain a second predicted user set as an output; the second recognition neural network is trained by a training data set including a plurality of training infrared reflection information and corresponding user identity labels; Inputting the sound information into a trained third recognition neural network to obtain a third predicted user set as an output; the third recognition neural network is trained by a training data set including a plurality of training sound information and corresponding user identity labels; An intersection of the first predicted user set, the second predicted user set, and the third predicted user set is calculated to obtain a user identity of the current user.
6. The milk preparation control method based on multi-source information according to claim 4, characterized in that: The operation scenarios include at least one of a bedroom milk making scene, a kitchen milk making scene, a morning milk making scene, an evening milk making scene, and a milk supplementation scene.
7. A milk preparation control system based on multi-source information, characterized in that: The system comprises: An acquisition module, used for acquiring multiple sensor information of the current user through multiple sensors arranged on the milk maker; A prediction module, configured to predict the user identity and operation scenario of the current user based on the plurality of sensor information and a data prediction algorithm; A determination module, used to determine the working strategy corresponding to the milk maker according to the user identity and the operation scenario, including: According to the operation scenario and the correspondence between the preset scenario and the milk preparation requirement, the milk preparation requirement corresponding to the operation scenario is determined; the milk preparation requirement includes the milk preparation temperature, the milk preparation concentration and the milk preparation stirring degree; According to the user identity and the correspondence between the preset identity and the milk making tendency, the milk making tendency corresponding to the user identity is determined; the milk making tendency includes the milk making time tendency and the washing degree tendency after milk making; Determining the milk preparation demand and the milk preparation tendency as a corresponding working strategy of the milk preparation device; The control module is used to generate a plurality of component control instructions corresponding to the milk maker according to the working strategy, including: Determine that the objective function is that the temperature difference, concentration difference, and duration difference corresponding to the milk preparation instruction set are all minimized; the temperature difference is the difference between the milk temperature after the milk preparation instruction set is executed and the milk preparation temperature; the concentration difference is the difference between the milk concentration after the milk preparation instruction set is executed and the milk preparation concentration; the duration difference is the difference between the execution duration of the milk preparation instruction set and the milk preparation duration tendency; Determining the restriction conditions includes that the stirring degree corresponding to the stirring control instruction in the milk making instruction set is greater than the milk making stirring degree, the execution order of all instructions in the milk making instruction set conforms to the preset milk making instruction order, and the cleaning degree corresponding to the self-cleaning control instruction in the milk making instruction set is greater than the cleaning degree tendency after milk making; Based on the objective function and the constraint conditions, the milk preparation instruction set corresponding to the milk preparation device is repeatedly iterated and calculated according to the particle swarm algorithm, and the milk temperature, milk concentration and execution time corresponding to each generated milk preparation instruction set are predicted by the trained neural network until the optimal milk preparation instruction set is calculated; the trained neural network is trained by a labeled training data set including multiple training instruction sets and corresponding milk temperatures, milk concentrations and execution times after execution; All instructions in the optimal milk making instruction set are determined as a plurality of component control instructions corresponding to the milk making machine, and are sent to the milk making machine for execution.
8. A milk preparation control system based on multi-source information, characterized in that: The system comprises: A memory storing executable program code; a processor coupled to the memory; The processor calls the executable program code stored in the memory to execute the milk preparation control method based on multi-source information as described in any one of claims 1-6.
Citation Information
Patent Citations
Baby automatic nursing system and method
CN108415284A
Coffee brewing method and device and computer readable storage medium
CN111568192A
Milk brewing ratio control method, intelligent brewing equipment and readable storage medium
CN113647826A
Remote control milk brewing method and device based on behavior monitoring and storage medium
CN113892829A
Automatic formula milk maker for home use and control method therefor
WO2016110265A1
