Cooking system, cooking equipment, cooking equipment control method and program
The cooking system automates cooking settings using a model that learns from historical data, improving user convenience by eliminating the need for repeated manual adjustments.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2022-04-11
- Publication Date
- 2026-04-03
AI Technical Summary
Existing cooking systems require users to manually set operation information, which can be cumbersome and inconvenient.
A cooking system that utilizes a cooking setting estimation model to automatically adjust cooking settings based on historical data, allowing users to cook without repeated setting adjustments.
The system enhances user convenience by automating cooking settings, allowing users to cook food according to past settings without manual intervention.
Smart Images

Figure 0007840202000002 
Figure 0007840202000003 
Figure 0007840202000004
Abstract
Description
Technical Field
[0001] The present disclosure relates to a cooking system, cooking equipment, a cooking equipment control method, and a program.
Background Art
[0002] A system has been proposed in which a plurality of pieces of operation information regarding a plurality of operations received by equipment are associated with an instruction sentence and stored in an operation information database, and when an instruction sentence is input, a part of the plurality of pieces of operation information associated with the input instruction sentence is extracted, and a control command for executing the extracted operation information is generated and transmitted to the equipment (see, for example, Patent Document 1). For example, by associating operation information indicating an operation level and an operation duration when cooking curry with an IH cooking heater in advance with an instruction sentence "cook curry" and storing it in an operation information database, when an instruction sentence "cook curry" is input, the IH cooking heater operates at the operation level and operation duration indicated by the operation information associated with the instruction sentence.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] By the way, in the system described in Patent Document 1, since the user of the equipment needs to set the details of the operation information in advance, there is a risk that the user may feel bothered by the setting work of the operation information. For this reason, there has been a demand to improve the convenience of the user by simplifying the setting work of the operation information by the user.
[0005] This disclosure is made in view of the above-mentioned reasons and aims to provide a cooking system, cooking equipment, cooking equipment control method, and program that can enhance user convenience. [Means for solving the problem]
[0006] To achieve the above objectives, the cooking system relating to this disclosure is A cooking appliance having a heating section for heating the food to be cooked, After cooking has started, each time a control update period arrives for updating the pre-set control content of the heating unit, a cooking setting estimation unit estimates the cooking settings from the transition of cooking settings, including the set heat level when heating the food to be cooked by the heating unit, from the start of cooking to the control update period until the next control update period, using a cooking setting estimation model. A heating control unit controls the heating unit based on the estimated cooking settings, A model generation unit generates cooking setting estimation model information that shows the cooking setting estimation model based on cooking history information including the history of the changes in cooking settings from the start to the end of cooking in the past, A classification unit that classifies multiple cooking history information showing the history of cooking settings from the start to the end of cooking within a predetermined period in the past into multiple cooking setting transition patterns, A recommendation pattern identification unit identifies a cooking setting transition pattern that recommends the generation of the cooking setting estimation model to the user based on the number of cooking history information belonging to each of the plurality of cooking setting transition patterns, Equipped with 、 The model generation unit generates cooking setting estimation model information representing the cooking setting estimation model based on the cooking setting history indicated by the plurality of cooking history information belonging to the identified cooking setting transition pattern. . [Effects of the Invention]
[0007] According to this disclosure, the model generation unit generates cooking setting estimation model information representing the aforementioned cooking setting estimation model based on cooking history information including the history of changes in cooking settings from the start to the end of cooking in the past. The cooking setting estimation unit, after the start of cooking and each time a control update period arrives, uses the cooking setting estimation model to estimate the cooking settings from the changes in cooking settings from the start of cooking to the control update period until the next control update period. The heating control unit 113 then controls the heating unit based on the estimated cooking settings. As a result, the user can cook the food according to the cooking settings used when cooking the food in the past, without having to perform cooking setting work for each time period from the start to the end of cooking, thus improving user convenience. [Brief explanation of the drawing]
[0008] [Figure 1] Schematic diagram of the cooking system according to Embodiment 1 of this disclosure [Figure 2] Block diagram showing the hardware configuration of the cooking system according to Embodiment 1 [Figure 3] Block diagram showing the functional configuration of the cloud server and cooking equipment according to Embodiment 1. [Figure 4] (A) is a diagram showing an example of information stored in the heating setting memory unit according to Embodiment 1, and (B) is a diagram showing an example of information stored in the temperature memory unit according to Embodiment 1. [Figure 5] Diagram illustrating the cooking setting estimation model according to Embodiment 1. [Figure 6] A diagram showing an example of information stored by the history storage unit according to Embodiment 1. [Figure 7] Block diagram showing the functional configuration of the terminal device according to Embodiment 1 [Figure 8] Sequence diagram showing the operation of the cooking system according to Embodiment 1 [Figure 9] Sequence diagram showing the operation of the cooking system according to Embodiment 1 [Figure 10](A) is a diagram showing an example of a part of an operation screen image displayed on the display unit of the terminal device according to Embodiment 1, and (B) is a diagram showing another example of a part of an operation screen image displayed on the display unit of the terminal device according to Embodiment 1 [Figure 11] Sequence diagram showing the operation of the cooking system according to Embodiment 1 [Figure 12] Flowchart showing an example of the flow of cooking history transmission processing executed by the cloud server according to Embodiment 1 [Figure 13] Flowchart showing an example of the flow of cooking equipment control processing executed by the control unit of the cooking equipment according to Embodiment 1 [Figure 14] Flowchart showing an example of the flow of cooking equipment control processing executed by the control unit of the cooking equipment according to Embodiment 1 [Figure 15] Flowchart showing an example of the flow of cooking setting estimation model registration processing executed by the terminal device according to Embodiment 1 [Figure 16] Block diagram showing the functional configurations of the cloud server and the cooking equipment according to Embodiment 2 of the present disclosure [Figure 17] Sequence diagram showing the operation of the cooking system according to Embodiment 2 [Figure 18] Flowchart showing an example of the flow of model transmission processing executed by the cloud server according to Embodiment 2 [Figure 19] Schematic configuration diagram of the cooking system according to the modification example [Figure 20] Sequence diagram showing the operation of the cooking system according to the modification example [Figure 21] (A) is a diagram showing an example of information stored in the heating setting storage unit according to the modification example, and (B) is a diagram showing an example of information stored in the temperature storage unit according to the modification example
Mode for Carrying Out the Invention
[0009] (Embodiment 1) Hereinafter, a cooking system according to an embodiment of the present disclosure will be described with reference to the drawings. The cooking system according to this embodiment includes a cooking appliance having a heating unit for heating an object to be cooked, a cooking setting estimation unit that estimates cooking settings from the transition of cooking settings, including the set heat output when heating the object to be cooked by the heating unit, from the start of cooking to the control update time, each time a control update time arrives after the start of cooking for updating a preset control content of the heating unit, and a heating control unit that controls the heating unit based on the estimated cooking settings.
[0010] As shown in Figure 1, the cooking system according to this embodiment comprises a cooking appliance 1, a cloud server 2, a terminal device 5, and a voice input device 7. The cooking appliance 1, terminal device 5, and voice input device 7 are connected to a local network NW2. The local network NW2 is, for example, a wired LAN (Local Area Network) or a wireless LAN, and is connected to a wide area network NW1 via a router 82 and a data line termination device 81. The data line termination device 81 is a modem, gateway, etc.
[0011] As shown in Figure 2, the cooking appliance 1 includes a control unit 100, a heating unit 11, a heating drive unit 12, an operating unit 17, and a temperature sensor 18. There are multiple types of heating units 11, such as an induction heating unit, a grill heating unit, and a microwave heating unit. The heating drive unit 12 drives the heating unit 11 based on a control signal input from the control unit 100.
[0012] The control unit 100 comprises a CPU (Central Processing Unit) 101, a main memory unit 102, an auxiliary memory unit 103, a neuroengine 104, a local communication unit 106, an interface 107, a timing unit 108, and a bus 109 that connects these units to each other. The main memory unit 102 is composed of volatile memory such as RAM (Random Access Memory) and is used as the working area for the CPU 101. The auxiliary memory unit 103 is composed of non-volatile memory such as semiconductor flash memory and stores programs for realizing various functions of the control unit 100. The neuroengine 104 is hardware dedicated to computational processing using a neural network with a preset number of nodes and layers. The local communication unit 106 is connected to the local network NW2 and sends various information notified by the CPU 101 to the local network NW2, and notifies the CPU 101 of various information received from the local network NW2. Interface 107 is connected to the heating drive unit 12, the operation unit 17, and the temperature sensor 18. When control information for controlling the heating drive unit 12 is input from the CPU 101, interface 107 generates a control signal based on the input control information and outputs it to the heating drive unit 12. The timing unit 108 is, for example, a real-time clock.
[0013] The CPU 101 reads the program stored in the auxiliary storage unit 103 into the main storage unit 102 and executes it, so as shown in Figure 3, it functions as a reception unit 111, a cooking setting change unit 112, a heating control unit 113, a history notification unit 114, a history acquisition unit 115, a model generation unit 116, a command acquisition unit 117, a cooking setting estimation unit 118, a model update unit 119, and a temperature acquisition unit 120. Furthermore, the auxiliary storage unit 103 shown in Figure 2 has a cooking setting storage unit 131, a temperature storage unit 132, and a model storage unit 133, as shown in Figure 3. The cooking setting storage unit 131 stores, for example as shown in Figure 4(A), setting heat information indicating the setting heat P[N] (where N is an integer greater than or equal to 0) used when heating the food to be cooked by the heating unit 11 at each point in time after cooking has started in the cooking appliance 1, and heating unit type information indicating the type of heating unit 11 used to heat the food to be cooked at each point in time, in association with elapsed time information T[N] indicating the elapsed time from the start of cooking to each point in time.
[0014] The temperature memory unit 132 stores, for example as shown in Figure 4(B), measurement temperature information indicating the measurement temperature Th[N] near the object being cooked, measured by the temperature sensor 18 at each point in time after cooking has started in the cooking appliance 1, in association with elapsed time information T[N] indicating the elapsed time up to each point in time after cooking has started.
[0015] The model memory unit 133 stores a cooking setting estimation model for estimating the cooking settings from the transition of cooking settings from the start of cooking of the food to the control update time when the control contents of the heating unit are updated, which is set in advance. The cooking setting estimation model is, for example, a recurrent neural network. In this case, the model memory unit 133 stores information indicating the structure of the cooking setting estimation model and information indicating the weight coefficients in the cooking setting estimation model. The information indicating the structure of the cooking setting estimation model includes information indicating the number of nodes, the number of layers, the weight coefficients corresponding to each node, and the activation function, similar to the family structure estimation model. Here, the weight coefficients include the weight coefficients used when feeding back the output from the layer to which each node belongs to the input. As shown in Figure 5, this cooking setting estimation model has an input layer L110, a hidden layer L120, and an output layer L130. The input layer L110 receives information on the set heat level, the type of heating element, and the measured temperature from the start of cooking of the object to be cooked up to the first point in time after the start of cooking.
[0016] The hidden layer L120 consists of three layers, each containing, for example, a predetermined number N[j] nodes y[j,i,t] (1≦i≦N[j], where N[j] is a positive integer). Here, the output y[2,j,t] of each node, excluding the node immediately following the input layer L110 and the node immediately following the output layer L130, is expressed by the following equation (2).
[0017]
number
[0018] Here, w in [j,i] and w feedback[j,i'] represents the weight coefficients, and f(*) represents the activation function. Also, t represents a positive integer that reflects the number obtained by dividing the elapsed time from the start of cooking to the first time point by a predetermined unit time. Nonlinear functions such as the sigmoid function, ramp function, and step function are used as activation functions. The output of each node at the first time point t is the output of an activation function whose argument is the sum of the sum of the weight coefficients multiplied by the outputs of multiple nodes belonging to the layer preceding the layer to which the node belongs at the first time point t, and the sum of the weight coefficients multiplied by the outputs of multiple nodes belonging to the same layer as the node at the previous time point t-1. Based on the output from the node belonging to the final layer of the hidden layer L120, the output of the output vector has as its elements the expected values for each of the predetermined combinations of set heat and the type of heating unit 11 used. Here, the output layer L130 performs processing using, for example, the softmax function. The combinations of set heat output and heating unit 11 also include combinations that indicate stopping the heating unit 11 and ending cooking. In addition, the model storage unit 133 stores initial heat output information and initial heating unit type information, which are necessary when estimating the set heat output and heating unit type using the cooking setting estimation model at the start of cooking, in association with the corresponding pattern identification information.
[0019] Returning to Figure 3, the reception unit 111 receives the details of the operation performed by the user on the operation unit 17 provided on the cooking appliance 1, generates operation information indicating the received operation details, and notifies the cooking setting change unit 112.
[0020] The cooking setting change unit 112 changes the cooking settings based on the content of the setting change operation when a user performs a setting change operation to change the cooking settings on the input unit 505 of the terminal device 5, or when a user performs a setting change operation to change the cooking settings on the operation unit 17 of the cooking appliance 1. In addition, the cooking setting change unit 112 also changes the cooking settings based on the voice information when voice information indicating a voice input to the voice input device 7 indicates a command to change the cooking settings. Specifically, when the cooking setting change unit 112 receives command information from the command acquisition unit 117 indicating that the cooking settings will be changed, or when it receives operation information indicating a change in cooking settings from the reception unit 111, it extracts at least one of the changed setting heat information and heating unit type information contained in the notified command information or operation information, and updates the setting heat information and heating unit type information at the time corresponding to the timing of the notification.
[0021] The heating control unit 113 controls the operation of the heating unit 11 based on the cooking settings set by the user via the terminal device 5, the operation unit 17, or the voice input device 7, or the cooking settings estimated by the cooking setting estimation unit 118. Specifically, the heating control unit 113 generates the aforementioned control information based on the set heat level information and heating unit type information stored in the cooking setting storage unit 131, and outputs the generated control information to the heating drive unit 12. Furthermore, if the cooking setting storage unit 131 stores information indicating the end of cooking in association with the most recent elapsed time information, the heating control unit 113 generates control information to stop the heating unit 11 and outputs the generated control information to the heating drive unit 12. As a result, the heating drive unit 12 stops the heating unit 11.
[0022] The temperature acquisition unit 120 acquires measured temperature information from the temperature sensor 18, indicating the measured temperature near the food being cooked, each time a preset temperature check period arrives after cooking has started in the cooking appliance 1. The temperature acquisition unit 120 then stores the acquired measured temperature information in the temperature storage unit 132, associating it with elapsed time information indicating the time elapsed from the start of cooking until the temperature check period.
[0023] Each time the cooking of the food to be cooked is completed, the history notification unit 114 generates cooking history information showing the changes in the set heat level information, heating unit type information, and measured temperature information at each point in time from the start to the end of cooking, which are stored in the cooking setting storage unit 131, and sends it to the cloud server 2.
[0024] The history acquisition unit 115 acquires pattern identification information that identifies the cooking setting transition pattern transmitted from the cloud server 2, and cooking history information belonging to this cooking setting transition pattern. It then extracts combinations of set heat information, heating unit type information, measured temperature information, and elapsed time information contained in each of the acquired cooking history information. The history acquisition unit 115 then notifies the model generation unit 116 of the extracted information along with the pattern identification information.
[0025] The model generation unit 116 generates a cooking setting estimation model corresponding to the cooking setting transition pattern indicated by the pattern identification information notified by the history acquisition unit 115, using a combination of set heat level information, heating unit type information, measured temperature information, and elapsed time information notified by the history acquisition unit 115. Specifically, the model generation unit 116 first uses the cooking setting estimation model stored in the model storage unit 133 to calculate the expected values of the set heat level, heating unit type, and measured temperature at each point from the start of cooking to the end of cooking, based on the set heat level, heating unit type, and measured temperature at the start of cooking for one combination of set heat level information, heating unit type information, and measured temperature information arbitrarily selected from the combinations of set heat level information, heating unit type information, and measured temperature information notified. Here, the model generation unit 116 performs calculations using the heating setting estimation model with the neuro-engine 104. Next, the model generation unit 116 sets the expected values so that the expected values of the combination of set heat level, heating unit type, and measured temperature at each point in time for the selected combination are higher than the expected values of other combinations. For example, the model generation unit 116 sets the expected value of the selected combination at each time point to a number greater than 0, and sets the expected value of the other combinations to "0". The model generation unit 116 then calculates the error between the expected values of the set heat, heating unit type, and measured temperature at each time point, calculated using the cooking setting estimation model, and the expected values of the set heat, heating unit type, and measured temperature at each time point corresponding to the selected combination. The model generation unit 116 then determines the weight coefficients of the cooking setting estimation model using the BPTT (Back Propagation Through Time) method based on the calculated error. The model generation unit 116 generates a trained cooking setting estimation model by repeatedly performing this series of processes for all combinations notified by the history acquisition unit 115. The model generation unit 116 stores the cooking setting estimation model information, which represents the generated trained cooking setting estimation model, in the model storage unit 133, associating it with the notified pattern identification information.
[0026] When the command acquisition unit 117 acquires cooking start command information that commands the start of cooking transmitted from the cloud server 2, it notifies the cooking setting estimation unit 118 of the acquired cooking start command information. This cooking start command information includes the pattern identification information described above. Furthermore, when the command acquisition unit 117 acquires cooking setting change command information that commands the change of cooking settings transmitted from the cloud server 2, it notifies the cooking setting change unit 112 of the acquired cooking setting change command information. This cooking setting change command information includes at least one of setting heat information indicating the changed setting heat and heating unit type information indicating the changed heating unit type.
[0027] The cooking setting estimation unit 118 estimates the cooking settings of the cooking appliance 1 until the next control update time, using a cooking setting estimation model based on the changes in cooking settings from the start of cooking until the aforementioned control update time. Specifically, the cooking setting estimation unit 118 uses the cooking setting estimation model information stored in the model storage unit 133 to calculate the expected value for each combination of multiple types of set heat and three types of heating elements at the aforementioned second time point, based on the set heat information, heating element type information, and measured temperature information at each time point from the start of cooking until the first time point after the start of cooking. The cooking setting estimation unit 118 then identifies the combination of set heat and heating element type that yields the highest calculated expected value. Next, the cooking setting estimation unit 118 stores the set heat information and heating element type information, which represent the identified combination of set heat and heating element type, in the cooking setting storage unit 131, associating them with the elapsed time information that indicates the next control update time. Furthermore, if the cooking setting estimation unit 118 identifies a combination that indicates the end of cooking, it stores the information indicating the end of cooking in the cooking setting storage unit 131.
[0028] When the cooking setting change unit 112 changes the set heat output information or heating unit type information stored in the cooking setting storage unit 131, the model update unit 119 updates the cooking setting estimation model information stored in the model storage unit 133 based on the changed set heat output information or heating unit type information and the measured temperature information after cooking is complete. Specifically, the model update unit 119 first uses the cooking setting estimation model already stored in the model storage unit 133 to calculate the expected value for each combination of set heat output and heating unit type at each point from the start to the end of cooking. Here, the model update unit 119 performs calculations using the heating setting estimation model with the neuro-engine 104. Next, the model update unit 119 sets the expected value so that the expected value of the actual set heat output and heating unit type combination stored in the cooking setting storage unit 131 is higher than the expected value of other combinations. For example, the model update unit 119 sets the expected value of the combination of set heat and heating unit type stored in the cooking setting memory unit 131 to a number greater than 0, and sets the expected value of other combinations to "0". Then, the model update unit 119 calculates the error between the expected value calculated using the cooking setting estimation model already stored in the model memory unit 133 and the expected value set based on the actual changes in set heat and heating unit type stored in the cooking setting memory unit 131. Then, the model update unit 119 determines the weight coefficients of the cooking setting estimation model using the aforementioned BPTT method based on the calculated error, and updates the cooking setting estimation model information stored in the model memory unit 133 with new cooking setting estimation model information showing the determined weight coefficients.
[0029] Returning to Figure 2, the cloud server 2 comprises a CPU 201, a main memory unit 202, an auxiliary memory unit 203, a wide-area communication unit 206, and a bus 209 that connects them to each other. The CPU 201 is, for example, a multi-core processor. The main memory unit 202 consists of volatile memory and is used as the working area for the CPU 201. The auxiliary memory unit 203 consists of large-capacity non-volatile memory and stores programs for realizing various functions of the cloud server 2. The wide-area communication unit 206 is connected to the wide-area network NW1.
[0030] The CPU 201 functions as a history acquisition unit 211, a classification unit 212, a recommendation pattern identification unit 213, a recommendation pattern notification unit 214, a registration request acquisition unit 215, a history notification unit 216, a voice information acquisition unit 217, a voice analysis unit 218, a command unit 219, and a command acquisition unit 220, as shown in Figure 3, by reading the program stored in the auxiliary storage unit 203 into the main memory and executing it. The auxiliary storage unit 203 also has a history storage unit 231. The history storage unit 231 stores cooking history information, which shows the past changes in set heat, heating unit type, and measured temperature at each point in time from the start to the end of cooking using each user's cooking appliance 1, associating it with cooking identification information that identifies each cooking and user identification information that identifies the user. Furthermore, for cooking history information classified into cooking setting transition patterns by the classification unit 212, the history storage unit 231 stores it as being associated with pattern identification information that identifies the cooking setting transition pattern to which the cooking history information belongs.
[0031] Returning to Figure 3, when the history acquisition unit 211 acquires the aforementioned cooking history information transmitted from the cooking appliance 1, it stores the acquired cooking history information in the history storage unit 231, associating it with the cooking identification information and the user identification information of the user associated with the transmitting cooking appliance 1.
[0032] The classification unit 212 classifies multiple cooking history information within a pre-set target period stored in the history storage unit 231 into multiple cooking setting transition patterns. First, for each of the multiple cooking history information within the target period stored in the history storage unit 231, the classification unit 212 generates a vector whose elements are the set heat at multiple points in time from the start to the end of cooking. Next, for each of the multiple cooking history information within the target period stored in the history storage unit 231, the classification unit 212 generates a vector whose elements are the identification values indicated by the heating unit type information, which indicates the type of heating unit 11 used at multiple points in time from the start to the end of cooking. Furthermore, for each of the multiple cooking history information within the target period stored in the history storage unit 231, the classification unit 212 generates a vector whose elements are the measured temperature at multiple points in time from the start to the end of cooking. Finally, for each cooking identification information, the classification unit 212 combines these vectors to generate a cooking setting transition vector that reflects the characteristics of the cooking setting transition pattern. If the history storage unit 231 stores various information, for example as shown in Figure 6, the classification unit 212 generates a vector (P[0], P[1], ..., P[N], ...) with the set heat level P[j] as an element. The classification unit 212 also generates a vector (IDE0, IDE0, ..., IDE1, ...) with the heating unit type IDEk as an element. Furthermore, the classification unit 212 generates a vector (Th[0], Th[1], ..., Th[N], ...) with the measured temperature Th[j] as an element. Then, for each cooking identification piece of information, the classification unit 212 combines these generated vectors to form a cooking setting transition vector (P[0], P[1], ..., P[N], ..., IDE0, IDE0, ..., IDE1, ..., Th[0], Th[1], ..., Th[N], ...). Here, if the number of time points is N, the dimensionality of the cooking setting transition vector is 3 × N. Next, the classification unit 212 performs clustering processing for each user to classify the multiple cooking history information into multiple cooking setting transition patterns based on the similarity of the cooking setting transition vectors corresponding to each of the aforementioned cooking history information.Specifically, the classification unit 212 uses cooking setting transition vectors corresponding to each of the generated cooking history information to classify them into multiple cooking setting transition patterns that are similar to each other, for example, based on the Euclidean distance between the multiple cooking setting transition vectors. The classification unit 212 stores pattern identification information indicating the cooking setting transition pattern to which each of the multiple cooking history information obtained by the clustering process belongs in the history storage unit 231, associating it with the cooking history identification information of each of the multiple cooking history information. Here, the classification unit 212 generates information as pattern identification information, for example, a representative value of the set heat included in the cooking history information belonging to the cooking setting transition pattern, and the most frequently used type of heating unit, and notifies the recommendation pattern notification unit 214 of this information.
[0033] The recommendation pattern identification unit 213 refers to multiple cooking history information stored in the history storage unit 231 and the associated pattern identification information to calculate the number of cooking history information items belonging to each cooking setting transition pattern. Then, based on the calculated number of cooking history information items belonging to each of the multiple cooking setting transition patterns, the recommendation pattern identification unit 213 identifies a cooking setting transition pattern for which it recommends the generation of a cooking setting estimation model to the user. Specifically, the recommendation pattern identification unit 213 identifies at least one cooking setting transition pattern for which the number of cooking history information items belonging to the cooking setting transition pattern notified by the classification unit 212 is equal to or greater than a preset standard ratio relative to the total number of cooking history information items stored in the history storage unit 231. The recommendation pattern identification unit 213 generates pattern identification information to identify the identified cooking setting transition pattern and notifies the recommendation pattern notification unit 214. Here, the pattern identification information can be, for example, information representing a name that includes the set heat information, heating unit type information, and measured temperature information indicated by the cooking history information included in the corresponding cooking setting transition pattern. The recommendation pattern notification unit 214 transmits pattern identification information of the cooking setting transition pattern identified by the recommendation pattern identification unit 213 to the terminal device 5.
[0034] The registration request acquisition unit 215 acquires registration request information transmitted from the terminal device 5, which requests the registration of a recommended cooking setting estimation model to the cooking appliance 1. Here, the registration request information includes user identification information and pattern identification information of the cooking setting transition pattern that the user wishes to register. When the registration request acquisition unit 215 acquires the registration request information, it extracts the user identification information and pattern identification information contained in the acquired registration request information and notifies the history notification unit 216. The history notification unit 216 selects cooking history information corresponding to the combination of user identification information and pattern identification information notified by the registration request acquisition unit 215 from among the multiple cooking history information stored in the history storage unit 231, and transmits the selected cooking history information to the cooking appliance 1.
[0035] When the voice information acquisition unit 217 acquires voice information transmitted from the voice input device 7, it notifies the voice analysis unit 218 of the acquired voice information. The voice analysis unit 218 performs voice analysis on the voice information notified by the voice information acquisition unit 217 to identify the command content corresponding to the voice information. Here, the command content may include starting cooking according to the cooking setting transition pattern selected by the user, or changing the cooking settings of the cooking appliance 1, i.e., the set heat level or heating unit type. Then, based on the identified command content, the voice analysis unit 218 generates cooking start command information that commands the start of cooking according to the cooking setting transition pattern selected by the user, or cooking setting change command information that commands the setting heat level or heating unit type of the cooking appliance 1 to be changed, and notifies the command unit 219. Here, the cooking start command information commands the cooking appliance to operate while estimating the set heat level or heating unit type of the cooking appliance 1 using a cooking setting estimation model corresponding to the cooking setting transition pattern selected by the user.
[0036] When the command acquisition unit 220 acquires the aforementioned cooking start command information or cooking setting change command information selected by the user transmitted from the terminal device 5, it notifies the command unit 219 of the acquired cooking start command information or cooking setting change command information. When the command unit 219 receives the aforementioned cooking start command information or cooking setting change command information from the command acquisition unit 220, it transmits the notified cooking start command information or cooking setting change command information to the cooking equipment 1. In addition, when the command unit 219 receives the aforementioned cooking start command information or cooking setting change command information from the voice analysis unit 218, it transmits the notified cooking start command information or cooking setting change command information to the cooking equipment 1.
[0037] The terminal device 5 is, for example, a smartphone, and as shown in Figure 2, comprises a CPU 501, a main memory unit 502, an auxiliary memory unit 503, a display unit 504, an input unit 505, a local communication unit 506, and a bus 509 connecting these to each other. The main memory unit 502 has volatile memory and is used as the working area of the CPU 501. The main memory unit 502 also has an image-dedicated memory (not shown) that temporarily stores image information to be displayed on the display unit 504. The auxiliary memory unit 503 is a non-volatile memory such as semiconductor flash memory and stores programs for the CPU 501 to execute various processes. The display unit 504 is a display device such as a liquid crystal display or an organic EL (Electro-Luminescence) display. The input unit 505 is, for example, a transparent touchpad placed on top of the display unit 504. The local communication unit 506 is connected to the local network NW2 and transmits information transferred from the CPU 501 to the cloud server 2 via the local network NW2 and the wide area network NW1, and also transfers information acquired from the cloud server 2 via the wide area network NW1 and the local network NW2 to the CPU 501.
[0038] The CPU 501 functions as an image forming unit 511, a display control unit 512, a reception unit 513, a command unit 514, and a registration request unit 515, as shown in Figure 7, by reading and executing programs stored in the auxiliary storage unit 503 into the main memory unit 502. The auxiliary storage unit 503 shown in Figure 2 includes a recommended pattern storage unit 531, an image storage unit 532, a registered pattern storage unit 533, and a pattern name storage unit 534, as shown in Figure 7. Furthermore, the image-dedicated memory of the main memory unit 502 shown in Figure 2 includes a display screen storage unit 521 that temporarily stores screen images to be displayed on the display unit 504, as shown in Figure 3. The recommended pattern storage unit 531 stores pattern identification information transmitted from the cloud server 2. The image storage unit 532 stores various image information, including image information that shows basic icon images for constructing operation screen images.
[0039] The registration pattern storage unit 533 stores the pattern identification information of cooking setting transition patterns that have been requested by the user to be registered to the cooking appliance 1 from among the pattern identification information stored in the recommendation pattern storage unit 531. The pattern name storage unit 534 stores the name of the cooking setting transition pattern in association with the corresponding pattern identification information, if the user has set a name for that cooking setting transition pattern. Examples of names for cooking setting transition patterns that include the name of the food being cooked include "fluffy omelet," "gourmet beef steak," "heated hamburger," and "sliced mackerel."
[0040] The image forming unit 511 forms an operation screen image that is referenced when performing the operation to register a cooking setting transition pattern for the cooking appliance 1 or to change the set heat level or heating unit type of the cooking appliance 1. Furthermore, when the pattern name selection unit 517 notifies the image forming unit 511 of pattern name information indicating a name corresponding to a cooking setting transition pattern, the image forming unit 511 uses the notified pattern name information to form an operation screen image for allowing the user to select a cooking setting transition pattern. Also, when the recommended pattern acquisition unit 516 notifies the image forming unit 511 of pattern identification information, the image forming unit 511 forms a registration operation screen image based on the notified pattern identification information to register a recommended cooking setting transition pattern to the cooking appliance 1. The image forming unit 511 stores the image information showing the formed operation screen image in the display screen storage unit 521. The display control unit 512 displays the aforementioned operation screen image on the display unit 504 based on the image information stored in the display screen storage unit 521.
[0041] The reception unit 513 receives the operation performed by the user on the input unit 505, generates operation information corresponding to the received operation, and notifies the command unit 514 or the registration request unit 515. When the user performs a pattern selection operation on the input unit 505 to select one cooking setting transition pattern from among several cooking setting transition patterns, the command unit 514 generates cooking start command information that instructs the system to estimate the cooking settings using the cooking setting estimation model corresponding to the selected cooking setting transition pattern, based on the content of the pattern selection operation indicated by the operation information. Furthermore, when the user performs a setting change operation on the input unit 505 to change the cooking settings, the command unit 514 generates cooking setting change command information to change the set heat output or heating unit type of the cooking equipment 1, based on the content of the setting change operation indicated by the operation information. The command unit 514 then transmits the generated cooking start command information or cooking setting change command information to the cloud server 2.
[0042] If the operation information indicates a model registration operation to register cooking setting estimation model information corresponding to a cooking setting transition pattern indicated by at least one pattern identification information from among the pattern identification information stored in the recommended pattern storage unit 531 to the cooking appliance 1, the registration request unit 515 generates registration request information including pattern identification information corresponding to the cooking setting estimation model information to be registered, based on that operation information. The registration request unit 515 then transmits the generated registration request information to the cloud server 2. When the recommended pattern acquisition unit 516 acquires the pattern identification information transmitted from the cloud server 2, it stores the acquired pattern identification information in the recommended pattern storage unit 531 and also notifies the image forming unit 511 of the acquired pattern identification information.
[0043] The pattern name selection unit 517 selects pattern name information from the pattern name information stored in the pattern name storage unit 534 that is associated with the pattern identification information stored in the registered pattern storage unit 533, and notifies the image forming unit 511. When the name setting unit 518 receives operation information from the reception unit 513 indicating an operation to assign a pattern name specified by the user to one of the pattern identification information stored in the registered pattern storage unit 533, it generates pattern name information indicating that pattern name, associates it with the corresponding pattern identification information, and stores it in the pattern name storage unit 534.
[0044] Next, the operation of the cooking system according to this embodiment will be explained with reference to Figures 8 to 10. First, as shown in Figure 8, the user performs a cooking start operation on the operation unit 17 of the cooking device 1 to start cooking, and then a preset temperature check time arrives. In this case, the cooking device 1 acquires measured temperature information from the temperature sensor 18, which indicates the measured temperature, and stores the acquired measured temperature information in the temperature storage unit 132 in association with elapsed time information indicating the elapsed time since the start of cooking (step S1). Next, the user performs a cooking end operation on the operation unit 17 of the cooking device 1 to end cooking. In this case, the cooking device 1 generates cooking history information that shows the changes in set heat, heating unit type, and measured temperature at each point in time from the start of cooking to the end of cooking (step S2). Subsequently, the generated cooking history information is transmitted from the cooking device 1 to the cloud server 2 (step S3). Meanwhile, when the cloud server 2 receives cooking history information transmitted from the cooking appliance 1, it stores the acquired cooking history information in the history storage unit 231, associating it with cooking identification information and user identification information of the user associated with the source cooking appliance 1.
[0045] Suppose the user then performs a registration operation to display a registration operation screen on the display unit 504 of the terminal device 5, which is used to register a cooking setting estimation model to the cooking appliance 1. In this case, the terminal device 5 generates pattern request information that includes user identification information to identify the user of the cooking appliance 1, and requests the cloud server 2 to send pattern identification information of the aforementioned cooking setting transition pattern (step S4). Next, the generated pattern request information is sent from the terminal device 5 to the cloud server 2 (step S5). Meanwhile, the cloud server 2 extracts the user identification information contained in the pattern request information sent from the terminal device 5 and generates the aforementioned cooking setting transition vectors for multiple cooking history information items corresponding to the extracted user identification information from the cooking history information stored in the history storage unit 231 (step S6). Next, the cloud server 2 performs clustering processing on the multiple cooking setting transition vectors corresponding to each of the generated multiple cooking history information items (step S7). As a result, the cloud server 2 classifies the multiple cooking history information items into a predetermined number of multiple cooking setting transition patterns. Next, the cloud server 2 identifies a cooking setting transition pattern for which it recommends the generation of a cooking setting estimation model to the user, based on the number of cooking history information items belonging to each of the multiple cooking setting transition patterns (step S8). Subsequently, the pattern identification information of the identified cooking setting transition pattern is transmitted from the cloud server 2 to the terminal device 5 (step S9). Meanwhile, upon acquiring the pattern identification information, the terminal device 5 forms a registration operation screen image based on the acquired pattern identification information and displays it on the display unit 504 in order to register the recommended cooking setting transition pattern to the cooking equipment 1 (step S10).
[0046] Next, suppose the user, referring to the registration operation screen image displayed on the display unit 504 of the terminal device 5, performs a model registration operation to the input unit 505 to register cooking setting estimation model information corresponding to a cooking setting transition pattern selected from among multiple cooking setting transition patterns to the cooking appliance 1. In this case, the terminal device 5 accepts the model registration operation and generates registration request information including pattern identification information of the cooking setting transition pattern to be registered (step S11). At this time, the terminal device 5 stores the pattern identification information of the cooking setting transition pattern to be registered in the registration pattern storage unit 533. Subsequently, the generated registration request information is transmitted from the terminal device 5 to the cloud server 2 (step S12). Meanwhile, when the cloud server 2 receives the registration request information, it identifies the cooking history information associated with the pattern identification information included in the acquired registration request information from the cooking history information stored in the history storage unit 231 (step S13). After that, the identified cooking history information and the corresponding pattern identification information are transmitted from the cloud server 2 to the cooking appliance 1 (step S14).
[0047] Meanwhile, when the cooking device 1 acquires cooking history information and corresponding pattern identification information transmitted from the cloud server 2, it extracts combinations of set heat information, heating unit type information, measured temperature information, and elapsed time information contained in each of the acquired cooking history information. Then, using the extracted information and combinations of set heat information, heating unit type information, measured temperature information, and elapsed time information, the cooking device 1 generates cooking setting estimation model information that shows a cooking setting estimation model corresponding to the cooking setting transition pattern identified by the acquired pattern identification information, and stores the generated cooking setting estimation model information in the model storage unit 133 in association with the pattern information (step S15).
[0048] Furthermore, suppose the user performs a pattern name registration operation on the input unit 505 of the terminal device 5 to assign a name devised by the user to the cooking setting transition pattern for which cooking setting estimation model information has been generated by the cooking appliance 1. In this case, the terminal device 5 generates pattern name information indicating the name devised by the user based on the content of the pattern name registration operation, and stores the generated pattern name information in the pattern name storage unit 534 in association with the pattern identification information of the target to which the pattern name is to be assigned, which is stored in the registered pattern storage unit 533 (step S16).
[0049] Next, as shown in Figure 9, suppose a cooking start operation is performed in which a cooking setting transition pattern, for which a cooking setting estimation model has been generated by the user, is specified. Here, the terminal device 5 displays an operation screen image GA1 on the display unit 504, for example, as shown in Figure 10(A). The operation screen image GA1 includes message images M11, M12, and M13 representing the operating status of each of the three IH heating units, a message image M14 representing the operating status of the grill heating unit, and an icon image IC1 representing the cooking appliance 1. The icon image IC1 is colored with pre-set colors for the parts corresponding to the operating IH heating unit and grill heating unit. The operation screen image GA1 also includes a button image BU11 indicating the part to be touched when stopping the cooking appliance 1 in the input unit 505, and a button image BU12 labeled "usual" indicating the part to be touched when specifying the cooking setting transition pattern. Then, when the user touches the part of the input unit 505 corresponding to the button image BU12 while the operation screen image GA1 shown in Figure 10(A) is displayed on the display unit 504, the terminal device 5 forms an operation screen image GA2, for example, as shown in Figure 10(B), based on the pattern name information stored in the pattern name storage unit 534, and displays it on the display unit 504. The operation screen image GA2 includes button images BU21, BU22, BU23, and BU24 that represent the pattern names of multiple types of cooking setting transition patterns for which the cooking setting estimation model was generated. If the pattern name information is not stored in the pattern name storage unit 534 for any of the cooking setting transition patterns to be displayed in the operation screen image GA2, that is, if the user has not assigned a pattern name, the button images BU21, BU22, BU23, and BU24 will represent the pattern identification information as is.
[0050] Here, when the user touches any of the parts of the input unit 505 corresponding to the button images BU21, BU22, BU23, or BU24, with the operation screen image GA2 as shown in Figure 11(B) displayed on the display unit 504, the terminal device 5 selects a cooking setting transition pattern corresponding to the touched button image BU21, BU22, BU23, or BU24, and generates cooking start command information including pattern identification information of the selected cooking setting transition pattern (step S17). Subsequently, the generated cooking start command information is transmitted from the terminal device 5 to the cloud server 2 (step S18), and then transmitted from the cloud server 2 to the cooking device 1 (step S19). Meanwhile, when the cooking device 1 acquires the cooking start command information, it extracts the pattern identification information contained in the acquired cooking start command information and selects cooking setting estimation model information corresponding to the extracted pattern identification information from the cooking setting estimation model information stored in the model storage unit 133 (step S20).
[0051] Subsequently, the cooking appliance 1 acquires measured temperature information from the temperature sensor 18 and stores the acquired measured temperature information in the temperature memory unit 132 in association with elapsed time information indicating the start of cooking (step S21). Next, the cooking appliance 1 uses a cooking setting estimation model to estimate the cooking settings of the cooking appliance 1, i.e., the set heat output and the type of heating unit 11 to be used, from the initial setting heat output information, the initial heating unit type information indicating the initial set heat output and the type of heating unit 11, which correspond to the extracted pattern identification information stored in the model memory unit 133, and the measured temperature information indicated by the measured temperature information stored in the temperature memory unit 132. Then, the cooking appliance 1 stores the estimated set heat output, the set heat output information indicating the type of heating unit 11 to be used, and the heating unit type information in the cooking setting memory unit 131 in association with elapsed time information indicating the start of cooking (step S22). Subsequently, the cooking appliance 1 uses the estimated type of heating unit 11 stored in the cooking setting memory unit 131 to execute control to heat the food to be cooked at the estimated set heat output (step S23).
[0052] Subsequently, when the pre-set control update time arrives, the cooking appliance 1 again acquires measured temperature information from the temperature sensor 18 and stores the acquired measured temperature information in the temperature storage unit 132 in association with elapsed time information indicating the start of cooking (step S24). Next, the cooking appliance 1 uses a cooking setting estimation model to estimate the next set heat level and the type of heating unit 11 to be used, based on the changes in set heat level and heating unit type from the start of cooking to the control update time, and the measured temperature indicated by the measured temperature information. Then, the cooking appliance 1 stores the estimated set heat level, the set heat level information indicating the type of heating unit 11, and the heating unit type information in the cooking setting storage unit 131 in association with elapsed time information indicating the next upcoming control update time (step S25). Subsequently, the cooking appliance 1 uses the estimated type of heating unit 11 stored in the cooking setting storage unit 131 to execute control to heat the food to be cooked at the estimated set heat level (step S26). Thereafter, the series of processes from steps S24 to S26 will be repeatedly executed each time a control update period arrives.
[0053] Furthermore, suppose the user changes the cooking settings, i.e., the set heat level or the type of heating unit 11 to be used, via the control panel 17 of the cooking appliance 1 during cooking. In this case, the cooking appliance 1 updates the set heat level information or heating unit type information stored in the cooking setting storage unit 131 to the changed set heat level information or heating unit type information as a result of the aforementioned operation (step S27). Subsequently, the cooking appliance 1 executes control to heat the food to be cooked at the updated set heat level using the type of heating unit 11 indicated by the updated cooking settings, i.e., the updated heating unit type information, stored in the cooking setting storage unit 131 (step S28).
[0054] Furthermore, suppose the user changes the set heat level or the type of heating element to be used via the input unit 505 of the terminal device 5 during cooking. In this case, the terminal device 5 generates setting change command information that includes setting heat level information indicating the changed setting heat level or heating element type information indicating the changed type of heating element 11 (step S29). Subsequently, the generated setting change command information is transmitted from the terminal device 5 to the cloud server 2 (step S30), and then transmitted from the cloud server 2 to the cooking appliance 1 (step S31). Meanwhile, when the cooking appliance 1 receives the setting change command information, it extracts the changed setting heat level information or heating element type information contained in the acquired setting change command information and updates the setting heat level information or heating element type information stored in the cooking setting storage unit 131 with the extracted changed setting heat level information or heating element type information (step S32). Next, the cooking appliance 1 executes control to heat the food to be cooked at the updated set heat level using the updated cooking setting stored in the cooking setting storage unit 131, that is, the type of heating unit 11 indicated by the updated heating unit type information (step S33).
[0055] Furthermore, as shown in Figure 11, suppose the user makes a voice input to the voice input device 7 during cooking to change the cooking settings, that is, to change the set heat level or the type of heating unit to be used. In this case, the voice input device 7 generates voice information indicating the input voice (step S34), and the generated voice information is transmitted from the voice input device 7 to the cloud server 2 (step S35). Meanwhile, when the cloud server 2 receives the voice information transmitted from the voice input device 7, it analyzes the acquired voice information (step S36). Here, suppose the cloud server 2 determines that the command content corresponding to the voice information is a change in the set heat level or a change in the type of heating unit (step S37). In this case, the cloud server 2 generates setting change command information that includes setting heat level information indicating the changed set heat level or heating unit type information indicating the changed type of heating unit (step S38). Subsequently, the generated setting change command information is transmitted from the cloud server 2 to the cooking appliance 1 (step S39). Meanwhile, when the cooking appliance 1 acquires setting change command information, it extracts the changed setting heat information or heating unit type information contained in the acquired setting change command information, and updates the setting heat information or heating unit type information stored in the cooking setting storage unit 131 with the extracted changed setting heat information or heating unit type information (step S40). Subsequently, the cooking appliance 1 uses the updated cooking setting stored in the cooking setting storage unit 131, i.e., the heating unit 11 indicated by the updated heating unit type information, to perform control to heat the food to be cooked at the updated setting heat (step S41).
[0056] Furthermore, when the pre-set control update time arrives, the cooking appliance 1 again acquires measured temperature information from the temperature sensor 18 and stores the acquired measured temperature information in the temperature memory unit 132 in association with the elapsed time information indicating the start of cooking (step S42). Next, the cooking appliance 1 estimates the next set heat level and type of heating unit for the cooking appliance 1 using a cooking setting estimation model based on the changes in set heat level and type of heating unit from the start of cooking to the control update time and the measured temperature indicated by the measured temperature information, and determines that cooking has ended (step S43). Then, the cooking appliance 1 determines that there has been a change in the cooking settings, i.e., the set heat level or the type of heating unit 11 used, between the start of cooking and the end of cooking (step S44). In this case, the cooking appliance 1 generates new cooking setting estimation model information using a combination of setting heat information, heating unit type information, measured temperature information, and elapsed time information stored in the cooking setting storage unit 131, and updates the cooking setting estimation model information stored in the model storage unit 133 with the generated cooking setting estimation model information (step S45).
[0057] Next, the cooking history transmission process, which transmits cooking history information used to generate cooking setting estimation model information executed by the cloud server 2 according to this embodiment to the cooking equipment 1, will be explained with reference to Figure 12. This cooking history process is started, for example, when a program for executing recommendation setting notification processing is started on the cloud server 2. First, the history acquisition unit 211 determines whether or not it has acquired cooking history information from the cooking equipment 1 (step S201). If the history acquisition unit 211 determines that it has not acquired cooking history information (step S201: No), the process in step S208, described later, is executed. On the other hand, if the history acquisition unit 211 determines that it has acquired cooking history information (step S201: Yes), the acquired cooking history information is stored in the history storage unit 231, associating it with cooking identification information and user identification information of the user associated with the source cooking equipment 1 (step S202). Next, the classification unit 212 determines whether the history storage unit 231 has accumulated cooking history information for the reference period from the most recent point to the most recent point, going back a predetermined reference period of length from the most recent point to the most recent point (step S203). If the classification unit 212 determines that the history storage unit 231 has not yet accumulated cooking history information for the reference period (step S203: No), the process in step S208, described below, is executed.
[0058] Meanwhile, when the classification unit 212 determines that the history storage unit 231 has accumulated cooking history information for the reference period (step S203: Yes), it generates a cooking setting transition vector from the accumulated cooking history information that reflects the characteristics of the cooking setting transition pattern indicated by each of the aforementioned cooking history information (step S204). Next, the classification unit 212 performs clustering on the multiple cooking setting transition vectors corresponding to each of the generated cooking history information (step S205). As a result, the classification unit 212 classifies the multiple cooking history information into a predetermined number of multiple cooking setting transition patterns. Subsequently, the recommendation pattern identification unit 213 identifies a cooking setting transition pattern to which it recommends the generation of a cooking setting estimation model to the user, based on the number of cooking history information belonging to each of the multiple cooking setting transition patterns (step S206). Next, the recommendation pattern notification unit 214 transmits the pattern identification information of the identified cooking setting transition pattern to the terminal device 5 (step 207).
[0059] Next, the registration request acquisition unit 215 determines whether or not it has acquired the registration request information transmitted from the terminal device 5 (step S208). If the registration request acquisition unit 215 determines that it has not acquired the registration request information (step S208: No), the process in step S201 is executed again. On the other hand, if the registration request acquisition unit 215 determines that it has acquired the aforementioned registration request information (step S208: Yes), it extracts the pattern identification information contained in the acquired registration request information and notifies the history notification unit 216. The history notification unit 216 then identifies the cooking history information associated with the pattern identification information notified by the registration request acquisition unit 215 from the cooking history information stored in the history storage unit 231 (step S209). After that, the history notification unit 216 transmits the identified cooking history information and the corresponding pattern identification information to the cooking appliance 1 (step S210), and the process in step S201 is executed again.
[0060] Next, the cooking appliance control process performed by the cooking appliance 1 according to this embodiment will be explained with reference to Figures 13 and 14. This cooking appliance control process is started, for example, when power is turned on to the cooking appliance 1. First, the reception unit 111 determines whether or not it has received a cooking start operation performed by the user via the operation unit 17 (step S101). If the reception unit 111 determines that it has not received a cooking start operation (step S101: No), the process in step S123, described later, is executed. On the other hand, if the reception unit 111 determines that it has received a cooking start operation (step S101: Yes), the temperature acquisition unit 120 determines whether or not a preset temperature confirmation period has arrived (step S102). Here, if the temperature acquisition unit 120 determines that the temperature confirmation period has not yet arrived (step S102: No), the process in step S105, described later, is executed. On the other hand, when the temperature acquisition unit 120 determines that the time for temperature confirmation has arrived (step S102: Yes), it acquires the measured temperature information from the temperature sensor 18, and stores the acquired measured temperature information in the temperature storage unit 132 in association with the elapsed time information (step S103). Next, the cooking setting change unit 112 generates the set heat level information and heating unit type information that indicate the set heat level and heating unit type received by the reception unit 111, and stores them in the cooking setting storage unit 131 in association with the elapsed time information (step S104).
[0061] Next, the reception unit 111 determines whether or not it has received a cooking completion operation performed by the user via the operation unit 17 (step S105). If the reception unit 111 determines that it has not received a cooking completion operation (step S105: No), the process in step S102 is executed again. On the other hand, if the reception unit 111 determines that it has received a cooking completion operation (step S105: Yes), the history notification unit 114 generates cooking history information showing the changes in the set heat level information, heating unit type information, and measured temperature information at each point in time from the start of cooking to the end of cooking, which are stored in the cooking setting storage unit 131, and sends it to the cloud server 2 (step S106).
[0062] Subsequently, the command acquisition unit 117 determines whether or not it has acquired the cooking start command information transmitted from the cloud server 2 (step S107). If the command acquisition unit 117 determines that it has not acquired the cooking start command information (step S107: No), the process in step S123, described later, is executed. On the other hand, if the command acquisition unit 117 determines that it has acquired the cooking start command information (step S107: Yes), it extracts the pattern identification information contained in the acquired cooking start command information and notifies the cooking setting estimation unit 118 of the extracted pattern identification information. The cooking setting estimation unit 118 then selects cooking setting estimation model information corresponding to the extracted pattern identification information from the cooking setting estimation model information stored in the model storage unit 133 (step S108).
[0063] Next, the temperature acquisition unit 120 and temperature sensor 18 acquire measured temperature information, and the acquired measured temperature information is stored in the temperature storage unit 132 in association with elapsed time information indicating the start of cooking (step S109). Subsequently, the cooking setting estimation unit 118 estimates the cooking settings of the cooking appliance 1, i.e., the set heat output and heating unit type, using the cooking setting estimation model based on the initial heat output, initial heating unit type, and measured temperature indicated by the measured temperature information stored in the temperature storage unit 132, which correspond to the extracted pattern identification information stored in the model storage unit 133. Then, the cooking setting estimation unit 118 stores the estimated set heat output information and heating unit type information in the cooking setting storage unit 131 in association with elapsed time information indicating the start of cooking (step S110). Subsequently, the heating control unit 113 and the heating unit 11 of the type indicated by the estimated heating unit type information stored in the cooking setting storage unit 131 execute control to heat the food to be cooked at the estimated set heat output (step S111).
[0064] Subsequently, the temperature acquisition unit 120 and the cooking setting estimation unit 118 determine whether or not a preset control update time has arrived (step S112). If the temperature acquisition unit 120 and the cooking setting estimation unit 118 determine that the control update time has not arrived (step S112: No), the reception unit 111 determines whether or not it has received a cooking setting change operation performed by the user via the operation unit 17 to change the set heat level or heating unit type (step S113). If the reception unit 111 determines that it has received a cooking setting change operation (step S113: Yes), the process in step S115 described later is executed. On the other hand, if the reception unit 111 determines that it has not received a cooking setting change operation (step S113: No), the command acquisition unit 117 determines whether or not it has received setting change command information transmitted from the cloud server 2 (step S114). Here, if the command acquisition unit 117 determines that it has not acquired the setting change command information (step S114: No), the process in step S112 is executed again. On the other hand, if the command acquisition unit 117 determines that it has acquired the setting change command information (step S114: Yes), it extracts the changed setting heat information or heating unit type information included in the acquired setting change command information and notifies the cooking setting change unit 112. The cooking setting change unit 112 then updates the setting heat information or heating unit type information with the notified changed setting heat information (step S115). Next, the heating control unit 113 uses the updated cooking setting stored in the cooking setting storage unit 131, that is, the type of heating unit 11 indicated by the updated heating unit type information, to execute control to heat the food to be cooked at the updated setting heat (step S116). Subsequently, the process in step S112 is executed again.
[0065] Furthermore, the temperature acquisition unit 120 and the cooking setting estimation unit 118 determine in step S112 that the control update time has arrived (step S112: Yes). In this case, as shown in Figure 14, the temperature acquisition unit 120 acquires measured temperature information from the temperature sensor 18 and stores the acquired measured temperature information in the temperature storage unit 132 in association with elapsed time information indicating the start of cooking (step S117). Subsequently, the cooking setting estimation unit 118 uses a cooking setting estimation model to estimate the combination of set heat output and the type of heating unit 11 to be used until the next control update time for the cooking appliance 1, based on the changes in set heat output and heating unit type from the start of cooking until the control update time, and the measured temperature indicated by the measured temperature information. The cooking appliance 1 then stores the estimated set heat output, set heat output information indicating the type of heating unit 11, and heating unit type information in the cooking setting storage unit 131 in association with elapsed time information indicating the start of cooking (step S118). Furthermore, if the cooking setting estimation unit 118 identifies a combination indicating the end of cooking, it stores the information indicating the end of cooking in the cooking setting storage unit 131. Next, the heating control unit 113 refers to the corresponding information stored in the cooking setting storage unit 131 until the next control update time and determines whether or not the cooking setting estimation unit 118 has estimated the end of cooking (step S119). Here, suppose the heating control unit 113 determines that the end of cooking has not yet been estimated (step S119: No). In this case, the heating control unit 113 executes control to heat the food to be cooked with the estimated set heat using the estimated type of heating unit 11 (step S120). Subsequently, the process in step S112 is executed again.
[0066] On the other hand, suppose the heating control unit 113 determines in step S119 that cooking has been estimated to be finished (step S119: Yes). In this case, the model update unit 119 determines whether there has been a change in the cooking settings, i.e., a change to a different set of heating power than the estimated set heating power or a change to a different type of heating unit 11 than the estimated type of heating unit 11, between the start of cooking and the end of cooking (step S121). If the model update unit 119 determines that there has been no change from the estimated set heating power or the type of heating unit 11 between the start of cooking and the end of cooking (step S121: No), the process in step 123 described later is executed. On the other hand, if the model update unit 119 determines that there has been a change from the estimated set heating power or the type of heating unit 11 between the start of cooking and the end of cooking (step S121: Yes), it generates new cooking setting estimation model information using a combination of set heating power information, heating unit type information, measured temperature information, and elapsed time information stored in the cooking setting storage unit 131. Then, the model update unit 119 updates the cooking setting estimation model information stored in the model storage unit 133 with the generated cooking setting estimation model information (step S122).
[0067] Subsequently, the history acquisition unit 115 determines whether or not it has acquired the cooking history information transmitted from the cloud server 2 and the corresponding pattern identification information (step S123). If the history acquisition unit 115 determines that it has not acquired the cooking history information and the corresponding pattern identification information (step S123: No), the process in step S101 is executed again. On the other hand, if the history acquisition unit 115 determines that it has acquired the cooking history information and the corresponding pattern identification information (step S123: Yes), it extracts the combination of set heat information, heating unit type information, measured temperature information, and elapsed time information contained in each of the acquired cooking history information (step S124). Next, the model generation unit 116 generates cooking setting estimation model information that shows the cooking setting estimation model corresponding to the acquired pattern identification information using the extracted combination of set heat information, heating unit type information, measured temperature information, and elapsed time information, and stores the generated cooking setting estimation model information in the model storage unit 133 in association with the pattern information (step S125). Subsequently, the process in step S101 is executed again.
[0068] Next, the cooking setting estimation model registration process, which is performed by the terminal device 5 according to this embodiment to register cooking setting estimation model information with the cooking appliance 1, will be explained with reference to Figure 15. This cooking setting estimation model registration process is started, for example, when power is turned on to the terminal device 5 and a program for executing the cooking setting estimation model registration process is started. First, the reception unit 513 determines whether or not it has received a registration operation screen display operation to display a registration operation screen for registering cooking setting estimation model information with the cooking appliance 1 on the display unit 504 (step S301). If the reception unit 513 determines that it has not received a registration operation screen display operation (step S301: No), the process in step S306, which will be described later, is executed. On the other hand, if the reception unit 513 determines that it has received a registration operation screen display operation (step S301: Yes), the recommendation pattern acquisition unit 516 generates the aforementioned pattern request information and sends it to the cloud server 2 (step S302). Next, the recommended pattern acquisition unit 516 acquires at least one pattern identification information transmitted from the cloud server 2 in accordance with the pattern request information and stores the acquired pattern identification information in the recommended pattern storage unit 531 (step S303). Subsequently, the pattern name selection unit 517 selects the pattern name information if there is a pattern name information in the pattern name storage unit 534 that corresponds to the pattern identification information stored in the recommended pattern storage unit 531 (step S304). Furthermore, the image forming unit 511 forms a registration operation screen image that is referenced when performing a model registration operation to select the pattern identification information of the cooking setting transition pattern to be registered for registration in the cooking appliance 1, based on the pattern identification information acquired by the recommended pattern acquisition unit 516 and the pattern name information selected by the pattern name selection unit 517, and stores it in the display screen storage unit 521. Then, the display control unit 512 displays the registration operation screen image stored in the display screen storage unit 521 on the display unit 504 (step S305). In this case, the registration operation screen image displays the cooking setting estimation pattern by pattern name for pattern identification information for which pattern name information has been selected from the pattern identification information stored in the recommended pattern storage unit 531.
[0069] Subsequently, the reception unit 513 determines whether or not it has received a model registration operation to register the cooking setting estimation model information to the cooking appliance 1 (step S306). If the reception unit 513 determines that it has not received a model registration operation (step S306: No), the process in step S309 described below is executed. On the other hand, if the reception unit 513 determines that it has received a model registration operation (step S306: Yes), it generates registration request information including the pattern identification information selected in the model registration operation and sends it to the cloud server 2 (step S307). Next, the registration request unit 515 stores the selected pattern identification information in the registration pattern storage unit 533 (step S308).
[0070] Next, the reception unit 513 determines whether or not it has received a pattern name registration operation from the user to assign a name devised by the user to a cooking setting transition pattern (step S309). If the reception unit 513 determines that it has not received a pattern name registration operation (step S309: No), the process in step S311, described below, is executed. On the other hand, if the reception unit 513 determines that it has received a pattern name registration operation (step S309: Yes), it generates pattern name information indicating the name devised by the user based on the content of the pattern name registration operation, and stores the generated pattern name information in the pattern name storage unit 534 in association with the pattern identification information of the target to which the pattern name is to be assigned, which is stored in the registered pattern storage unit 533 (step S310).
[0071] Subsequently, the system determines whether or not it has received an operation screen display operation from the user to display an operation screen image (for example, the operation screen image GA2 in Figure 10(B)) on the display unit 504 for selecting a cooking method using the cooking setting estimation model (step S311). If the reception unit 513 determines that it has not received an operation screen display operation (step S311: No), the process in step S301 is executed again. On the other hand, if the reception unit 513 determines that it has received an operation screen display operation (step S311: Yes), the pattern name selection unit 517 selects the pattern name information if there is such information in the pattern name information stored in the pattern name storage unit 534 that corresponds to the pattern identification information stored in the registered pattern storage unit 533 (step S312). Next, the image forming unit 511 forms the aforementioned operation screen image based on the pattern identification information stored in the registered pattern storage unit 533 and the pattern name information selected by the pattern name selection unit 517, and stores it in the display screen storage unit 521. Then, the display control unit 512 displays the registration operation screen image stored in the display screen storage unit 521 on the display unit 504 (step S313). Here, the registration operation screen image displays the cooking setting estimation pattern by pattern name for pattern identification information for which pattern name information has been selected from the pattern identification information stored in the registration pattern storage unit 533. Subsequently, the process of step S301 is executed again.
[0072] As described above, in the cooking system according to this embodiment, the model generation unit 116 generates cooking setting estimation model information based on cooking history information that shows the history of changes in cooking settings from the start to the end of cooking in the past, i.e., the set heat level and the type of heating unit 11 used. The cooking setting estimation unit 118 estimates the set heat level and the type of heating unit 11 to be used from the start of cooking until the next control update time, based on the changes in the set heat level and the type of heating unit 11 used from the start of cooking until the control update time. The heating control unit 113 then controls the heating unit 11 based on the estimated set heat level and the type of heating unit 11 used. As a result, the user can cook the food according to the cooking settings used when cooking the food in the past, without having to set the set heat level and the type of heating unit 11 used at each time period from the start to the end of cooking, thus improving user convenience.
[0073] Furthermore, the classification unit 212 in this embodiment classifies multiple cooking history information, which shows the history of changes in set heat and the type of heating unit 11 from the start to the end of cooking within a past reference period, into multiple cooking setting transition patterns. The recommendation pattern identification unit 213 identifies cooking setting transition patterns to which the user should be recommended to generate a cooking setting estimation model, based on the number of cooking history information belonging to each of the multiple cooking setting transition patterns. The model generation unit 116 then generates cooking setting estimation model information based on the cooking setting history shown by the multiple cooking history information belonging to the identified cooking setting transition pattern. As a result, cooking setting estimation model information corresponding to the cooking setting transition patterns that the user frequently uses when cooking is registered in the cooking equipment 1. Therefore, when the user cooks using a cooking setting transition pattern that they frequently use, they do not need to set the set heat and the type of heating unit 11 to use, thus reducing the burden on the user.
[0074] Incidentally, cooking systems have been provided that allow users to operate cooking appliances such as induction cooktops via a terminal device 5. In this type of cooking system, the terminal device 5 has pre-registered information indicating the operation of cooking appliances that the user uses frequently, and displays the registered operation details in a list format on the display unit 504. Here, the information indicating the operation details includes, for example, combinations of heating method, heating type, heat level, and heating time for the cooking appliance, and in some cases, users can register their own custom operation names for each of these. For example, by registering the operation name "Fluffy Omelet" for the combination of heating method, heating type, heat level, and heating time when cooking an "omelet," the user can simply select the combination with the operation name "Fluffy Omelet" via the input unit 505 of the terminal device 5, and the cooking appliance will control itself with the control content necessary to achieve the selected combination.
[0075] However, with this conventional cooking system, users were required to pre-register combinations of heating methods, heating types, heat levels, and heating times for the cooking equipment, which could be burdensome for users. In contrast, in the cooking system according to this embodiment, the cloud server 2 identifies cooking history information belonging to cooking setting transition patterns that are frequently used by the user, and the cooking equipment 1 generates cooking setting transition model information based on the identified cooking history information. Thereafter, the heating unit 11 is controlled using the cooking setting transition model indicated by the generated cooking setting estimation model information. As a result, users do not need to register the set heat level, heating unit 11 type, etc. for each time period during cooking for cooking in cooking setting transition patterns that are frequently used, thus reducing the burden on users.
[0076] Furthermore, in the cooking system according to this embodiment, if the set heat level or the type of heating unit 11 is changed between the start and end of cooking, the model update unit 119 updates the cooking setting estimation model information after cooking is complete, based on the changes in the set heat level and the type of heating unit stored in the cooking setting storage unit 131. As a result, for cooking setting estimation models corresponding to cooking setting transition patterns frequently used by the user, if the user changes the set heat level or the type of heating unit 11 used between the start and end of cooking, the cooking setting estimation model is used to estimate and determine that the set heat level and the type of heating unit 11 were inappropriate, and the cooking setting estimation model information is updated.
[0077] (Embodiment 2) The control system according to this embodiment differs from Embodiment 1 in that the cloud server generates a cooking setting estimation model and transmits cooking setting estimation model information indicating the generated cooking setting estimation model to the cooking appliance 1. The cooking appliance then uses the cooking setting estimation model transmitted from the cloud server to estimate the cooking settings of the cooking appliance 1.
[0078] The hardware configuration of the cooking system according to this embodiment is the same as that of the cooking system according to Embodiment 1. Hereinafter, hardware configurations similar to those in Embodiment 1 will be described using the same reference numerals as in Embodiment 1. The CPU 101 of the control unit 2100 of the cooking appliance 2001 reads the program stored in the auxiliary storage unit 103 into the main storage unit 102 and executes it, so as shown in Figure 16, it functions as a reception unit 111, a cooking setting change unit 112, a heating control unit 113, a history notification unit 114, a history acquisition unit 115, a command acquisition unit 117, a cooking setting estimation unit 118, a model update unit 119, a temperature acquisition unit 120, and a model acquisition unit 2121. Note that in Figure 16, components similar to those in Embodiment 1 are denoted by the same reference numerals as in Figure 3. The auxiliary storage unit 103 also includes a cooking setting storage unit 131, a temperature storage unit 132, and a model storage unit 133, as shown in Figure 16. The model acquisition unit 2121 acquires cooking setting estimation model information and corresponding pattern identification information transmitted from the cloud server 2002, and stores the acquired cooking setting estimation model information and pattern identification information in the model storage unit 133, associating them with each other.
[0079] The CPU 201 of the cloud server 2002 functions as a history acquisition unit 211, a classification unit 212, a recommendation pattern identification unit 213, a recommendation pattern notification unit 214, a registration request acquisition unit 215, a voice information acquisition unit 217, a voice analysis unit 218, a command unit 219, a command acquisition unit 220, a model generation unit 2221, and a model transmission unit 2222 by reading programs stored in the auxiliary storage unit 203 into the main memory and executing them. The auxiliary storage unit 203 also includes a history storage unit 231 and a model storage unit 2232. The model storage unit 2232 stores cooking setting estimation model information generated by the model generation unit 2221, associating it with corresponding pattern identification information.
[0080] The model generation unit 2221 selects cooking history information from among multiple cooking history information stored in the history storage unit 231 that corresponds to the combination of user identification information and pattern identification information notified by the registration request acquisition unit 215. Then, using the combination of set heat information, heating unit type information, measured temperature information, and elapsed time information corresponding to the selected cooking history information, the model generation unit 2221 generates cooking setting estimation model information that shows a cooking setting estimation model corresponding to the cooking setting transition pattern indicated by the pattern identification information notified by the registration request acquisition unit 215. The model generation unit 2221 stores the generated cooking setting estimation model information in the model storage unit 2232. The model transmission unit 2222 selects cooking setting estimation model information corresponding to the pattern identification information notified by the registration request acquisition unit 215 from among the cooking setting estimation model information stored in the model storage unit 2232, and transmits the selected cooking setting estimation model information together with the corresponding pattern identification information to the cooking equipment 2001.
[0081] Next, the operation of the cooking system according to this embodiment will be described with reference to Figure 17. In Figure 17, the same reference numerals as in Figures 8, 9, and 11 are used for processes similar to those in Embodiment 1. First, after a series of processes from steps S1 to S8 are executed, the user performs a model registration operation on the input unit 505 to register cooking setting estimation model information corresponding to a cooking setting transition pattern selected from among multiple cooking setting transition patterns to the cooking equipment 2001, while referring to the registration operation screen image displayed on the display unit 504 of the terminal device 5. In this case, the terminal device 5 receives the model registration operation and generates registration request information as described above (step S9). Next, the generated registration request information is sent from the terminal device 5 to the cloud server 2002 (step S10). On the other hand, when the cloud server 2002 obtains the registration request information, it identifies the cooking history information associated with the pattern identification information included in the obtained registration request information from the cooking history information stored in the history storage unit 231 (step S11). Next, the cloud server 2002 generates cooking setting estimation model information that indicates a cooking setting estimation model corresponding to a cooking setting transition pattern, using the combination of setting heat information, heating unit type information, measured temperature information, and elapsed time information contained in each identified cooking history information (step S2001). Here, the cloud server 2002 stores the generated cooking setting estimation model information in the model storage unit 2232, associating it with the corresponding pattern identification information. Subsequently, the cooking setting estimation model information and the corresponding pattern identification information stored in the model storage unit 2232 are transmitted from the cloud server 2002 to the cooking equipment 2001 (step S2002). Meanwhile, when the cooking equipment 2001 receives the cooking setting estimation model information and the corresponding pattern identification information transmitted from the cloud server 2, it stores the acquired cooking setting estimation model information and pattern identification information in the model storage unit 133, associating them with each other (step S2003).
[0082] Next, the model transmission process performed by the cloud server 2 according to this embodiment to send cooking setting estimation model information to the cooking equipment 1 will be explained with reference to Figure 18. In Figure 18, processes similar to the cooking history transmission process described in Embodiment 1 are denoted by the same reference numerals as in Figure 12. First, after a series of processes from steps S201 to S207 are executed, the registration request acquisition unit 215 determines whether or not it has acquired the registration request information transmitted from the terminal device 5 (step S208). If the registration request acquisition unit 215 determines that it has not acquired the registration request information (step S208: No), the process in step S201 is executed again. On the other hand, if the registration request acquisition unit 215 determines that it has acquired the aforementioned registration request information (step S208: Yes), it extracts the pattern identification information contained in the acquired registration request information and notifies the history notification unit 216. Then, the model generation unit 2221 identifies the cooking history information associated with the pattern identification information notified by the registration request acquisition unit 215 from among the cooking history information stored in the history storage unit 231 (step S209). Next, the model generation unit 2221 generates cooking setting estimation model information that indicates a cooking setting estimation model corresponding to a cooking setting transition pattern, using the combination of set heat information, heating unit type information, measured temperature information, and elapsed time information contained in each of the identified cooking history information. Then, the model generation unit 2221 stores the generated cooking setting estimation model information in the model storage unit 2232, associating it with the corresponding pattern identification information (step S2201). Subsequently, the model transmission unit 2222 selects cooking setting estimation model information corresponding to the pattern identification information notified by the registration request acquisition unit 215 from the cooking setting estimation model information stored in the model storage unit 2232, and transmits the selected cooking setting estimation model information and the corresponding pattern identification information to the cooking equipment 2001 (step S2202). After that, the process in step S201 is executed again.
[0083] As described above, in the cooking system according to this embodiment, the cloud server 2002 generates cooking setting estimation model information and transmits the generated cooking setting estimation model information to the cooking device 2001. This eliminates the need for the cooking device 2001 to generate cooking setting estimation model information from multiple cooking history information, thus reducing the processing load on the cooking device 2001.
[0084] Although embodiments of the present disclosure have been described above, the present disclosure is not limited to the embodiments described above. For example, as shown in Figure 19, multiple cooking appliances 2001A and 2001B may be able to communicate with a cloud server 2002 via a local network NW2 and a wide-area network NW1, respectively, and the cooking setting estimation model information generated by the cloud server 2002 may be shared among the multiple cooking appliances 2001A and 2001B. In Figure 19, components similar to those in Embodiment 1 are denoted by the same reference numerals as in Figure 1. Terminal devices 5A and 5B are connected to the local network NW2 to which cooking appliances 2001A and 2001B are connected, respectively. Furthermore, the hardware configuration and functional configuration of the cooking appliances 2001A and 2001B and the cloud server 2002 in this modified example are the same as the hardware configuration and functional configuration of the cooking appliance 2001 and the cloud server 2002 described in Embodiment 2. Furthermore, the hardware and functional configurations of terminal devices 5A and 5B are the same as those of terminal device 5 described in Embodiment 1. Hereafter, in this modified example, the same reference numerals used in the descriptions of Embodiments 1 and 2 will be used as appropriate.
[0085] The operation of the cooking system according to this modified example will be explained with reference to Figure 20. In Figure 19, the same reference numerals as in Figures 8, 9, and 11 are used for processes similar to those in Embodiment 1. First, suppose the user performs a model registration operation to register cooking setting estimation model information corresponding to a cooking setting transition pattern selected from among multiple cooking setting transition patterns to the cooking equipment 2001A at the input unit 505 of the terminal device 5A. In this case, the terminal device 5A receives the model registration operation and generates registration request information as described above (step S9). Next, the generated registration request information is sent from the terminal device 5A to the cloud server 2002 (step S10). On the other hand, suppose the cloud server 2002 determines that there is no cooking setting estimation model information associated with the pattern identification information included in the acquired registration request information among the cooking setting estimation model information stored in the model storage unit 2232 (step S3001). In this case, the cloud server 2002 identifies the cooking history information associated with the pattern identification information included in the acquired registration request information from among the cooking history information stored in the history storage unit 231 (step S3002). Next, the cloud server 2002 generates cooking setting estimation model information that indicates a cooking setting estimation model corresponding to a cooking setting transition pattern, using the combination of setting heat information, heating unit type information, measured temperature information, and elapsed time information contained in each identified cooking history information (step S3003). Here, the cloud server 2002 stores the generated cooking setting estimation model information in the model storage unit 2232, associating it with the corresponding pattern identification information. Subsequently, the cooking setting estimation model information and the corresponding pattern identification information stored in the model storage unit 2232 are transmitted from the cloud server 2002 to the cooking device 2001A (step S3004). Meanwhile, when the cooking device 2001A receives the cooking setting estimation model information and the corresponding pattern identification information transmitted from the cloud server 2, it stores the acquired cooking setting estimation model information and pattern identification information in the model storage unit 133, associating them with each other (step S3005).
[0086] Next, suppose the user performs a model registration operation on the input unit 505 of the terminal device 5B to register cooking setting estimation model information corresponding to a cooking setting transition pattern selected from among multiple cooking setting transition patterns to the cooking appliance 2001B. In this case, the terminal device 5B accepts the model registration operation and generates registration request information as described above (step S3006). Subsequently, the generated registration request information is sent from the terminal device 5B to the cloud server 2002 (step S3007). Meanwhile, suppose the cloud server 2002 determines that there is cooking setting estimation model information stored in the model storage unit 2232 that is associated with the pattern identification information included in the acquired registration request information (step S3008). In this case, the cloud server 2002 identifies the cooking setting estimation model information associated with the pattern identification information included in the acquired registration request information (step S3009). After that, the identified cooking setting estimation model information and the corresponding pattern identification information are sent from the cloud server 2002 to the cooking appliance 2001B (step S3010). Meanwhile, when cooking appliance 2001B receives cooking setting estimation model information and corresponding pattern identification information transmitted from cloud server 2, it associates the acquired cooking setting estimation model information and pattern identification information with each other and stores them in model storage unit 133 (step S3011). In this way, the same cooking setting estimation model information generated by cloud server 2002 is registered in both cooking appliances 2001A and 2001B.
[0087] This configuration allows multiple users to control cooking appliances 2001A and 2001B using a common cooking setting estimation model. For example, it enables users to control cooking appliances 2001A and 2001B even for dishes they have no prior experience with, using the cooking setting estimation model. Consequently, users can perform a wider variety of cooking tasks appropriately, thus increasing user convenience.
[0088] In each embodiment, for example, as shown in Figure 21(A), the heating setting storage unit 4131 may store the set heat information for each time period after the start of cooking, corresponding to the elapsed time information, separately for each of the multiple types of heating units 11. Then, as shown in Figure 21(B), the temperature storage unit 4132 may store the measured temperature information for each time period after the start of cooking, corresponding to the elapsed time information, separately for each of the multiple types of heating units 11. In this case, a cooking setting estimation model exists for each of the multiple types of heating units 11, and estimates only the set heat for the period from the start of cooking to the next control update time based on the changes in set heat and measured temperature for the corresponding heating unit 11 from the start of cooking to the control update time. The cooking setting estimation unit 118 then individually estimates only the set heat for the period from the start of cooking to the next control update time based on the changes in set heat and measured temperature for each of the multiple types of heating units 11, using the cooking setting estimation model. Furthermore, the history storage unit 231 stores cooking history information separately for each of the multiple types of heating units 11, and the model generation units 116 and 2221 generate cooking setting estimation model information separately for each of the multiple types of heating units 11.
[0089] With this configuration, cooking setting estimation model information is generated separately for each of the multiple types of heating units 11, thus reducing estimation errors due to differences in the types of heating units 11. Therefore, the set heat levels of cooking equipment 1, 2001 can be estimated with high accuracy until the next control update time.
[0090] In the cooking system according to Embodiment 1, there may be multiple cooking devices 1, and each of the multiple cooking devices 1 may have a model transmission unit that transmits cooking setting estimation model information stored in the model storage unit 133 to other cooking devices 1, and a model acquisition unit that acquires cooking setting estimation model information transmitted from other cooking devices 1 and stores the acquired cooking setting estimation model information in the model storage unit 133. In this case, the cooking setting estimation unit 118 can estimate the cooking settings using the cooking setting estimation model indicated by the acquired cooking setting estimation model information transmitted from other cooking devices 1.
[0091] In each embodiment, the terminal device 5 may display on the display unit 504 an operation screen image that displays the heat output, temperature, etc. of the heating unit 11 of the cooking appliance 1, 2001 in real time, or an operation screen image that displays a countdown of when the heat output of the heating unit 11 will be changed, estimated using a cooking setting estimation model. This configuration has the advantage that it makes it easier for the user to grasp the progress of cooking with the cooking appliance 1, 2001.
[0092] In each embodiment, the recommended pattern identification unit 213 may always identify multiple cooking setting transition patterns based on the number of cooking history information items belonging to each of the calculated multiple cooking setting transition patterns, and the recommended pattern notification unit 214 may transmit pattern identification information of the multiple cooking setting transition patterns identified by the recommended pattern identification unit 213 to the terminal device 5. The terminal device 5 may then create a registration operation screen image and display it on the display unit 504 in order to register the recommended multiple cooking setting transition patterns to the cooking equipment 1 based on the multiple pattern identification information obtained from the cloud server 2. With this configuration, the user can narrow down the number of cooking setting transition patterns to which to register cooking setting transition model information to the cooking equipment 1 from among the multiple recommended cooking setting transition patterns. Furthermore, by increasing the number of classifications of cooking setting transition patterns, it becomes possible to classify cooking setting transition patterns in more detail. For example, when cooking a "boiled egg," the cooking setting transition pattern for so-called "hard-boiled" cooking and the cooking setting transition pattern for "soft-boiled" cooking can be displayed as separate cooking setting transition patterns on the registration operation screen image. This makes it possible to accumulate cooking setting transition patterns that are finely adapted to the user's preferences in the menu, displayed on the operation screen image when cooking using the cooking setting estimation model.
[0093] Furthermore, the various functions of cooking appliances 1, 2001, 2001A, and 2001B related to this disclosure may be realized by software, firmware, or a combination of software and firmware. In this case, the software or firmware may be written as a program, and the program may be stored on a computer-readable recording medium such as a flexible disk, CD-ROM (Compact Disc Read Only Memory), DVD (Digital Versatile Disc), and MO (Magneto-Optical Disc) and distributed, and a computer capable of realizing the aforementioned functions may be configured by loading and installing the program on a computer. In cases where each function is realized by a division of labor between the OS (Operating System) and an application, or by cooperation between the OS and an application, only the parts other than the OS may be stored on the recording medium.
[0094] Furthermore, it is possible to superimpose each program onto the carrier wave and distribute it over a network. For example, the program could be posted on a bulletin board system (BBS) on the network and distributed over the network. These programs could then be launched and executed under the control of the OS, just like other application programs, to perform the aforementioned processing.
[0095] Although preferred embodiments have been described in detail above, the invention is not limited to the embodiments described above, and various modifications and substitutions can be made to the embodiments described above without departing from the scope of the claims.
[0096] The various aspects of this disclosure are summarized below as an appendix.
[0097] (Note 1) A cooking appliance having a heating section for heating the food to be cooked, After cooking has started, each time a control update period arrives for updating the pre-set control content of the heating unit, a cooking setting estimation unit estimates the cooking settings from the transition of cooking settings, including the set heat level when heating the food to be cooked by the heating unit, from the start of cooking to the control update period until the next control update period, using a cooking setting estimation model. A heating control unit controls the heating unit based on the estimated cooking settings, The system includes a model generation unit that generates cooking setting estimation model information representing the cooking setting estimation model based on cooking history information including the history of the changes in cooking settings from the start to the end of cooking in the past, Cooking system. (Note 2) A classification unit that classifies multiple cooking history information showing the history of cooking settings from the start to the end of cooking within a predetermined period in the past into multiple cooking setting transition patterns, The system further includes a recommendation pattern identification unit that identifies a cooking setting transition pattern to which it recommends the generation of the cooking setting estimation model to the user, based on the number of cooking history information items belonging to each of the plurality of cooking setting transition patterns, The model generation unit generates cooking setting estimation model information representing the cooking setting estimation model based on the cooking setting history indicated by the plurality of cooking history information belonging to the identified cooking setting transition pattern. The cooking system described in Appendix 1. (Note 3) Input section, The system further comprises: a command unit that, when a user performs a pattern selection operation to select one cooking setting transition pattern from among the plurality of cooking setting transition patterns to the input unit, generates command information that instructs the system to estimate the cooking settings using the cooking setting estimation model corresponding to the selected cooking setting transition pattern, based on the content of the pattern selection operation; The cooking system described in Appendix 2. (Note 4) A terminal device having an input section, The cooking appliance includes an operating unit, When a user performs a setting change operation on the input unit to change the cooking settings, or when a user performs a setting change operation on the operation unit to change the cooking settings, the cooking setting change unit changes the cooking settings based on the content of the setting change operation. The system further includes a model update unit that updates cooking setting transition model information, which indicates the cooking setting estimation model, based on the changed cooking settings if the cooking settings are changed between the start and end of cooking. A cooking system as described in any one of the items 1 to 3 of the appendix. (Note 5) A voice input device that generates voice information indicating the voice when voice is input, A voice analysis unit analyzes the voice information and determines whether or not the voice information indicates a command to change the cooking settings, When it is determined that the voice information indicates a command to change the cooking settings, a cooking setting change unit changes the cooking settings based on the voice information. The system further includes a model update unit that updates cooking setting transition model information, which indicates the cooking setting estimation model, based on the changed cooking settings if the cooking settings are changed between the start and end of cooking. A cooking system as described in any one of the items 1 to 4 of the appendix. (Note 6) A voice input device that generates voice information indicating the voice when voice is input, A voice analysis unit analyzes the voice information and determines whether or not the voice information indicates the selection of one cooking setting transition pattern from among the multiple cooking setting transition patterns, The system further comprises: a command unit that, when it is determined that the voice information indicates the selection of one cooking setting transition pattern from among the plurality of cooking setting transition patterns, generates command information that instructs the system to estimate the cooking settings using the cooking setting estimation model corresponding to the selected cooking setting transition pattern, based on the voice information; The cooking system described in Appendix 2. (Note 7) There are multiple cooking appliances, Each of the aforementioned cooking appliances is, A model transmission unit that transmits cooking setting estimation model information, which shows the cooking setting estimation model, to other cooking equipment, It includes a model acquisition unit that acquires the cooking setting estimation model information transmitted from other cooking equipment, The cooking setting estimation unit estimates the cooking settings using the cooking setting estimation model indicated by the cooking setting estimation model information transmitted from other cooking equipment that it has acquired. A cooking system as described in any one of the items 1 to 6 of the appendix. (Note 8) The server further comprises a model storage unit that can communicate with the cooking equipment and stores cooking setting estimation model information indicating the cooking setting estimation model, and a model transmission unit that transmits the cooking setting estimation model information stored in the model storage unit to the cooking equipment, The cooking setting estimation unit estimates the cooking settings using the cooking setting estimation model indicated by the cooking setting estimation model information acquired by the cooking equipment from the server. A cooking system as described in any one of the items 1 to 6 of the appendix. (Note 9) There are multiple heating units, The cooking setting estimation model exists separately for each of the multiple heating units. A cooking system as described in any one of the items 1 to 8 of the appendix. (Note 10) A heating section for heating the food to be cooked, After cooking has started, each time a control update period arrives for updating the pre-set control content of the heating unit, a cooking setting estimation unit estimates the cooking settings from the transition of cooking settings, including the set heat level when heating the food to be cooked by the heating unit, from the start of cooking to the control update period until the next control update period, using a cooking setting estimation model. A heating control unit controls the heating unit based on the estimated cooking settings, The system includes a model generation unit that generates cooking setting estimation model information representing the cooking setting estimation model based on cooking history information including the history of the changes in cooking settings from the start to the end of cooking in the past, cooking equipment. (Note 11) After cooking of the object to be cooked begins, each time a control update period arrives in which the control content of the heating unit that heats the object to be cooked is updated, the cooking settings are estimated using a cooking setting estimation model that estimates the cooking settings from the transition of cooking settings, including the set heat level when the heating unit heats the object to be cooked, from the start of cooking to the control update period until the next control update period. A step of controlling the heating unit based on the estimated cooking settings, The process includes the step of generating cooking setting estimation model information that represents the cooking setting estimation model, based on cooking history information that includes a history of the changes in cooking settings from the start to the end of cooking in the past. A method for controlling cooking equipment. (Note 12) Computers, After cooking of the object to be cooked begins, each time a control update period arrives for updating the control content of the heating unit that heats the object to be cooked, a cooking setting estimation unit estimates the cooking settings from the transition of cooking settings, including the set heat level when the heating unit heats the object to be cooked, from the start of cooking to the control update period until the next control update period, using a cooking setting estimation model. A heating control unit controls the heating unit based on the estimated cooking settings. A model generation unit generates cooking setting estimation model information that represents the cooking setting estimation model, based on cooking history information including the history of the changes in cooking settings from the start to the end of cooking in the past. A program designed to function as such. [Industrial applicability]
[0098] This disclosure is suitable as a cooking system having a function to assist users in setting up cooking equipment when cooking. [Explanation of symbols]
[0099] 1,2001,2001A,2001B Cooking equipment, 2,2002 Cloud server, 5,5A,5B Terminal device, 7 Voice input device, 11 Heating unit, 12 Heating drive unit, 17 Operation unit, 18 Temperature sensor, 81 Data line termination device, 82 Router, 100,2100 Control unit, 101,201,501 CPU, 102,202,502 Main memory unit, 103,203,503 Auxiliary memory unit, 104 Neuro engine, 106,506 Local notification unit, 107 Interface, 108 Timing unit, 109,209 Bus, 111,513 Reception unit, 112 Cooking setting change unit, 113 Heating control unit, 114,216 History notification unit, 115,211 History acquisition unit, 116,2221 Model generation unit, 117 Command acquisition unit, 118 Cooking setting estimation unit, 119 Model update unit, 120 Temperature acquisition unit, 131 Cooking setting storage unit, 132 Temperature storage unit, 133, 2232 Model storage unit, 212 Classification unit, 213 Recommended pattern identification unit, 214 Recommended pattern notification unit, 215 Registration request acquisition unit, 217 Voice information acquisition unit, 218 Voice analysis unit, 219, 514 Command unit, 220 Command acquisition unit, 504 Display unit, 505 Input unit, 511 Image formation unit, 512 Display control unit, 515 Registration request unit, 516 Recommended pattern acquisition unit, 517 Pattern name selection unit, 518 Name setting unit, 2121 Model acquisition unit, 2222 Model transmission unit, BU11, BU12, BU21, BU22, BU23, BU24 Button image, GA1, GA2 Operation screen image, IC1 Icon image, M11, M12, M13, M14 Message image, L110 Input layer, L120 Hidden layer, L130 Output layer, NW1 Wide area network, NW2 Local network
Claims
1. A cooking appliance having a heating section for heating the food to be cooked, After cooking has started, each time a control update period arrives for updating the pre-set control content of the heating unit, a cooking setting estimation unit estimates the cooking settings from the transition of cooking settings, including the set heat level when heating the food to be cooked by the heating unit, from the start of cooking to the control update period until the next control update period, using a cooking setting estimation model. A heating control unit controls the heating unit based on the estimated cooking settings, A model generation unit generates cooking setting estimation model information that shows the cooking setting estimation model based on cooking history information including the history of the changes in cooking settings from the start to the end of cooking in the past, A classification unit that classifies multiple cooking history information showing the history of cooking settings from the start to the end of cooking within a predetermined period in the past into multiple cooking setting transition patterns, The system includes a recommendation pattern identification unit that identifies a cooking setting transition pattern to which the user is recommended to generate the cooking setting estimation model, based on the number of cooking history information items belonging to each of the plurality of cooking setting transition patterns. The model generation unit generates cooking setting estimation model information representing the cooking setting estimation model based on the cooking setting history indicated by the plurality of cooking history information belonging to the identified cooking setting transition pattern. Cooking system.
2. A cooking appliance having a heating section for heating an object to be cooked, After cooking has started, each time a control update period arrives for updating the pre-set control content of the heating unit, a cooking setting estimation unit estimates the cooking settings from the transition of cooking settings, including the set heat level when heating the food to be cooked by the heating unit, from the start of cooking to the control update period until the next control update period, using a cooking setting estimation model. A heating control unit controls the heating unit based on the estimated cooking settings, The system includes a model generation unit that generates cooking setting estimation model information representing the cooking setting estimation model based on cooking history information including the history of the changes in cooking settings from the start to the end of cooking in the past, There are multiple heating units, The cooking setting estimation model exists separately for each of the multiple heating units. Cooking system.
3. Input section, The system further comprises: a command unit that, when a user performs a pattern selection operation to select one cooking setting transition pattern from among the plurality of cooking setting transition patterns to the input unit, generates command information that instructs the system to estimate the cooking settings using the cooking setting estimation model corresponding to the selected cooking setting transition pattern, based on the content of the pattern selection operation; The cooking system according to claim 1.
4. A terminal device having an input section, The cooking appliance includes an operating unit, When a user performs a setting change operation on the input unit to change the cooking settings, or when a user performs a setting change operation on the operation unit to change the cooking settings, the cooking setting change unit changes the cooking settings based on the content of the setting change operation. The system further includes a model update unit that updates cooking setting transition model information, which indicates the cooking setting estimation model, based on the changed cooking settings if the cooking settings are changed between the start and end of cooking. The cooking system according to claim 1 or 2.
5. A voice input device that generates voice information indicating the voice when voice is input, A voice analysis unit analyzes the voice information and determines whether or not the voice information indicates a command to change the cooking settings, When it is determined that the voice information indicates a command to change the cooking settings, a cooking setting change unit changes the cooking settings based on the voice information. The system further includes a model update unit that updates cooking setting transition model information, which indicates the cooking setting estimation model, based on the changed cooking settings if the cooking settings are changed between the start and end of cooking. The cooking system according to claim 1 or 2.
6. A voice input device that generates voice information indicating the voice when voice is input, A voice analysis unit analyzes the voice information and determines whether or not the voice information indicates the selection of one cooking setting transition pattern from among the multiple cooking setting transition patterns. The system further includes a command unit that, when it is determined that the voice information indicates the selection of one cooking setting transition pattern from among the plurality of cooking setting transition patterns, generates command information that instructs the system to estimate the cooking settings using the cooking setting estimation model corresponding to the selected cooking setting transition pattern, based on the voice information. The cooking system according to claim 1.
7. A cooking appliance having a heating section for heating an object to be cooked, After cooking has started, each time a control update period arrives for updating the pre-set control content of the heating unit, a cooking setting estimation unit estimates the cooking settings from the transition of cooking settings, including the set heat level when heating the food to be cooked by the heating unit, from the start of cooking to the control update period until the next control update period, using a cooking setting estimation model. A heating control unit controls the heating unit based on the estimated cooking settings, The system includes a model generation unit that generates cooking setting estimation model information representing the cooking setting estimation model based on cooking history information including the history of the changes in cooking settings from the start to the end of cooking in the past, There are multiple cooking appliances, Each of the aforementioned cooking appliances is, A model transmission unit that transmits cooking setting estimation model information, which shows the cooking setting estimation model, to other cooking equipment, It includes a model acquisition unit that acquires the cooking setting estimation model information transmitted from other cooking equipment, The cooking setting estimation unit estimates the cooking settings using the cooking setting estimation model indicated by the cooking setting estimation model information transmitted from other cooking equipment that it has acquired. Cooking system.
8. The server further comprises a model storage unit that can communicate with the cooking equipment and stores cooking setting estimation model information indicating the cooking setting estimation model, and a model transmission unit that transmits the cooking setting estimation model information stored in the model storage unit to the cooking equipment, The cooking setting estimation unit estimates the cooking settings using the cooking setting estimation model indicated by the cooking setting estimation model information acquired by the cooking equipment from the server. A cooking system according to any one of claims 1, 2, 6, or 7.
9. A heating section for heating the food to be cooked, After cooking has started, each time a control update period arrives for updating the pre-set control content of the heating unit, a cooking setting estimation unit estimates the cooking settings from the transition of cooking settings, including the set heat level when heating the food to be cooked by the heating unit, from the start of cooking to the control update period until the next control update period, using a cooking setting estimation model. A heating control unit controls the heating unit based on the estimated cooking settings, A model generation unit generates cooking setting estimation model information that shows the cooking setting estimation model based on cooking history information including the history of the changes in cooking settings from the start to the end of cooking in the past, A classification unit that classifies multiple cooking history information showing the history of cooking settings from the start to the end of cooking within a predetermined period in the past into multiple cooking setting transition patterns, The system includes a recommendation pattern identification unit that identifies a cooking setting transition pattern to which the user is recommended to generate the cooking setting estimation model, based on the number of cooking history information items belonging to each of the plurality of cooking setting transition patterns. The model generation unit generates cooking setting estimation model information representing the cooking setting estimation model based on the cooking setting history indicated by the plurality of cooking history information belonging to the identified cooking setting transition pattern. cooking equipment.
10. A heating unit for heating the food to be cooked, After cooking has started, each time a control update period arrives for updating the pre-set control content of the heating unit, a cooking setting estimation unit estimates the cooking settings from the transition of cooking settings, including the set heat level when heating the food to be cooked by the heating unit, from the start of cooking to the control update period until the next control update period, using a cooking setting estimation model. A heating control unit controls the heating unit based on the estimated cooking settings, The system includes a model generation unit that generates cooking setting estimation model information representing the cooking setting estimation model based on cooking history information including the history of the changes in cooking settings from the start to the end of cooking in the past, There are multiple heating units, The cooking setting estimation model exists separately for each of the multiple heating units. cooking equipment.
11. After cooking of an object to be cooked, each time a control update period arrives in which a predetermined control update period for updating the control content of the heating unit that heats the object to be cooked arrives, the cooking equipment estimates the cooking settings from the transition of cooking settings, including the set heat output when heating the object to be cooked by the heating unit, from the start of cooking to the control update period until the next control update period, using a cooking setting estimation model. The cooking appliance controls the heating unit based on the estimated cooking settings, The cooking equipment includes the step of classifying multiple cooking history information, which shows the history of cooking settings from the start to the end of cooking within a predetermined period in the past, into multiple cooking setting transition patterns, The cooking equipment identifies a cooking setting transition pattern for which it recommends the generation of the cooking setting estimation model to the user, based on the number of cooking history information items belonging to each of the plurality of cooking setting transition patterns. The cooking equipment includes the step of generating cooking setting estimation model information that represents the cooking setting estimation model based on the cooking setting history indicated by the plurality of cooking history information belonging to the identified cooking setting transition pattern, A method for controlling cooking equipment.
12. After cooking of an object to be cooked, each time a control update period arrives in which a predetermined control update period for updating the control content of the heating unit that heats the object to be cooked arrives, the cooking equipment estimates the cooking settings from the transition of cooking settings, including the set heat output when heating the object to be cooked by the heating unit, from the start of cooking to the control update period until the next control update period, using a cooking setting estimation model. The cooking appliance controls the heating unit based on the estimated cooking settings, The cooking equipment includes the step of generating cooking setting estimation model information that represents the cooking setting estimation model based on cooking history information including a history of the changes in the cooking settings from the start to the end of cooking in the past, There are multiple heating units, The cooking setting estimation model exists separately for each of the multiple heating units. A method for controlling cooking equipment.
13. Computers, After cooking of the object to be cooked begins, each time a control update period arrives for updating the control content of the heating unit that heats the object to be cooked, a cooking setting estimation unit estimates the cooking settings from the transition of cooking settings, including the set heat level when the heating unit heats the object to be cooked, from the start of cooking to the control update period until the next control update period, using a cooking setting estimation model. A heating control unit controls the heating unit based on the estimated cooking settings. A model generation unit generates cooking setting estimation model information that represents the cooking setting estimation model, based on cooking history information including the history of the changes in cooking settings from the start to the end of cooking in the past. A classification unit that classifies multiple cooking history information showing the history of cooking settings from the start to the end of cooking within a predetermined period in the past into multiple cooking setting transition patterns. A recommendation pattern identification unit identifies a cooking setting transition pattern that recommends the generation of the cooking setting estimation model to the user, based on the number of cooking history information items belonging to each of the plurality of cooking setting transition patterns. It is a program designed to function as such. The model generation unit generates cooking setting estimation model information representing the cooking setting estimation model based on the cooking setting history indicated by the plurality of cooking history information belonging to the identified cooking setting transition pattern. program.
14. Computers, After cooking of the object to be cooked begins, each time a control update period arrives for updating the control content of the heating unit that heats the object to be cooked, a cooking setting estimation unit estimates the cooking settings from the transition of cooking settings, including the set heat level when the heating unit heats the object to be cooked, from the start of cooking to the control update period until the next control update period, using a cooking setting estimation model. A heating control unit controls the heating unit based on the estimated cooking settings. A model generation unit generates cooking setting estimation model information that represents the cooking setting estimation model, based on cooking history information including the history of the changes in cooking settings from the start to the end of cooking in the past. It is a program designed to function as such. There are multiple heating units, The cooking setting estimation model exists separately for each of the multiple heating units. program.
Citation Information
Patent Citations
Microwave oven with infrared evaluation control
JP2019519744A
Voice control system and voice control device
JP2020187689A
cooker
JP2021162268A
Heating cooker and cooking method with heat
JP2021173458A
Control of artificial intelligent cooking device
KR1020210106685A