Information processing device, information processing method, cooking system, and cooking method
An information processing device generates new recipes by analyzing chemical and sensory data, facilitating chef innovation and robotic cooking automation.
Patent Information
- Application Number
- JP2021537229
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2019-08-08
- Filing Date
- 2020-07-27
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2040-07-27
AI Technical Summary
Existing culinary practices face challenges in creating new recipes due to fixed concepts based on common sense and cultural or experiential limitations.
An information processing device that analyzes chemical structure, sensor, and subjective flavor information to generate new recipes by vector operations, enabling a cooking robot to autonomously prepare dishes based on selected ingredient combinations.
Facilitates the creation of novel recipes and automates cooking processes, allowing chefs to innovate and cooking robots to prepare unique dishes accurately.
Smart Images

Figure 0007593317000014 
Figure 0007593317000015 
Figure 0007593317000016
Abstract
Description
[Technical field]
[0001] The present technology relates in particular to an information processing device and an information processing method that are capable of generating new recipes, Cooking systems, and How to cook By law Regarding. [Background technology]
[0002] There are services that publish cooking recipes. Users can search for their favorite recipes by searching through categories or by entering the names of ingredients as keywords.
[0003] For example, a restaurant chef is not only required to serve the same dishes according to existing recipes, but also to create new recipes by devising new ingredients, cooking methods, and presentation methods. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Special Publication No. 2017-506169 [Patent Document 2] Special Publication No. 2017-536247 Summary of the Invention [Problem to be solved by the invention]
[0005] It is not easy to continue creating new recipes because of stereotypes based on common sense, culture, and experience in the culinary world.
[0006] The present technology has been made in light of these circumstances, and makes it possible to generate new recipes. [Means for solving the problem]
[0007] The information processing device according to the first aspect of the present technology is configured to calculate the chemical structure of ingredients used in cooking. A vector with multiple elements Chemical structure information , Se The results were obtained by measuring The flavor of the food is represented by a vector with multiple items as elements. Sensor information and human subjective evaluation of the flavor of ingredients A vector with multiple elements The recipe generating unit generates a new recipe based on the subjective flavor information represented by the recipe generating unit. The recipe generation unit selects a combination of ingredients by performing a vector operation to multiply the vectors constituting the chemical structure information of each ingredient to be combined by a coefficient corresponding to the amount of each combination, and generates the new recipe using ingredients included in the selected combination of ingredients.
[0008] The second aspect of the present technology Cooking System teeth, The cooking robot includes an information processing unit that generates a new recipe based on chemical structure information representing the chemical structures of ingredients used in cooking by vectors having multiple items as elements, sensor information representing the flavors of the ingredients measured by a sensor by vectors having multiple items as elements, and subjective flavor information representing a person's subjective evaluation of the flavor of the ingredients by vectors having multiple items as elements, and a cooking robot that performs cooking based on recipe data representing the new recipe. The information processing unit selects a combination of ingredients by performing a vector operation that multiplies the vectors constituting the chemical structure information of each ingredient to be combined by a coefficient corresponding to the amount of each combination, and generates the new recipe using ingredients included in the selected combination of ingredients. [Brief description of the drawings]
[0009] [Figure 1] 1 is a diagram showing an example of recipe presentation by an information processing device according to an embodiment of the present technology; [Diagram 2] FIG. 1 is a diagram showing examples of flavor components. [Diagram 3] FIG. 13 is a diagram showing an example of a screen used to specify a flavor. [Figure 4] FIG. 10 is a diagram illustrating an example of a database used to generate a recipe. [Diagram 5] FIG. 11 is a diagram showing an example of information stored in a flavor subjective information DB. [Figure 6] FIG. 11 is a diagram illustrating an example of information stored in a sensing information DB. [Figure 7] FIG. 2 is a diagram showing an example of information stored in a chemical structure information DB. [Figure 8] FIG. 2 is a diagram showing the relationship between databases. [Figure 9] FIG. 2 is a diagram showing the relationship between databases. [Figure 10] FIG. 13 illustrates an example of creating a new recipe. [Figure 11] FIG. 13 shows an example of a recipe presentation for sake blending. [Figure 12] 11 is a flowchart showing a flow of a series of processes for generating a recipe. [Figure 13] FIG. 13 is a diagram showing an example of a subjective flavor evaluation. [Figure 14]FIG. 13 is a diagram illustrating an example of inverse transformation. [Figure 15] FIG. 2 is a block diagram illustrating an example of a hardware configuration of an information processing device. [Figure 16] 2 is a block diagram showing an example of a functional configuration of an information processing device; [Figure 17] FIG. 1 illustrates an example of the configuration of a network system. [Figure 18] FIG. 1 is a diagram illustrating an example of the configuration of a control system. [Figure 19] FIG. 4 is a diagram showing an example of the description of recipe data; [Figure 20] FIG. 11 is a diagram showing an example of a flow of recreating a dish based on recipe data. [Figure 21] FIG. 1 is a diagram illustrating an example of an arrangement of data processing devices. [Figure 22] FIG. 2 is a perspective view showing the appearance of the cooking robot. [Figure 23] FIG. 2 is an enlarged view of the cooking arm. [Figure 24] FIG. 2 is a diagram showing the appearance of the cooking arm. [Diagram 25] 11A to 11C are diagrams showing examples of ranges of motion of each part of a cooking arm. [Figure 26] FIG. 13 is a diagram showing an example of a connection between a cooking arm and a controller. [Figure 27] FIG. 2 is a block diagram showing a configuration example of a cooking robot. [Figure 28] 2 is a block diagram showing an example of a functional configuration of a data processing device. FIG. [Figure 29] 11 is a flowchart illustrating processing of the data processing device. [Diagram 30] FIG. 13 is a diagram illustrating another example of the configuration of the control system. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0010] <Overview of this technology> This technology is a technology for generating a new recipe for a dish and presenting it to a user such as a chef. Here, a new recipe means a recipe that is different from a recipe prepared on the recipe generation side. The new recipe includes a recipe that is different from a recipe prepared on the generation side in at least one of the elements that make up the recipe, such as a recipe with different ingredients or a recipe with a different cooking method. A dish reproduced based on a new recipe is a dish that is different from a dish reproduced based on a recipe prepared in advance.
[0011] The recipe is generated using chemical structure information that represents the chemical structure of ingredients used in cooking, sensor information obtained by measuring the flavor of ingredients with a sensor, and subjective flavor information that represents a person's subjective evaluation of the flavor of the ingredients. Information that represents the relationship between the chemical structure information, the sensor information, and the subjective flavor information is also used.
[0012] For example, when information on a subjective evaluation of flavor is input as a condition, sensor information corresponding to the input subjective evaluation is identified, and further, chemical structure information corresponding to the identified sensor information is identified. Based on the identified chemical structure information, ingredients are selected, and a recipe using the ingredients is generated.
[0013] A chef who receives a recipe can cook the food exactly as it is presented to them. In addition, the chef can create a new recipe by using the presented recipe as a hint. This technology can be said to be a technology that presents information that can serve as a trigger for creating a new recipe.
[0014] Recipes generated by this technology are not only used to present recipes to chefs, but also to control cooking robots, which operate autonomously based on recipe data and complete dishes by cooking them.
[0015] By controlling its operations based on new recipes, the cooking robot will be able to create new dishes.
[0016] Hereinafter, an embodiment of the present technology will be described in the following order. 1. Presenting the recipe 2. Generate recipes 3. Configuration and operation of each device 4. Example of control of cooking robot 5. Other Examples
[0017] <Recipe presentation> FIG. 1 is a diagram showing an example of a recipe presented by an information processing device according to an embodiment of the present technology.
[0018] The situation shown in the upper part of Fig. 1 is a situation in which a chef is cooking and thinking about what kind of sauce to put on a cooked dish. In the example of Fig. 1, an information processing device 1, which is a tablet terminal, is placed next to the chef. The information processing device 1 has a function of presenting a new recipe in response to a request from the chef.
[0019] In addition, food refers to the finished product that is produced through cooking. Cooking refers to the process of cooking food and the act (task) of cooking food.
[0020] For example, as shown in speech bubble #1, a chef may want a sauce that is "strongly sour and sweet, and has a light texture." In this example, a recipe is presented in response to a flavor specification such as "strongly sour and sweet, and has a light texture."
[0021] FIG. 2 is a diagram showing examples of flavor components.
[0022] The deliciousness that humans sense in their brain, or "flavor," is primarily composed of a combination of the taste perceived by our sense of taste, the aroma perceived by our sense of smell, and the texture perceived by our sense of touch, as shown in Figure 2.
[0023] FIG. 3 is a diagram showing an example of a screen used to specify a flavor.
[0024] The flavor designation screen shown in Fig. 3 is displayed when a chef performs a predetermined operation on the information processing device 1. In the example of Fig. 3, three radar charts, radar charts 11 to 13, are displayed. The radar charts 11 to 13 are a radar chart used to designate taste, a radar chart used to designate aroma, and a radar chart used to designate texture, respectively.
[0025] For example, radar chart 11 is a radar chart with nine taste elements as its axes. The taste elements are the so-called five basic tastes of saltiness, sourness, bitterness, sweetness, and umami. For example, a chef can specify the value of each element by touching the position of each element on the radar chart with his / her finger.
[0026] In the example of FIG. 3, the elements of taste, aroma, and texture are all the same, with nine types, but the number of each element may be different.
[0027] The flavor may be specified by voice instead of by using a radar chart as shown in Fig. 3. When the flavor is specified by voice, the information processing device 1 performs voice recognition, language analysis, and the like to identify the meaning of the chef's remarks.
[0028] The flavor may not be specified by specifying a value on a radar chart, but the value of each element may be directly input by operating a keyboard or the like.
[0029] Returning to the explanation of Fig. 1, when the flavor of the sauce desired by the chef is specified as described above, the information processing device 1 determines the combination of ingredients and cooking steps that will realize the flavor desired by the chef, and presents them to the chef as shown in speech bubble #2. In the example of Fig. 1, the information processing device 1 presents "Blend raspberries and seaweed in XX way."
[0030] That is, in this example, a recipe for a dish containing sauce is composed of ingredients and cooking process information. "Raspberries" and "seaweed" are the ingredients, and "blend in this way" is the cooking process information.
[0031] The chef can then follow the instructions provided by the information processing device 1 and create a new sauce based on the instructions, or can use the information as a hint to create a new sauce. The information processing device 1 can be considered a recipe generator that presents the chef with a new recipe itself or information that can serve as a hint for a new recipe.
[0032] <Recipe Creation> Information used to generate recipes FIG. 4 is a diagram showing an example of a database used to generate a recipe.
[0033] As shown in FIG. 4, the information processing device 1 has prepared therein a flavor subjective information DB 21, a sensing information DB 22, and a chemical structure information DB 23.
[0034] 4 may be provided on a server on the Internet, rather than on the information processing device 1. One or two of the three types of databases may be provided on the information processing device 1, and the other databases may be provided on a server on the Internet.
[0035] FIG. 5 is a diagram showing an example of information stored in the flavor subjective information DB 21. As shown in FIG.
[0036] The flavor subjective information DB21 is a database of subjective evaluations of the flavor of each ingredient. For example, each ingredient is eaten by many people, and information expressing the subjective evaluation value of the flavor on a predetermined scale is stored in the flavor subjective information DB21 as flavor subjective information.
[0037] For example, the subjective flavor information of ingredients A and B is expressed as a vector expression (e-dimensional) in a subjective flavor evaluation space E, as shown in the following formula (1).
number
[0038] Similarly, other ingredients are represented by vectors whose elements are the items of the subjective evaluation. For example, EAi is a coefficient corresponding to the evaluation value of the item with index i included in the subjective evaluation of ingredient A.
[0039] FIG. 6 is a diagram showing an example of information stored in the sensing information DB 22. As shown in FIG.
[0040] The sensing information DB22 is a database of the results of sensing the flavor of each ingredient. For example, the flavor of each ingredient is measured using a flavor measuring device, and the sensing information obtained as the measurement result is stored in the sensing information DB22. As flavor is expressed by taste, aroma, and texture as described above, the flavor of each ingredient is measured using a taste measuring device, an aroma measuring device, a texture measuring device, etc. The texture includes the elasticity, viscosity, temperature, etc. of the ingredient.
[0041] The sensing information of ingredients A and B is expressed as a vector expression (s dimensions) in sensing information space S, as shown in the following formula (2).
number
[0042] Similarly, other ingredients are represented by vectors whose elements are each item of the sensing information. For example, SAi is a coefficient corresponding to the sensor value of the item with index i included in the sensing information of ingredient A.
[0043] FIG. 7 is a diagram showing an example of information stored in the chemical structure information DB 23. As shown in FIG.
[0044] The chemical structure information DB 23 is a database of the chemical structure of each ingredient. For example, the chemical structure of each ingredient is measured by a separation analyzer that uses the principle of chromatography, and the chemical structure information obtained as a result of the measurement is stored in the chemical structure information DB 23.
[0045] The chemical structure information of ingredients A and B is expressed as a vector expression (c-dimensional) in chemical structure space Ch by using molecular descriptors as shown in the following formula (3).
number
[0046] Similarly, other ingredients are represented by vectors whose elements are chemical substances used to express the chemical structure. For example, NAi is a coefficient according to the amount of chemical substance with index i contained in ingredient A. There are chemical substances that exist only in ingredients A and B, but the coefficient of the chemical substances is 0.
[0047] Vectorization of chemical structures is performed in this way using molecular descriptors. Vectorization using molecular descriptors is performed, for example, by detecting the chemical substances contained in ingredients and their amounts using a separation analyzer, treating each chemical substance Ck as one element of a c-dimensional vector, and setting the amount (molar number, mass, etc.) of the chemical substance Ck contained in the ingredient as Nk. Ingredient X is expressed as in the following formula (4).
number
[0048] The above description is a fragment number descriptor, which is one of the molecular descriptors. The chemical substance Ck includes -CH3, -OH, -NH2, -COOH, -CH2-, -CH2-CH2-, etc. Other description methods, such as structural descriptors and count descriptors, may be used to represent the chemical structure of each ingredient.
[0049] In addition to chemical structures, information expressing other chemical characteristics such as properties and reactions may be prepared in the chemical structure information DB 23 .
[0050] FIG. 8 is a diagram showing the relationship between the databases.
[0051] As indicated by arrows A1 to A3, functions used to convert values (vectors) in each space into values in another space are learned by machine learning such as deep learning.
[0052] A function F1 indicated by an arrow A1 is a function used when converting values in the chemical structure space Ch into values in the sensing information space S. A function F2 indicated by an arrow A2 is a function used when converting values in the sensing information space S into values in the flavor subjective evaluation space E. A function F3 indicated by an arrow A3 is a function used when converting values in the chemical structure space Ch into values in the flavor subjective evaluation space E.
[0053] For example, the function F1 is configured by a neural network (NN) that receives the chemical structure information of each ingredient represented by the above-mentioned vector representation and outputs the sensing information of each ingredient. The function F1 is trained, for example, by using the chemical structure information of a certain ingredient as training data and the sensing information of the same ingredient as teacher data.
[0054] The inverse functions of each function are also learned through machine learning such as deep learning.
[0055] 9, a function InvF1 is used when converting values in the sensing information space S into values in the chemical structure space Ch. A function InvF2 is used when converting values in the flavor subjective evaluation space E into values in the sensing information space S. A function InvF3 is used when converting values in the flavor subjective evaluation space E into values in the chemical structure space Ch.
[0056] A new recipe is generated based on the above database information and functions that represent the relationships between the databases.
[0057] Example of recipe generation FIG. 10 is a diagram showing an example of creating a new recipe.
[0058] Here, we will explain about sake blending. Sake blending refers to the process of creating a new flavor of sake by blending multiple brands of sake.
[0059] In the example of FIG. 10, a certain brand of sake, Sake_A, and another brand of sake, Sake_B, are blended to generate a sake, Sake_NEW.
[0060] The brands of sake to be blended correspond to ingredients in cooking, and the blending amounts, temperature, etc. correspond to cooking steps in cooking. The information processing device 1 specifies which brands to blend and how to blend them, and generates a recipe that shows the details.
[0061] FIG. 11 is a diagram showing an example of a recipe presentation for sake blending.
[0062] In sake blending, chefs also request a recipe by specifying the flavor of the sake they want to create.
[0063] In the example of Fig. 11, a recipe for making sake with a "strong pungent taste and a strong refreshing aroma" is requested. The flavor "strong pungent taste and a strong refreshing aroma" is specified using a screen such as that described with reference to Fig. 3.
[0064] The information processing device 1 identifies a combination of brands to create sake with a flavor of "strong spiciness and a strong refreshing aroma" and how to blend them, and presents this to the chef.
[0065] FIG. 12 is a flowchart showing the flow of a series of processes for creating a recipe for sake blending.
[0066] When the chef specifies a flavor such as "strong spiciness and strong refreshing aroma," in step S1, the information processing device 1 identifies a subjective flavor evaluation E (New-Blending) by referring to the flavor subjective information DB 21. The subjective flavor evaluation E (New-Blending) is an evaluation value that represents the flavor specified by the chef.
[0067] FIG. 13 is a diagram showing an example of the subjective flavor evaluation E (New-Blending).
[0068] As shown in Figure 13, the subjective flavor evaluation E (New-Blending) is expressed by a vector consisting of elements such as saltiness, sourness, bitterness, sweetness, umami, spiciness, astringency, refreshing aroma, mild aroma, full-bodied aroma, and mouthfeel. The value of each element corresponds to the value specified by the chef.
[0069] Among the elements shown in Figure 13, saltiness, sourness, bitterness, sweetness, umami, spiciness, and astringency are elements related to taste. Refreshing aroma, mild aroma, and full-bodied aroma are elements related to aroma. Mouth is an element related to texture.
[0070] Using such subjective flavor evaluation E (New-Blending) as a starting point, the brands to be blended and how to blend them are specified.
[0071] 12, the information processing device 1 specifies a value of the sensing information space S corresponding to the taste subjective evaluation E(New-Blending). S(New-Blending), which is a value of the sensing information space S, is calculated by the following formula (5).
number
[0072] As described above, the function InvF2 (FIG. 9) is a function used when converting values in the flavor subjective evaluation space E into values in the sensing information space S.
[0073] In step S3, the information processing device 1 specifies a value of the chemical structure space Ch corresponding to the sensing information S(New-Blending). Ch(New-Blending), which is a value of the chemical structure space Ch, is calculated by the following formula (6).
number
[0074] As described above, the function InvF1 is a function used when converting a value in the sensing information space S into a value in the chemical structure space Ch.
[0075] This will identify the chemical structure of the sake that will achieve the flavor specified by the chef.
[0076] In step S4, the information processing device 1 selects all brand combinations whose chemical structure information is stored in the chemical structure information DB 23, and identifies the chemical structure of each combination based on the chemical structure information.
[0077] Here, the two brands are Sake_X and Sake_Y, and all combinations of the two brands are selected, and the chemical structures for each combination are identified. Instead of two brands, three or more brands may be selected.
[0078] In step S5, the information processing device 1 identifies from all combinations a combination of sake Sake_A and sake Sake_B that has a chemical structure closest to Ch (New-Blending), which is the value of the chemical structure of sake that achieves the flavor specified by the chef.
[0079] For example, a combination of sake Sake_A and sake Sake_B is specified based on the distance in the chemical structure space Ch. The combination of sake Sake_A and sake Sake_B specified here is the combination with the shortest distance to Ch(New-Blending) in the chemical structure space Ch.
[0080] In step S6, the information processing device 1 specifies the amount α of sake Sake_A and the amount β of sake Sake_B. The blend that realizes the flavor specified by the chef is expressed by the following formula (7).
number
[0081] α and β can be calculated as follows. For simplicity, let A = Ch(Sake_A), B = Ch(Sake_B), and C = Ch(New-Blending) using matrices that represent chemical structures. t = Ch(Sake_A) t , B t =Ch(Sake_B) t , C t = Ch(New-Blending) t The superscript t stands for transposition.
[0082] The above equation (7) can be expressed as the following equation (8).
number
[0083] The above equation (8) can be expressed as the following equation (9).
number
[0084] From equation (9), α can be calculated as equation (10).
number
[0085] The quantity β can be determined in a similar manner.
[0086] FIG. 14 is a diagram illustrating an example of the inverse transformation.
[0087] After the combination of sake Sake_A and sake Sake_B and the values of α and β are specified as described above, adjustments are made by inverse transformation as appropriate.
[0088] 14, the information processing device 1 identifies a value of the sensing information space S corresponding to Ch(New-Blending), which is a value of the chemical structure space Ch. S(New-Blending), which is a value of the sensing information space S, is calculated by the following formula (11).
number
[0089] Moreover, the information processing device 1 specifies a value of the flavor subjective evaluation space E corresponding to S(New-Blending), which is a value of the sensing information space S. E(New-Blending1), which is a value of the flavor subjective evaluation space E, is calculated by the following formula (12).
number
[0090] The error ΔE between E(New-Blending), the value of the subjective flavor evaluation specified by the chef, and E(New-Blending1), the value of the subjective flavor evaluation obtained by inverse transformation, is expressed by the following equation (13).
number
[0091] For example, if the error ΔE is smaller than the threshold, the selection of the brand combination and the blend amounts α and β are completed.
[0092] On the other hand, if the error ΔE is greater than the threshold, the combination of stocks and the amounts α and β are adjusted.
[0093] In step S7 of FIG. 12, the information processing device 1 presents to the chef, as a new recipe, information including the use of Sake_A and Sake_B and blending Sake_A in an amount α and Sake_B in an amount β.
[0094] Recipes for other dishes, rather than just those related to sake blending, can also be generated using a similar process and presented to the chef.
[0095] In this way, the information processing device 1 presents a recipe not by selecting a recipe that meets the conditions from a number of pre-prepared recipes, but by generating a recipe each time according to the flavor specified by the chef.
[0096] Through the above processing, it is possible to generate and present a recipe for a dish that matches the flavor specified by a chef, based on the relationship between the subjective flavor information, sensing information, and chemical structure information.
[0097] Instead of information on an ingredient (brand) basis, subjective flavor information, sensing information, and chemical structure information of sake made by actually blending each brand may be measured, and the relationships between them may be learned.
[0098] At this time, by changing the amounts α and β during learning, it becomes possible to easily identify the amounts α and β that correspond to the flavor specified by the chef. For example, learning is performed by changing β / α, which is the ratio of the amount β to the amount α, with the amount α as the standard.
[0099] In selecting a combination of ingredients, restrictions may be imposed such as selecting a combination of ingredients that has a chemical structure that constitutes a dominant aroma. In the above example, a brand of sake that has a similar chemical structure to the chemical structure that characterizes the taste, aroma, and texture of Sake_A is selected as Sake_B, and a combination of Sake_A and Sake_B is selected. Recommendations based on such dominant aromas may be made by an AI system.
[0100] Other examples of recipe generation In step S5 of FIG. 12, the combination of sake Sake_A and sake Sake_B is selected by selecting the combination having the chemical structure closest to Ch (New-Blending), but it may also be selected by the following method.
[0101] First, one brand of sake with the chemical structure closest to Ch (New-Blending) is selected. The selected brand is called Sake_A.
[0102] Next, the quantities α and β are calculated as described above when each of the other brands is selected as Sake_B. The values of the chemical structure space Ch when Sake_A and Sake_B are blended are expressed as formula (7) above.
[0103] In the chemical structure space Ch, the combination of sake Sake_A and sake Sake_B that gives the closest value to Ch(New-Blending) is selected from all combinations.
[0104] That is, in this example, sake Sake_A corresponding to one ingredient is used as a reference, and sake Sake_B to be paired with sake Sake_A is selected.
[0105] Instead of selecting the brand of sake having the closest chemical structure to Ch(New-Blending) as Sake_A, the brand of sake whose chemical structure is represented by a vector parallel to Ch(New-Blending) in the chemical structure space Ch may be selected as Sake_A.
[0106] For example, the inner product of a vector representing Ch (New-Blending) and a vector representing the chemical structure of sake Sake_A is divided by the norms ||Ch|| and ||A||, and the sake Sake_A corresponding to the largest ||A|| is selected.
[0107] This can result in recipes that use unexpected ingredients while still achieving the flavor specified by the chef.
[0108] <Configuration and operation of each device> Configuration of information processing device 1 FIG. 15 is a block diagram showing an example of the hardware configuration of the information processing device 1. As shown in FIG.
[0109] 15, the information processing device 1 is configured with a computer such as a tablet terminal, etc. A CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, and a RAM (Random Access Memory) 103 are connected to each other by a bus 104.
[0110] An input / output interface 105 is further connected to the bus 104. An input unit 106 including a keyboard, a mouse, etc., and an output unit 107 including a display, a speaker, etc. are connected to the input / output interface 105.
[0111] Furthermore, to the input / output interface 105, a storage unit 108 formed of a hard disk or non-volatile memory, a communication unit 109 formed of a network interface, and a drive 110 for driving a removable medium 111 are connected.
[0112] The CPU 101 loads a program stored in the storage unit 108 into the RAM 103 via the input / output interface 105 and the bus 104 and executes the program, thereby performing various processes such as generating recipes.
[0113] FIG. 16 is a block diagram showing an example of a functional configuration of the information processing device 1.
[0114] At least some of the functional units shown in Fig. 16 are realized by executing a predetermined program by the CPU 101 in Fig. 15. Among the components shown in Fig. 16, the same components as those described above are denoted by the same reference numerals.
[0115] 16, an information processing unit 151 is realized in the information processing device 1. The information processing unit 151 includes a recipe generating unit 161 and a presenting unit 162. The information processing unit 151 is provided with a flavor subjective information DB 21, a sensing information DB 22, and a chemical structure information DB 23.
[0116] When a flavor is specified by a chef, the recipe generating unit 161 generates a recipe as described above based on the information stored in the flavor subjective information DB 21, the sensing information DB 22, and the chemical structure information DB 23 and the information representing the relationship between each piece of information. The information representing the recipe generated by the recipe generating unit 161 is supplied to the presentation unit 162.
[0117] The chef may specify conditions such as not only the flavor but also the name of the dish, the genre of the dish, the style of cooking such as Japanese or American, the ingredients to be used, etc. In this case, a recipe that meets the conditions specified by the chef is generated.
[0118] For example, when an ingredient to be used is specified as a condition, the ingredient specified by the chef is used as a standard, and other ingredients to be used in combination with the ingredient are selected as described above, and a recipe is generated.
[0119] The recipes generated by the recipe generating unit 161 may be linked to the subjective flavor information, sensing information, and chemical structure information of the ingredients used in the recipes. When the recipes are presented, the subjective flavor information, sensing information, and chemical structure information of the ingredients are also presented, allowing the chef to create the recipes by referring to the information.
[0120] The presentation unit 162 presents the recipe generated by the recipe generation unit 161 to the chef. The recipe may be presented by voice from a speaker or by display on the display screen. For example, the presentation unit 162 presents an explanation of each cooking step of the recipe to the chef in order.
[0121] The information processing unit 151 having such a configuration performs the series of processes described with reference to Fig. 12. The processes of steps S1 to S6 in Fig. 12 are performed by the recipe generating unit 161, and the process of step S7 is performed by the presenting unit 162.
[0122] FIG. 17 is a diagram illustrating an example of the configuration of a network system.
[0123] 17 shows a configuration in which a new recipe is generated in a recipe generation server 171 on the Internet. The recipe generation server 171 is provided with the same configuration as the information processing unit 151 shown in FIG.
[0124] Communication is performed via the Internet between the recipe generation server 171 and the information processing device 1 provided on the chef's side. Information indicating the flavor and the like specified by the chef is transmitted from the information processing device 1 to the recipe generation server 171.
[0125] The recipe generation unit 161 of the recipe generation server 171 receives the flavor information designated by the chef and transmitted from the information processing device 1, and generates a recipe.
[0126] The presentation unit 162 transmits information about the recipe generated by the recipe generation unit 161 to the information processing device 1, and causes it to be presented to the chef.
[0127] In this way, it is possible for a new recipe to be generated in the recipe generation server 171 on the Internet.
[0128] <Example of controlling a cooking robot> Control system configuration Although the above describes the generation of recipes intended for human chefs, recipes may be generated for cooking robots. In this case, cooking is performed by the cooking robot according to the newly generated recipe.
[0129] FIG. 18 is a diagram illustrating an example of the configuration of a control system.
[0130] As shown in Fig. 18, the control system is composed of a data processing device 301 and a cooking robot 302. The cooking robot 302 is a robot equipped with a driving system such as a cooking arm, various sensors, and a function for cooking. The cooking robot 302 is installed, for example, in a home.
[0131] The data processing device 301 is a device that controls the cooking robot 302. The data processing device 301 is configured with a computer or the like.
[0132] 18, the cooking robot 302 is controlled by the data processing device 301 based on recipe data prepared for each dish. The recipe data includes information about each cooking step.
[0133] The data processing device 301 controls the cooking robot 302 based on the recipe data to make the cooking robot 302 cook the food. Recipe data generated by the information processing unit 151 in FIG. 16 is supplied to the data processing device 301 and used to control the cooking robot 302.
[0134] For example, when recipe data is input as indicated by an arrow A1, the data processing device 301 controls the cooking operation of the cooking robot 302 by outputting an instruction command based on the description of the recipe data as indicated by an arrow A2.
[0135] The cooking robot 302 drives each part, such as the cooking arm, according to the command supplied from the data processing device 301 to perform cooking operations for each cooking step. The command includes information for controlling the torque, driving direction, and driving amount of the motor provided in the cooking arm.
[0136] Until the food is cooked, the data processing device 301 sequentially outputs commands to the cooking robot 302. The cooking robot 302 performs actions according to the commands, and the food is finally cooked.
[0137] FIG. 19 is a diagram showing an example of the description contents of recipe data.
[0138] As shown in Fig. 19, one recipe data is composed of multiple cooking step data sets. In the example of Fig. 19, a cooking step data set for cooking step #1, a cooking step data set for cooking step #2, ..., a cooking step data set for cooking step #N are included.
[0139] Each cooking step data set includes cooking action information, which is information about cooking actions for implementing a cooking step. For example, one cooking step data set is composed of time-series data of cooking action information for implementing one cooking step.
[0140] The cooking operation information includes ingredient information and operation information.
[0141] The ingredient information is information about ingredients used in the cooking process, including information about the type, amount, and size of the ingredient.
[0142] Ingredients include not only ingredients that have not been cooked at all, but also cooked (prepared) ingredients obtained by a certain cooking process. The ingredient information included in the cooking operation information of a certain cooking process includes information on ingredients that have been through a previous cooking process.
[0143] The operation information is information about the movement of the cooking arm and the like in the cooking process. The information about the movement includes information about the type of cooking tool used in cooking.
[0144] For example, the action information for a cooking process of cutting an ingredient includes information indicating the use of a knife as a cooking tool, the cutting position, the number of cuts, the strength of the cut, the angle, the speed, and the like.
[0145] In addition, the action information for the cooking process of stirring a pot containing liquid as an ingredient includes information indicating the use of a ladle as a cooking tool, and information indicating the strength, angle, speed, time, etc. of stirring.
[0146] Operation information for a cooking process of baking certain ingredients using an oven includes information indicating that the oven is used as a cooking tool, the heat of the oven, baking time, and the like.
[0147] The operation information for the cooking process of plating includes information on plating, such as the tableware to be used, the arrangement of the ingredients, and the color of the ingredients.
[0148] FIG. 20 is a diagram showing an example of a flow of recreating a dish based on recipe data.
[0149] 20, the cooking robot 302 recreates a dish by repeating cooking for each cooking step based on cooking action information for each time included in the cooking step data set described in the recipe data. A dish is completed through multiple cooking steps, cooking steps #1 to #N.
[0150] FIG. 21 is a diagram showing an example of the arrangement of the data processing device 301. As shown in FIG.
[0151] As shown in A of Fig. 21, the data processing device 301 is provided as, for example, an external device of the cooking robot 302. In the example of A of Fig. 21, the data processing device 301 and the cooking robot 302 are connected via a network such as the Internet.
[0152] The command transmitted from the data processing device 301 is received by the cooking robot 302 via the network. Various data, such as images captured by a camera of the cooking robot 302 and sensor data measured by a sensor provided in the cooking robot 302, are transmitted from the cooking robot 302 to the data processing device 301 via the network.
[0153] 21B, the data processing device 301 may be provided inside the housing of the cooking robot 302. In this case, the operation of each part of the cooking robot 302 is controlled according to the instruction commands generated by the data processing device 301.
[0154] The following description will be mainly based on the assumption that the data processing device 301 is provided as an external device to the cooking robot 302.
[0155] -External appearance of cooking robot FIG. 22 is a perspective view showing the appearance of the cooking robot 302.
[0156] 22, the cooking robot 302 is a kitchen-type robot having a horizontally elongated rectangular parallelepiped housing 311. Inside the housing 311, which is the main body of the cooking robot 302, various components are provided.
[0157] A cooking assistance system 312 is provided on the rear side of the housing 311. Each space formed in the cooking assistance system 312 by dividing it with thin plate-like members has a function to assist cooking by the cooking arms 321-1 to 321-4, such as a refrigerator, an oven range, and storage.
[0158] A rail is provided in the longitudinal direction of the top plate 311A, and cooking arms 321-1 to 321-4 are provided on the rail. The cooking arms 321-1 to 321-4 are capable of changing their positions along the rail, which serves as a moving mechanism.
[0159] The cooking arms 321-1 to 321-4 are robot arms formed by connecting cylindrical members at joints. Various tasks related to cooking are performed by the cooking arms 321-1 to 321-4.
[0160] The space above the top plate 311A is a cooking space where cooking is performed by the cooking arms 321-1 to 321-4.
[0161] 22 shows four cooking arms, the number of cooking arms is not limited to four. Hereinafter, when there is no need to distinguish between the cooking arms 321-1 to 321-4, they will be collectively referred to as cooking arm 321.
[0162] FIG. 23 is an enlarged view of the cooking arm 321.
[0163] 23, attachments with various cooking functions are attached to the tip of the cooking arm 321. As attachments for the cooking arm 321, various attachments are prepared, such as an attachment with a manipulator function (hand function) for grasping ingredients or tableware, and an attachment with a knife function for cutting ingredients.
[0164] 23, knife attachment 331-1, which is an attachment having a knife function, is attached to cooking arm 321-1. A chunk of meat placed on top plate 311A is cut using knife attachment 331-1.
[0165] A spindle attachment 331-2, which is an attachment used to fix and rotate ingredients, is attached to the cooking arm 321-2.
[0166] A peeler attachment 331-3 that functions as a peeler for peeling food ingredients is attached to the cooking arm 321-3.
[0167] The skin of the potato, which is lifted by the cooking arm 321-2 using the spindle attachment 331-2, is peeled by the cooking arm 321-3 using the peeler attachment 331-3. In this way, it is possible for multiple cooking arms 321 to work together to perform one task.
[0168] A manipulator attachment 331-4 having a manipulator function is attached to the cooking arm 321-4. Using the manipulator attachment 331-4, the frying pan with the chicken on it is carried to the space of the cooking assistance system 312 having an oven function.
[0169] Cooking using such cooking arms 321 can be performed by changing the attachments as appropriate depending on the type of work. It is also possible to attach the same attachment to multiple cooking arms 321, such as attaching the manipulator attachment 331-4 to each of the four cooking arms 321.
[0170] Cooking by the cooking robot 302 is performed not only using the above-mentioned attachments prepared as tools for the cooking arm, but also using the same tools as those used by humans when cooking. For example, a knife used by a human can be grasped by the manipulator attachment 331-4, and cooking such as cutting ingredients can be performed using the knife.
[0171] Cooking arm configuration FIG. 24 is a diagram showing the appearance of the cooking arm 321.
[0172] 24, the cooking arm 321 is generally formed by connecting thin cylindrical members with hinges that serve as joints. Each hinge is provided with a motor or the like that generates a force to drive each member.
[0173] The cylindrical member includes, in order from the tip, a detachable member 351, a relay member 353, and a base member 355.
[0174] The detachable member 351 and the relay member 353 are connected by a hinge portion 352 , and the relay member 353 and the base member 355 are connected by a hinge portion 354 .
[0175] A detachable portion 351A to which an attachment is attached and detached is provided at the tip of the detachable member 351. The detachable member 351 has the detachable portion 351A to which various attachments are attached and detached, and functions as a cooking function arm portion that performs cooking by operating the attachment.
[0176] A detachable part 356 that is attached to a rail is provided at the rear end of the base member 355. The base member 355 functions as a moving function arm part that realizes the movement of the cooking arm 321.
[0177] FIG. 25 is a diagram showing an example of the range of motion of each part of the cooking arm 321.
[0178] As shown by the ellipse #1, the detachable member 351 can rotate about the central axis of the circular cross section. The small flat circle shown in the center of the ellipse #1 indicates the direction of the axis of rotation of the dashed line.
[0179] As shown by the circle #2, the detachable member 351 is rotatable about an axis passing through a fitting portion 351B with the hinge portion 352. The relay member 353 is rotatable about an axis passing through a fitting portion 353A with the hinge portion 352.
[0180] The two small circles shown inside circle #2 indicate the directions of the respective rotation axes (perpendicular to the paper surface). The movable range of detachable member 351 about the axis passing through fitting portion 351B and the movable range of relay member 353 about the axis passing through fitting portion 353A are each, for example, a range of 90 degrees.
[0181] The relay member 353 is composed of a leading end member 353-1 and a trailing end member 353-2, which are separated from each other. As shown by the ellipse #3, the relay member 353 is rotatable about the central axis of the circular cross section at the connecting portion 353B between the members 353-1 and 353-2. The other movable parts basically have the same range of motion.
[0182] In this manner, the detachable member 351 having the detachable part 351A at its tip, the relay member 353 connecting the detachable member 351 and the base member 355, and the base member 355 having the detachable part 356 connected at its rear end are rotatably connected by hinges. The movement of each movable part is controlled by a controller in the cooking robot 302 according to an instruction command.
[0183] FIG. 26 is a diagram showing an example of the connection between the cooking arm and the controller.
[0184] As shown in Fig. 26, the cooking arm 321 and the controller 361 are connected via wires in a space 311B formed inside the housing 311. In the example of Fig. 26, the cooking arms 321-1 to 321-4 and the controller 361 are connected via wires 362-1 to 362-4, respectively. The flexible wires 362-1 to 362-4 bend appropriately depending on the positions of the cooking arms 321-1 to 321-4.
[0185] Configuration of Cooking Robot 302 FIG. 27 is a block diagram showing an example of the configuration of the cooking robot 302.
[0186] The cooking robot 302 is configured by connecting each unit to a controller 361 (FIG. 26) that serves as a control device for controlling the operation of the cooking robot 302. Among the components shown in FIG. 27, the same components as those described above are denoted by the same reference numerals. Duplicate descriptions will be omitted as appropriate.
[0187] In addition to the cooking arm 321, a camera 401, a sensor 402, and a communication unit 403 are connected to the controller 361.
[0188] The controller 361 is configured by a computer having a CPU, a ROM, a RAM, a flash memory, etc. The controller 361 executes a predetermined program by the CPU and controls the overall operation of the cooking robot 302. The controller 361 may configure the data processing device 301.
[0189] For example, the controller 361 controls the communication unit 403 to transmit an image captured by the camera 401 and sensor data measured by the sensor 402 to the data processing device 301 .
[0190] In the controller 361, a command acquisition unit 411 and an arm control unit 412 are realized by executing a predetermined program.
[0191] The command acquisition unit 411 acquires a command transmitted from the data processing device 301 and received by the communication unit 403. The command acquired by the command acquisition unit 411 is supplied to an arm control unit 412.
[0192] The arm control unit 412 controls the operation of the cooking arm 321 according to the command acquired by the command acquisition unit 411 .
[0193] The camera 401 captures the surroundings of the cooking robot 302 and outputs the captured images to the controller 361. The camera 401 is provided at various positions, such as in front of the cooking assistance system 312 and at the tip of the cooking arm 321.
[0194] The sensor 402 is composed of various sensors such as a temperature and humidity sensor, a pressure sensor, a light sensor, a distance sensor, a human sensor, a positioning sensor, a vibration sensor, etc. Measurement by the sensor 402 is performed at a predetermined cycle. Sensor data indicating the measurement results by the sensor 402 is supplied to the controller 361.
[0195] The camera 401 and the sensor 402 may be provided at a position away from the housing 311 of the cooking robot 302.
[0196] The communication unit 403 is a wireless communication module such as a wireless LAN module, a mobile communication module compatible with LTE (Long Term Evolution), etc. The communication unit 403 communicates with the data processing device 301 and external devices such as a server on the Internet.
[0197] As shown in FIG. 27, the cooking arm 321 is provided with a motor 421 and a sensor 422.
[0198] The motor 421 is provided at each joint of the cooking arm 321. The motor 421 rotates around its axis under the control of the arm control unit 412. An encoder that measures the amount of rotation of the motor 421, a driver that adaptively controls the rotation of the motor 421 based on the measurement result by the encoder, and the like are also provided at each joint.
[0199] The sensor 422 is composed of, for example, a gyro sensor, an acceleration sensor, a touch sensor, etc. The sensor 422 measures the angular velocity, acceleration, etc. of each joint during the operation of the cooking arm 321, and outputs information indicating the measurement results to the controller 361. Sensor data indicating the measurement results of the sensor 422 are also transmitted from the cooking robot 302 to the data processing device 301 as appropriate.
[0200] Configuration of data processing device 301 FIG. 28 is a block diagram showing an example of the functional configuration of the data processing device 301.
[0201] At least some of the functional units shown in FIG. 28 are realized by the CPU of the computer constituting the data processing device 301 executing a predetermined program.
[0202] 28, a command generation unit 431 is realized in the data processing device 301. The command generation unit 431 is composed of a recipe data acquisition unit 451, a robot state estimation unit 452, a control unit 453, and a command output unit 454.
[0203] The recipe data acquisition unit 451 acquires recipe data newly generated in the information processing device 1 or the like, and outputs it to the control unit 453. The information processing unit 151 (FIG. 16) having a recipe generating function may be provided in the recipe data acquisition unit 451.
[0204] The robot state estimation unit 452 receives images and sensor data transmitted from the cooking robot 302. The cooking robot 302 transmits images taken by its own camera and sensor data measured by sensors provided at predetermined positions of the cooking robot 302 at a predetermined cycle. The images taken by the cooking robot 302's camera show the surroundings of the cooking robot 302.
[0205] The robot state estimation unit 452 estimates the state of the surroundings of the cooking robot 302, such as the state of the cooking arm 321 and the state of ingredients, and the state of the cooking process by analyzing the images and sensor data transmitted from the cooking robot 302. Information indicating the state of the surroundings of the cooking robot 302 estimated by the robot state estimation unit 452 is supplied to the control unit 453.
[0206] The control unit 453 generates an instruction command for controlling the cooking robot 302 based on the cooking process data set described in the recipe data supplied from the recipe data acquisition unit 451. For example, an instruction command for causing the cooking arm 321 to perform an operation represented by the cooking operation information included in the cooking process data set is generated.
[0207] The command is generated based on the surrounding state of the cooking robot 302 estimated by the robot state estimation unit 452. The command generated by the control unit 453 is supplied to the command output unit 454.
[0208] The command output unit 454 transmits the instruction command generated by the control unit 453 to the cooking robot 302.
[0209] Operation of the data processing device 301 The processing of the data processing device 301 that controls the operation of the cooking robot 302 will be described with reference to the flowchart in FIG.
[0210] In step S101, the recipe data acquisition unit 451 acquires recipe data representing a recipe generated by the information processing device 1 or the like.
[0211] In step S102, the control unit 453 selects a cooking operation based on the cooking process data set described in the recipe data, and generates an instruction command for performing the selected cooking operation. For example, the cooking process data set is selected in the order of cooking operations, and the cooking operations included in the selected cooking operations are selected in the order of execution.
[0212] In step S103, the command output unit 454 transmits an instruction command to the cooking robot 302 to cause it to perform a cooking operation.
[0213] In step S104, the robot state estimation unit 452 estimates the state of the cooking robot 302.
[0214] In step S105, the control unit 453 determines whether or not all cooking operations have been completed. If it is determined in step S105 that all cooking operations have not been completed, the process returns to step S102, the next cooking operation is selected, and the above processing is repeated.
[0215] If it is determined in step S105 that all cooking operations have been completed, the process ends. At this time, the dish is completed based on new recipe data generated by the information processing device 1 or the like.
[0216] In this way, it is possible for the information processing device 1 to generate recipe data for controlling a robot that uses a cooking arm to cook.
[0217] When a recipe for blending an amount of sake Sake_A of α and an amount of sake Sake_B of β is generated as described above, for example, an instruction command for performing the following cooking operations is output to the cooking robot 302. Each operation is performed by the cooking arm 321.
[0218] 1. Prepare sake Sake_A. 2. Prepare sake Sake_B. 3. Prepare a cup. 4. Pour α amount of sake Sake_A into a glass. 5. Pour β of sake Sake_B into a glass. 6. Shake the glass while holding it up to mix Sake_A and Sake_B. 7. Present the cup to the user of the cooking robot 302.
[0219] By carrying out this series of operations, a new sake with the flavor specified by the chef is provided to the user of the cooking robot 302.
[0220] FIG. 30 is a diagram illustrating another example of the configuration of the control system.
[0221] 30, an electronic cooking appliance 303 such as a microwave oven is provided instead of a cooking robot 302. The electronic cooking appliance 303 performs cooking operations according to commands supplied from a data processing device 301 to cook food.
[0222] In this way, recipe data can be used to control various appliances that automatically perform cooking operations.
[0223] <Other examples> Computer configuration example The above-mentioned series of processes can be executed by hardware or software. When the series of processes is executed by software, the program constituting the software is installed in a computer incorporated in dedicated hardware or a general-purpose personal computer.
[0224] The program to be installed is provided by being recorded on removable medium 111 shown in FIG. 15, which is made up of an optical disk (CD-ROM (Compact Disc-Read Only Memory), DVD (Digital Versatile Disc), etc.) or a semiconductor memory. Alternatively, the program may be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital broadcasting. The program can be installed in advance in ROM 102 or storage unit 108.
[0225] The program executed by the computer may be a program in which processing is performed chronologically in the order described in this specification, or it may be a program in which processing is performed in parallel or at the required timing, such as when called.
[0226] In this specification, a system refers to a collection of multiple components (devices, modules (parts), etc.), regardless of whether all the components are in the same housing. Therefore, multiple devices housed in separate housings and connected via a network, and a single device in which multiple modules are housed in a single housing, are both systems.
[0227] The effects described herein are merely examples and are not limiting, and other effects may also be present.
[0228] The embodiments of the present technology are not limited to the above-described embodiments, and various modifications are possible without departing from the gist of the present technology.
[0229] For example, the present technology can be configured as cloud computing, in which a single function is shared and processed collaboratively by multiple devices via a network.
[0230] Furthermore, each step described in the above flow chart can be executed by one device, or can be shared and executed by a plurality of devices.
[0231] Furthermore, when a single step includes multiple processes, the multiple processes included in the single step can be executed by a single device, or can be shared and executed by multiple devices. [Explanation of symbols]
[0232] 1 Information processing device, 21 Flavor subjective information DB, 22 Sensing information DB, 23 Chemical structure information DB, 151 Information processing unit, 161 Recipe generation unit, 162 Presentation unit, 171 Recipe generation server, 301 Data processing device, 302 Cooking robot
Claims
1. a recipe generation unit that generates a new recipe based on chemical structure information that represents the chemical structure of ingredients used in cooking by a vector having a plurality of items as elements, sensor information that represents the flavor of the ingredients obtained by measurement using a sensor by a vector having a plurality of items as elements, and subjective flavor information that represents a person's subjective evaluation of the flavor of the ingredients by a vector having a plurality of items as elements, The recipe generation unit performs a vector operation to multiply the vectors constituting the chemical structure information of each of the ingredients to be combined by a coefficient corresponding to the amount of each combination, thereby selecting a combination of ingredients, and generates the new recipe using ingredients included in the selected combination of ingredients. Information processing device.
2. The recipe generation unit generates the new recipe based on conversion information that represents a relationship between the chemical structure information, the sensor information, and the flavor subjective information related to the same food material. The information processing device according to claim 1 .
3. The recipe generation unit generates the new recipe to which the chemical structure information, the sensor information, and the subjective flavor information related to ingredients used in cooking according to the new recipe are linked. The information processing device according to claim 1 .
4. The cooking robot further includes a command generating unit that generates, based on recipe data representing the new recipe generated by the recipe generating unit, an instruction command for causing the cooking robot to perform a cooking operation corresponding to each step described in the new recipe. The information processing device according to claim 1 .
5. The chemical structure information is information obtained by measuring the chemical structure of the food material using an analyzer. The information processing device according to claim 1 .
6. The sensor information is information obtained by measuring the flavor of ingredients using a flavor measuring device. The information processing device according to claim 1 .
7. The flavor subjective information is information that represents a subjective evaluation value of the flavor of a food ingredient by a person who has eaten the ingredient. The information processing device according to claim 1 .
8. an information processing device that generates a new recipe based on chemical structure information that represents the chemical structure of ingredients used in cooking using a vector having a plurality of items as elements, sensor information that represents the flavor of the ingredients obtained by measurement using a sensor using a vector having a plurality of items as elements, and subjective flavor information that represents a person's subjective evaluation of the flavor of the ingredients using a vector having a plurality of items as elements; Selecting a combination of ingredients by performing a vector operation in which a coefficient corresponding to the amount of each combination is multiplied by the vector constituting the chemical structure information of each ingredient to be combined; generating said new recipe using ingredients included in the selected combination of ingredients; An information processing method comprising:
9. An information processing unit that generates a new recipe based on chemical structure information that represents the chemical structure of ingredients used in cooking using a vector whose elements are multiple items, sensor information that represents the flavor of the ingredients obtained by measurement using a sensor using a vector whose elements are multiple items, and subjective flavor information that represents a person's subjective evaluation of the flavor of the ingredients using a vector whose elements are multiple items; a cooking robot that cooks based on recipe data representing the new recipe; Equipped with The information processing unit performs a vector operation to multiply the vectors constituting the chemical structure information of each of the ingredients to be combined by a coefficient corresponding to the amount of each combination, thereby selecting a combination of ingredients, and generating the new recipe using ingredients included in the selected combination of ingredients. Cooking system.
10. The information processing unit generates the new recipe based on conversion information that represents a relationship between the chemical structure information, the sensor information, and the flavor subjective information regarding the same food material. The cooking system of claim 9.
11. The information processing unit generates the new recipe in which the chemical structure information, the sensor information, and the flavor subjective information regarding ingredients used in cooking according to the new recipe are linked. The cooking system of claim 9.
12. The cooking robot includes a command generation unit that generates instruction commands for causing the cooking robot to execute cooking operations corresponding to each step described in the new recipe based on recipe data representing the new recipe generated by the information processing unit. The cooking system of claim 9.
13. An information processing unit that generates a new recipe based on chemical structure information that represents the chemical structure of ingredients used in cooking using a vector whose elements are a plurality of items, sensor information that represents the flavor of the ingredients obtained by measurement using a sensor using a vector whose elements are a plurality of items, and subjective flavor information that represents a human subjective evaluation of the flavor of the ingredients using a vector whose elements are a plurality of items; Cooking robot and A cooking system comprising: Selecting a combination of ingredients by performing a vector operation in which a coefficient corresponding to the amount of each combination is multiplied by the vector constituting the chemical structure information of each ingredient to be combined; generating said new recipe using ingredients included in the selected combination of ingredients; performing cooking based on recipe data representing the new recipe; Cooking methods including.
Citation Information
Patent Citations
Method and system for food preparation in a robotic cooking kitchen
JP2017506169A
Robot Manipulation Method and System for Executing Domain Specific Applications in Instrumented Environments Using Electronic Small Manipulation Libraries
JP2017536247A
Food cooking device
JP2019120485A
Analytics-based design and planning of creative menus
US20150161912A1
Techniques for modifying recipes to reduce preparation times and / or incorporate preferred ingredients
US20160179935A1
