Information processing method, information processing apparatus, and program product

Abstract

A first type of module defined by a function unit that can be executed by a device and a second type of module defined by an operation unit that should be executed by a person are defined. A reception unit (420) receives information relating to a first type of module executed by a device. An estimation unit (424) estimates a module sequence in which the modules of the first type and the modules of the second type are arranged in an operation order on the basis of the received information relating to the modules of the first type. The correction unit (426) corrects the module sequence when receiving an instruction to correct the estimated module sequence.

Description

Technical Field

[0001] The present disclosure relates to information processing technology, and more particularly to an information processing method, an information processing apparatus, and a program product for determining functions / actions of a device. Background Art

[0002] Efficiently utilize the operation history of a device to provide appropriate services such as automatic control and information provision to a user. For example, when a service providing apparatus receives the operation history of a device, it controls the device so that the device operates according to the operation history (for example, refer to Patent Document 1).

[0003] [Prior Art Documents]

[0004] [Patent Documents]

[0005] Patent Document 1: Japanese Patent Application Laid-Open No. 2004-185612 Summary of the Invention

[0006] [Problems to be Solved by the Invention]

[0007] A cooking recipe includes not only actions of a device but also human intervention. Therefore, control content including human intervention such as a cooking recipe cannot be created only from the operation history of the device. On the other hand, it is desired to simply create control content including human intervention.

[0008] The present disclosure has been made in view of such circumstances, and an object thereof is to provide a technique for simply creating control content including human intervention.

[0009] [Technical Solution for Solving the Technical Problem]

[0010] To solve the above problems, an information processing method according to one aspect of the present disclosure is an information processing method that defines a first type of module defined in units of functions executable by a device and a second type of module defined in units of actions to be performed by a human, and includes: a step of receiving information related to the first type of module executed by the device; a step of inferring a module sequence in which the first type of module and the second type of module are arranged in an action order based on the received information related to the first type of module; and a step of correcting the module sequence when an instruction to correct the inferred module sequence is received.

[0011] Another aspect of the present disclosure is an information processing apparatus. The apparatus is an information processing apparatus that defines a first type of module defined in units of functions executable by a device and a second type of module defined in units of actions to be performed by a person, and includes: a reception unit that receives information related to the first type of module executed by the device; a speculation unit that speculates a module sequence in which the first type of module and the second type of module are arranged in an action order based on the received information related to the first type of module; and a correction unit that corrects the module sequence when an instruction to correct the speculated module sequence is received.

[0012] In addition, any combination of the above components, and a manner of converting the expressions of the present disclosure among a method, an apparatus, a system, a recording medium, a computer program, etc., are also effective as aspects of the present disclosure.

[0013] [Advantages of the Invention]

[0014] According to the present disclosure, it is possible to simply create control content including human intervention. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 is a diagram showing the configuration of a device control system according to an embodiment.

[0016] Figure 2 (a)-(e) of Figure 1 is a diagram showing the configuration of a functional module used in the device control system of

[0017] Figure 3 (a)-(c) of Figure 1 is a diagram showing the configuration of a functional module sequence used in the device control system of

[0018] Figure 4 is a diagram showing Figure 1 the outline of the operation of the device of

[0019] Figure 5 is a diagram showing Figure 1 the configuration of the device control system of

[0020] Figure 6 is a diagram showing Figure 5 the configuration of the device of

[0021] Figure 7 is a diagram showing Figure 5 the configuration of the user device of

[0022] Figure 8 is a diagram showing Figure 5 the configuration of the information processing apparatus of

[0023] Figure 9Figures (a)-(d) are diagrams showing the cooking process when cooking 4 dishes in parallel.

[0024] Figure 10 represents Figure 5 a diagram of the data structure of the execution history DB.

[0025] Figure 11 represents Figure 7 a diagram of the execution history displayed on the display unit.

[0026] Figure 12 represents Figure 8 a diagram of the processing outline of the selection unit.

[0027] Figure 13 represents Figure 5 a diagram of the data structure of the sample DB.

[0028] Figure 14 represents Figure 5 a diagram of the data structure of the database stored in the storage unit.

[0029] Figure 15 represents Figure 8 a diagram of the processing outline of the estimation unit.

[0030] Figure 16 represents Figure 8 a diagram of the processing outline of the correction unit.

[0031] Figure 17 represents Figure 8 a diagram of another processing outline of the correction unit.

[0032] Figure 18 represents Figure 5 a flowchart of the storage step of the execution history of the equipment control system.

[0033] Figure 19 represents Figure 5 a flowchart of the production step of the module sequence of the equipment control system. Detailed implementation

[0034] The embodiments described below all represent a preferred specific example of the present disclosure. Therefore, the numerical values, shapes, materials, constituent elements, arrangement positions and connection manners of the constituent elements, as well as the steps (processes) and the order of the steps shown in the following embodiments are only examples and do not limit the gist of the present disclosure. Therefore, the constituent elements in the following embodiments that are not described in the independent claims representing the uppermost concept of the present disclosure are described as arbitrary constituent elements. In addition, in each drawing, the same reference numerals are assigned to substantially the same constituent elements, and repeated descriptions are omitted or simplified. Hereinafter, the embodiments will be described in the following order: (1) Outline of the functional modules and the functional module sequence, (2) Configuration of the device control system, (3) Storage of the execution history, (4) Creation of the functional module sequence.

[0035] (1) Outline of the functional modules and the functional module sequence

[0036] In household electrical appliances such as rice cookers, washing machines, and microwave ovens (hereinafter referred to as "devices"), the functions / actions of the hardware are controlled by software for realizing specific functions. In the present embodiment, a device control system is introduced as a mechanism capable of producing or updating the software for controlling the device.

[0037] Figure 1 The configuration of the device control system 1000 is shown. In the device control system 1000, a four-layer model composed of the first layer to the fourth layer is defined. The configuration of the device 100 is specified in the first layer. The device 100 is, for example, a rice cooker (device 100a), a washing machine (device 100b), or a microwave oven (device 100c). The device 100 is not limited to these. Each device 100 includes a plurality of components 102, a plurality of drivers 104, and a plurality of functional modules 110.

[0038] The component 102 refers to a hardware element that constitutes a unit for dividing the actions (actuation / sensing) of the device 100, and includes an actuator and a sensor that execute the functions of the device 100. The actuator is an output device, and the sensor is an input device. The actuator is, for example, the bottom external IH (Induction Heating) coil (component 102a), the main body IH coil (component 102b), the stepping motor (component 102c), the water container IH coil (component 102d), the cooling fan (component 102e), and the piezoelectric buzzer (component 102f) of the rice cooker (device 100a). The sensor is, for example, the temperature sensor (component 102g) of the rice cooker (device 100a). The components 102 included in the rice cooker (device 100a) are not limited to these, and the washing machine (device 100b) and the microwave oven (100c) are also configured in the same way.

[0039] The driver 104 is software for directly controlling the components 102. The IH control (driver 104) of the rice cooker (device 100a) controls the bottom external IH coil (component 102a). Also, the IH control (driver 104b) controls the main body IH coil (component 102b), the pressure valve control (driver 104c) controls the stepper motor (component 102c), and the IH control (driver 104d) controls the water container IH coil (component 102d). Furthermore, the cooling fan control (driver 104e) controls the cooling fan (component 102e), the buzzer control (driver 104f) controls the piezoelectric buzzer (component 102f), and the sensor control (driver 104g) controls the temperature sensor (component 102g). The driver 104 included in the rice cooker (device 100a) is not limited to these, and the washing machine (device 100b) and the microwave oven (100c) are also configured in the same way.

[0040] The function module 110 refers to a software interface (API: Application Programming Interface) corresponding to one or more drivers 104 and used to operate one or more components 102. The function module 110 can receive one or more parameters for controlling the operation of each component 102. The details of the function module 110 will be described later.

[0041] In the second layer, in order to make the device 100 execute the target process, a function module sequence 120 in which one or more function modules 110 are arranged in the operation order is defined. In other words, the function module sequence 120 defines the execution order of one or more function modules 110. The target process is determined according to the device 100. For example, cooking for the rice cooker (device 100a) and the microwave oven (100c), and washing for the washing machine (device 100b). The function module sequence 120a is used for the rice cooker (device 100a), the function module sequence 120b is used for the washing machine (device 100b), and the function module sequence 120c is used for the microwave oven (device 100c). The device 100 executes operations in the order of the function modules 110 arranged in the function module sequence 120. Therefore, by changing the arrangement of the function modules 110 or changing the parameters set in the function modules 110, the functions / operations of the device 100 can be updated. The details of the function module sequence 120 will be described later.

[0042] At the third layer, a platform server 130 for managing various information of the device control system 1000 is configured. The platform server 130 includes a sequence manager, a device manager, and various databases. The sequence manager manages the function module sequence 120, the device manager manages the registration information of the device 100 that can use the function module sequence 120, and the various databases manage the user information that can use the function module sequence 120.

[0043] At the fourth level, there is a user application server 132 that discloses the function module sequence 120 as a user application. The function module sequence 120 disclosed in the user application server 132 is downloaded to the device 100. The downloaded function module sequence 120 can be used in the device 100. If other function module sequences 120 are downloaded to the device 100, other function module sequences 120 can be used in the device 100.

[0044] It is also possible to aggregate the third and fourth levels in the device control system 1000. In this case, the platform server 130 and the user application server 132 are integrally formed. In addition, the third and fourth levels in the device control system 1000 can also be arranged at the same level. Furthermore, the third and fourth levels in the device control system 1000 can be omitted. In this case, the function module sequence 120 is downloaded from a user device (not shown) held by the user to the device 100.

[0045] Figure 2 (a)-(e) show the configuration of the function module 110 used in the device control system 1000. Figure 2 (a) shows the basic configuration of the function module 110. The function module 110 is defined in units of functions executable by the device 100 and has a "module name" corresponding to the content of the function. Multiple parameters corresponding to the function can be set in the function module 110. Each parameter set in the function module 110 is output to the driver 104. When the driver 104 receives the parameter from the function module 110, it controls the operation of the component 102 according to the parameter.

[0046] Figure 2 (b) shows Figure 1 the function module 110a of "pre-boiling" in the rice cooker (device 100a). In the function module 110a of "pre-boiling", parameters such as the bottom temperature, duration, convection mode, bottom (outer) IH time, and bottom (inner) IH time can be set. Figure 2 (c) shows Figure 1 the function module 110b of "boiling" in the rice cooker (device 100a), Figure 2 (d) shows Figure 1 the function module 110c of "simmering" in the rice cooker (device 100a), Figure 2 (e) shows the function module 110d of "warming". Multiple parameters can also be set in each of the function modules 110b to 110d. Figure 1 The same applies to the function modules 110 in the washing machine (device 100b) and the microwave oven (device 100c).

[0047] Figure 3(a) - (c) show the sequence of functional modules 120 used in the device control system 1000, particularly Figure 1 the composition of the sequence of functional modules 120a used in the rice cooker (device 100a). Figure 3 (a) shows the sequence for "cooking rice", Figure 3 (b) shows the sequence for "simmering cooking", Figure 3 (c) shows the sequence for "roast beef (low - temperature cooking)".

[0048] In Figure 3 the sequence for "cooking rice" shown in (a), there are arranged in sequence three "pre - cooking" functional modules 110a, a "cooking" functional module 110n, a "boiling" functional module 110b, a "simmering" functional module 110c, and a "warming" functional module 110d. Different parameters are set in the three "pre - cooking" functional modules 110a. In this way, by arranging in sequence the three "pre - cooking" functional modules 110a with different parameters set, three - stage pre - cooking can be performed.

[0049] In Figure 3 the sequence for "simmering cooking" shown in (b), there are arranged in sequence a "pre - cooking" functional module 110a, a "cooking" functional module 110n, a "boiling" functional module 110b, and a "warming" functional module 110d. Figure 3 The sequence for "roast beef (low - temperature cooking)" shown in (c) includes a "warming" functional module 110d. In this way, by changing the types, arrangement methods, and parameters of the functional modules 110 used, different target processes such as "cooking rice", "simmering cooking", and "roast beef (low - temperature cooking)" can be performed. Figure 1 The sequence of functional modules 120 in the washing machine (device 100b) and the microwave oven (device 100c) is the same.

[0050] Figure 4 shows the general operation of device 100, particularly Figure 1 the rice cooker (device 100a). It shows the operation of device 100a according to Figure 3 (a) the sequence for "cooking rice". In the soaking process, by sequentially executing the three "pre - cooking" functional modules 110a with different parameters set, the corresponding components 102 act according to the parameters. As a result, the pot temperature increases step - by - step over time. Next, by sequentially executing the "cooking" functional module 110n, the "boiling" functional module 110b, the "simmering" functional module 110c, and the "warming" functional module 110d, the corresponding components 102 act according to the parameters. That is, by sequentially executing multiple functional modules 110, rice cooking is performed in device 100a.

[0051] In the description so far, the functional module 110 is defined in terms of the functional units executable by the device 100, and a functional module sequence 120 in which one or more functional modules 110 are arranged in an operation sequence is defined. Such a functional module 110 does not include actions that a person should perform. On the other hand, in actual target processing, actions that a person should perform are sometimes required. To cope with this, hereinafter, the functional module 110 and the functional module sequence 120 so far are extended. Therefore, the functional module 110 is also defined as a unit of actions that a person should perform. Through such an expression of the functional module 110, it is possible to process the actions of a person and the actions of the device 100 in the same column. In addition, the functional module 110 defined in terms of the functional units executable by the device 100 is defined as a "first type of module", and the functional module 110 defined in terms of the units of actions that a person should perform is defined as a "second type of module". Hereinafter, the functional module 110 is used without distinguishing between the first type of module and the second type of module.

[0052] (2) Configuration of the device control system

[0053] Figure 5 Shows the configuration of the device control system 1000. The device control system 1000 includes a device 100a, a device 100c, a device 100d, a user device 150, a network 300, an information processing device 400, and a storage device 450. In addition, the storage device 450 includes an execution history DB 460 and a sample DB 470.

[0054] The devices 100a and 100c are, for example, Figure 1 rice cookers and microwave ovens. The device 100d is, for example, an IH cooking heater. Each device 100 performs Figure 1 processing at the first level and the second level, and is connected to the network 300. In addition to the device 100, the network 300 is also connected to the user device 150, the information processing device 400, and the storage device 450. In the network 300, any one of wired communication, wireless communication, and a combination of wired communication and wireless communication is performed between these devices.

[0055] The user device 150 is a device used by a user who performs target processing - for example, cooking. For example, it is a computer, a smart phone, or a tablet terminal. The user device 150 receives information related to the cooked dish from the user in the device 100. The user device 150 sends the information related to the dish to the information processing device 400 via the network 300.

[0056] The information processing device 400 is, for example, a computer such as a server or a cloud server having a processor, a memory, etc. In addition, the information processing device 400 is also used to execute Figure 1The user application server 132 for the fourth-level processing. When the information processing device 400 receives information related to a dish from the user device 150, it selects the function module sequence 120 corresponding to the dish and sends the information of the function module sequence 120 to the device 100 via the network 300. When the device 100 receives the information of the function module sequence 120 from the information processing device 400, it performs the actions according to the function module sequence 120.

[0057] In addition to such processing, the information processing device 400 cooperates with the storage device 450 to create or update the function module sequence 120. At this time, the user inputs various information using the user device 150. The information input by the user is reflected when creating the function module sequence 120 in the information processing device 400.

[0058] The storage device 450 is, for example, an HDD (Hard Disk Drive) or an SSD (Solid State Drive), and is a storage area capable of storing electronic information. The execution history DB 460 stores the execution history of the function module 110 in each device 100, and the sample DB 470 stores samples of the function module sequence 120 for various recipes.

[0059] Figure 6 Shows the configuration of the device 100. The device 100 includes a component 102, a communication unit 140, a display unit 142, an operation unit 144, a processing unit 146, and a storage unit 148. The processing unit 146 includes a function module 110 and a driver 104. As described above, the device 100 is a household electrical appliance such as a rice cooker, a washing machine, or a microwave oven. As Figure 1 shown, there are multiple components 102, drivers 104, and function modules 110 respectively, but here, only one is shown for the sake of clarity of the drawing.

[0060] The communication unit 140 is connected to the network 300 and performs communication with the information processing device 400 via the network 300. For example, the communication unit 140 receives the information of the function module sequence 120 from the information processing device 400. The function module sequence 120 includes the function module 110 that the device 100 should execute in the function module sequence 120 for the target processing. In addition, the storage unit 148 stores the function module 110 executable in the device 100. The processing unit 146 reads out the function module 110 stored in the storage unit 148 based on the information of the function module sequence 120 received in the communication unit 140 and causes the component 102 to perform the processing according to the function module sequence 120 via the driver 104.

[0061] The display unit 142 displays information from the processing unit 146. The operation unit 144 is an interface capable of receiving inputs from the user, such as a button. Additionally, the display unit 142 and the operation unit 144 may be integrated as a touch panel. The operation unit 144 outputs the received input to the processing unit 146.

[0062] Figure 7 Shows the configuration of the user device 150. The user device 150 includes a display unit 152, an operation unit 154, a processing unit 156, a storage unit 158, and a communication unit 160. As described above, the user device 150 is a computer, a smartphone, or a tablet terminal. The display unit 152 displays information received from the processing unit 156. The operation unit 154 is an interface capable of receiving inputs from the user, such as a button. Additionally, the display unit 152 and the operation unit 154 may be integrated as a touch panel. The operation unit 154 outputs the received input to the processing unit 156.

[0063] The processing unit 156 outputs the information to be displayed to the display unit 152 and at the same time receives inputs from the operation unit 154. Additionally, the processing unit 156 also stores information in the storage unit 158 or reads information from the storage unit 158. Furthermore, the processing unit 156 is connected to the network 300 via the communication unit 160 and performs communication with the information processing device 400 via the network 300. With such a configuration, when the operation unit 154 receives specified information from the user, the processing unit 156 sends the specified information from the communication unit 160 to the information processing device 400.

[0064] Figure 8 Shows the configuration of the information processing device 400. The information processing device 400 includes a processing unit 406, a storage unit 408, and a communication unit 410. The processing unit 406 includes a reception unit 420, a selection unit 422, a speculation unit 424, and a correction unit 426.

[0065] The processing unit 406 performs the processing in the information processing device 400, such as the processing of creating the function module sequence 120. The details of the processing in the processing unit 406 will be described later. The storage unit 408 stores the information used in the processing unit 406. The communication unit 410 is connected to the network 300 and communicates with the device 100, the user device 150, and the storage device 450 via the network 300.

[0066] (3) Storage of execution history

[0067] As described above, by arranging multiple function modules 110, the function module sequence 120 can be freely created. However, the user does not understand in detail the operations of each component 102. Therefore, it is difficult to know which combination of function modules 110 can achieve an action suitable for the user's expectations. As a result, the creation of the function module sequence 120 becomes difficult.

[0068] For such a user, it is desired to create the functional module sequence 120 in a manner that reproduces their actual cooking. For example, store the functional modules 110 executed in the device 100 during actual cooking, and create the functional module sequence 120 by arranging the functional modules 110 in the order of execution. However, in actual cooking, not only the actions of the device 100 but also the actions of the user are involved, and the functional modules 110 associated with the user's actions cannot be stored. Therefore, in the above-described process, a functional module sequence 120 like that of reproducing cooking cannot be created.

[0069] In addition, even after cooking, when the user considers creating a recipe (functional module sequence 120), it is difficult to create the functional module sequence 120 because the executed functional modules 110 are not stored. Furthermore, sometimes multiple dishes are cooked in parallel during cooking instead of a single dish. In this case, since the functional modules 110 corresponding to the multiple dishes are mixed, it is difficult to create the functional module sequence 120 corresponding to a single dish. In the present embodiment, the functional module sequence 120 is inferred based on the functional modules 110 respectively executed in the multiple devices 100, and the creation of the functional module sequence 120 is assisted. Such a functional module sequence 120 is equivalent to a recipe.

[0070] Figure 9 (a) - (d) represent the cooking processes when cooking 4 dishes in parallel. Here, it is assumed that in addition to braised pork, rice, simmered taro, and miso soup are cooked simultaneously. Figure 9 (a) represents the cooking process of braised pork. In the cooking process of braised pork, the functional modules 110aa of "cutting", 110ab of "blanching", 110ac of "washing", 110ad of "mixing", and 110ae of "cooking" are sequentially executed. Here, the functional modules 110aa of "cutting", 110ac of "washing", and 110ad of "mixing" are performed by a person. The functional modules 110ab of "blanching" and 110ae of "cooking" are performed by an IH cooking heater (device 100d).

[0071] Figure 9 (b) represents the cooking process of rice. In the cooking process of rice, the functional modules 110ba of "washing" and 110bb of "cooking rice" are sequentially executed. Here, the functional module 110ba of "washing" is performed by a person, and the functional module 110bb of "cooking rice" is performed by an electric rice cooker (device 100a).

[0072] Figure 9(c) represents the cooking process of taro stew. In the cooking process of taro stew, the function modules 110ca for "blanching", 110cb for "peeling", 110cc for "mixing", 110cd for "cooking", and 110ce for "cooling" are executed in sequence. Here, the function module 110ca for "blanching" is executed by a microwave oven (device 100c), the function modules 110cb for "peeling", 110cc for "mixing", and 110ce for "cooling" are executed by a person, and the function module 110cd for "cooking" is executed by an IH cooking heater (device 100d).

[0073] Figure 9 (d) represents the cooking process of miso soup. In the cooking process of miso soup, the function modules 110da for "cutting" and 110db for "cooking" are executed in sequence. Here, the function module 100da for "cutting" is executed by a person, and the function module 110db for "cooking" is executed by an IH cooking heater (device 100d).

[0074] After cooking, the rice cooker (device 100a) reports to the information processing device 400 via the network 300 that the function module 110bb for "cooking rice" has been executed. The microwave oven (device 100c) reports to the information processing device 400 via the network 300 that the function module 110ca for "blanching" has been executed. The IH cooking heater (device 100d) reports to the information processing device 400 via the network 300 that the function module 110aa for "cutting", etc., has been executed. Each report includes user identification information for identifying the user (household).

[0075] When the information processing device 400 receives reports from the rice cooker (device 100a), the microwave oven (device 100c), and the IH cooking heater (device 100d), it stores each report in the execution history DB 460. Figure 10 Represents the data structure of the execution history DB 460. In the execution history DB 460, the execution time, the name of the function module 110 executed, the set parameters in the function module 110, and the user identification information are stored for each report. Such reports exist in a mixture of multiple dishes and multiple devices 100. In addition, when the execution history DB 460 stores reports from devices 100 used by multiple users, the user identification information is used to identify the sending source of each report. In this way, the execution history DB 460 can store information related to the function module 110 executed by the device 100, but cannot store information related to the function module 110 executed by a person.

[0076] (4) Creation of the function module sequence

[0077] Here, it is assumed that after the cooking of the above-mentioned braised pork, rice, taro stew, and miso soup is completed, the user considers the case of retaining the recipe of the braised pork as the function module sequence 120. Therefore, here, the processing of the function module sequence 120 for making braised pork will be described. The user operates the operation unit 154 of the user device 150 to input an instruction to start making the function module sequence 120 (hereinafter referred to as "production start instruction"). The production start instruction includes user identification information. The communication unit 160 sends the production start instruction to the information processing device 400 via the network 300.

[0078] The communication unit 410 of the information processing device 400 receives the production start instruction from the user device 150. When the reception unit 420 receives the production start instruction, the processing unit 406 accesses the execution history DB 460 via the communication unit 410 in order to obtain the execution history (one or more reports) for the user identification information included in the production start instruction. Correspondingly, the reception unit 420 receives the execution history from the execution history DB 460 via the communication unit 410. The execution history can also be said to be information related to the function module 110 (type 1 module) executed by the device 100. The communication unit 410 sends the execution history to the user device 150 via the network 300.

[0079] The communication unit 160 of the user device 150 receives the execution history from the information processing device 400. The processing unit 156 displays the execution history on the display unit 152. Figure 11 The execution history displayed on the display unit 152 is shown. A plurality of function modules 110 executed in each device 100 are arranged in the order of execution time. For example, the function module 110ab of "blanching", the function module 110bb of "cooking rice", the function module 110ca of "blanching", and the function module 110cd of "boiling" are arranged in sequence from the front. In addition, the function module 110ae of "boiling" is arranged more than 15 minutes after starting from the function module 110cd of "boiling". Furthermore, the function module 110db of "boiling" is arranged more than 10 minutes after starting from the function module 110ae of "boiling".

[0080] As described above, since the user considers retaining the recipe of the braised pork as the function module sequence 120, the operation unit 154 of the user device 150 is operated as Figure 11 shown, and the function module 110 included in the recipe of the braised pork is selected from the displayed plurality of function modules 110. The processing unit 156 receives the information of the function module 110 selected by the user. The communication unit 160 sends the information of the selected function module 110 to the information processing device 400 via the network 300.

[0081] The communication unit 410 of the information processing device 400 receives the information of the selected function module 110 from the user device 150. The acceptance unit 420 accepts the information of the selected function module 110. The selection unit 422 selects one or more function modules 110 from the multiple function modules 110 included in the execution history according to the information of the selected function module 110. This is equivalent to selecting the function module 110 corresponding to one recipe (braised pork) among the multiple recipes from the multiple function modules 110 included in the execution history. Figure 12 Shows the processing outline of the selection unit 422. Selection Figure 11 Among the multiple function modules 110 shown, the function module 110ab of "blanching" and the function module 110ae of "cooking" included in the recipe of braised pork.

[0082] As described above, the user operates the operation unit 154 of the user device 150 to select the function module 110, but information related to the executed recipe can also be further input. The information related to the executed recipe is, for example, at least one of the recipe name, recipe category, and main ingredients, but is not limited thereto. The processing unit 156 accepts the information related to the executed recipe. The communication unit 160 sends the information related to the executed recipe to the information processing device 400 via the network 300. The communication unit 410 of the information processing device 400 receives the information related to the executed recipe from the user device 150. The acceptance unit 420 accepts the information related to the executed recipe.

[0083] The function module 110 selected by the selection unit 422 is the function module 110 to be executed by the device 100. Therefore, in order to reproduce the recipe through the multiple function modules 110, the function modules 110 to be executed by humans are insufficient. The speculation unit 424 speculates a function module sequence 120 in which the function modules 110 defined in units of functions executable by the device 100 and the function modules 110 defined in units of actions to be performed by humans are arranged in the order of actions. In order to perform the speculation, the speculation unit 424 uses the sample DB 470.

[0084] Figure 13 Shows the data structure of the sample DB 470. The sample DB 470 stores samples of the function module sequence 120 for each of the multiple recipes. For example, "braised pork", "rice", "taro stew", "miso soup", "A"... can be shown as the recipe name, and for each recipe name, multiple function modules 110 included in the sample of the function module sequence 120 are shown. Here, the sample of the function module sequence 120 is associated with the recipe name, but it can also be associated with the recipe category and the main ingredients.

[0085] The speculation unit 424 obtains a sample of the functional module sequence 120 corresponding to the recipe shown in the recipe-related information received by the reception unit 420 by referring to the sample DB 470. In addition, the speculation unit 424 determines the functional module 110 corresponding to the functional module 110 selected in the selection unit 422 among the plurality of functional modules 110 included in the obtained sample of the functional module sequence 120. The functional module 110 corresponding to the selected functional module 110 refers to the same functional module 110 as the selected functional module 110 or a functional module 110 similar to the selected functional module 110.

[0086] To illustrate the process for determining the functional module 110 similar to the selected functional module 110, the following is used here Figure 14 . Figure 14 represents the data structure of the database stored in the storage unit 408. The functional modules 110 of "B1", the functional modules 110 of "B2",..., the functional modules 110 of "BN" with similar functions are aggregated into "Group B". There are multiple such groups. The other functional modules 110 in the group including the selected functional module 110 can be said to be functional modules 110 similar to the selected functional module 110.

[0087] Figure 15 represents the processing outline of the speculation unit 424. It represents the functional module sequence 120 speculated by the speculation unit 424. The functional module 110ea of "cut", the functional module 110ab of "blanching", the functional module 110ec of "wash", the functional module 110ed of "mix", and the functional module 110ae of "cook" are arranged in sequence from the front. Here, the functional module 110ab of "blanching" and the functional module 110ae of "cook" are the functional modules 110 included in the execution history, and the functional module 110ea of "cut", the functional module 110ec of "wash", and the functional module 110ed of "mix" are the functional modules 110 speculated by the speculation unit 424. Through such processing, based on the functional module 110 associated with the operation of the device 100, the functional module sequence 120 including the functional module 110 associated with the user's operation can be speculated.

[0088] In the case where the user does not input information related to the executed recipe to the user device 150, the reception unit 420 of the information processing device 400 does not receive information related to the executed recipe. In the case where the reception unit 420 does not receive information related to the executed recipe, the speculation unit 424 obtains a sample including the functional module sequence 120 of the pattern in which the functional modules 110 arranged in the selection unit 422 are arranged, by referring to the sample DB 470. That is, the speculation unit 424 obtains a sample including the functional module sequence 120 of the pattern identical to the pattern in which the functional modules 110 arranged in the selection unit 422 are arranged. At this time, the speculation unit 424 may also use the information on the time interval between the selected functional modules 110. In addition, the information on ingredients, the device 100, and the set parameters (strength / time) may also be used. The subsequent processing may be the same as before, and the speculation unit 424 speculates the functional module sequence 120 as shown in Figure 15 . The communication unit 410 of the information processing device 400 transmits the information on the functional module sequence 120 speculated in the speculation unit 424 to the user device 150 via the network 300.

[0089] The communication unit 160 of the user device 150 receives the information on the functional module sequence 120 from the information processing device 400. The processing unit 156 displays the information on the functional module sequence 120 as shown in Figure 15 on the display unit 152. While observing the functional module sequence 120 displayed on the display unit 152, the user operates the operation unit 154 and inputs an instruction to correct the functional module sequence 120. The instruction to correct is, for example, deleting or changing the functional modules 110 included in the functional module sequence 120, adding the functional modules 110 to the functional module sequence 120, or inputting the set parameters (ingredients, grams, etc.).

[0090] The processing unit 156 receives the instruction to correct. The communication unit 160 transmits the instruction to correct to the information processing device 400 via the network 300. The communication unit 410 of the information processing device 400 receives the instruction to correct from the user device 150. The reception unit 420 receives the instruction to correct. When receiving the instruction to correct, the correction unit 426 corrects the functional module sequence 120 according to the instruction to correct. Figure 16 shows the processing outline of the correction unit 426. Here, as an example, set parameters are added to the functional modules 110ea, etc. in the functional module sequence 120 as shown in Figure 15 . The correction by the correction unit 426 is not limited to this.

[0091] The correction unit 426 refers to the chart in Figure 14 to identify the functional modules 110 similar to the functional modules 110 included in the functional module sequence 120, that is, the functional modules 110 having the same function, and may also propose a conversion to such functional modules 110.Figure 17 Another processing overview of the correction unit 426 is shown. Here, the function module 110ef of "boiling", which has the same function as the function module 110ae of "boiling", is a candidate for conversion. The proposal for conversion is made on the display unit 152 of the user device 150. When conversion is to be performed, the user inputs an instruction for conversion to the operation unit 154 of the user device 150. When the reception unit 420 of the information processing device 400 receives the instruction for conversion, the correction unit 426 converts the function module 110. When correcting the function module sequence 120, the storage unit 408 stores both the function module sequence 120 before correction and the function module sequence 120 after correction.

[0092] This configuration can be implemented in hardware by the CPU (Central Processing Unit) of any computer, a memory, and other LSIs (Large Scale Integration), and in software by a program loaded into the memory, etc. However, the function modules implemented through their cooperation are depicted here. Therefore, those skilled in the art should understand that these function modules can be implemented in various forms by only hardware, or a combination of hardware and software.

[0093] The operation of the equipment control system 1000 based on the above configuration is described. Figure 18 It is a flowchart of the storage step of the execution history of the equipment control system 1000. The user makes a setting for the equipment 100 (S10). An instruction to start using the equipment 100 by the user is sent to the equipment 100 (S12). The function module 110 is executed in the equipment 100 (S14). The equipment 100 adds the execution history of the function module 110 to the execution history DB 460 (S16).

[0094] Figure 19 It is a flowchart of the production step of the module sequence of the equipment control system 1000. An instruction to start producing the function module sequence 120 based on the user is input into the information processing device 400 via the user device 150 (S50). The information processing device 400 displays the most recently executed function module 110 on the user device 150 (S52). Information based on the user is input into the information processing device 400 via the user device 150 (S54). The information processing device 400 displays the function module 110 selected by the user on the user device 150 (S56). The information processing device 400 infers the function module sequence 120 based on the selected function module 110 (S58), and displays the function module sequence 120 on the user device 150 (S60). The information processing device 400 receives a correction based on the user via the user device 150 (S62), and corrects the function module sequence 120 (S64).

[0095] According to this embodiment, since the functional module sequence 120 in which the first type of module and the second type of module are arranged in the order of operation is inferred based on the received information related to the first type of module, it is possible to simply create control content including human intervention. In addition, since the functional module sequence 120 is corrected when an instruction to correct the inferred functional module sequence 120 is received, it is possible to simply create a functional module sequence 120 that meets the user's wishes. In addition, it is not necessary to plan cooking in order to create the functional module sequence 120, and the functional module sequence 120 can be easily created only by selecting the functional module 110 from one's own cooking history.

[0096] In addition, when information related to the functional module 110 corresponding to one recipe among a plurality of recipes is selected from the execution history, since the functional module sequence 120 is inferred based on the selected functional module 110, even if there are multiple recipes mixed in the execution history, it is possible to create a functional module sequence 120 for the desired recipe. In addition, since, based on the arrangement pattern of the functional modules 110, a sample of the functional module sequence 120 is obtained by referring to the sample DB 470, and this sample is used to infer the functional module sequence 120, it is possible to add functional modules 110 related to human actions. In addition, since, based on the received information related to the recipe, a sample of the functional module sequence 120 is obtained by referring to the sample DB 470, and this sample is used to infer the functional module sequence 120, it is possible to add functional modules 110 related to human actions.

[0097] The outline of one aspect of the present disclosure is as follows. An information processing method according to one aspect of the present disclosure is an information processing method that defines a first type of module defined in units of functions executable by a device (100) and a second type of module defined in units of actions to be performed by a person, and includes: a step of receiving information related to the first type of module executed by the device (100); a step of inferring a module sequence in which the first type of module and the second type of module are arranged in the order of operation based on the received information related to the first type of module; and a step of correcting the module sequence when an instruction to correct the inferred module sequence is received.

[0098] It further includes a step of selecting information related to the first type of module corresponding to one recipe among a plurality of recipes according to the received information related to the first type of module. The step of making the inference may also infer the module sequence based on the selected information related to the first type of module.

[0099] The step of making the inference may also, based on the arrangement pattern of the first type of module, refer to a storage area storing samples of module sequences for each of a plurality of recipes, obtain a sample of the module sequence, and infer the module sequence based on the obtained sample of the module sequence and the information related to the first type of module.

[0100] It also has a step of receiving information related to the recipe to be executed. The step of making a speculation can also obtain a sample of the module sequence by referring to a storage area (470) storing samples of module sequences for each of a plurality of recipes based on the received recipe-related information, and make a speculation on the module sequence based on the obtained sample of the module sequence and the information related to the first type of module.

[0101] Another aspect of the present disclosure is an information processing apparatus (400). The apparatus is an information processing apparatus (400) that defines a first type of module defined by a functional unit executable by a device (100) and a second type of module defined by an action unit to be performed by a person, and includes: a reception unit (420) that receives information related to the first type of module executed by the device (100); a speculation unit (424) that speculates a module sequence in which the first type of module and the second type of module are arranged in an action order based on the received information related to the first type of module; and a correction unit (426) that corrects the module sequence when an instruction to correct the speculated module sequence is received.

[0102] As described above, the present disclosure has been described based on the embodiments. Those skilled in the art should understand that the embodiments are merely illustrative, and various variations may exist in the combination of each constituent element or each processing procedure, and such variations are also within the scope of the present disclosure.

[0103] [Industrial Applicability]

[0104] According to the present disclosure, it is possible to simply create control content including human intervention.

[0105] [Description of Reference Numerals]

[0106] 100 Device, 102 Component, 104 Driver, 110 Functional Module, 120 Functional Module Sequence, 130 Platform Server, 132 User Application Server, 140 Communication Unit, 142 Display Unit, 144 Operation Unit, 146 Processing Unit, 148 Storage Unit, 150 User Device, 152 Display Unit, 154 Operation Unit, 156 Processing Unit, 158 Storage Unit, 160 Communication Unit, 300 Network, 400 Information Processing Apparatus, 406 Processing Unit, 408 Storage Unit, 410 Communication Unit, 420 Reception Unit, 422 Selection Unit, 424 Speculation Unit, 426 Correction Unit, 450 Storage Device, 460 Execution History DB, 470 Sample DB, 1000 Device Control System.

Claims

1. An information processing method, which is an information processing method that defines a first type of module specified by a function unit executable by a device and a second type of module specified by an action unit that a person should perform, and includes: A step of receiving information related to the first type of module executed by the device, A step of inferring a module sequence in which the first type of module and the second type of module are arranged in an action order based on the received information related to the first type of module, and A step of correcting the module sequence when an instruction to correct the inferred module sequence is received.

2. The information processing method according to claim 1, further includes a step of selecting information related to the first type of module corresponding to one recipe among a plurality of recipes according to the received information related to the first type of module; The step of making the inference infers the module sequence based on the selected information related to the first type of module.

3. The information processing method according to claim 1 or 2, The step of making the inference obtains a sample of the module sequence by referring to a storage area storing samples of module sequences for each of a plurality of recipes based on a pattern of arrangement of the first type of modules, and infers the module sequence based on the obtained sample of the module sequence and the information related to the first type of module.

4. The information processing method according to claim 1 or 2, further includes a step of receiving information related to the executed recipe; The step of making the inference obtains a sample of the module sequence by referring to a storage area storing samples of module sequences for each of a plurality of recipes based on the received information related to the recipe, and infers the module sequence based on the obtained sample of the module sequence and the information related to the first type of module.

5. An information processing device, which is an information processing device that defines a first type of module specified by a function unit executable by a device and a second type of module specified by an action unit that a person should perform, and includes: A receiving unit that receives information related to the first type of module executed by the device, An inferring unit that infers a module sequence in which the first type of module and the second type of module are arranged in an action order based on the received information related to the first type of module, and A correcting unit that corrects the module sequence when an instruction to correct the inferred module sequence is received.

6. A program product, which is a program product that defines a first type of module specified by a function unit executable by a device and a second type of module specified by an action unit that a person should perform, and is used to cause a computer to execute the following steps: A step of receiving information related to the first type of module executed by the device, A step of inferring a module sequence in which the first type of module and the second type of module are arranged in an action order based on the received information related to the first type of module, and A step of correcting the module sequence when an instruction to correct the inferred module sequence is received.

Images