Information processing method, information processing device, and program

Abstract

A first acquisition unit (440) acquires, as a first block sequence, a predetermined block sequence executed by the device, the block sequence being a block sequence in which a plurality of blocks specified for each function unit executable by the device are arranged in an operation order. A second acquisition unit (442) acquires action information indicating the content of an action performed by a user on the device. The output unit (448) outputs a second block sequence generated by correcting or deleting the blocks that do not match the action information included in the first block sequence.

Description

Technical Field

[0001] The present disclosure relates to information processing technology, and more particularly to an information processing method, an information processing apparatus, and a program for controlling the operation of a device. Background Art

[0002] After the washing machine is scheduled, the user's desired action is expected to be achieved even if the state of the washing machine changes. Therefore, when the user is out, the weight of the clothes in the washing machine or the operating state changes and the scheduled content needs to be changed, control information for changing the scheduled content is sent to the washing machine (for example, refer to Patent Document 1).

[0003] Prior art literature

[0004] Patent Literature

[0005] Patent Document 1: Japanese Patent Application Publication No. 2020-103871 Summary of the invention

[0006] Technical problem to be solved by the invention

[0007] In Patent Document 1, the reservation content is changed according to the change of the weight of the clothes in the washing machine or the operation status, and the control information is sent to the washing machine. However, the information used to determine the necessity of changing the reservation content is the weight of the clothes or the operation status, and the specific user action such as what kind of clothes are put in is not considered.

[0008] The present disclosure has been made in view of such circumstances, and an object of the present disclosure is to provide a technique for correcting a process when a result different from a predetermined result may occur at the end of the process due to an action initiated by a user.

[0009] Methods used to solve technical problems

[0010] In order to solve the above technical problems, an information processing method of one scheme of the present invention includes: a step of obtaining a predetermined block sequence executed by a device as a first block sequence, wherein the block sequence is a block sequence in which a plurality of blocks specified by functional units executable by the device are arranged in an action order; a step of obtaining action information representing the content of an action performed by a user on the device; and a step of outputting a second block sequence generated by correcting or deleting blocks included in the first block sequence that do not conform to the action information.

[0011] Another scheme of the present disclosure is an information processing device. The device includes: a first acquisition unit, which acquires a predetermined block sequence executed by a device as a first block sequence, wherein the block sequence is a block sequence in which a plurality of blocks specified by functional units executable by the device are arranged in an action order; a second acquisition unit, which acquires action information indicating the content of an action performed by a user on the device; and an output unit, which outputs a second block sequence generated by correcting or deleting blocks included in the first block sequence that do not conform to the action information.

[0012] Furthermore, arbitrary combinations of the above-described constituting elements and modes in which the expression of the present disclosure is converted into methods, apparatuses, systems, recording media, computer programs, etc. may also be practiced as modes of the present disclosure.

[0013] Effects of the Invention

[0014] According to the present disclosure, when a result different from a predetermined result may occur at the end of a process due to an action initiated by a user, the process can be corrected. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 It is a diagram showing the configuration of the device control system according to the embodiment.

[0016] Figure 2 (a)-(e) are shown in Figure 1 A diagram showing the configuration of the functional blocks used in the device control system.

[0017] Figure 3 (a)-(c) are shown in Figure 1 A diagram showing the structure of a sequence of function blocks used in a device control system.

[0018] Figure 4 It is shown Figure 1 A diagram showing an overview of the operation of the device.

[0019] Figure 5 It is a diagram showing the configuration of the information processing system according to the embodiment.

[0020] Figure 6 It is shown Figure 5 A diagram showing a configuration of an information processing device.

[0021] Figure 7 It is shown Figure 6 Diagram of the data structure of the function block sequence stored in the block DB.

[0022] Figure 8 It is shown Figure 6 Diagram of the data structure of the rule information DB.

[0023] Fig. 9 It is shown Figure 6Diagram of other data structures of the rule information DB.

[0024] Fig.10 It is shown Figure 6 A diagram showing an overview of processing performed by a first acquisition unit.

[0025] Fig.11 It is shown Figure 6 A diagram showing an overview of processing performed by a first processing unit.

[0026] Fig.12 It is shown based on Figure 5 A sequence diagram of the correction steps of the functional block sequence of the information processing system.

[0027] Fig.13 It is shown Figure 6 Flowchart of the steps of correcting a function block sequence performed by an information processing device.

[0028] Fig.14 This is a diagram showing an overview of processing performed by the first processing unit of Modification Example 1.

[0029] Fig.15 This is a diagram showing the structure of a functional block sequence of Modification Example 2.

[0030] Fig.16 1 is a diagram showing a data structure of a table stored in a storage unit according to Modification 3. DETAILED DESCRIPTION

[0031] The embodiments described below all represent a preferred specific example of the present disclosure. Therefore, the numerical values, shapes, materials, constituent elements, configuration positions and connection methods of the constituent elements, as well as the steps (processes) and the order of the steps shown in the following embodiments are examples and are not intended to limit the present disclosure. Therefore, among the constituent elements in the following embodiments, the constituent elements not recorded in the independent claims representing the top-level concepts of the present disclosure are described as arbitrary constituent elements. In addition, in each figure, the same figure numerals are marked for substantially the same structures, and repeated descriptions are omitted or simplified. In the following, the embodiments are described in the order of (1) an overview of functional blocks and functional block sequences, and (2) a modified order of functional block sequences.

[0032] (1) Overview of function blocks and function block sequences

[0033] In household electrical appliances such as rice cookers, washing machines, and microwave ovens (hereinafter referred to as "devices"), the functions and actions of the hardware are controlled by software for implementing specific functions. In this embodiment, a device control system is introduced as a structure that enables the creation or update of software for controlling the device.

[0034] Figure 1The configuration of the information processing system 1000 is shown. In the information processing system 1000, a four-layer model consisting of the first layer to the fourth layer is defined. In the first layer, the configuration of the device 100 is specified. The device 100 is, for example, a rice cooker (device 100a), a washing machine (device 100b), and a microwave oven (device 100c). The device 100 is not limited to this. Each device 100 includes a plurality of components 102, a plurality of drivers 104, and a plurality of functional blocks 110.

[0035] The so-called component 102 is a hardware element that is a unit in which the actions (actions, sensing) of the device 100 are divided, and includes actuators and sensors that perform the functions of the device 100. The actuator is an output device, and the sensor is an input device. The actuator is, for example, the bottom outer IH (Induction Heating) coil (component 102a), the main body IH coil (component 102b), the stepping motor (component 102c), the water container IH coil (component 102d), the cooling fan (component 102e), and the piezoelectric buzzer (component 102f) in the rice cooker (device 100a). The sensor is, for example, the temperature sensor (component 102g) in the rice cooker (device 100a). The component 102 included in the rice cooker (device 100a) is not limited to this, and the washing machine (device 100b) and the microwave oven (device 100c) also have the same structure.

[0036] The so-called driver 104 is software for directly controlling the component 102. The IH control (driver 104) in the rice cooker (device 100a) controls the bottom outer IH coil (component 102a). In addition, the IH control (driver 104b) controls the main body IH coil (component 102b), the pressure valve control (driver 104c) controls the stepping motor (component 102c), and the IH control (driver 104d) controls the water container IH coil (component 102d). In addition, the fan control (driver 104e) controls the cooling fan (component 102e), the buzzer control (driver 104f) controls the piezoelectric buzzer (component 102f), and the sensor control (driver 104g) controls the temperature sensor (component 102g). The driver 104 included in the rice cooker (device 100a) is not limited to this, and the washing machine (device 100b) and the microwave oven (device 100c) are also configured in the same manner.

[0037] The function block 110 corresponds to one or more drivers 104 and is a software interface (API: Application Programming Interface) for operating one or more components 102. The function block 110 can receive one or more parameters for controlling the operation of (each) component 102. The details of the function block 110 will be described later.

[0038] In the second layer, in order for the device 100 to execute the target process, a function block sequence 120 is defined in which one or more function blocks 110 are arranged in the order of operation. In other words, the function block sequence 120 defines the execution order of one or more function blocks 110. The target process is determined according to the device 100, for example, cooking for the rice cooker (device 100a) and the microwave oven (device 100c), and washing for the washing machine (device 100b). The function block sequence 120a is used in the rice cooker (device 100a), the function block sequence 120b is used in the washing machine (device 100b), and the function block sequence 120c is used in the microwave oven (device 100c). The device 100 executes the operation in the order of the function blocks 110 arranged in the function block sequence 120. Therefore, by changing the arrangement of the function blocks 110 and changing the parameters set for the function blocks 110, the function and operation of the device 100 can be updated. The details of the function block sequence 120 will be described later.

[0039] In the third layer, a platform server 130 is configured to manage various information in the information processing system 1000. The platform server 130 includes a sequence manager, a device manager, and various databases. The sequence manager manages the function block sequence 120, the device manager manages the registration information of the device 100 that can use the function block sequence 120, and the various databases manage the user information that can use the function block sequence 120.

[0040] In the fourth layer, a user application server 132 is arranged as a user application to publish each function block sequence 120. The function block sequence 120 published by the user application server 132 is downloaded to the device 100. The downloaded function block sequence 120 can be used in the device 100. After other function block sequences 120 are downloaded to the device 100, other function block sequences 120 can be used in the device 100.

[0041] The third layer and the fourth layer in the information processing system 1000 may be integrated. In this case, the platform server 130 and the user application server 132 are integrally configured. In addition, the third layer and the fourth layer in the information processing system 1000 may be arranged in the same layer. Furthermore, the third layer and the fourth layer in the information processing system 1000 may be omitted. In this case, the function block sequence 120 is downloaded from a user device (not shown) owned by the user to the device 100.

[0042] Figure 2 (a) to (e) show the configuration of the functional block 110 used in the information processing system 1000 . Figure 2(a) shows the basic structure of the function block 110. The function block 110 is defined as a functional unit that can be executed by the device 100, and has a "block name" corresponding to the content of the function. A plurality of parameters corresponding to the function can be set for the function block 110. Each parameter set for the function block 110 is output to the driver 104. After receiving the parameters from the function block 110, the driver 104 controls the action of the component 102 according to the parameters.

[0043] Figure 2 (b) means Figure 1 The function block 110a of "pre-cooking" in the electric rice cooker (device 100a). For the function block 110a of "pre-cooking", the parameters of the pot bottom temperature, duration, convection mode, bottom (outer) IH time, and bottom (inner) IH time can be set. Figure 2 (c) shows Figure 1 The "boiling" function block 110b in the rice cooker (device 100a) Figure 2 (d) shows Figure 1 The "stew and steam" function block 110c in the electric rice cooker (device 100a), Figure 2 (e) shows a "keep warm" function block 110d. A plurality of parameters can also be set in each of the function blocks 110b to 110d. Figure 1 The same is true for the functional block 110 in the washing machine (device 100b) and the microwave oven (device 100c).

[0044] Figure 3 (a) to (c) show a functional block sequence 120 used in the information processing system 1000, and in particular, Figure 1 The composition of the function block sequence 120a used in the rice cooker (device 100a). Figure 3 (a) represents the sequence for "steaming rice", Figure 3 (b) shows a sequence for "cooking a dish", Figure 3 (c) shows the sequence for "Roast beef (cooked at low temperature)".

[0045] exist Figure 3 In the sequence for "steaming rice" shown in (a), three "pre-cooking" function blocks 110a, "cooking completion" function blocks 110n, "boiling" function blocks 110b, "stewed steaming" function blocks 110c, and "keeping warm" function blocks 110d are arranged in order. Different parameters are set in the three "pre-cooking" function blocks 110a. By arranging the three "pre-cooking" function blocks 110a with different parameters in order, three-stage pre-cooking can be performed.

[0046] exist Figure 3In the sequence for “cooking food” shown in (b), a function block 110a of “pre-cooking”, a function block 110n of “cooking completion”, a function block 110b of “boiling”, and a function block 110d of “keeping warm” are arranged in order. Figure 3 The sequence for "roast beef (low temperature cooking)" shown in (c) includes a function block 110d of "keep warm". By changing the type, arrangement and parameters of the function blocks 110 used in this way, different target processes of "steaming rice", "cooking boiled food" and "roast beef (low temperature cooking)" can be performed. Figure 1 The same is true for the functional block sequence 120 in the washing machine (device 100b) and the microwave oven (device 100c).

[0047] Figure 4 The device 100 is shown, in particular Figure 1 The operation overview of the rice cooker (device 100a) is shown in FIG. Figure 3 The operation of the device 100a for the sequence of "steaming rice" of (a). In the soaking process, by sequentially executing the three "pre-cooking" function blocks 110a with different parameters set, the corresponding components 102 operate according to the parameters. As a result, the pot temperature increases in a step-like manner over time. Then, by sequentially executing the "cooking completion" function block 110n, the "boiling" function block 110b, the "stewing" function block 110c, and the "keeping warm" function block 110d, the corresponding components 102 operate according to the parameters. That is, by sequentially executing multiple function blocks 110, steaming rice is performed in the device 100a.

[0048] (2) Correction of function block sequence

[0049] Figure 5 The configuration of the information processing system 1000 is shown. The information processing system 1000 includes a device 100, a sensor 200, a network 300, an information processing device 400, and a terminal 500. The device 100, the sensor 200, the information processing device 400, and the terminal 500 are connected via a network 300 such as the Internet. The information processing system 1000 corrects the process when the quality of the finished product decreases after the process is completed by the action performed by the user. The number of devices 100, sensors 200, and terminals 500 included in the information processing system 1000 is not limited to "1".

[0050] Device 100 is a household electrical appliance such as a washing machine, a rice cooker, a microwave oven, and an automatic cooking device. Device 100 is used by user 10. User 10 puts consumer goods such as food ingredients and clothes into device 100, and sets processes such as a cooking process or a washing process for device 100. Device 100 performs cooking or washing by following the cooking process or the washing process. However, user 10 may make contradictory actions such as putting in the wrong time for the scheduled cooking process or washing process, or putting a sweater into the washing machine. Such contradictory actions are more common for beginners who are not accustomed to doing housework, and it is difficult for user 10 to freely re-create the cooking process or the washing process, that is, it is difficult for user 10 to correct the process by himself.

[0051] The information processing system 1000 of this embodiment aims to correct the process in such a situation. The user 10 performs the consumer product placement 50 on the device 100. When the device 100 is a washing machine, the consumer products are suits, sweaters, etc., and when the device 100 is a cooking device, the consumer products are ingredients and seasonings. The sensor 200 is a shooting device such as a camera, and is set at a position where it can shoot the consumer products placed in the device 100. The sensor 200 can be set outside the device 100 or mounted inside the device 100. The sensor 200 generates a dynamic image or a still image (hereinafter collectively referred to as an "image") by performing consumer product shooting 52 on the device 100. For example, the sensor 200 shoots an image in a manner to know the consumer products placed in the washing machine, the pot or frying pan on the stove, etc. by the user 10. The sensor 200 has a communication function and is connected to the information processing device 400 via the network 300. The sensor 200 sends the shot image as sensor information 54 to the information processing device 400 via the network 300. In addition, the sensor 200 may also capture an image and send it to the information processing device 400. Furthermore, the sensor 200 may also perform image recognition processing on the captured image, and as a result, for example, a character string of a sweater or the like contained in the image may be obtained as metadata. In this case, the sensor 200 sends the sensor information 54 contained in the metadata to the information processing device 400 via the network 300.

[0052] The device 100 receives an operation 56 from the user 10. The operation 56 received by the device 100 is an operation for selecting any one of a plurality of programs (menus) prepared in the cooking process or the washing process. For example, in the washing process, a "fully automatic program" and a "fashion program" are prepared as a plurality of programs. These programs are implemented by a functional block sequence described later. The device 100 has a communication function and is connected to the information processing device 400 via the network 300. The device 100 sends the content of the operation 56 performed by the user 10, such as identification information of the functional block sequence, to the information processing device 400 as operation information 58.

[0053] The information processing device 400 is a device having a communication function that can be connected to the network 300, for example, a computer such as a server or a cloud server having a processor, a memory, etc. The information processing device 400 receives the sensor information 54 from the sensor 200 via the network 300, and receives the operation information 58 from the device 100. The information processing device 400 determines whether the action content of the user 10 identified by the sensor information 54 is consistent with the action of the device 100 shown in the operation information 58, that is, the content of the function block sequence. When the action content of the user 10 is consistent with the function block sequence, the information processing device 400 causes the device 100 to perform the action shown by the operation information 58. On the other hand, when the action content of the user 10 is inconsistent with the function block sequence, the information processing device 400 corrects the function block sequence. The details of the processing in the information processing device 400 will be described later. The information processing device 400 sends the information of the corrected function block sequence as the correction information 60 to the device 100 or the terminal 500 via the network 300.

[0054] The device 100 receives the revision information 60 from the information processing device 400 via the network 300. The device 100 has a display unit (not shown) such as a display, and displays the content of the revision information 60, that is, the content of the revised function block sequence, on the display unit. The user 10 confirms the content of the screen displayed on the display unit and inputs an execution instruction of the revised function block sequence. The device 100 executes an action corresponding to the revised function block sequence according to the instruction input by the user 10. In addition, the device 100 may execute the action corresponding to the revised function block sequence without displaying the content of the revision information 60 on the display unit. Furthermore, if the device 100 does not have a display unit, the content of the revision information 60 may be displayed on the terminal 500 instead of the device 100.

[0055] The terminal 500 is a device having a communication function that can be connected to the network 300 and is used by a user. The terminal 500 is, for example, a computer, a smart phone, or a tablet terminal. The terminal 500 includes an operation unit (not shown) such as buttons that can receive information input by the user, and a display unit (not shown) such as a display that can display information to the user. The operation unit and the display unit may also be integrated as a touch panel. After receiving the revision information 60 from the information processing device 400 via the network 300, the terminal 500 displays the content of the revision information 60, that is, the content of the revised function block sequence, on the display unit.

[0056] The user 10 confirms the content of the screen displayed on the display unit, and inputs the execution instruction of the revised function block sequence through the operation unit. The terminal 500 sends information showing the execution instruction of the revised function block sequence (hereinafter referred to as "instruction information") to the device 100 via the network 300, or sends it to the device 100 via the network 300, the information processing device 400, and the network 300. The device 100 performs the action corresponding to the revised function block sequence according to the received instruction information. In the description so far, the device 100 receives the operation 56 from the user 10 and sends the operation information 58 to the information processing device 400. However, it is also possible that the terminal 500 receives the operation from the user 10 and sends the operation information 58 to the device 100 and the information processing device 400. In addition, the action corresponding to the revised function block sequence can be performed without causing the device 100 and the terminal 500 to display the content of the revision information 60.

[0057] Figure 6 4 shows the configuration of information processing device 400. Information processing device 400 includes communication unit 410, processing unit 420, and storage unit 430. Processing unit 420 includes first acquisition unit 440, second acquisition unit 442, first processing unit 444, second processing unit 446, and output unit 448, and storage unit 430 includes block DB 460 and rule information DB 462.

[0058] The storage unit 430 is a HDD (Hard Disk Drive) or an SSD (Solid State Drive), and can store electronic information. The block DB 460 stores the device 100 or the functional block sequence 120 .

[0059] Figure 7 The data structure of the function block sequence 610 stored in the block DB 460 is represented. Here, as an example, the function block sequence 610 used by the washing machine is shown. In the function block sequence 610, the first function block 600a to the sixth function block 600f, which are collectively referred to as the function block 600, are arranged in this order. The function block 600 and the function block sequence 610 correspond to the aforementioned function block 110 and the function block sequence 120. The first function block 600a is an API related to the "put in clothes" function, the second function block 600b is an API related to the "put in detergent and softener" function, and the third function block 600c is an API related to the "washing" function. In addition, the fourth function block 600d is an API related to the "rinsing" function, the fifth function block 600e is an API related to the "spinning" function, and the sixth function block 600f is an API related to the "drying" function.

[0060] As the consumer products 620 that can be used in the functional block sequence 610, the first consumer product 620a to the seventh consumer product 620g are shown. The first consumer product 620a is "detergent", the second consumer product 620b is "detergent for fashion", and the third consumer product 620c is "softener". The fourth consumer product 620d is "suit", the fifth consumer product 620e is "fashion", the sixth consumer product 620f is "dirty clothes", and the seventh consumer product 620g is "sweater".

[0061] For each function block 600, it is possible to set a consumer product 602 or a parameter 604. For example, for the first function block 600a "put in clothes", suits, fashion clothes, dirty clothes, and sweaters can be set as the consumer product 602. For the second function block 600b "put in detergent and softener", detergent, detergent for fashion clothes, and softener can be set as the consumer product 602. For the third function block 600c "wash", detergent, detergent for fashion clothes, suits, fashion clothes, dirty clothes, and sweaters can be set as the consumer product 602, and the water volume, time, water temperature, and number of times can be set as the parameter 604.

[0062] For the fourth function block 600d "rinsing", softener, suits, fashions, dirty clothes, and sweaters can be set as the consumer product 602, and the number of times can be set as the parameter 604. For the fifth function block 600e "dehydration", suits, fashions, dirty clothes, and sweaters can be set as the consumer product 602, and the time can be set as the parameter 604. For the sixth function block 600f "drying", suits, fashions, dirty clothes, and sweaters can be set as the consumer product 602, and the time and temperature can be set as the parameter 604. In addition, rule information 622 is associated with each consumer product 620. The rule information 622 will be described later. The function block sequence 610 stored in the block DB 460 is not limited to Figure 7 .return Figure 6 .

[0063] The communication unit 410 performs communication with the device 100, the sensor 200, and the terminal 500 via the network 300. For example, the communication unit 410 receives the sensor information 54 from the sensor 200 and receives the operation information 58 from the device 100. The second acquisition unit 442 of the processing unit 420 receives the sensor information 54 from the communication unit 410. When the sensor information 54 is an image, the second acquisition unit 442 recognizes the content of the action performed by the user 10 on the device 100 and the consumer product 620 used in the action performed by the user 10 by performing image recognition processing on the image. For example, the user 10 recognizes the action content of putting the consumer product 620 (detergent, suit, sweater) in the washing machine. Here, one consumer product 620 is associated with one action content, such as putting a sweater (consumer product) in the washing machine, putting detergent (consumer product) in the tank, etc. On the other hand, when the sensor information 54 is metadata, the second acquisition unit 442 omits the image recognition processing. As a result, the second acquisition unit 442 acquires action information indicating the action content and the consumer product 620.

[0064] The second acquisition unit 442 acquires rule information indicating whether the action content included in the action information matches the function block 600 from the rule information DB 462 . Figure 8 The data structure of the rule information DB 462 is shown. Figure 7 The rule information specified for the function block 600 in the function block sequence 610. "ID" is a number used to make the rule information identifiable. "Block" is the function block 600, and parameter information can also be stored together. "Action content, consumer goods" is a combination of the user's action content and the consumer goods 620, as shown by the aforementioned action information. The suitable "mark" is also called suitable information, indicating that for each function block 600, the action content is suitable for the function block 600. In addition, the suitable mark sometimes also indicates that for each function block 600, the action content is suitable for the parameters represented by the function block 600. If the user does not perform the action content corresponding to the suitable mark, the function block 600 needs to be deleted or corrected. The unsuitable "mark" is also called unsuitable information, indicating that for each function block 600, the action content is unsuitable for the function block 600. If the user performs the action content corresponding to the unsuitable mark, the function block 600 needs to be deleted or corrected.

[0065] Thus, the rule information is information indicating the consumer product 620 that the user should, should not, or should not use for each combination of the consumer product 620 and the functional block 600, and the parameters determined for each consumer product 620. Fig. 9 Indicates other data structures of the rule information DB 462. "Block modification" indicates the content of deletion or modification when it is determined that the function block 600 needs to be deleted or modified. Return Figure 6 .

[0066] The first acquisition unit 440 receives the operation information 58 from the communication unit 410. As described above, the operation information 58 includes the content of the operation 56 performed by the user 10, such as the identification information of the function block sequence 610. The identification information of the function block sequence 610 is the identification information of the predetermined function block sequence 610 executed by the device 100. The first acquisition unit 440 acquires the function block sequence 610 from the block DB 460 according to the identification information of the function block sequence 610.

[0067] Fig.10 The following is an overview of the processing performed by the first acquisition unit 440. Figure 7 The same function block sequence 610 is used, but the consumer product 602 or parameter 604 corresponding to the identification information of the function block sequence 610 is selected. Here, the user washes in the "full automatic program" in the washing machine, so the consumer product 602 or parameter 604 corresponding to the function block sequence 610 of the program is selected. For example, in the first function block 600a, only suits are selected from the consumer products 602, and fashion, dirty clothes, and sweaters are deleted. In addition, in the third function block 600c, detergents and suits are used to wash from the consumer products 602, and detergents for fashion, fashion, dirty clothes, and sweaters are deleted. And, in the third function block 600c, as parameters 604, the water volume: 20L, time: 12 minutes, water temperature: 15 degrees, number of times: 1 time are set. The same is true for other function blocks 600.

[0068] Furthermore, if the user selects the "Fashion Program" in the washing machine, the fifth consumer product 620e "Fashion" and the second consumer product 620b "Fashion Detergent" are selected as the utilized consumer product 602. Furthermore, the utilized consumer product 602 and the parameter 604 in the function block 600 after the "Washing" in the third function block 600c are also selected to match the Fashion Program. Return Figure 6 .

[0069] The first processing unit 444 causes the function block sequence 610 to reflect the action content or consumables 620 included in the action information. Fig.11 The first processing unit 444 performs the processing. Fig.10 The function block sequence 610 is the same as that of the first function block 600a. Since the action content of the user 10 putting the sweater into the washing machine and the consumables 620 are displayed in the action information, the first processing unit 444 checks the sweater using the consumables 602 in the first function block 600a as an additional item 606. Return Figure 6 .

[0070] On the other hand, the rule information for the function block 600 has been obtained. When the first processing unit 444 determines that the action content indicating the suitable mark is not included in the user's action information, it decides to correct or delete the corresponding function block 600 in the suitable mark. In addition, when the first processing unit 444 determines that the parameter of the function block 600 indicating the suitable mark is not set, it decides to correct or delete the corresponding function block 600 in the suitable mark. This is equivalent to deleting and correcting the function block 600 in a manner that sets the suitable mark when the user does not perform the action of the suitable mark. For example, when the detergent is not put into the detergent tank but into the softener tank, the way water flows in the softener tank is corrected when the function block 600 is washed.

[0071] On the other hand, when the first processing unit 444 determines that the action information of the user includes an action content indicating an unsuitable mark, it decides to modify or delete the corresponding function block 600 in the unsuitable mark. This is equivalent to modifying or deleting the function block 600 in a manner that becomes a suitable mark by referring to the rule information DB 462 when the user performs an action indicating an unsuitable mark. For example, when a sweater is put into a washing machine even though there is a dryer block, the dryer block is deleted because it has an unsuitable mark, or the function block 600 is modified or deleted. Figure 8 Alternatively, you can also change the parameters specified by the ID "2". Fig. 9 Block modification, modify and delete function block 600.

[0072] The second processing unit 446 refers to the rule information and generates a new function block sequence 610 after correcting or deleting the function block 600 when it is determined in the first processing unit 444 that there is a function block 600 that does not match the action information in the original function block sequence 610. When the original function block sequence 610 is referred to as the "first function block sequence", the new function block sequence 610 is referred to as the "second function block sequence". Here, in the second function block sequence, all function blocks 600 are consistent with the action. According to these correction contents, the function block sequence 610 is corrected, and the execution of the function block sequence 610 that may result in a result different from the predetermined result at the end of the process due to the action initiated by the user can be avoided, and the function block sequence 610 can be executed to obtain the same result as or a result similar to the originally predetermined result. The correction content is not limited to this.

[0073] When the first processing unit 444 determines that the action content of the user 10 matches the function block sequence 610, the output unit 448 transmits information for causing the device 100 to execute the action indicated by the operation information 58 to the device 100 via the communication unit 410 and the network 300. On the other hand, when the second processing unit 446 generates a new function block sequence 610, the output unit 448 transmits the information of the new function block sequence 610 to the device 100 as the revision information 60 via the network 300.

[0074] After receiving the revision information 60, the device 100 displays the content of the new function block sequence 610 on the display unit to confirm with the user 10 whether to adopt the new function block sequence 610. In addition, after receiving the revision information 60, the device 100 may adopt the new function block sequence 610 without requesting confirmation and display "Function block sequence revised" on the display unit. For example, when the user 10 designs the initial function block sequence 610 by himself, the user 10 is requested to confirm, but when the user 10 selects operation information such as "fully automatic program", the user 10's confirmation is not required.

[0075] The output unit 448 may also transmit the revision information 60 to the terminal 500 via the network 300. After receiving the revision information 60, the terminal 500 displays the content of the new function block sequence 610 on the display unit to confirm with the user 10 whether to adopt the new function block sequence 610.

[0076] This structure can be realized in hardware by a CPU (Central Processing Unit), memory, or other LSI (Large Scale Integration) of any computer, and in software by a program loaded into a memory, etc., but here, a block of functions realized by their cooperation is drawn. Therefore, it should be understood by those skilled in the art that these functional blocks can be realized in various forms only by hardware or by a combination of hardware and software.

[0077] The operation of the information processing system 1000 based on the above configuration will be described. Fig.12 1 is a sequence diagram showing a correction step based on a functional block sequence of the information processing system 1000. The user 10 puts the consumer product 620 into the device 100 (S100, S102). The device 100 stores the consumer product 620 (S104). The sensor 200 photographs the user 10 putting the consumer product 620 into the device 100 (S106). The sensor 200 sends the sensor information 54 to the information processing device 400 (S108). After receiving the sensor information 54 (S110), the information processing device 400 recognizes the action information (S112) and obtains the rule information (S114).

[0078] The user 10 performs a device operation on the device 100 (S116), and the device 100 receives the operation (S118). The device 100 sends the operation information 58 to the information processing device 400 (S120, S122). After receiving the operation information 58 (S124), the information processing device 400 obtains the function block sequence 610 (S126). The information processing device 400 detects the function block 600 that is not suitable for the action content (S128). The information processing device 400 corrects the function block sequence 610 (S130). The information processing device 400 sends the revision information 60 to the device 100 (S132), and the device 100 displays the function block sequence 610 (S134). The information processing device 400 sends the revision information 60 to the terminal 500 (S136), and the terminal 500 displays the function block sequence 610 (S138).

[0079] Fig.13 4 is a flowchart showing the procedure of revising the function block sequence performed by the information processing device 400. The second acquisition unit 442 acquires action information (S1) and acquires rule information (S2). The first acquisition unit 440 acquires operation information 58 (S3). When it is necessary to revise the function block sequence 610 (Y of S4), the second processing unit 446 performs the revision generation process of the function block sequence 610 (S5). The output unit 448 outputs the revision information 60 (S6). When it is not necessary to revise the function block sequence 610 (N of S4), the process ends.

[0080] (Variant 1)

[0081] In the embodiment, it is assumed that user 10 puts a sweater into a washing machine. In variant 1, it is assumed that a different situation occurs, for example, user 10 puts the detergent and softener in the wrong place. The washing machine is provided with a detergent inlet and a softener inlet, respectively, and user 10 should put detergent in the detergent inlet and softener in the softener inlet. However, in variant 1, user 10 puts softener in the detergent inlet and detergent in the softener inlet. In response to this contradictory action, information processing system 1000 corrects the process.

[0082] Figure 5The sensor 200 captures the action of the user 10 putting softener into the detergent inlet of the device 100 (washing machine) and then putting detergent into the softener inlet. The sensor 200 sends the image of the action of the user 10 as sensor information 54 to the information processing device 400 via the network 300. The sensor information 54 sent from the network 300 may also include metadata of the result of the image recognition processing by the sensor 200. The device 100 receives the operation 56 from the user 10 in the same manner as above. The device 100 sends the content of the operation 56 performed by the user 10, such as the identification information of the function block sequence, as operation information 58 to the information processing device 400.

[0083] The communication unit 410 of the information processing device 400 receives the sensor information 54 from the sensor 200 and the operation information 58 from the device 100. After receiving the sensor information 54 from the communication unit 410, the second acquisition unit 442 of the processing unit 420 performs image recognition processing on the image in the sensor information 54. As a result, the second acquisition unit 442 recognizes the action content that the user 10 puts the softener in the detergent inlet and the detergent in the softener inlet, and the consumer product 620. When the sensor information 54 sent by the sensor 200 includes metadata, the image recognition processing in the second acquisition unit 442 is omitted.

[0084] The second acquisition unit 442 acquires the rule information corresponding to the consumer product 620 included in the action information from the rule information DB 462. When the consumer product 620 included in the action information is detergent or softener, the second acquisition unit 442 acquires the rule information corresponding to the consumer product 620. Figure 8 The rule information for the first consumer product 620a and the rule information for the third consumer product 620c.

[0085] The first acquisition unit 440 receives the operation information 58 from the communication unit 410. The first acquisition unit 440 acquires the function block sequence 610 from the block DB 460 based on the identification information of the function block sequence 610 included in the operation information 58. Fig.10 shown.

[0086] The first processing unit 444 causes the function block sequence 610 to reflect the action content or the consumable product 620 included in the action information. The action information shows that the user 10 puts a softener into the detergent inlet and puts a detergent into the softener inlet and the consumable product 620, so the first processing unit 444 checks the detergent and softener using the consumable product 602 in the second function block 600b.

[0087] On the other hand, the rule information for the consumer product 620 indicated in the action information has already been obtained. As described above, when the first processing unit 444 determines that the action content indicating the appropriate mark is not included in the user's action information, or when the parameters of the function block 600 indicating the appropriate mark are not set, it determines to modify or delete the function block 600. On the other hand, when the first processing unit 444 determines that the action content indicating the unsuitable mark is included in the user's action information, it determines to modify or delete the function block 600. Figure 8 The action contents of “Put detergent into the detergent tank” of ID “3” and “Put softener into the softener tank” of ID “4” do not correspond.

[0088] When determining that there is a function block 600 that does not match the action information, the first processing unit 444 corrects the function block 600 . Fig.14 The processing outline of the first processing unit 444 is shown. In the original function block sequence 610, after the second function block 600b, the third function block 600c, the fourth function block 600d, and the fifth function block 600e continue. In response to this, the first processing unit 444 is corrected in such a way that after the second function block 600b, the fourth function block 600d, the third function block 600c, the third function block 600c, the fourth function block 600d, and the fifth function block 600e are arranged. In the fourth function block 600d after the second function block 600b, the action of dissolving the detergent put into the softener inlet is performed, and in the third function block 600c after the fourth function block 600d, the action of washing the suit is performed. In addition, in the third function block 600c after the third function block 600c, the action of dissolving the softener put into the detergent inlet is performed, and in the fourth function block 600d after the third function block 600c, the action of rinsing is performed. The subsequent actions are the same as the previous ones, so the description is omitted here.

[0089] (Variant 2)

[0090] Heretofore, the washing process has been described as the object, but in Modification 2, the cooking process will be described as the object. Fig.15 The structure of the function block sequence 612 used in the cooking process of stir-fried vegetables is shown. In the function block sequence 612, the seventh function block 600g to the twelfth function block 600l, collectively referred to as the function block 600, are arranged in this order. The seventh function block 600g to the twelfth function block 600l respectively correspond to the functions of "stir-frying pork", "adding carrots", "adding cabbage", "adding seasoning", "adding bean sprouts", and "combining flavors". The function block sequence 612 other than the thirteenth function block 600m is stored in the block DB 460.

[0091] As the consumables 620 that can be used in the function block sequence 612, the eighth consumables 620h to the twelfth consumables 620l are shown. The eighth consumable 620h is "bean sprouts", the ninth consumable 620i is "pork", the tenth consumable 620j is "cabbage", the eleventh consumable 620k is "carrot", and the twelfth consumable 620l is "seasoning". For each function block 600, it is possible to set the consumable 602 or parameter 604 to be used. For example, for the seventh function block 600g "fried pork", pork can be set as the consumable 602 to be used. In addition, the association rule information 622 is associated with each consumable 620. The function block sequence 612 stored in the block DB 460 is not limited to Fig.15 .

[0092] Figure 5 The sensor 200 captures the action of the user 10 adding bean sprouts when the user 10 stir-fries pork. The sensor 200 sends the image of the action of the user 10 as sensor information 54 to the information processing device 400 via the network 300. The sensor information 54 sent from the network 300 may also include metadata of the result of the image recognition processing by the sensor 200. The device 100 or the terminal 500 sends the information of selecting stir-fried vegetables as operation information 58 to the information processing device 400.

[0093] The communication unit 410 of the information processing device 400 receives the sensor information 54 from the sensor 200 and the operation information 58 from the device 100 or the terminal 500. After receiving the sensor information 54 from the communication unit 410, the second acquisition unit 442 of the processing unit 420 performs image recognition processing on the image in the sensor information 54. As a result, the second acquisition unit 442 recognizes the action content of the user 10 adding bean sprouts when frying pork and the consumables 620. When the sensor information 54 sent from the sensor 200 includes metadata, the image recognition processing in the second acquisition unit 442 is omitted.

[0094] The second acquisition unit 442 acquires the rule information corresponding to the consumable product 620 included in the action information from the rule information DB 462. The rule information includes, for example, appropriate flags such as the ingredients put in are correct (for example, sugar and salt are not mixed up), the order of putting in the ingredients is correct, and the way the ingredients are cut is correct (for example, the arc is not cut into pieces by mistake).

[0095] The first acquisition unit 440 receives the operation information 58 from the communication unit 410. The first acquisition unit 440 acquires the function block sequence 612 from the block DB 460 according to the operation information 58. The acquired function block sequence 612 is as follows: Fig.15 shown.

[0096] The first processing unit 444 reflects the action content or consumable 620 included in the action information on the function block sequence 612. The action information shows that the user 10 adds bean sprouts to stir-fried pork and the consumable 620, so the first processing unit 444 checks the bean sprouts using the consumable 602 in the eleventh function block 600k.

[0097] On the other hand, the rule information for the consumable product 620 indicated by the action information has already been acquired. The first processing unit 444 performs the same processing as above, for example, marking the appropriateness as “the order of putting in the ingredients is correct”, and confirms that the action content of the user 10 is inappropriate.

[0098] When the first processing unit 444 determines that there is a function block 600 that does not match the action information, it corrects the function block 600. Fig.15 In the embodiment, a thirteenth function block 600m "removing bean sprouts" is added between the seventh function block 600g and the eighth function block 600h. With such a correction, even if the user 10 mistakenly adds bean sprouts first, the bean sprouts can be temporarily removed during the process, thereby avoiding the bean sprouts from losing their texture when stir-fried vegetables.

[0099] Other examples of corrections in the cooking process are as follows. When the user 10 mistakenly puts salt instead of sugar, the function block sequence 612 is corrected so that the weight (parameter) of all ingredients matches the amount of salt mistakenly put in. When the user 10 mistakenly puts minced meat in curry, the function block sequence 612 is corrected so that the prepared dish becomes a curry without sauce (a dish using minced meat). When the user 10 makes a mistake in cutting the onion and cuts it into smaller pieces instead of the arc-shaped ones, the function block sequence 612 is corrected so that a menu using minced onions is prepared.

[0100] (Variant 3)

[0101] As described above, the information processing device 400 in the variant example 3 generates a new function block sequence 610 by modifying or deleting the function block 600. The function block sequence 610 may also be the function block sequence 612, but for the sake of clarity, it is referred to as "the function block sequence 610" hereinafter. In the variant example 3, the user 10 executes the new function block sequence 610, but the execution result is not satisfactory. The information processing system 1000, the information processing device 400 and the Figure 5 , Figure 6 Here, the explanation will focus on the differences from what has been described so far.

[0102] As described above, the first processing unit 444 of the information processing device 400 uses Fig. 9The rule information DB 462 shown in FIG. 4 modifies the function block 600, and the second processing unit 446 generates a new function block sequence 610 based on the modified function block 600. Fig. 9 The rule information of ID "2" corrects the status of the function block 600. That is, the function block 600 is corrected to "change the spin-drying end time (parameter change)". Such a block correction is made to be changeable. Fig.16 The data structure of the table stored in the storage unit 430 is shown. For example, "mode A", "mode B", and "mode C" are prepared in advance as block corrections, and "mode A" with a use flag set is used. Therefore, "mode A" corresponds to "change the spin-drying end time (parameter change)". Fig. 9 Prepare the IDs Fig.16 That form will do.

[0103] The terminal 500 receives the amendment information 60 indicating the new function block sequence 610. The amendment information 60 also includes the identification information of the new function block sequence 610. The terminal 500 obtains the new function block sequence 610 and the identification information of the new function block sequence 610 based on the received amendment information 60. After the user 10 causes the device 100 to execute the new function block sequence 610, the user 10 uses the terminal 500 to input an evaluation of the execution result of the new function block sequence 610. The evaluation can be expressed as either satisfaction or dissatisfaction, for example. The terminal 500 sends a combination of the identification information of the new function block sequence 610 and the evaluation (hereinafter referred to as "evaluation information") to the information processing device 400 via the network 300.

[0104] The communication unit 410 of the information processing device 400 receives the evaluation information from the terminal 500. The communication unit 410 outputs the evaluation information to the first processing unit 444. When the evaluation in the evaluation information is satisfactory, the first processing unit 444 does not change the content of the block correction of the rule information DB 462 corresponding to the identification information. For example, the mode A is maintained. On the other hand, when the evaluation in the evaluation information is unsatisfactory, the first processing unit 444 changes the content of the block correction of the rule information DB 462 corresponding to the identification information. For example, the first processing unit 444 changes the mode A to the mode B. In this way, the evaluation of the user 10 is fed back to the block correction.

[0105] The evaluation may not only indicate satisfaction or dissatisfaction, but may also indicate the reason for dissatisfaction, such as insufficient drying. The first processing unit 444 makes corrections such as lengthening the drying time according to the reason for dissatisfaction.

[0106] According to the present embodiment, when the predetermined function block sequence 610 executed by the device 100 does not match the action information, the function block sequence 610 is corrected, so that when a result different from the predetermined result may be generated at the end of the process due to the action initiated by the user 10, the process can be corrected. In addition, when correcting the function block sequence 610, the function block 600 is corrected, so that the parameter can be changed. In addition, the action information is acquired based on the sensor information received from the sensor 200, so the action of the user 10 can be grasped. In addition, the sensor information is an image captured in the sensor 200, so the action of the user 10 can be correctly grasped through image recognition processing. In addition, the sensor information includes metadata after the image is processed by image recognition in the sensor 200, so the action of the user 10 can be correctly grasped. In addition, in the action information, the consumer product 620 used in the action of the user 10 is also indicated, so the incorrect use of the consumer product 620 by the user 10 can be identified.

[0107] In addition, in the case where the action content does not conform to the rule information, it is determined that there is a function block 600 that does not conform to the action information, so the judgment can be easily performed. In addition, in the case where the necessary action in the function block 600 is not shown in the action content, it is determined that there is a function block 600 that does not conform to the action information, so the necessary action can be used in the judgment. In addition, in the case where the prohibited action in the function block 600 is shown in the action content, it is determined that there is a function block 600 that does not conform to the action information, so the prohibited action can be used in the judgment. In addition, in the case where the parameter value prohibited from being used in the function block 600 is shown in the action content, it is determined that there is a function block 600 that does not conform to the action information, so the parameter value can be used in the judgment.

[0108] Furthermore, by deleting the function blocks 600 that do not match the action information, a function block sequence 610 that matches the action information can be generated. Furthermore, by changing the parameters set for the function blocks 600 that do not match the action information, a function block sequence 610 that matches the action information can be generated. Furthermore, by replacing the function blocks 600 that do not match the action information with other function blocks 600, a function block sequence 610 that matches the action information can be generated. Furthermore, by changing the order of the function blocks 600 included in the function block sequence 610, a function block sequence 610 that matches the action information can be generated.

[0109] In addition, the evaluation of the execution result of the new function block sequence 610 is fed back to the information processing device 400, so that the function block 600 can be modified or deleted according to the evaluation of the user 10. In addition, since the function block 600 is modified or deleted according to the evaluation of the user 10, the function block sequence 610 that improves the user's satisfaction can be generated.

[0110] The summary of one scheme of the present disclosure is as follows. An information processing method of one scheme of the present disclosure includes: a step of obtaining a predetermined block sequence executed by a device as a first block sequence, the block sequence being a block sequence formed by arranging a plurality of blocks specified by functional units executable by the device in an action order; a step of obtaining action information indicating the content of an action performed by a user on the device; and a step of outputting a second block sequence generated by correcting or deleting blocks included in the first block sequence that do not conform to the action information.

[0111] The step of acquiring the action information may also acquire the action information based on sensor information received from the sensor.

[0112] The sensor is a photographing device, and the sensor information may also include the image photographed by the photographing device or the result information of the recognized image.

[0113] Action information may also include consumables used during the user's actions.

[0114] Alternatively, the method may further include obtaining rule information indicating whether the action content matches the block, and referring to the rule information to correct the blocks included in the first block sequence that do not match the action information to generate the second block sequence.

[0115] Alternatively, the rule information may include, in units of blocks, adaptation information indicating that the action content is adapted to the block. Alternatively, it may be determined that the action content indicating the adaptation information corresponding to a certain block included in the first block sequence is not included in the action information of the user, and the certain block may be modified or deleted.

[0116] Alternatively, the rule information may include, in units of blocks, at least one piece of incompatibility information indicating that the action content is incompatible with the block. Alternatively, it may be determined that the action content indicating incompatibility information corresponding to a certain block included in the first block sequence is included in the action information of the user, and the certain block is corrected or deleted.

[0117] Alternatively, the rule information may include, in units of blocks, adaptation information indicating that the action content is adapted to the parameters indicated by the block. Alternatively, it may be determined that the parameters of the block indicating the adaptation information corresponding to a block included in the first block sequence are not set, and the block may be modified or deleted.

[0118] Alternatively, in the second block sequence, blocks that do not match the action information are deleted.

[0119] In the second block sequence, parameters set for blocks that do not match the action information may be changed.

[0120] Alternatively, in the second block sequence, blocks that do not match the action information are replaced with other blocks.

[0121] The order of the blocks included in the first block sequence may be changed in the second block sequence.

[0122] Another scheme of the present disclosure is an information processing device. The device includes: a first acquisition unit, which acquires a predetermined block sequence executed by a device as a first block sequence, wherein the block sequence is a block sequence in which a plurality of blocks specified by functional units executable by the device are arranged in an action order; a second acquisition unit, which acquires action information indicating the content of an action performed by a user on the device; and an output unit, which outputs a second block sequence generated by correcting or deleting blocks included in the first block sequence that do not conform to the action information.

[0123] The present disclosure has been described above based on the embodiments. It should be understood by those skilled in the art that the embodiments are for illustration only, and various modifications can be implemented for the combination of these components or processing steps, and such modifications are also within the scope of the present disclosure.

[0124] The sensor 200 of this embodiment may be a sensor different from the imaging device. This sensor also sends the sensor information 54 to the information processing device 400. According to this modification, the degree of freedom of configuration can be increased.

[0125] Industrial Applicability

[0126] According to the present disclosure, when a result different from a predetermined result may occur at the end of a process due to an action initiated by a user, the process can be corrected.

[0127] Description of Reference Numerals

[0128] 10 user, 50 put in consumer goods, 52 shoot consumer goods, 54 sensor information, 56 operation, 58 operation information, 60 amendment information, 100 equipment, 200 sensor, 300 network, 400 information processing device, 410 communication unit, 420 processing unit, 430 storage unit, 440 first acquisition unit, 442 second acquisition unit, 444 first processing unit, 446 second processing unit, 448 output unit, 460 block DB, 462 rule information DB, 500 terminal, 600 function block, 602 use of consumer goods, 604 parameter, 606 add item, 610, 612 function block sequence, 620 consumer goods, 622 rule information, 1000 information processing system.

Claims

1. An information processing method, comprising: A step of acquiring a predetermined block sequence executed by the device as a first block sequence, wherein the block sequence is a block sequence in which a plurality of blocks specified by functional units executable by the device are arranged in an action order; A step of acquiring action information indicating the content of an action performed by a user on the device; as well as and outputting a second block sequence generated by correcting or deleting the blocks included in the first block sequence that do not match the action information.

2. The information processing method according to claim 1, In the step of acquiring the action information, the action information is acquired based on sensor information received from a sensor.

3. The information processing method according to claim 2, The sensor is a photographing device, The sensor information includes an image captured by the capturing device or result information of recognizing the image.

4. The information processing method according to claim 1, The action information includes consumables used in the action performed by the user.

5. The information processing method according to claim 4, It also includes the step of obtaining rule information indicating whether the action content is consistent with the block; The rule information is referred to, and blocks included in the first block sequence that do not conform to the action information are corrected or deleted to generate the second block sequence.

6. The information processing method according to claim 5, The rule information includes, in units of the blocks, adaptation information indicating that the action content is adapted to the blocks. determining that the action content representing the appropriate information corresponding to a certain block included in the first block sequence is not included in the action information of the user, Modify or delete the block in question.

7. The information processing method according to claim 5, The rule information includes at least one of incompatibility information indicating that the action content is incompatible with the block in units of the block, determining that the action content indicating the inappropriate information corresponding to a certain block included in the first block sequence is included in the action information of the user, Modify or delete the block in question.

8. The information processing method according to claim 5, The rule information includes, in units of the blocks, compatibility information indicating that the action content is compatible with the parameters indicated by the blocks, determining that a parameter of a block representing the adaptation information corresponding to a block included in the first block sequence is not set, Modify or delete the block in question.

9. The information processing method according to any one of claims 1 to 8, In the second block sequence, the blocks that do not match the action information are deleted.

10. The information processing method according to any one of claims 1 to 8, In the second block sequence, the parameters set for the blocks that do not match the action information are changed.

11. The information processing method according to any one of claims 1 to 8, In the second block sequence, the blocks that do not match the action information are replaced with other blocks.

12. The information processing method according to any one of claims 1 to 8, In the second block sequence, the order of the blocks included in the first block sequence is changed.

13. An information processing device, comprising: A first acquisition unit acquires a predetermined block sequence executed by the device as a first block sequence, wherein the block sequence is a block sequence in which a plurality of blocks specified by functional units executable by the device are arranged in an action order; a second acquisition unit, which acquires action information indicating the content of an action performed by a user on the device; as well as The output unit outputs a second block sequence generated by correcting or deleting the blocks included in the first block sequence that do not match the action information.

14. A program product for causing a computer to execute A step of acquiring a predetermined block sequence executed by the device as a first block sequence, wherein the block sequence is a block sequence in which a plurality of blocks specified by functional units executable by the device are arranged in an action order; A step of acquiring action information indicating the content of an action performed by a user on the device; as well as The step of outputting a second block sequence generated by correcting or deleting the blocks included in the first block sequence that do not match the action information.

Images