Control method, method, information processing system, and program

Abstract

To inhibit work efficiency from deteriorating when a target person measures a plurality of materials by using an information processing system.SOLUTION: A control method for an information processing system including a metering device for measuring amounts of materials and an imaging device for capturing an image of a target person, the control method including acquiring an amount of a first material, acquiring a gesture performed by the target person after acquiring the amount of the first material, and acquiring an amount of a second material in a case where it is determined that the gesture acquired after acquiring the amount of the first material is a first gesture.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to a control method, a method, an information processing system, and a program. [Background technology]

[0002] There is known an information processing system for sequentially measuring a plurality of ingredients to obtain the amounts of the ingredients. For example, a drug compounding management system is known that measures the amounts of a plurality of drugs to be compounded and calculates the remaining amount of each drug (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 7-39573 Summary of the Invention [Problem to be solved by the invention]

[0004] In the information processing system described above, after weighing one ingredient, when weighing the next ingredient, the worker must manually operate the information processing system to transition to a state where the next ingredient can be weighed. If the worker is wearing gloves, the worker must remove the gloves before operating the information processing system, and then put the gloves back on after operating the system, in order to prevent any ingredients from adhering to the gloves from adhering to the information processing system. This poses a problem of reduced work efficiency when weighing multiple ingredients using the information processing system. [Means for solving the problem]

[0005] One aspect of the control method of the present invention is a control method for an information processing system including a weighing device that weighs an amount of an ingredient and an imaging device that images a subject, and includes acquiring the amount of a first ingredient, acquiring a gesture made by the subject after acquiring the amount of the first ingredient, and acquiring the amount of a second ingredient if it is determined that the gesture acquired after acquiring the amount of the first ingredient is the first gesture.

[0006] One aspect of the control method of the present invention is a control method for a control device, which includes acquiring an amount of a first ingredient, determining whether or not a gesture has been input by a subject after acquiring the amount of the first ingredient, and acquiring an amount of a second ingredient if it is determined that the gesture has been input.

[0007] One embodiment of the method of the present invention includes obtaining a quantity of a first ingredient by a metering device, obtaining a gesture made by a subject by a photographing device after obtaining the quantity of the first ingredient, and obtaining a quantity of a second ingredient by the metering device after obtaining the gesture.

[0008] One aspect of the information processing system of the present invention comprises an imaging device, a weighing device, and a control device that controls the imaging device and the weighing device, and the control device is capable of acquiring the amount of a first ingredient using the weighing device, acquiring a gesture made by a subject using the imaging device after acquiring the amount of the first ingredient, and acquiring the amount of a second ingredient using the weighing device after acquiring the gesture.

[0009] One aspect of the program of the present invention executes the above control method. [Brief explanation of the drawings]

[0010] [Figure 1] FIG. 1 illustrates an information processing system according to an embodiment. [Figure 2] 1 is a block diagram illustrating a configuration of an information processing system according to an embodiment. [Figure 3] FIG. 10 is a diagram showing an example of a startup screen displayed when an application program for formulation management processing is started in one embodiment. [Figure 4] 10 is a flowchart showing an example of a control procedure executed by an information processing system when starting a blending management process in one embodiment, and an example of an action procedure performed by an operator when starting blending. [Figure 5] A figure showing an example of a formulation screen displayed when formulation management processing is being executed in one embodiment, showing a state in which a dialog box instructing the placement of a measuring container is displayed. [Figure 6] 10 is a flowchart showing an example of a control procedure executed by an information processing system when a main component is measured in one embodiment, and an example of an action procedure performed by an operator when a main component is measured. [Figure 7] A figure showing an example of a formulation screen displayed when formulation management processing is being executed in one embodiment, showing a state in which a dialog box instructing the user to read the barcode of an ingredient is displayed. [Figure 8] FIG. 10 is a diagram showing an example of a formulation screen displayed when a main component is being measured in the formulation management process of an embodiment. [Figure 9] A figure showing an example of a formulation screen displayed when the main agent is being weighed in one embodiment of the formulation management process, showing the state in which the barcodes of the main agents of multiple lots have been read. [Figure 10] 10 is a flowchart illustrating an example of a control procedure executed by the information processing system when determining an ingredient to be measured next after the main ingredient in the compounding management process of one embodiment. [Figure 11] 10 is a flowchart showing an example of a control procedure executed by an information processing system when performing a measurement process of a curing agent in an embodiment, and an example of an action procedure performed by an operator when measuring the curing agent. [Figure 12] FIG. 10 is a diagram showing an example of a formulation screen displayed when a curing agent is being measured in the formulation management process of an embodiment. [Figure 13] 10 is a flowchart illustrating an example of a control procedure executed by the information processing system when calculating and displaying upper and lower limit values ​​of the amount of curing agent in an embodiment. [Figure 14] FIG. 2 is a diagram illustrating an example of a base agent master according to an embodiment. [Figure 15] 10 is a flowchart showing an example of a control procedure executed by an information processing system when performing a diluent measurement process in one embodiment, and an example of an action procedure performed by an operator when measuring a diluent. [Figure 16] FIG. 10 is a diagram showing an example of a formulation screen displayed when a diluent is being measured in the formulation management process of one embodiment. [Figure 17] 10 is a flowchart illustrating an example of a control procedure executed by the information processing system when calculating and displaying upper and lower limit values ​​for the amount of diluent in an embodiment. [Figure 18] FIG. 10 is a diagram illustrating an example of a dilution list according to an embodiment. [Figure 19] FIG. 10 is a diagram illustrating an example of a diluent list according to an embodiment. [Figure 20] FIG. 10 is a diagram showing an example of a formulation screen showing formulation results of the formulation management process in one embodiment. [Figure 21] 10 is a flowchart showing an example of a control procedure executed by an information processing system after a formulation result is displayed in a formulation management process of one embodiment, and an example of an action procedure performed by an operator after the formulation result is displayed. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. Note that the scope of the present disclosure is not limited to the following embodiments and can be modified as desired within the scope of the technical concept of the present disclosure. In addition, in the following drawings, the scale and number of each structure may differ from the actual structure in order to make each configuration easier to understand.

[0012] FIG. 1 is a diagram illustrating an information processing system 100 according to this embodiment. FIG. 2 is a block diagram illustrating the configuration of the information processing system 100. The information processing system 100 according to this embodiment illustrated in FIG. 1 is an information processing system used when a worker (subject) WP mixes multiple ingredients M. The worker WP corresponds to the subject. In this embodiment, the ingredients M are paints. The mixed ingredients M may also be medicines, seasonings, fragrances, etc. As illustrated in FIG. 1, the information processing system 100 includes a first server (control device) 10, a second server 20, an operation terminal 30, a weighing device 40, a reading device 50, and a temperature and humidity sensor 60.

[0013] In this embodiment, the first server 10 is installed in a location different from the location where the worker WP prepares the material M. The first server 10 can communicate with the second server 20 and the operation terminal 30 via a communication network such as an IP (Internet Protocol) network. The first server 10 is a control device that controls each unit of the information processing system 100. As shown in FIG. 2 , the first server 10 includes a first control unit 11, a first communication unit 12, and a memory unit 13. The first control unit 11 is capable of executing the preparation management process described below. The first control unit 11 is, for example, a microprocessor. The first communication unit 12 communicates with the second server 20 and the operation terminal 30 via the communication network. The memory unit 13 stores various data used in the preparation management process described below. The first server 10 is a computer that can execute the preparation management process described below based on a program installed in the memory unit 13.

[0014] The second server 20 is a computer capable of communicating with the weighing device 40 and the temperature and humidity sensor 60. In this embodiment, the second server 20 receives the output from the weighing device 40 and the output from the temperature and humidity sensor 60 via wireless communication such as Bluetooth (registered trademark). The output from the weighing device 40 and the output from the temperature and humidity sensor 60 may also be sent to the second server 20 via wired communication. The second server 20 obtains the amount of ingredient M weighed by the weighing device 40 based on the output from the weighing device 40. The second server 20 obtains the temperature and humidity of the environment in which the weighing device 40 is placed based on the output from the temperature and humidity sensor 60. The second server 20 sends the obtained amount of ingredient M and the environmental temperature and humidity to the operation terminal 30 via the first server 10.

[0015] The second server 20 is installed with a program for obtaining the amount of material M measured by the weighing device 40 based on the output from the weighing device 40, and a program for obtaining the environmental temperature and humidity based on the output from the temperature and humidity sensor 60. These programs are sent, for example, from the first server 10 to the second server 20 via wireless communication. Note that these programs may also be installed directly into the second server 20 from a medium on which the programs are recorded. Furthermore, the output from the weighing device 40 and the output from the temperature and humidity sensor 60 may be sent directly to the operation terminal 30 via wireless or wired communication without going through the second server 20.

[0016] The operation terminal 30 is a terminal operated by a worker WP when using the information processing system 100. The operation terminal 30 is capable of displaying processes executed by the first server 10. In this embodiment, the operation terminal 30 is a smart device such as a tablet terminal. The operation terminal 30 has a second control unit 31, a second communication unit 32, an input unit 33, a display unit 34, and an imaging device 70.

[0017] The second communication unit 32 communicates with the first communication unit 12 via a communication network. In this embodiment, the input unit 33 and the display unit 34 are the screen of the operation terminal 30. The worker WP can input data to the operation terminal 30 by touching the screen of the operation terminal 30, which is the input unit 33, with his or her fingers. Images and videos showing the blending management process, which will be described later, are displayed on the screen of the operation terminal 30, which is the display unit 34.

[0018] The second control unit 31 controls the operation terminal 30 based on signals sent from the first server 10. The second control unit 31 is, for example, a microprocessor. The second control unit 31 transmits the amount of material M input from the second server 20 via the first server 10, the environmental temperature and humidity input from the second server 20 via the first server 10, and the information of the barcode BC input from the reading device 50 to the first server 10 via the second communication unit 32.

[0019] The imaging device 70 is a device for capturing an image of the worker WP. In this embodiment, the imaging device 70 is a camera built into the operation terminal 30. The imaging device 70 is capable of capturing an image of the worker WP looking at the display unit 34. The imaging device 70 is capable of capturing images and videos.

[0020] The weighing device 40 is a device capable of measuring the weight of the material M. As shown in Fig. 1, in the blending management process described below, a measuring container 41 is placed on the weighing device 40. The weighing device 40 is capable of measuring the weight of the material M placed in the measuring container 41.

[0021] The reading device 50 is a device capable of reading the identification information of the material M. In this embodiment, the reading device 50 is a barcode reader capable of reading the barcode BC printed on the container of the material M. The barcode BC is, for example, a two-dimensional barcode. The reading device 50 can communicate with the operation terminal 30 via wired communication or wireless communication. The information of the barcode BC read by the reading device 50 is sent to the operation terminal 30.

[0022] The temperature and humidity sensor 60 can measure the temperature and humidity of the environment in which the temperature and humidity sensor 60 is placed. The temperature and humidity sensor 60 is placed in the same room in which the weighing device 40 is placed. This allows the temperature and humidity sensor 60 to measure the temperature and humidity of the environment in which the weighing device 40 is placed.

[0023] Next, the formulation management process executed by the information processing system 100 will be described. The worker WP can cause the first server 10 to start the formulation management process by sending a signal to the first server 10 via the operation terminal 30. The worker WP operates the operation terminal 30 to launch an application program for the formulation management process stored in the first server 10. The screen of the application program for the formulation management process is displayed on the screen of the operation terminal 30, i.e., on a browser launched on the display unit 34.

[0024] 3 is a diagram showing an example of a startup screen 34a that is displayed when an application program for blending management processing is started. As shown in FIG. 3, the startup screen 34a displays the current date. The startup screen 34a displays an image capture screen 35. The image capture screen 35 displays an image captured by the image capture device 70 in real time. Specifically, the image capture screen 35 displays an image of the worker WP viewing the screen of the operation terminal 30 in real time.

[0025] The start-up screen 34a displays a menu list for the blending management process. In the example of FIG. 3, the menu list includes the following items: "Material Receipt," "Blending," "Inventory Adjustment," "Material Master Maintenance," and "Material Inventory List." The worker WP can execute each item by selecting a desired item from the menu list. The worker WP can register a newly added material M in the information processing system 100 by selecting the "Material Receipt" item. The worker WP can cause the information processing system 100 to start the blending management process by selecting the "Blending" item. The worker WP selects the "Blending" item when blending material M. The worker WP can correct the inventory amount of the registered material M by selecting the "Inventory Adjustment" item. The worker WP can correct various parameters, such as the blending ratio determined for each material M, by selecting the "Material Master Maintenance" item. The worker WP can check the list of registered materials M by selecting the "Material Inventory List" item.

[0026] The worker WP can select each item in the above menu list by touching the screen of the operation terminal 30, i.e., the input unit 33. The worker WP can also select the "blending" item by making a specific gesture toward the imaging device 70. In this embodiment, the worker WP can select the "blending" item by making a gesture GP toward the imaging device 70 while the startup screen 34a is displayed. The gesture GP is a gesture in which only the index finger and middle finger are extended. Note that items other than "blending" among the items in the above menu list may also be selectable by the worker WP's gesture. Note that in the following description, the operations that the worker WP can perform by gestures can also be performed by the worker WP directly touching the input unit 33 with their hands.

[0027] The information processing system 100 analyzes video captured by the imaging device 70 to determine whether the worker WP shown in the video is making a specific gesture. In this embodiment, the analysis of the video is performed by the second control unit 31 of the operation terminal 30. More specifically, when an application program for blending management processing is launched, the first control unit 11 of the first server 10 sends an analysis program stored in the storage unit 13 to the second control unit 31. The second control unit 31 analyzes the video captured by the imaging device 70 by reading and executing the analysis program sent from the first control unit 11. Alternatively, the video captured by the imaging device 70 may be sent from the operation terminal 30 to the first server 10, and the analysis program may be executed by the first control unit 11 of the first server 10, thereby analyzing the video.

[0028] Next, the formulation management process that starts when the "Formulation" option is selected on the startup screen 34a will be described. When performing formulation, the worker WP wears gloves WG on both hands. In this embodiment, the formulation management process is executed by the first control unit 11 of the first server 10. FIG. 4 is a flowchart showing an example of a control procedure executed by the information processing system 100 when the formulation management process of this embodiment starts, and an example of an action procedure performed by the worker WP when formulation starts. FIG. 5 is a diagram showing an example of a formulation screen 34b that is displayed when the formulation management process is being executed, showing a state in which a dialog box 81 instructing the worker WP to place the measuring container 41 is displayed. When the worker WP selects the "Formulation" option and executes the formulation management process, the startup screen 34a switches to the formulation screen 34b shown in FIG. 5. The formulation screen 34b displays the captured image 35 and the current date, just like the startup screen 34a.

[0029] As shown in Fig. 4, when the blending management process starts, the information processing system 100 measures and displays the temperature and humidity of the environment in which blending is performed (step Sa). In this embodiment, the information processing system 100 measures the temperature and humidity of the environment in which blending is performed using the temperature and humidity sensor 60. The temperature and humidity of the environment in which blending is performed are the temperature and humidity of the environment in which the weighing device 40 is placed. As shown in Fig. 5, the environmental temperature and humidity measured by the temperature and humidity sensor 60 are displayed on the blending screen 34b.

[0030] As shown in FIG. 4, the information processing system 100 displays the environmental temperature and humidity, and then displays a dialogue 81 instructing the operator to place the measuring container 41 (step Sb). As shown in FIG. 5, in step Sb, the information processing system 100 displays the dialogue 81 on the blending screen 34b. As shown in FIG. 4, after displaying the dialogue 81, the information processing system 100 determines whether or not a specific operation input has been made by the operator WP (step Sc). The operator WP places the measuring container 41 on the measuring device 40 in accordance with the instructions displayed in the dialogue 81 (step Pa) and performs a gesture operation toward the imaging device 70 (step Pb). In step Sc of this embodiment, the information processing system 100 determines whether or not a specific gesture operation has been made by the operator WP. The specific gesture operation determined in step Sc is an operation of making a gesture GK. The gesture GK is a gesture in which the index finger and the tip of the thumb are brought together and the other fingers are extended.

[0031] If it is determined in step Sc that the worker WP has made the gesture GK (step Sc: YES), the information processing system 100 closes the dialogue 81 and starts the measurement process of the main agent (first material) M1 (step S10). In this embodiment, the main agent M1 corresponds to the first material.

[0032] Fig. 6 is a flowchart showing an example of a control procedure executed by the information processing system 100 when carrying out the weighing process of the main agent M1, and an example of an action procedure performed by the worker WP when carrying out the weighing process of the main agent M1. As shown in Fig. 6, when the weighing process of the main agent M1 is started, the information processing system 100 displays a dialog 82 instructing the worker WP to read the barcode BC of the main agent M1 (step S11). Fig. 7 is a diagram showing an example of the formulation screen 34b displayed when the formulation management process is being executed, showing a state in which the dialog 82 instructing the worker WP to read the barcode BC of the material M is displayed. As shown in Fig. 7, in step S11, the information processing system 100 displays the dialog 82 on the formulation screen 34b.

[0033] As shown in FIG. 6, after displaying the dialog box 82, the information processing system 100 determines whether the barcode BC has been read (step S12). Following the instructions in the dialog box 82, the worker WP reads the barcode BC of the main agent M1 using the reading device 50 (step P11). If it is determined in step S12 that the barcode BC has been read (step S12: YES), the information processing system 100 determines whether the information input by reading the barcode BC is appropriate (step S13). In step S13, the information processing system 100 determines whether the first identification information input by reading the barcode BC is appropriate information for the main agent M1. More specifically, in step S13, the information processing system 100 compares the first identification information input by reading the barcode BC with the identification information of each material M stored in the storage unit 13, and determines whether the material M having the read barcode BC is appropriate as the main agent M1. That is, the control method of the information processing system 100 includes determining whether or not the material M specified based on the first identification information input by reading the barcode BC is a correct material as the main agent M1.

[0034] For example, if the worker WP mistakenly reads the barcode BC of a material M other than the main agent M1, the information processing system 100 determines that the information input by reading the barcode BC is inappropriate (step S13: NO). Furthermore, if the barcode BC read by the worker WP is the barcode BC of a material M not registered in the information processing system 100, the information processing system 100 determines that the information input by reading the barcode BC is inappropriate (step S13: NO). If it is determined that the information input by reading the barcode BC is inappropriate (step S13: NO), the information processing system 100 leaves the dialog 82 displayed and does not start measuring the main agent M1. In other words, the control method of the information processing system 100 includes not acquiring the amount of the main agent M1 when it is determined that the material M identified based on the first identification information input by reading the barcode BC is not the correct material for the main agent M1. In this case, the information processing system 100 may display an error message on the formulation screen 34b indicating that the read barcode BC is not an appropriate barcode BC.

[0035] If the information input by reading the barcode BC is determined to be appropriate (step S13: YES), the information processing system 100 acquires and displays various information about the main agent M1 (step S14). In step S14, the information processing system 100 acquires information about the main agent M1 based on the first identification information input by reading the barcode BC. That is, the control method of the information processing system 100 includes acquiring the first identification information and acquiring information about the main agent M1 based on the first identification information. In step S14, the information processing system 100 compares the identification information of the material M stored in the storage unit 13 with the first identification information, outputs information about the material M indicated by the first identification information from the storage unit 13, and displays it on the formulation screen 34b. FIG. 8 is a diagram showing an example of the formulation screen 34b displayed when the main agent M1 is being weighed in the formulation management process. 8, the displayed information about the main agent M1 includes the name of the main agent M1, the lot number of the main agent M1, the expiration date of the main agent M1, and the remaining amount of the main agent M1. In other words, the control method of the information processing system 100 includes obtaining the remaining amount of the main agent M1 based on the first identification information.

[0036] As shown in FIG. 6, after displaying various information about the main agent M1, the information processing system 100 starts measuring the main agent M1 (step S15). That is, the control method of the information processing system 100 includes acquiring the amount of the main agent M1 when it is determined that the material M identified based on the first identification information input by reading the barcode BC is the correct material for the main agent M1. The worker WP pours a desired amount of the main agent M1 into the measuring container 41 (step P12). As shown in FIG. 8, in step S15, the information processing system 100 acquires the amount of the main agent M1 poured into the measuring container 41, i.e., the poured amount, using the weighing device 40, and displays the amount on the formulation screen 34b. That is, the control method of the information processing system 100 includes acquiring the amount of the main agent M1 using the weighing device 40. In step S15, the information processing system 100 subtracts the weight of the measuring container 41 from the weight obtained based on the measuring device 40 to obtain the amount of the main agent M1 added, and displays this amount on the blending screen 34b. In the example of Fig. 8, the amount of the main agent M1 added is 4.00 kg.

[0037] The information processing system 100 updates the display of the acquired amount of main agent M1 in real time and displays it on the formulation screen 34b. The information processing system 100 updates the display of the remaining amount of main agent M1 displayed on the formulation screen 34b according to the acquired amount of main agent M1. The information processing system 100 displays the amount of main agent M1 used for the lot from which the barcode BC was read next to the display of the remaining amount of main agent M1 for that lot. When only one lot of main agent M1 is used, the amount of main agent M1 used is the same as the amount of main agent M1 added to the measuring container 41.

[0038] As shown in FIG. 6, when the measurement of the main agent M1 is started, the information processing system 100 determines whether a specific operation has been input by the operator WP (step S16). The operator WP performs a gesture operation when the addition of the main agent M1 for the lot for which the barcode BC was read is completed (step P13). In step S16, the information processing system 100 can accept two gestures: gesture GP and gesture (first gesture) GN. The gesture GN is a gesture in which only the index finger and thumb are extended and the index finger is pointed to the right as seen from the operator WP. Thus, the control method of the information processing system 100 includes acquiring the amount of the main agent M1 and then acquiring the gesture performed by the operator WP using the imaging device 70. Note that the mark indicating the gesture GN, as shown in each figure, is oriented in the direction in which the operator WP's gesture GN appears on the imaging screen 35, i.e., in the direction in which the operator WP's gesture GN appears as seen from the imaging device 70.

[0039] In step S16, the gesture GP is a gesture for performing the "dialog display" operation. If it is determined in step S16 that the operator WP has performed the gesture GP (step S16: "dialog display"), the information processing system 100 performs step S11 again and displays the dialog 82 again, which instructs the operator to read the barcode BC of the main agent M1. The information processing system 100 then performs steps S12 to S15 again as described above. If the amount of main agent M1 to be poured into the measuring container 41 is insufficient with only the main agent M1 of one lot, the operator WP performs the gesture GP to display the dialog 82 in order to read the main agent M1 of another lot. After the dialog 82 is displayed, the operator WP reads the barcode BC of the main agent M1 of another lot using the reading device 50 and pours the main agent M1 of that other lot into the measuring container 41.

[0040] FIG. 9 shows an example of the formulation screen 34b displayed when the main agent M1 is being weighed in the formulation management process, showing the state in which the barcodes BC of the main agent M1 of multiple lots have been read. When the barcodes BC of the main agent M1 of multiple lots have been read, various information about the main agent M1 of each lot is displayed vertically. The example in FIG. 9 shows the state in which the barcodes BC of the main agent M1 of two lots have been read. For example, if a worker WP wants to add 4.00 kg of the main agent M1 to the weighing container 41 and only 3.20 kg of the main agent M1 of the first lot remains, the worker WP reads the barcode BC of the main agent M1 of the next lot and adds 0.80 kg of the main agent M1 of the next lot to the weighing container 41, thereby increasing the amount of the main agent M1 added to the weighing container 41 to 4.00 kg. When the barcode BC of the main agent M1 of a new lot is read and the weight of the weighing container 41 increases, the information processing system 100 determines that the main agent M1 of a new lot has been poured into the weighing container 41, and updates the display of the remaining amount of the main agent M1 of the new lot.

[0041] In step S16 shown in FIG. 6, the gesture GN is a gesture for performing a "next" operation. In step S16, the gesture GN corresponds to the first gesture. If it is determined in step S16 that the worker WP has performed the gesture GN (step S16: "next"), the information processing system 100 proceeds to the measurement process of the next material M (step Sd). In this embodiment, the material M measured after the main material M1 is a hardener (second material) M2 or a diluent (second material) M3. In this embodiment, the hardener M2 and the diluent M3 correspond to the second material.

[0042] 10 is a flowchart showing an example of a control procedure executed by the information processing system 100 when determining the material M to be measured after the main agent M1 in the blending management process. As shown in FIG. 10, after the main agent M1 has been measured, the information processing system 100 determines whether the main agent M1 is a two-component paint (step Se). A two-component paint is a paint that requires mixing a curing agent M2 with the main agent M1. In contrast, a one-component paint is a paint that does not require mixing a curing agent M2 with the main agent M1.

[0043] In step Se, the information processing system 100 determines whether the main agent M1 is a two-component paint based on the information about the main agent M1 stored in the memory unit 13. If it is determined in step Se that the main agent M1 is a two-component paint (step Se: YES), the information processing system 100 starts the measurement process of the hardener M2 (step S20). If it is determined in step Se that the main agent M1 is not a two-component paint (step Se: NO), the information processing system 100 determines that the main agent M1 is a one-component paint, and starts the measurement process of the diluent M3 (step S30). In this way, the control method of the information processing system 100 includes obtaining the amount of the hardener M2 or the diluent M3 when the gesture obtained after obtaining the amount of the main agent M1 is the gesture GN as the first gesture.

[0044] Fig. 11 is a flowchart showing an example of a control procedure executed by the information processing system 100 when performing a measurement process of the curing agent M2, and an example of an action procedure executed by the worker WP when measuring the curing agent M2. Fig. 12 is a diagram showing an example of a blending screen 34b displayed when the measurement of the curing agent M2 is being performed in the blending management process.

[0045] As shown in FIG. 11, when the measurement process of the curing agent M2 is started, the information processing system 100 displays a dialog box instructing the operator to read the barcode BC of the curing agent M2 (step S21) and determines whether the barcode BC has been read (step S22). The dialog box displayed in step S21 is, for example, the same as the dialog box 82 displayed when the measurement process of the main agent M1 is started. When the operator WP reads the barcode BC of the curing agent M2 using the reading device 50 (step P21), the information processing system 100 determines whether the information input by reading the barcode BC is appropriate (step S23). In step S23, the information processing system 100 determines whether the material M identified based on the second identification information input by reading the barcode BC is the correct material M for the curing agent M2 to be mixed with the main agent M1. In other words, the control method of the information processing system 100 includes determining whether the material M identified based on the second identification information is the correct material M for the curing agent M2 to be mixed with the main agent M1. The other processes in step S23 are the same as the other processes in step S13 described above, except that the material M is the curing agent M2.

[0046] If it is determined in step S23 that the input information is inappropriate by reading the barcode BC (step S23: NO), the information processing system 100 leaves the dialog instructing to read the barcode BC of the curing agent M2 displayed and does not start measuring the curing agent M2. In other words, the control method of the information processing system 100 includes not acquiring the amount of the curing agent M2 when it is determined that the material M identified based on the second identification information is not the correct material as the curing agent M2 to be mixed with the main agent M1.

[0047] If it is determined in step S23 that the information input by reading the barcode BC is appropriate (step S23: YES), the information processing system 100 acquires and displays various information about the curing agent M2 (step S24). In step S24, the information processing system 100 acquires information about the curing agent M2 based on the second identification information input by reading the barcode BC. In other words, the control method of the information processing system 100 includes acquiring the second identification information and acquiring information about the curing agent M2 based on the second identification information.

[0048] 12, the information about the curing agent M2 displayed in step S24 includes the name of the curing agent M2, the lot number of the curing agent M2, the expiration date of the curing agent M2, and the remaining amount of the curing agent M2. In other words, the control method of the information processing system 100 includes obtaining the remaining amount of the curing agent M2 based on the second identification information.

[0049] As shown in Fig. 11, after displaying various pieces of information about the curing agent M2, the information processing system 100 calculates and displays upper and lower limit values ​​for the amount of the curing agent M2 (step S25). In step S25, the information processing system 100 calculates the upper and lower limit values ​​for the amount of the curing agent M2 based on information about the main agent M1 stored in the storage unit 13. Fig. 13 is a flowchart showing an example of a control procedure executed by the information processing system 100 when calculating and displaying the upper and lower limit values ​​for the amount of the curing agent M2. As shown in Fig. 13, in step S25, the information processing system 100 acquires the mixing ratio of the main agent M1 and the curing agent M2 from the main agent master 91 (step S25a).

[0050] FIG. 14 is a diagram showing an example of a base agent master 91. As shown in FIG. 14, the base agent master 91 stores information for each base agent M1, such as the material name of the base agent M1, the type of base agent M1, the volume of the base agent M1, the mixing ratio of the base agent M1, the mixing ratio of the curing agent M2, the expiration date of the base agent M1 when unopened, the expiration date of the base agent M1 after opening, the drying temperature of the base agent M1, and the drying time of the base agent M1. The type of base agent M1 indicates whether the base agent M1 is a two-component paint or a one-component paint. If the base agent M1 is a one-component paint, the mixing ratio of the curing agent M2 for that base agent M1 is not registered in the base agent master 91. The volume of the base agent M1 registered in the base agent master 91 is the volume of the base agent M1 for each lot.

[0051] In step S25a, the information processing system 100 acquires the mixing ratio of the main agent M1 and the curing agent M2 by referring to the mixing ratio of the main agent M1 and the curing agent M2 registered in the main agent master 91. In the example of Fig. 14, the mixing ratio of the main agent M1 is 5, and the mixing ratio of the curing agent M2 is 1. Therefore, in the example of Fig. 14, the worker WP only needs to mix the main agent M1 and the curing agent M2 at a mixing ratio of 5:1.

[0052] 13, after obtaining the mixing ratio of the main agent M1 and the curing agent M2, the information processing system 100 calculates the lower limit of the amount of the curing agent M2 from the amount of the main agent M1 and the mixing ratio (step S25b). Specifically, for example, if the amount of the main agent M1 added is 4.00 kg, the amount of the curing agent M2 calculated from the mixing ratio in the example of FIG. 14 is one-fifth of the amount of the main agent M1, i.e., 0.80 kg. In step S25b, the information processing system 100 calculates the amount of the curing agent M2 calculated as above as the lower limit of the amount of the curing agent M2 to be mixed with the main agent M1.

[0053] After calculating the lower limit of the amount of curing agent M2, the information processing system 100 calculates the upper limit of the amount of curing agent M2 from the lower limit and the upper limit ratio (step S25c). The upper limit ratio is the ratio of the upper limit of the amount of curing agent M2 that can be added to the amount calculated from the mixing ratio registered in the main agent master 91, i.e., the amount calculated from the lower limit. For example, if the upper limit ratio is 10%, the upper limit of the amount of curing agent M2 is the value obtained by increasing the lower limit by 10%. Specifically, if the lower limit of the amount of curing agent M2 is 0.80 kg and the upper limit ratio is 10%, the upper limit of the amount of curing agent M2 is 0.88 kg. The upper limit ratio is, for example, uniformly determined in advance for all two-component main agents M1 and stored in the storage unit 13. Note that the upper limit ratio may be determined individually for each two-component main agent M1 and registered in the main agent master 91.

[0054] In this way, the lower limit and upper limit of the amount of curing agent M2 are calculated, and a predetermined range of the amount of curing agent M2 to be added is defined. The predetermined range of the curing agent M2 is a range equal to or greater than the lower limit of the amount of curing agent M2 and equal to or less than the upper limit of the amount of curing agent M2. In this way, the control method of the information processing system 100 includes defining the predetermined range of the curing agent M2 based on the acquired amount of main agent M1.

[0055] As shown in Fig. 13, after calculating the upper limit value of the amount of curing agent M2, the information processing system 100 displays the upper and lower limit values ​​of the amount of curing agent M2 (step S25d). As shown in Fig. 12, the lower limit value M2L of the curing agent M2 is displayed to the left of the display of the input amount of curing agent M2 on the blending screen 34b. The upper limit value M2U of the curing agent M2 is displayed to the right of the display of the input amount of curing agent M2 on the blending screen 34b. On the blending screen 34b, a less-than-equal sign "≦" is displayed between the display of the input amount of curing agent M2 and the display of the lower limit value M2L, and between the display of the input amount of curing agent M2 and the display of the upper limit value M2U.

[0056] As shown in FIG. 11, after displaying the upper and lower limits of the amount of curing agent M2, the information processing system 100 starts measuring the curing agent M2 (step S26). That is, the information processing system 100 acquires the amount of curing agent M2 when it determines that the material M identified based on the second identification information is the correct material for the curing agent M2 to be mixed with the main agent M1. The worker WP pours the amount of curing agent M2 into the measuring container 41 that is equal to or greater than the lower limit M2L and equal to or less than the upper limit M2U displayed on the blending screen 34b (step P22). As shown in FIG. 12, in step S26, the information processing system 100 acquires the amount of curing agent M2 poured into the measuring container 41, i.e., the pouring amount, using the weighing device 40 and displays it on the blending screen 34b. In step S26, the information processing system 100 subtracts the weight of the measuring container 41 and the weight of the main agent M1 charged into the measuring container 41 from the weight obtained based on the measuring device 40 to obtain the amount of the charged curing agent M2 and displays it on the blending screen 34b. In the example of Fig. 12, the charged amount of the curing agent M2 is 0.85 kg.

[0057] The information processing system 100 updates the display of the acquired amount of curing agent M2 in real time and displays it on the formulation screen 34b. The information processing system 100 updates the display of the remaining amount of curing agent M2 displayed on the formulation screen 34b according to the acquired amount of curing agent M2. The information processing system 100 displays the amount of curing agent M2 used for the lot from which the barcode BC was read next to the display of the remaining amount of curing agent M2 for that lot. When only one lot of curing agent M2 is used, the amount of curing agent M2 used is the same as the amount of curing agent M2 charged into the measuring container 41.

[0058] As shown in FIG. 11, when the measurement of the hardener M2 is started, the information processing system 100 determines whether a specific operation has been input by the worker WP (step S27). The worker WP performs a gesture operation when the addition of the hardener M2 for the lot for which the barcode BC has been read is completed (step P23). There are three gestures that the information processing system 100 can accept in step S27: gesture GP, gesture GN, and gesture (third gesture) GR. Gesture GR is a gesture in which only the index finger and thumb are extended and the index finger is pointed left as seen from the worker WP. Note that the mark indicating gesture GR, which is appropriately shown in each figure, is shown in the orientation when the gesture GR of the worker WP is displayed on the imaging screen 35, that is, the orientation when the gesture GR performed by the worker WP is viewed from the imaging device 70.

[0059] In step S27, the gesture GP is a gesture for performing the "dialog display" operation. If it is determined in step S27 that the worker WP has performed the gesture GP (step S27: "dialog display"), the information processing system 100 performs step S21 again and displays again the dialog instructing the worker WP to read the barcode BC of the curing agent M2. The information processing system 100 then performs steps S22 to S26 again as described above. If the amount of curing agent M2 to be poured into the measuring container 41 is insufficient with only one lot of curing agent M2, the worker WP performs the gesture GP to display the dialog in order to read another lot of curing agent M2. After the dialog is displayed, the worker WP reads the barcode BC of the other lot of curing agent M2 using the reading device 50 and pours the other lot of curing agent M2 into the measuring container 41. When two or more lots of the curing agent M2 are used, information about the multiple curing agents M2 is displayed side by side on the blending screen 34b, similar to the example in the case of the main agent M1 shown in FIG.

[0060] In step S27, the gesture GR is a gesture for performing a "back" operation. In step S27, the gesture GR corresponds to the third gesture. If it is determined in step S27 that the worker WP has performed the gesture GR (step S27: "back"), the information processing system 100 performs the measurement process of the main agent M1 (step S10) again. That is, the control method of the information processing system 100 includes acquiring the amount of the main agent M1 when the gesture GR as the third gesture is acquired after acquiring the amount of the hardener M2. For example, if the worker WP has accidentally added more hardener M2 than the upper limit value M2U to the measuring container 41, the worker WP can perform the gesture GR to return to measuring the main agent M1 and add additional main agent M1 to the measuring container 41. The processing of the information processing system 100 after returning to measuring the main agent M1 is the same as the processing from step S10 onwards described above.

[0061] In step S27, the gesture GN is a gesture for performing a "next" operation. If it is determined in step S27 that the worker WP has performed the gesture GN (step S27: "next"), the information processing system 100 determines whether the amount of hardener M2 is appropriate (step S28). In step S28, the information processing system 100 determines whether the amount of hardener M2 added is within a range of a lower limit M2L or more and an upper limit M2U or less. In other words, the control method of the information processing system 100 includes determining whether the acquired amount of hardener M2 is within a predetermined range. If the amount of hardener M2 added in step S28 is not within the range of a lower limit M2L or more and an upper limit M2U or less (step S28: NO), the information processing system 100 determines that the amount of hardener M2 is inappropriate, and continues step S27, which accepts the gesture operation. In other words, the control method of the information processing system 100 includes not proceeding to the measurement process of the next material M even if the gesture GN is acquired when it is determined that the acquired amount of hardener M2 is not within a predetermined range.

[0062] If the amount of the hardener M2 introduced in step S28 is within the range of the lower limit M2L or more and the upper limit M2U or less (step S28: YES), the information processing system 100 starts the measurement process of the diluent M3 (step S30).

[0063] Fig. 15 is a flowchart showing an example of a control procedure executed by the information processing system 100 when performing a weighing process of the diluent M3, and an example of an action procedure executed by the worker WP when performing a weighing process of the diluent M3. Fig. 16 is a diagram showing an example of a blending screen 34b displayed when the diluent M3 is being weighed in the blending management process.

[0064] 15, when the measurement process of the diluent M3 is started, the information processing system 100 displays a dialog box instructing the operator to read the barcode BC of the diluent M3 (step S31) and determines whether the barcode BC has been read (step S32). The dialog box displayed in step S31 is, for example, the same as the dialog box 82 displayed when the measurement process of the main agent M1 is started. When the operator WP reads the barcode BC of the diluent M3 using the reading device 50 (step P31), the information processing system 100 determines whether the information input by reading the barcode BC is appropriate (step S33). In step S33, the information processing system 100 determines whether the material M identified based on the second identification information input by reading the barcode BC is the correct material M for the diluent M3 to be mixed with the main agent M1. In other words, the control method of the information processing system 100 includes determining whether the material M identified based on the second identification information is the correct material M for the diluent M3 to be mixed with the main agent M1. The other processes in step S33 are the same as the other processes in step S13 described above, except that the material M is a diluent M3.

[0065] If it is determined in step S33 that the input information is inappropriate by reading the barcode BC (step S33: NO), the information processing system 100 leaves the dialog instructing the user to read the barcode BC of the diluent M3 displayed and does not start measuring the diluent M3. In other words, the control method of the information processing system 100 includes not acquiring the amount of the diluent M3 when it is determined that the material M identified based on the second identification information is not a correct material as the diluent M3 to be mixed with the main material M1.

[0066] If it is determined in step S33 that the information input by reading the barcode BC is appropriate (step S33: YES), the information processing system 100 acquires and displays various information about the diluent M3 (step S34). In step S34, the information processing system 100 acquires information about the diluent M3 based on the second identification information input by reading the barcode BC. In other words, the control method of the information processing system 100 includes acquiring the second identification information and acquiring information about the diluent M3 based on the second identification information.

[0067] 16, the information about the diluent M3 displayed in step S34 includes the name of the diluent M3, the lot number of the diluent M3, the expiration date of the diluent M3, and the remaining amount of the diluent M3. That is, the control method of the information processing system 100 includes obtaining the remaining amount of the diluent M3 based on the second identification information.

[0068] As shown in FIG. 15, after displaying various pieces of information about the diluent M3, the information processing system 100 calculates and displays upper and lower limit values ​​for the amount of diluent M3 (step S35). In step S35, the information processing system 100 calculates the upper and lower limit values ​​for the amount of diluent M3 based on information about the diluent M3 corresponding to the main agent M1 stored in the storage unit 13. FIG. 17 is a flowchart showing an example of a control procedure executed by the information processing system 100 when calculating and displaying the upper and lower limit values ​​for the amount of diluent M3. As shown in FIG. 17, in step S35, the information processing system 100 acquires the upper and lower limit values ​​for the dilution ratio based on the dilution list 92 and the environmental temperature acquired at the start of blending (step S35a). A dilution list 92 is registered for each main agent M1.

[0069] FIG. 18 is a diagram showing an example of the dilution list 92. As shown in FIG. 18, the dilution list 92 registers a lower limit and an upper limit of the dilution ratio for each environmental temperature. In the example of FIG. 18, the lower limit and the upper limit of the dilution ratio are registered for each of three environmental temperatures: 0°C or higher but lower than 10°C, 10°C or higher but lower than 20°C, and 20°C or higher but lower than 30°C. In step S35a, the information processing system 100 acquires the lower limit and the upper limit of the dilution ratio corresponding to the environmental temperature. In the example of FIG. 18, when the environmental temperature measured by the temperature and humidity sensor 60 at the start of blending is 10°C or higher but lower than 20°C, the lower limit of the dilution ratio is 25% and the upper limit of the dilution ratio is 28%. The dilution ratio is the ratio of the amount of diluent M3 to the amount of main agent M1.

[0070] As shown in FIG. 17, after obtaining the upper and lower limit values ​​of the dilution ratio, the information processing system 100 obtains the mixing ratio of the diluent M3 from the diluent list 93 (step S35b). The mixing ratio of the diluent M3 is the ratio at which multiple types of diluent M3 are mixed when multiple types of diluent M3 are required. A diluent list 93 is registered for each main component M1. FIG. 19 is a diagram showing an example of the diluent list 93. As shown in FIG. 19, the diluent list 93 registers the diluent name and the mixing ratio of the diluent M3. The diluent list 93 shown in the example of FIG. 19 registers two diluents M3, and it is registered that the mixing ratio of each diluent M3 is 1. In this case, the two diluents M3 are mixed at a ratio of 1:1.

[0071] As shown in FIG. 17, after obtaining the mixing ratio of the diluent M3, the information processing system 100 calculates the lower limit of the amount of diluent M3 based on the amount of main agent M1, the lower limit of the dilution rate, and the mixing ratio (step S35c). In step S35c, the information processing system 100 calculates the lower limit of the total amount of diluent M3 to be mixed with the main agent M1 based on the amount of main agent M1 added and the lower limit of the dilution rate, and calculates the proportion of diluent M3 currently being metered at this lower limit of the total amount based on the mixing ratio of the diluents M3. For example, if the amount of main agent M1 is 4.00 kg and the lower limit of the dilution rate is 25%, the total amount of diluent M3 to be mixed with the main agent M1 is 1.00 kg. In this case, for example, if two types of diluent M3 are required and the mixing ratio of the two types of diluent M3 is 1:1, 0.50 kg of each diluent M3 is required. When one type of diluent M3 is required, 1.00 kg of the diluent M3 is required.

[0072] After obtaining the lower limit of the amount of diluent M3, the information processing system 100 calculates the upper limit of the amount of diluent M3 based on the amount of main component M1, the upper limit of the dilution rate, and the mixing ratio (step S35d). Step S35d is the same as step S35c, except that the dilution rate used is the upper limit.

[0073] In this manner, the lower and upper limits of the amount of diluent M3 are calculated, and a predetermined range of the amount of diluent M3 to be dispensed is defined. The predetermined range of the amount of diluent M3 is a range from the lower limit of the amount of diluent M3 to the upper limit of the amount of diluent M3. In this manner, the control method of the information processing system 100 includes defining the predetermined range of the amount of diluent M3 based on the amount of the main agent M1 obtained and the temperature of the environment in which the metering device 40 is placed.

[0074] After calculating the upper limit value for the amount of diluent M3, the information processing system 100 displays the upper and lower limits for the amount of diluent M3 (step S35e). As shown in FIG. 16, the lower limit value M3L of diluent M3 is displayed to the left of the display of the amount of diluent M3 added on the blending screen 34b. The upper limit value M3U of diluent M3 is displayed to the right of the display of the amount of diluent M3 added on the blending screen 34b. On the blending screen 34b, a less-than-equal sign "≦" is displayed between the display of the amount of diluent M3 added and the display of the lower limit value M3L, and between the display of the amount of diluent M3 added and the display of the upper limit value M3U.

[0075] As shown in FIG. 15, after displaying the upper and lower limits of the amount of diluent M3, the information processing system 100 starts measuring the diluent M3 (step S36). That is, the control method of the information processing system 100 includes acquiring the amount of diluent M3 when it is determined that the material M identified based on the second identification information is the correct material M for the diluent M3 to be mixed with the main agent M1. The worker WP pours an amount of diluent M3 into the measuring container 41 that is equal to or greater than the lower limit M3L and equal to or less than the upper limit M3U displayed on the blending screen 34b (step P32). As shown in FIG. 16, in step S36, the information processing system 100 acquires the amount of diluent M3 poured into the measuring container 41, i.e., the pouring amount, using the weighing device 40 and displays it on the blending screen 34b. In step S36, the information processing system 100 subtracts the weight of the measuring container 41 and the total weight of the material M charged into the measuring container 41 from the weight obtained based on the measuring device 40 to obtain the amount of diluent M3 charged, and displays this on the blending screen 34b. When the main agent M1 and the hardener M2 are charged into the measuring container 41, the total weight of the material M charged into the measuring container 41 is the sum of the weight of the main agent M1 and the weight of the hardener M2.

[0076] In the example of FIG. 16, the amount of diluent M3 added is 0.65 kg. The information processing system 100 updates the display of the acquired amount of diluent M3 in real time and displays it on the formulation screen 34b. The information processing system 100 updates the display of the remaining amount of diluent M3 displayed on the formulation screen 34b according to the acquired amount of diluent M3. The information processing system 100 displays the amount of diluent M3 used for the lot from which the barcode BC was read next to the display of the remaining amount of diluent M3 for that lot. When only one lot of diluent M3 is used, the amount of diluent M3 used is the same as the amount of diluent M3 added to the measuring container 41.

[0077] 15, when the measurement of diluent M3 is started, the information processing system 100 determines whether or not a specific operation has been input by the worker WP (step S37). The worker WP performs a gesture operation when the addition of diluent M3 for the lot for which the barcode BC has been read is completed (step P33). There are three gestures that the information processing system 100 can accept in step S37: gesture GP, gesture (second gesture) GN, and gesture (third gesture) GR.

[0078] In step S37, the gesture GP is a gesture for performing the "dialog display" operation. If it is determined in step S37 that the operator WP has performed the gesture GP (step S37: "dialog display"), the information processing system 100 performs step S31 again and displays again the dialog instructing the operator to read the barcode BC of the diluent M3. The information processing system 100 then performs steps S32 to S36 again as described above. If the amount of diluent M3 to be poured into the measuring container 41 is insufficient with only one lot of diluent M3, the operator WP performs the gesture GP to display the dialog in order to read another lot of diluent M3. After the dialog is displayed, the operator WP reads the barcode BC of the other lot of diluent M3 using the reader 50 and pours the other lot of diluent M3 into the measuring container 41. When two or more lots of diluent M3 are used, information about the plurality of diluents M3 is displayed side by side on the compounding screen 34b, similar to the example in the case of the main agent M1 shown in FIG.

[0079] In step S37, the gesture GR is a gesture for performing a "back" operation. In step S37, the gesture GR corresponds to the third gesture. If it is determined in step S37 that the worker WP has performed the gesture GR (step S37: "back"), the information processing system 100 performs the measurement process of the main agent M1 again (step S10). In other words, the control method of the information processing system 100 includes acquiring the amount of the main agent M1 when the gesture GR as the third gesture is acquired after acquiring the amount of the diluent M3. For example, if the worker WP has accidentally poured more diluent M3 than the upper limit value M3U into the measuring container 41, the worker WP can perform the gesture GR to return to measuring the main agent M1 and add additional main agent M1 to the measuring container 41. The processing of the information processing system 100 after returning to the measurement of the main agent M1 is the same as the processing from step S10 onwards described above.

[0080] If it is determined in step S37 that the worker WP has performed the gesture GR, the information processing system 100 may return to the weighing process of the previous material M. In this case, if the weighing process of the main agent M1 was performed before the weighing process of the diluent M3 currently being measured, the information processing system 100 returns to the weighing process of the main agent M1. Also, in this case, if the weighing process of the hardener M2 was performed before the weighing process of the diluent M3 currently being measured, the information processing system 100 returns to the weighing process of the hardener M2. Also, in this case, if the weighing process of another diluent M3 was performed before the weighing process of the diluent M3 currently being measured, the information processing system 100 returns to the weighing process of the other diluent M3.

[0081] The gesture GN in step S37 is a gesture for performing a "next" operation. If it is determined in step S37 that the worker WP has performed the gesture GN (step S37: "next"), the information processing system 100 determines whether the amount of diluent M3 is appropriate (step S38). In step S38, the information processing system 100 determines whether the amount of diluent M3 added is equal to or greater than the lower limit M3L and equal to or less than the upper limit M3U. In other words, the control method of the information processing system 100 includes determining whether the acquired amount of diluent M3 is within a predetermined range. If the amount of diluent M3 added in step S38 is not equal to or greater than the lower limit M3L and equal to or less than the upper limit M3U (step S38: NO), the information processing system 100 determines that the amount of diluent M3 is inappropriate and continues step S37, which accepts the gesture operation.

[0082] If the amount of diluent M3 added in step S38 is within the range of the lower limit M3L to the upper limit M3U (step S38: YES), the information processing system 100 determines whether the metering process for all diluents M3 has been completed (step S39). If multiple types of diluents M3 are required in step S39 and the metering process for all types of diluents M3 has not yet been completed (step S39: NO), the information processing system 100 returns to step S31 and starts the metering process for the next diluent M3.

[0083] In step S39, if all diluents M3 have been measured, including cases where only one type of diluent M3 is required (step S39: YES), the information processing system 100 displays the blending result 39 (step S40). That is, the control method of the information processing system 100 includes: acquiring a gesture performed by the worker WP using the image capture device 70 after acquiring the amount of diluent M3; and outputting the blending result 39 if the gesture acquired after acquiring the amount of diluent M3 is the gesture GN. When the main agent M1 is a one-component paint, the blending result 39 is the blending result of the main agent M1, which is the first material, and the diluent M3, which is the second material. When the main agent M1 is a two-component paint, the blending result 39 is the blending result of the main agent M1, which is the first material, the hardener M2, which is the second material, and the diluent M3, which is the second material. The gesture GN in step S37 when measuring the last diluent M3 corresponds to the second gesture.

[0084] Even if the operator WP performs the gesture GN in step S37 when measuring the last amount of diluent M3, if it is determined in step S38 that the amount of diluent M3 is inappropriate, as described above, the blending result 39 will not be displayed. That is, the control method of the information processing system 100 includes not outputting the blending result 39 even if the gesture GN is acquired as the second gesture when it is determined that the acquired amount of diluent M3 is not within the predetermined range. The control method of the information processing system 100 also includes not proceeding to the measurement process of the next diluent M3 or the display process of the blending result 39 even if the gesture GN is acquired when it is determined that the acquired amount of diluent M3 is not within the predetermined range.

[0085] Fig. 20 is a diagram showing an example of the formulation screen 34b displaying a formulation result 39 of the formulation management process. As shown in Fig. 20, the formulation result 39 includes the name of each formulated material M, the amount of each material M placed in the measuring container 41, and the total amount of the formulated materials M. The example in Fig. 20 shows the formulation result 39 for a case where the main material M1 is a two-component paint and two types of diluent M3 are required.

[0086] 21 is a flowchart showing an example of a control procedure executed by the information processing system 100 after the formulation result 39 is displayed in the formulation management process, and an example of an action procedure performed by the worker WP after the formulation result 39 is displayed. As shown in FIG. 21, after displaying the formulation result 39, the information processing system 100 determines whether or not a specific operation input has been made by the worker WP (step S41). After checking the formulation result 39, the worker WP performs a gesture operation (step P41). In step S41, there are two gestures that the information processing system 100 can accept: gesture GK and gesture GR.

[0087] In step S41, the gesture GR is a gesture for performing a "back" operation. If it is determined in step S41 that the worker WP has performed the gesture GR (step S41: "back"), the information processing system 100 performs the weighing process of the main agent M1 again (step S10). For example, if the worker WP checks the blending result 39 and wants to increase the amount of blended material M, the worker WP can perform the gesture GR to add additional main agent M1, thereby increasing the amount of blended material M. Note that, similar to step S37, if it is determined in step S41 that the worker WP has performed the gesture GR, the information processing system 100 may return to the weighing process of the previous material M.

[0088] In step S41, the gesture GK is a gesture for performing the "mixing complete" operation. If it is determined in step S41 that the worker WP has performed the gesture GK (step S41: "mixing complete"), the information processing system 100 updates the inventory amount of the used material M (step S42). In step S42, the information processing system 100 updates each inventory amount stored in the storage unit 13 by subtracting the amount of each material M poured into the measuring container 41 from the inventory amount of each material M stored in the storage unit 13. In other words, the control method of the information processing system 100 includes updating the remaining amount of main agent M1 based on the acquired amount of main agent M1, updating the remaining amount of curing agent M2 based on the acquired amount of curing agent M2, and updating the remaining amount of diluent M3 based on the acquired amount of diluent M3.

[0089] This completes one round of the formulation management process and one round of formulation. After completing one round of the formulation management process, the information processing system 100 may return to step Sa and start the next round of formulation management process.

[0090] Although the functions of the information processing system 100 described above are realized by executing a program, i.e., software, stored in the first server 10 as a control device, the functions are not limited to this. At least some of the functions of the information processing system 100 described above may be realized by hardware including circuitry such as an LSI (Large Scale Integration), an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), and a GPU (Graphics Processing Unit), or may be realized by a combination of software and hardware.

[0091] Each process in the information processing system 100 may be executed by any device installed in any location. The first server 10 may be installed in a location similar to where the worker WP performs work. The functions of the first server 10 may be installed in the second server 20 or the operation terminal 30. For example, the above-mentioned application program may be installed in the second control unit 31 of the operation terminal 30, and the second control unit 31 may execute the same processes as the first control unit 11 described above. The functions of the second server 20 may be installed in the operation terminal 30. The first server 10, the second server 20, and the operation terminal 30 may be integrated into a single terminal, which may be configured as a control device that controls the information processing system 100.

[0092] According to this embodiment, a control method for an information processing system 100 including a weighing device 40 for weighing the amount of material M and an imaging device 70 for capturing an image of a worker WP (subject) includes the steps of: acquiring the amount of main agent M1 (first material); acquiring a gesture performed by the worker WP after acquiring the amount of main agent M1; and, if it is determined that the gesture acquired after acquiring the amount of main agent M1 is gesture GN (first gesture), acquiring the amount of hardener M2 (second material) or diluent M3 (second material). Therefore, the worker WP can proceed with the processing of the information processing system 100 to measure the next material M by performing a gesture operation without touching the information processing system 100 with their hands. This eliminates the need for the worker WP to remove their gloves WG and operate the information processing system 100 with their hands before weighing the next material M. This prevents a decrease in work efficiency when the worker WP uses the information processing system 100 to measure multiple materials M.

[0093] Furthermore, according to this embodiment, the control method of the first server 10 (control device) includes acquiring the amount of main agent M1 (first material), determining whether or not a gesture has been input by the worker WP (subject) after acquiring the amount of main agent M1, and acquiring the amount of hardener (second material) M2 or diluent (second material) M3 if it is determined that a gesture has been input. This control method, like the control method of the information processing system 100 described above, can also prevent a decrease in work efficiency when the worker WP measures multiple materials M.

[0094] Furthermore, the method of this embodiment, which has been described using the control method of the information processing system 100 as an example, includes acquiring the amount of main agent (first material) M1 by the weighing device 40, acquiring a gesture made by the worker (subject) WP by the imaging device 70 after acquiring the amount of main agent M1, and acquiring the amount of hardener (second material) M2 or diluent (second material) M3 by the weighing device 40 after acquiring the gesture. This method, like the control method and information processing system 100 described above, can also prevent a decrease in work efficiency when the worker WP weighs multiple materials M.

[0095] Furthermore, according to this embodiment, the information processing system 100 includes an imaging device 70, a weighing device 40, and a first server 10 (control device) that controls the imaging device 70 and the weighing device 40. The first server 10 is capable of acquiring the amount of main agent M1 (first material) using the weighing device 40, acquiring a gesture made by a worker WP (subject) using the imaging device 70 after acquiring the amount of main agent M1, and acquiring the amount of curing agent M2 (second material) or diluent M3 (second material) using the weighing device 40 after acquiring the gesture. Therefore, similar to the control method of the information processing system 100 described above, it is possible to prevent a decrease in work efficiency when the worker WP weighs multiple materials M.

[0096] The program of this embodiment executes the control method described above. The program of this embodiment is an application program for blending management processing stored in the first server 10. By installing this program in the first server 10, the information processing system 100 can execute the control method described above, thereby preventing a decrease in work efficiency when the worker WP weighs multiple ingredients M using the information processing system 100. Furthermore, since the first server 10 on which the program is installed is prepared in advance in a location separate from the location where the worker WP weighs multiple ingredients M, the worker WP can easily use the information processing system 100 by simply preparing the weighing device 40, the reading device 50, the temperature and humidity sensor 60, the imaging device 70, and a terminal that can access the first server 10 and view the processing screen executed by the first server 10.

[0097] Furthermore, according to this embodiment, the control method of the information processing system 100 includes acquiring a gesture performed by a worker WP (subject) after acquiring the amount of diluent M3 (second material), and outputting a blending result 39 of the main agent M1 and the diluent M3 when it is determined that the gesture acquired after acquiring the amount of diluent M3 is a gesture GN (second gesture). Therefore, the worker WP can check the blending result 39 of the material M by performing a gesture operation without touching the information processing system 100 with his or her hand. This allows the worker WP to check the blending result 39 without removing the gloves WG. Therefore, if the worker WP continues blending after checking the blending result 39, there is no need to put the gloves WG back on. This prevents a decrease in the work efficiency of the worker WP when blending the material M.

[0098] Furthermore, according to this embodiment, the control method of the information processing system 100 includes acquiring the amount of the main agent M1 (first material) when it is determined that the gesture acquired after acquiring the amount of the hardener M2 (second material) or the diluent M3 (second material) is a gesture GR (third gesture) different from the gesture GN. Therefore, even if the worker WP accidentally increases the amount of the hardener M2 or the diluent M3 when measuring the hardener M2 or the diluent M3, the worker WP can return the processing of the information processing system 100 to measuring the main agent M1 by performing a gesture operation without touching the information processing system 100 with his or her hand. This further reduces a decrease in work efficiency when the worker WP uses the information processing system 100 to measure multiple materials M.

[0099] Furthermore, according to this embodiment, the control method of the information processing system 100 includes determining whether the acquired amount of diluent M3 (second material) is within a predetermined range, and if it is determined that the acquired amount of diluent M3 is not within the predetermined range, not outputting the blending result 39 even if a gesture GN (second gesture) is acquired after the amount of diluent M3 is acquired. This prevents the blending result 39 from being displayed with an incorrect amount of diluent M3 mixed with the main material M1. This prevents multiple materials M from being blended in incorrect amounts.

[0100] Furthermore, according to this embodiment, the control method of the information processing system 100 includes defining the predetermined range based on the acquired amount of the main agent M1 (first material). Therefore, an appropriate amount of the diluent M3 can be defined as the predetermined range according to the measured amount of the main agent M1. This further prevents multiple materials M from being mixed in incorrect amounts.

[0101] Furthermore, according to this embodiment, the control method of the information processing system 100 includes defining the predetermined range based on the temperature of the environment in which the metering device 40 is placed. Therefore, the amount of diluent M3 to be mixed with the main agent M1 can be appropriately set within the predetermined range according to the temperature of the environment. This allows the multiple ingredients M to be mixed in more appropriate amounts.

[0102] Furthermore, according to this embodiment, the control method of the information processing system 100 includes acquiring first identification information, acquiring information about the main agent M1 (first material) based on the first identification information, acquiring second identification information, and acquiring information about the curing agent M2 (second material) or the diluent M3 (second material) based on the second identification information. Therefore, each material M can be identified according to the acquired identification information.

[0103] Furthermore, according to this embodiment, the control method of the information processing system 100 includes acquiring the remaining amount of main agent M1 (first material) based on the first identification information, acquiring the remaining amount of curing agent M2 (second material) or diluent M3 (second material) based on the second identification information, updating the remaining amount of main agent M1 based on the acquired amount of main agent M1, and updating the remaining amount of curing agent M2 or diluent M3 based on the acquired amount of curing agent M2 or diluent M3. Therefore, the remaining amount of each material M can be updated based on the measured amount of each material M, and the inventory amount of each material M can be automatically and appropriately managed.

[0104] Furthermore, according to this embodiment, the control method of the information processing system 100 includes determining whether the material M identified based on the first identification information is the correct material for the main agent M1 (first material), acquiring the amount of the main agent M1 when it is determined that the material M identified based on the first identification information is the correct material for the main agent M1, and not acquiring the amount of the main agent M1 when it is determined that the material M identified based on the first identification information is not the correct material M for the main agent M1. Therefore, even if the worker WP mistakenly attempts to measure a material M other than the main agent M1, it is possible to prevent the wrong material M from being measured.

[0105] Furthermore, according to this embodiment, the control method of the information processing system 100 includes determining whether the material M identified based on the second identification information is the correct material for the curing agent M2 (second material) or the diluent M3 (second material) to be mixed with the main agent M1 (first material), acquiring the amount of the curing agent M2 or the amount of the diluent M3 when it is determined that the material M identified based on the second identification information is the correct material for the curing agent M2 or the diluent M3 to be mixed with the main agent M1, and not acquiring the amount of the curing agent M2 or the diluent M3 when it is determined that the material M identified based on the second identification information is not the correct material for the curing agent M2 or the diluent M3 to be mixed with the main agent M1. Therefore, even if the worker WP mistakenly attempts to measure a material M different from the material M to be mixed with the main agent M1, it is possible to prevent the incorrect material M from being measured and the incorrect material M from being mixed with the main agent M1.

[0106] The embodiments of the present disclosure are not limited to the above-described embodiments, and the following configurations and methods may also be employed. The information processing system according to the present disclosure may be used for any task, as long as it is a system used for a task including measuring multiple materials M. The information processing system may be used, for example, for a task in which multiple materials M are sequentially measured and placed in separate locations without being mixed. An example of such a task is a task in which multiple materials M that must be mixed and used immediately are measured, and the mixed materials M are not used immediately, by placing the multiple materials M into separate containers to prevent them from mixing. The first material and the second material may each be any material. The first material and the second material may be the same material. For example, the first material may be a powder paint that can be used for painting without mixing, and the second material may be a detergent used to clean tools, or the first material may be the detergent and the second material may be the powder paint. The gesture performed by the subject to perform an operation may be any type of gesture. In the above-described embodiment, the first gesture and the second gesture are the same gesture, but this is not limited to this. The first gesture and the second gesture may be different gestures. Furthermore, the configurations and methods described in this specification can be appropriately combined within a range that does not contradict each other.

[0107] Summary of this disclosure A summary of this disclosure is provided below.

[0108] (Appendix 1) A control method for an information processing system including a measuring device that measures an amount of an ingredient and an imaging device that images a subject, Obtaining a quantity of a first ingredient; acquiring a gesture made by the subject after acquiring the amount of the first ingredient; acquiring an amount of a second ingredient when it is determined that the gesture acquired after acquiring the amount of the first ingredient is a first gesture; A control method comprising:

[0109] According to this method, the subject can proceed with the processing of the information processing system to measure the next ingredient by performing a gesture operation without touching the information processing system with their hands. This eliminates the need for the subject to remove their gloves and operate the information processing system with their hands before measuring the next ingredient. Therefore, it is possible to prevent a decrease in work efficiency when the subject uses the information processing system to measure multiple ingredients.

[0110] (Appendix 2) acquiring a gesture made by the subject after acquiring the amount of the second ingredient; outputting a blending result of the first ingredient and the second ingredient when it is determined that the gesture acquired after acquiring the amount of the second ingredient is the second gesture; 2. The control method of claim 1, comprising:

[0111] According to this method, the subject can check the compounding results of ingredients by performing gesture operations without touching the information processing system with their hands. This allows the subject to check the compounding results without removing their gloves, and if they continue compounding after checking the compounding results, they do not have to go through the trouble of putting their gloves back on. This prevents a decrease in the subject's work efficiency when compounding ingredients.

[0112] (Appendix 3) The control method described in Appendix 2 includes obtaining the amount of the first ingredient when it is determined that the gesture obtained after obtaining the amount of the second ingredient is a third gesture different from the second gesture.

[0113] According to this method, even if the subject accidentally uses too much of the second ingredient when measuring the second ingredient, the subject can return the information processing system to measuring the first ingredient by performing a gesture operation without touching the information processing system with his or her hand. This further prevents a decrease in work efficiency when the subject uses the information processing system to measure multiple ingredients.

[0114] (Appendix 4) determining whether the amount of the second material obtained is within a predetermined range; when it is determined that the acquired amount of the second ingredient is not within the predetermined amount range, the blending result is not output even if the second gesture is acquired after the amount of the second ingredient is acquired. 4. The control method of claim 2 or 3, comprising:

[0115] This method prevents the display of a blending result with an incorrect amount of the second ingredient mixed with the first ingredient, thereby preventing multiple ingredients from being blended in incorrect amounts.

[0116] (Appendix 5) The control method of claim 4, further comprising defining the predetermined range based on the amount of the first material obtained.

[0117] This method allows the appropriate amount of the second ingredient to be determined within the predetermined range according to the measured amount of the first ingredient, thereby further preventing the mixing of multiple ingredients in incorrect amounts.

[0118] (Appendix 6) 6. The control method of claim 4 or 5, further comprising defining the predetermined range based on a temperature of an environment in which the metering device is placed.

[0119] According to this method, the amount of the second material mixed with the first material can be appropriately set within the above-mentioned predetermined range according to the environmental temperature, thereby allowing multiple materials to be mixed in more appropriate amounts.

[0120] (Appendix 7) Obtaining first identification information; obtaining information about the first material based on the first identification information; Obtaining second identification information; obtaining information about the second material based on the second identification information; 7. The control method according to any one of claims 1 to 6, comprising:

[0121] According to this method, each material can be identified according to the acquired identification information.

[0122] (Appendix 8) obtaining a remaining amount of the first material based on the first identification information; obtaining a remaining amount of the second material based on the second identification information; updating the remaining amount of the first ingredient based on the acquired amount of the first ingredient; updating the remaining amount of the second ingredient based on the acquired amount of the second ingredient; 8. The control method of claim 7, comprising:

[0123] According to this method, the remaining amount of each ingredient can be updated based on the measured amount of each ingredient, and the inventory amount of each ingredient can be managed automatically and appropriately.

[0124] (Appendix 9) determining whether the material identified based on the first identification information is a correct material as the first material; acquiring an amount of the first ingredient when it is determined that the ingredient identified based on the first identification information is a correct ingredient as the first ingredient; not acquiring the amount of the first ingredient when it is determined that the ingredient identified based on the first identification information is not a correct ingredient as the first ingredient; 9. The control method of claim 7 or 8, comprising:

[0125] According to this method, even if the subject tries to measure an ingredient other than the first ingredient by mistake, it is possible to prevent the wrong ingredient from being measured.

[0126] (Appendix 10) determining whether the material identified based on the second identification information is a correct material as the second material to be mixed with the first material; acquiring an amount of the second ingredient when it is determined that the ingredient identified based on the second identification information is a correct ingredient to be mixed with the first ingredient; not acquiring the amount of the second ingredient when it is determined that the ingredient identified based on the second identification information is not a correct ingredient as the second ingredient to be mixed with the first ingredient; 10. The control method according to any one of Supplementary Note 7 to Supplementary Note 9, comprising:

[0127] According to this method, even if the subject mistakenly attempts to measure an ingredient different from the ingredient to be mixed into the first ingredient, it is possible to prevent the wrong ingredient from being measured and the wrong ingredient from being mixed into the first ingredient.

[0128] (Appendix 11) A control method for a control device, comprising: Obtaining a quantity of a first ingredient; After obtaining the amount of the first ingredient, determining whether a gesture has been input by the subject; acquiring an amount of the second ingredient when it is determined that the gesture has been input; A control method comprising:

[0129] According to this method, similar to the above-described method for controlling an information processing system, it is possible to prevent a decrease in work efficiency when the subject measures multiple ingredients.

[0130] (Appendix 12) obtaining a quantity of a first ingredient by a metering device; After acquiring the amount of the first material, capturing a gesture made by the subject with an image capturing device; acquiring a quantity of a second ingredient by the metering device after acquiring the gesture; A method comprising:

[0131] According to this method, similar to the above-described method for controlling an information processing system, it is possible to prevent a decrease in work efficiency when the subject measures multiple ingredients.

[0132] (Appendix 13) An imaging device; a weighing device; a control device that controls the imaging device and the weighing device; Equipped with The control device obtaining a quantity of a first ingredient by the metering device; capturing a gesture made by the subject with the imaging device after capturing the amount of the first ingredient; acquiring a quantity of a second ingredient by the metering device after acquiring the gesture; An information processing system capable of executing the above.

[0133] According to this configuration, similar to the control method of the information processing system described above, it is possible to prevent a decrease in work efficiency when the subject uses the information processing system to measure multiple ingredients.

[0134] (Appendix 14) A program for executing the control method according to any one of Supplementary Note 1 to Supplementary Note 11.

[0135] By executing this program on a computer, the information processing system can be made to execute the above-mentioned control method, thereby preventing a decrease in work efficiency when the subject uses the information processing system to measure multiple ingredients. [Explanation of symbols]

[0136] 10...first server (control device), 39...mixing result, 40...measuring device, 70...imaging device, 100...information processing system, GK, GP...gesture, GN...gesture (first gesture, second gesture), GR...gesture (third gesture), M...material, M1...main agent (first material), M2...hardener (second material), M3...diluent (second material), WP...worker (target person)

Claims

1. A control method for an information processing system including a measuring device that measures an amount of an ingredient and an imaging device that images a subject, obtaining a quantity of a first ingredient; acquiring a gesture performed by the subject after acquiring the amount of the first ingredient; acquiring an amount of a second ingredient when it is determined that the gesture acquired after acquiring the amount of the first ingredient is a first gesture; A control method comprising:

2. acquiring a gesture performed by the subject after acquiring the amount of the second ingredient; outputting a blending result of the first ingredient and the second ingredient when it is determined that the gesture acquired after acquiring the amount of the second ingredient is the second gesture; The control method of claim 1 , comprising:

3. The control method according to claim 2, further comprising obtaining the amount of the first ingredient when it is determined that a gesture obtained after obtaining the amount of the second ingredient is a third gesture different from the second gesture.

4. determining whether the amount of the second material obtained is within a predetermined range; when it is determined that the acquired amount of the second ingredient is not within the predetermined amount range, the blending result is not output even if the second gesture is acquired after the amount of the second ingredient is acquired. The control method of claim 2 , comprising:

5. The control method according to claim 4 , further comprising defining the predetermined range based on the amount of the first material obtained.

6. The control method according to claim 5 , further comprising defining the predetermined range based on a temperature of an environment in which the metering device is placed.

7. Obtaining first identification information; obtaining information about the first material based on the first identification information; Obtaining second identification information; obtaining information about the second material based on the second identification information; The control method of claim 1 , comprising:

8. acquiring a remaining amount of the first material based on the first identification information; acquiring a remaining amount of the second material based on the second identification information; updating the remaining amount of the first ingredient based on the acquired amount of the first ingredient; updating the remaining amount of the second ingredient based on the acquired amount of the second ingredient; The control method of claim 7, comprising:

9. determining whether the material identified based on the first identification information is a correct material as the first material; acquiring an amount of the first ingredient when it is determined that the ingredient identified based on the first identification information is the correct ingredient as the first ingredient; not acquiring the amount of the first ingredient when it is determined that the ingredient identified based on the first identification information is not a correct ingredient as the first ingredient; The control method of claim 7, comprising:

10. determining whether the material identified based on the second identification information is a correct material as the second material to be mixed with the first material; acquiring an amount of the second material when it is determined that the material identified based on the second identification information is a correct material as the second material to be mixed with the first material; not acquiring the amount of the second material when it is determined that the material identified based on the second identification information is not a correct material as the second material to be mixed with the first material; The control method according to any one of claims 7 to 9, comprising:

11. A control method for a control device, comprising: obtaining a quantity of a first ingredient; determining whether a gesture has been input by the subject after obtaining the amount of the first ingredient; acquiring an amount of the second ingredient when it is determined that the gesture has been input; A control method comprising:

12. obtaining a quantity of a first ingredient by a metering device; After acquiring the amount of the first ingredient, capturing a gesture made by the subject with a camera; acquiring a quantity of a second ingredient by the metering device after acquiring the gesture; A method comprising:

13. An imaging device; a weighing device; a control device that controls the imaging device and the weighing device; Equipped with The control device obtaining a quantity of a first ingredient by the metering device; capturing a gesture made by the subject with the imaging device after capturing the amount of the first ingredient; acquiring a quantity of a second ingredient by the metering device after acquiring the gesture; An information processing system capable of executing the above.

14. A program that executes the control method according to any one of claims 1 to 9 and 11.

Images