Paint usage management system, paint usage management method, and program

Abstract

A paint usage management system, a paint usage management method, and a program are provided that can accurately estimate the amount of paint used. [Solution] The cloud server 1 is equipped with a usage estimation unit 112 that estimates the usage amount of at least one type of paint using a paint usage estimation model from painting method type information, information on the area of ​​the area to be painted, and blending ratio information; a weight detection unit 4 that detects the weight of each paint storage container in which paint is stored; an actual usage calculation unit 114 that calculates the actual usage amount of paint as a differential weight equivalent to the difference in weight before and after the user removes the paint required to paint the area to be painted from the paint storage container; and a model update unit 115 that updates the paint usage estimation model using past painting method type information, information on the area of ​​the area to be painted, blending ratio information, and actual usage information.

Description

Technical Field

[0001] The present invention relates to a paint usage management system, a paint usage management method, and a program.

Background Art

[0002] There has been proposed an ordering system including a weighing scale configured to transmit weight data obtained by measuring the weight of a measurement object to the outside, and an ordering device configured to acquire the weight data transmitted by the weighing scale, and the ordering device executes processing related to ordering of the measurement object based on the weight data (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] By the way, for example, in the painting of an automobile body, the painting method of the painting target part and the blending amount of the paint used for painting are determined in advance, and at least one type of paint required for painting is estimated from the area of the painting target part and the position of the painting target part in the entire painting target object. However, the amount of paint used per unit area of the painting target part varies among multiple painting contractors, and even when painting target parts of the same area are painted by the same painting method, it often varies depending on the painting contractor. Therefore, when trying to appropriately manage the paint inventory based on the weight data of the cans filled with paint using an ordering system as described in Patent Document 1, for example, it is necessary to separately set a weight standard for each painting contractor as a reference for accurately grasping the amount of paint used by the painting contractor and placing an order.

[0005] This invention has been made in view of the above reasons, and aims to provide a paint usage management system, a paint usage management method, and a program that can accurately estimate the amount of paint used. [Means for solving the problem]

[0006] To achieve the above objective, the paint usage management system according to the present invention is Painting method type information indicating the type of painting method for the area to be painted, painting area area information indicating the area of ​​the area to be painted, and mixing ratio information of the paint used for painting the area to be painted. Painting condition information that shows the conditions under which painting is performed. A paint usage estimation unit estimates the amount of at least one type of paint to be used, using a paint usage estimation model for estimating the amount of each of at least one type of paint required for painting the area to be painted. A weight detection unit that detects the weight of each of the multiple paint storage containers containing paint, An actual usage amount calculation unit calculates the difference in weight, which corresponds to the difference in weight detected by the weight detection unit of at least one paint storage container before and after the paint necessary for painting the area to be painted is taken out of at least one of the plurality of paint storage containers, as the actual amount of paint used. Information on the type of painting method used when the aforementioned part to be painted was painted in the past, information on the area of ​​the part to be painted, information on the mixing ratio, and information on the actual amount used, Painting condition information that indicates the conditions under which painting is to be performed, The system includes a model update unit that updates the paint usage estimation model using the following: The aforementioned paint usage estimation model is a neural network. . [Effects of the Invention]

[0007] According to the present invention, the usage amount estimation unit estimates the usage amount of at least one type of paint required for painting a target area, using a paint usage amount estimation model that estimates the usage amount of at least one type of paint required for painting a target area, based on painting method type information, painting target area information, and mixing ratio information. The model update unit updates the paint usage amount estimation model using painting method type information, painting target area information, mixing ratio information, and actual usage amount information from when the target area was painted in the past. As a result, the amount of paint to be used for painting the target area that the user intends to paint is estimated using a paint usage amount estimation model that has been successively updated according to the user's paint usage history, so that the amount of paint used can be accurately estimated for each user. [Brief explanation of the drawing]

[0008] [Figure 1] This figure shows an example of the configuration of a paint usage management system according to an embodiment of the present invention. [Figure 2] This is a block diagram showing the hardware configuration of a terminal device and a cloud server according to an embodiment. [Figure 3] This is a block diagram showing the functional configuration of the terminal device and cloud server according to the embodiment. [Figure 4] This figure shows an example of the information stored by the usage history storage unit according to the embodiment. [Figure 5] This is an explanatory diagram of the neural network used in the cloud server according to the embodiment. [Figure 6] This is a sequence diagram illustrating the operation of the paint usage management system according to the embodiment. [Figure 7] This is a sequence diagram illustrating the operation of the paint usage management system according to the embodiment. [Figure 8] This flowchart shows an example of the flow of terminal control processing performed by the terminal device according to the embodiment. [Figure 9] This flowchart shows an example of the paint usage management process performed by the cloud server according to the embodiment. [Figure 10]This flowchart shows an example of the paint usage management process performed by the cloud server according to the embodiment. [Modes for carrying out the invention]

[0009] Hereinafter, a paint usage management system according to an embodiment of the present invention will be described with reference to the drawings. The paint usage management system according to this embodiment comprises a usage estimation unit, a weight detection unit, an actual usage calculation unit, and a model update unit. The usage estimation unit estimates the usage of at least one type of paint using a paint usage estimation model for estimating the usage of at least one type of paint necessary for painting a target area, based on painting method type information indicating the type of painting method for the target area, painting target area information indicating the area of ​​the target area within the target area, and mixing ratio information of the paints used for painting the target area. The weight detection unit detects the weight of each of the multiple paint storage containers that store the paint. The actual usage calculation unit calculates the actual paint usage as the difference weight corresponding to the difference in weight of at least one paint storage container before and after the paint necessary for painting the target area is taken out of at least one of the multiple paint storage containers. The model update unit updates the paint usage estimation model using information on the type of painting method used when the target area was painted in the past, information on the area of ​​the target area, information on the mixing ratio, and information on the actual amount of paint used.

[0010] The paint storage management system according to this embodiment, as shown in Figure 1, comprises a weight detection unit 4 that detects the weight of each of the multiple paint storage containers CA in which paints stored by a painting contractor, a terminal device 3 owned by the painting contractor, and a cloud server 1. The weight detection unit 4 is connected to a local network NW2 constructed at the storage location of the paint storage containers CA managed by the painting contractor, and can communicate with the cloud server 1 via a router 8 and a wide-area network NW1 connected to the local network NW2. The terminal device 3 and the terminal device 9 owned by the paint supplier can communicate with the cloud server 1 via the wide-area network NW1. Here, the wide-area network NW1 is, for example, the Internet. The local network NW2 is, for example, a wireless LAN (Local Area Network). The terminal device 9 is, for example, a personal computer and is equipped with a display unit. When it receives order information, which indicates the order details when a painting contractor orders paint, transmitted from the cloud server 1, it forms an order content notification image based on the acquired order information and displays it on the display unit to notify the paint supplier of the order details.

[0011] The terminal device 3 is, for example, a smartphone, and as shown in Figure 2, comprises a CPU 301, a main memory unit 302, an auxiliary memory unit 303, a display unit 304, an input unit 305, a communication unit 306, an imaging unit 307, and a bus 309 connecting these to each other. The main memory unit 302 has volatile memory such as RAM and is used as a workspace for the CPU 301. The main memory unit 302 also has an image-dedicated memory (not shown) that temporarily stores image information to be displayed on the display unit 304. The auxiliary memory unit 303 is a non-volatile memory such as semiconductor flash memory and stores programs for the CPU 301 to execute various processes. The display unit 504 is a display device such as a liquid crystal display or an organic EL (Electro-Luminescence) display. The input unit 305 is, for example, a transparent touchpad placed on top of the display unit 304. The communication unit 306 is connected to the wide area network NW1 and transmits information transferred from the CPU 301 to the cloud server 1 via the wide area network NW1, and also transfers various information acquired from the cloud server 1 via the wide area network NW1 to the CPU 301.

[0012] The imaging unit 307 includes a camera and a DMA (Direct Memory Access) controller. After startup, the DMA controller transfers photographic image information obtained by the camera to a dedicated image memory. Furthermore, when the imaging unit 307 receives control information corresponding to the imaging command information described later from the CPU 301, it generates image information indicating the photograph taken at the time the control information was transferred and notifies the CPU 301.

[0013] The CPU 301 functions as a reception unit 311, an image forming unit 312, a display control unit 313, an imaging control unit 314, a painting content information generation unit 315, a painting content information transmission unit 316, an estimated usage amount acquisition unit 317, a remaining amount status acquisition unit 318, an order request unit 319, and a registration notification unit 320, as shown in FIG. 3, by reading out and executing the program stored in the auxiliary storage unit 303 into the main storage unit 302. Further, the image dedicated memory of the main storage unit 302 shown in FIG. 2 has a display image storage unit 321 that temporarily stores the screen image to be displayed on the display unit 304.

[0014] The reception unit 311 receives the operation performed by the painting contractor using the terminal device 3 on the input unit 305, generates operation information corresponding to the received operation, and notifies the imaging control unit 314, the painting content information generation unit 315, the order request unit 319, or the registration notification unit 320. Specifically, when the reception unit 311 receives a painting target area input operation from the painting contractor on the input unit 305, in which the area of ​​the part of the object to be painted is entered, it generates operation information including the painting target area information and notifies the painting content information generation unit 315. Note that this painting target area is determined, for example, when repairing a damaged part of an automobile by painting, based on the area of ​​the part that needs to be painted after the damaged part has been repaired. Furthermore, when the reception unit 311 receives an imaging preparation operation or imaging operation from the painting contractor on the input unit 305 to capture an identification code, it generates operation information including activation command information that commands the imaging unit 307 to start up or imaging command information that commands the imaging unit 307 to perform an imaging operation, and notifies the imaging control unit 314. Here, the identification code is, for example, a QR code (registered trademark), a barcode, etc., printed on a work order for painting work, and is used to identify painting method information indicating the painting method of the paint to be applied to the area to be painted, and mixing ratio information indicating the mixing ratio of the primary color paints. The painting method information also includes, for example, the dilution degree of each primary color paint used to prepare the paint used for painting, and solvent identification information that identifies the type of solvent used for dilution. The painting method information may also include information on painting methods such as blending paint and block painting. Furthermore, when the receiving unit 311 receives a painting completion registration operation from the input unit 305 to register that the painting of the area to be painted on the object to be painted has been completed, or a paint filling completion registration operation to register that the paint has been filled into the paint storage container CA, it generates operation information corresponding to the received operation and notifies the registration notification unit 320. Also, when the receiving unit 311 receives an order request operation from the input unit 305 to order the insufficient amount of paint, it generates operation information indicating the order details corresponding to the order request operation and notifies the order request unit 319. Here, the painting completion registration operation includes the process of entering the amount of unused paint left over after the painting work has been completed by the painting contractor.For example, 20 kg of paint was prepared before the start of the painting work. If 5 kg of the prepared paint remained, the amount of 5 kg of the remaining unused paint is input.

[0015] The image forming unit 312 forms an estimated usage / estimated remaining amount notification image for notifying the painter of the estimated usage amount and the estimated remaining amount of the paint based on the estimated usage amount information indicating the estimated usage amount of the paint used by the painter for painting the painting target part, which is acquired by the estimated usage amount acquisition unit 317, and the estimated remaining amount information indicating the estimated remaining amount of the paint after painting, which is acquired by the remaining amount status acquisition unit 318. Further, the image forming unit 312 forms an estimated usage / estimated remaining amount notification image for notifying the painter of the estimated usage amount and the estimated remaining amount of the paint based on the above-described estimated usage amount information acquired by the estimated usage amount acquisition unit 317 and the order urging information for urging the order of the paint before painting, which is acquired by the remaining amount status acquisition unit 318. Then, the image forming unit 312 causes the formed image to be stored in the display image storage unit 321.

[0016] The display control unit 313 causes the display unit 304 to display various images indicated by the various image information stored in the display image storage unit 321. The imaging control unit 314 activates the imaging unit 307 when operation information including activation command information is notified from the reception unit 311. Further, the imaging control unit 315 transfers control information for causing the imaging unit 307 to perform an imaging operation to the imaging unit 307 when operation information including imaging command information is notified from the reception unit 311. At this time, when the imaging unit 307 images, for example, the above-described identification code, the imaging unit 307 generates imaging image information indicating an imaging image including the image of the identification code and transfers it to the painting content information generation unit 315.

[0017] When the painting content information generation unit 315 receives captured image information from the imaging unit 307, it determines whether or not the captured image information captures an identification code. If the painting content information generation unit 315 determines that it captures an identification code, it performs a process to extract the identification code image from the captured image and then identifies information indicating the painting method and the mixing ratio of primary color paints indicated by the identification code. The painting content information generation unit 315 then generates painting content information that includes the information indicating the area of ​​the part to be painted as notified by the reception unit 311, and the identified information indicating the painting method and the mixing ratio of primary color paints. The painting content information generation unit 315 notifies the painting content information transmission unit 316 of the generated painting content information. The painting content information transmission unit 316 transmits the notified painting content information to the cloud server 1.

[0018] When the estimated usage acquisition unit 317 acquires the aforementioned estimated usage information transmitted from the cloud server 1, it notifies the image forming unit 312 of the acquired estimated usage information. When the remaining amount status acquisition unit 318 acquires the aforementioned estimated remaining amount information or order reminder information transmitted from the cloud server 1, it notifies the image forming unit 312 of the acquired estimated remaining amount information or order reminder information.

[0019] When the order request unit 319 receives operational information indicating the order details from the reception unit 311, it generates order request information that requests an order for paint from a paint supplier, indicating the order details included in the operational information. The order request unit 319 then sends the generated order request information to the cloud server 1. When the registration notification unit 320 receives operational information corresponding to the aforementioned painting completion registration operation from the reception unit 311, it generates painting completion registration information based on the notified operational information and sends it to the cloud server 1. Here, the painting completion registration information includes unused paint quantity information indicating the amount of unused paint left over when the painting contractor performed the painting work. Furthermore, when the registration notification unit 320 receives operational information corresponding to the aforementioned paint filling completion registration operation from the reception unit 311, it generates filling completion registration information based on the notified operational information and sends it to the cloud server 1. Here, the filling completion registration information includes color identification information that identifies the paint filled by the painting contractor.

[0020] As shown in Figure 2, Cloud Server 1 comprises a CPU 101, a main memory unit 102, an auxiliary memory unit 103, a communication unit 106, and a bus 109 connecting these units, and functions as a paint usage management device that manages the amount of paint used by a painting contractor to paint the aforementioned target areas. The CPU 101 is, for example, a multi-core processor. The main memory unit 102 has volatile memory and is used as a workspace for the CPU 101. The auxiliary memory unit 103 consists of large-capacity non-volatile memory and stores programs for realizing various functions of Cloud Server 1. The communication unit 106 is connected to the wide-area network NW1.

[0021] The CPU 101 reads the program stored in the auxiliary storage unit 103 into the main storage unit 102 and executes it, so as shown in Figure 3, it functions as a paint content information acquisition unit 111, a usage amount estimation unit 112, a weight acquisition unit 113, an actual usage amount calculation unit 114, a model update unit 115, an estimated usage amount notification unit 116, a remaining amount monitoring unit 117, a remaining amount estimation unit 118, a remaining amount determination unit 119, an order unit 120, a remaining amount status notification unit 121, an unused paint amount acquisition unit 122, and a correction amount calculation unit 123. Furthermore, the auxiliary storage unit 103 shown in Figure 2 has a model storage unit 131, a usage history storage unit 132, and a remaining amount storage unit 133, as shown in Figure 3. The usage record storage unit 132 stores, for example as shown in Figure 4, information on the type of painting method used by the painting contractor, information on the area of ​​the area to be painted, color identification information that identifies each of at least one primary color paints contained in the paint used for painting, mixing ratio information that shows their mixing ratio, and actual usage amount information that shows the amount of each primary color paint actually used by the painting contractor, in association with usage date and time information that shows the date and time of use and user identification information that identifies the painting contractor.In the example shown in Figure 4, the painting contractor used painting method PM[0] on 2022 / 1 / 4 for an area of ​​1m². 2 This indicates that the area to be painted was painted using paint containing Super Black.

[0022] Returning to Figure 3, the model storage unit 131 stores paint usage estimation model information, which represents a paint usage estimation model for estimating the amount of at least one type of paint required to paint a target area, based on the aforementioned painting method type information, the aforementioned painting target area information, and the aforementioned mixing ratio information. This paint usage estimation model is, for example, a feedforward neural network. In this case, the model storage unit 131 stores information indicating the structure of the neural network and information indicating the weight coefficients in that neural network. Here, the information indicating the structure of the neural network includes information indicating the number of nodes, the number of layers, the weight coefficients corresponding to each node, and the activation function. As shown in Figure 5, this neural network has an input layer L10, a hidden layer L20, and an output layer L30. The input layer L10 receives the aforementioned painting method type information, the aforementioned painting target area information, and the aforementioned mixing ratio information.

[0023] The hidden layer L20 consists of N (N is a positive integer) layers, each containing a predetermined number M[j] of nodes x[j,i] (1≦i≦M[j], where M[j] is a positive integer). That is, the hidden layer L20 has a structure in which each node sequence is connected to the others. Here, the output y[j,i] of each node x[j,i] is expressed by the following relationship (1).

number

[0024] Returning to Figure 3, the remaining amount storage unit 133 stores remaining amount information indicating the remaining amount of each of the pre-set multiple types of paint, associating it with color identification information that identifies each of the multiple types of paint.

[0025] When the painting content information acquisition unit 111 acquires painting content information transmitted from the terminal device 3, it extracts the painting method type information, the area of ​​the part to be painted, and the mixing ratio information contained in the acquired painting content information and notifies the usage amount estimation unit 112. The painting content information acquisition unit 111 also stores the extracted painting method type information, the area of ​​the part to be painted, and the mixing ratio information in the usage record storage unit 132 in association with the usage date and time information and the user identification information. Here, the painting content information acquisition unit 111 identifies the date and time on which the painting content information was acquired from the terminal device 3 as the usage date and time. If the painting content information includes usage date and time information, the painting content information acquisition unit 111 may also extract that usage date and time information and store it in the usage record storage unit 132.

[0026] The usage amount estimation unit 112 estimates the usage amount of each of the multiple types of paint using the aforementioned paint usage amount estimation model. Specifically, the usage amount estimation unit 112 uses the paint usage amount estimation model stored in the model storage unit 131 to calculate the expected usage amount of each primary color paint used for painting from the painting method type information, painting target area information, and mixing ratio information notified by the painting content information acquisition unit 111. The usage amount estimation unit 112 then notifies the estimated usage amount notification unit 116 and the remaining amount estimation unit 118 of the estimated usage amount expected value as the estimated usage amount. The estimated usage amount notification unit 116 generates estimated usage amount information showing the estimated usage amount of each of the multiple types of paint estimated by the usage amount estimation unit 112 and transmits it to the terminal device 3.

[0027] When the weight acquisition unit 113 acquires the aforementioned painting completion registration information or the aforementioned filling completion registration information transmitted from the terminal device 3, it sends weight request information to the weight detection unit 4 requesting the transmission of weight information indicating the weight of the paint storage container CA. As a result, the weight acquisition unit 113 acquires the weight information transmitted from the weight detection unit 4, extracts the total container weight information indicating the total weight of the paint storage container CA included in the acquired weight information, and the color identification information of the paint stored in the paint storage container CA, and notifies the remaining amount monitoring unit 117.

[0028] The unused paint quantity acquisition unit 122 acquires unused paint quantity information, which indicates the amount of leftover unused paint that was not used in the painting work from the adjusted paint prepared from paint taken out of at least one paint storage container CA. Specifically, when the unused paint quantity acquisition unit 122 acquires the aforementioned painting completion registration information transmitted from the terminal device 3, it acquires unused paint quantity information by extracting the aforementioned unused paint quantity information contained in the acquired painting completion registration information. The unused paint quantity acquisition unit 122 then notifies the correction amount calculation unit 123 of the acquired unused paint quantity information.

[0029] The correction amount calculation unit 123 calculates, based on the mixing ratio of the prepared paint, the amount of each of at least one primary color paints contained in the unused paint, from the amount of unused paint indicated by the unused paint amount information, as a correction amount for the actual usage amount calculated from the weight of at least one paint storage container CA. Specifically, the correction amount calculation unit 123 refers to the mixing ratio information stored in the usage history storage unit 132 and calculates, from the amount of unused paint indicated by the unused paint amount information notified by the unused paint amount acquisition unit 122, the amount of each of at least one primary color paints contained in the unused paint, as a correction amount for the actual usage amount calculated from the weight of the paint storage container CA. Then, the correction amount calculation unit 123 notifies the actual usage amount calculation unit 114 of the calculated correction amount.

[0030] The Actual Usage Calculation Unit 114 calculates the actual usage amount of paint by subtracting the weight of at least one of the multiple paint storage containers CA before and after the painter takes out the paint necessary to paint the aforementioned target area from at least one of the multiple paint storage containers CA. Specifically, when the Actual Usage Calculation Unit 114 receives notification of the total container weight information from the Weight Acquisition Unit 113, it calculates the weight of the paint itself after the painter has used it by subtracting the weight of the aforementioned paint storage containers CA from the weight indicated by the notified total container weight information. Next, the Actual Usage Calculation Unit 114 calculates the amount of each primary color paint taken out from the paint storage containers CA by subtracting the weight of the paint itself calculated from the remaining amount of paint before the update stored in the remaining amount storage unit 133. Then, the Actual Usage Calculation Unit 114 calculates the aforementioned actual usage amount by subtracting the correction amount notified by the correction amount calculation unit 123 from the calculated amount taken out, and stores the actual usage information indicating the calculated actual usage amount in the usage history storage unit 132. Furthermore, when the actual usage calculation unit 114 stores new actual usage information in the usage history storage unit 132, it notifies the remaining amount monitoring unit 117 of an update permission notification that allows the remaining amount information stored in the remaining amount storage unit 133 to be updated.

[0031] The remaining amount monitoring unit 117 monitors the remaining amount of paint in each of the multiple paint storage containers CA based on the weight of each container. Specifically, when the remaining amount monitoring unit 117 receives notification of the total container weight information from the weight acquisition unit 113 and the aforementioned update permission notification information from the actual usage amount calculation unit 114, it calculates the weight of paint only after the painter has used the paint by subtracting the weight of the pre-set paint storage containers CA from the weight indicated by the notified total container weight information. The remaining amount monitoring unit 117 then updates the information indicating the remaining amount of paint stored in the remaining amount storage unit 133 with the information indicating the calculated weight of the paint.

[0032] The model update unit 115 stores information on the type of painting method used by the painting contractor when they previously painted the target area, information on the area of ​​the target area, information on the mixing ratio, and actual usage history storage unit 132. Achievements A new paint usage estimation model is generated using actual usage information indicating the dosage. The model update unit 115 then updates the paint usage estimation model information stored in the model storage unit 131 using the paint usage estimation model information indicating the newly generated paint usage estimation model. The model update unit 115 updates the paint usage estimation model information stored in the model storage unit 131 each time actual usage information is added to the usage history storage unit 132. Here, the model update unit 115 first uses a neural network, such as the one shown in Figure 5, stored in the model storage unit 131, to calculate the expected usage amount for each of the multiple types of paint from the painting method type information, the area information of the painting target, and the mixing ratio information when the painting target area was painted in the past. Next, the model update unit 115 calculates the error between the actual usage amount indicated by the actual usage information for each of the multiple types of paint stored in the usage history storage unit 132 and the expected usage amount calculated using the neural network. Then, the model update unit 115 determines the weight coefficients of the neural network using backpropagation based on the calculated error, and stores the information indicating the determined weight coefficients in the model storage unit 131.

[0033] The remaining amount estimation unit 118 calculates the estimated remaining amount for each of the multiple types of paint by subtracting the estimated usage amount indicated by the estimated usage amount information notified by the usage amount estimation unit 112 from the remaining amount indicated by the remaining amount information for each of the multiple types of paint stored in the remaining amount storage unit 133. Then, the remaining amount estimation unit 118 notifies the remaining amount determination unit 119 and the remaining amount status notification unit 121 of the information indicating the calculated estimated remaining amount.

[0034] The remaining amount determination unit 119 determines whether the amount of paint remaining after use, obtained by subtracting the estimated amount of paint used from the remaining amount of at least one paint estimated to be used by the painting contractor, is less than a preset safety level. Specifically, the remaining amount determination unit 119 determines whether the estimated remaining amount indicated by the information notified by the remaining amount estimation unit 118 is less than a preset safety level. The remaining amount determination unit 119 then notifies the remaining amount status notification unit 121 of the determination result.

[0035] If the remaining amount status notification unit 121 determines that the estimated remaining amount is equal to or greater than the aforementioned safe remaining amount, it generates estimated remaining amount information, including information indicating the estimated remaining amount notified by the remaining amount estimation unit 118, and transmits it to the terminal device 3. Also, if the remaining amount status notification unit 121 determines that the estimated remaining amount is less than the aforementioned safe remaining amount, it generates the aforementioned order reminder information, including information indicating the estimated remaining amount notified by the remaining amount estimation unit 118, and transmits it to the terminal device 3.

[0036] If the ordering unit 120 determines that the amount of paint remaining after painting the target area by the painting contractor is less than the aforementioned safe amount, it generates order information to order paint from the paint supplier so that the amount of paint remaining after use will be less than the safe amount, in response to the paint supplier's order request for paint. When the ordering unit 120 receives the aforementioned order request information transmitted from the terminal device 3, it generates order information indicating the contents of the paint order to the paint supplier and transmits the generated order information to the terminal device 9 held by the paint supplier.

[0037] Next, the operation of the paint storage management system according to this embodiment will be described with reference to Figures 6 and 7. First, as shown in Figure 6, when a painter performs the aforementioned input operation of the area to be painted to the input unit 305 of the terminal device 3, the terminal device 3 receives the aforementioned area to be painted information (step S1). Next, after the painter performs an imaging preparation operation to activate the imaging unit 307 of the terminal device 3, the terminal device 3 performs an imaging operation to capture the identification code listed on the work order or the like for painting work, and the terminal device 3 captures the identification code listed on the work order or the like (step S2). Subsequently, the terminal device 3 performs a process to extract the identification code image from the captured image, then identifies information indicating the painting method and the mixing ratio of the primary color paints indicated by the identification code, and generates painting content information including the aforementioned area to be painted information and the information indicating the identified painting method and the mixing ratio of the primary color paints (step S3). After that, the generated painting content information is transmitted from the terminal device 3 to the cloud server 1 (step S4).

[0038] Meanwhile, when the cloud server 1 obtains painting content information from the terminal device 3, it extracts painting method type information, painting target area information, and mixing ratio information from the obtained painting content information, and stores this extracted information in the usage history storage unit 132 in association with usage date and time information and user identification information (step S5). Next, the cloud server 1 estimates the amount of paint used for each of the multiple types of paint using the paint usage amount estimation model described above (step S6). Subsequently, the cloud server 1 calculates the estimated remaining amount for each of the multiple types of paint by subtracting the estimated usage amount indicated by the estimated usage amount information notified by the usage amount estimation unit 112 from the remaining amount indicated by the remaining amount information for each of the multiple types of paint stored in the remaining amount storage unit 133 (step S7). Here, suppose the cloud server 1 determines that the calculated estimated remaining amount for each of the multiple types of paint is equal to or greater than a preset safety remaining amount (step S8). In this case, the cloud server 1 generates estimated usage amount information indicating the estimated usage amount and estimated remaining amount information indicating the estimated remaining amount of paint after use (step S9). Subsequently, the generated estimated usage information and estimated remaining amount information are transmitted from the cloud server 1 to the terminal device 3 (step S10). Meanwhile, when the terminal device acquires the estimated usage information and estimated remaining amount information, it forms the aforementioned estimated usage / estimated remaining amount notification image based on the acquired estimated usage information and estimated remaining amount information and displays it on the display unit 304 (step S11).

[0039] Then, after the painting contractor has completed painting the area to be painted, the terminal device 3 performs the aforementioned painting completion registration operation to the input unit 305, and the terminal device 3 accepts this operation and generates the aforementioned painting completion registration information (step S12). Next, the generated painting completion registration information is transmitted from the terminal device 3 to the cloud server 1 (step S13). Meanwhile, when the cloud server 1 receives the aforementioned painting completion registration information transmitted from the terminal device 3, it extracts the aforementioned unused paint quantity information contained in the acquired painting completion registration information (step S14). Subsequently, the cloud server 1 refers to the mixing ratio information stored in the usage history storage unit 132 and calculates the amount of each of at least one type of primary color paint contained in the unused paint from the amount of unused paint indicated by the extracted unused paint quantity information, as a correction amount for the actual usage amount calculated from the weight of the paint storage container CA (step S15).

[0040] Subsequently, the aforementioned weight request information is transmitted from the cloud server 1 to the weight detection unit 4 (step S16). Meanwhile, when the weight detection unit 4 receives the weight request information transmitted from the cloud server 1, it generates weight information indicating the detected weight of the paint storage container CA (step S17). Subsequently, the generated weight information is transmitted from the weight detection unit 4 to the cloud server 1 (step S18).

[0041] Meanwhile, when the cloud server 1 acquires weight information, as shown in Figure 7, it calculates the weight of the paint itself after the painter has used it by subtracting the weight of the aforementioned paint storage container CA from the weight indicated by the total container weight information included in the weight information, and calculates the amount of each primary color paint taken out of the paint storage container CA by subtracting the weight of the paint itself calculated from the remaining amount of paint stored in the remaining amount storage unit 133 before the update. Then, the cloud server 1 calculates the aforementioned actual usage amount by subtracting the correction amount notified by the correction amount calculation unit 123 from the calculated amount taken out. Then, the cloud server 1 stores the actual usage amount information indicating the calculated actual usage amount in the usage amount storage unit 132 (step S19). After that, the cloud server 1 updates the information indicating the remaining amount of paint stored in the remaining amount storage unit 133 using the information indicating the weight of only the paint after the painter has used it (step S20). Next, the cloud server 1 generates new paint usage estimation model information, which represents a paint usage estimation model, using the painting method type information, painting area information, mixing ratio information, and actual usage amount information, which are stored in the usage history storage unit 132, when painting contractors have painted the target area in the past. Then, the model update unit 115 updates the paint usage estimation model information stored in the model storage unit 131 using the newly generated paint usage estimation model information (step S21).

[0042] Furthermore, after the cloud server 1 has performed the processing in step S7 described above, it is determined that the estimated remaining amount of each of the calculated types of paint is less than the aforementioned safe remaining amount (step S22). In this case, the cloud server 1 generates estimated usage information indicating the estimated usage amount and order reminder information urging the ordering of paint (step S23). Subsequently, the generated estimated usage information and order reminder information are transmitted from the cloud server 1 to the terminal device 3 (step S24). Meanwhile, when the terminal device receives the estimated usage information and order reminder information, it forms the aforementioned order reminder image based on the acquired estimated usage information and order reminder information and displays it on the display unit 304 (step S25).

[0043] Suppose the painting contractor confirms the order reminder image displayed on the display unit 304 of the terminal device 3 and performs an order request operation to the input unit 305 to order the insufficient amount of paint. In this case, the terminal device 3 generates the aforementioned order request information indicating the order details in response to the order request operation (step S26). Next, the generated order request information is transmitted from the terminal device 3 to the cloud server 1 (step S27). Meanwhile, when the cloud server 1 receives the aforementioned order request information transmitted from the terminal device 3, it generates order information indicating the paint order details to the paint supplier (step S28). Subsequently, the generated order information is transmitted from the cloud server 1 to the terminal device 9 owned by the paint supplier (step S29).

[0044] Suppose that the paint ordered by the painting contractor arrives at the contractor's location, the contractor fills the paint into the paint storage container CA, and then performs the aforementioned paint filling completion operation on the input unit 305 of the terminal device 3. In this case, the terminal device 3 receives this operation and generates the aforementioned paint filling completion registration information (step S30). Next, the generated paint filling completion registration information is transmitted from the terminal device 3 to the cloud server 1 (step S31). Meanwhile, when the cloud server 1 receives the paint filling completion registration information, the aforementioned weight request information is transmitted from the cloud server 1 to the weight detection unit 4 (step S32). Meanwhile, when the weight detection unit 4 receives the weight request information transmitted from the cloud server 1, it generates weight information indicating the detected weight of the paint storage container CA (step S33). Subsequently, the generated weight information is transmitted from the weight detection unit 4 to the cloud server 1 (step S34). Meanwhile, when the cloud server 1 obtains weight information, it calculates the weight of the paint itself after the painter has used it by subtracting the weight of the aforementioned paint storage container CA from the weight indicated by the total container weight information included in the weight information, and updates the information indicating the remaining amount of paint stored in the remaining amount storage unit 133 using the calculated information indicating only the weight of the paint (step S35).

[0045] Next, the terminal control processing performed by the terminal device 3 according to this embodiment will be explained with reference to Figure 8. This terminal control processing is started when power is supplied to the terminal device 3 and a program for executing terminal control processing is started in the terminal device 3. First, the reception unit 311 determines whether or not it has received the aforementioned input operation for the area of ​​the part to be painted (step S201). If the reception unit 311 determines that it has not received the input operation for the area of ​​the part to be painted (step S201: No), the processing in step S206, which will be described later, is executed. On the other hand, if the reception unit 311 determines that it has received the input operation for the area of ​​the part to be painted (step S201: Yes), it generates operation information including information on the area of ​​the part to be painted according to that operation and notifies the painting content information generation unit 315. Next, the reception unit 311 determines whether or not it has received the aforementioned imaging preparation operation and imaging operation for imaging the aforementioned identification code (step S202). If the reception unit 311 determines that it has not received the imaging preparation operation or imaging operation painting (step S202: No), the process in step S206 described later is executed. On the other hand, if the reception unit 311 determines that it has received the aforementioned imaging preparation operation or imaging operation painting (step S202: Yes), it generates operation information including the aforementioned startup command information and imaging command information and notifies the imaging control unit 314. The imaging control unit 314 then activates the imaging unit 307 and transfers control information to the imaging unit 307 to cause it to perform an imaging operation, thereby causing the imaging unit 307 to capture the identification code (step S203). At this time, the imaging unit 307 generates image information showing the image containing the identification code and transfers it to the painting content information generation unit 315. Subsequently, the painting content information generation unit 315 performs a process to extract the identification code image from the image transferred from the imaging unit 307 and then identifies information indicating the painting method and the mixing ratio of the primary color paints indicated by the identification code (step S204). Subsequently, the painting content information generation unit 315 generates painting content information that includes the information indicating the area of ​​the part to be painted as notified by the reception unit 311, and information indicating the specified painting method and the mixing ratio of the primary color paints, and notifies the painting content information transmission unit 316 of the generated painting content information.Then, the painting content information transmission unit 316 transmits the notified painting content information to the cloud server 1 (step S205).

[0046] Next, the estimated usage acquisition unit 317 and the remaining capacity acquisition unit 318 determine whether or not they have acquired the estimated usage information and estimated remaining capacity information transmitted from the cloud server 1 (step S206). If the estimated usage acquisition unit 317 and the remaining capacity acquisition unit 318 determine that they have not acquired the estimated usage information and estimated remaining capacity information (step S206: No), the process in step S208 described later is executed. On the other hand, if the estimated usage acquisition unit 317 and the remaining capacity acquisition unit 318 determine that they have acquired the estimated usage information and estimated remaining capacity information (step S206: Yes), they notify the image forming unit 12 of the acquired estimated usage information and estimated remaining capacity information, respectively. The image forming unit 312 then forms the estimated usage / estimated remaining capacity notification image based on the notified estimated usage information and estimated remaining capacity information, and the display control unit 313 displays the formed estimated usage / estimated remaining capacity notification image on the display unit 304 (step S207).

[0047] Next, the reception unit 311 determines whether or not it has received the aforementioned painting completion registration operation (step S208). This painting completion registration operation includes an operation in which the painting contractor inputs the amount of unused paint left over after performing the painting work. If the reception unit 311 determines that it has not received the painting completion registration operation (step S208: No), the process in step S210 described later is executed. On the other hand, if the reception unit 311 determines that it has received the painting completion registration operation (step S208: Yes), it generates operation information corresponding to the content of the received painting completion registration operation and notifies the registration notification unit 320. The registration notification unit 320 then generates painting completion registration information based on the notified operation information and sends it to the cloud server 1 (step S209).

[0048] Subsequently, the estimated usage acquisition unit 317 and the remaining amount status acquisition unit 318 determine whether or not they have acquired the aforementioned estimated usage information and order reminder information transmitted from the cloud server 1 (step S210). If the estimated usage acquisition unit 317 and the remaining amount status acquisition unit 318 determine that they have not acquired the estimated usage information and order reminder information (step S210: No), the process described in step S212 is executed. On the other hand, if the estimated usage acquisition unit 317 and the remaining amount status acquisition unit 318 determine that they have acquired the aforementioned estimated usage information and order reminder information (step S210: Yes), they notify the image forming unit 312 of the acquired estimated usage information and order reminder information, respectively. The image forming unit 312 then forms the aforementioned order reminder image based on the notified estimated usage information and order reminder information, and the display control unit 313 displays the formed order reminder image on the display unit 304 (step S211).

[0049] Next, the reception unit 311 determines whether or not it has received the aforementioned order request operation (step S212). If the reception unit 311 determines that it has not received the order operation (step S212: No), the process in step S214 described below is executed. On the other hand, if the reception unit 311 determines that it has received the order operation (step S212: Yes), it generates operation information indicating the order details corresponding to the received order request operation and notifies the order request unit 319. The order request unit 319 then generates order request information indicating the order details included in the notified operation information and sends the generated order request information to the cloud server 1 (step S213).

[0050] Next, the reception unit 311 determines whether or not it has received the aforementioned paint filling completion registration operation (step S214). If the reception unit 311 determines that it has not received the paint filling completion registration operation (step S214: No), the process in step S201 is executed again. On the other hand, if the reception unit 311 determines that it has received the aforementioned paint filling completion registration operation, it generates operation information corresponding to the content of the received paint filling completion registration operation and notifies the registration notification unit 320. The registration notification unit 320 then generates filling completion registration information based on the notified operation information and sends it to the cloud server 1 (step S215). After that, the process in step S201 is executed again.

[0051] Next, the paint usage management process executed by the cloud server 1 according to this embodiment will be explained with reference to Figure 9. This paint usage management process is started when the program for executing the paint usage management process is launched on the cloud server 1. First, the paint content information acquisition unit 111 determines whether or not it has acquired the aforementioned paint content information transmitted from the terminal device 3 (step S101). If the paint content information acquisition unit 111 determines that it has not acquired the paint content information (step S101: No), the process in step S113, which will be described later, is executed. On the other hand, if the paint content information acquisition unit 111 determines that it has acquired the paint content information (step S101: Yes), it extracts the paint method type information, the area information of the part to be painted, and the mixing ratio information included in the acquired paint content information, associates them with the date and time of use information and the user identification information, and stores them in the usage record storage unit 132 (step S102). The paint content information acquisition unit 111 also notifies the usage amount estimation unit 112 of the extracted paint method type information, the area information of the part to be painted, and the mixing ratio information.

[0052] Next, the usage amount estimation unit 112 uses the aforementioned paint usage amount estimation model to estimate the amount of paint to be used for each of the multiple types of paint based on the notified painting method type information, painting target area information, and mixing ratio information (step S103). At this point, the usage amount estimation unit 112 notifies the estimated usage amount information, which indicates the estimated usage amount, to the estimated usage amount notification unit 116 and the remaining amount estimation unit 118.

[0053] Next, the remaining amount estimation unit 118 calculates the estimated remaining amount for each of the multiple types of paint by subtracting the estimated usage amount indicated by the estimated usage amount information notified by the usage amount estimation unit 112 from the remaining amount indicated by the remaining amount information for each of the multiple types of paint stored in the remaining amount storage unit 133 (step S104). At this point, the remaining amount estimation unit 118 notifies the remaining amount determination unit 119 of the information indicating the calculated estimated remaining amount.

[0054] Subsequently, the remaining amount determination unit 119 determines whether the estimated remaining amount calculated by the remaining amount estimation unit 118 is equal to or greater than a preset safe remaining amount (step S105). Let's assume that the remaining amount determination unit 119 determines that the estimated remaining amount is equal to or greater than the safe remaining amount (step S105: Yes). In this case, the estimated usage amount notification unit 116 generates estimated usage amount information showing the estimated usage amount for each of the multiple types of paint estimated by the usage amount estimation unit 112 and transmits it to the terminal device 3, and the remaining amount status notification unit 121 generates estimated remaining amount information including the information showing the estimated remaining amount mentioned above and transmits it to the terminal device 3 (step S106). Next, the process of step S108, described below, is executed.

[0055] On the other hand, suppose the remaining amount determination unit 119 determines that the estimated remaining amount is equal to or greater than the safe remaining amount (Step S105: No). In this case, the estimated usage amount notification unit 116 generates estimated usage amount information indicating the estimated usage amount for each of the multiple types of paint estimated by the usage amount estimation unit 112 and transmits it to the terminal device 3, and the remaining amount status notification unit 121 generates the order reminder information based on the information indicating the estimated remaining amount and transmits it to the terminal device 3 (Step S107).

[0056] Next, the weight acquisition unit 113 and the unused paint quantity acquisition unit 122 determine whether or not they have acquired the aforementioned painting completion registration information transmitted from the terminal device 3 (step S108). If the weight acquisition unit 113 and the unused paint quantity acquisition unit 122 determine that they have not acquired the painting completion registration information (step S108: No), the process in step S116 described later is executed. On the other hand, suppose the weight acquisition unit 113 and the unused paint quantity acquisition unit 122 determine that they have acquired the painting completion registration information (step S108: Yes). In this case, the unused paint quantity acquisition unit 122 extracts the aforementioned unused paint quantity information included in the acquired painting completion registration information (step S109). Here, the unused paint quantity acquisition unit 122 notifies the correction amount calculation unit 123 of the acquired unused paint quantity information.

[0057] Subsequently, the correction amount calculation unit 123 refers to the mixing ratio information stored in the usage record storage unit 132 and calculates the amount of paint for each of at least one type of primary color paint contained in the unused paint, based on the amount of unused paint indicated by the unused paint amount information notified by the unused paint amount acquisition unit 122, as a correction amount for the actual usage amount calculated from the weight of the paint storage container CA (step S110). At this point, the correction amount calculation unit 123 notifies the actual usage amount calculation unit 114 of the calculated correction amount.

[0058] Next, the weight acquisition unit 113 transmits the aforementioned weight request information to the weight detection unit 4 (step S111). As a result, the weight acquisition unit 113 acquires the weight information transmitted from the weight detection unit 4 (step S112). Here, the weight acquisition unit 113 extracts the aforementioned total container weight information and color identification information included in the acquired weight information and notifies the remaining amount monitoring unit 117. Subsequently, the actual usage amount calculation unit 114 calculates the weight of the paint itself after the painter has used it by subtracting the weight of the aforementioned paint storage container CA from the weight indicated by the total container weight information notified by the weight acquisition unit 113. Then, the actual usage amount calculation unit 114 calculates the amount of each primary color paint taken out of the paint storage container CA by subtracting the weight of the paint itself calculated from the remaining amount of paint before the update stored in the remaining amount storage unit 133. Then, the actual usage amount calculation unit 114 calculates the actual usage amount by subtracting the correction amount notified by the correction amount calculation unit 123 from the calculated withdrawal amount, and stores the actual usage amount information indicating the calculated actual usage amount in the usage history storage unit 132 (step S113).

[0059] Next, the remaining amount monitoring unit 117 calculates the weight of the paint only after the painter has used it by subtracting the weight of the aforementioned paint storage container CA from the weight indicated by the total container weight information notified by the weight acquisition unit 113. Then, the remaining amount monitoring unit 117 updates the remaining amount information, which indicates the remaining amount of paint stored in the remaining amount storage unit 133, with the information indicating the calculated weight of the paint (step S114).

[0060] Next, the model update unit 115 generates paint usage estimation model information, which represents a new paint usage estimation model, using the painting method type information, painting area information, mixing ratio information, and actual usage amount information, which are stored in the usage history storage unit 132, when a painting contractor has painted the target area in the past. Then, the model update unit 115 updates the paint usage estimation model information stored in the model storage unit 131 using the generated paint usage estimation model information (step S115).

[0061] Subsequently, as shown in Figure 10, the ordering unit 120 determines whether or not it has received the aforementioned order request information transmitted from the terminal device 3 (step S116). If the ordering unit 120 determines that it has not received the order request information (step S116: No), the process in step S118, described later, is executed. On the other hand, if the ordering unit 120 determines that it has received the order request information (step S116: Yes), it generates the aforementioned order information and transmits the generated order information to the terminal device 9 owned by the paint supplier (step S117).

[0062] Next, the weight acquisition unit 113 determines whether or not it has acquired the aforementioned filling completion registration information transmitted from the terminal device 3 (step S118). If the weight acquisition unit 113 determines that it has not acquired the filling completion registration information (step S118: No), the process in step S101 is executed again. On the other hand, if the weight acquisition unit 113 determines that it has acquired the filling completion registration information (step S118: Yes), it transmits the aforementioned weight request information to the weight detection unit 4 (step S119). As a result, the weight acquisition unit 113 acquires the weight information transmitted from the weight detection unit 4 (step S120). Here, the weight acquisition unit 113 extracts the aforementioned total container weight information and color identification information included in the acquired weight information and notifies the remaining amount monitoring unit 117. Subsequently, the remaining amount monitoring unit 117 calculates the weight of only the paint after the painter has used the paint by subtracting the weight of the aforementioned paint storage container CA from the weight indicated by the total container weight information notified by the weight acquisition unit 113. Then, the remaining amount monitoring unit 117 updates the remaining amount information, which is stored in the remaining amount storage unit 133, with the calculated information indicating the weight of the paint (step S121). After that, the process in step S101 is executed again.

[0063] Incidentally, in the case of painting a car body, for example, the painting method for the area to be painted and the proportions of the paint colors to be used are predetermined. It is common practice to estimate the amount of at least one type of paint needed for painting based on the area of ​​the area to be painted and its position within the overall object. Furthermore, if the object to be painted is, for example, a car fender, the painting method will differ between the central part and the edges of the fender, so the amount of paint needed will be estimated taking these differences into account. It should be noted that this painting method may also be determined at the discretion of the painting contractor. For example, when repairing a damaged area of ​​a car, the painting method will be set to blending paint, block painting, etc., depending on the area or location of the part that needs painting after the repair. However, the amount of paint used per unit area of ​​the area to be painted varies among multiple painting contractors, and even when painting the same area of ​​the area to be painted using the same painting method, it often differs from one contractor to another.

[0064] As described above, according to the cloud server 1 of this embodiment, the usage amount estimation unit 112 estimates the usage amount of at least one type of paint required for painting a target area, using a paint usage amount estimation model that estimates the usage amount of at least one type of paint required for painting a target area, based on painting method type information, painting target area information, and mixing ratio information. Furthermore, the model update unit 115 updates the paint usage amount estimation model using painting method type information, painting target area information, mixing ratio information, and actual usage amount information from when the target area was painted in the past. As a result, the amount of paint to be used for painting a target area to be painted by a painting contractor is estimated using a paint usage amount estimation model that has been successively updated according to the paint usage history of the user painting contractor, so that the amount of paint used can be accurately estimated for each painting contractor.

[0065] Although embodiments of the present invention have been described above, the present invention is not limited to the embodiments described above. For example, the paint usage estimation model may estimate the amount of paint used from information such as the amount of paint discharged per unit time from the spray gun used for painting, the average distance between the area to be painted and the spray gun during painting, the air pressure of the spray gun, and the temperature and humidity of the place where the painting work is performed, in addition to the painting method information, the area information of the part to be painted and the mixing ratio information described above.

[0066] In this embodiment, the paint usage estimation model may be represented by a convolutional neural network (CNN).

[0067] In this embodiment, when a painting contractor captures an identification code listed on a work order or the like using the imaging unit 306 of the terminal device 3, the terminal device 3 acquires painting method information indicating the painting method of the paint to be applied to the area to be painted, and painting content information including the acquired painting method information is transmitted from the terminal device 3 to the cloud server 1. However, this is not the only example; the painting contractor may input painting method information via the input unit 305 of the terminal device 3, and the terminal device 2 may acquire painting method information indicating the painting method of the area to be painted. Here, the painting contractor may input painting method information indicating, for example, a blending paint or block painting via the input unit 305, and the terminal device 3 may acquire the input painting method information.

[0068] In this embodiment, the cloud server 1 determines that the estimated remaining amount of each of the calculated types of paint is less than the aforementioned safe amount, generates order reminder information and sends it to the terminal device 3, and when the terminal device 3 receives the order reminder information, it forms an order reminder image and displays it on the display unit 304. That is, an example in which a series of processes from steps S23 to S27 are executed has been described. However, the system is not limited to this, and the cloud server 1 may immediately generate the aforementioned order information and send it to the terminal device 9 if it determines that the estimated remaining amount of each of the calculated types of paint is less than the aforementioned safe amount.

[0069] Furthermore, the various functions of the cloud server 1 and terminal device 3 according to the present invention can be implemented using a normal computer system, without requiring a dedicated system. For example, the cloud server 1 and terminal device 3 that perform the above-mentioned operations may be configured by distributing a program for performing the above operations to computers connected to a network, stored on a non-temporary recording medium (such as a CD-ROM (Compact Disc Read Only Memory)) that can be read by the computer system, and then installing the program into the computer system.

[0070] Furthermore, the method of providing the program to the computer is arbitrary. For example, the program may be uploaded to a bulletin board system (BBS) on a communication line and distributed to the computer via the communication line. The computer then launches this program and executes it under the control of the operating system (OS), just like any other application. In this way, the computer functions as a cloud server 1 and terminal device 3 that perform the processes described above.

[0071] Although embodiments and variations of the present invention have been described above, the present invention is not limited thereto. The present invention includes embodiments and variations that are appropriately combined, and those that are appropriately modified thereto. [Industrial applicability]

[0072] This invention is suitable as a system for painting contractors to manage the amount of paint they use themselves. [Explanation of symbols]

[0073] 1: Cloud server, 3,9: Terminal device, 4: Weight detection unit, 8: Router, 101,301: CPU, 102,302: Main memory unit, 103,303: Auxiliary memory unit, 106,306: Communication unit, 109,309: Bus, 111: Paint content information acquisition unit, 112: Usage estimation unit, 113: Weight acquisition unit, 114: Actual usage calculation unit, 115: Model update unit, 116: Estimated usage notification unit, 117: Remaining amount monitoring unit, 118: Remaining amount estimation unit, 119: Remaining amount determination unit, 120: Ordering unit, 121: Remaining amount status notification unit, 131: Model memory unit, 132: Usage history storage unit, 133: Remaining amount storage unit, 304: Display unit, 305: Input unit, 307: Imaging unit, 311: Reception unit, 312: Image forming unit, 313: Display control unit, 314: Imaging control unit, 315: Paint content information generation unit, 316: Paint content information transmission unit, 317: Estimated usage amount acquisition unit, 318: Remaining amount status acquisition unit, 319: Order request unit, 320: Registration notification unit, 321: Display image storage unit, CA: Paint storage container, L10: Input layer, L20: Hidden layer, L30: Output layer, NW1: Wide area network, NW2: Local network

Claims

1. A paint usage estimation unit estimates the amount of at least one type of paint needed to paint a target area, using a paint usage estimation model that estimates the amount of at least one type of paint needed to paint a target area, based on painting method type information indicating the type of painting method for the target area, painting target area area information indicating the area of ​​the target area, paint mixing ratio information for the paint used to paint the target area, and painting condition information indicating the conditions for painting. A weight detection unit that detects the weight of each of the multiple paint storage containers containing paint, An actual usage amount calculation unit calculates the difference in weight, which corresponds to the difference in weight detected by the weight detection unit of at least one paint storage container before and after the paint necessary for painting the area to be painted is taken out of at least one of the plurality of paint storage containers, as the actual amount of paint used. The system includes a model update unit that updates the paint usage estimation model using information on the type of painting method used when the aforementioned painting target area was painted in the past, information on the area of ​​the painting target area, information on the mixing ratio, information on the actual amount used, and information on painting conditions indicating the conditions under which painting is performed. The aforementioned paint usage estimation model is a neural network. Paint usage management system.

2. A paint usage estimation unit estimates the amount of at least one type of paint needed to paint a target area, using a paint usage estimation model that estimates the amount of at least one type of paint needed to paint a target area, based on painting method type information indicating the type of painting method for the target area, painting target area area information indicating the area of ​​the target area, paint mixing ratio information for the paint used to paint the target area, and painting condition information indicating the conditions for painting. A weight detection unit that detects the weight of each of the multiple paint storage containers containing paint, An actual usage amount calculation unit calculates the difference in weight, which corresponds to the difference in weight detected by the weight detection unit of at least one paint storage container before and after the paint necessary for painting the area to be painted is taken out of at least one of the plurality of paint storage containers, as the actual amount of paint used. The system includes a model update unit that updates the paint usage estimation model using information on the type of painting method used when the aforementioned painting target area was painted in the past, information on the area of ​​the painting target area, information on the mixing ratio, information on the actual amount used, and information on painting conditions indicating the conditions under which painting is performed. The aforementioned paint usage estimation models exist in multiple forms for each user of the paint, The usage estimation unit selects a paint usage estimation model corresponding to a user who uses paint, and uses the selected paint usage estimation model to estimate the usage amount of at least one type of paint. Paint usage management system.

3. The painting condition information includes at least one of the following: the amount of paint discharged per unit time from the spray gun used for painting, the average distance between the area to be painted and the spray gun during painting, the air pressure of the spray gun, and the temperature and humidity of the location where the painting work is performed. A paint usage management system according to claim 1 or 2.

4. A paint usage estimation unit estimates the amount of at least one type of paint needed to paint a target area, using a paint usage estimation model that estimates the amount of at least one type of paint needed to paint a target area, based on painting method type information indicating the type of painting method for the target area, painting target area area information indicating the area of ​​the target area, and paint mixing ratio information for the paints used to paint the target area. A weight detection unit that detects the weight of each of the multiple paint storage containers containing paint, An actual usage amount calculation unit calculates the difference in weight, which corresponds to the difference in weight detected by the weight detection unit of at least one paint storage container before and after the paint necessary for painting the area to be painted is taken out of at least one of the plurality of paint storage containers, as the actual amount of paint used. A model update unit updates the paint usage estimation model using the painting method type information from when the aforementioned painting target area was painted in the past, the painting target area area information, the mixing ratio information, and the actual usage amount information indicating the actual usage amount. A remaining amount monitoring unit monitors the remaining amount of paint stored in each of the plurality of paint storage containers based on the weight of each of the plurality of paint storage containers, A remaining amount determination unit that determines whether the remaining amount of paint after use, obtained by subtracting the estimated amount of paint used from the remaining amount of at least one paint estimated to be used, is less than a preset safety remaining amount, The system includes an ordering unit that, when it is determined that the remaining amount after use is less than the safe amount, immediately generates ordering information to order paint from the supplier of the paint whose remaining amount after use is less than the safe amount. Paint usage management system.

5. The system further comprises a painting content information generation unit that extracts an identification code image from an image captured by an imaging unit, identifies painting method type information indicating the type of painting method for the part to be painted that is associated with the identification code corresponding to the extracted identification code image, and paint mixing ratio information for the paint used to paint the part to be painted, and generates painting content information including the identified painting method type information and the mixing ratio information, The usage amount estimation unit estimates the usage amount of at least one type of paint necessary for painting a target area, using a paint usage amount estimation model that estimates the usage amount of at least one type of paint necessary for painting a target area, based on the painting method type information and the mixing ratio information included in the painting content information, the area information of the target area to be painted, and the painting condition information. A paint usage management system according to claim 1 or 2.

6. An unused paint quantity acquisition unit acquires unused paint quantity information indicating the amount of unused paint remaining that was not used in the painting work among the prepared paint prepared from the paint taken out from the at least one paint storage container, The system further includes a correction amount calculation unit that, based on the mixing ratio of the prepared paint, calculates the amount of each of at least one primary color paints contained in the unused paint, from the amount of unused paint indicated by the unused paint amount information, as a correction amount for the actual usage amount calculated from the weight of the at least one paint storage container, based on the mixing ratio of the prepared paint, A paint usage management system according to at least one of claims 1, 2, and 4.

Images