Repair painting support system and repair painting support method

Abstract

To provide a repair coating support system which can select a repair coating method with no need of carrying out complicated measurement.SOLUTION: A repair coating support system comprises: a storage device which stores identification information of a vehicle and coating information of the vehicle in association with each other; and a processing device. The processing device is configured to: extract repair portion information regarding a portion where repair coating is required and the identification information from an image of the vehicle; retrieve the coating information associated with the extracted identification information from the storage device; and select a repair coating method based on the retrieved coating information and the extracted repair portion information.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present disclosure relates to a repair coating support system and a repair coating support method.

Background Art

[0002] Conventionally, there has been known an invention related to a method for judging a toning end point using a multi-angle colorimeter and a micro-brightness measuring device in toning a paint having brightness for repair coating (see Patent Document 1 below). According to this method, in repair coating of a coating film having brightness, even a toning operator with little toning experience can perform toning without hesitation in judging the toning end point, and individual differences in the judgment of the toning end point can be eliminated (see Patent Document 1, Abstract, Paragraph 0083, etc.).

Prior Art Literature

Patent Literature

[0003]

Patent Document 1

Summary of the Invention

Problem to be Solved by the Invention

[0004] The method for judging a toning end point described in the above Patent Document 1 requires complicated measurement such as measurement under two or more angle conditions using a multi-angle colorimeter. Accordingly, the present disclosure provides a repair coating support system and a repair coating support method that enable selection of a repair coating method without requiring complicated measurement.

Means for Solving the Problem

[0005] One aspect of the present disclosure is a repair painting support system comprising a storage device for storing vehicle identification information and painting information relating to the painting of the vehicle in association with each other, and a processing device, wherein the processing device extracts repair location information relating to areas requiring repair painting and the identification information from an image of the vehicle, obtains the painting information associated with the extracted identification information from the storage device, and selects a repair painting method based on the obtained painting information and the extracted repair location information.

[0006] Another aspect of this disclosure is a repair painting support method characterized by including: a painting information storage step of associating vehicle identification information and painting information relating to the painting of the vehicle and storing them in a storage device; an imaging step of taking images of the portion of the vehicle including the identification information and the portion requiring repair painting; an information extraction step of extracting repair location information relating to the portion requiring repair painting and the identification information from the images taken in the imaging step; a painting information acquisition step of acquiring the painting information associated with the identification information extracted in the information extraction step from the storage device; and a step of selecting a repair painting method based on the painting information acquired in the painting information acquisition step and the repair location information extracted in the information extraction step. [Effects of the Invention]

[0007] According to each of the above embodiments of this disclosure, it is possible to provide a repair painting support system and a repair painting support method that enable the selection of a repair painting method without requiring complex measurements. [Brief explanation of the drawing]

[0008] [Figure 1] A flowchart illustrating one embodiment of the repair painting support method related to this disclosure. [Figure 2] A flowchart illustrating one embodiment of the repair painting support method related to this disclosure. [Figure 3] A flowchart illustrating one embodiment of the repair painting support method related to this disclosure. [Figure 4] A flowchart illustrating one embodiment of the repair painting support method related to this disclosure. [Modes for carrying out the invention]

[0009] Hereinafter, embodiments of the repair painting support system and repair painting support method relating to this disclosure will be described with reference to the drawings.

[0010] Figures 1 to 4 are flowcharts illustrating one embodiment of a repair painting support method using the repair painting support system according to this disclosure. The repair painting support system of this embodiment can be configured by one or more computing devices including a storage device and a processing device, such as a network server.

[0011] The repair painting support system and repair painting support method of this embodiment support repair painting by automatically selecting a repair painting method for repairing damage such as scratches on the paintwork of a vehicle, including decals. The repair painting support method of this embodiment includes, for example, a painting information storage step performed before each of the steps shown in Figures 1 to 4. The painting information storage step is performed, for example, after the completion of the painting process at a vehicle manufacturing plant.

[0012] In the painting information storage process, for example, vehicle identification information and painting information relating to the vehicle's paintwork are stored in association with each other in the storage device of the arithmetic unit constituting the repair painting support system of this embodiment. The vehicle identification information includes, for example, at least one of the vehicle registration number written on the vehicle's license plate and the chassis number written on the vehicle's chassis. The painting information includes, for example, at least one of the color number specified for each vehicle model by the automobile manufacturer, color measurement data measured at the vehicle manufacturing plant, and actual data on the repair painting method.

[0013] When a user of the repair painting support system starts the processing flow of the repair painting support method shown in Figure 1, they first perform an imaging step P101 in which they take an image of the vehicle. In this imaging step P101, the user takes images of parts of the vehicle that contain identification information and areas that require repair painting, for example, using the camera of a smartphone. Parts that contain identification information of the vehicle include, for example, the vehicle's license plate or chassis parts such as the dashboard. The images taken in imaging step P101 are transmitted to the computing device that constitutes the repair painting support system via a network such as a wireless communication line and the internet.

[0014] Subsequently, the repair painting support system executes an information extraction process P102, which extracts information from the image captured in the imaging process P101, as shown in Figure 1, for example. In this information extraction process P102, the processing unit of the repair painting support system extracts information about the areas requiring repair painting and vehicle identification information from the image of the vehicle captured in the imaging process P101.

[0015] More specifically, the processing unit, for example, executes a program stored in the storage device and performs image processing to identify the vehicle type and extracts repair location information, including the parts that require repainting, and stores it in the storage device. The processing unit also extracts and reads vehicle identification information, such as the vehicle registration number and chassis number, from the vehicle image and stores it in the storage device.

[0016] Subsequently, the repair painting support system performs, for example, the painting information acquisition process P103 shown in Figure 1, the process P201 for determining whether or not the vehicle is manufactured in-house, as shown in Figure 2, and the damage type determination process P401 shown in Figure 4, in parallel. In the painting information acquisition process P103 shown in Figure 1, the processing unit of the repair painting support system acquires, for example, painting information associated with the vehicle identification information extracted in the aforementioned information extraction process P102, from the storage device of the repair painting support system. The painting information may include not only the color measurement data measured at the vehicle manufacturing plant as described above, but also information on decals to be affixed to the vehicle.

[0017] In step P201 for determining whether the vehicle is manufactured by the company as shown in Fig. 2, the processing device of the repair painting support system determines, based on the information extracted in the foregoing information extraction step P102, whether the vehicle photographed in the foregoing vehicle photographing step P101 is a vehicle manufactured by the company. In step P201, when the processing device determines (YES) that the photographed vehicle is a vehicle manufactured by the company, it executes color determination step P202.

[0018] In addition, when the processing device determines (NO) that the photographed vehicle is not a vehicle manufactured by the company, it executes color determination step P202 after step P203 of notifying the user that the reliability of repair painting method selection will decrease. In color determination step P202, the processing device determines, for example, the in-house color number based on the information extracted in step P102. Also, in this color determination step P202, the processing device may determine, for example, the color code or the lightness and chromaticity in L*a*b* color space based on information extracted from the image.

[0019] Thereafter, the processing device of the repair painting support system executes, for example, step P204 of collating the result determined in color determination step P202 with the painting information acquired in the foregoing painting information acquisition step P103. In addition, the processing device executes, for example, step P205 of extracting a repair painting method associated with the painting information acquired in the foregoing painting information acquisition step P103 by referring to a database that stores painting information including color numbers and factory color measurement data in association with the performance of repair painting methods.

[0020] Furthermore, the processing device of the repair painting support system executes step P206 of selecting a repair painting method based on the acquired painting information and the extracted repair location information. More specifically, the processing device selects the repair painting method based on, for example, the collation result of step P204 and the extraction result of step P205. When the color of the vehicle paint based on the collation result of step P204 corresponds to a specific color number, the repair painting method may be limited.

[0021] Furthermore, the processing device may, for example, based on the extraction result of step P205, select a repair coating method that has many accumulated results for a specific color number or factory color measurement data. In step P206, the processing device of the repair coating support system selects a repair coating method for producing a repair film that is used after being formed on a polypropylene base material and then peeled off. The repair coating method includes, for example, coating, ordinary printing such as gravure printing or screen printing, or inkjet printing (steps P207-P209).

[0022] Thereafter, the processing device of the repair coating support system implements, according to the repair coating method selected in step P206, step P210 of selecting the layer structure and film thickness of the repair coating, step P211 of selecting paints and inks, and step P212 of calculating material costs. Furthermore, the processing device implements, for example, step P213 of acquiring image-related information. The image-related information includes, for example, information such as the date and time when the vehicle image was captured in step P101, weather, illuminance, the angle of the camera relative to the subject during shooting, the distance between the camera and the subject, reflection of surrounding objects on the painted surface, the captured part and its shape, and the model of the smartphone.

[0023] Thereafter, the processing device of the repair coating support system implements, for example, the database matching step P301 shown in FIG. 3. In this step P301, the processing device of the repair coating support system extracts a target value of color tone using artificial intelligence (AI) from a database in which the aforementioned image-related information, repair coating toning data, repair results, customer satisfaction and the like are stored in association with each other. Furthermore, the processing device implements step P302 of determining the target value of color tone extracted in step P301 as the target value of color tone for repair coating.

[0024] Subsequently, the processing unit of the repair painting support system performs a process P303 to determine whether or not there is stock of repair film based on the target color value determined in process P302. If it determines that there is stock (YES), it performs an inventory response process P304. In this inventory response process P304, the processing unit presents information about the stock of repair film to the user of the repair painting support system. Subsequently, the user of the repair painting support system performs a process P312 to cut the optimal color portion of the presented stock of repair film and a process P313 to apply the cut repair patch.

[0025] On the other hand, in step P303, which determines whether or not there is stock of repair film, the processing unit of the repair painting support system performs step P305, which determines whether or not there is color reliability. If the processing unit determines in step P305 that there is no color reliability (NO), it notifies the user of the repair painting support system that repair painting with a repair patch is not possible (step P306), and terminates the processing flow as shown in Figure 1.

[0026] Furthermore, if the processing unit determines in step P305 that there is color reliability (YES), it executes step P307 to determine the color reliability on a scale from small to large and to determine the gradient. In this step P307, the processing unit determines the distance and color gamut of the color toning gradient according to the color reliability. More specifically, the processing unit increases the gradient distance and color gamut as the color reliability decreases.

[0027] Subsequently, the processing unit of the repair painting support system performs, for example, step P308, which involves selecting a gradation method. More specifically, in step P308, the processing unit selects the optimal gradation method from among the first method, the second method, and the third method, depending on, for example, the gradation distance and color range determined in step P307 (steps P309-P311).

[0028] The first method is, for example, to print or paint by gradually changing the numerical values ​​in the L*a*b* color space from the center of the repair film. The second method is, for example, to print or paint by gradually changing the film thickness of the base color or color clear from the center color. The third method is, for example, to gradually make the film transparent from the repair area toward the edge. Subsequently, the user of the repair painting support system performs the steps P312 of cutting the optimal color portion of the repair film produced by the presented gradient method and the step P313 of applying the cut repair patch.

[0029] Furthermore, the user inputs repair results into the repair painting support system, including, for example, a photograph of the repaired area after painting, a video of the repair painting process, the color conditions used, as well as the location, size, and shape of the repaired area, and customer satisfaction. The processing unit of the repair painting support system then performs step P104, for example as shown in Figure 1, to store the repair results input by the user in a storage device, and terminates the processing flow.

[0030] Furthermore, in the repair painting support method of this embodiment, after the completion of step P102 shown in Figure 1, the steps shown in Figure 4 are performed in parallel with the steps shown in Figures 2 and 3. In the damage type determination step P401 shown in Figure 4, the processing device of the repair painting support system determines whether the repair area is paint damage or decal damage, for example, based on information such as the location, shape, type, size, and depth of the repair area extracted from the image in step P102.

[0031] If the processing unit of the repair painting support system determines in step P401 that there is paint damage, it performs step P402 to identify the repair area and part shape of the paint. Furthermore, the processing unit performs step P403 to determine whether a film can be selected based on the identified repair area and part shape of the paint and the conformability (flexibility) of the film. In step P403, if the processing unit determines, for example, that film selection is not possible (NO), it performs step P306 to notify the user that the repair patch is not possible, as shown in Figure 3, and terminates the processing flow as shown in Figure 1.

[0032] Meanwhile, in step P403, if the processing device determines, for example, that film selection is possible (YES), it selects a film suitable for the identified paint repair area and part shape, and performs step P404 to determine the substrate of the damaged area. If the processing device determines that the substrate of the damaged area is resin, it performs step P410 to calculate the repair cost. If it determines that the substrate of the damaged area is steel plate, it performs step P405 to determine the need for dent repair and step P406 to detect rust and exposed surfaces.

[0033] Subsequently, the processing unit of the repair painting support system performs step P407 to determine whether or not a waterproof film can be used. In step P407, for example, if the processing unit determines that the damaged area is flat and a waterproof film can be used (YES), it adds a waterproof film to the repair paint (step P408). If the damaged area has a complex shape and a waterproof film cannot be used (NO), it adds a waterproof coating to the repair paint (step P409).

[0034] Subsequently, the processing unit of the repair painting support system performs step P410, which calculates the cost according to the painting repair method and presents it to the user. The user then performs step P411, which repairs dents and scratches on the damaged area. After that, the user performs step P313, which involves applying the repair patch shown in Figure 3.

[0035] On the other hand, in the damage type determination process P401 shown in Figure 4, if the processing device of the repair painting support system determines that the damage is to the decal, it performs a process P412 to identify the repair area and part shape of the decal. Subsequently, based on the decal information obtained in the painting information acquisition process P103 shown in Figure 1, it searches for the decal product and performs a process P413 to determine whether or not the decal has a part number.

[0036] In step P413, if the processing unit determines that there is no decal part number (NO), it proceeds through step P414 to recognize the decal design (surface texture, color pattern) and then creates inkjet printing data corresponding to the recognized design (step P415). On the other hand, if the processing unit determines in step P413 that there is a decal part number (YES), it creates inkjet printing data corresponding to that part number (step P415).

[0037] Subsequently, the processing unit of the repair painting support system operates, for example, an inkjet printer to print a film and select a surface textured film (steps P416-P417). The user then uses, for example, a laminating device to laminate the selected film with the printed film (step P418). After that, the user performs step P419, in which they apply the decal produced by lamination to the repair area.

[0038] Furthermore, the user inputs repair results into the repair painting support system, including, for example, a photograph of the repaired area after painting, a video of the repair painting process, the color conditions used, as well as the location, size, and shape of the repaired area, and customer satisfaction. The processing unit of the repair painting support system then performs step P104, for example as shown in Figure 1, to store the repair results input by the user in a storage device, and terminates the processing flow.

[0039] The operation of the repair painting support system and repair painting support method of this embodiment will be explained below in comparison with conventional technologies.

[0040] The conventional color matching endpoint determination method described in Patent Document 1 above requires complex measurements, such as measurements under two or more angle conditions using a multi-angle colorimeter. Furthermore, this conventional method is limited to color determination only, does not lead to the proposal of repair methods, and cannot handle decals. Moreover, it is difficult to perform the determination without owning the necessary equipment, making it impossible for dealerships to provide immediate service. More specifically, multi-angle colorimeters can only determine the color of a very small area, and cannot grasp the shape of the repair area or the depth of the damage. In addition, the conventional method cannot recognize the color pattern or surface texture of decals. Furthermore, the conventional method not only limits the repair method to repair paint materials, but also makes color matching judgments based on manufacturer standards and worker standards, and cannot propose materials based on vehicle history or make judgments that take into account the customer's required level.

[0041] In contrast, the repair painting support system of this embodiment includes, as described above, a storage device that stores vehicle identification information and painting information related to the vehicle's paintwork in association with each other, and a processing device. The processing device extracts repair location information and identification information related to areas requiring repair painting from an image of the vehicle, obtains painting information associated with the extracted identification information from the storage device, and selects a repair painting method based on the obtained painting information and the extracted repair location information.

[0042] Furthermore, as described above, the repair painting support method of this embodiment includes a painting information storage step, an imaging step P101, an information extraction step P102, a painting information acquisition step P103, and a repair painting method selection step P206. The painting information storage step is a step of associating vehicle identification information and painting information related to the painting of that vehicle and storing it in a storage device. The imaging step P101 is a step of taking images of the part of the vehicle that includes the vehicle identification information and the part that requires repair painting. The information extraction step P102 is a step of extracting repair location information related to the part that requires repair painting and vehicle identification information from the images taken in the imaging step P101. The painting information acquisition step P103 is a step of acquiring painting information associated with the identification information extracted in the information extraction step P102 from a storage device. Step P206 is a step of selecting a repair painting method based on the painting information acquired in the painting information acquisition step P103 and the repair location information extracted in the information extraction step P102.

[0043] With this configuration, the repair painting support system and repair painting support method of this embodiment provide a system and method that makes it possible to select a repair painting method without requiring complex measurements. In other words, by using images captured by a camera such as a smartphone, it becomes unnecessary to perform complex measurements using a multi-angle colorimeter or the like. Furthermore, by acquiring painting information from the time of vehicle manufacture stored in a memory device, it is possible to understand even fine color differences, such as the paint used on the vehicle and its lot number, and to confirm the painting method necessary for repair.

[0044] Furthermore, by comparing the repair location information extracted from the image with paint information from the vehicle's manufacturing and customer satisfaction, it is possible to select the manufacturing method for the paint or decal repair patch film and determine the repair area, thereby creating the optimal repair patch film. In addition, by comparing the vehicle history with the vehicle identification information extracted from the image, and based on paint information including factory color measurement data from when the vehicle was new, it is possible to propose the most cost-effective method among, for example, paint film, printed film, and inkjet film.

[0045] Furthermore, based on the repair location information extracted from the image, the repair depth can be determined, and the necessity and method of surface preparation can be determined. In addition, the repair location information can be used to match decal products, and if no matching product is found, the design (color, pattern, and texture) can be recognized from the repair location information to create a repair film.

[0046] While embodiments of the repair painting support system and repair painting support method relating to this disclosure have been described in detail above using drawings, the specific configuration is not limited to these embodiments, and any design changes, etc., that do not depart from the gist of this disclosure are also included in this disclosure. [Explanation of Symbols]

[0047] P101 Imaging Process P102 Information extraction process P103 Painting Information Acquisition Process P206 Process for selecting a repair painting method

Claims

1. A repair painting support system comprising a storage device and a processing device that stores vehicle identification information and painting information relating to the vehicle's paint and decals affixed to the vehicle in association, The processing device extracts from the image of the vehicle repair location information and identification information regarding the location of damage to the paint or decal that requires repair, and determines whether the damage is to the paint or the decal based on the extracted repair location information. A repair painting support system characterized by determining that the damage is to the decal, identifying the repair area included in the repair location information of the decal, determining whether there is a part number for the decal based on the decal information included in the paint information associated with the identification information, and if it is determined that there is no part number, recognizing the design of the decal from the paint information associated with the identification information, and creating inkjet printing data for producing a repair patch film to repair the decal in the repair area according to the recognized design.

2. An information extraction step in which a processing device extracts information about the location of damage requiring repair and the identification information from an image of a portion of the vehicle including vehicle identification information and an image of a location of damage to the vehicle's paint or a decal affixed to the vehicle that requires repair, A damage type determination step in which the processing device determines whether the damage is to the paint or to the decal, based on the repair location information extracted in the information extraction step, If, in the damage type determination step, the damage is determined to be damage to the decal, the processing device identifies the repair area included in the repair location information of the decal. The process involves the processing device determining whether or not the decal part number exists based on the repair range identified in the identification step and the decal information included in the paint information associated with the identification information stored in the storage device, If it is determined in the determination step that the part number does not exist, the processing device recognizes the design of the decal from the paint information associated with the identification information, The process includes the creation of inkjet printing data by the processing device for producing a repair patch film to repair the decal in the repair area, in accordance with the design recognized in the recognition step, A repair painting support method characterized by including the following.

Images