Repair coating support system and repair coating support method

The repair painting support system and method address the complexity of existing toning end point determination by using vehicle identification and painting information to select repair methods efficiently, including decal repairs, through image analysis and stored data.

JP2024162089AActive Publication Date: 2024-11-21TOYOTA JIDOSHA KK
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
JP2023077281
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-09
Publication Date
2024-11-21
Estimated Expiration
2043-05-09

AI Technical Summary

Technical Problem

Existing methods for determining the toning end point in repair painting require complex measurements using multi-angle colorimeters, limiting their applicability and not addressing decal repair needs.

Method used

A repair painting support system and method that associate vehicle identification and painting information, extract repair location information from images, and select a repair painting method based on stored data without requiring complicated measurements.

Benefits of technology

Enables selection of a repair painting method without complex measurements, allowing for efficient repair painting of vehicles, including decals, by utilizing smartphone images and stored data to determine optimal repair methods and materials.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024162089000001_ABST
    Figure 2024162089000001_ABST
Patent Text Reader

Abstract

To provide a repair coating support system which can select a repair coating method with no need of carrying out complicated measurement.SOLUTION: A repair coating support system comprises: a storage device which stores identification information of a vehicle and coating information of the vehicle in association with each other; and a processing device. The processing device is configured to: extract repair portion information regarding a portion where repair coating is required and the identification information from an image of the vehicle; retrieve the coating information associated with the extracted identification information from the storage device; and select a repair coating method based on the retrieved coating information and the extracted repair portion information.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to a repair painting support system and a repair painting support method. [Background technology]

[0002] There has been known an invention relating to a method for determining the end point of color matching using a multi-angle colorimeter and a micro-color brilliance meter in the color matching of a paint having a lustrous feel for repair painting (see Patent Document 1 below). According to this method, even a color matcher with little experience in color matching can match colors without hesitation in determining the end point of color matching in repair painting of a coating film having a lustrous feel, and it is also possible to eliminate individual differences in the determination of the end point of color matching (Patent Document 1, Abstract, paragraph 0083, etc.). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2001-318000 A Summary of the Invention [Problem to be solved by the invention]

[0004] The color matching end point determination method described in Patent Document 1 requires complex measurements such as measurements at two or more angles using a multi-angle colorimeter. Therefore, the present disclosure provides a repair painting support system and a repair painting support method that can select a repair painting method without requiring complex measurements. [Means for solving the problem]

[0005] One aspect of the present disclosure is a repair painting support system that includes a memory device that stores identification information of a vehicle in association with painting information related to the painting of the vehicle, and a processing device, wherein the processing device extracts repair area information and the identification information related to areas requiring repair painting from an image of the vehicle, obtains the painting information associated with the extracted identification information from the memory device, and selects a repair painting method based on the obtained painting information and the extracted repair area information.

[0006] Another aspect of the present disclosure is a repair painting support method comprising: a painting information storage step of associating identification information of a vehicle with painting information related to the painting of the vehicle and storing the associated information in a storage device; an imaging step of taking images of a portion of the vehicle including the identification information and an area requiring repair painting; an information extraction step of extracting repair area information and the identification information related to the area requiring repair painting from the images taken in the imaging step; a painting information acquisition step of acquiring the painting information associated with the identification information extracted in the information extraction step from the storage device; and a step of selecting a repair painting method based on the painting information acquired in the painting information acquisition step and the repair area information extracted in the information extraction step. Effect of the Invention

[0007] According to each of the above aspects of the present disclosure, it is possible to provide a repair painting support system and a repair painting support method that are capable of selecting a repair painting method without requiring complex measurements. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a flow chart showing an embodiment of a repair painting support method according to the present disclosure. [Diagram 2] FIG. 1 is a flow chart showing an embodiment of a repair painting support method according to the present disclosure. [Diagram 3] FIG. 1 is a flow chart showing an embodiment of a repair painting support method according to the present disclosure. [Figure 4] FIG. 1 is a flow chart showing an embodiment of a repair painting support method according to the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, embodiments of a repair painting support system and a repair painting support method according to the present disclosure will be described with reference to the drawings.

[0010] 1 to 4 are flow charts showing an embodiment of a repair painting support method using a repair painting support system according to the present disclosure. The repair painting support system of the present embodiment can be configured by one or more computing devices including a storage device and a processing device, such as a network server.

[0011] The repair painting support system and repair painting support method of the present embodiment support repair painting by automatically selecting a repair painting method for repairing damage such as scratches that has occurred in the paint of a vehicle, including a decal. The repair painting support method of the present embodiment includes a painting information storage step that is performed, for example, before each step shown in Figures 1 to 4. The painting information storage step is performed, for example, after the painting step is completed in a vehicle manufacturing plant.

[0012] In the painting information storage step, for example, vehicle identification information and painting information related to the painting of the vehicle are stored in association with each other in a storage device of a computing device constituting the repair painting support system of this embodiment. The vehicle identification information includes, for example, at least one of the vehicle registration number written on the license plate of the vehicle and the chassis number written on the chassis of the vehicle. The painting information includes, for example, at least one of a color number determined for each vehicle model by the automobile manufacturer, color measurement data measured at the vehicle manufacturing plant, and performance data of the repair painting method.

[0013] When a user of the repair painting support system starts the process flow of the repair painting support method shown in FIG. 1, first, an imaging step P101 is performed to capture an image of a vehicle. In this imaging step P101, the user takes an image of a part including the vehicle's identification information and a part that needs repair painting, for example, with a smartphone camera. The part including the vehicle's identification information is, for example, the vehicle's license plate or a chassis part such as a dash panel. The image captured in the imaging step P101 is transmitted to a computing device constituting the repair painting support system, for example, via a wireless communication line and a network such as the Internet.

[0014] Thereafter, the repair painting support system executes an information extraction step P102 for extracting information from the image captured in the imaging step P101, as shown in Fig. 1. In this information extraction step P102, the processing device of the repair painting support system extracts repair location information relating to locations requiring repair painting and vehicle identification information from the vehicle image captured in the imaging step P101.

[0015] More specifically, the processing device executes a program stored in the storage device and performs image processing to identify the vehicle model, extract repair location information including locations that require repair painting, and store the information in the storage device. The processing device also extracts and reads vehicle identification information, such as the vehicle registration number and chassis number, from the vehicle image, and stores the information in the storage device.

[0016] Thereafter, the repair painting support system performs, in parallel, for example, a painting information acquisition step P103 shown in Fig. 1, a step P201 for determining whether the vehicle is a company-manufactured vehicle or not shown in Fig. 2, and a damage type determination step P401 shown in Fig. 4. In the painting information acquisition step P103 shown in Fig. 1, the processing device of the repair painting support system acquires, for example, painting information associated with the vehicle identification information extracted in the above-mentioned information extraction step P102 from the storage device of the repair painting support system. Note that the painting information may include information on decals to be affixed to the vehicle in addition to the above-mentioned color measurement data measured at the vehicle manufacturing plant.

[0017] 2, in step P201 for determining whether the vehicle is manufactured by the company, the processing device of the repair painting support system determines whether the vehicle photographed in the above-mentioned vehicle photographing step P101 is manufactured by the company, based on the information extracted in the above-mentioned information extraction step P102. In this step P201, if the processing device determines that the photographed vehicle is manufactured by the company (YES), it executes a color determination step P202.

[0018] If the processing device determines that the photographed vehicle is not manufactured by the company (NO), the processing device goes through step P203 to notify the user that the reliability of the selection of the repair painting method is reduced, and then executes color judgment step P202. In color judgment step P202, the processing device determines the company's color number based on the information extracted in step P102, for example. In this color judgment step P202, the processing device may also determine the color code or the lightness and chromaticity of the L*a*b* color space based on the information extracted from the image, for example.

[0019] Thereafter, the processing device of the repair painting support system performs step P204, for example, to compare the result of the judgment in the color judgment step P202 with the painting information acquired in the above-mentioned painting information acquisition step P103. The processing device also performs step P205, for example, to refer to a database that associates and stores painting information including color numbers and factory color measurement data with the results of repair painting methods, and extracts the repair painting method associated with the painting information acquired in the above-mentioned painting information acquisition step P103.

[0020] Furthermore, the processing device of the repair painting support system performs a process P206 of selecting a repair painting method based on the acquired painting information and the extracted repair part information. More specifically, the processing device selects a repair painting method based on, for example, the collation result of process P204 and the extraction result of process P205. If the paint color of the vehicle based on the collation result of process P204 has a specific color number, the repair painting method may be limited.

[0021] The processing device may also select a repair coating method that has a proven track record for a specific color number or factory color measurement data, for example, based on the extraction result of step P205. In step P206, the processing device of the repair coating support system selects a repair coating method for producing a repair film that is formed on a polypropylene substrate and then peeled off for use. Repair coating methods include, for example, painting, regular printing such as gravure printing or screen printing, or inkjet printing (steps P207-P209).

[0022] Thereafter, the processing device of the repair painting support system performs, for example, step P210 of selecting the layer structure and film thickness of the repair painting according to the repair painting method selected in step P206, step P211 of selecting paint and ink, and step P212 of calculating the material cost. Furthermore, the processing device performs, for example, step P213 of acquiring image-related information. The image-related information includes, for example, information on the date and time when the image of the vehicle was taken in step P101, the weather, the illuminance, the angle of the camera relative to the subject at the time of taking the image, the distance between the camera and the subject, the reflection of surrounding objects on the painted surface, the part and its shape that was taken, the model of the smartphone, and the like.

[0023] Thereafter, the processing device of the repair painting support system performs, for example, a database comparison step P301 shown in Fig. 3. In this step P301, the processing device of the repair painting support system extracts a target value of color tone using artificial intelligence (AI) from a database in which the above-mentioned image-related information, repair painting color matching data, repair performance, customer satisfaction, etc. are stored in association with each other. Furthermore, the processing device performs a step P302 in which the target value of color tone extracted in step P301 is determined as the target value of color tone for the repair painting.

[0024] Thereafter, the processing device of the repair painting support system performs step P303 of judging whether or not there is repair film in stock based on the target color tone value determined in step P302, and performs inventory management step P304 if it judges that there is stock (YES). In this inventory management step P304, the processing device presents, for example, information about the repair film in stock to the user of the repair painting support system. The user of the repair painting support system then performs step P312 of cutting the optimal color portion of the presented stock of repair film, and step P313 of attaching the cut repair patch.

[0025] On the other hand, if the processing device of the repair painting support system determines that there is no inventory (NO) in step P303 for determining the availability of repair film in stock, it executes step P305 for determining the availability of color reliability. If the processing device determines that there is no color reliability (NO) in this step P305, it notifies the user of the repair painting support system that repair painting using the repair patch is not possible (step P306), and ends the processing flow as shown in FIG.

[0026] Furthermore, if the processing device determines in step P305 that there is color reliability (YES), it executes step P307, which determines the color reliability between low and high and determines the gradation. In this step P307, the processing device determines the distance and color gamut of the toning gradation according to the color reliability. More specifically, the smaller the color reliability, the larger the gradation distance and color gamut are set by the processing device.

[0027] Thereafter, the processing device of the repair painting support system performs, for example, step P308 of selecting a gradation method. More specifically, in this step P308, the processing device selects the optimal gradation method from the first method, the second method, and the third method according to, for example, the gradation distance and color gamut determined in step P307 (steps P309-P311).

[0028] The first method is, for example, a method of printing or painting by gradually changing the numerical values ​​of the L*a*b* color space from the center of the repair film. The second method is, for example, a method of printing or painting by gradually changing the film thickness of the base color or color clear from the center color. The third method is, for example, a method of gradually making the film transparent from the repair location toward the edge of the film. After that, the user of the repair painting support system performs process P312 of cutting the optimal color part of the repair film created by the presented gradation method, and process P313 of attaching the cut repair patch.

[0029] The user also inputs the repair results, including, for example, a photograph of the repaired area after the repair painting, a video of the repair painting, and the color conditions used, as well as the location, size, and shape of the repaired area, and customer satisfaction, to the repair painting support system. The processing device of the repair painting support system performs step P104 of storing the repair results input by the user in a storage device, as shown in Fig. 1, for example, and ends the processing flow.

[0030] Furthermore, in the repair painting support method of this embodiment, after the completion of step P102 shown in Fig. 1, the steps shown in Fig. 4 are carried out in parallel with the steps shown in Fig. 2 and Fig. 3. In a damage type determination step P401 shown in Fig. 4, the processing device of the repair painting support system determines whether the repair area is paint damage or decal damage based on information such as the location, shape, type, size, and depth of the repair area extracted from the image in step P102.

[0031] When the processing device of the repair painting support system determines in step P401 that there is paint damage, it performs step P402, which specifies the paint repair range and part shape. The processing device then performs step P403, which determines whether or not a film can be selected, based on the specified paint repair range and part shape and the film's conformability (flexibility). In this step P403, if the processing device determines that the film cannot be selected (NO), for example, it performs step P306, shown in Fig. 3, which notifies the user that a repair patch is not possible, and ends the processing flow as shown in Fig. 1.

[0032] On the other hand, in step P403, if the processing device determines that a film can be selected (YES), it selects a film suitable for the specified paint repair range and part shape, and performs step P404 of determining the base material of the damaged part. If the processing device determines that the base material of the damaged part is resin, it performs step P410 of calculating the repair cost, and if the processing device determines that the base material of the damaged part is steel plate, it performs step P405 of determining the need for dent repair and step P406 of detecting rust and exposed surfaces.

[0033] After that, the processing device of the repair painting support system performs step P407 to determine whether or not a waterproof film can be used. In this step P407, if the processing device determines that the damaged area is flat and that a waterproof film can be used (YES), it adds a waterproof film to the repair painting (step P408), and if the damaged area is complex in shape and that a waterproof film cannot be used (NO), it adds a waterproof coat to the repair painting (step P409).

[0034] Then, the processing device of the repair painting support system performs step P410 of calculating the cost according to the painting repair method and presenting it to the user, and the user performs step P411 of repairing the dents and scratches in the damaged area. Then, the user performs step P313 of applying the repair patch shown in FIG. 3 described above.

[0035] On the other hand, when the processing device of the repair painting support system determines that the damage is to a decal in the damage type determination step P401 shown in Fig. 4, it performs step P412 to specify the repair range and part shape of the decal. Then, it performs step P413 to search for decal products based on the decal information acquired in the painting information acquisition step P103 shown in Fig. 1, and to determine whether or not the part number of the decal is available.

[0036] If the processing device determines in step P413 that the decal does not have a part number (NO), it proceeds to step P414, where it recognizes the decal design (surface texture, color and pattern), and creates inkjet print data according to the recognized design (step P415).On the other hand, if the processing device determines in step P413 that the decal has a part number (YES), it creates inkjet print data according to the part number (step P415).

[0037] After that, the processing device of the repair painting support system operates, for example, an inkjet printer to print a film and select a surface texture film (steps P416-P417). In addition, the user uses, for example, a laminating device to laminate the selected film and the printed film (step P418). After that, the user performs step P419 to attach the decal produced by the lamination process to the repair location.

[0038] The user also inputs the repair results, including, for example, a photograph of the repaired area after the repair painting, a video of the repair painting, and the color conditions used, as well as the location, size, and shape of the repaired area, and customer satisfaction, to the repair painting support system. The processing device of the repair painting support system performs step P104 of storing the repair results input by the user in a storage device, as shown in Fig. 1, for example, and ends the processing flow.

[0039] The operation of the repair painting support system and the repair painting support method of the present embodiment will be described below in comparison with the conventional technology.

[0040] The conventional color matching end point judgment method described in the above Patent Document 1 requires complex measurements such as measurements at two or more angles using a multi-angle colorimeter. In addition, this conventional method is limited to judging only the color, does not lead to a proposal of a repair method, and cannot deal with decals. Furthermore, it is difficult to make a judgment unless the equipment is owned, and it is not possible to immediately respond at a dealership. More specifically, the multi-angle colorimeter judges only the color of a very small area, and cannot grasp the situation such as the shape of the repair part and the depth of the damage. In addition, the conventional method cannot recognize the color pattern or surface texture of the decal. In addition, the conventional method not only limits the repair method to the repair paint material, but also judges the color matching based on the manufacturer's standard and the worker's standard, and cannot propose materials based on the vehicle history or make a judgment taking into account the customer's required level.

[0041] In contrast, the repair painting support system of this embodiment includes a storage device that stores vehicle identification information and painting information related to painting of the vehicle in association with each other, and a processing device, as described above. The processing device extracts repair location information and identification information related to locations requiring repair painting from an image of the vehicle, obtains painting information associated with the extracted identification information from the storage device, and selects a repair painting method based on the obtained painting information and the extracted repair location information.

[0042] As described above, the repair painting support method of this embodiment includes a painting information storage step, an imaging step P101, an information extraction step P102, a painting information acquisition step P103, and a step P206 for selecting a repair painting method. The painting information storage step is a step for storing the identification information of a vehicle and the painting information related to the painting of the vehicle in association with each other in a storage device. The imaging step P101 is a step for taking an image of a part including the identification information of the vehicle and a part requiring repair painting. The information extraction step P102 is a step for extracting repair part information related to a part requiring repair painting and the identification information of the vehicle from the image taken in the imaging step P101. The painting information acquisition step P103 is a step for acquiring the painting information associated with the identification information extracted in the information extraction step P102 from the storage device. The step P206 is a step for selecting a repair painting method based on the painting information acquired in the painting information acquisition step P103 and the repair part information extracted in the information extraction step P102.

[0043] With such a configuration, the repair painting support system and the repair painting support method of the present embodiment can provide a system and a method that can select a repair painting method without requiring complicated measurements. That is, by using an image taken by a camera such as a smartphone, complicated measurements using a multi-angle colorimeter or the like are not required. In addition, by acquiring the painting information stored in the storage device at the time of vehicle manufacture, it is possible to grasp even minute color differences such as the paint used on the vehicle and its lot, and to confirm the painting method required for repair.

[0044] Furthermore, the repair location information extracted from the image is collated with the painting information at the time of vehicle manufacture and customer satisfaction, and the optimum repair patch film can be produced by selecting the method of producing the paint or decal repair patch film and determining the repair range, etc. Also, the vehicle history can be collated from the vehicle identification information extracted from the image, and the least expensive method can be proposed, for example, from among painted film, printed film, and inkjet film, based on the painting information including factory color measurement data from when the vehicle was new.

[0045] In addition, the system can determine the depth of the repair based on the repair area information extracted from the image, and determine the necessity and method of base preparation. Furthermore, the system can match decal products using the repair area information, and if there is no corresponding product, it can recognize the design (color, pattern, and texture) from the repair area information and create a repair film.

[0046] The above describes in detail the embodiments of the repair painting support system and repair painting support method according to the present disclosure using the drawings, but the specific configuration is not limited to this embodiment, and even if there are design changes, etc., within the scope that does not deviate from the gist of the present disclosure, they are included in the present disclosure. [Explanation of symbols]

[0047] P101 Imaging process P102 Information extraction process P103 Painting information acquisition process P206 Process for selecting repair painting method

Claims

1. A repair painting support system including a storage device that stores vehicle identification information and painting information related to painting of the vehicle in association with each other, and a processing device, The processing device extracts repair area information and the identification information regarding areas requiring repair painting from the image of the vehicle, obtains the painting information associated with the extracted identification information from the storage device, and selects a repair painting method based on the obtained painting information and the extracted repair area information.

2. a coating information storage step of storing, in a storage device, identification information of a vehicle and coating information relating to coating of the vehicle in association with each other; an imaging step of taking an image of a portion of the vehicle including the identification information and a portion that requires repair painting; an information extraction step of extracting repair location information and the identification information relating to the location requiring repair painting from the image captured in the imaging step; a coating information acquisition step of acquiring, from the storage device, the coating information associated with the identification information extracted in the information extraction step; selecting a repair painting method based on the painting information acquired in the painting information acquisition step and the repair part information extracted in the information extraction step; A repair painting support method comprising the steps of:

Citation Information

Patent Citations

  • Vehicle diagnosis method, terminal device, and computer-readable storage medium

    JP2019524523A

  • Production method of coating material and prediction method of color data

    JP2021188046A

  • Method of judging toning end point

    JP2001318000A