A maintenance system that automatically determines the vehicle's sheet metal and paint condition

Abstract

The present invention relates to a maintenance system for automatically determining the sheet metal and paint condition of an automobile, implemented as a computing device comprising one or more processors and one or more memories for storing instructions executable by said processors, wherein when an automobile to be maintained is located in a sheet metal and paint maintenance area, a status information receiving unit controls a status measurement module located in one area of ​​said sheet metal and paint maintenance area to receive status information based on the sheet metal and paint condition of said automobile to be maintained; when the reception of said status information is completed, an abnormality verification process executing unit performs an abnormality verification process capable of identifying whether there is an abnormality in the exterior of said automobile to be maintained and whether there is an abnormality in the interior sheet metal of said automobile to be maintained based on said status information; and when at least one of the damaged area of ​​the exterior of said automobile to be maintained and the damaged area of ​​the interior sheet metal of said automobile to be maintained is identified upon completion of said abnormality verification process, a maintenance guide information providing unit analyzes said identified damaged area based on a previously stored maintenance algorithm and, through said analysis result, generates maintenance guide information for restoring the sheet metal and paint condition of said automobile to be maintained located in said sheet metal and paint maintenance area to its original state and provides it to a mechanic account. In addition, various embodiments identified through this document are possible.

Description

Technology Field

[0001] The present invention relates to a maintenance system that automatically determines the sheet metal and paint condition of an automobile. Specifically, the invention relates to a technology that receives condition information regarding an automobile to be maintained located in a sheet metal and paint maintenance area through a condition measurement module, identifies whether there are external abnormalities or internal cracks in the sheet metal of the automobile to be maintained based on the received condition information, generates maintenance guide information to guide maintenance thereon, and provides it to a mechanic account. Background Technology

[0002] The automotive industry is undergoing significant changes today. With the rise of the climate crisis, automotive fuels are shifting from traditional petroleum-based fuels like gasoline and diesel to eco-friendly fuels such as electricity and hydrogen. Due to these changes, industries related to internal combustion engines are being evaluated as "declining industries." However, demand for industries related to the vehicle exterior, such as sheet metal work and paintwork, is projected to actually increase. This is because sheet metal work and painting are required for the bodies of electric and hydrogen vehicles that are replacing internal combustion engine cars, and the recent rise in interest in "tuning"—which involves customizing the exterior of a vehicle beyond its functional aspects—is also seen as a positive factor. Nevertheless, acquiring the necessary information and skills requires a considerable amount of time and effort for those wishing to work in these fields, and the industry is developing various technologies to address this issue.

[0003] As an example, Korean registered patent 10-2464844 (Method and system for automotive repair painting using analysis of spray characteristics of a spray gun) discloses a technology for performing repair painting by considering the characteristics of a water-soluble paint and a spray gun used for repair painting.

[0004] However, the aforementioned prior art discloses only a technology for performing repair painting by simply considering the characteristics of water-soluble paints and spray guns. Specifically, it does not disclose a technology for receiving condition information regarding a vehicle to be repaired located in a sheet metal painting maintenance area through a condition measurement module, identifying whether there are external abnormalities or internal cracks in the sheet metal of the vehicle to be repaired based on the received condition information, and generating maintenance guide information to guide maintenance and providing it to a mechanic account. Therefore, there is a need for a technology that can solve this problem. The problem to be solved

[0005] Accordingly, the present invention is derived to solve the problems of the aforementioned prior art. Specifically, it aims to enable even mechanics who are not proficient in maintenance techniques to perform maintenance of a certain quality or higher by receiving status information regarding a vehicle to be serviced located in a sheet metal painting and maintenance area through a status measurement module, identifying whether there are external abnormalities or internal cracks in the sheet metal of the vehicle to be serviced based on the received status information, and generating maintenance guide information to guide maintenance and providing it to a mechanic account. means of solving the problem

[0006] A maintenance system for automatically determining the sheet metal and paint condition of an automobile, implemented as a computing device comprising one or more processors and one or more memories for storing instructions executable by said processors according to an embodiment of the present invention, is characterized by comprising: a status information receiving unit that, when an automobile to be maintained is located in a sheet metal and paint maintenance area, controls a status measurement module located in one area of ​​said sheet metal and paint maintenance area to receive status information based on the sheet metal and paint condition of said automobile to be maintained; an abnormality verification process executing unit that, when the reception of said status information is completed, performs an abnormality verification process capable of identifying whether there is an abnormality in the exterior of said automobile to be maintained and whether there is an abnormality in the interior sheet metal of said automobile to be maintained based on said status information; and a maintenance guide information providing unit that, when at least one of the damaged area of ​​the exterior of said automobile to be maintained and the damaged area of ​​the interior sheet metal of said automobile to be maintained is identified upon completion of said abnormality verification process, analyzes said identified damaged area based on a previously stored maintenance algorithm, and generates maintenance guide information for restoring the sheet metal and paint condition of said automobile to be maintained located in said sheet metal and paint maintenance area to its original state through said analysis result and provides it to a mechanic account.

[0007] Preferably, the above-mentioned condition measurement module comprises: a camera module configured to photograph the exterior of a vehicle to be serviced located in the sheet metal painting maintenance area and to generate image information reflecting the exterior sheet metal condition and paint condition of the vehicle to be serviced; and an ultrasonic sensor module configured to include a transmitter that outputs a first ultrasonic wave to the exterior of the vehicle to be serviced located in the sheet metal painting maintenance area and a receiver that receives a second ultrasonic wave reflected by the exterior of the vehicle to be serviced and to generate ultrasonic information capable of identifying the interior sheet metal condition of the vehicle to be serviced.

[0008] The above status information receiving unit may include: an image information receiving unit that, when the vehicle to be serviced is located in the sheet metal painting and maintenance area, controls a camera module located in one area of ​​the sheet metal painting and maintenance area to receive image information capable of determining whether there is an abnormality in the external sheet metal condition and painting condition of the vehicle to be serviced; and an ultrasonic information receiving unit that, while the function of the image information receiving unit is being performed, controls an ultrasonic sensor module located in one area of ​​the sheet metal painting and maintenance area to receive ultrasonic information capable of determining whether there is an abnormality in the internal sheet metal of the vehicle to be serviced.

[0009] The above-mentioned abnormality verification process execution unit may include: a vehicle object comparison unit that, when the image information receiving unit receives the image information, starts a first abnormality verification process among the abnormality verification processes and implements a first vehicle object, which is a virtual object reflecting the external sheet metal condition and paint condition of the vehicle to be serviced based on the image information in a virtual space, and a second vehicle object, which is a virtual object corresponding to a vehicle of the same model as the vehicle to be serviced, and compares and analyzes the first vehicle object and the second vehicle object; and an exterior damage information generation unit that generates exterior damage information based on the identification result when the function execution of the vehicle object comparison unit is completed and at least one damaged area among the external sheet metal condition and paint condition of the first vehicle object relative to the second vehicle object is identified.

[0010] The above abnormality verification process execution unit may further include: a reference ultrasonic information identification unit that, when the ultrasonic information receiving unit receives the ultrasonic information, initiates a second abnormality verification process among the above abnormality verification processes and identifies the reference ultrasonic information of a vehicle of the same model as the vehicle to be serviced among a plurality of reference ultrasonic information stored in a database; an internal sheet metal abnormality determination unit that, when the identification of the reference ultrasonic information is completed, compares the waveform of the reference ultrasonic information with the waveform of the ultrasonic information and determines whether an abnormality has occurred in the internal sheet metal of the vehicle to be serviced through the similarity rate of the waveform of the ultrasonic information to the waveform of the reference ultrasonic information; and an internal damage information generation unit that, when it is determined that an abnormality has occurred in the internal sheet metal condition of the vehicle to be serviced by the performance of the function of the internal sheet metal abnormality determination unit, identifies the damaged area of ​​the internal sheet metal through the waveform based on the ultrasonic information and generates internal damage information.

[0011] When the internal damage information generation unit determines that an abnormality has occurred in the internal sheet metal condition of the vehicle to be serviced through the performance of the function of the internal judgment abnormality judgment unit, it is possible to analyze the ultrasonic information through a previously stored artificial intelligence algorithm and identify the damaged area, the size of the damaged area, and the location of the damaged area of ​​the internal sheet metal of the vehicle to be serviced through the analysis results.

[0012] The above maintenance guide information providing unit comprises: an exterior maintenance guide generating unit that, when the generation of exterior damage information is completed by the performance of the function of the above anomaly verification process performing unit, analyzes the damaged areas of the exterior bodywork and paint of the vehicle to be maintained based on the exterior damage information based on the previously stored maintenance algorithm, and derives the necessary process product, inventory of the necessary process product, appropriate usage amount of the necessary process product, and process guide used to restore at least one damaged area among the exterior bodywork and paint of the vehicle to be maintained to its original state through the analysis results, thereby generating exterior maintenance guide information; and an interior maintenance guide generating unit that, when the generation of interior damage information is completed by the performance of the function of the above anomaly verification process performing unit, analyzes the damaged area of ​​the interior bodywork of the vehicle to be maintained based on the previously stored maintenance algorithm based on the interior damage information, and derives the necessary process product, inventory of the necessary process product, appropriate usage amount of the necessary process product, and process guide used to restore the interior bodywork condition of the vehicle to be maintained to its original state through the analysis results, thereby generating interior maintenance guide information. It is possible to include a guide providing unit that provides maintenance guide information generated upon completion of the functions of the exterior maintenance guide generating unit and the interior maintenance guide generating unit to the mechanic account, thereby enabling the mechanic, who is the user of the mechanic account, to maintain a vehicle subject to maintenance located in the sheet metal painting maintenance area.

[0013] The above-mentioned previously stored maintenance algorithm may be an algorithm that analyzes and learns the correlation between exterior damage information for another vehicle subject to maintenance, interior damage information for another vehicle subject to maintenance, exterior maintenance guide information for another vehicle subject to maintenance, interior maintenance guide information for another vehicle subject to maintenance, and maintenance history information generated as a result of maintaining another vehicle subject to maintenance, and generates maintenance guide information for restoring at least one of the exterior bodywork, painting, and interior bodywork of the vehicle subject to maintenance to its original state.

[0014] A maintenance system that automatically determines the sheet metal and paint condition of the above-mentioned vehicle can, when the mechanic begins maintenance on the vehicle to be maintained located in the sheet metal and paint maintenance area, identify the tools to be used during maintenance through a process guide based on the maintenance guide information, and then control a lighting module provided in one area of ​​the sheet metal and paint maintenance area where the identified tools are placed to recommend the tools to be used during maintenance to the mechanic. Effects of the invention

[0015] The maintenance system of the present invention, which automatically determines the condition of the sheet metal and paintwork of an automobile, can efficiently perform maintenance on the sheet metal and paintwork of automobiles by providing maintenance guide information to mechanics with little experience in the maintenance industry, where significant effort and time are required for personnel training. Brief explanation of the drawing

[0016] FIG. 1 is a block diagram illustrating a maintenance system that automatically determines the sheet metal and paint condition of an automobile according to one embodiment of the present invention. FIG. 2 is a block diagram illustrating a status information receiving unit of a maintenance system that automatically determines the sheet metal and painting status of an automobile according to one embodiment of the present invention. FIG. 3 is a block diagram illustrating an abnormality verification process execution unit of a maintenance system that automatically determines the sheet metal and painting status of an automobile according to one embodiment of the present invention. FIG. 4 is another block diagram illustrating an abnormality verification process execution unit of a maintenance system that automatically determines the sheet metal and painting status of an automobile according to one embodiment of the present invention. FIG. 5 is a block diagram illustrating a maintenance guide information providing unit of a maintenance system that automatically determines the sheet metal and painting status of an automobile according to one embodiment of the present invention. FIG. 6 is a drawing for explaining an example of the internal configuration of a computing device according to an embodiment of the present invention. Specific details for implementing the invention

[0017] Hereinafter, various embodiments and / or aspects are disclosed with reference to the drawings. For illustrative purposes, numerous specific details are disclosed in the following description to aid in a general understanding of one or more aspects. However, it will also be recognized by those skilled in the art that these aspects may be practiced without such specific details. The following description and the accompanying drawings describe specific exemplary aspects of one or more aspects in detail. However, these aspects are exemplary, and some of the various methods in the principles of the various aspects may be used, and the description is intended to include all such aspects and their equivalents.

[0018] As used herein, terms such as "examples," "examples," "aspects," "examples," etc., may not be interpreted as implying that any aspect or design described is better or more advantageous than other aspects or designs.

[0019] Additionally, the terms “comprising” and / or “comprising” should be understood to mean that the relevant feature and / or component is present, but not to exclude the presence or addition of one or more other features, components and / or groups thereof.

[0020] Additionally, terms including ordinal numbers, such as first, second, etc., may be used to describe various components, but said components are not limited by said terms. Such terms are used solely for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be named the second component, and similarly, the second component may be named the first component. The term "and / or" includes a combination of a plurality of related described items or any of a plurality of related described items.

[0021] Furthermore, in the embodiments of the present invention, all terms used herein, including technical or scientific terms, unless otherwise defined, have the same meaning as generally understood by those skilled in the art to which the present invention pertains. Terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant technology, and should not be interpreted in an ideal or overly formal sense unless explicitly defined in the embodiments of the present invention.

[0022] FIG. 1 is a block diagram illustrating a maintenance system that automatically determines the sheet metal and paint condition of an automobile according to one embodiment of the present invention.

[0023] Referring to FIG. 1, a maintenance system (100) (hereinafter referred to as the maintenance system) for automatically determining the sheet metal and paint condition of a vehicle, implemented as a computing device comprising one or more processors and one or more memories that store instructions that can be executed by said processors, may include a status information receiving unit (101), an abnormality verification process execution unit (103), and a maintenance guide information providing unit (105).

[0024] According to one embodiment, when a vehicle to be serviced is located in a sheet metal painting maintenance area, the state information receiving unit (101) controls a state measurement module (101a) located in one area of ​​the sheet metal painting maintenance area to receive state information based on the sheet metal condition and painting condition of the vehicle to be serviced.

[0025] According to one embodiment, the sheet metal painting maintenance area may be an area in which a plurality of maintenance kits are arranged to restore the sheet metal condition and painting condition of the vehicle to be maintained to their original state, and a condition measurement module (101a), configured to sense the sheet metal condition and painting condition of the vehicle to be maintained, is arranged in each area.

[0026] According to one embodiment, when the state information receiving unit (101) confirms that the vehicle to be serviced is located in one area of ​​the sheet metal painting maintenance area through a load sensor located on the lower surface of the sheet metal painting maintenance area, it can receive state information generated by controlling the state measurement module (101a) to sense the sheet metal condition and painting condition of the vehicle to be serviced.

[0027] According to one embodiment, the state measurement module (101a) may include a camera module and an ultrasonic sensor module.

[0028] In relation to the above, the camera module may be configured to photograph the exterior of a vehicle to be serviced located in the sheet metal painting maintenance area, and may be configured to generate image information reflecting the exterior sheet metal condition and paint condition of the vehicle to be serviced.

[0029] In addition, the ultrasonic sensor module is configured to include a transmitter that outputs a first ultrasonic wave to the exterior of a vehicle to be serviced located in the sheet metal painting maintenance area, and a receiver that receives a second ultrasonic wave reflected by the exterior of the vehicle to be serviced, thereby generating ultrasonic information capable of identifying the internal sheet metal condition of the vehicle to be serviced.

[0030] That is, the state information receiving unit (101) can receive the state information based on the image information received from the camera module and the ultrasonic information received from the ultrasonic sensor module from the state measurement module (101a).

[0031] According to one embodiment, when the abnormality verification process execution unit (103) completes receiving the status information, it can perform an abnormality verification process capable of identifying whether there is an abnormality in the exterior of the vehicle to be serviced and whether there is an abnormality in the interior sheet metal of the vehicle to be serviced, based on the status information.

[0032] According to one embodiment, the abnormality checking process execution unit (103) can perform the abnormality checking process when the status information receiving unit (101) completes receiving the status information.

[0033] More specifically, the above-mentioned anomaly verification process execution unit (103), when the above-mentioned anomaly verification process starts, extracts source information for implementing the above-mentioned vehicle to be maintained into a first vehicle object, which is a virtual object, based on the image information among the above-mentioned status information, and can implement the first vehicle object, which is a virtual object, in a virtual space in which the exterior condition and paint condition of the above-mentioned vehicle to be maintained are reflected through the extracted source information. In relation to the above, a detailed explanation of how the above-mentioned anomaly verification process execution unit (103) performs the above-mentioned anomaly verification process through the above-mentioned image information will be explained in FIG. 3.

[0034] In addition, the above abnormality verification process execution unit (103) can identify whether the internal sheet metal condition of the vehicle to be serviced is normal based on the ultrasonic information when the above abnormality verification process starts. In relation to the above, a detailed explanation of how the above abnormality verification process execution unit (103) performs the above abnormality verification process through the ultrasonic information will be explained in FIG. 4.

[0035] According to one embodiment, when at least one of the damaged area of ​​the exterior of the vehicle to be maintained and the damaged area of ​​the interior sheet metal of the vehicle to be maintained is identified as the abnormality verification process is completed, the maintenance guide information providing unit (105) can analyze the identified damaged area based on a previously stored maintenance algorithm and, through the analysis result, generate maintenance guide information for restoring the sheet metal condition and paint condition of the vehicle to be maintained located in the sheet metal paint maintenance area to their original state and provide it to a mechanic account.

[0036] According to one embodiment, the maintenance guide information providing unit (105) can confirm that the identification of damaged areas on the exterior of the vehicle to be maintained (e.g., damaged areas on the exterior sheet metal condition and paint condition) and damaged areas on the interior of the vehicle to be maintained (e.g., damaged areas on the interior sheet metal) is completed as the abnormality verification process is completed by the performance of the function of the abnormality verification process performing unit (103).

[0037] Accordingly, the maintenance guide information providing unit (105) can generate maintenance guide information for restoring the sheet metal condition and paint condition of the vehicle to be maintained located in the sheet metal paint maintenance area by analyzing the identified damaged area (e.g., damaged area for the exterior and interior of the vehicle to be maintained, respectively) based on the previously stored maintenance algorithm.

[0038] According to one embodiment, the previously stored maintenance algorithm includes exterior damage information for another vehicle subject to maintenance (location of damaged exterior bodywork, damaged area of ​​damaged exterior bodywork, damage type of damaged exterior bodywork, location of damaged paint, damaged area of ​​damaged paint, damage type of damaged paint), interior damage information for another vehicle subject to maintenance (location of damaged interior bodywork, damaged area of ​​damaged interior bodywork, damage type of damaged interior bodywork), exterior maintenance guide information for another vehicle subject to maintenance (necessary process products used to restore the damaged exterior bodywork condition and paint condition to their original state, inventory of necessary process products, appropriate usage amount of necessary process products, and process guide), interior maintenance guide information for another vehicle subject to maintenance (necessary process products used to restore the damaged interior bodywork condition to its original state, inventory of necessary process products, appropriate usage amount of necessary process products, and process guide), and maintenance history information generated as a result of maintaining another vehicle subject to maintenance (a series of processes in which an actual mechanic restored the bodywork condition and paint condition of the vehicle subject to maintenance to their original state (process products used, appropriate usage amount of process products used, and processes applied to the actual process). It may be an algorithm that analyzes and learns the correlation between information based on a guide to generate maintenance guide information for restoring at least one of the exterior bodywork, paintwork, and interior bodywork of the vehicle to be maintained to its original state.

[0039] That is, the aforementioned stored maintenance algorithm may include an artificial neural network model (ANN), a convolutional neural network model (CNN), and a recurrent neural network model (RNN), and may also include algorithms of various other models.

[0040] According to one embodiment, the maintenance guide information providing unit (105) can analyze the identified damaged area based on a previously stored maintenance algorithm to generate maintenance guide information for restoring the sheet metal condition and paint condition of a vehicle to be maintained located in the sheet metal paint maintenance area to its original state, and provide it to a mechanic account.

[0041] In relation to the above, the maintenance guide information may be configured to include exterior maintenance guide information for restoring the exterior condition (exterior bodywork condition and paint condition) of the vehicle to be maintained to its original state and interior maintenance guide information for restoring the interior bodywork condition of the vehicle to be maintained to its original state. A detailed explanation of the maintenance guide information is provided in FIG. 5.

[0042] FIG. 2 is a block diagram illustrating a status information receiving unit of a maintenance system that automatically determines the sheet metal and painting status of an automobile according to one embodiment of the present invention.

[0043] Referring to FIG. 2, a maintenance system for automatically determining the sheet metal and paint condition of a vehicle (e.g., a maintenance system for automatically determining the sheet metal and paint condition of a vehicle (100)) (hereinafter referred to as the maintenance system), which is implemented as a computing device comprising one or more processors and one or more memories that store instructions that can be executed by said processors, may include a status information receiving unit (200) (e.g., a status information receiving unit (101) of FIG. 1).

[0044] According to one embodiment, when a vehicle to be serviced is located in a sheet metal painting maintenance area, the state information receiving unit (200) controls a state measurement module located in one area of ​​the sheet metal painting maintenance area to receive state information based on the sheet metal condition and painting condition of the vehicle to be serviced.

[0045] According to one embodiment, the state information receiving unit (200) may include an image information receiving unit (201) and an ultrasound information receiving unit (203) as detailed configurations for performing the above-described function.

[0046] According to one embodiment, when the vehicle to be serviced is located in the sheet metal painting maintenance area, the image information receiving unit (201) controls a camera module (201a) located in one area of ​​the sheet metal painting maintenance area to receive image information capable of determining whether there is an abnormality in the external sheet metal condition and painting condition of the vehicle to be serviced.

[0047] According to one embodiment, the camera module (201a) may be configured to photograph the exterior of a vehicle to be serviced located in the sheet metal painting maintenance area, and may be configured to generate image information reflecting the exterior sheet metal condition and painting condition of the vehicle to be serviced.

[0048] In relation to the above, the image information may be information generated by capturing the exterior of the vehicle to be serviced by enlarging and reducing the entire area, with the configuration reflecting the external sheet metal condition and paint condition of the vehicle to be serviced. Additionally, it may be information containing source information for implementing a virtual object corresponding to the vehicle to be serviced in a virtual space. Accordingly, the camera module (201a) may be a configuration that includes a depth camera function rather than a simple camera device.

[0049] According to one embodiment, the ultrasonic information receiving unit (203) can receive ultrasonic information capable of determining whether there is an abnormality in the internal sheet metal condition of the vehicle to be maintained by controlling (203a) an ultrasonic sensor module located in one area of ​​the sheet metal painting maintenance area while the function of the image information receiving unit (201) is performed.

[0050] According to one embodiment, the ultrasonic sensor module (203a) may be configured to include a transmitter that outputs a first ultrasonic wave to the exterior of a vehicle to be serviced located in the sheet metal painting maintenance area, and a receiver that receives a second ultrasonic wave reflected by the exterior of the vehicle to be serviced, and may be configured to generate ultrasonic information capable of identifying the internal sheet metal condition of the vehicle to be serviced.

[0051] In relation to the above, the ultrasonic information is information containing frequencies and waveforms according to the internal sheet metal condition of the vehicle to be serviced, and may be information containing frequencies and waveforms based on the damaged area, size of damage, and location of damage of the internal sheet metal of the vehicle to be serviced.

[0052] FIG. 3 is a block diagram illustrating an abnormality verification process execution unit of a maintenance system that automatically determines the sheet metal and painting status of an automobile according to one embodiment of the present invention.

[0053] Referring to FIG. 3, a maintenance system for automatically determining the sheet metal and paint condition of a vehicle (e.g., a maintenance system for automatically determining the sheet metal and paint condition of a vehicle (100)) (hereinafter referred to as the maintenance system), which is implemented as a computing device comprising one or more processors and one or more memories that store instructions that can be executed by said processors, may include an abnormality verification process execution unit (300) (e.g., an abnormality verification process execution unit (103) of FIG. 1).

[0054] According to one embodiment, when the abnormality verification process execution unit (300) completes receiving status information, it can perform an abnormality verification process capable of identifying whether there is an abnormality in the exterior of the vehicle to be serviced and whether there is an abnormality in the interior sheet metal of the vehicle to be serviced, based on the status information.

[0055] According to one embodiment, the abnormality verification process execution unit (300) may include a vehicle object comparison unit (301) and an exterior damage information generation unit (303) as detailed configurations for performing the above-described function.

[0056] According to one embodiment, the vehicle object comparison unit (301) can, when the image information receiving unit (e.g., the image information receiving unit (201) of FIG. 2) receives image information, start a first abnormality verification process among the abnormality verification processes, and implement a first vehicle object (301a), which is a virtual object reflecting the external sheet metal condition and paint condition of the vehicle to be serviced based on the image information in a virtual space, and a second vehicle object (301b), which is a virtual object corresponding to a vehicle of the same model as the vehicle to be serviced, and compare and analyze the first vehicle object (301a) and the second vehicle object (301b).

[0057] According to one embodiment, when the first abnormality verification process is started, the vehicle object comparison unit (301) can implement a first vehicle object (301a), which is a virtual object reflecting the external sheet metal condition and paint condition of the vehicle to be serviced in a virtual space, through source information based on the image information. In this regard, the source information may be configured to include information capable of implementing the external appearance condition of the vehicle to be serviced, that is, the external sheet metal shape and paint condition.

[0058] Afterward, the above-mentioned automobile object comparison unit (301) can implement the second automobile object (301b) based on reference automobile information selected by the mechanic account. In this regard, the reference automobile information is source information for an automobile of the same model as the vehicle to be serviced, and may be information for implementing the second automobile object which serves as a standard for determining whether there are abnormalities in the external sheet metal condition and paint condition of the vehicle to be serviced.

[0059] According to one embodiment, when the implementation of the first automobile object (301a) and the second automobile object (301b) in the virtual space is completed, the automobile object comparison unit (301) can compare the shape of the exterior sheet metal and the state of the paint of the second automobile object (301b) and the first automobile object (301a) based on the second automobile object (301b).

[0060] At this time, the vehicle object comparison unit (301) can determine whether there is an abnormality in the external sheet metal form of the first vehicle object (301a) by overlaying the first vehicle object (301a) based on the second vehicle object (301b). Additionally, the vehicle object comparison unit (301) can determine whether there is an abnormality in the external sheet metal form of the first vehicle object (301a) by comparing depth data for the same external sheet metal area of ​​the first vehicle object (301a) and the second vehicle object (301b).

[0061] For example, if the depth data of the first area of ​​the fender of the first vehicle object (301a) differs from the first area of ​​the fender of the second vehicle object (301b), the vehicle object comparison unit (301) may determine that an abnormality has occurred in the first area of ​​the fender of the first vehicle object (301a) and determine the first area as a damaged area for the external sheet metal.

[0062] Finally, the vehicle object comparison unit (301) can determine whether there is an abnormality in the paint condition of the first vehicle object (301a) through a color comparison algorithm including at least one of a Gray model, an RGB model, an HSV model, and a YCBCr model to compare the paint condition of the second vehicle object (301b) with the paint condition of the second vehicle object (301b).

[0063] For example, the vehicle object comparison unit (301) may determine that an abnormality has occurred in the paint condition of the second area of ​​the fender of the first vehicle object (301a) when the color value of the second area of ​​the fender of the second vehicle object (301b) is different through the color comparison algorithm, and determine the second area as a damaged area for the paint.

[0064] According to one embodiment, the exterior damage information generation unit (303) can generate exterior damage information (303a) based on the identification result when the identification of at least one damaged area among the exterior sheet metal condition and paint condition of the first vehicle object (301a) relative to the second vehicle object (301b) is completed as the function of the vehicle object comparison unit (301) is completed.

[0065] According to one embodiment, the exterior damage information (303a) may be configured to include information regarding a damaged area of ​​the exterior bodywork of the vehicle to be repaired and information regarding a damaged area of ​​the paint of the vehicle to be repaired. That is, the exterior damage information (303a) may include a damaged area of ​​the exterior bodywork of the vehicle to be repaired, the location of the damaged area, the size of the damaged area, the shape of the damage to the damaged area, etc., and may be information including a damaged area of ​​the paint of the vehicle to be repaired, the location of the damaged area, the size of the damaged area, the shape of the damage to the damaged area, the original color of the paint of the damaged area, etc.

[0066] FIG. 4 is another block diagram illustrating an abnormality verification process execution unit of a maintenance system that automatically determines the sheet metal and painting status of an automobile according to one embodiment of the present invention.

[0067] Referring to FIG. 4, a maintenance system for automatically determining the sheet metal and paint condition of a vehicle (e.g., a maintenance system for automatically determining the sheet metal and paint condition of a vehicle (100)) (hereinafter referred to as the maintenance system), which is implemented as a computing device comprising one or more processors and one or more memories that store instructions that can be executed by said processors, may include an abnormality verification process execution unit (400) (e.g., an abnormality verification process execution unit (103) of FIG. 1).

[0068] According to one embodiment, when the abnormality verification process execution unit (400) completes receiving status information, it can perform an abnormality verification process capable of identifying whether there is an abnormality in the exterior of the vehicle to be serviced and whether there is an abnormality in the interior sheet metal of the vehicle to be serviced, based on the status information.

[0069] According to one embodiment, the abnormality verification process execution unit (400) may include a reference ultrasonic information identification unit (401), an internal sheet metal abnormality determination unit (403), and an internal damage information generation unit (405) as detailed configurations for performing the above-described function.

[0070] According to one embodiment, when the ultrasonic information receiving unit (e.g., the ultrasonic information receiving unit (203) of FIG. 2) receives ultrasonic information, the reference ultrasonic information identification unit (401) can start a second abnormality verification process among the abnormality verification processes and identify the reference ultrasonic information (401a) of a vehicle that is the same model as the vehicle to be serviced among a plurality of reference ultrasonic information stored in a database.

[0071] According to one embodiment, when the second abnormality verification process is initiated, the reference ultrasonic information identification unit (401) can identify the reference ultrasonic information (401a) of a vehicle of the same model as the vehicle to be serviced among a plurality of reference ultrasonic information stored in a database. At this time, the reference ultrasonic information (401a) is ultrasonic information for a vehicle of the same model as the vehicle to be serviced, and may be information including a waveform for a vehicle that has no abnormalities in its internal sheet metal condition.

[0072] According to one embodiment, when the internal sheet metal abnormality determination unit (403) completes the identification of the reference ultrasonic information (401a), it can compare the waveform of the reference ultrasonic information (401a) with the waveform of the ultrasonic information (403a) and determine whether an abnormality has occurred in the internal sheet metal of the vehicle to be serviced through the similarity rate of the waveform of the ultrasonic information (403a) to the waveform of the reference ultrasonic information (401a).

[0073] More specifically, the internal sheet metal abnormality determination unit (403) can determine the frequency of the reference ultrasonic information (401a) and the frequency of the ultrasonic information (403a) in order to compare the waveform of the reference ultrasonic information (401a) and the waveform of the ultrasonic information (403a). At this time, the internal sheet metal abnormality determination unit (403) can divide each frequency into multiple sections in order to compare the frequency of the reference ultrasonic information (401a) and the frequency of the ultrasonic information (403a).

[0074] In relation to the above, the internal sheet metal abnormality determination unit (403) may compare the frequency of the reference ultrasonic information (401a) and the frequency of the ultrasonic information (403a) based on the same section. For example, the first section of the frequency of the reference ultrasonic information (401a) and the first section of the frequency of the ultrasonic information (403a) may be sections that correspond to each other and are compared.

[0075] According to one embodiment, the internal sheet metal defect determination unit (403) can compare how similar the first frequency section of the ultrasonic information (403a) is to the first frequency section of the reference ultrasonic information (401a) when comparing the first frequency section of the reference ultrasonic information (401a) and the first frequency section of the ultrasonic information (403a) in correspondence with each other. In this regard, the internal sheet metal defect determination unit (403) can determine that there is no defect in the internal sheet metal if, when comparing how similar the first frequency section of the ultrasonic information (403a) is to the first frequency section of the reference ultrasonic information (401a), the first frequency section of the ultrasonic information (401a) is similar to the first frequency section of the reference ultrasonic information (401a) by more than a specified similarity rate value, the first frequency section of the ultrasonic information (401a) is similar to the first frequency section of the reference ultrasonic information (401a).

[0076] In relation to the above, the internal sheet metal abnormality determination unit (403) may determine that an abnormality has occurred in the internal sheet metal if the first frequency section of the ultrasonic information (403a) is not similar to the first frequency section of the reference ultrasonic information (401a) by more than a specified similarity rate value.

[0077] According to one embodiment, when the internal damage information generating unit (405) determines that an abnormality has occurred in the internal sheet metal condition of the vehicle to be serviced by performing the function of the internal sheet metal abnormality determination unit (403), it can identify the damaged area of ​​the internal sheet metal through a waveform based on the ultrasonic information and generate internal damage information (405a).

[0078] According to one embodiment, when the internal damage information generating unit (405) determines that an abnormality has occurred in the internal sheet metal of the vehicle to be serviced, it can analyze the ultrasonic information (403a) through a previously stored artificial intelligence algorithm to identify the damaged area of ​​the internal sheet metal where the abnormality occurred, the size of the damaged area, and the location of the damaged area.

[0079] According to one embodiment, the stored artificial intelligence algorithm is an algorithm that analyzes and learns the correlation between internal damage information (e.g., the damaged area of ​​the internal bodywork of the other vehicle being serviced, the size of the damaged area, and the location of the damaged area) and ultrasonic information regarding the other vehicle being serviced, and may include an artificial neural network model (ANN), a convolutional neural network model (CNN), and a recurrent neural network model (RNN), and may also include algorithms of various other models.

[0080] Accordingly, the internal damage information generating unit (405) can generate the internal damage information (405a) based on the identified internal sheet metal damage area, the size of the damage area, and the location of the damage area. That is, the internal damage information (405a) may be information including the damage area, the size of the damage area, and the location of the damage area of ​​the internal sheet metal of the vehicle to be serviced.

[0081] FIG. 5 is a block diagram illustrating a maintenance guide information providing unit of a maintenance system that automatically determines the sheet metal and painting status of an automobile according to one embodiment of the present invention.

[0082] Referring to FIG. 5, a maintenance system for automatically determining the sheet metal and paint condition of a vehicle (e.g., a maintenance system for automatically determining the sheet metal and paint condition of a vehicle (100)) (hereinafter referred to as the maintenance system), which is implemented as a computing device comprising one or more processors and one or more memories that store instructions that can be executed by said processors, may include a maintenance guide information providing unit (500) (e.g., a maintenance guide information providing unit (105) of FIG. 1).

[0083] According to one embodiment, when at least one of the damaged area of ​​the exterior of the vehicle to be serviced and the damaged area of ​​the interior sheet metal of the vehicle to be serviced is identified as the abnormality verification process is completed, the maintenance guide information providing unit (500) can analyze the identified damaged area based on a previously stored maintenance algorithm (500a), and through the analysis result, generate maintenance guide information for restoring the sheet metal condition and paint condition of the vehicle to be serviced located in the sheet metal paint maintenance area to their original state and provide it to a mechanic account.

[0084] According to one embodiment, the maintenance guide information providing unit (500) may include an exterior maintenance guide generating unit (501), an interior maintenance guide generating unit (503), and a guide providing unit (505) as detailed configurations for performing the above-described function.

[0085] According to one embodiment, when the generation of exterior damage information is completed by the function of the abnormality verification process execution unit (e.g., the abnormality verification process execution unit (103) of FIG. 1), the exterior maintenance guide generation unit (501) can generate exterior maintenance guide information by analyzing the damaged areas of the exterior sheet metal and paint of the vehicle to be maintained based on the exterior damage information, based on the previously stored maintenance algorithm (500a), and deriving the necessary process product, inventory of the necessary process product, appropriate usage amount of the necessary process product, and process guide used to restore at least one damaged area of ​​the exterior sheet metal and paint of the vehicle to be maintained through the analysis results.

[0086] According to one embodiment, when the exterior maintenance guide generation unit (501) completes the generation of exterior damage information as the first abnormality verification process is completed, the generated exterior damage information can be analyzed through the previously stored maintenance algorithm (500a).

[0087] According to one embodiment, the exterior maintenance guide generation unit (501) can analyze the damaged area, location of the damaged area, size of the damaged area, and type of damage to the damaged area of ​​the exterior sheet metal of the vehicle to be maintained based on the exterior damage information through the previously stored maintenance algorithm (500a), and derive the process product, inventory of the process product, appropriate amount of the process product, and process guide (process sequence, explanation, and method of use for tools used, etc.) required to restore the exterior sheet metal of the vehicle to its original condition.

[0088] In addition, the exterior maintenance guide generation unit (501) can analyze the damaged area of ​​the paint, the location of the damaged area, the size of the damaged area, the shape of the damaged area, and the original color of the paint of the damaged area for the vehicle to be maintained based on the exterior damage information through the previously stored maintenance algorithm (500a), and derive the process product, inventory of the process product, appropriate usage amount of the process product, and process guide (process sequence, explanation, and method of use for tools used, etc.) required to restore the paint of the vehicle to its original state.

[0089] Accordingly, the exterior maintenance guide generation unit (501) can generate exterior maintenance guide information based on the process product, inventory of process product, appropriate usage amount of process product, and process guide required to restore at least one of the exterior sheet metal work and painting of the vehicle to the original state derived above.

[0090] According to one embodiment, when the internal maintenance guide generation unit (503) completes the generation of the internal damage information by performing the function of the abnormality verification process execution unit, it can generate internal maintenance guide information by analyzing the damaged area of ​​the internal sheet metal of the vehicle to be maintained based on the internal damage information based on the previously stored maintenance algorithm (500a), and deriving the necessary process product, inventory of the necessary process product, appropriate usage amount of the necessary process product, and process guide used to restore the internal sheet metal condition of the vehicle to its original state through the analysis result.

[0091] According to one embodiment, when the internal maintenance guide generation unit (503) completes the generation of internal damage information as the second abnormality verification process is completed, the generated internal damage information can be analyzed through the previously stored maintenance algorithm (500a).

[0092] According to one embodiment, the internal maintenance guide generation unit (503) can analyze the damaged area, the size of the damaged area, and the location of the damaged area of ​​the internal sheet metal of the vehicle to be maintained based on the internal damage information through the previously stored maintenance algorithm (500a), and derive the process product, inventory of the process product, appropriate usage amount of the process product, and process guide (process sequence, description, and method of use for tools used, etc.) required to restore the internal sheet metal of the vehicle to its original state.

[0093] Accordingly, the internal maintenance guide generation unit (503) can generate internal maintenance guide information based on the process product, inventory of process product, appropriate usage amount of process product, and process guide required to restore the internal sheet metal of the vehicle to its original condition.

[0094] According to one embodiment, the previously stored maintenance algorithm (500a) may be an algorithm that analyzes and learns the correlation between exterior damage information for another vehicle subject to maintenance, interior damage information for another vehicle subject to maintenance, exterior maintenance guide information for another vehicle subject to maintenance, interior maintenance guide information for another vehicle subject to information, and maintenance history information generated as a result of maintaining another vehicle subject to maintenance.

[0095] Accordingly, the previously stored maintenance algorithm (500a) is an algorithm for generating maintenance guide information to restore at least one of the external sheet metal, paint, and internal sheet metal of the vehicle to be maintained to its original state, and may include an artificial neural network model (ANN), a convolutional neural network model (CNN), and a recurrent neural network model (RNN), and may also include algorithms of various other models.

[0096] According to one embodiment, the guide providing unit (505) provides maintenance guide information generated upon completion of the functions of the exterior maintenance guide generating unit (501) and the interior maintenance guide generating unit (503) to the mechanic account, thereby enabling the mechanic, who is the user of the mechanic account, to perform maintenance on a vehicle to be maintained located in the sheet metal painting maintenance area.

[0097] Accordingly, the mechanic can identify the necessary process products, the inventory of the necessary process products, and the appropriate amount of the necessary process products used to restore the exterior sheet metal and paint of the vehicle to be repaired to their original state through the exterior maintenance guide information generated by the performance of the function of the exterior maintenance guide generation unit (501), and then restore at least one of the exterior sheet metal and paint of the vehicle to be repaired to their original state according to the process guide.

[0098] In addition, the mechanic can restore the interior sheet metal of the vehicle to be repaired to its original state according to the process guide after identifying the necessary process product, the inventory of the necessary process product, and the appropriate amount of the necessary process product used to restore the interior sheet metal of the vehicle to be repaired to its original state through the internal maintenance guide information generated by the performance of the function of the internal maintenance guide generation unit (503).

[0099] According to one embodiment, when the mechanic starts maintenance on a vehicle to be maintained located in the sheet metal painting maintenance area, the maintenance system identifies the tool to be used during maintenance through a process guide based on the maintenance guide information, and then controls a lighting module provided in one area of ​​the sheet metal painting maintenance area where the identified tool is placed to recommend the tool to be used during maintenance to the mechanic.

[0100] In relation to the above, when maintenance of a vehicle to be maintained begins, the maintenance system identifies the tools used to restore the exterior bodywork and paintwork of the vehicle to be maintained to their original condition through a process guide based on the exterior maintenance guide information, and then controls a lighting module provided in one area of ​​the bodywork and paintwork maintenance area where the identified tools are placed to recommend the tools to be used during maintenance to the mechanic.

[0101] In addition, when maintenance begins on a vehicle to be maintained, the maintenance system identifies the tool used to restore the internal bodywork of the vehicle to its original condition through a process guide based on the internal maintenance guide information, and then controls a lighting module provided in one area of ​​the bodywork painting maintenance area where the identified tool is placed to recommend the tool to be used during maintenance to the mechanic.

[0102] At this time, the maintenance system can output different colors through the lighting module according to the exterior sheet metal, paint, and interior sheet metal, respectively, so that a mechanic can selectively perform maintenance on the vehicle to be maintained.

[0103] FIG. 6 is a drawing for explaining an example of the internal configuration of a computing device according to an embodiment of the present invention.

[0104] FIG. 6 illustrates an example of the internal configuration of a computing device according to an embodiment of the present invention. In the following description, descriptions of unnecessary embodiments that overlap with the descriptions of FIG. 1 to 5 described above will be omitted.

[0105] As illustrated in FIG. 6, the computing device (10000) may include at least one processor (11100), memory (11200), peripheral interface (11300), input / output subsystem (11400), power circuit (11500), and communication circuit (11600). In this case, the computing device (10000) may correspond to a user terminal (A) connected to a haptic interface device or the aforementioned computing device (B).

[0106] The memory (11200) may include, for example, high-speed random access memory, a magnetic disk, SRAM, DRAM, ROM, flash memory, or non-volatile memory. The memory (11200) may include software modules, instruction sets, or various other data required for the operation of the computing device (10000).

[0107] At this time, access to memory (11200) from other components, such as the processor (11100) or peripheral device interface (11300), can be controlled by the processor (11100).

[0108] The peripheral device interface (11300) can connect input and / or output peripheral devices of the computing device (10000) to the processor (11100) and memory (11200). The processor (11100) can perform various functions for the computing device (10000) and process data by executing software modules or instruction sets stored in the memory (11200).

[0109] The input / output subsystem (11400) can connect various input / output peripherals to the peripheral interface (11300). For example, the input / output subsystem (11400) may include a controller for connecting peripherals such as a monitor, keyboard, mouse, printer, or, if necessary, a touchscreen or sensor to the peripheral interface (11300). According to another aspect, input / output peripherals may be connected to the peripheral interface (11300) without passing through the input / output subsystem (11400).

[0110] The power circuit (11500) can supply power to all or part of the components of the terminal. For example, the power circuit (11500) may include one or more power sources such as a power management system, a battery or alternating current (AC), a charging system, a power failure detection circuit, a power converter or inverter, a power status indicator, or any other components for power generation, management, and distribution.

[0111] The communication circuit (11600) can enable communication with another computing device using at least one external port.

[0112] Alternatively, as described above, the communication circuit (11600) may enable communication with other computing devices by including an RF circuit and transmitting and receiving an RF signal, also known as an electromagnetic signal.

[0113] The embodiment of FIG. 6 is merely an example of a computing device (10000), and the computing device (11000) may have some components shown in FIG. 6 omitted, additional components not shown in FIG. 6 added, or a configuration or arrangement that combines two or more components. For example, a computing device for a communication terminal in a mobile environment may include, in addition to the components shown in FIG. 6, a touchscreen or a sensor, etc., and the communication circuit (1160) may include a circuit for RF communication of various communication methods (WiFi, 3G, LTE, Bluetooth, NFC, Zigbee, etc.). The components that can be included in the computing device (10000) may be implemented as hardware, software, or a combination of both hardware and software, including one or more integrated circuits specialized for signal processing or applications.

[0114] Methods according to embodiments of the present invention may be implemented in the form of program instructions that can be executed through various computing devices and recorded on a computer-readable medium. In particular, the program according to the present embodiment may be configured as a PC-based program or an application dedicated to a mobile terminal. An application to which the present invention is applied may be installed on a user terminal through a file provided by a file distribution system. For example, the file distribution system may include a file transmission unit (not shown) that transmits the file upon a request from the user terminal.

[0115] The device described above may be implemented as a hardware component, a software component, and / or a combination of a hardware component and a software component. For example, the device and components described in the embodiments may be implemented using one or more general-purpose or special-purpose computers, such as, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. The processing unit may execute an operating system (OS) and one or more software applications executed on said operating system. Additionally, the processing unit may access, store, manipulate, process, and generate data in response to the execution of the software. For ease of understanding, the processing unit may be described as being used as a single unit, but those skilled in the art will understand that the processing unit may include a plurality of processing elements and / or a plurality of types of processing elements. For example, the processing unit may include multiple processors or one processor and one controller. Additionally, other processing configurations, such as parallel processors, are also possible.

[0116] Software may include computer programs, code, instructions, or a combination of one or more of these, and may configure a processing unit to operate as desired or command the processing unit independently or collectively. Software and / or data may be permanently or temporarily embodied in any type of machine, component, physical device, virtual equipment, computer storage medium, or device so as to be interpreted by the processing unit or to provide instructions or data to the processing unit. Software may be distributed across networked computing devices and stored or executed in a distributed manner. Software and data may be stored on one or more computer-readable recording media.

[0117] The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc., either alone or in combination. The program instructions recorded on the medium may be those specifically designed and configured for the embodiment, or they may be those known and available to those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes; optical recording media such as CD-ROMs and DVDs; magneto-optical media such as floptical disks; and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, and flash memory. Examples of program instructions include machine code, such as that generated by a compiler, as well as high-level language code that can be executed by a computer using an interpreter, etc. The hardware devices described above may be configured to operate as one or more software modules to perform the operation of the embodiment, and vice versa.

[0118] Although the embodiments have been described above with reference to limited embodiments and drawings, those skilled in the art can make various modifications and variations from the description above. For example, appropriate results may be achieved even if the described techniques are performed in a different order than described, and / or if the components of the described system, structure, device, circuit, etc. are combined or assembled in a form different from described, or replaced or substituted by other components or equivalents. Therefore, other implementations, other embodiments, and equivalents to the claims below also fall within the scope of the claims.

Claims

Claim 1 A maintenance system for automatically determining the sheet metal and paint condition of an automobile, implemented as a computing device comprising one or more processors and one or more memories for storing instructions executable by said processors, wherein when an automobile to be maintained is located in a sheet metal and paint maintenance area, a status information receiving unit controls a status measurement module located in one area of ​​said sheet metal and paint maintenance area to receive status information based on the sheet metal and paint condition of said automobile to be maintained; and when the reception of said status information is completed, an abnormality verification process executing unit performs an abnormality verification process capable of identifying whether there is an abnormality in the exterior of said automobile to be maintained and whether there is an abnormality in the interior sheet metal of said automobile to be maintained based on said status information. A maintenance guide information providing unit that, when at least one of the damaged area on the exterior of the vehicle to be maintained and the damaged area on the interior bodywork of the vehicle to be maintained is identified upon completion of the above abnormality verification process, analyzes the identified damaged area based on a previously stored maintenance algorithm and, through the analysis result, generates maintenance guide information for restoring the bodywork and paint conditions of the vehicle to be maintained located in the bodywork and paint maintenance area to their original state and provides it to a mechanic account; wherein the condition measurement module comprises: a camera module configured to photograph the exterior of the vehicle to be maintained located in the bodywork and paint maintenance area and generates image information reflecting the exterior bodywork and paint conditions of the vehicle to be maintained; and an ultrasonic sensor module configured to include a transmitter that outputs a first ultrasonic wave to the exterior of the vehicle to be maintained located in the bodywork and paint maintenance area and a receiver that receives a second ultrasonic wave reflected by the exterior of the vehicle to be maintained and generates ultrasonic information capable of identifying the interior bodywork condition of the vehicle to be maintained.The system includes: a status information receiving unit, wherein when the vehicle to be serviced is located in the sheet metal painting and maintenance area, the system controls a camera module located in one area of ​​the sheet metal painting and maintenance area to receive image information capable of determining whether there is an abnormality in the external sheet metal condition and paint condition of the vehicle to be serviced; and an ultrasonic information receiving unit, wherein while the function of the image information receiving unit is performed, the system controls an ultrasonic sensor module located in one area of ​​the sheet metal painting and maintenance area to receive ultrasonic information capable of determining whether there is an abnormality in the internal sheet metal of the vehicle to be serviced; wherein the abnormality verification process performing unit, when the image information receiving unit receives the image information, starts a first abnormality verification process among the abnormality verification processes, implements a first vehicle object, which is a virtual object reflecting the external sheet metal condition and paint condition of the vehicle to be serviced based on the image information in a virtual space, and a second vehicle object, which is a virtual object corresponding to a vehicle of the same model as the vehicle to be serviced, and compares and analyzes the first vehicle object and the second vehicle object. and, as the function of the vehicle object comparison unit is completed, when the identification of at least one damaged area among the external sheet metal condition and paint condition of the first vehicle object relative to the second vehicle object is completed, an exterior damage information generation unit that generates exterior damage information based on the identification result; wherein the abnormality verification process execution unit includes, when the ultrasonic information receiving unit receives the ultrasonic information, a reference ultrasonic information identification unit that starts a second abnormality verification process among the abnormality verification processes and identifies a reference ultrasonic information of a vehicle of the same model as the vehicle subject to maintenance among a plurality of reference ultrasonic information stored in a database;A maintenance system for automatically determining the sheet metal and paint condition of a vehicle, comprising: an internal sheet metal abnormality determination unit that, when the identification of the above-mentioned reference ultrasonic information is completed, compares the waveform of the above-mentioned reference ultrasonic information with the waveform of the above-mentioned ultrasonic information and determines whether an abnormality has occurred in the internal sheet metal of the vehicle to be maintained through the similarity rate of the waveform of the above-mentioned ultrasonic information to the waveform of the above-mentioned ultrasonic information; and an internal damage information generation unit that, when it is determined through the performance of the function of the above-mentioned internal sheet metal abnormality determination unit that an abnormality has occurred in the internal sheet metal condition of the vehicle to be maintained, identifies a damaged area of ​​the internal sheet metal through a waveform based on the above-mentioned ultrasonic information and generates internal damage information; wherein the internal damage information generation unit, when it is determined through the performance of the function of the above-mentioned internal sheet metal abnormality determination unit that an abnormality has occurred in the internal sheet metal condition of the vehicle to be maintained, analyzes the above-mentioned ultrasonic information through a previously stored artificial intelligence algorithm and identifies the damaged area of ​​the internal sheet metal, the size of the damaged area, and the location of the damaged area of ​​the vehicle to be maintained through the analysis result. Claim 2 delete Claim 3 delete Claim 4 delete Claim 5 delete Claim 6 delete Claim 7 In claim 1, the maintenance guide information providing unit comprises: an exterior maintenance guide generating unit that, when the generation of exterior damage information is completed by the performance of the function of the abnormality verification process performing unit, analyzes the damaged areas of the exterior sheet metal and paint of the vehicle to be maintained based on the exterior damage information based on the previously stored maintenance algorithm, and derives the necessary process product, inventory of the necessary process product, appropriate usage amount of the necessary process product, and process guide used to restore at least one damaged area among the exterior sheet metal and paint of the vehicle to be maintained to its original state through the analysis results, thereby generating exterior maintenance guide information; and an interior maintenance guide generating unit that, when the generation of interior damage information is completed by the performance of the function of the abnormality verification process performing unit, analyzes the damaged area of ​​the interior sheet metal of the vehicle to be maintained based on the interior damage information based on the previously stored maintenance algorithm, and derives the necessary process product, inventory of the necessary process product, appropriate usage amount of the necessary process product, and process guide used to restore the interior sheet metal condition of the vehicle to be maintained to its original state through the analysis results, thereby generating interior maintenance guide information. A maintenance system for automatically determining the sheet metal and paint condition of a vehicle, characterized by including: a guide providing unit that provides maintenance guide information generated upon completion of the functions of the exterior maintenance guide generating unit and the interior maintenance guide generating unit to the mechanic account, thereby enabling the mechanic, who is the user of the mechanic account, to perform maintenance on a vehicle subject to maintenance located in the sheet metal and paint maintenance area. Claim 8 A maintenance system for automatically determining the sheet metal and paint condition of a vehicle, characterized in that, in claim 7, the previously stored maintenance algorithm is an algorithm that analyzes and learns the correlation between exterior damage information for another vehicle subject to maintenance, interior damage information for another vehicle subject to maintenance, exterior maintenance guide information for another vehicle subject to maintenance, interior maintenance guide information for another vehicle subject to maintenance, and maintenance history information generated by maintaining another vehicle subject to maintenance, and generates maintenance guide information for restoring at least one of the exterior sheet metal, paint, and interior sheet metal condition of the vehicle subject to maintenance to its original state. Claim 9 In claim 8, the maintenance system for automatically determining the sheet metal and paint condition of the vehicle is characterized by, when the mechanic starts maintenance on the vehicle to be maintained located in the sheet metal and paint maintenance area, identifying the tool to be used during maintenance through a process guide based on the maintenance guide information, and then controlling a lighting module provided in one area of ​​the sheet metal and paint maintenance area where the identified tool is placed to recommend the tool to be used during maintenance to the mechanic.

Images