Vehicle instrument detection method, system and terminal

Abstract

The present invention relates to a vehicle instrument detection method, system and terminal, and relates to the field of instrument detection, which includes: obtaining test bench image information; determining the instrument installation position according to the test bench image information and preset reference markings; controlling a preset clamping device to position the vehicle instrument at the instrument installation position; detecting the vehicle instrument surface with a preset instrument surface detection method to determine the laying of a preset protective film feature and handle abnormal conditions of the protective film feature; inputting a preset instrument logic program into the vehicle instrument and obtaining a vehicle instrument display image; determining an output program qualified prompt or an output program error prompt according to the comparison between the vehicle instrument display image and preset reference icon parameters. The above scheme can effectively improve the accuracy of vehicle instrument detection results.

Description

Technical Field

[0001] The present invention relates to the field of instrument detection, and in particular to a vehicle instrument detection method, system and terminal. Background Art

[0002] Vehicle instruments are an important part of the interior of a car. They display various parameters and status of the vehicle through pointers or numbers, providing the driver with real-time vehicle information about the vehicle's status and performance.

[0003] Before leaving the factory, the vehicle instrument needs to be tested for its overall condition to ensure that it can be used normally. When testing the vehicle instrument, the running program is first pre-written in the vehicle instrument, and then the display icon is obtained through the surface of the vehicle instrument through the camera, and compared with the normal display to determine the functional integrity. In the actual testing process, since the surface of the vehicle instrument is coated with a protective film, the abnormality of the protective film and the accuracy of the installation position of the vehicle instrument will affect the camera's acquisition and analysis capabilities, resulting in errors in the test results, which needs to be improved. Summary of the invention

[0004] In order to improve the accuracy of vehicle instrument detection results, the present invention provides a vehicle instrument detection method, system and terminal.

[0005] In a first aspect, the present invention provides a vehicle instrument detection method, which adopts the following technical solution:

[0006] A vehicle instrument detection method, comprising:

[0007] Obtain test bench image information;

[0008] Determine the instrument installation position based on the test bench image information and preset reference lines;

[0009] Controlling a preset clamping device to position the vehicle instrument at the instrument installation position;

[0010] Inspect the vehicle instrument surface using a preset instrument surface inspection method to determine the laying condition of the preset protective film feature and handle any abnormal condition of the protective film feature;

[0011] Inputting a preset instrument logic program into the vehicle instrument and acquiring the vehicle instrument display image;

[0012] The output program qualification prompt or output program error prompt is determined based on the comparison between the vehicle instrument display image and the preset reference icon parameters.

[0013] By adopting the above technical solution, the system first accurately positions the vehicle instrument, so that the camera can accurately collect the instrument image after the instrument is installed in the instrument installation position, and the collected result is more accurate when compared with the database result; and before the camera collection process, the system will check the protective film on the surface of the instrument to ensure that the protective film is well applied on the surface of the instrument and the protective film is not easy to interfere with the camera collection process; through the above two methods, the accuracy of the vehicle instrument detection results is improved.

[0014] Optionally, the vehicle instrument installation and positioning method includes:

[0015] Determine the relative positions of the contour vertices and the relative positions of the edge midpoints according to the preset instrument top view contour;

[0016] Determine the laser irradiation point position at the instrument installation position according to the relative position of each contour vertex and the relative position of the edge midpoint;

[0017] Controlling a preset laser device to vertically emit laser downward at a laser irradiation point position to generate a laser red dot feature at the instrument installation position and form a laser anchor point image;

[0018] Controlling the clamping device to clamp the vehicle instrument to a preset pre-positioning height above the instrument installation position, and obtaining a laser red dot distribution image;

[0019] Based on the inconsistency between the laser red dot distribution image and the laser anchor point image, the laser red dot distribution image and the laser anchor point image are compared to determine the laser red dot feature blocked by the vehicle instrument, and the blocked red dot feature position of the blocked laser red dot feature in the laser anchor point image is determined;

[0020] The vehicle instrument is adjusted to move horizontally according to the position of the blocked red dot feature until the laser red dot distribution image and the laser anchor point image are consistent, and the vehicle instrument is lowered and installed at the instrument installation position.

[0021] By adopting the above technical solution, the system determines the position for installing the instrument on the test bench according to the outline of the vehicle instrument and the reference marking line, and uses laser marking to emit a laser red dot to the test bench through a laser device as a contour mark. When installing the instrument, the adjustment method of the instrument is determined by the covered laser red dot. Only when all the laser red dots are not blocked, it means that the instrument is installed in place. The method is simple and the alignment and installation effect is good.

[0022] Optionally, the method for handling the foreign matter features on the vehicle instrument surface includes:

[0023] When the vehicle instrument is located at the instrument installation position, acquiring a surface image of the vehicle instrument;

[0024] Determine the characteristic position of the foreign object according to the vehicle instrument surface image and the preset reference surface image;

[0025] Determine the shortest distance direction of the boundary based on the characteristic position of the foreign body and the top view profile of the instrument;

[0026] Control a preset suction cup device to extend from the test table and adsorb to the bottom of the vehicle instrument with a preset adsorption force;

[0027] The lifting force of the suction cup device is determined according to the preset vehicle instrument weight, and the suction cup device is controlled by the lifting force and the direction of the shortest distance to the boundary to lift and tilt the vehicle instrument so that the foreign body features slide down from the shortest distance direction to be removed.

[0028] By adopting the above technical solution, when there is foreign matter on the surface of the instrument, the system can drive the instrument to tilt through the suction cup device during the installation of the instrument, so that the foreign matter slides off from the direction closest to the boundary of the instrument. In this process, since the direction in which the foreign matter slides off is short, the foreign matter is not easy to scratch the protective film on the surface of the instrument.

[0029] Optionally, the instrument surface detection method includes:

[0030] Obtain the overall image of the vehicle instrument;

[0031] Select the protective film features from the overall image of the vehicle instrument;

[0032] Determine the contour of the protective film based on the overall image of the vehicle instrument and the characteristics of the protective film;

[0033] Based on the inconsistency between the protective film contour and the preset reference laying contour, it is defined as the protective film corner warping, and the protective film feature is processed by the preset protective film corner warping processing method;

[0034] Based on the consistency between the protective film profile and the reference laying profile, the vehicle instrument is powered on to emit backlight, and a protective film backlight image is obtained;

[0035] Determine whether there is an abnormal brightness feature on the protective film feature whose brightness is inconsistent with a preset reference brightness according to the backlight image recognition of the protective film;

[0036] If there is an abnormal brightness feature on the protective film feature whose brightness is inconsistent with the reference brightness, the abnormal brightness feature is defined as a protective film scratch and is processed using a preset protective film scratch processing method.

[0037] Optional methods for treating scratches on the protective film include:

[0038] Determining characteristic brightness of abnormal brightness features based on the luminescent image of the protective film;

[0039] Based on the inconsistency between the characteristic brightness and the preset reference backlight brightness, it is defined as the characteristic that the scratch does not penetrate the protective film, and the characteristic position of the scratch and the characteristic path of the scratch are determined according to the luminous image of the protective film and the abnormal brightness characteristics;

[0040] Controlling a preset heating device to heat the protective film feature along the scratch feature path at a preset heating temperature so that the scratch feature position has adhesiveness;

[0041] The preset smoothing device is controlled to follow the heating device to move and press along the scratch feature path with a preset pressing force to bond the two sides of the scratch feature path.

[0042] By adopting the above technical solution, the system heats the scratch position of the protective film to increase the viscosity of the scratch position, and then presses the scratch position through a smoothing device so that the two sides of the crack at the scratch position can be re-bonded. The steps are relatively simple and no additional adhesive is required.

[0043] Optionally, also include:

[0044] Based on the consistency between the characteristic brightness and the reference backlight brightness, it is defined as the scratch penetration protective film feature, and the position of one of the top corners of the protective film and the positions of the edges on both sides of the top corner are determined according to the overall image of the vehicle instrument and the contour of the protective film;

[0045] Determine the lifting path between the top corners of two protective films on opposite sides according to the contour of the protective film;

[0046] Control the preset scraper to scrape up a corner of the protective film feature at the top corner of the protective film;

[0047] Control one of the clamping devices to lift up the old protective film feature along the lifting path, and control another clamping device to synchronously attach the new protective film feature to the vehicle instrument surface along the lifting path according to the top angle position of the protective film and the positions of the edges on both sides of the top angle;

[0048] The preset blowing device is controlled to blow air between the new protective film feature and the old protective film feature with a preset blowing force.

[0049] By adopting the above technical solution, when the protective film needs to be replaced, the system controls the clamping device to simultaneously disassemble and assemble the new protective film and the old protective film, thereby improving efficiency and preventing dust from falling on the surface of the opened instrument; and, in the process of replacing the protective film, the air blowing device is used to blow air between the new protective film and the old protective film, which can both blow away the dust and generate negative pressure between the two to facilitate the application of the new protective film.

[0050] Optionally, the method for processing the warping of the edge of the protective film includes:

[0051] Determine the lifting and laying range according to the protective film contour and the reference laying contour;

[0052] Controlling a preset wiping device to wipe the warped laying range, and controlling a preset spraying device to spray the warped laying range to clean and humidify the vehicle instrument;

[0053] Determine the warped corners and corner crease positions of the protective film features according to the overall image of the vehicle instrument and the features of the protective film;

[0054] Determine the exposed top corner position of the lifting laying range according to the reference laying profile;

[0055] Determine the shoveling path based on the exposed top corner position and the corner crease position;

[0056] Control the preset scraper to extend from under the raised edge to the edge crease at a preset inclination angle, and at a preset scraping speed, take the edge crease as the starting point along the scraping path to turn over the raised edge and re-fit it to the raised laying range.

[0057] By adopting the above technical solution, in case of curling of the edges and corners of the protective film, the system controls the spray device to spray the curled installation range. The mist can blow away the dust on the surface of the instrument and moisten the surface of the instrument to facilitate the restoration of the edges and corners of the protective film. In the process of restoring the edges and corners of the protective film, a scraper is used to apply horizontal force to the edges and corners of the protective film, so that the edges and corners of the protective film can be better re-attached to the surface of the instrument and the mist water between the protective film and the instrument can be squeezed out.

[0058] Optionally, in the process of comparing the vehicle instrument display image and the reference icon parameters, a highlight spot may be generated on the vehicle instrument surface due to reflection. The method for processing the highlight spot includes:

[0059] Determine the position and brightness of the highlight spot according to the vehicle instrument display image and the preset highlight spot;

[0060] Determine the auxiliary lighting position of the preset auxiliary light device on the side wall of the vehicle instrument according to the position of the highlight light spot;

[0061] Determine the illumination brightness of the auxiliary light device according to the light spot brightness and the preset backlight brightness;

[0062] The auxiliary light device is controlled to perform auxiliary lighting on the highlight light spot from the auxiliary lighting position with lighting brightness.

[0063] In a second aspect, the present application provides a vehicle instrument detection system, which adopts the following technical solution:

[0064] A vehicle instrument detection system, comprising:

[0065] An acquisition module is used to acquire the image information of the test bench, the vehicle instrument display image, the laser red dot distribution image, the vehicle instrument surface image, the vehicle instrument overall image and the protective film backlight image;

[0066] A memory for storing a program of any one of the above vehicle instrument detection methods;

[0067] The program in the memory can be loaded and executed by the processor to implement a vehicle instrument detection method.

[0068] In a third aspect, the present application provides a smart terminal, which adopts the following technical solution:

[0069] An intelligent terminal comprises a memory and a processor, wherein the memory stores a computer program which can be loaded by the processor and execute any one of the above-mentioned vehicle instrument detection methods.

[0070] In summary, the present application includes at least one of the following beneficial technical effects:

[0071] The system first accurately locates the vehicle instrument, so that the camera can accurately collect the instrument image after the instrument is installed in the instrument installation position, and the collection result is more accurate when compared with the database result; and before the camera collection process, the system will check the protective film on the surface of the instrument to ensure that the protective film is well laid on the surface of the instrument and the protective film is not easy to interfere with the camera collection process; through the above two methods, the accuracy of the vehicle instrument detection results is improved;

[0072] When scratches appear on the surface of the protective film, the system uses different methods to deal with them according to the depth of the scratches. If the scratches do not penetrate the protective film, the system heats the scratched position of the protective film to increase the viscosity of the scratched position, and then presses the scratched position through a smoothing device so that the two sides of the crack at the scratched position can be re-bonded. The steps are relatively simple and no additional adhesive is required. If the scratches penetrate the protective film, the protective film needs to be replaced. The system controls the clamping device to simultaneously disassemble and assemble the new protective film and the old protective film, thereby improving efficiency and preventing dust from falling on the surface of the opened instrument. In addition, during the process of replacing the protective film, the air blowing device is used to blow air between the new protective film and the old protective film, which can both blow away the dust and create a negative pressure between the two to facilitate the application of the new protective film.

[0073] In the case of curling of the edges and corners of the protective film, the system controls the spray device to spray the curled application range. The mist can blow away the dust on the surface of the instrument and moisten the surface of the instrument to facilitate the restoration of the edges and corners of the protective film. During the restoration of the edges and corners of the protective film, a scraper is used to apply horizontal force to the edges and corners of the protective film, which can make the edges and corners of the protective film fit better to the surface of the instrument and squeeze out the mist water between the protective film and the instrument. BRIEF DESCRIPTION OF THE DRAWINGS

[0074] Figure 1 is a method flow chart of a vehicle instrument detection method according to an embodiment of the present invention;

[0075] Figure 2 is a method flow chart of a vehicle instrument installation and positioning method according to an embodiment of the present invention;

[0076] Figure 3 is a method flow chart of a method for processing features of foreign matter on the surface of a vehicle instrument panel according to an embodiment of the present invention;

[0077] Figure 4 is a method flow chart of the instrument surface detection method according to an embodiment of the present invention;

[0078] Figure 5 The method flow of the protective film scratch treatment method according to the embodiment of the present invention is Figure 1 ;

[0079] Figure 6 The method flow of the protective film scratch treatment method according to the embodiment of the present invention is Figure 2 ;

[0080] Figure 7 It is a flow chart of a method for processing warped corners of a protective film according to an embodiment of the present invention. DETAILED DESCRIPTION

[0081] The present invention is further described in detail below in conjunction with the accompanying drawings and embodiments.

[0082] The embodiment of the present application discloses a vehicle instrument detection method. The system first accurately installs the vehicle instrument to the instrument installation position and removes foreign matter on its surface, and then determines the scratches and corner turning of the protective film on the surface of the vehicle instrument through image recognition. According to different situations, the system uses different processing methods to process the protective film to ensure that the protective film is intact and can protect the surface of the vehicle instrument.

[0083] Reference Figure 1 , a vehicle instrument detection method comprises the following steps:

[0084] Step S100: Acquire test table image information.

[0085] The test bench surface image information refers to an image obtained by photographing the test bench surface through an environmental camera disposed in a test work area.

[0086] Step S101: Determine the instrument installation position according to the test table image information and the preset reference markings.

[0087] The reference marking is a marking marked on the test bench by technicians to indicate the installation position of the vehicle instrument. The reference marking is in the shape of a cross and is marked at the center of the vehicle instrument installation position. It will not be described in detail here.

[0088] The instrument installation position refers to the position on the test bench for installing the vehicle instrument. When the vehicle instrument is installed at the instrument installation position, a test camera used to test the vehicle instrument can face the vehicle instrument.

[0089] Since the reference mark is located at the center of the instrument installation position, the instrument installation position can be known by identifying and determining the reference mark in the test bench image information.

[0090] Step S102: Control a preset clamping device to position the vehicle instrument at the instrument installation position.

[0091] The clamping device is used to pick up and clamp the vehicle instrument to change the position of the vehicle instrument. In subsequent embodiments, the clamping device can also be used to adjust the characteristics of the protective film.

[0092] After the instrument installation position is determined, the system controls the clamping device to install the vehicle instrument at the instrument installation position. The specific installation and positioning method will not be described here in detail, but will be described in detail in subsequent embodiments.

[0093] Step S103: Detect the vehicle instrument surface using a preset instrument surface detection method to determine the application status of the preset protective film characteristics and handle any abnormalities of the protective film characteristics.

[0094] Since the protective film has been laid on the surface of the vehicle instrument before the functional test, the integrity of the protective film needs to be ensured when testing the function of the vehicle instrument. If the protective film is abnormal, the abnormality needs to be handled. The protective film is detected and handled by the instrument surface detection method, which will not be described in detail here and will be described in detail in the subsequent embodiments.

[0095] Step S104: inputting a preset instrument logic program into the vehicle instrument and acquiring a vehicle instrument display image.

[0096] The instrument logic program is pre-written by the technicians and written into the test instrument when the vehicle instrument is tested. After the instrument logic program is entered, the icons on the vehicle instrument will light up and go out according to the logic of the program, which will not be described in detail here.

[0097] The vehicle instrument display image refers to the image obtained by the test camera set just above the test bench after the vehicle instrument is powered on and the backlight is on. The on and off status of the icons in the instrument can appear in the vehicle instrument display image. The test camera and the environment camera are two different cameras. When the vehicle instrument is installed, the test camera is located above the top of the vehicle instrument and is specifically used to identify and determine the icon display status in the vehicle instrument.

[0098] After the vehicle instrument is installed at the instrument installation location, the instrument is powered on and the program is input into the instrument, and the instrument can now operate according to the logic of the program.

[0099] Step S105: Determine an output program qualified prompt or an output program error prompt based on a comparison between the vehicle instrument display image and preset reference icon parameters.

[0100] The baseline icon parameters are the parameters such as the on / off status, brightness, position, and size of the icons in the vehicle instrument when they are running according to the instrument logic program, which are set by the technicians and will not be described in detail here.

[0101] The vehicle instrument display image is compared with the reference icon parameters. If the icon display of the vehicle instrument obtained by the test camera is consistent with the reference icon parameters, it means that the vehicle instrument functions normally, and the output program is qualified.

[0102] If the icon display of the vehicle instrument obtained by the test camera is inconsistent with the reference icon parameters, it means that the vehicle instrument has a functional abnormality. In this case, rework is required and a program error prompt is output to prompt the staff to remove the vehicle instrument that has completed the test and determine the cause of the abnormality before processing.

[0103] Reference Figure 2 , the vehicle instrument installation and positioning method includes the following steps:

[0104] Step S200: Determine the relative positions of the contour vertices and the relative positions of the edge midpoints according to the preset instrument top view contour.

[0105] The top-view profile of the instrument refers to the circumferential profile of the automobile instrument in a top view. The top-view profile of the instrument is associated with the fixed form of the automobile instrument and is set by technical personnel during product design, so it will not be elaborated here.

[0106] The relative position of contour vertices refers to the relative position relationship of all vertices in the instrument's top view contour. The relative position of edge midpoints refers to the relative position relationship of all edge midpoints in the instrument's top view contour. When the instrument's top view contour is a determined parameter, the relative position of contour vertices and the relative position of edge midpoints can be directly determined by the instrument's top view contour.

[0107] Step S201: Determine the laser irradiation point position at the instrument installation position according to the relative position of each contour vertex and the relative position of the edge midpoint.

[0108] In this embodiment, by arranging a laser device above the test bench, the laser device can emit laser vertically downward and irradiate the test bench surface. The laser irradiation point position is the position where the laser device irradiates the test bench and generates a laser red dot. The laser irradiation point position is consistent with the relative position of the contour vertex and the relative position of the edge midpoint.

[0109] Step S202: Control a preset laser device to emit laser vertically downward at the laser irradiation point position to generate a laser red dot feature at the instrument installation position and form a laser anchor point image.

[0110] The laser anchor point image refers to an image composed of all the laser red dots irradiated at the relative positions of the contour vertices and the relative positions of the edge midpoints. It is used as a reference when positioning the vehicle instrument. The laser anchor point image is a fixed standard image and will not change due to the obstruction of the laser device.

[0111] Step S203: Control the clamping device to clamp the vehicle instrument to a preset pre-positioning height above the instrument installation position, and obtain a laser red dot distribution image.

[0112] In this embodiment, in order to position the vehicle instrument when it is installed, the instrument is first suspended at a certain height above the instrument installation position by a clamping device. This height is the pre-positioning height, which is set by the technician and will not be described in detail here. At this height, there is a gap between the instrument and the instrument installation position, so that the laser red dot below it can be observed and positioned.

[0113] The laser red dot distribution image refers to the image of the laser red dot on the test bench below the instrument when it is at the pre-positioned height, which is obtained by the environmental camera. When the instrument position is inaccurate, part of the laser red dot will be blocked, and the laser red dot distribution image will change.

[0114] Step S204: Based on the inconsistency between the laser red dot distribution image and the laser anchor point image, the laser red dot distribution image and the laser anchor point image are compared to determine the laser red dot feature blocked by the vehicle instrument, and the blocked red dot feature position of the blocked laser red dot feature in the laser anchor point image is determined.

[0115] Compare the laser red dot distribution image and the laser anchor point image. If the two are consistent, it means that the installation position of the instrument has been aligned. At this time, the instrument can be lowered and installed at the instrument installation position.

[0116] If the laser red dot distribution image and the laser anchor point image are inconsistent, it means that the vehicle instrument position is not aligned, and part of the laser red dot is blocked due to the deviation of the vehicle instrument. By comparing the laser red dot distribution image and the laser anchor point image, it is possible to determine which laser red dot features are blocked and not displayed on the test bench. The position of these blocked laser red dot features in the laser anchor point image is the blocked red dot feature position.

[0117] Step S205: The vehicle instrument is horizontally moved and adjusted according to the position of the blocked red dot feature until the laser red dot distribution image and the laser anchor point image are consistent, and the vehicle instrument is lowered and installed at the instrument installation position.

[0118] According to the positional relationship of these obstructed red dot feature positions, the adjustment amount and adjustment movement direction required to adjust the vehicle instrument to the accurate position can be determined, and the instrument can be adjusted horizontally according to the adjustment amount and adjustment movement direction. During the adjustment process, if the laser red dot distribution image and the laser anchor point image are consistent, it means that the instrument position has been adjusted in place, and the instrument can be lowered and installed at the instrument installation position.

[0119] Reference Figure 3 , the method for dealing with the foreign matter characteristics on the surface of the vehicle instrument includes the following steps:

[0120] Step S300: When the vehicle instrument is located at the instrument installation position, a surface image of the vehicle instrument is acquired.

[0121] The vehicle instrument surface image refers to the image of the top surface of the instrument acquired by the environmental camera. If there are foreign body features on the instrument surface, the foreign body features will appear in the vehicle instrument surface image and can be identified.

[0122] Step S301: determining the characteristic position of a foreign object according to the vehicle instrument surface image and a preset reference surface image.

[0123] The reference surface image refers to an image when the instrument surface is absolutely clean. This image is used as a reference image for judging whether there are foreign objects on the instrument, and will not be described in detail here.

[0124] The vehicle instrument surface image is compared with the reference surface image. If there are foreign body features on the instrument surface, the difference between the vehicle instrument surface image and the reference surface image is the foreign body feature. The position of the foreign body feature in the vehicle instrument surface image can be determined based on the foreign body feature identified by the image, and the actual position of the foreign body feature on the instrument surface can be determined based on the preset image ratio. The foreign body feature position refers to the actual position of the foreign body feature on the instrument surface.

[0125] Step S302: Determine the shortest distance direction of the boundary according to the characteristic position of the foreign object and the top view profile of the instrument.

[0126] The boundary shortest distance direction refers to the direction of the shortest distance between the foreign body feature position and the top view contour of the instrument on the instrument surface. After the boundary shortest distance direction is determined here, the foreign body feature needs to be removed from this direction in subsequent embodiments. When the foreign body feature position of the foreign body feature on the instrument surface is determined, the shortest distance from the foreign body feature position to the boundary contour can be determined, and the direction pointed by the shortest distance is the boundary shortest distance direction.

[0127] Step S303: Control a preset suction cup device to extend from the test table and adsorb to the bottom of the vehicle instrument with a preset adsorption force.

[0128] When the vehicle instrument is installed on the test bench from the pre-positioned height, a suction cup device can be extended from the middle of the test bench to absorb the instrument, so that the vehicle instrument is not easily displaced in the case of vibration or accidental collision. The absorption force is the force set by the technician when the suction cup device absorbs and fixes the instrument, which will not be described here.

[0129] Step S304: Determine the lifting force of the suction cup device according to the preset vehicle instrument weight, and control the suction cup device to lift and tilt the vehicle instrument with the lifting force and the direction of the shortest distance to the boundary to slide and remove the foreign body features from the direction of the shortest distance to the boundary.

[0130] When there are foreign features on the instrument surface, the instrument needs to be tilted so that the foreign features slide off the instrument surface. In this embodiment, the suction cup device can be raised and lowered and the suction cup can be tilted and rotated. The instrument is lifted up by the suction cup device and rotated in the direction of the shortest distance to the boundary and then tilted. At this time, the foreign features can slide off in the direction of the shortest distance to the boundary. During the sliding of the foreign features, the instrument surface is not easily scratched because the sliding distance is the shortest.

[0131] The lifting force is the force when the suction cup device lifts the vehicle instrument. The lifting force is proportional to the weight of the vehicle instrument. The heavier the vehicle instrument, the greater the lifting force.

[0132] Reference Figure 4 , the instrument surface detection method includes the following steps:

[0133] Step S400: Acquire the overall image of the vehicle instrument.

[0134] The overall image of the vehicle instrument refers to the image of the vehicle instrument obtained by the environment camera. The top surface of the vehicle instrument is coated with a protective film feature, which can appear in the overall image of the vehicle instrument and be recognized.

[0135] Step S401: select the protective film features from the overall image of the vehicle instrument.

[0136] The overall image of the vehicle instrument includes the protective film features and the background. In order to better identify the protective film features, it is necessary to first remove the background except the protective film features from the overall image of the vehicle instrument, leaving only the protective film features.

[0137] Step S402: determining the contour of the protective film according to the overall image of the vehicle instrument and the characteristics of the protective film.

[0138] The protective film contour refers to the overall contour of the protective film feature. The protective film contour can be determined by image recognition of the protective film feature. When the protective film feature has an abnormal situation of edge warping, the protective film contour is the contour of the protective film feature after the edge warping.

[0139] Step S4031: Based on the inconsistency between the protective film contour and the preset reference laying contour, it is defined as the protective film edge corner warping, and the protective film feature is processed using the preset protective film edge corner warping processing method.

[0140] The reference laying profile refers to the standard profile when the protective film characteristics are normally laid flat on the instrument surface. It is used as a standard to judge whether the protective film characteristics are abnormal, and will not be elaborated here.

[0141] If the contour of the protective film is inconsistent with the reference laying contour, it means that the protective film feature has warped corners. At this time, the system processes the protective film feature with warped corners using a protective film corner warping processing method. The protective film corner warping processing method will not be described here and will be introduced in detail in subsequent embodiments.

[0142] Step S4032: Based on the fact that the protective film contour is consistent with the reference installation contour, the vehicle instrument is powered on to emit backlight, and a protective film backlight image is acquired.

[0143] If the protective film contour is consistent with the reference laying contour, it means that the protective film feature laying is normal. At this time, the surface of the protective film is tested again to determine whether there is any abnormality on the protective film surface.

[0144] The protective film backlight image refers to a surface image of the protective film obtained by the ambient camera after the vehicle instrument panel is powered on and the backlight is turned on.

[0145] Step S40321: Determine whether there is an abnormal brightness feature on the protective film feature whose brightness is inconsistent with a preset reference brightness based on the protective film backlight image recognition.

[0146] The reference brightness refers to the brightness of the complete protective film features under backlight illumination. The reference brightness can be determined by recognizing the backlight image of the protective film. It is a parameter pre-determined by a technician and will not be elaborated here.

[0147] If there are scratches on the protective film feature, the thickness of the protective film at the scratch is thinner, so the brightness is brighter than other parts under backlight, and the brightness of other parts is the reference brightness. The brightness of the backlight image of the protective film is identified to determine whether there is a position where the brightness is inconsistent with the reference brightness. The abnormal brightness feature is the position where the brightness on the protective film feature is inconsistent with the reference brightness. The system will handle the abnormal brightness feature in a targeted manner.

[0148] Step S40322: If there is an abnormal brightness feature on the protective film feature whose brightness is inconsistent with the reference brightness, the abnormal brightness feature is defined as a protective film scratch and processed using a preset protective film scratch processing method.

[0149] If there is an abnormal brightness feature on the protective film feature whose brightness is inconsistent with the reference brightness, the abnormal brightness feature is a scratch on the protective film. The system processes the scratch on the protective film through a protective film scratch processing method. The protective film scratch processing method is not described here and will be described in detail in subsequent embodiments.

[0150] Reference Figure 5 , the protective film scratch treatment method includes the following steps:

[0151] Step S500: determining the characteristic brightness of the abnormal brightness feature according to the luminescent image of the protective film.

[0152] The characteristic brightness refers to the brightness of the protective film feature at the abnormal brightness feature. The characteristic brightness can be determined by image recognition of the abnormal brightness feature in the protective film luminescence image.

[0153] Step S501: Based on the inconsistency between the characteristic brightness and the preset reference backlight brightness, it is defined as a scratch that does not penetrate the protective film feature, and the scratch feature position and scratch feature path are determined according to the protective film luminous image and abnormal brightness features.

[0154] The reference backlight brightness refers to the brightness when the backlight passes through the top of the vehicle instrument. The difference between the reference backlight brightness and the reference brightness is that the reference backlight brightness is the brightness of the top surface of the instrument, while the reference brightness is the brightness of the protective film feature surface when the backlight passes through the protective film feature.

[0155] The brightness of the scratch is analyzed to determine whether the scratch has penetrated the protective film. The system uses different methods to handle the two situations: penetration and non-penetration.

[0156] If the feature brightness is inconsistent with the baseline backlight brightness, it means that the scratch depth is shallow and has not completely penetrated the protective film feature.

[0157] The scratch feature position refers to the position of the scratch on the protective film feature. The scratch feature path refers to the shape path of the scratch. The scratch feature position and the scratch feature path can be obtained by image recognition and analysis of the abnormal brightness features in the protective film luminescent image.

[0158] Step S502: controlling a preset heating device to heat the protective film feature along the scratch feature path at a preset heating temperature so that the scratch feature position has adhesiveness.

[0159] The heating device is used to heat the protective film so that the protective film has adhesiveness. The protective film is made of transparent plastic material, and its adhesiveness will increase when heated to a certain degree.

[0160] The heating temperature is the temperature set by the technician when the heating device heats the protective film features. Heating at the heating temperature is not likely to cause melting damage to the protective film features, which will not be elaborated here.

[0161] In this embodiment, the heating device is used to move and heat along the scratch feature path, so that the viscosity of the protective film feature on the scratch feature path is increased.

[0162] Step S503: Control the preset smoothing device to follow the heating device to move and press along the scratch feature path with a preset pressing force to bond the two sides of the scratch feature path.

[0163] When the viscosity of the protective film feature on the scratch feature path increases, the system smoothes and presses along the scratch feature path through a smoothing device, and at this time, the two sides of the cracked scratch on the scratch feature path can be re-bonded.

[0164] The pressing force is the force applied by the smoothing device set by the technician to smooth the features of the protective film. The protective film is smoothed by the pressing force, which is not easy to cause damage to the protective film and will not be elaborated here.

[0165] Reference Figure 6 When the characteristic brightness is consistent with the reference backlight brightness, the method for treating scratches on the protective film includes the following steps:

[0166] Step S600: Based on the characteristic brightness being consistent with the reference backlight brightness, it is defined as a scratch penetrating the protective film feature, and the position of one of the top corners of the protective film and the positions of the edges on both sides of the top corner are determined according to the overall image of the vehicle instrument and the contour of the protective film.

[0167] When the characteristic brightness is consistent with the reference backlight brightness, it means that the scratch has penetrated the protective film, so that the characteristic brightness at the scratch is consistent with the reference backlight brightness. If the scratch penetrates the protective film, the protective film can no longer protect the instrument surface, so it is necessary to discard the protective film and replace it with a new one.

[0168] In order to allow the new protective film to replace the old protective film and be completely laid in the original position of the old protective film, it is necessary to first determine a top corner position of the protective film and the side positions on both sides of the top corner position, and use the top corner position and the side positions on both sides of the top corner position as the positioning reference for laying the new protective film.

[0169] The top corner position of the protective film and the side line positions on both sides of the top corner can be obtained by image recognition and analysis of the contour of the protective film in the overall image of the vehicle instrument.

[0170] Step S601: determining the lifting path between the top corners of two opposite protective films according to the contour of the protective film.

[0171] In this embodiment, the top corner position of the protective film is not only used as a positioning reference, but also the position where the old protective film begins to be lifted up and the position where the new protective film begins to be laid.

[0172] The lifting path refers to the moving path direction of the top corner position of the protective film when the system lifts up the old protective film. Here, the line between the top corner position where the old protective film starts to lift up and the other top corner position on the opposite side is taken as the lifting path, so the lifting path can be determined by analyzing the top corner positions of the two opposite protective films in the protective film contour.

[0173] Step S602: Control a preset scraper to scrape up a corner of the protective film feature at the top corner of the protective film.

[0174] The blade head of the scraper is thinner and is used to scrape up the protective film.

[0175] After determining the top angle position of the protective film, the system controls the scraper to move from the top angle position of the protective film feature, first scraping up an angle of the protective film feature to facilitate the subsequent clamping of the clamping device.

[0176] Step S603: Control one of the clamping devices to lift up the old protective film feature along the lifting path, and control another clamping device to synchronously attach the new protective film feature to the vehicle instrument surface along the lifting path according to the top angle position of the protective film and the positions of the edges on both sides of the top angle.

[0177] When the protective film feature tilts up a corner, the system controls the clamping device to clamp the tilted corner, and controls the clamping device to move along the lifting path to lift the old protective film. In the process of lifting the old protective film feature, the system synchronously controls another clamping device to install the new protective film feature in the position of the old protective film feature. During the installation process, the top corner position of the new protective film is first laid based on the positioning of the top corner position of the protective film and the position of the edges on both sides of the top corner, and then the clamping device is controlled to move along the lifting path to completely stick the protective film on the surface of the instrument.

[0178] The process of removing the old protective film and the process of laying the new protective film are carried out simultaneously, so that the exposed instrument surface in the gap between the new protective film and the old protective film is not easy to get dust.

[0179] Step S604: Control a preset blowing device to blow air between the new protective film features and the old protective film features with a preset blowing force.

[0180] The air blowing device is used to blow air into the gap between the new protective film and the old protective film, so that dust is not easy to fall on the exposed instrument surface. And by blowing air, negative pressure is formed in the gap between the new protective film and the old protective film, so as to facilitate the laying of the new protective film.

[0181] The blowing force is the force of the blowing device set by the technician to blow air at the gap between the new protective film and the old protective film, which will not be described in detail here.

[0182] Reference Figure 7 The method for processing the edge and corner warping of the protective film includes the following steps:

[0183] Step S700: determining the lifting and laying range according to the protective film contour and the reference laying contour.

[0184] The warping laying range refers to the area on the instrument surface that was originally protected by the protective film features but is exposed after the edges of the protective film features are warped. The range where the reference laying contour is located is composed of the range where the protective film contour is located and the warping laying range. The warping laying range can be determined based on the protective film contour and the reference laying contour.

[0185] Step S701: Control a preset wiping device to wipe the warped laying range, and control a preset spraying device to spray the warped laying range to clean and humidify the vehicle instrument.

[0186] The wiping device is arranged in the test working area and is used to wipe the instrument surface in the warping laying range to remove the dust falling in the warping laying range.

[0187] The spray device is used to spray the warped laying range, and the wind force generated by the spray further removes dust and humidifies the warped laying range.

[0188] Step S702: Determine the warped corners and corner crease positions of the protective film features according to the overall image of the vehicle instrument and the protective film features.

[0189] The warped corner refers to the vertex corner of the protective film feature where the warping has occurred. The corner crease position refers to the folded position when the protective film feature is folded due to the warping. The warped corner and corner crease position of the protective film feature can be obtained by image recognition analysis of the protective film feature that has warped in the overall image of the vehicle instrument.

[0190] Step S703: Determine the exposed top corner position of the warped laying range according to the reference laying profile.

[0191] The exposed top corner position refers to the position in the warped laying range that corresponds to the top corner position in the reference laying profile. The exposed top corner position can be obtained by analyzing the reference laying profile.

[0192] Step S704: Determine the leveling path according to the exposed top corner position and the corner crease position.

[0193] The flattening path refers to the movement and restoration path of the warped corner when restoring the warped corner of the protective film feature. The flattening path is the line connecting the exposed top corner position and the corner crease position.

[0194] Step S705: Control a preset scraper to extend from below the raised edge to the edge crease at a preset tilt angle, and at a preset scraping speed, start from the edge crease and move along the scraping path to turn over the raised edge and re-attach it to the raised laying range.

[0195] In this embodiment, the system controls the scraper to extend under the raised corner and to scrape the raised corner horizontally along the flattening path starting from the crease position of the corner. At this time, the vertex of the raised corner of the protective film feature can be restored to the exposed top corner position, so that the protective film feature can be re-applied to the instrument surface.

[0196] During the movement of the blade, the mist water left in the lifting and laying range by the spray device can moisten the protective film features to better bond the protective film features to the instrument, while the excess mist water can be squeezed out from between the protective film features and the instrument during the movement of the blade.

[0197] The tilt angle is the angle set by the technician when the scraper is scraping the raised corners of the protective film, which will not be elaborated here.

[0198] The scraping speed is the speed set by the technician at which the scraper moves on the raised corners of the protective film features. The scraper is moved by controlling the scraping speed so that the protective film features can better adhere to the surface of the instrument. I will not go into details here.

[0199] In the process of comparing the vehicle instrument display image and the reference icon parameters, a highlight spot will be generated on the vehicle instrument surface due to reflection. The processing method of the highlight spot includes the following steps:

[0200] Step S800: determining the position and brightness of the highlight spot according to the vehicle instrument display image and the preset highlight spot.

[0201] The highlight spot position refers to the position where the highlight spot appears on the surface of the vehicle instrument. The spot brightness refers to the brightness of the highlight spot. Both the highlight spot position and the spot brightness can be determined by image recognition analysis of the highlight spot that appears in the vehicle instrument display image.

[0202] Step S801: determining the auxiliary lighting position of the preset auxiliary light device on the side wall of the vehicle instrument according to the position of the highlight light spot.

[0203] The auxiliary light device is used to provide auxiliary fill light to the instrument surface to increase the brightness of the backlight in a certain range around the highlight light spot position, thereby weakening the highlight light spot.

[0204] In this embodiment, the instrument surface is supplemented with light in the thickness direction of the vehicle instrument surface, and the auxiliary lighting position is the position where the auxiliary light device emits auxiliary light. When the highlight spot position is determined, the auxiliary lighting position is the point on the instrument side wall closest to the highlight spot position.

[0205] Step S802: determining the illumination brightness of the auxiliary light device according to the light spot brightness and the preset backlight brightness.

[0206] The lighting brightness is the brightness of the light emitted by the auxiliary light device. The lighting brightness is related to the light spot brightness and the backlight brightness. The sum of the light spot brightness and the backlight brightness needs to be within the preset visible range of the light spot brightness. In order to see the highlight light spot clearly, the brightness of the ambient light needs to be within a certain range of the highlight brightness, which is the visible range, and will not be described here.

[0207] Step S803: controlling the auxiliary light device to perform auxiliary lighting on the highlight light spot from the auxiliary lighting position with the lighting brightness.

[0208] After determining the auxiliary lighting position and lighting brightness of the auxiliary lighting device, the auxiliary lighting device is controlled to perform auxiliary lighting, so that the detection camera is not easily affected by the high-brightness light spot when collecting data on the instrument surface.

[0209] Based on the same inventive concept, an embodiment of the present invention provides a vehicle instrument detection system.

[0210] A vehicle instrument detection system comprises:

[0211] An acquisition module is used to acquire the test bench image information, the vehicle instrument display image, the laser red dot distribution image, the vehicle instrument surface image and the vehicle instrument overall image;

[0212] A memory for storing a program of a vehicle instrument detection method;

[0213] The program in the memory can be loaded and executed by the processor to implement a vehicle instrument detection method.

[0214] Based on the same inventive concept, an embodiment of the present invention provides an intelligent terminal, including a memory and a processor, wherein the memory stores a computer program that can be loaded by the processor and execute a vehicle instrument detection method.

[0215] The above is only a preferred embodiment of the present invention, and the protection scope of the present invention is not limited to the above embodiments. All technical solutions under the concept of the present invention belong to the protection scope of the present invention. It should be pointed out that for ordinary technicians in this technical field, some improvements and modifications without departing from the principle of the present invention should also be regarded as the protection scope of the present invention.

Claims

1. A vehicle instrument detection method, characterized in that: include: Obtain test bench image information; Determine the instrument installation position based on the test bench image information and preset reference lines; Controlling a preset clamping device to position the vehicle instrument at the instrument installation position; Inspect the vehicle instrument surface using a preset instrument surface inspection method to determine the laying condition of the preset protective film feature and handle any abnormal condition of the protective film feature; Inputting a preset instrument logic program into the vehicle instrument and acquiring the vehicle instrument display image; Determine an output program qualified prompt or an output program error prompt based on the comparison between the vehicle instrument display image and the preset reference icon parameters; The methods for dealing with the characteristics of foreign matter on the surface of vehicle instruments include: When the vehicle instrument is located at the instrument installation position, acquiring a surface image of the vehicle instrument; Determine the characteristic position of the foreign object according to the vehicle instrument surface image and the preset reference surface image; Determine the shortest distance direction of the boundary based on the characteristic position of the foreign body and the top view profile of the instrument; Control a preset suction cup device to extend from the test table and adsorb to the bottom of the vehicle instrument with a preset adsorption force; The lifting force of the suction cup device is determined according to the preset weight of the vehicle instrument, and the suction cup device is controlled to lift and tilt the vehicle instrument according to the lifting force and the direction of the shortest distance of the boundary so as to slide and remove the foreign body features from the direction of the shortest distance of the boundary; Instrument surface inspection methods include: Obtain the overall image of the vehicle instrument; Select the protective film features from the overall image of the vehicle instrument; Determine the contour of the protective film based on the overall image of the vehicle instrument and the characteristics of the protective film; Based on the inconsistency between the protective film contour and the preset reference laying contour, it is defined as the protective film corner warping, and the protective film feature is processed by the preset protective film corner warping processing method; Based on the consistency between the protective film profile and the reference laying profile, the vehicle instrument is powered on to emit backlight, and a protective film backlight image is obtained; Determine whether there is an abnormal brightness feature on the protective film feature whose brightness is inconsistent with a preset reference brightness according to the protective film backlight image recognition, wherein the reference brightness is the brightness of the protective film feature surface when the backlight passes through the protective film feature, and the reference backlight brightness is the brightness of the top surface of the meter; If there is an abnormal brightness feature on the protective film feature whose brightness is inconsistent with the reference brightness, the abnormal brightness feature is defined as a protective film scratch and is processed using a preset protective film scratch processing method.

2. A vehicle instrument detection method according to claim 1, characterized in that: Vehicle instrument installation and positioning methods include: Determine the relative positions of the contour vertices and the relative positions of the edge midpoints according to the preset instrument top view contour; Determine the laser irradiation point position at the instrument installation position according to the relative position of each contour vertex and the relative position of the edge midpoint; Controlling a preset laser device to vertically emit laser downward at a laser irradiation point position to generate a laser red dot feature at the instrument installation position and form a laser anchor point image; Controlling the clamping device to clamp the vehicle instrument to a preset pre-positioning height above the instrument installation position, and obtaining a laser red dot distribution image; Based on the inconsistency between the laser red dot distribution image and the laser anchor point image, the laser red dot distribution image and the laser anchor point image are compared to determine the laser red dot feature blocked by the vehicle instrument, and the blocked red dot feature position of the blocked laser red dot feature in the laser anchor point image is determined; The vehicle instrument is adjusted to move horizontally according to the position of the blocked red dot feature until the laser red dot distribution image and the laser anchor point image are consistent, and the vehicle instrument is lowered and installed at the instrument installation position.

3. A vehicle instrument detection method according to claim 1, characterized in that: The methods for treating scratches on protective film include: Determine characteristic brightness of abnormal brightness features based on the luminescent image of the protective film; Based on the inconsistency between the characteristic brightness and the preset reference backlight brightness, it is defined as the characteristic that the scratch does not penetrate the protective film, and the characteristic position of the scratch and the characteristic path of the scratch are determined according to the luminous image of the protective film and the abnormal brightness characteristics; Controlling a preset heating device to heat the protective film feature along the scratch feature path at a preset heating temperature so that the scratch feature position has adhesiveness; The preset smoothing device is controlled to follow the heating device to move and press along the scratch feature path with a preset pressing force to bond the two sides of the scratch feature path.

4. A vehicle instrument detection method according to claim 3, characterized in that: Also includes: Based on the consistency between the characteristic brightness and the reference backlight brightness, it is defined as the scratch penetration protective film feature, and the position of one of the top corners of the protective film and the positions of the edges on both sides of the top corner are determined according to the overall image of the vehicle instrument and the contour of the protective film; Determine the lifting path between the top corners of two protective films on opposite sides according to the contour of the protective film; Control the preset scraper to scrape up a corner of the protective film feature at the top corner of the protective film; Control one of the clamping devices to lift up the old protective film feature along the lifting path, and control another clamping device to synchronously attach the new protective film feature to the vehicle instrument surface along the lifting path according to the top angle position of the protective film and the positions of the edges on both sides of the top angle; The preset blowing device is controlled to blow air between the new protective film feature and the old protective film feature with a preset blowing force.

5. A vehicle instrument detection method according to claim 1, characterized in that: The methods for dealing with the warping of the protective film corners include: Determine the lifting and laying range according to the protective film contour and the reference laying contour; Controlling a preset wiping device to wipe the warped laying range, and controlling a preset spraying device to spray the warped laying range to clean and humidify the vehicle instrument; Determine the warped corners and corner crease positions of the protective film features according to the overall image of the vehicle instrument and the features of the protective film; Determine the exposed top corner position of the lifting laying range according to the reference laying profile; Determine the shoveling path based on the exposed top corner position and the corner crease position; Control the preset scraper to extend from under the raised edge to the edge crease at a preset inclination angle, and at a preset scraping speed, take the edge crease as the starting point along the scraping path to turn over the raised edge and re-fit it to the raised laying range.

6. A vehicle instrument detection method according to claim 1, characterized in that: When comparing the vehicle instrument display image and the reference icon parameters, the vehicle instrument surface will produce a highlight spot due to reflection. The processing method of the highlight spot includes: Determine the position and brightness of the highlight spot according to the vehicle instrument display image and the preset highlight spot; Determine the auxiliary lighting position of the preset auxiliary light device on the side wall of the vehicle instrument according to the position of the highlight light spot; Determine the illumination brightness of the auxiliary light device according to the light spot brightness and the preset backlight brightness; The auxiliary light device is controlled to perform auxiliary lighting on the highlight light spot from the auxiliary lighting position with lighting brightness.

7. A vehicle instrument detection system, characterized in that: include: An acquisition module is used to acquire the image information of the test bench, the vehicle instrument display image, the laser red dot distribution image, the vehicle instrument surface image, the vehicle instrument overall image and the protective film backlight image; A memory for storing a program of a vehicle instrument detection method according to any one of claims 1 to 6; The program in the memory can be loaded and executed by the processor to implement a vehicle instrument detection method.

8. An intelligent terminal, characterized in that: The invention comprises a memory and a processor, wherein the memory stores a computer program which can be loaded by the processor and executes a vehicle instrument detection method as claimed in any one of claims 1 to 6.

Images