Vehicle detection method, device and equipment and storage medium
Through the use of image information to identify the characteristic hole of the vehicle and position the area to be tested through the use of image information to achieve the rapid and accurate testing of LASD glue material coverage, it solves the problem of inaccurate detection and low production efficiency during the spraying process.
Patent Information
- Application Number
- CN202310922150.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-07-26
- Publication Date
- 2025-01-28
AI Technical Summary
During the automobile production process, when spraying LASD glue materials, the glue materials contain impurities, which can easily block the spray head, resulting in defects such as glue leakage, spray leakage, spray misalignment on the bilge in the car body. The existing detection methods are slow and inaccurate. Impact production efficiency.
By obtaining the image information of the bottom board of the vehicle, identify the first feature hole of the vehicle, and to locate the measurement area according to the characteristic hole position, and the glue material coverage detection is performed to achieve accurate detection of the coverage of the glue material of the vehicle cabin.
This method can quickly and accurately detect the coverage of glue materials on the bottom plate of the vehicle cabin, improve the detection efficiency, and reduce the defect rate in production.
Smart Images

Figure CN119379969A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of machine vision, and in particular to a vehicle detection method, device, equipment and storage medium. Background Art
[0002] During the automobile production process, it is necessary to apply LASD (Liquid Applied Sound Deadener) glue on the interior cabin floor of the car body according to the NVH (Noise, Vibration, Harshness) simulation results to isolate vibrations and reduce noise, thereby improving the ride comfort of the car.
[0003] At present, in the process of spraying LASD glue, impurities in the glue material can easily clog the nozzle, causing defects such as glue leakage, spraying leakage, and spraying misalignment in the part of the bottom plate of the vehicle body that needs to be sprayed with glue material. In the existing glue material defect detection process, the glue material is directly detected at the preset position, so it is necessary to adjust the preset position before each glue material detection. The glue material detection speed in this way is slow. At the same time, once the preset position is adjusted inaccurately, it is easy to cause inaccurate detection results, which seriously affects the production efficiency of automobile products. Summary of the invention
[0004] In view of this, the present application provides a vehicle detection method, device, equipment and storage medium, the main purpose of which is to solve the problem of inaccurate detection of the coverage of sprayed LASD glue materials during the vehicle production process, thereby affecting the production efficiency of the vehicle.
[0005] To achieve the above objectives, the present application discloses a vehicle detection method in a first aspect, the method comprising:
[0006] Acquire image information of the vehicle cabin floor;
[0007] In the image information, identifying a first characteristic hole position of the vehicle;
[0008] Positioning a plurality of areas to be measured of the image information according to the first characteristic hole position;
[0009] The plurality of test areas to which the adhesive material has been sprayed are tested to obtain a coverage test result of the adhesive material in the vehicle cabin floor.
[0010] Optionally, identifying a first characteristic hole position of a vehicle in the image information includes:
[0011] Performing grayscale value conversion on image information captured under a preset light source to obtain grayscale values at different positions in the vehicle cabin floor;
[0012] Determine the surrounding characteristic points of the characteristic hole position of the vehicle by comparing the gray value difference between adjacent positions in the vehicle cabin bottom plate with the gray value difference threshold;
[0013] A first characteristic hole position of the vehicle is determined by identifying at least one surrounding characteristic point.
[0014] Optionally, positioning a plurality of areas to be measured of the image information according to the first characteristic hole position includes:
[0015] Establishing a coordinate system using the position of at least one of the first characteristic holes in the image information;
[0016] The positions of the multiple areas to be measured of the image information in the coordinate system are determined, and the multiple areas to be measured are positioned.
[0017] Optionally, before determining the positions of the multiple areas to be measured of the image information in the coordinate system and positioning the multiple areas to be measured, the method further includes:
[0018] Determine the hole position coordinate value of the at least one first characteristic hole position in the coordinate system established at the position;
[0019] Determine the vehicle model corresponding to the current vehicle cabin floor using the hole position coordinate values;
[0020] The determining positions of the multiple areas to be measured of the image information in the coordinate system and positioning the multiple areas to be measured includes:
[0021] Determine the positions of multiple areas to be tested of the image information of the vehicle model in the coordinate system, and locate the multiple areas to be tested.
[0022] Optionally, before positioning the plurality of areas to be measured of the image information according to the first characteristic hole position, the method further includes:
[0023] Obtaining the reference characteristic hole position corresponding to the reference image information;
[0024] Performing hole position comparison using the first characteristic hole position and the reference characteristic hole position, and outputting a comparison result, wherein the comparison result includes at least one of a horizontal coordinate difference, a vertical coordinate difference, and an angle difference between the first characteristic hole position and the reference characteristic hole position;
[0025] If the comparison result is greater than the comparison threshold, the first characteristic hole position is corrected to obtain a second characteristic hole position;
[0026] The positioning of the plurality of areas to be measured of the image information according to the first characteristic hole position includes:
[0027] Establishing a coordinate system using the position of at least one of the second characteristic holes in the image information;
[0028] The positions of the multiple areas to be measured of the image information in the coordinate system are determined, and the multiple areas to be measured are positioned.
[0029] Optionally, the detecting of the plurality of test areas on which the adhesive material has been sprayed to obtain the coverage detection result of the adhesive material in the vehicle cabin floor includes:
[0030] Performing pixel processing on the area to be tested on which the adhesive material has been sprayed at a preset pixel value to obtain a plurality of pixel blocks;
[0031] Respectively identifying the pixel grayscale values corresponding to the plurality of pixel blocks;
[0032] Marking pixel blocks whose pixel grayscale values are greater than a preset grayscale value;
[0033] Restore the region length value corresponding to the marked pixel block;
[0034] According to the comparison result between the area length value and the preset length value, the coverage detection result of the glue material in the vehicle cabin floor is output.
[0035] Optionally, outputting the coverage detection result of the adhesive material in the vehicle cabin floor according to the comparison result between the area length value and the preset length value includes:
[0036] Generate identification information corresponding to the area to be tested according to a comparison result between the area length value and a preset length value;
[0037] The identification information is used to output a coverage detection result of the adhesive material in the vehicle cabin floor.
[0038] Optionally, obtaining image information of a vehicle cabin floor taken by a camera includes:
[0039] Identify the same characteristic hole positions in the front bottom plate image, the middle bottom plate image, and the rear bottom plate image;
[0040] The front floor panel image, the middle floor panel image and the rear floor panel image are spliced by utilizing the same characteristic hole positions to generate image information of the vehicle's entire cabin floor panel.
[0041] In a second aspect of the present application, an embodiment provides a vehicle detection device, the device comprising:
[0042] An acquisition module, used for acquiring image information of a vehicle cabin bottom plate;
[0043] A recognition module, used to recognize a first characteristic hole position of a vehicle in the image information;
[0044] A positioning module, used for positioning a plurality of areas to be measured of the image information according to the first characteristic hole position;
[0045] The detection module is used to detect the multiple test areas where the glue material has been sprayed, and obtain the coverage detection result of the glue material in the vehicle cabin bottom plate.
[0046] In a third aspect of the present application, an electronic device is provided, including:
[0047] At least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute any one of the methods disclosed in the first aspect.
[0048] In a fourth aspect of the present application, an embodiment provides a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the method described in the first aspect is implemented.
[0049] In summary, according to the technical solution disclosed in the present application, a vehicle detection method, device, equipment and storage medium are disclosed, by obtaining image information of the vehicle's cabin floor; in the image information, the first characteristic hole position of the vehicle is identified; according to the first characteristic hole position, multiple areas to be tested of the image information are located; multiple areas to be tested that have been sprayed with glue material are detected, and the coverage detection result of the glue material in the vehicle's cabin floor is obtained. In the technical solution of the present application, after the vehicle completes the spraying of the glue material, the image information of the vehicle's cabin floor is photographed by a camera, and the first characteristic hole position of the vehicle photographed in the image information is used as a reference point to locate the area to be tested, and after confirming the area to be tested, the coverage detection result of the glue material sprayed in the area to be tested is identified to achieve the detection of the vehicle. The technical solution of the present application can be used to accurately obtain the area to be detected from the image information generated by the camera shooting the vehicle's cabin floor, and the first characteristic hole position of the vehicle is used as a reference, and the detection of the glue material is realized. The technical solution of the present application can be used to directly analyze the image to quickly realize the detection of the glue material coverage, and the detection of the vehicle can be quickly realized, which ensures the detection efficiency of the vehicle.
[0050] The above description is only an overview of the technical solution of the present application. In order to more clearly understand the technical means of the present application, it can be implemented in accordance with the contents of the specification. In order to make the above and other purposes, features and advantages of the present application more obvious and easy to understand, the specific implementation methods of the present application are listed below. BRIEF DESCRIPTION OF THE DRAWINGS
[0051] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.
[0052] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.
[0053] Figure 1 A flow chart of a vehicle detection method provided by an embodiment of the present application is shown;
[0054] Figure 2 A schematic diagram of the structure of a vehicle cabin floor photographed by multiple cameras provided in an embodiment of the present application is shown;
[0055] Figure 3 An overall flow chart of vehicle detection provided by an embodiment of the present application is shown;
[0056] Figure 4 A structural diagram of a vehicle detection device provided in an embodiment of the present application is shown. DETAILED DESCRIPTION
[0057] In order to more clearly understand the above-mentioned purposes, features and advantages of the present application, the scheme of the present application will be further described below. It should be noted that the embodiments of the present application and the features in the embodiments can be combined with each other without conflict.
[0058] In order to solve the problem of inaccurate detection of the coverage of the sprayed LASD adhesive material during the vehicle production process, thereby affecting the production efficiency of the vehicle:
[0059] This embodiment provides a vehicle detection method, such as Figure 1 FIG. 1 is a flowchart of the method of this embodiment, and the method of this embodiment may specifically include the following steps:
[0060] Step 101, obtaining image information of the vehicle cabin floor.
[0061] The technical solution of this application is mainly aimed at detecting the glue material sprayed on the vehicle bottom plate, and the detection process is to detect the image of the vehicle bottom plate. Therefore, it is necessary to take a picture of the vehicle bottom plate when the vehicle bottom plate reaches the shooting position of the camera to generate image information of the vehicle bottom plate.
[0062] Step 102: Identify a first characteristic hole position of the vehicle in the image information.
[0063] There are some holes distributed in the vehicle cabin floor. In this embodiment, after acquiring the image information of the vehicle cabin floor, a group of first characteristic hole positions is identified from the image information. The first characteristic hole positions may be holes with high processing accuracy in the vehicle cabin floor.
[0064] Step 103: positioning a plurality of areas to be measured of the image information according to the first characteristic hole position.
[0065] After the first characteristic hole position is confirmed in the image information, the area to be tested is located by taking the first characteristic hole position as a reference point according to the block relationship between the area to be tested and the first characteristic point position in the image information.
[0066] Step 104 , inspecting the plurality of areas to be inspected on which the adhesive material has been sprayed, and obtaining the coverage inspection result of the adhesive material in the vehicle cabin bottom plate.
[0067] After the area to be tested is determined, the area to be tested has been sprayed with adhesive material. By detecting the coverage of the adhesive material, the coverage detection result of the adhesive material is identified, and it is determined whether the coverage of the adhesive material meets the coverage requirements, thereby completing the detection of the vehicle.
[0068] In this embodiment, for a vehicle floor panel sprayed with adhesive material, the method proposed in this embodiment can identify the first characteristic hole position of the image information of the vehicle floor panel, and further determine the area to be tested, and perform adhesive material detection on the area to be tested, so as to quickly locate the area to be tested, and accurately obtain the adhesive material coverage detection result for the area to be tested, thereby ensuring the operating efficiency of the vehicle production line.
[0069] In a possible embodiment, identifying a first characteristic hole position of a vehicle in the image information includes:
[0070] Perform grayscale value conversion on image information captured under a preset light source to obtain grayscale values of different blocks in the vehicle cabin floor plate; determine the surrounding feature points of the vehicle's characteristic hole position by comparing the grayscale value difference between adjacent blocks in the vehicle cabin floor plate with a grayscale difference threshold; and determine the first characteristic hole position of the vehicle by identifying at least one surrounding feature point.
[0071] In the present embodiment, the confirmation of the first characteristic hole position is further explained. When the vehicle cabin floor is illuminated by a preset light source, different blocks have different brightness in the image information generated by the capture. For example, the characteristic hole position cannot be illuminated by the light source, has low brightness, and has the smallest grayscale value, while the surface of the vehicle cabin floor can be directly illuminated by the light source, has high brightness, and has a large grayscale value.
[0072] Therefore, the content of this embodiment realizes the confirmation of the first characteristic hole position based on the above-mentioned characteristics, that is, there is a difference in brightness value between different areas of the image, and after the brightness value is expressed in the form of grayscale value, the grayscale value of different positions between the vehicle cabin floor panels is calculated, wherein the grayscale value difference between the grayscale value of the first characteristic hole position and the adjacent vehicle cabin floor panel surface is the maximum value of the grayscale value difference between different positions, and the first characteristic hole position and the adjacent vehicle cabin floor panel surface are in an adjacent relationship, therefore, by setting a grayscale difference threshold, at least one surrounding feature point of the first characteristic hole position is obtained, and the position of the first characteristic hole position in the image information is confirmed through the adjacent relationship or surrounding relationship between the surrounding feature points and the first characteristic hole position.
[0073] By adopting the technical solution of this embodiment, under a preset light source, different positions under the vehicle cabin floor are irradiated with different light, resulting in different brightness. By utilizing the large difference in brightness values between the first characteristic hole position and the adjacent vehicle cabin floor surface, the position of the first characteristic hole position can be accurately acquired.
[0074] In a possible embodiment, positioning multiple areas to be measured of the image information according to the first characteristic hole position includes:
[0075] A coordinate system is established using the position of at least one first characteristic hole in the image information; the positions of multiple areas to be measured in the image information in the coordinate system are determined, and the multiple areas to be measured are positioned.
[0076] In the present embodiment, after confirming at least one first characteristic hole position, a coordinate system is generated according to the specific position of the first characteristic point in the image information to represent the specific coordinate values of each point in the image information. Among them, the Y axis of the coordinate system can be based on the positive front and rear direction of the vehicle. Further, after setting up the coordinate system, the specific position of the area to be measured in the coordinate system can be directly obtained through the coordinate system, and the area to be measured can be accurately located based on the obtained specific position.
[0077] By adopting the technical solution of this embodiment, an overall coordinate system of the image information is established based on the point value of the known first feature point, so that other areas of the image information can be accurately reflected in the coordinate system. For example, the coordinate system and the position of the area to be measured in the image information can be used to accurately locate the area to be measured in the coordinate system.
[0078] In a possible embodiment, before determining the positions of the multiple areas to be measured of the image information in the coordinate system and positioning the multiple areas to be measured, the method further includes:
[0079] Determine the hole position coordinate value of at least one first characteristic hole position in the position establishment coordinate system; determine the vehicle model corresponding to the current vehicle cabin bottom plate using the hole position coordinate value;
[0080] Determine the positions of multiple areas to be measured of the image information in the coordinate system, and locate the multiple areas to be measured, including:
[0081] The positions of multiple areas to be tested of the image information under the vehicle model in the coordinate system are determined, and the multiple areas to be tested are positioned.
[0082] This embodiment takes into account the diversity of vehicle models and adds a technical solution for determining the vehicle model. For example, in the cabin floor panels of different vehicle models, the same first feature point may exist at the same position of the cabin floor panel. For example, the first feature point exists at the center of the crossbeam between the front floor panel and the middle floor panel. Then, the technical solution of this embodiment is adopted to determine the hole coordinate values of the first feature point in the corresponding coordinate system. According to the difference in the hole coordinate values, the difference in the coordinate system is reflected, so as to confirm the vehicle model to which it belongs according to the coordinate system, and realize the accurate positioning of the position of the area to be measured according to the coordinate system corresponding to the vehicle model.
[0083] The technical solution of this embodiment proposes a method for determining the vehicle model with respect to various vehicle signals belonging to the vehicle floor plate. The difference in the point values of the first feature point at the same position in different coordinate systems is used to confirm the difference in coordinate systems. Thus, the vehicle model can be determined based on the correspondence between the coordinate system and the vehicle model, and the diversity of the vehicle floor plate can be determined.
[0084] In a possible embodiment, before positioning the plurality of to-be-tested areas of the image information according to the first characteristic hole position, the method further includes:
[0085] Obtain a reference characteristic hole position corresponding to the reference image information; perform hole position comparison using the first characteristic hole position and the reference characteristic hole position, and output a comparison result, wherein the comparison result includes at least one of a horizontal coordinate difference, a vertical coordinate difference, and an angle difference between the first characteristic hole position and the reference characteristic hole position; if the comparison result is greater than a comparison threshold, correct the first characteristic hole position to obtain a second characteristic hole position;
[0086] Positioning multiple areas to be measured of the image information according to the first characteristic hole position includes:
[0087] Establishing a coordinate system using the position of at least one second characteristic hole position in the image information;
[0088] The positions of the multiple areas to be measured of the image information in the coordinate system are determined, and the multiple areas to be measured are positioned.
[0089] In the technical solution of this embodiment, before performing the positioning of the area to be measured, a step of correcting the image information is also included. By confirming a set of reference image information, the reference characteristic hole position of the reference image information is compared with the first characteristic hole position, the hole position difference is determined, the comparison result is output, and it is determined whether the image information has generated an image deviation. If it is confirmed that the image has a deviation, the first characteristic hole position is corrected based on the reference characteristic hole position to achieve image correction.
[0090] The technical solution of this embodiment can solve the problem of inaccurately generated first feature hole positions caused by position deviation of the vehicle. The position of the first feature hole positions can be corrected using the reference feature hole positions, and the corrected image information can be passed to subsequent image processing steps to ensure the accuracy of the recognition results.
[0091] In a possible embodiment, multiple test areas to be tested on which the adhesive material has been sprayed are tested to obtain the coverage test result of the adhesive material in the vehicle cabin bottom plate, including:
[0092] The area to be tested where the glue material has been sprayed is pixelated at a preset pixel value to obtain multiple pixel blocks; the pixel grayscale values corresponding to the multiple pixel blocks are respectively identified; the pixel blocks whose pixel grayscale values are greater than the preset grayscale values are marked; the area length values corresponding to the marked pixel blocks are restored; and based on the comparison result between the area length value and the preset length value, the coverage detection result of the glue material in the vehicle cabin floor is output.
[0093] In the present embodiment, the process of detecting the area to be tested is specifically described, and the area to be tested is pixelated to generate corresponding pixel blocks, and the grayscale values of the pixel blocks are identified. The adhesive material covers the area to be tested. For example, under normal preset lighting conditions, the pixel grayscale value of the image information is between 0 and 255, 0 represents the darkest, and 255 represents the brightest. The area with a pixel grayscale value less than 80 is regarded as the adhesive material being well attached to the area to be tested. At this time, the adhesive material in this area does not have leakage, leakage, or bubbles.
[0094] Therefore, the present embodiment proposes to identify and compare the grayscale value of the glue material of each pixel block, confirm the glue material spraying situation corresponding to the current pixel block, and mark and count the pixel blocks with too high pixel grayscale values, so as to output the final glue material coverage detection result. The technical solution of this embodiment can further identify the glue material adhesion situation at all positions of the test area and output the accurate glue material coverage situation.
[0095] In a possible embodiment, outputting the coverage detection result of the adhesive material in the vehicle cabin bottom plate according to the comparison result between the area length value and the preset length value includes:
[0096] According to the comparison result between the area length value and the preset length value, the identification information corresponding to the area to be tested is generated; and the coverage detection result of the adhesive material in the vehicle cabin bottom plate is outputted using the identification information.
[0097] In the present embodiment, it is further proposed to output a display mark based on the comparison result between the area length value and the preset length value. The area length value indicates the length value of the pixel block in the area to be tested where the continuous adhesive material adhesion does not meet the preset pixel grayscale value. As for the output of the mark information, for example, when the area length value is greater than the preset length value, a red spraying abnormality signal is output, and when the area length value is less than the preset length value, a green spraying normal signal is output. Furthermore, when a spraying abnormality signal appears in any area to be tested, it is regarded as the adhesive material spraying of the whole vehicle is unqualified, and an alarm signal is output, indicating that the adhesive material needs to be re-brushed.
[0098] In a possible embodiment of the present application, obtaining image information of a vehicle cabin floor photographed by a camera includes:
[0099] Identify the same characteristic hole positions in the front floor plate image, the middle floor plate image and the rear floor plate image; use the same characteristic hole positions to splice the front floor plate image, the middle floor plate image and the rear floor plate image to generate image information of the vehicle's entire cabin floor plate.
[0100] In this embodiment, with respect to the process of using a camera to shoot a vehicle's cabin floor and generate image information, this embodiment proposes a possible solution, that is, in order to improve the clarity of the image information, multiple cameras are used to shoot different blocks of the vehicle's cabin floor respectively, generate images corresponding to different blocks, and re-stitch the images corresponding to the different blocks generated by shooting to generate complete image information of the vehicle's entire cabin floor. At the same time, in the content of this embodiment, it is further proposed to divide the vehicle's cabin floor into a front floor, a middle floor, and a rear floor. The specific front and rear division direction is based on the vehicle's driving direction. At the same time, the division between the front floor and the middle floor, and between the middle floor and the rear floor can be based on the crossbeam in the vehicle's cabin floor.
[0101] After the front floor image, the middle floor image and the rear floor image are generated by shooting, the same characteristic hole positions shared by the front floor image, the middle floor image and the rear floor image are further identified, and the front floor image and the middle floor image, and the middle floor image and the rear floor image are respectively stitched to generate image information of the vehicle's entire cabin floor. Exemplarily, the characteristic hole position A can be located in the middle crossbeam of the front and middle floor of the vehicle, then the characteristic hole position A will exist in the front floor image and the middle floor image, and the characteristic hole position A is the same characteristic hole position in the front floor image and the middle floor image, and the front floor image and the middle floor image can be spliced using the characteristic hole position A.
[0102] The image information of the vehicle's entire cabin floor generated by the technical solution of this embodiment, each camera only shoots the corresponding block of the vehicle's cabin floor, which can make the image information captured by each camera more informative, and can make the final generated image information of the entire cabin floor display clearer, which can further support the subsequent steps of processing the image information. Figure 2 As shown, a structural schematic diagram of a multi-camera vehicle cabin floor is disclosed. When it is confirmed that the vehicle cabin floor has reached a preset position, multiple cameras are controlled by an industrial computer to shoot the vehicle cabin floor under a light source to generate image information respectively, wherein the light source can adjust the light source brightness through a light source controller respectively, and when it is confirmed that the coverage detection result of the adhesive material is abnormal, an alarm signal is output.
[0103] Based on the above embodiments, an overall flow chart of vehicle detection is disclosed as follows: Figure 3 As shown, when the vehicle detection method is enabled, it is confirmed whether the vehicle has reached the preset position and the corresponding trigger signal is output. Multiple cameras are used to shoot the vehicle cabin floor to obtain image information. For the multiple image information shot by the camera, the same characteristic hole positions contained in different image information are used to splice the multiple images, and the characteristic hole positions in the image information are located. The vehicle type X01 or X02 is confirmed by the characteristic hole positions, and the coverage of the adhesive material is identified for the area to be tested under the vehicle type, and the normal or abnormal identification results are output.
[0104] This embodiment provides a vehicle detection device, such as Figure 4 As shown, it is a structural diagram of the device of this embodiment, including:
[0105] An acquisition module 41 is used to acquire image information of a vehicle cabin bottom plate;
[0106] A recognition module 42, used to recognize a first characteristic hole position of a vehicle in the image information;
[0107] A positioning module 43, used for positioning a plurality of areas to be measured of the image information according to the first characteristic hole position;
[0108] The detection module 44 is used to detect the multiple test areas where the glue material has been sprayed, and obtain the coverage detection result of the glue material in the vehicle cabin bottom plate.
[0109] Optionally, the identification module 42 is specifically used for:
[0110] Performing grayscale value conversion on image information captured under a preset light source to obtain grayscale values at different positions in the vehicle cabin floor;
[0111] Determine the surrounding characteristic points of the characteristic hole position of the vehicle by comparing the gray value difference between adjacent positions in the vehicle cabin bottom plate with the gray value difference threshold;
[0112] A first characteristic hole position of the vehicle is determined by identifying at least one surrounding characteristic point.
[0113] Optionally, the positioning module 43 is specifically used for:
[0114] Establishing a coordinate system using the position of at least one of the first characteristic holes in the image information;
[0115] The positions of the multiple areas to be measured of the image information in the coordinate system are determined, and the multiple areas to be measured are positioned.
[0116] Optionally, the positioning module 43 is specifically used for:
[0117] Determine the hole position coordinate value of the at least one first characteristic hole position in the coordinate system established at the position;
[0118] Determine the vehicle model corresponding to the current vehicle cabin floor using the hole position coordinate values;
[0119] Determine the positions of multiple areas to be tested of the image information of the vehicle model in the coordinate system, and locate the multiple areas to be tested.
[0120] Optionally, the positioning module 43 is specifically used for:
[0121] Obtaining the reference characteristic hole position corresponding to the reference image information;
[0122] Performing hole position comparison using the first characteristic hole position and the reference characteristic hole position, and outputting a comparison result, wherein the comparison result includes at least one of a horizontal coordinate difference, a vertical coordinate difference, and an angle difference between the first characteristic hole position and the reference characteristic hole position;
[0123] If the comparison result is greater than the comparison threshold, the first characteristic hole position is corrected to obtain a second characteristic hole position;
[0124] The second characteristic hole position is used to locate a plurality of areas to be measured of the image information.
[0125] Optionally, the detection module 44 is specifically used for:
[0126] Performing pixel processing on the area to be tested on which the adhesive material has been sprayed at a preset pixel value to obtain a plurality of pixel blocks;
[0127] Respectively identifying the pixel grayscale values corresponding to the plurality of pixel blocks;
[0128] Marking pixel blocks whose pixel grayscale values are greater than a preset grayscale value;
[0129] Restore the region length value corresponding to the marked pixel block;
[0130] According to the comparison result between the area length value and the preset length value, the coverage detection result of the glue material in the vehicle cabin floor is output.
[0131] Optionally, the detection module 44 is specifically used for:
[0132] Generate identification information corresponding to the area to be tested according to a comparison result between the area length value and a preset length value;
[0133] The identification information is used to output a coverage detection result of the adhesive material in the vehicle cabin floor.
[0134] Optionally, the acquisition module 41 is specifically used for:
[0135] Controlling a plurality of cameras to respectively photograph the front bottom plate, the middle bottom plate and the rear bottom plate of the vehicle cabin bottom plate to obtain the front bottom plate image, the middle bottom plate image and the rear bottom plate image;
[0136] Identify the same characteristic hole positions in the front bottom plate image, the middle bottom plate image, and the rear bottom plate image;
[0137] The front floor panel image, the middle floor panel image and the rear floor panel image are spliced by utilizing the same characteristic hole positions to generate image information of the vehicle's entire cabin floor panel.
[0138] Based on this understanding, the technical solution of the present application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, USB flash drive, mobile hard disk, etc.), including a number of instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to execute the methods of various implementation scenarios of the present application.
[0139] Based on the above Figure 1 The method shown, and Figure 4 In order to achieve the above-mentioned purpose, the embodiment of the present application further provides an electronic device that can be configured on the vehicle (such as a new energy vehicle) side, and the device includes at least one processor and a memory that is communicatively connected to the at least one processor; the memory is used to store instructions that can be executed by at least one processor, and the instructions are executed by at least one processor, and the processor is used to execute a computer program to implement the above-mentioned Figure 1 The method shown.
[0140] Optionally, the above-mentioned physical device may also include a user interface, a network interface, a camera, a radio frequency (RF) circuit, a sensor, an audio circuit, a WI-FI module, etc. The user interface may include a display, an input unit such as a keyboard, etc., and the optional user interface may also include a USB interface, a card reader interface, etc. The network interface may optionally include a standard wired interface, a wireless interface (such as a WI-FI interface), etc.
[0141] Those skilled in the art will appreciate that the above-mentioned physical device structure provided in this embodiment does not constitute a limitation on the physical device, and may include more or fewer components, or a combination of certain components, or different arrangements of components.
[0142] Based on the above Figure 1 The method shown, the embodiment of the present application also provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the method corresponding to any embodiment is implemented. The storage medium may also include an operating system and a network communication module. The operating system is a program that manages the hardware and software resources of the above-mentioned entity device, and supports the operation of information processing programs and other software and / or programs. The network communication module is used to realize communication between the components inside the storage medium, and communication with other hardware and software in the information processing entity device.
[0143] Through the description of the above implementation methods, those skilled in the art can clearly understand that the present application can be implemented by means of software plus the necessary general hardware platform, or by hardware. By applying the scheme of this embodiment, compared with the current prior art, this embodiment obtains image information of the vehicle's floor panel; in the image information, identifies the first characteristic hole position of the vehicle; locates multiple areas to be tested in the image information according to the first characteristic hole position; detects multiple areas to be tested that have been sprayed with glue material, and obtains the coverage detection result of the glue material in the vehicle's floor panel. In the technical scheme of the present application, after the vehicle has completed the spraying of the glue material, the image information of the vehicle's floor panel is captured by a camera, and the first characteristic hole position of the vehicle captured in the image information is used as a reference point to locate the area to be tested, and after confirming the area to be tested, the coverage detection result of the glue material sprayed in the area to be tested is identified to achieve the detection of the vehicle. By adopting the technical solution of the present application, the area to be inspected can be accurately obtained from the image information generated by the camera shooting the vehicle's cabin floor, with the first characteristic hole position of the vehicle as a reference, and the detection of the rubber material can be realized. By adopting the technical solution of the present application, the coverage of the rubber material can be quickly detected by directly analyzing the image, and the vehicle can be quickly detected, thereby ensuring the detection efficiency of the vehicle.
[0144] It should be noted that, in this article, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the term "comprises" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.
[0145] The above is only a specific implementation of the present application, so that those skilled in the art can understand or implement the present application. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to the embodiments described herein, but will conform to the widest scope consistent with the principles and novel features applied for herein.
Claims
1. A vehicle detection method, characterized in that: include: Acquire image information of the vehicle cabin floor; In the image information, identifying a first characteristic hole position of the vehicle; Positioning a plurality of areas to be measured of the image information according to the first characteristic hole position; The plurality of test areas to which the adhesive material has been sprayed are tested to obtain a coverage test result of the adhesive material in the vehicle cabin floor.
2. The method according to claim 1, characterized in that The step of identifying a first characteristic hole position of the vehicle in the image information includes: Performing grayscale value conversion on image information captured under a preset light source to obtain grayscale values at different positions in the vehicle cabin floor; Determine the surrounding characteristic points of the characteristic hole position of the vehicle by comparing the gray value difference between adjacent positions in the vehicle cabin bottom plate with the gray value difference threshold; A first characteristic hole position of the vehicle is determined by identifying at least one surrounding characteristic point.
3. The method according to claim 1, characterized in that The positioning of the plurality of areas to be measured of the image information according to the first characteristic hole position includes: Establishing a coordinate system using the position of at least one of the first characteristic holes in the image information; The positions of the multiple areas to be measured of the image information in the coordinate system are determined, and the multiple areas to be measured are positioned.
4. The method according to claim 3, characterized in that Before determining the positions of the multiple areas to be measured of the image information in the coordinate system and positioning the multiple areas to be measured, the method further includes: Determine the hole position coordinate value of the at least one first characteristic hole position in the coordinate system established at the position; Determine the vehicle model corresponding to the current vehicle cabin floor using the hole position coordinate values; The determining positions of the multiple areas to be measured of the image information in the coordinate system and positioning the multiple areas to be measured includes: Determine the positions of multiple areas to be tested of the image information of the vehicle model in the coordinate system, and locate the multiple areas to be tested.
5. The method according to claim 3, characterized in that: Before positioning the plurality of areas to be measured of the image information according to the first characteristic hole position, the method further includes: Obtaining the reference characteristic hole position corresponding to the reference image information; Performing hole position comparison using the first characteristic hole position and the reference characteristic hole position, and outputting a comparison result, wherein the comparison result includes at least one of a horizontal coordinate difference, a vertical coordinate difference, and an angle difference between the first characteristic hole position and the reference characteristic hole position; If the comparison result is greater than the comparison threshold, the first characteristic hole position is corrected to obtain a second characteristic hole position; The positioning of the plurality of areas to be measured of the image information according to the first characteristic hole position includes: Establishing a coordinate system using the position of at least one of the second characteristic holes in the image information; The positions of the multiple areas to be measured of the image information in the coordinate system are determined, and the multiple areas to be measured are positioned.
6. The method according to claim 1, characterized in that The step of testing the plurality of test areas on which the adhesive material has been sprayed to obtain the coverage test result of the adhesive material in the vehicle cabin bottom plate includes: Performing pixel processing on the area to be tested on which the adhesive material has been sprayed at a preset pixel value to obtain a plurality of pixel blocks; Respectively identifying the pixel grayscale values corresponding to the plurality of pixel blocks; Marking pixel blocks whose pixel grayscale values are greater than a preset grayscale value; Restore the region length value corresponding to the marked pixel block; According to the comparison result between the area length value and the preset length value, the coverage detection result of the glue material in the vehicle cabin floor is output.
7. The method according to claim 6, characterized in that Outputting the coverage detection result of the adhesive material in the vehicle cabin bottom plate according to the comparison result between the area length value and the preset length value includes: Generate identification information corresponding to the area to be tested according to a comparison result between the area length value and a preset length value; The identification information is used to output a coverage detection result of the adhesive material in the vehicle cabin floor.
8. The method according to claim 1, characterized in that The step of obtaining image information of the vehicle cabin floor comprises: Acquire a front bottom plate image, a middle bottom plate image, and a rear bottom plate image; Identify the same characteristic hole positions in the front bottom plate image, the middle bottom plate image, and the rear bottom plate image; The front floor panel image, the middle floor panel image and the rear floor panel image are spliced by utilizing the same characteristic hole positions to generate image information of the vehicle's entire cabin floor panel.
9. A vehicle detection device, characterized in that: include: An acquisition module, used for acquiring image information of a vehicle cabin bottom plate; A recognition module, used to recognize a first characteristic hole position of a vehicle in the image information; A positioning module, used for positioning a plurality of areas to be measured of the image information according to the first characteristic hole position; The detection module is used to detect the multiple test areas where the glue material has been sprayed, and obtain the coverage detection result of the glue material in the vehicle cabin bottom plate.
10. An electronic device, characterized in that: include: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method according to any one of claims 1 to 8.
11. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 8 is implemented.