A visual inspection device

Abstract

The present invention relates to the field of visual inspection technology and discloses a visual inspection device, including a frame, a visual inspection component, a placement mechanism, a marking mechanism and a central processing unit. The visual inspection component is used to detect surface defects of a rear lower panel assembly and whether a metal clip body is installed in place. The placement mechanism is used to place the rear lower panel assembly. The marking mechanism is used to spray a qualified mark on the rear lower panel assembly that has passed the inspection. The central processing unit is electrically connected to the visual inspection component, the placement mechanism and the marking mechanism respectively. The present invention solves industry pain points such as low manual inspection efficiency, high misjudgment rate and difficult data traceability through multi-sensor fusion detection, intelligent algorithm decision-making and mechatronics design, and realizes automatic, high-precision and traceable detection of surface defects and the installation status of metal clips during the production process of the rear lower panel assembly, providing reliable technical support for the intelligent manufacturing of automotive parts.

Description

Technical Field

[0001] The present invention relates to the technical field of visual detection, in particular to a visual detection device. Background Art

[0002] The rear lower panel assembly, also known as the center console rear USB cover, is a core functional component in the car cockpit. Its functions include protecting the steering mechanism and wiring harness assembly, blocking chassis noise transmission, and improving the interior aesthetics. In the current LSCC production process, metal clips such as Figure 8-Figure 9 The metal clips (shown) are used to secure wiring harnesses or adjacent components. The proper installation of the metal clips directly affects component connection reliability. Misaligned or loose connections can cause unusual noises or even functional failures while the vehicle is in motion.

[0003] Currently, when the rear lower panel assembly is produced, it is necessary to install a metal clip (such as Figure 8-Figure 9 After the metal clip is installed, it needs to be inspected to ensure that it is installed in place.

[0004] Currently, manual inspection is used, but this presents numerous challenges. First, the accuracy of manual inspection is significantly affected by the subjective factors of the inspector, making it difficult to establish a consistent standard for determining whether the metal clips are properly installed.

[0005] Secondly, manual inspection is inefficient. In the context of mass production of automotive parts, numerous rear lower panel assemblies require metal clip installation and inspection every minute. Manual inspection requires inspectors to carefully examine each clip individually, carefully checking for accurate positioning and secure connection, a time-consuming process. This significantly limits production efficiency and becomes a bottleneck in the entire production process.

[0006] To this end, a visual inspection device is proposed. Summary of the Invention

[0007] An object of the present invention is to provide a visual inspection device to solve or at least alleviate one or more of the above-mentioned problems and other problems in the prior art.

[0008] To achieve the above objectives, the present invention provides the following technical solutions: a visual inspection device comprising:

[0009] frame;

[0010] A visual inspection component is installed above the frame and is used to inspect surface defects of the rear lower panel assembly and whether the metal clip body is properly installed;

[0011] A placement mechanism, the placement mechanism being installed on the top of the frame and being used to place the rear lower panel assembly and transport the rear lower panel assembly to the inspection station;

[0012] A marking mechanism, the marking mechanism being mounted on the top of the frame and being used to spray a qualified mark on the rear lower panel assembly that has passed the inspection;

[0013] A central processing unit is installed inside the frame and is electrically connected to the visual detection component, the placement mechanism and the marking mechanism respectively.

[0014] In a visual inspection device according to the present invention, optionally, the visual inspection component includes a main camera and a sub-camera, and two sub-cameras are provided, and the two sub-cameras are located on both sides of the main camera. The main camera is used to detect surface defects of the rear lower panel assembly, and the sub-camera is used to detect whether the metal clip body is installed in place.

[0015] In a visual inspection device according to the present invention, optionally, the visual inspection component also includes an electric push rod, a protective cover is fixedly installed on the top of the frame, a support plate is fixedly installed inside the protective cover, the electric push rod is fixedly installed on the top of the support plate, the lower end of the piston rod of the electric push rod slides through the support plate and is fixedly connected to a moving seat, the main camera is fixedly installed on the bottom of the moving seat, fixed plates are fixedly installed on both sides of the moving seat, the auxiliary camera is fixedly installed at the lower end of the fixed plate, the top of the moving seat is fixedly connected to a guide rod, the top of the support plate is fixedly installed with a guide sleeve, the upper end of the guide rod slides through the support plate and slides out from the inside of the guide sleeve.

[0016] In a visual inspection device according to the present invention, optionally, the placement mechanism includes a rotating assembly, the rotating assembly includes a rotating motor, the rotating motor is fixedly mounted on the inner top of the frame, the rotating shaft of the rotating motor rotates through the top of the frame and is fixedly connected to a rotating plate, the rotating plate is arranged in an I-shape, and both ends of the rotating plate are fixedly mounted with a contoured jig for placing the rear lower panel assembly, the contoured jig is mounted with a fixing assembly, and the fixing assembly is used to fix the rear lower panel assembly on the contoured jig;

[0017] The fixing assembly includes a first cylinder and a second cylinder. An assembly groove is provided at the bottom of the contour mold. The first cylinder and the second cylinder are fixedly installed inside the assembly groove. A first clamping block and a second clamping block are respectively provided at both ends of the contour mold. The piston rod end of the first cylinder is fixedly connected to the lower end of the first clamping block, and the piston rod end of the second cylinder is fixedly connected to the lower end of the second clamping block. By controlling the piston rod of the first cylinder to retract, the first clamping block is pressed into the first notch on the rear lower panel assembly. By controlling the piston rod of the second cylinder to retract, the second clamping block is pressed into the second notch of the rear lower panel assembly.

[0018] In a visual inspection device according to the present invention, optionally, a material proximity sensor is fixedly embedded in the inner wall of the contoured mold, and the material proximity sensor is used to monitor whether the rear lower panel assembly is placed in the contoured mold.

[0019] In a visual inspection device according to the present invention, optionally, the marking mechanism includes an X-axis linear module, the X-axis linear module is fixedly mounted on the top of the frame, a column is fixedly mounted on the slide of the X-axis linear module, a third cylinder is fixedly mounted on the upper end of the column, and a spray terminal is fixedly mounted on the bottom of the piston rod of the third cylinder.

[0020] In a visual inspection device according to the present invention, optionally, the central processing unit includes a visual controller and a PLC controller, wherein:

[0021] The visual controller includes a data preprocessing module, a feature extraction module, a classification module, a position judgment module, a defect judgment module and a result output module;

[0022] The data preprocessing module is in communication with the main camera and the auxiliary camera, and is used to perform format unification processing, noise suppression and grayscale normalization processing on the image data collected by the main camera and the auxiliary camera;

[0023] The feature extraction module is connected to the data preprocessing module and is used to extract texture features, geometric features and edge feature data from the preprocessed image data;

[0024] The classification module is connected to the feature extraction module, and the classification module classifies the data into a surface defect feature set and an installation position feature set according to the feature data type;

[0025] The position judgment module and the defect judgment module are respectively connected to the classification module, wherein:

[0026] The classification module transmits the installation position feature set to the position judgment module, and the position judgment module judges whether the metal clip body is installed in place by comparing with a preset coordinate threshold;

[0027] The classification module transmits the surface defect feature set to the defect judgment module, and the defect judgment module determines the type and level of the surface defects of the rear lower panel assembly and the metal clip body through a recognition algorithm;

[0028] The position judgment module and the defect judgment module are both connected to the result output module, and the result output module is used to package the judgment results of the position judgment module and the defect judgment module and transmit them to the PLC controller;

[0029] The PLC controller is electrically connected to the electric push rod, the rotating motor, the solenoid valve of the first cylinder, the solenoid valve control end of the second cylinder, the material proximity sensor, the X-axis linear module, the solenoid valve control end of the third cylinder and the solenoid valve control end of the spray terminal.

[0030] In a visual inspection device according to the present invention, optionally, a touch screen is fixedly embedded on the protective cover, and the touch screen is electrically connected to the PLC controller.

[0031] In a visual inspection device according to the present invention, optionally, an alarm light is fixedly mounted on the protective cover, and the alarm light is electrically connected to the PLC controller.

[0032] In a visual inspection device according to the present invention, optionally, four corners of the bottom of the frame are fixedly mounted with Forma wheels.

[0033] Compared with the prior art, the present invention has the following beneficial effects:

[0034] Through multi-sensor fusion detection, intelligent algorithm decision-making and mechatronic design, this invention solves industry pain points such as low manual inspection efficiency, high misjudgment rate and difficult data tracing. It realizes automatic, high-precision and traceable detection of surface defects and metal clip installation status during the production process of the rear lower panel assembly, providing reliable technical support for the intelligent manufacturing of automotive parts. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] Figure 1 This is a structural schematic diagram of a visual inspection device of the present invention;

[0036] Figure 2 This is a schematic diagram of the three-dimensional structure of a visual inspection device of the present invention;

[0037] Figure 3 for Figure 2 A schematic diagram of the enlarged structure of part A in FIG;

[0038] Figure 4 This is a schematic structural diagram of a visual inspection component in a visual inspection device of the present invention;

[0039] Figure 5 This is a schematic structural diagram of a contour-profiling mold in a visual inspection device of the present invention;

[0040] Figure 6 A schematic structural diagram of a contour-forming mold in a visual inspection device according to the present invention from another perspective;

[0041] Figure 7 This is a circuit principle block diagram of a visual inspection device of the present invention;

[0042] Figure 8 This is one of the structural schematic diagrams of a rear lower panel assembly in a visual inspection device of the present invention;

[0043] Figure 9 This is the second structural schematic diagram of the rear lower panel assembly in a visual inspection device of the present invention.

[0044] In the figure: 1. Frame; 101. Protective cover; 1011. Support plate; 102. Forma wheel; 2. Visual inspection assembly; 201. Main camera; 202. Secondary camera; 203. Electric push rod; 204. Moving seat; 205. Fixed plate; 206. Guide sleeve; 207. Guide rod; 3. Placement mechanism; 301. Profile jig; 3011. Assembly slot; 302. Fixing assembly; 3021. First cylinder; 30211. First clamping block; 3022. Second cylinder; 30221. Second clamping block; 303. Rotating assembly; 3031. Rotating motor ;3032, rotating plate; 304, material proximity sensor; 4, marking mechanism; 401X-axis linear module; 402, column; 403, third cylinder; 404, spray terminal; 5, touch screen; 6, alarm light; 7, rear lower panel assembly; 701, first notch; 702, second notch; 8, metal clip body; 9, vision controller; 901, data preprocessing module; 902, feature extraction module; 903, classification module; 904, position judgment module; 905, defect judgment module; 906, result output module; 10, PLC controller. DETAILED DESCRIPTION

[0045] The technical solution of the present invention will be further described below with reference to the accompanying drawings and through specific implementation methods.

[0046] Among them, the drawings are only used for illustrative purposes and represent only schematic diagrams rather than actual pictures, and should not be understood as limiting this patent; in order to better illustrate the embodiments of the present invention, some parts of the drawings may be omitted, enlarged or reduced, and do not represent the size of the actual product; for those skilled in the art, it is understandable that some well-known structures and their descriptions in the drawings may be omitted.

[0047] The same or similar numbers in the drawings of the embodiments of the present invention correspond to the same or similar parts; in the description of the present invention, it should be understood that if the terms "upper", "lower", "left", "right", "inside", "outside" and the like indicate an orientation or position relationship based on the orientation or position relationship shown in the drawings, it is only for the convenience of describing the present invention and simplifying the description, and does not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operate in a specific orientation. Therefore, the terms describing the position relationship in the drawings are only used for illustrative purposes and cannot be understood as limiting this patent. For ordinary technicians in this field, the specific meanings of the above terms can be understood according to specific circumstances.

[0048] In the description of the present invention, unless otherwise expressly specified or limited, when the term "connection" or the like appears to indicate a connection relationship between components, such term should be understood in a broad sense. For example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium; it can be internal communication between two components or an interaction between two components. For those skilled in the art, the specific meanings of the above terms in the present invention can be understood in specific circumstances.

[0049] Example

[0050] See also Figures 1 to 9 This embodiment provides a visual inspection device, including: a frame 1, a visual inspection component 2, a placement mechanism 3, a marking mechanism 4 and a central processing unit.

[0051] Among them, the four corners of the bottom of the frame 1 are fixedly installed with a Forma wheel 102. The Forma wheel 102 is equipped with a brake device to support the overall movement and fixation of the frame 1, facilitating the flexible deployment and maintenance of the equipment in the workshop;

[0052] The visual inspection component 2 is installed above the frame 1 and is used to inspect the surface defects of the rear lower panel assembly 7 and whether the metal clip body 8 is installed in place;

[0053] Among them, the placement mechanism 3 is installed on the top of the frame 1, and the placement mechanism 3 is used to place the rear lower panel assembly 7 and transport the rear lower panel assembly 7 to the inspection station;

[0054] Among them, the marking mechanism 4 is installed on the top of the frame 1, and the marking mechanism 4 is used to spray a qualified mark on the rear lower panel assembly 7 that has passed the inspection;

[0055] The central processing unit is installed inside the frame 1, and the central processing unit is electrically connected to the visual detection component 2, the placement mechanism 3 and the marking mechanism 4 respectively.

[0056] The frame 1 serves as the main body of the device, supporting each functional module. After the placement mechanism 3 transports the rear lower panel assembly 7 to the inspection station, the visual inspection component 2 uses image acquisition to analyze surface defects and the installation status of the metal clip body 8. Based on the inspection results, the central processing unit controls the marking mechanism 4 to inkjet print on qualified products, automating the entire inspection, assessment, and marking process.

[0057] In this embodiment, the visual inspection component 2 includes a main camera 201 and a sub-camera 202. Two sub-cameras 202 are provided, and the two sub-cameras 202 are located on both sides of the main camera 201. The main camera 201 is used to detect surface defects of the rear lower panel assembly 7, and the sub-camera 202 is used to detect whether the metal clip body 8 is installed in place.

[0058] The main camera 201 focuses vertically on the surface of the rear lower panel assembly 7, and detects defects such as scratches and shrinkage marks through high-resolution imaging; the two auxiliary cameras 202 are symmetrically distributed on both sides of the main camera 201, shooting the installation position of the metal clip body 8, and judging the installation status through multi-view image fusion.

[0059] Furthermore, the visual inspection component 2 also includes an electric push rod 203, a protective cover 101 is fixedly installed on the top of the frame 1, a support plate 1011 is fixedly installed inside the protective cover 101, the electric push rod 203 is fixedly installed on the top of the support plate 1011, and the lower end of the piston rod of the electric push rod 203 slides through the support plate 1011 and is fixedly connected to the moving seat 204, the main camera 201 is fixedly installed on the bottom of the moving seat 204, and fixed plates 205 are fixedly installed on both sides of the moving seat 204, the auxiliary camera 202 is fixedly installed on the lower end of the fixed plate 205, the top of the moving seat 204 is fixedly connected to a guide rod 207, and the top of the support plate 1011 is fixedly installed with a guide sleeve 206, and the upper end of the guide rod 207 slides through the support plate 1011 and slides out from the inside of the guide sleeve 206.

[0060] The electric push rod 203 drives the movable base 204 vertically along the guide rod 207 and guide sleeve 206, adjusting the distance between the main camera 201 and the detection target to optimize imaging accuracy. The secondary camera 202 is linked to the movable base 204 via the fixed plate 205 to ensure synchronized focusing of multiple cameras. The protective cover 101 blocks external light interference.

[0061] In this embodiment, the placement mechanism 3 includes a rotating assembly 303, which includes a rotating motor 3031. The rotating motor 3031 is fixedly mounted on the inner top of the frame 1. The rotating shaft of the rotating motor 3031 rotates through the top of the frame 1 and is fixedly connected to a rotating plate 3032. The rotating plate 3032 is arranged in an I-shape. Both ends of the rotating plate 3032 are fixedly mounted with a contoured jig 301 for placing the rear lower panel assembly 7. The contoured jig 301 is mounted with a fixing assembly 302. The fixing assembly 302 is used to fix the rear lower panel assembly 7 on the contoured jig 301.

[0062] The fixing assembly 302 includes a first cylinder 3021 and a second cylinder 3022. An assembly groove 3011 is provided at the bottom of the profiling jig 301. The first cylinder 3021 and the second cylinder 3022 are both fixedly installed inside the assembly groove 3011. A first clamping block 30211 and a second clamping block 30221 are respectively provided at both ends of the profiling jig 301. The piston rod end of the first cylinder 3021 is fixedly connected to the lower end of the first clamping block 30211, and the piston rod end of the second cylinder 3022 is fixedly connected to the lower end of the second clamping block 30221. By controlling the piston rod of the first cylinder 3021 to retract, the first clamping block 30211 is pressed into the first notch 701 on the rear lower panel assembly 7. By controlling the piston rod of the second cylinder 3022 to retract, the second clamping block 30221 is pressed into the second notch 702 of the rear lower panel assembly 7.

[0063] The rotating motor 3031 drives the I-shaped rotating plate 3032 to rotate 180°, alternating the two contoured jigs 301 between the loading and unloading and inspection positions. The fixing assembly 302, driven by the first and second cylinders 3021 and 3022, presses the first and second clamping blocks 30211 and 30221 into the first and second notches 701 and 702 of the rear lower panel assembly 7, achieving rapid positioning and anti-displacement fixation.

[0064] Furthermore, a material proximity sensor 304 is fixedly embedded in the inner wall of the contour mold 301 , and the material proximity sensor 304 is used to monitor whether the rear lower panel assembly 7 is placed in the contour mold 301 .

[0065] In this embodiment, the marking mechanism 4 includes an X-axis linear module 401, which is fixedly installed on the top of the frame 1. A column 402 is fixedly installed on the slide of the X-axis linear module 401, a third cylinder 403 is fixedly installed on the upper end of the column 402, and a spray terminal 404 is fixedly installed on the bottom of the piston rod of the third cylinder 403.

[0066] The X-axis linear module 401 drives the slide to drive the inkjet terminal 404 to move horizontally to the target coding position; the third cylinder 403 controls the vertical lifting of the inkjet terminal 404 to ensure that the printing head maintains a constant distance (5-10mm) from the workpiece surface to achieve clear marking. When the rear lower panel assembly 7 is inspected, the X-axis linear module 401 drives the inkjet terminal 404 to move to the edge of the frame 1 to avoid interference with the inspection.

[0067] In this embodiment, a touch screen 5 is fixedly embedded on the protective cover 101 , and the touch screen 5 is electrically connected to the PLC controller 10 .

[0068] The touch screen 5 displays the detection data (such as defect type, installation offset), equipment status (such as motor speed, cylinder pressure) and alarm information in real time, and supports operator parameter setting and manual intervention.

[0069] In this embodiment, an alarm light 6 is fixedly mounted on the protective cover 101 , and the alarm light 6 is electrically connected to the PLC controller 10 .

[0070] When a defective product is detected, the PLC controller 10 triggers the alarm light 6 to flash, prompting the operator to handle it in time.

[0071] In this embodiment, the central processing unit includes a visual controller 9 and a PLC controller 10, wherein:

[0072] The visual controller 9 includes a data preprocessing module 901, a feature extraction module 902, a classification module 903, a position judgment module 904, a defect judgment module 905 and a result output module 906;

[0073] The data pre-processing module 901 is in communication with the main camera 201 and the auxiliary camera 202, and is used to perform format unification, noise suppression and grayscale normalization on the image data collected by the main camera 201 and the auxiliary camera 202;

[0074] The feature extraction module 902 is connected to the data preprocessing module 901 and is used to extract texture features, geometric features and edge feature data from the preprocessed image data;

[0075] The classification module 903 is connected to the feature extraction module 902, and the classification module 903 classifies the data into a surface defect feature set and an installation position feature set according to the feature data type;

[0076] The position judgment module 904 and the defect judgment module 905 are respectively connected to the classification module 903, wherein:

[0077] The classification module 903 transmits the installation position feature set to the position judgment module 904, and the position judgment module 904 judges whether the metal clip body 8 is installed in place by comparing the preset coordinate threshold;

[0078] The classification module 903 transmits the surface defect feature set to the defect judgment module 905 , which determines the type and level of the surface defects of the rear lower panel assembly 7 and the metal clip body 8 through a recognition algorithm;

[0079] The position determination module 904 and the defect determination module 905 are both connected to the result output module 906 , which is used to package the determination results of the position determination module 904 and the defect determination module 905 and transmit them to the PLC controller 10 ;

[0080] The PLC controller 10 is electrically connected to the electric push rod 203, the rotating motor 3031, the solenoid valve of the first cylinder 3021, the solenoid valve control end of the second cylinder 3022, the material proximity sensor 304, the X-axis linear module 401, the solenoid valve control end of the third cylinder 403 and the solenoid valve control end of the spray terminal 404.

[0081] In this embodiment, in the feature fusion and decision-making process of the visual detection component, a device reliability equation based on the dynamic weight of multimodal features is introduced:

[0082]

[0083] Parameter Description:

[0084] C: device reliability (0-1 range);

[0085] G: Geometric matching (calculated based on the overlap between the clip and the mounting hole contour);

[0086] T: texture consistency (calculated by gray-level co-occurrence matrix);

[0087] E: edge alignment (Hausdorff distance based on Canny edge detection);

[0088] ΔP: 3D point cloud projection deviation (calculated by binocular vision reconstruction);

[0089] α, β, γ: dynamic weight coefficients (0-1 range, satisfying α+β+γ=1);

[0090] k: sigmoid gain coefficient (default k=3);

[0091] Pmax: Maximum allowable projection deviation (empirical value 2.5mm).

[0092] Technical effects:

[0093] Improved detection accuracy: Compared with traditional single threshold judgment, the false detection rate is reduced by 42% (experimental data);

[0094] Adaptability: The weight coefficient is dynamically adjusted according to the reflective characteristics of the workpiece surface and remains stable under mirror / matte materials;

[0095] 3D compensation mechanism: corrects the inherent errors of 2D image analysis through point cloud projection deviation;

[0096] Nonlinear fusion: The sigmoid function enhances the decision weights of key features.

[0097] The workflow is as follows:

[0098]

[0099] 1. Dynamic weight mechanism: Automatically adjust the weight of each feature dimension through a real-time feedback system

[0100] α=0.5+0.5tanh(5(G-0.8));

[0101] When G>0.8, the geometric feature weight is automatically increased to adapt to precision assembly scenarios;

[0102] 2. 3D-2D Joint Verification: This is the first time that point cloud projection deviation has been introduced into traditional 2D visual inspection systems, solving the following technical challenges:

[0103] Perspective distortion caused by the camera installation angle;

[0104] Depth deviation of workpiece curved surface installation;

[0105] Misjudgment of edges caused by reflections from metal parts.

[0106] 3. Nonlinear decision boundary: A flexible decision boundary is established through the sigmoid function. Compared with the traditional hard threshold method:

[0107] A transition zone was established at the 0.7-0.9 confidence interval;

[0108] Conduct secondary reviews of borderline cases;

[0109] Record transition zone cases for iterative model optimization.

[0110] The implementation verification data is as follows:

[0111] Test conditions Accuracy of traditional methods The accuracy of this equation Standard lighting 95.2％ 98.7％ Strong side light interference 82.1％ 94.3％ Surface oil stains 88.6％ 93.8％ Assembly semi-locked state 76.4％ 89.5％

[0112] This equation has been successfully applied to the production line of an automotive parts manufacturer, increasing the pass rate of the rear lower panel assembly inspection station from 91.3% to 97.6%, and reducing the rework costs caused by false detection by 68%.

[0113] Working principle: The rear lower panel assembly 7 is placed in the profiling jig 301 at the loading position manually or by a robot. After the material proximity sensor 304 detects the rear lower panel assembly 7, the signal is transmitted to the PLC controller 10. After a delay of 1-5 seconds, the PLC controller 10 controls the piston rods of the first cylinder 3021 and the second cylinder 3022 to retract, so that the first clamping block 30211 and the second clamping block 30221 are pressed into the first notch 701 and the second notch 702 respectively, fixing the rear lower panel assembly 7 in the profiling jig 301. Then the PLC controller 10 controls the rotary motor 3031 to drive the rotary plate 3032 to rotate, thereby rotating the rear lower panel assembly 7 to the detection position. At this time, the PLC controller 10 controls the piston rod of the electric push rod 203 to extend, thereby driving the main camera 201 to move to the top of the rear lower panel assembly 7, and the auxiliary camera 20 2 moves to the side of the rear lower panel assembly 7, the main camera 201 captures an image of the upper surface of the rear lower panel assembly 7, and the auxiliary camera 202 captures an image of the side of the rear lower panel assembly 7, and transmits the captured data to the data preprocessing module 901. The data preprocessing module 901 performs format unification, noise suppression, and grayscale normalization on the captured image data, and then transmits the data to the feature extraction module 902. The feature extraction module 902 extracts texture features, geometric features, and edge feature data from the preprocessed image data. Then, the classification module 903 classifies the data into a surface defect feature set and an installation position feature set according to the feature data type. The classification module 903 transmits the installation position feature set to the position judgment module 904. The position judgment module 904 determines whether the metal clip body 8 is installed in place by comparing it with a preset coordinate threshold.

[0114] The classification module 903 transmits the surface defect feature set to the defect judgment module 905 , which determines the type and level of the surface defects of the rear lower panel assembly 7 and the metal clip body 8 through a recognition algorithm;

[0115] The position judgment module 904 and the defect judgment module 905 are both connected to the result output module 906 . The result output module 906 is used to package the judgment results of the position judgment module 904 and the defect judgment module 905 and transmit them to the PLC controller 10 .

[0116] If it is determined that the installation position of the metal clip body 8 is qualified, and there are no defects on the surfaces of the metal clip body 8 and the rear lower panel assembly 7, the PLC controller 10 controls the electric push rod 203 to drive the main camera 201 and the auxiliary camera 202 to reset, and then controls the X-axis linear module 401 to drive the spray terminal 404 to move to just above the rear lower panel assembly 7, and then the third cylinder 403 drives the spray terminal 404 to move downward to the set position, and the spray terminal 404 sprays the code on the qualified rear lower panel assembly 7, and then the PLC controller 10 controls the marking mechanism 4 to reset, and then controls the rotary motor 3031 to drive the qualified rear lower panel assembly 7 to move to the loading and unloading station for unloading, and the qualified products are placed in the good product area manually or by a robot;

[0117] On the contrary, if it is determined that the installation position of the metal clip body 8 is unqualified or the surface of the metal clip body 8 or the surface of the rear lower panel assembly 7 is defective, the PLC controller 10 controls the alarm light 6 to send an alarm signal, the PLC controller 10 controls the electric push rod 203 to drive the main camera 201 and the auxiliary camera 202 to reset, the PLC controller 10 controls the marking mechanism 4 to reset, and then controls the rotating motor 3031 to drive the unqualified rear lower panel assembly 7 to move to the loading and unloading station for unloading, and the unqualified products are placed in the defective area manually or by a robot.

[0118] Parts not described in the present invention are the same as those in the prior art or can be implemented using the prior art. Although the embodiments of the present invention have been shown and described, it will be understood by those skilled in the art that various changes, modifications, substitutions and variations may be made to these embodiments without departing from the principles and spirit of the present invention. The scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. A visual inspection device, characterized in that: include: Frame (1), visual inspection component (2), placement mechanism (3), marking mechanism (4), central processing unit; The visual inspection component (2) is installed above the frame (1), and the visual inspection component (2) is used to detect surface defects of the rear lower panel assembly (7) and whether the metal clip body (8) is installed in place; the placement mechanism (3) is installed on the top of the frame (1), and the placement mechanism (3) is used to place the rear lower panel assembly (7) and transport the rear lower panel assembly (7) to the inspection station; the marking mechanism (4) is installed on the top of the frame (1), and the marking mechanism (4) is used to spray a qualified mark on the rear lower panel assembly (7) that has passed the inspection; the central processing unit is installed inside the frame (1), and the central processing unit is electrically connected to the visual inspection component (2), the placement mechanism (3) and the marking mechanism (4) respectively; the central processing unit includes a visual controller (9) and a PLC controller (10), wherein: The visual controller (9) comprises a data preprocessing module (901), a feature extraction module (902), a classification module (903), a position judgment module (904), a defect judgment module (905) and a result output module (906); the data preprocessing module (901) is connected to the main camera (201) and the auxiliary camera (202) for performing format unification processing, noise suppression and grayscale normalization processing on the image data collected by the main camera (201) and the auxiliary camera (202); the feature extraction module (902) is connected to the data preprocessing module (901) for extracting texture features, geometric features and edge feature data from the preprocessed image data; the classification module (903) is connected to the feature extraction module (902), and the classification module (903) classifies the data into a surface defect feature set and an installation position feature set according to the feature data type; the position judgment module (904) and the defect judgment module (905) are respectively connected to the classification module (903), wherein: The classification module (903) transmits the installation position feature set to the position judgment module (904), and the position judgment module (904) determines whether the metal clip body (8) is installed in place by comparing the preset coordinate threshold value; the classification module (903) transmits the surface defect feature set to the defect judgment module (905), and the defect judgment module (905) determines the type and level of the surface defects of the rear lower panel assembly (7) and the metal clip body (8) through the recognition algorithm; the position judgment module (904) and the defect judgment module (905) are both connected to the result output module (906), and the result output module (906) is used to package the judgment results of the position judgment module (904) and the defect judgment module (905) and transmit them to the PLC controller (10); The PLC controller (10) is electrically connected to the electric push rod (203), the rotary motor (3031), the solenoid valve of the first cylinder (3021), the solenoid valve control end of the second cylinder (3022), the material proximity sensor (304), the X-axis linear module (401), the solenoid valve control end of the third cylinder (403), and the solenoid valve control end of the spray terminal (404). The position determination module (904) determines the installation state of the metal clip body (8) through the device reliability equation. The device reliability equation is: Among them, C is the device reliability; G is the geometric matching degree; T is the texture consistency; E is the edge alignment; ΔP is the three-dimensional point cloud projection deviation; α, β, γ are dynamic weight coefficients, satisfying α+β+γ=1; k is the sigmoid gain coefficient; Pmax is the maximum allowable projection deviation.

2. A visual inspection device according to claim 1, characterized in that: The visual inspection component (2) comprises a main camera (201) and a secondary camera (202), wherein two secondary cameras (202) are provided and the two secondary cameras (202) are located on both sides of the main camera (201), the main camera (201) is used to detect surface defects of the rear lower panel assembly (7), and the secondary cameras (202) are used to detect whether the metal clip body (8) is installed in place.

3. A visual inspection device according to claim 2, characterized in that: The visual detection component (2) further comprises an electric push rod (203), a protective cover (101) is fixedly mounted on the top of the frame (1), a support plate (1011) is fixedly mounted inside the protective cover (101), the electric push rod (203) is fixedly mounted on the top of the support plate (1011), the lower end of the piston rod of the electric push rod (203) slides through the support plate (1011) and is fixedly connected to a moving seat (204), and the main camera (201) is fixedly mounted on the support plate (1011). The bottom of the movable seat (204) is fixedly mounted with a fixing plate (205) on both sides of the movable seat (204), the auxiliary camera (202) is fixedly mounted on the lower end of the fixing plate (205), the top of the movable seat (204) is fixedly connected with a guide rod (207), the top of the support plate (1011) is fixedly mounted with a guide sleeve (206), the upper end of the guide rod (207) slides through the support plate (1011) and then slides out from the inside of the guide sleeve (206).

4. A visual inspection device according to claim 3, characterized in that: The placement mechanism (3) includes a rotating assembly (303), the rotating assembly (303) includes a rotating motor (3031), the rotating motor (3031) is fixedly mounted on the inner top of the frame (1), the rotating shaft of the rotating motor (3031) rotates through the top of the frame (1) and is fixedly connected to a rotating plate (3032), the rotating plate (3032) is arranged in an I-shaped configuration, and both ends of the rotating plate (3032) are fixedly mounted with a contoured mold (301) for placing the rear lower panel assembly (7), the contoured mold (301) is mounted with a fixing assembly (302), and the fixing assembly (302) is used to fix the rear lower panel assembly (7) on the contoured mold (301); The fixing assembly (302) includes a first cylinder (3021) and a second cylinder (3022). The bottom of the profiling mold (301) is provided with an assembly groove (3011). The first cylinder (3021) and the second cylinder (3022) are both fixedly mounted inside the assembly groove (3011). The two ends of the profiling mold (301) are respectively provided with a first clamping block (30211) and a second clamping block (30221). The piston rod end of the first cylinder (3021) is in contact with the first clamping block (302 11), the lower end of the second clamping block (30221) is fixedly connected, the piston rod end of the second cylinder (3022) is fixedly connected to the lower end of the second clamping block (30221), and the first clamping block (30211) is pressed into the first notch (701) on the rear lower panel assembly (7) by controlling the piston rod of the first cylinder (3021) to retract, and the second clamping block (30221) is pressed into the second notch (702) of the rear lower panel assembly (7) by controlling the piston rod of the second cylinder (3022) to retract.

5. A visual inspection device according to claim 4, characterized in that: A material proximity sensor (304) is fixedly embedded in the inner wall of the profiling mold (301), and the material proximity sensor (304) is used to monitor whether the rear lower panel assembly (7) is placed in the profiling mold (301).

6. A visual inspection device according to claim 5, characterized in that: The marking mechanism (4) includes an X-axis linear module (401), the X-axis linear module (401) is fixedly mounted on the top of the frame (1), a column (402) is fixedly mounted on the slide of the X-axis linear module (401), a third cylinder (403) is fixedly mounted on the upper end of the column (402), and a spray terminal (404) is fixedly mounted on the bottom of the piston rod of the third cylinder (403).

7. A visual inspection device according to claim 6, characterized in that: A touch screen (5) is fixedly embedded on the protective cover (101), and the touch screen (5) is electrically connected to the PLC controller (10).

8. A visual inspection device according to claim 7, characterized in that: An alarm light (6) is fixedly mounted on the protective cover (101), and the alarm light (6) is electrically connected to the PLC controller (10).

9. The visual inspection device according to claim 1, wherein: Four corners of the bottom of the frame (1) are fixedly mounted with Forma wheels (102).

Images