A double-sided visual inspection and recognition device
By designing a double-sided visual detection and recognition device, using rotation and angle adjustment devices for comprehensive shooting, combined with photoelectric sensors and control devices, the problems of low efficiency, high cost and low recognition accuracy in AOI technology are solved, and automated detection and classification are realized , improves detection efficiency and accuracy.
Patent Information
- Application Number
- CN201811164420.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2018-10-05
- Publication Date
- 2024-11-26
- Estimated Expiration
- 2038-10-05
AI Technical Summary
The existing PCBA automatic optical detection and identification technology (AOI) has low efficiency, high cost, low recognition accuracy, and high false alarm rate. It requires manual re-inspection, relying on manual visual inspection, which is inefficient and easy to miss inspection, and is proficient in employee proficiency. Higher requirements.
Design a double-sided visual detection and identification device, including a main body bracket, a bearing platform, a moving mechanism and a shooting device, and conduct a comprehensive shooting of the front and back of the finished circuit board through the first and second shooting devices, and use rotation and angle adjustment devices to ensure the image The comprehensiveness and accuracy of the shooting are combined with photoelectric sensors and control devices for automatic detection and classification.
It improves detection efficiency and accuracy, reduces equipment costs, reduces false alarm rates, reduces the demand for manual re-inspection, and realizes automated inspection and identification of finished circuit boards.
Smart Images

Figure CN109342457B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of visual detection and recognition, and in particular to a double-sided visual detection and recognition device. Background Art
[0002] Finished circuit board (Printed Circuit Board + Assembly, referred to as PCBA), that is, the finished circuit board is PCBA, PCBA is one of the key components of electronic equipment. PCBA specifically refers to the circuit board obtained by SMT mounting on the blank PCB board and then DIP plug-in (some products do not require this step), that is, various electronic devices are assembled on the PCB through surface packaging technology. The positive and negative positions of the components on the PCBA, the short circuit of the solder joints, and the number of pins directly affect the performance and yield of the circuit board. Therefore, it is an indispensable and very important link for PCBA to detect whether the product is qualified before delivery and use.
[0003] At present, the existing PCBA defect detection and identification mainly adopts the logic type of automatic optical inspection and identification technology (Automatic Optic Inspection, referred to as AOI). The principle is to illuminate the components from three different angles through RGB three-color light and then reflect it back. Different solder joint forms reflect different colors of light. The reference position and set parameters are used to perform vector analysis on the color and brightness of the reflected light. AOI is a new test technology that has just emerged, but it has developed rapidly. Many manufacturers have launched AOI test equipment. When automatically inspecting, the machine automatically scans the PCB through a camera, collects images, compares the tested components with the qualified parameters in the database, and checks the defects on the PCB through image processing. The defects are displayed / marked through a display or automatic mark for maintenance personnel to repair.
[0004] AOI requires high-precision lenses and specially designed light sources, and the hardware cost is high. It uses high-speed and high-precision visual processing technology to automatically detect various mounting errors and welding defects on PCB boards. PCB boards can range from fine-pitch high-density boards to low-density large-size boards. By using AOI as a tool to reduce defects, errors can be found and eliminated early in the assembly process to achieve good process control. Early detection of defects will avoid sending bad boards to subsequent assembly stages, and AOI will reduce repair costs and avoid scrapping unrepairable circuit boards. However, AOI uses image comparison, manually sets thresholds, has a high false alarm rate, requires manual re-inspection, and has a long preparation time before production. In addition, there are PCBA image comparison errors and low recognition accuracy. At present, the appearance of the plug-in process basically relies on manual visual inspection, which is inefficient, easy to miss, and has high requirements for employee proficiency. Summary of the invention
[0005] Aiming at the defects of low efficiency, high cost and low recognition accuracy in the prior art AOI detection of finished circuit boards, the present invention provides a double-sided visual detection and recognition device.
[0006] The technical solution adopted by the embodiment of the present invention to solve its technical problem is: to provide a double-sided visual inspection and identification device, which is set up on the existing production inspection line, including a main body bracket, a carrying platform arranged in the middle of the main body bracket for placing and conveying the finished circuit board to be inspected and identified, a first motion mechanism arranged at the top of the main body bracket, a first shooting device arranged at the lower end of the first motion mechanism for shooting the front image of the finished circuit board, and a control device arranged on the main body bracket and connected to the first motion mechanism and the first shooting device and used for control; the first motion mechanism moves arbitrarily in an XY plane parallel to the finished circuit board; specifically, the carrying platform includes two parallel conveying tracks for placing and conveying the finished circuit board to be inspected and identified, and two forward docking tracks and rearward docking tracks that are docked with the production inspection line and the conveying tracks.
[0007] Preferably, the front end of the forward docking track bends downward to dock with the production and inspection assembly line, and the forward docking track is used to transfer the finished circuit boards to be inspected from the production and inspection assembly line to the conveying track; the rear end of the rearward docking track bends downward to dock with the production and inspection assembly line, and the rearward docking track transfers the finished circuit boards that have been inspected and identified on the conveying track to the production and inspection assembly line.
[0008] Preferably, it also includes two lens groups respectively arranged on the left and right sides of the two conveying tracks, and the lens groups are used to generate mirror images of the left and right sides of the finished circuit board so that the first camera device can capture the left and right side images of the finished circuit board; the carrying platform also includes a spacing adjustment device arranged between the two conveying tracks for adjusting the spacing between the conveying tracks.
[0009] Preferably, it also includes a first Z-axis motion mechanism arranged at the lower end of the first motion mechanism and movable in the Z-axis direction, a first rotating device arranged at the lower end of the first Z-axis motion mechanism and rotatable around the Z-axis direction, and a first angle adjustment device arranged on the first rotating device for adjusting any rotation angle of the first shooting device; the Z-axis direction is a direction perpendicular to the finished circuit board; specifically, the first shooting device is arranged at the lower end of the first rotating device; the lens of the first shooting device faces the front of the finished circuit board to shoot the front image of the finished circuit board.
[0010] Preferably, it also includes a second motion mechanism arranged at the bottom of the main support, and a second shooting device arranged at the upper end of the second motion mechanism for shooting the back image of the finished circuit board; the second motion mechanism can move arbitrarily in an XY plane parallel to the finished circuit board.
[0011] Preferably, it also includes a second Z-axis motion mechanism arranged at the upper end of the second motion mechanism and movable in the Z-axis direction, a second rotating device arranged at the upper end of the second Z-axis motion mechanism and rotatable around the Z-axis direction, and a second angle adjustment device arranged on the second rotating device for adjusting any rotation angle of the second camera; the second camera is arranged at the upper end of the second rotating device; the lens of the second camera faces the back of the finished circuit board to capture the back image of the finished circuit board.
[0012] Preferably, the first motion mechanism includes two first X-axis motion components mounted and fixed on the main support 10, a first Y-axis motion component connected to the first X-axis motion component, and a first Z-axis motion mechanism installed at the lower end of the first Y-axis motion component; the first motion mechanism also includes a first X-axis driving component arranged on the first X-axis motion component for driving the first Y-axis motion component, a first Z-axis motion mechanism installed at the lower end of the first Y-axis motion component, and a first Y-axis driving component arranged on the first Y-axis motion component for driving the first Z-axis motion mechanism.
[0013] The second motion mechanism includes two second X-axis motion components mounted and fixed on the main body bracket, a second Y-axis motion component connected to the second X-axis motion component, and the second Z-axis motion mechanism is installed at the lower end of the second Y-axis motion component; the second motion mechanism also includes a second X-axis driving component arranged on the second X-axis motion component for driving the second Y-axis motion component, a second Z-axis motion mechanism is installed at the lower end of the second Y-axis motion component, and a second Y-axis driving component arranged on the second Y-axis motion component for driving the second Z-axis motion mechanism.
[0014] Preferably, it also includes a photoelectric sensor arranged on the main support and connected to the control device for detecting whether the finished circuit board is in a preset position; when the photoelectric sensor detects that the finished circuit board is in the preset position, it sends a photoelectric signal to the control device; the control device is used to control the first motion mechanism and the second motion mechanism to move according to the planned motion path and the first shooting device and the second shooting device to comprehensively shoot the finished circuit board after receiving the photoelectric signal, and perform image recognition on multiple images of the finished circuit board to extract multiple image features for comprehensive judgment, and then classify the finished circuit boards to obtain a classification result, wherein the classification result is a qualified finished circuit board or an unqualified finished circuit board.
[0015] Preferably, a box body for overall packaging is arranged on the periphery of the main frame, and a side frame for placing the control device is arranged on the side of the main frame.
[0016] Preferably, it also includes a light source for providing illumination, a display device for display, an input device for input, and an alarm device for alarm prompting, which are arranged on the main support and connected to the control device.
[0017] The technical solution of the double-sided visual inspection and recognition equipment of the present invention has the following advantages or beneficial effects: the present invention arranges the first shooting device on the first moving mechanism of the main support, so that the first shooting device can perform mobile shooting of the finished circuit board. Compared with fixed shooting, the number of required shooting devices is reduced, and a comprehensive image can be obtained; the first moving mechanism is equipped with a rotating device and an angle adjustment device to make the image shooting angle more comprehensive, with high shooting efficiency, simple structure and low cost. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. It is obvious that the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative work. In the drawings:
[0019] Figure 1 It is a schematic diagram of an assembly structure of a double-sided visual inspection and recognition device embodiment of the present invention;
[0020] Figure 2 It is another schematic diagram of the assembly structure of the double-sided visual inspection and recognition device of the present invention;
[0021] Figure 3 It is a structural schematic diagram of an embodiment of a double-sided visual detection and recognition device of the present invention;
[0022] Figure 4 yes Figure 3 A schematic structural diagram of a first motion mechanism and a first photographing device;
[0023] Figure 5 yes Figure 3 A schematic structural diagram of a second motion mechanism and a second shooting device. DETAILED DESCRIPTION
[0024] In order to make the purpose, technical solutions and advantages of the present invention more clearly understood, the various embodiments to be described below will refer to the corresponding drawings, which constitute a part of the embodiments, and describe various embodiments that may be used to implement the present invention. It should be understood that other embodiments may be used, or the embodiments listed herein may be modified in structure and function without departing from the scope and essence of the present invention.
[0025] It should be noted that the front and back, left and right, top and bottom, middle and bottom in the embodiments of the present invention are only defined for the convenience of describing the embodiments, and are not specific positional definitions of the front and back, left and right, top and bottom, middle and bottom in the usual sense. Specifically, the front is the front of the finished circuit board (i.e., PCBA) parallel to the direction of the production and inspection assembly line, the rear is the back of the finished circuit board parallel to the direction of the production and inspection assembly line, the left and right are directions perpendicular to the production and inspection assembly line, the X-axis direction is a direction parallel to the production and inspection assembly line, the Y-axis direction is a direction perpendicular to the production and inspection assembly line, the Z-axis direction is a direction perpendicular to the finished circuit board, the X-axis direction, the Y-axis direction, and the Z-axis direction are all perpendicular to each other, the XY plane is a plane parallel to the finished circuit board, and the YZ plane is a plane perpendicular to the finished circuit board.
[0026] In this embodiment, the finished circuit board is divided into a single-sided board and a double-sided board. The single-sided board refers to a single-sided PCBA formed by SMT mounting on one side of a PCB blank board and then passing through a DIP plug-in, while the double-sided board refers to a double-sided PCBA formed by SMT mounting on both sides of a PCB blank board and then passing through a DIP plug-in. For the detection and identification of the finished circuit board of the single-sided board, it is only necessary to shoot the front image of the circuit board from the top, front and back, left and right, and diagonally above. For the double-sided board, it is also necessary to obtain the back image, and a shooting device can be set under the finished circuit board to shoot, or the finished circuit board can be turned over and shot by a shooting device set on the top. The former solution is adopted in this embodiment, and the specific technical solution is described as follows.
[0027] In this embodiment, the finished circuit board needs to identify the following defects: wrong components, missing or multiple components, reverse, damaged, floating or skewed, poor solder joints, etc., mainly including: wrong components (that is, the wrong components are installed), missing or multiple components (that is, the components are not installed where they should be on the PCBA, or the components are installed where they should not be installed), reverse components (that is, the device is installed in the wrong direction), damaged components (that is, the surface or side of the device has cracks or damage), dirty components (that is, the surface has dirt covering the characters or blank areas), floating or skewed components (that is, the bottom of the device is not close to the PCBA surface or the bottom plane of the device is not close to the PCBA surface), The CBA planes are obviously not parallel); defective solder joints include: solder joints with tin (that is, two or more independent solder feet are connected together), empty solder joints (that is, the solder joints appear to be soldered, but the actual solder is not tightly connected to the device pins), too much tin (that is, there is too much solder, resulting in a large top or solder wrap), too little tin (that is, there are holes in the solder joints, the solder joints are sunken, or the solder is flush with the pad without obvious tin creeping), tin beads and tin slag (that is, tin slag or tin beads appear in the blank area of PCB), pull tips (that is, wire drawing appears on the top or side of the plug-in pins), character or graphic errors (that is, the characters or graphics on the front or side of the device do not meet the standards), and other possible defects.
[0028] More specifically, different defects require the acquisition of images of finished circuit boards from different angles, including: (1) photographing the finished circuit board from the top front to acquire the content of the finished circuit board, including: wrong components, missing components, multiple components, reverse components, contaminated components, solder joints, empty solder joints, excessive solder, insufficient solder, tin beads, tin slag, pull tips, character or graphic errors, etc.; (2) photographing the finished circuit board from the front, back, left, and right to acquire the content of the finished circuit board, including: damaged components, floating or skewed components, character or graphic errors, etc.; (3) photographing the finished circuit board from the top obliquely to acquire the content of the finished circuit board, including: wrong components, floating or skewed components, character or graphic errors, etc. To this end, it is necessary to set up different shooting devices to acquire all-round images of the finished circuit board from top to bottom, left to right, front to back, and so on, so as to more comprehensively and accurately detect, identify and classify the finished circuit board.
[0029] The double-sided visual inspection and identification equipment embodiment of the present invention can be used for product inspection of final finished circuit boards and also for quality monitoring during the production process; it can be used for both single-sided finished circuit boards and double-sided finished circuit boards.
[0030] First embodiment
[0031] Reference Figure 1-5 As shown, an embodiment of a double-sided visual inspection and identification device of the present invention is provided, wherein the double-sided visual inspection and identification device 100 is set up on an existing production inspection line 200, which can specifically be an existing conveying device such as a conveyor belt, and the double-sided visual inspection and identification device includes a main frame 10, a carrying platform 20 arranged in the middle of the main frame 10 for placing and conveying a finished circuit board to be inspected and identified, a first motion mechanism 30 arranged at the top of the main frame 10, a first shooting device 40 arranged at the lower end of the first motion mechanism 30 for shooting a front image of the finished circuit board, and a control device (not shown in the figure) arranged on the main frame 10 and connected to both the first motion mechanism 30 and the first shooting device 40 and used for control; specifically, the first motion mechanism 31 moves arbitrarily in an XY plane parallel to the finished circuit board; the carrying platform 20 includes two parallel conveying tracks 21 for placing and conveying the finished circuit board to be inspected and identified, and two forward docking tracks 22 and rearward docking tracks 23 that are docked with the production inspection line 200 and the conveying track 21.
[0032] In this embodiment, the front end of the forward docking track 22 is bent downward to dock with the production and inspection assembly line 200. The forward docking track 22 is used to transfer the finished circuit boards to be inspected and identified from the production and inspection assembly line 200 to the conveying track 21. The front end of the forward docking track 22 is a bell mouth, so that the scattered finished circuit boards on the production and inspection assembly line 200 can be gathered to the forward docking track 22, and then transferred to the conveying track 21; the rear end of the rear docking track 23 is bent downward to dock with the production and inspection assembly line 200 to transfer the finished circuit boards that have been inspected and identified, and then the finished circuit boards that have been inspected and identified enter the subsequent process.
[0033] In this embodiment, two lens groups 80 are also included, which are respectively arranged on the left and right sides of the two conveying tracks 21. The lens group 80 is used to generate mirror images of the front and left sides of the finished circuit board so that the first shooting device 40 can shoot the front and left side images of the finished circuit board. In order to make the double-sided visual inspection and recognition equipment adapt to finished circuit boards of different sizes, the carrying platform 20 also includes a spacing adjustment device 24 arranged between the two conveying tracks 21 for adjusting the spacing between the conveying tracks 21, so that the carrying platform 20 can carry finished circuit boards of different sizes, and has a wider range of applications.
[0034] In this embodiment, the first Z-axis motion mechanism 31 is provided at the lower end of the first motion mechanism 30 and is movable in the Z-axis direction, the first rotating device 32 is provided at the lower end of the first Z-axis motion mechanism 31 and is rotatable around the Z-axis direction, and the first angle adjusting device 33 is provided on the first rotating device 32 for adjusting any rotation angle of the first shooting device 40; specifically, the first shooting device 40 is provided at the lower end of the first rotating device 32; the lens of the first shooting device 41 is facing the front of the finished circuit board to shoot the front image of the finished circuit board. More specifically, the first shooting device 40 can move arbitrarily in the X-axis direction, the Y-axis direction, and the Z-axis direction through the motion coordination of the first motion mechanism 30, the first Z-axis motion mechanism 31, the first rotating device 32, and the first angle adjusting device 33. At the same time, through the motion coordination of the first rotating device 32, the first shooting device 40 can rotate 360 degrees on the XY plane. The arbitrary rotation angle adjustment of the first angle adjusting device 33 can enable the first shooting device 40 to shoot images of any angle of the front of the finished circuit board, including front images, oblique front images, etc. In addition, the first photographing device 40 can photograph the front, left and side images of the finished circuit board through the two lens groups 80, such as the front left side image, the front right side image, etc.
[0035] like Figure 4As shown, in this embodiment, the first motion mechanism 30 includes two first X-axis motion components 34 mounted and fixed on the main frame 10, a first Y-axis motion component 35 connected to the first X-axis motion component 34, and a first Z-axis motion mechanism 31 installed at the lower end of the first Y-axis motion component 35. The first motion mechanism 30 also includes a first X-axis driving component 36 arranged on the first X-axis motion component 34 for driving the first Y-axis motion component 35, a first Z-axis motion mechanism 31 installed at the lower end of the first Y-axis motion component 35, and a first Y-axis driving component 37 arranged on the first Y-axis motion component 35 for driving the first Z-axis motion mechanism 31. More specifically, the specific structure of the second motion mechanism 30 can be other structures, which are not further limited here.
[0036] In this embodiment, the outer periphery of the main support 10 is provided with a box for overall packaging, and also includes a light source (not shown) connected to the control device on the main support 10 for providing illumination, a display device (not shown) for display, an input device (not shown) for input, and an alarm device (not shown) for alarm prompt. Specifically, a side frame 11 for placing the control device is provided on the side of the main support 10, and the side frame 11 can also be used to place a power box and a driver, etc. A display device (such as a display, etc.) can be provided at the top of the main support to display the results or fault information of the image shooting detection, and an input device (such as a keyboard, etc.) can be provided on the side of the main support to set and modify the program, etc. Of course, the specific setting position can adopt other forms and positions according to the needs of the actual detection process. Specifically, a light source (not shown) is provided around to provide illumination to the first shooting device 40, and the shadow problem is solved by the fill light of the light source, so that the photo is clearer.
[0037] In this embodiment, the alarm device and the control device 80 can be connected wirelessly or by wire. The alarm device can be a sound alarm (such as a buzzer, an audio player, etc.) or a light alarm (indicator light, etc.), and the installation position of the alarm device is installed according to the requirements. If the number of unqualified finished circuit boards determined to be unqualified exceeds 10 or a preset number in the recognition result of the control device, the control device controls the alarm device to alarm and remind the staff. Of course, the number set here can be changed according to the customer's requirements and is not limited. Specifically, the display device and the control device can be connected wirelessly or by wire. The display device is installed together with the main bracket 10, or it can be installed at the monitoring position where the operator is located. The display device can use a touch screen to facilitate the staff to directly operate and check the specific recognition results on the display screen. The operator can also send relevant instructions to the control device through the function options on the display device, such as starting and stopping detection, so that it is convenient for the operator to make a choice.
[0038] In this embodiment, it also includes a photoelectric sensor (not shown) arranged on the main support 10 and connected to the control device for detecting whether the finished circuit board is in a preset position; when the photoelectric sensor detects that the finished circuit board is in a preset position, it sends a photoelectric signal to the control device; the control device is used to control the first shooting device 40 to shoot the finished circuit board after receiving the photoelectric signal, and extract multiple image features based on image recognition of multiple circuit board images of the finished circuit board for comprehensive judgment and then classify the finished circuit board to obtain a classification result, wherein the classification result is a qualified finished circuit board or an unqualified finished circuit board. Specifically, the control device controls the first motion mechanism 30, the first Z-axis motion mechanism 31, the first rotation device 32, and the first angle adjustment device 33 to move according to the planned motion path, and then controls the first shooting device 40 to shoot multi-angle front images of the finished circuit board.
[0039] More specifically, the comprehensive judgment of the control device adopts a deep learning algorithm for comprehensive detection, identification, analysis and classification. Of course, other algorithms can also be used for classification. More specifically, unqualified finished circuit boards can be further subdivided, and the specific and accurate reasons and locations of the unqualified products can be clearly marked, and more detailed classification can be carried out, so that the subsequent maintenance work can be carried out smoothly and quickly, and the work efficiency can be improved. It should be noted that the function of the control device 80 is not limited to controlling the movement of the motion mechanism and controlling the shooting device to shoot, and performing image recognition and classification on multiple circuit board images respectively; it can also be used for adjusting the angle of the shooting device, the alarm of the alarm device, the transmission mechanism and the movement stop, etc. At the same time, the structural form of the control device 80 can be an independent computer (such as an industrial computer, etc.) set in this device, or a server for production line control set in a unified manner, or a remote cloud server, etc., without further restriction here.
[0040] For a finished single-sided circuit board, the first motion mechanism and the first shooting device can be used together to achieve full shooting of the single-sided circuit board. For a finished double-sided circuit board, a corresponding motion mechanism and shooting device need to be set below the finished circuit board, as described below.
[0041] Second embodiment
[0042] Different from the first embodiment, the double-sided visual inspection and recognition device of this embodiment further includes a second motion mechanism 60 disposed at the bottom of the main support 10, and a second shooting device 70 disposed at the upper end of the second motion mechanism 60 for shooting the reverse image of the finished circuit board. It also includes a second Z-axis motion mechanism 61 disposed at the upper end of the second motion mechanism 60 and movable in the Z-axis direction, a second rotating device 62 disposed at the upper end of the second Z-axis motion mechanism 61 and rotatable around the Z-axis direction, and a second angle adjustment device 63 disposed at the second rotating device 62 for adjusting any rotation angle of the second shooting device 70; the second shooting device 70 is disposed at the upper end of the second rotating device 62; the lens of the second shooting device 70 faces the reverse side of the finished circuit board to shoot the reverse image of the finished circuit board. Specifically, the second motion mechanism 60 moves arbitrarily in the XY plane parallel to the finished circuit board.
[0043] like Figure 5 As shown, in this embodiment, the second motion mechanism 60 includes two second X-axis motion components 63 fixedly arranged on the main support 10, a second Y-axis motion component 64 connected to the second X-axis motion component 63, a second Z-axis motion mechanism 61 installed at the lower end of the second Y-axis motion component 64, and a second shooting device 70 installed at the lower end of the second Z-axis motion mechanism 61; the second motion mechanism 60 also includes a second X-axis driving component 66 arranged on the second X-axis motion component 64 for driving the second Y-axis motion component 65, a second Z-axis motion mechanism 61 installed at the lower end of the second Y-axis motion component 65, and a second Y-axis driving component 67 arranged on the second Y-axis motion component 65 for driving the second Z-axis motion mechanism 61. More specifically, the specific structure of the second motion mechanism 60 can be other structures, which are not further limited here.
[0044] In this embodiment, the control device controls the first motion mechanism 30 and the second motion mechanism 60 to move according to the planned motion path and controls the first shooting device 40 and the second shooting device 70 to take a comprehensive shot of the finished circuit board, and performs image recognition according to the multiple images of the finished circuit board taken by the shooting device to extract multiple image features for comprehensive judgment and then classify the finished circuit board to obtain a classification result, wherein the classification result is a qualified finished circuit board or an unqualified finished circuit board. More specifically, the comprehensive judgment of the control device adopts a deep learning algorithm for comprehensive detection, identification, analysis and classification, and of course other algorithms can also be used for classification. More specifically, unqualified finished circuit boards can be further subdivided, and the specific and accurate reasons and locations of the unqualified products and their locations can be clearly marked, and more detailed classification can be performed, so that subsequent maintenance work can be carried out smoothly and quickly, and work efficiency can be improved. It should be noted that the function of the control device 80 is not limited to controlling the movement of the motion mechanism and controlling the shooting device to shoot, and performing image recognition and classification on multiple circuit board images respectively; it can also be used for adjusting the angle of the shooting device, the alarm of the alarm device, the stop of the transmission mechanism and the like. At the same time, the structural form of the control device can be an independent computer (such as an industrial computer, etc.) set in this equipment, or it can be a server for uniformly setting up production line control, or it can be a remote cloud server, etc., without further restriction here.
[0045] In this embodiment, the two shooting devices can shoot at the following angles: (1) shooting the finished circuit board from the top front, used to collect and obtain the content of the finished circuit board including: wrong components, missing components, multiple components, reverse components, contaminated components, solder joints, empty soldering, too much tin, too little tin, tin beads, tin slag, pull tips, character or graphic errors, etc.; (2) shooting the finished circuit board from the front, back, left, and right, used to collect and obtain the content of the finished circuit board including: damaged components, floating or skewed components, character or graphic errors, etc.; (3) shooting the finished circuit board from the top obliquely, used to collect and obtain the content of the finished circuit board including: wrong components, floating or skewed components, character or graphic errors, etc. To this end, it is necessary to set up different shooting devices to obtain all-round images of the finished circuit board from top to bottom, left to right, front to back, and then the finished circuit board can be detected, identified and classified more comprehensively and accurately. More specifically, the first camera device 40 and the second camera device 70 can complete shooting at angle (1). When the first camera device 40 is provided with a first angle adjustment device 33 and the second camera device 70 is provided with a second angle adjustment device 63, shooting at angles (1), (2), and (3) can be completed.
[0046] The double-sided visual inspection and identification equipment of this embodiment has the following specific inspection and identification steps: when the finished circuit board moves to the shooting range of the preset device, the control device controls the motion mechanism to move according to the planned predetermined path, and the shooting device shoots and captures the full range of images of the finished circuit board. After the shooting is completed, the above-mentioned shooting device immediately sends the acquired image to the control device, and the control device extracts multiple image features based on image recognition of multiple circuit board images of the finished circuit board for comprehensive judgment and then classifies the finished circuit boards to obtain classification results, wherein the classification results are qualified finished circuit boards or unqualified finished circuit boards. The control device performs post-image recognition processing on the captured images to obtain classification results, realizing intelligent control of the shooting process and obtaining detection and identification classification results; at the same time, mobile shooting greatly reduces the number of required shooting devices compared to fixed shooting, thereby reducing the economic cost of the equipment.
[0047] The present invention arranges the shooting device on the moving mechanism of the main support so that the shooting device can perform mobile shooting of the finished circuit board. Compared with fixed shooting, the number of required shooting devices is reduced and a comprehensive image can be obtained. The rotating device and the angle adjustment device are installed on the moving mechanism to make the image shooting angle more comprehensive, with high shooting efficiency, simple structure, low cost, low false alarm rate, and no need for manual re-inspection.
[0048] It should be noted that the various shooting devices, stepper motors, synchronous belts, etc. in the embodiments of the present invention have basically the same structure, but there are slight differences according to different functions. They are set as the first, second, etc. numbers, just to distinguish them from the names for the convenience of description. The above-mentioned shooting devices can be industrial cameras, smart cameras, high-definition high-speed cameras, high-definition high-speed cameras with built-in light sources, or high-definition high-speed cameras, etc. If there is no light source, a light source must be configured near each shooting device. The light source can be coaxial light, annular light, and backlight; it can also be a three-color light source, which can include a charge coupled device (CCD), a complementary metal oxide semiconductor (CMOS) photoelectric sensor, or a contact image photoelectric sensor (CIS), etc.
[0049] In this embodiment, the box body can be a closed box body with a door, or a frame or other similar structures. The material of the box body and the frame is not limited, and can be wood or metal, such as aluminum alloy, iron, etc. If the main support is a box-like object, the box body can be designed to consist of two detachably connected parts, which is convenient for the maintenance and replacement of the device installed inside.
[0050] The above description is only the preferred embodiment of the present invention. It is known to those skilled in the art that various changes or equivalent substitutions may be made to these features and embodiments without departing from the spirit and scope of the present invention. In addition, under the teachings of the present invention, these features and embodiments may be modified to adapt to specific circumstances and materials without departing from the spirit and scope of the present invention. Therefore, the present invention is not limited to the specific embodiments disclosed herein, and all embodiments falling within the scope of the claims of this application belong to the protection scope of the present invention.
Claims
1. A double-sided visual inspection and recognition device, wherein the double-sided visual inspection and recognition device (100) is installed on an existing production inspection line (200), characterized in that: The invention comprises a main frame (10), a carrying platform (20) arranged in the middle of the main frame (10) for placing and conveying a finished circuit board to be detected and identified, a first moving mechanism (30) arranged at the top of the main frame (10), a first shooting device (40) arranged at the lower end of the first moving mechanism (30) for shooting a front image of the finished circuit board, and a control device arranged on the main frame (10) and connected to the first moving mechanism (30) and the first shooting device (40) for controlling the finished circuit board; The first motion mechanism (30) moves arbitrarily in an XY plane parallel to the finished circuit board; The carrying platform (20) comprises two parallel conveying tracks (21) for placing and conveying the finished circuit boards to be inspected and identified, and two forward docking tracks (22) and rearward docking tracks (23) both docked with the production inspection assembly line (200) and the conveying tracks (21); The front end of the forward docking track (22) is bent downward to dock with the production and inspection assembly line (200), and the forward docking track (22) is used to transport the finished circuit board to be inspected and identified from the production and inspection assembly line (200) to the conveying track (21), and the front end of the forward docking track (22) is a bell mouth; the rear end of the rearward docking track (23) is bent downward to dock with the production and inspection assembly line (200), and the rearward docking track (23) transports the finished circuit board that has been inspected and identified on the conveying track (21) to the production and inspection assembly line (200).
2. The double-sided visual inspection and recognition device according to claim 1, characterized in that: It also includes two lens groups (80) respectively arranged on the left and right sides of the two conveying tracks (21), the lens groups (80) being used to generate mirror images of the front and left sides of the finished circuit board so that the first shooting device (40) can shoot images of the front and left sides of the finished circuit board; The carrying platform (20) further comprises a spacing adjustment device (24) arranged between the two conveying tracks (21) and used for adjusting the spacing between the conveying tracks (21).
3. The double-sided visual inspection and recognition device according to any one of claims 1-2, characterized in that: It also includes a first Z-axis motion mechanism (31) disposed at the lower end of the first motion mechanism (30) and movable in the Z-axis direction, a first rotation device (32) disposed at the lower end of the first Z-axis motion mechanism (31) and rotatable around the Z-axis direction, and a first angle adjustment device (33) disposed on the first rotation device (32) for adjusting any rotation angle of the first shooting device (40); the Z-axis direction is a direction perpendicular to the finished circuit board; The first shooting device (40) is arranged at the lower end of the first rotating device (32); the lens of the first shooting device (40) faces the front of the finished circuit board to shoot the front image of the finished circuit board.
4. The double-sided visual inspection and recognition device according to claim 3, characterized in that: It also includes a second motion mechanism (60) arranged at the bottom of the main frame (10), and a second shooting device (70) arranged at the upper end of the second motion mechanism (60) for shooting an image of the back side of the finished circuit board; The second motion mechanism (60) can move arbitrarily in an XY plane parallel to the finished circuit board.
5. The double-sided visual inspection and recognition device according to claim 4, characterized in that: It also includes a second Z-axis motion mechanism (61) disposed at the upper end of the second motion mechanism (60) and movable in the Z-axis direction, a second rotation device (62) disposed at the upper end of the second Z-axis motion mechanism (61) and rotatable around the Z-axis direction, and a second angle adjustment device (63) disposed on the second rotation device (62) for adjusting any rotation angle of the second shooting device (70); The second shooting device (70) is arranged at the upper end of the second rotating device (62); the lens of the second shooting device (70) faces the back side of the finished circuit board to shoot the back side image of the finished circuit board.
6. The double-sided visual inspection and recognition device according to claim 5, characterized in that: The first motion mechanism (30) comprises two first X-axis motion components (34) mounted and fixed on the main frame (10), a first Y-axis motion component (35) connected to the first X-axis motion component (34), and the first Z-axis motion mechanism (31) is installed at the lower end of the first Y-axis motion component (35); The first motion mechanism (30) further comprises a first X-axis driving assembly (36) arranged on the first X-axis motion assembly (34) for driving the first Y-axis motion assembly (35); the first Z-axis motion mechanism (31) is installed at the lower end of the first Y-axis motion assembly (35); and a first Y-axis driving assembly (37) arranged on the first Y-axis motion assembly (35) for driving the first Z-axis motion mechanism (31); The second motion mechanism (60) comprises two second X-axis motion components (64) mounted and fixed on the main frame (10), a second Y-axis motion component (65) connected to the second X-axis motion component (64), and the second Z-axis motion mechanism (61) is installed at the lower end of the second Y-axis motion component (65); The second motion mechanism (60) further includes a second X-axis driving assembly (66) disposed on the second X-axis motion assembly (64) for driving the second Y-axis motion assembly (65); the second Z-axis motion mechanism (61) is installed at the lower end of the second Y-axis motion assembly (65); and a second Y-axis driving assembly (67) disposed on the second Y-axis motion assembly (65) for driving the second Z-axis motion mechanism (61).
7. The double-sided visual inspection and recognition device according to claim 5, characterized in that: It also includes a photoelectric sensor disposed on the main support (10) and connected to the control device for detecting whether the finished circuit board is in a preset position; When the photoelectric sensor detects that the finished circuit board is in the preset position, it sends a photoelectric signal to the control device; The control device is used for, after receiving the photoelectric signal, controlling the first motion mechanism (30) and the second motion mechanism (60) to move according to the planned motion path and the first shooting device (40) and the second shooting device (70) to comprehensively shoot the finished circuit board, and performing image recognition on multiple images of the finished circuit board to extract multiple image features for comprehensive judgment, and then classifying the finished circuit board to obtain a classification result, wherein the classification result is a qualified finished circuit board or an unqualified finished circuit board.
8. The double-sided visual inspection and recognition device according to claim 7, characterized in that: The defects to be detected and identified in the finished circuit board include: wrong components, missing or multiple components, reversed components, damaged components, floating or skewed components and / or poor solder joints.
9. The double-sided visual inspection and recognition device according to claim 8, characterized in that: A box body for overall packaging is arranged on the periphery of the main frame (10), and a side frame (11) for placing the control device is arranged on the side of the main frame (10); It also includes a light source for providing illumination, a display device for displaying, an input device for inputting, and an alarm device for alarming, which are arranged on the main frame (10) and are connected to the control device.
