Industrial camera adaptive focusing device and method for multi-angle detection of edge grinding and chamfering of Micro-LED splicing surface

By introducing a combination of multi-view angle detection camera and laser ranging sensor in industrial cameras, the problem of difficulty in detecting multi-angle angles of Micro-LED splicing surfaces in traditional cameras is solved, automatic focus and high-precision detection are achieved, and the stability of the detection effect is ensured. .

CN118641478BActive Publication Date: 2024-11-05JIANGSU FULAT AUTOMATION EQUIP CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411113979.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-08-14
Publication Date
2024-11-05
Estimated Expiration
2044-08-14

AI Technical Summary

Technical Problem

Traditional industrial cameras are difficult to meet the detection requirements of the Micro-LED splicing surface in the five directions (upper, lower, side, upper 45°, lower 45°), and the problem of camera phase loss during the detection process is prone to occur.

Method used

An adaptive focus device for industrial cameras for multi-angle detection of micro-LED splicing surface grinding chamfering is designed, using five detection cameras and two laser ranging sensors to realize multi-angle detection and automatic focus through a linear actuator and a robot. , ensure detection accuracy and stability.

Benefits of technology

Accurate detection of edges in all directions of Micro-LED splicing surfaces is achieved, avoiding camera phase-filling, and improving detection effect and stability.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118641478B_ABST
    Figure CN118641478B_ABST
Patent Text Reader

Abstract

The present invention discloses an industrial camera adaptive focusing device and method for multi-angle detection of Micro-LED splicing surface edge grinding and chamfering. The carrier is slidably arranged on the frame and is used to convey the glass substrate with chamfered upper and lower edges of the splicing surface. There are five detection cameras, each of which is driven by a linear actuator. The first detection camera and the second detection camera are facing the upper chamfered surface and the lower chamfered surface of the glass substrate. The third detection camera and the fourth inspection camera are facing the display surface and the back of the glass substrate respectively. The fifth detection camera is facing the splicing surface of the glass substrate. Two laser ranging sensors measure the distance between them and the splicing surface and the display surface of the glass substrate respectively. Through the laser ranging + linear module compensation means or scheme, automatic focusing is achieved in all directions during the detection process, and the effect of clear photography is achieved during the photo-taking process.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to an industrial camera adaptive focusing device and method for multi-angle detection of edge grinding and chamfering of Micro-LED splicing surfaces. Background Art

[0002] Glass-based Micro LED is usually used for large-size display product splicing. The front is the display surface, and the back is used to install the driver chip. The back and front lines are connected through side wiring (such as Figure 7 ), in order to ensure the reliability of the side routing, the edge of the glass substrate needs to be chamfered. In order to ensure that the accuracy of the chamfer can meet the requirements of the routing, the size information of the chamfer needs to be measured. In addition, after the side routing is completed, the effect of the side line needs to be tested, which needs to be measured by AOI (Auto Optical Inspection).

[0003] Traditional industrial camera inspection is usually based on plane or 3D measurement, so it is unable to meet the inspection requirements of the top, bottom, side, 45° up, and 45° down of this product. In addition, due to the high inspection accuracy and large product size deformation, there is a problem of camera focus during the measurement process. Summary of the invention

[0004] The present invention aims to solve the problems existing in the above-mentioned prior art and provides an industrial camera adaptive focusing device and method for multi-angle detection of Micro-LED splicing surface edge grinding and chamfering.

[0005] The technical solutions adopted in the present invention are:

[0006] Industrial camera adaptive focusing device for multi-angle detection of Micro-LED splicing surface edge chamfering, including

[0007] frame;

[0008] A carrier, which is slidably mounted on the frame and is used to transport the glass substrate with chamfered upper and lower edges of the splicing surface;

[0009] Detection cameras, wherein five detection cameras are provided, corresponding to a first detection camera, a second detection camera, a third detection camera, a fourth detection camera and a fifth detection camera, each detection camera is driven by a linear actuator, the first detection camera and the second detection camera are facing to shoot the upper chamfered surface and the lower chamfered surface of the glass substrate, the third detection camera and the fourth detection camera are facing to shoot the display surface and the back surface of the glass substrate respectively, and the fifth detection camera is facing to shoot the splicing surface of the glass substrate;

[0010] Laser distance measuring sensors, wherein two laser distance measuring sensors are provided, including a horizontal laser distance measuring sensor and a vertical laser distance measuring sensor, and the two laser distance measuring sensors respectively measure the distance between themselves and the splicing surface of the glass substrate and the display surface.

[0011] Furthermore, an electric slide is provided on the frame, the carrier is arranged on the electric slide, and can be linearly displaced in the X and Y directions, and rotated in the Z-axis direction; the X direction is the sliding direction of the electric slide, the Y direction is the horizontal direction perpendicular to the sliding direction, and the Z direction is the vertical direction.

[0012] Furthermore, the device also includes a robot and an alignment camera. The robot moves the glass substrate to the stage, and the position of the glass substrate is positioned by the alignment camera. The stage adjusts the position in the X and / or Y and / or Z directions so that the splicing surface of the glass substrate is parallel to the conveying direction of the stage.

[0013] Furthermore, the linear actuator is driven by an electric screw.

[0014] The present invention also discloses an adaptive focusing method.

[0015] 1) Establishment of standard focal length of detection camera;

[0016] Take a glass substrate to be inspected as a standard sample, place it on the carrier and align it so that its splicing surface is parallel to the conveying direction of the carrier. Five inspection cameras correspondingly shoot the display surface, back surface, splicing surface, upper chamfered surface and lower chamfered surface of the splicing surface of the standard sample, adjust the position of the inspection camera, obtain the best focal length of each inspection camera and store it in the PC;

[0017] 2) Product testing;

[0018] After the glass substrate to be inspected is transported to the stage for alignment, the stage drives the glass substrate to be inspected to move linearly. During the movement, the horizontal laser ranging sensor first detects the distance between the glass substrate to be inspected and the splicing surface, and transmits the measured distance and the deviation of the best focal length of the first inspection camera, the second inspection camera and the fifth inspection camera to the PC, and the PC drives the linear actuators of the three inspection cameras to complete the distance compensation;

[0019] The vertical laser distance sensor detects the distance to the display surface of the detected glass substrate, and transmits the measured distance and the deviation from the optimal focal length of the remaining two detection cameras to the PC, which drives the linear actuators of the two detection cameras to complete the distance compensation.

[0020] Furthermore, at the optimal focal length, the distance between the stitching surface of the standard sample and the display surface is measured by two laser ranging sensors as d0, and the distance between the five detection cameras and the corresponding surface of the standard sample is P; the distance between the vertical laser ranging sensor and the third detection camera is measured as D.

[0021] Furthermore, the process of distance compensation is:

[0022] The glass substrate to be inspected moves toward the direction of the inspection camera at a speed of V, and the two laser distance sensors measure the distance according to the sampling period t. In each sampling period, the measurement points of the two laser distance sensors acting on the glass substrate to be inspected are sampling points, and the distance between the sampling points and the corresponding laser distance sensors is d1. When the glass substrate to be inspected is moving, the laser distance sensor measures once, and adds the d1 measured each time into the data queue in sequence. The capacity of the queue is greater than D / (V*t).

[0023] The time it takes for the sampling point K on the display surface to move to the third detection camera is T=D / V. At this time, the amount by which the linear actuator corresponding to the third detection camera needs to be adjusted is (d1-d0). The distance from the adjusted third detection camera to the display surface of the glass substrate to be inspected is P+ (d1-d0). The time it takes for the linear actuator corresponding to the third detection camera to be adjusted is 2t. The linear actuator starts compensation 2t in advance. After the sampling point is detected, the measured d1 is popped out from the data queue.

[0024] Furthermore, the robot carries the inspected glass substrate onto the stage, and the alignment camera photographs the Mark on the glass substrate. By adjusting the X and / or Y and / or Z axis directions of the stage, the Mark is made to coincide with the alignment template of the alignment camera. At this time, the splicing surface of the inspected glass substrate is parallel to the conveying direction of the stage.

[0025] Furthermore, after the inspected glass substrate is aligned on the stage, the distances from the splicing surface of the inspected glass substrate to the center of the third inspection camera and the center of the fourth inspection camera are equal, both of which are 1 mm to 2.5 mm.

[0026] The present invention has the following beneficial effects:

[0027] The present invention achieves the capture of defects and dimensions in all directions of the product edge by adopting means or solutions of a multi-view camera, which facilitates the subsequent measurement of defects and dimensions in all directions.

[0028] Through laser ranging + linear module compensation means or solutions, automatic focus is achieved in all directions during the detection process, clear photography is achieved during the photo-taking process, the stability of the photography process is improved, the problem of out-of-focus camera photography during the measurement process is avoided, and the detection effect is guaranteed. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] Figure 1 This is a structural diagram of the present invention.

[0030] Figure 2 Installation diagram of five detection cameras and two laser ranging sensors.

[0031] Figure 3 Schematic diagram of a glass substrate being transported and photographed by five inspection cameras and two laser ranging sensors.

[0032] Figure 4 Schematic diagram of the shooting angles of the five detection cameras.

[0033] Figure 5 Schematic diagram for testing the standard focal length of a camera.

[0034] Figure 6 Supplementary diagram of adaptive focus adjustment of industrial cameras during product inspection.

[0035] Figure 7 This is a schematic diagram of routing the existing glass substrate through the side. DETAILED DESCRIPTION

[0036] The present invention will be further described below in conjunction with the accompanying drawings.

[0037] like Figures 1 to 3 The present invention discloses an industrial camera adaptive focusing device for multi-angle detection of Micro-LED splicing surface edge grinding and chamfering, comprising a detection camera, a laser ranging sensor, a carrier 3 and a frame 4.

[0038] The carrier 3 is slidably arranged on the frame 4 and is used to convey the glass substrate 400, and the upper and lower edges of the conveying splicing surface of the glass substrate are chamfered. There are five detection cameras, corresponding to the first detection camera 11, the second detection camera 12, the third detection camera 13, the fourth detection camera 14 and the fifth detection camera 15. Each detection camera is driven by a linear actuator, and the linear actuator is driven by an electric screw with high driving accuracy. The first detection camera 11 and the second detection camera 12 are directly facing the upper chamfered surface and the lower chamfered surface of the glass substrate, the third detection camera 13 and the fourth detection camera 14 are arranged vertically, and respectively face the display surface and the back of the glass substrate, and the fifth detection camera 15 is arranged horizontally and faces the splicing surface of the glass substrate.

[0039] Two laser distance measuring sensors are provided, including a horizontal laser distance measuring sensor 21 and a vertical laser distance measuring sensor 22. The two laser distance measuring sensors measure the distance between themselves and the splicing surface of the glass substrate and the display surface respectively.

[0040] The sliding of the carrier 3 on the frame 4 is achieved by arranging an electric slide 41 on the frame 4 , and the carrier 3 is arranged on the electric slide 41 .

[0041] The stage 3 itself can move in three directions, X, Y, and Z, on the electric slide 41, which is mainly used to position the glass substrate 400, wherein the X and Y directions are linear displacements, and the Z direction is horizontal rotation. The X direction is the sliding direction of the electric slide 41, the Y direction is a horizontal direction perpendicular to the sliding direction, and the Z direction is a vertical direction. The driving of the X and Y directions is driven by an electric screw, and the rotation of the Z direction is driven by a servo motor.

[0042] The glass substrate 400 is transported to the stage 3 by a robot. In order to quickly position the transported glass substrate 400 on the stage, the device is also provided with an alignment camera 5. The robot transports the glass substrate to the stage 3, and the position of the glass substrate is positioned by the alignment camera. The stage 3 is adjusted in the X and / or Y and / or Z directions so that the splicing surface of the glass substrate is parallel to the conveying direction of the stage.

[0043] Combination Figures 4 to 6 , based on the above device, the control method of the present invention is as follows:

[0044] 1) Establishment of standard focal length of detection camera;

[0045] First, take a glass substrate to be inspected as a standard sample, place it on the carrier 3 and align it so that its splicing surface is parallel to the conveying direction of the carrier. Five inspection cameras correspondingly shoot the display surface, back surface, splicing surface, upper chamfered surface and lower chamfered surface of the splicing surface of the standard sample. The position of the corresponding inspection camera is adjusted by the linear actuator to obtain the optimal focal length of each inspection camera and store it in the PC.

[0046] like Figure 5 At the optimal focal length, the distance between the stitching surface of the distance standard sample and the display surface is measured by two laser ranging sensors as d0, the distance between the five detection cameras and the corresponding surface of the standard sample is P, and the distance between the vertical laser ranging sensor 22 and the third detection camera 13 is D.

[0047] 2) Product testing;

[0048] After the glass substrate to be inspected is transported to the stage 3 for alignment, the electric slide 41 drives the stage 3 and causes the glass substrate to be inspected to move linearly. During the movement, the horizontal laser ranging sensor 21 first detects the distance between the splicing surface of the glass substrate to be inspected, and transmits the measured distance and the deviation of the best focal length of the first inspection camera 11, the second inspection camera 12 and the fifth inspection camera 15 to the PC, and the PC drives the linear actuators of the three inspection cameras to complete the distance compensation; the vertical laser ranging sensor 22 detects the distance between the display surface of the glass substrate to be inspected, and transmits the measured distance and the deviation of the best focal length of the third inspection camera 13 and the fourth inspection camera 14 to the PC, and the PC drives the linear actuators of the two inspection cameras to complete the distance compensation.

[0049] Combination Figure 6 , the strategy of the present invention to supplement the detection camera position is:

[0050] The glass substrate to be inspected moves at a speed V toward the direction of the inspection camera, and the two laser distance sensors measure the distance according to the sampling period t (t=50ms). In each sampling period, the measurement points where the two laser distance sensors act on the glass substrate to be inspected are sampling points, such as Figure 6 In the figure, taking the upper display surface as an example, the distance of the sampling point K in each sampling period on the display surface corresponds to the distance d1 of the laser ranging sensor. When the detected glass substrate is moving, the vertical laser ranging sensor 22 measures each time, and adds the d1 measured each time to the data queue in sequence. The capacity of the queue is greater than D / (V*t) to ensure that the queue capacity does not overflow.

[0051] The time for each sampling point K on the display surface to move to the third detection camera 13 is T=D / V. At this time, the amount of adjustment required for the linear actuator corresponding to the third detection camera 13 is (d1-d0). The distance from the adjusted third detection camera 13 to the display surface of the glass substrate to be inspected is P+ (d1-d0). The time required for the linear actuator corresponding to the third detection camera 13 to adjust is 2t. The linear actuator starts compensation 2t in advance. After the sampling point is detected, the measured d1 is popped out from the data queue.

[0052] The measurement and sampling method of the horizontal laser distance measuring sensor 21 is the same as that of the vertical laser distance measuring sensor 22, so it will not be repeated.

[0053] The alignment of each inspected glass substrate on the carrier 3 is based on camera positioning, that is, the robot moves the inspected glass substrate to the carrier, and the alignment camera 5 photographs the Mark on the glass substrate. By adjusting the X and / or Y and / or Z axis direction of the carrier, the Mark is overlapped with the alignment template of the alignment camera. At this time, the splicing surface of the inspected glass substrate is parallel to the conveying direction of the carrier.

[0054] After the glass substrate to be inspected is aligned on the stage, the distances between the splicing surface of the glass substrate to be inspected and the center of the third inspection camera 13 and the center of the fourth inspection camera 14 are equal, both of which are 1 mm to 2.5 mm. The same plane where the center line of the third inspection camera 13 and the center line of the fourth inspection camera 14 are located is parallel to the conveying direction of the delivery stage 3.

[0055] The above description is only a preferred embodiment of the present invention. It should be pointed out that a person skilled in the art can make several improvements without departing from the principle of the present invention, and these improvements should also be regarded as within the protection scope of the present invention.

Claims

1. An industrial camera adaptive focusing method for multi-angle detection of Micro-LED splicing surface edge chamfering, characterized by: An adaptive focusing device is included, the device comprising Rack (4); A carrier (3), the carrier (3) being slidably mounted on the frame (4) and used for conveying a glass substrate with chamfered upper and lower edges of the splicing surface; An inspection camera, wherein five inspection cameras are provided, corresponding to a first inspection camera (11), a second inspection camera (12), a third inspection camera (13), a fourth inspection camera (14) and a fifth inspection camera (15), each inspection camera being driven by a linear actuator, the first inspection camera (11) and the second inspection camera (12) facing the upper chamfered surface and the lower chamfered surface of the glass substrate, the third inspection camera (13) and the fourth inspection camera (14) facing the display surface and the back surface of the glass substrate respectively, and the fifth inspection camera (15) facing the splicing surface of the glass substrate; Laser distance measuring sensors, wherein two laser distance measuring sensors are provided, including a horizontal laser distance measuring sensor (21) and a vertical laser distance measuring sensor (22), the two laser distance measuring sensors respectively measuring the distance between themselves and the glass substrate splicing surface and the display surface; The method comprises: 1) Establishment of standard focal length of detection camera; Take a glass substrate to be inspected as a standard sample, place it on the carrier and align it so that its splicing surface is parallel to the conveying direction of the carrier. Five inspection cameras correspondingly shoot the display surface, back surface, splicing surface, upper chamfered surface and lower chamfered surface of the splicing surface of the standard sample, adjust the position of the inspection camera, obtain the best focal length of each inspection camera and store it in the PC; 2) Product testing; After the glass substrate to be inspected is transported to the stage for alignment, the stage drives the glass substrate to be inspected to move linearly. During the movement, the horizontal laser distance measuring sensor (21) first detects the distance between the glass substrate to be inspected and the splicing surface, and transmits the measured distance and the deviation of the best focal length of the first inspection camera (11), the second inspection camera (12) and the fifth inspection camera (15) to the PC, and the PC drives the linear actuators of the three inspection cameras to complete the distance compensation; The vertical laser distance measuring sensor (22) detects the distance between the detected glass substrate display surface and transmits the measured distance and the deviation from the optimal focal length of the remaining two detection cameras to the PC, and the PC drives the linear actuators of the two detection cameras to complete the distance compensation; At the optimal focal length, the distance between the splicing surface of the distance standard sample and the display surface is measured by two laser distance measuring sensors as d0, and the distance between the five detection cameras and the corresponding surface of the standard sample is P; the distance between the vertical laser distance measuring sensor (22) and the third detection camera (13) is measured as D; The process of distance compensation is: The glass substrate to be inspected moves toward the direction of the inspection camera at a speed of V, and the two laser distance sensors measure the distance according to the sampling period t. In each sampling period, the measurement points of the two laser distance sensors acting on the glass substrate to be inspected are sampling points, and the distance between the sampling points and the corresponding laser distance sensors is d1. When the glass substrate to be inspected is moving, the laser distance sensor measures once, and adds the d1 measured each time into the data queue in sequence. The capacity of the queue is greater than D / (V*t). The time required for the sampling point K on the display surface to move to the third detection camera (13) is T=D / V. At this time, the amount by which the linear actuator corresponding to the third detection camera needs to be adjusted is (d1-d0). The distance from the adjusted third detection camera (13) to the display surface of the glass substrate to be detected is P+ (d1-d0). The time required for the linear actuator corresponding to the third detection camera to be adjusted is 2t. The linear actuator starts compensation 2t in advance. After the sampling point is detected, the d1 measured this time is popped out from the data queue.

2. The method for industrial camera adaptive focusing for multi-angle detection of Micro-LED splicing surface edge chamfering according to claim 1, characterized in that: The robot carries the inspected glass substrate to the stage, and the alignment camera (5) photographs the mark on the glass substrate. By adjusting the stage in the X and / or Y and / or Z axis directions, the mark is made to coincide with the alignment template of the alignment camera. At this time, the splicing surface of the inspected glass substrate is parallel to the conveying direction of the stage.

3. The method for industrial camera adaptive focusing for multi-angle detection of Micro-LED splicing surface edge grinding and chamfering according to claim 1, characterized in that: After the inspected glass substrate is aligned on the carrier, the distances from the splicing surface of the inspected glass substrate to the center of the third inspection camera (13) and the center of the fourth inspection camera (14) are equal, both being 1 mm to 2.5 mm.