Rejudgment test method and system based on automatic optical detection
In Micro&Mini product detection, the main camera is used to obtain and convert defect coordinates and control the re-judgment camera for precise positioning, which solves the problem of inaccurate re-judgment positioning in the prior art, and improves the detection efficiency and accuracy.
Patent Information
- Application Number
- CN202411090865.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-09
- Publication Date
- 2024-12-06
AI Technical Summary
In the optical detection of Micro&Mini products, defect coordinates cannot be accurately positioned during the automatic optical detection and re-judgment process, resulting in insufficient detection efficiency and accuracy.
Through the main camera detection, obtain the coordinates of the abnormal point of the object to be detected, perform coordinate system conversion, convert the image coordinates into world coordinates, and use linear servo motor to control the re-judgment camera to move to the defect position for re-judgment, realizing automatic optical detection and re-judgment integration.
It improves the efficiency and accuracy of Micro&Mini product defect re-judgment, achieves rapid and accurate positioning of bad defects, and improves the accuracy of detection.
Smart Images

Figure CN119086556A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of optical detection, and more specifically, to a re-judgment test and system based on automated optical detection. Background Art
[0002] When performing defect inspection on Micro & Mini products, for example, when performing defect inspection on Light-Emitting Diodes (LEDs), the coordinates of the product itself and the detected defects can be located based on automated optical inspection (AOI), and then moved to an independent high-power microscope camera by a motor to read data and move to the inspection position corresponding to the inspection data of the automated optical inspection to take images.
[0003] At present, the commonly used testing method in the Micro&Mini market is to conduct automated optical inspection alone, or to conduct re-inspection based on automated optical inspection by personnel using a microscope. This method of optical inspection of products fails to provide timely feedback on the test results of automated optical inspection, and there is a problem that the coordinates of detected defects cannot be accurately located during re-inspection. Summary of the invention
[0004] In response to at least one defect or improvement need in the prior art, the present invention provides a re-judgment test method and system based on automated optical inspection, which realizes the integration of automated optical inspection and re-judgment, improves the efficiency of re-judgment of defective Micro & Mini products, quickly analyzes and transforms the detection information of defective defects, realizes rapid and accurate positioning of defect re-judgment, and improves the accuracy of re-judgment of objects to be inspected.
[0005] To achieve the above-mentioned purpose, according to the first aspect of the present invention, a re-judgment test method based on automated optical inspection is provided, the method comprising: inspecting an object to be inspected by a main camera to determine inspection information of the object to be inspected, wherein the inspection information comprises a first coordinate of an abnormal point in the object to be inspected, and the abnormal point is a point at a defect in the object to be inspected; based on the inspection information, the first coordinate is converted into a second coordinate, wherein the second coordinate is a coordinate in a world coordinate system; and the re-judgment camera is controlled to move to the position indicated by the second coordinate to re-judgment the abnormal point of the object to be inspected.
[0006] In an exemplary embodiment, converting a first coordinate into a second coordinate based on detection information includes: determining a first image coordinate and a second image coordinate in the first coordinate in the detection information; converting the first image coordinate into a first world coordinate in the second coordinate according to a rotation coefficient; and converting the second image coordinate into a second world coordinate in the second coordinate according to the rotation coefficient.
[0007] In an exemplary embodiment, after detecting the object to be detected by the main camera and determining the detection information of the object to be detected, the method also includes: when there are at least two abnormal points of the object to be detected, obtaining at least two first coordinates corresponding to the object to be detected; when the parameter distance between the at least two first coordinates does not exceed a preset value, controlling the re-judgment camera to move to the position indicated by any one of the at least two first coordinates after being converted into the second coordinate; and re-judgmenting the abnormal points of the object to be detected by the re-judgment camera.
[0008] In an exemplary embodiment, when there are at least two abnormal points detected on the object to be detected, after obtaining at least two first coordinates corresponding to the object to be detected, the method also includes: when a parameter distance between the at least two first coordinates exceeds a preset value, controlling the re-judgment camera to move to the position indicated by each of the at least two first coordinates after being converted into the second coordinate; and re-judgmenting the abnormal points of the object to be detected by using the re-judgment camera.
[0009] In an exemplary embodiment, before converting the first image coordinates into the first world coordinates in the second coordinates according to the rotation coefficient, the method also includes: rotating the test calibration screen to the main camera, and obtaining the pixel coordinates of multiple calibration points in the calibration image through the main camera, wherein the test calibration screen is used to display the calibration image; rotating the test calibration screen to the re-judgment camera, moving the re-judgment camera in turn to the top of the multiple calibration points, and obtaining the world coordinates corresponding to the multiple calibration points calibrated by the re-judgment camera; solving the affine transformation matrix between the pixel coordinates and the world coordinates; and determining the rotation coefficient based on the radial transformation matrix.
[0010] In an exemplary embodiment, controlling the re-judgment camera to move to the position indicated by the second coordinate to re-judgment the abnormal points of the object to be inspected includes: controlling the re-judgment camera to move along the X-axis direction according to the second coordinate through the X-axis servo linear motor in the linear servo motor; controlling the storage table to move along the Y-axis direction according to the second coordinate through the Y-axis servo linear motor in the linear servo motor; and re-judging the abnormal points of the object to be inspected based on the re-judgment camera at the second coordinate position.
[0011] According to the second aspect of the present invention, there is also provided a re-judgment test system based on automated optical inspection, which applies the re-judgment test method based on automated optical inspection as described above, including: a main camera, a re-judgment camera, a storage table and a linear servo motor; wherein the linear servo motor includes an X-axis servo linear motor, a Y-axis servo linear motor and a Z-axis servo linear motor, the X-axis servo linear motor is used to control the re-judgment camera to move along the X-axis direction, the Y-axis servo linear motor is used to control the storage table to move along the Y-axis direction, and the Z-axis servo linear motor is used to control the re-judgment camera to move along the Z-axis direction.
[0012] According to the third aspect of the present invention, a re-judgment test device based on automated optical inspection is also provided, which includes: a first determination unit, used to detect an object to be inspected through a main camera, and determine detection information of the object to be inspected, wherein the detection information includes a first coordinate of an abnormal point in the object to be inspected, and the abnormal point is a point at a defect in the object to be inspected; a conversion unit, used to convert the first coordinate into a second coordinate based on the detection information, wherein the second coordinate is a coordinate in the coordinate system of the re-judgment camera; a moving unit, used to control the re-judgment camera to move to the position indicated by the second coordinate, and re-judgment the abnormal point of the object to be inspected.
[0013] According to a fourth aspect of the present invention, there is further provided a computer-readable storage medium, in which a computer program is stored, wherein the computer program is configured to execute the above-mentioned re-judgment test method based on automated optical detection when running.
[0014] According to a fifth aspect of the present invention, there is also provided an electronic device, comprising a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor executes the above-mentioned re-test method based on automated optical detection through the computer program.
[0015] In general, the above technical solutions conceived by the present invention can achieve the following beneficial effects compared with the prior art:
[0016] The present invention provides a re-judgment test method based on automated optical inspection, which is suitable for optical inspection of Micro & Mini products. The product to be inspected is first photographed and inspected by an automated optical inspection main camera to obtain the coordinates of the product defect, and the coordinates are converted into a coordinate system. The re-judgment camera, that is, a high-power microscope camera, is driven by a linear servo motor to re-judge the product defects and move it to the abnormal coordinates of the product for re-judgment, thereby realizing the integration of automated optical inspection and re-judgment, quickly analyzing and converting the detection information of bad defects, and realizing fast and accurate positioning of defect re-judgment, thereby improving the accuracy of re-judgment inspection of the object to be inspected. BRIEF DESCRIPTION OF THE DRAWINGS
[0017] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0018] Figure 1A schematic flow chart of an optional re-judgment test method based on automated optical detection provided in an embodiment of the present application;
[0019] Figure 2 A schematic diagram of an optional coordinate system conversion provided in an embodiment of the present application;
[0020] Figure 3 A schematic diagram of an optional nine-point calibration diagram provided in an embodiment of the present application;
[0021] Figure 4 A schematic diagram of an optional re-judgment test system based on automated optical detection provided in an embodiment of the present application;
[0022] Figure 5 A schematic diagram of the structure of an optional re-judgment test device based on automated optical detection provided in an embodiment of the present application;
[0023] Figure 6 A schematic diagram of the structure of an optional electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0024] In order to make the purpose, technical solutions and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention. In addition, the technical features involved in the various embodiments of the present invention described below can be combined with each other as long as they do not conflict with each other.
[0025] The terms "first", "second", "third", etc. in the specification and claims of this application and the above-mentioned drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally includes steps or units that are not listed, or optionally includes other steps or units inherent to these processes, methods, products or devices.
[0026] According to one aspect of the embodiments of the present application, a re-judgment test method based on automated optical detection is provided. Figure 1 The following describes a review test method based on automated optical detection provided by an embodiment of the present application.
[0027] Figure 1 is a flow chart of an optional re-judgment test method based on automated optical detection provided in an embodiment of the present application, such as Figure 1 As shown, the process of the method may include the following steps:
[0028] S102, detecting the object to be detected by a main camera to determine detection information of the object to be detected, wherein the detection information includes a first coordinate of an abnormal point in the object to be detected, and the abnormal point is a point at a defect in the object to be detected;
[0029] S104, converting the first coordinate into a second coordinate based on the detection information, wherein the second coordinate is a coordinate in a world coordinate system;
[0030] S106, controlling the re-judgment camera to move to the position indicated by the second coordinate, and re-judging the abnormal point of the object to be detected.
[0031] The re-evaluation test method based on automated optical inspection in the present application can be applicable to the scenario of optical inspection of the object to be inspected. Specifically, the object to be inspected can be a Micro & Mini product, such as LED lamp beads, or other products to be optically inspected; the main camera for automated optical inspection of the object to be inspected can be an AOI inspection main camera, or other inspection cameras; the re-evaluation camera for defect re-evaluation of the product can be a high-power microscope camera, or other types of cameras, which are not limited here.
[0032] In order to determine whether the object to be detected has defects, the object to be detected can be optically detected. Optionally, the object to be detected can be detected by the main camera. For example, the main camera can automatically scan the object to be detected through a high-definition camera and then collect images of the object to be detected, compare the collected images with qualified parameters in the database, and check the defects on the product through image processing technology. In other words, using the graphic recognition method, the standard digitized image stored in the system is compared with the actual detected image to obtain the defect detection result (i.e., detection information).
[0033] When performing automated optical inspection, the placement table carrying the object to be inspected is moved to the main camera detection position by a linear servo motor, the object to be inspected is inspected and photographed by the main camera, and the detection information of the object to be inspected is recorded. It should be noted that the detection information may include the pixel coordinates (i.e., first coordinates) of the abnormal point in the object to be inspected in the image captured by the main camera, and may also include product information (e.g., product specifications, quantity) of the object to be inspected. The abnormal point may be the point at the defect in the object to be inspected detected after the initial optical inspection by the main camera. After determining the detection information of the defect of the object to be inspected, the first coordinate can be converted into a second coordinate in the world coordinate system based on the detection information, so that the linear servo motor controls the re-judgment camera to move to the position indicated by the second coordinate according to the second coordinate, and re-judgments the abnormal point of the object to be inspected, thereby completing the all-in-one machine detection.
[0034] Specifically, the object to be detected is an LED lamp bead, the main camera is an AOI detection main camera, and the re-judgment camera is a high-power microscope camera. The LED lamp beads can be detected by the AOI detection main camera, and the axis movement is controlled by the linear servo motor to move the storage table carrying the LED lamp beads to the detection position of the AOI detection main camera. The LED lamp beads are detected and photographed by the AOI detection main camera. After the AOI algorithm, the detection information of the LED lamp beads is recorded. Here, the detection information may include the pixel coordinates of the abnormal points in the LED lamp beads in the image captured by the AOI detection main camera, and may also include the product information of the AOI detection (for example, the specifications and quantity of the lamp beads). After determining the detection information of the defective part of the LED lamp bead, the first coordinate can be converted into the second coordinate in the world coordinate system based on the detection information, so that the linear servo motor controls the re-judgment camera to move to the position indicated by the second coordinate according to the second coordinate, and the abnormal points of the LED lamp beads are re-judged, thereby completing the all-in-one machine detection and switching to the next LED product test.
[0035] Through the above steps S102 to S106, the main camera is used to detect the object to be detected, and the detection information of the object to be detected is determined, wherein the detection information includes the first coordinates of the abnormal point in the object to be detected, and the abnormal point is the point at the defect in the object to be detected; based on the detection information, the first coordinate is converted into a second coordinate, wherein the second coordinate is a coordinate in the world coordinate system; the re-judgment camera is controlled to move to the position indicated by the second coordinate, and the abnormal point of the object to be detected is re-judged. This method realizes the integration of automated optical detection and re-judgment, quickly analyzes and transforms the detection information of bad defects, and realizes fast and accurate positioning of defect re-judgment, thereby improving the accuracy of re-judgment detection of the object to be detected.
[0036] In an exemplary embodiment, converting the first coordinate into the second coordinate based on the detection information includes:
[0037] S11, determining the first image coordinates and the second image coordinates in the first coordinates in the detection information;
[0038] S12, converting the first image coordinates into first world coordinates in the second coordinates according to the rotation coefficient;
[0039] S13, converting the second image coordinates into second world coordinates in the second coordinates according to the rotation coefficient.
[0040] In this embodiment, after the AOI main camera is used to detect the object to be detected and the detection information of the object to be detected is obtained, the coordinates of the abnormal LED lamp beads and other information can be output to the re-judgment camera (re-judgment high-power microscope unit). Then, the coordinate information in the detection information needs to be converted into the second coordinate in the world coordinate system, so that the linear servo motor can control the re-judgment camera to the position indicated by the second coordinate.
[0041] Optionally, Figure 2 A schematic diagram of an optional coordinate system conversion provided in an embodiment of the present application, such as Figure 2 As shown, the first image coordinate (image coordinate X) and the second image coordinate (image coordinate Y) in the first coordinate in the detection information can be determined, and the first image coordinate can be converted into the first world coordinate (world coordinate X) in the second coordinate according to the rotation coefficient; the second image coordinate can be converted into the second world coordinate (world coordinate Y) in the second coordinate according to the rotation coefficient.
[0042] For example, the coordinate transformation can be performed in the following manner:
[0043] x'y' / mechanical coordinates (world coordinates); xy / image coordinates;
[0044] R / rotation coefficient, M / displacement;
[0045] [x';y']=R[x;Y]+M
[0046] x'=ax+by+C
[0047] y'=a'x+b'Y+C'
[0048] x0'=ax0+by0+C
[0049] x1'=axl+by1+C
[0050] x2'=ax2+by2+C
[0051] y0'=a'x0+b'y0+C'
[0052] yl'=a'xl+b'yl+C'
[0053] y2'=a'x2+b'y2+C'
[0054] [x0 y0 1][a]=[x0'][x0 y0 1][a]=[y0']
[0055] [xl y1 1][b]=[x1'][xl y1 1][b]=[y1']
[0056] [x2 y2 1][c]=[x2'][x2 y2 1][c]=[y2']
[0057] Through this embodiment, the image coordinates are converted into world coordinates through conversion between coordinate systems, which are used to control the high-power re-inspection microscope to move to the coordinate positioning for defect re-inspection through a linear servo motor, thereby avoiding the problem of manual re-inspection that it is difficult to find the defect for inspection, and facilitating rapid positioning in automated optical inspection.
[0058] In an exemplary embodiment, after detecting the object to be detected by the main camera and determining the detection information of the object to be detected, the method further includes:
[0059] S21, when there are at least two abnormal points of the object to be detected, obtaining at least two first coordinates corresponding to the object to be detected;
[0060] S22, when the parameter distance between the at least two first coordinates does not exceed a preset value, controlling the re-judgment camera to move to a position indicated by any first coordinate of the at least two first coordinates after being converted into a second coordinate;
[0061] S23, re-judging the abnormal points of the object to be detected by using a re-judgment camera.
[0062] In this embodiment, after the object to be detected is detected by the main camera, when there are at least two abnormal points of the object to be detected, at least two first coordinates corresponding to the object to be detected are obtained. The parameter distance between the at least two first coordinates is calculated, where the parameter distance is the average value of the sum of the parameter distances between each of the at least two first coordinates. When the parameter distance between the at least two first coordinates does not exceed the preset value, that is, when the distribution of the abnormal points in the object to be detected is relatively concentrated, the re-judgment camera can be controlled to move to the position indicated by any first coordinate of the at least two first coordinates after being converted into the second coordinate, that is, the re-judgment camera is controlled by the linear servo motor to move and take a picture once, so that the re-judgment detection of all the above abnormal points can be completed.
[0063] Furthermore, after calculating the parameter distance between at least two first coordinates, when the parameter distance between at least two first coordinates does not exceed a preset value, any one of the first coordinates can be selected for coordinate transformation, and all defects of the object to be inspected can be re-judged according to the converted second coordinates, thereby reducing some calculations and the mobile image acquisition process, and further improving the efficiency of re-judgment.
[0064] In an exemplary embodiment, when there are at least two abnormal points of the object to be detected, after obtaining at least two first coordinates corresponding to the object to be detected, the method further includes:
[0065] S31, when the parameter distance between at least two first coordinates exceeds a preset value, controlling the re-judgment camera to move to the position indicated by each of the at least two first coordinates after being converted into a second coordinate;
[0066] S32, re-evaluating abnormal points of the object to be detected by using a re-evaluation camera.
[0067] In this embodiment, after the object to be detected is detected by the main camera, when there are at least two abnormal points of the object to be detected, at least two first coordinates corresponding to the object to be detected are obtained, and the parameter distance between the at least two first coordinates is calculated. Similar to the above, the parameter distance here is the average value of the sum of the parameter distances between each of the at least two first coordinates. When the parameter distance between the at least two first coordinates exceeds the preset value, that is, when the distribution of the abnormal points in the object to be detected is relatively scattered, the re-judgment camera can be controlled to move to the position indicated by each of the at least two first coordinates after being converted into the second coordinate, that is, the linear servo motor is used to control the re-judgment camera to move a number of times that matches the number of abnormal points, and re-judgment is performed respectively to complete the re-judgment detection of all the above abnormal points.
[0068] In an exemplary embodiment, before converting the first image coordinates into first world coordinates in the second coordinates according to the rotation coefficient, the method further comprises:
[0069] S41, rotating the test calibration screen to the main camera, and obtaining pixel coordinates of multiple calibration points in the calibration map through the main camera, wherein the test calibration screen is used to display the calibration map;
[0070] S42, rotating the test calibration screen to the re-judgment camera, moving the re-judgment camera to the top of multiple calibration points in sequence, and obtaining the world coordinates corresponding to the multiple calibration points calibrated by the re-judgment camera;
[0071] S43, solving the affine transformation matrix between pixel coordinates and world coordinates;
[0072] S44, determining the rotation coefficient based on the radial transformation matrix.
[0073] In this embodiment, Figure 3 A schematic diagram of an optional nine-point calibration diagram provided in an embodiment of the present application, combined with Figure 2 and Figure 3As shown, when performing coordinate transformation, the affine transformation matrix between the coordinate systems can be determined by calibration, and then the rotation coefficient can be determined by the affine transformation matrix.
[0074] Specifically, by calibrating the high-power microscope camera at the re-judgment station, obtaining the conversion relationship between the image pixel XYZ coordinates of the AOI inspection main camera and the world XYZ coordinates of the mechanical axis of the re-judgment station may include the following steps:
[0075] 1) AOI station obtains the coordinates of the calibration points
[0076] Turn the product to the AOI inspection position, switch to display the calibration map, use the large camera to capture and save the original image, and read the pixel coordinates of the calibration point center on the large camera image.
[0077] 2) Review the workstation to obtain world coordinates
[0078] Turn the product to the re-inspection station and move the re-inspection camera to the following positions: Figure 3 Place the mark point directly above the nine calibration points shown in the figure, make the center of the mark point located at the center of the image, and record the world coordinates.
[0079] After reading the pixel coordinates and the world coordinates, the affine transformation matrix (ie, transformation matrix) between the pixel coordinates and the world coordinates can be determined, and the rotation coefficient R in the coordinate conversion process can be determined by the affine transformation matrix.
[0080] In an exemplary embodiment, controlling the re-judgment camera to move to the position indicated by the second coordinate to re-judge the abnormal point of the object to be detected includes:
[0081] S51, controlling the re-judgment camera to move along the X-axis direction according to the second coordinate by using the X-axis servo linear motor in the linear servo motor;
[0082] S52, controlling the placement table to move along the Y-axis direction according to the second coordinate by using the Y-axis servo linear motor in the linear servo motor;
[0083] S53, re-judging the abnormal points of the object to be detected based on the re-judgment camera at the second coordinate position.
[0084] In this embodiment, the main camera is an AOI detection main camera, and the re-judgment camera is a re-judgment high-power microscope camera. The AOI detection main camera can be used to take the original image after the entire Micro&Mini product is lit. After the original image is detected by the AOI algorithm, the abnormal LED lamp bead coordinates and other information are output to the re-judgment high-power microscope unit. The re-judgment high-power microscope camera receives the information output by the AOI detection main camera, and relies on the linear servo motor to drive the microscope camera to move to the abnormal LED lamp bead coordinates of the Micro&Mini product for re-judgment.
[0085] Specifically, the X-axis servo linear motor in the linear servo motor can be used to control the high-power microscope camera to move along the X-axis according to the second coordinate; the Y-axis servo linear motor in the linear servo motor can be used to control the placement table to move along the Y-axis according to the second coordinate. The abnormal points of the Micro&Mini product can be re-judged based on the high-power microscope camera at the second coordinate position.
[0086] like Figure 4 As shown, according to another aspect of the embodiment of the present application, a re-judgment test system using the re-judgment test method based on automated optical detection is also provided, and the re-judgment test method based on automated optical detection is applied, including:
[0087] Main camera 1, review camera 2, storage platform 3 and linear servo motor 7;
[0088] Among them, the linear servo motor 7 includes an X-axis servo linear motor 4, a Y-axis servo linear motor 5, and a Z-axis servo linear motor. The X-axis servo linear motor is used to control the movement of the re-judgment camera along the X-axis direction, the Y-axis servo linear motor is used to control the movement of the storage table along the Y-axis direction, and the Z-axis servo linear motor is used to control the movement of the re-judgment camera along the Z-axis direction.
[0089] According to another aspect of an embodiment of the present application, a re-test device for implementing the above-mentioned re-test method based on automated optical detection is also provided. Figure 5 is a schematic structural diagram of an optional re-judgment test device based on automated optical detection according to an embodiment of the present application, such as Figure 4 As shown, the device may include:
[0090] A first determining unit 502 is used to detect the object to be detected by using a main camera to determine detection information of the object to be detected, wherein the detection information includes a first coordinate of an abnormal point in the object to be detected, and the abnormal point is a point at a defect in the object to be detected;
[0091] A conversion unit 504, configured to convert the first coordinate into a second coordinate based on the detection information, wherein the second coordinate is a coordinate in a complex camera coordinate system;
[0092] The moving unit 506 is used to control the re-judgment camera to move to the position indicated by the second coordinate to re-judgment the abnormal point of the object to be detected.
[0093] It should be noted that the first determining unit 502 in this embodiment can be used to execute the above step S102, the converting unit 504 in this embodiment can be used to execute the above step S104, and the moving unit 506 in this embodiment can be used to execute the above step S106.
[0094] Through the above module, the main camera is used to detect the object to be detected, and the detection information of the object to be detected is determined, wherein the detection information includes the first coordinates of the abnormal point in the object to be detected, and the abnormal point is the point at the defect in the object to be detected; based on the detection information, the first coordinate is converted into a second coordinate, wherein the second coordinate is a coordinate in the world coordinate system; the re-judgment camera is controlled to move to the position indicated by the second coordinate, and the abnormal point of the object to be detected is re-judged. This method realizes the integration of automated optical detection and re-judgment, quickly analyzes and transforms the detection information of bad defects, and realizes fast and accurate positioning of defect re-judgment, thereby improving the accuracy of re-judgment detection of the object to be detected.
[0095] In one exemplary embodiment, the conversion unit comprises:
[0096] A determination module, used to determine the first image coordinates and the second image coordinates in the first coordinates in the detection information;
[0097] A first conversion module, used for converting the first image coordinates into first world coordinates in the second coordinates according to the rotation coefficient;
[0098] The second conversion module is used to convert the second image coordinates into second world coordinates in the second coordinates according to the rotation coefficient.
[0099] In an exemplary embodiment, the above device further comprises:
[0100] An acquisition unit, configured to acquire at least two first coordinates corresponding to the object to be detected when at least two abnormal points of the object to be detected are detected;
[0101] A first control unit is used to control the re-judgment camera to move to a position indicated by any first coordinate of the at least two first coordinates after being converted into a second coordinate when a parameter distance between the at least two first coordinates does not exceed a preset value;
[0102] The first re-judgment unit is used to re-judgment the abnormal points of the object to be detected through a re-judgment camera.
[0103] In an exemplary embodiment, the above device further comprises:
[0104] A second control unit is used to control the re-judgment camera to move to the position indicated by each of the at least two first coordinates after being converted into the second coordinate when the parameter distance between the at least two first coordinates exceeds a preset value;
[0105] The second re-judgment unit is used to re-judgment the abnormal points of the object to be detected through a re-judgment camera.
[0106] In an exemplary embodiment, the above device further comprises:
[0107] A first calibration unit, used for rotating a test calibration screen to a main camera, and obtaining pixel coordinates of a plurality of calibration points in a calibration map through the main camera, wherein the test calibration screen is used for displaying the calibration map;
[0108] The second calibration unit is used to rotate the test calibration screen to the re-judgment camera, move the re-judgment camera to the top of multiple calibration points in sequence, and obtain the world coordinates corresponding to the multiple calibration points calibrated by the re-judgment camera;
[0109] A solving unit, used for solving the affine transformation matrix between pixel coordinates and world coordinates;
[0110] The second determining unit is used to determine the rotation coefficient based on the radiation transformation matrix.
[0111] In one exemplary embodiment, the mobile unit comprises:
[0112] The first moving module is used to control the re-judgment camera to move along the X-axis direction according to the second coordinate through the X-axis servo linear motor in the linear servo motor;
[0113] The second moving module is used to control the placement table to move along the Y-axis direction according to the second coordinate through the Y-axis servo linear motor in the linear servo motor;
[0114] The re-judgment module is used to re-judgment the abnormal points of the object to be detected based on the re-judgment camera at the second coordinate position.
[0115] It should be noted here that the examples and scenarios implemented by the above-mentioned modules and corresponding steps are the same, but are not limited to the contents disclosed in the above-mentioned embodiments. It should be noted that the above-mentioned modules as part of the device can run in a hardware environment and can be implemented by software or hardware, wherein the hardware environment includes a network environment.
[0116] According to another aspect of the embodiments of the present application, a storage medium is further provided. Optionally, in this embodiment, the storage medium can be used to execute the program code of any of the above-mentioned automated optical detection-based re-judgment test methods in the embodiments of the present application.
[0117] Optionally, in this embodiment, the storage medium is configured to store program codes for executing the following steps:
[0118] S1, inspecting an object to be inspected by a main camera to determine inspection information of the object to be inspected, wherein the inspection information includes a first coordinate of an abnormal point in the object to be inspected, and the abnormal point is a point at a defect in the object to be inspected.
[0119] S2, converting the first coordinate into a second coordinate based on the detection information, wherein the second coordinate is a coordinate in a world coordinate system.
[0120] S3, controlling the re-judgment camera to move to the position indicated by the second coordinate, and re-judging the abnormal point of the object to be detected.
[0121] Optionally, the specific examples in this embodiment may refer to the examples described in the above embodiments, which will not be described in detail in this embodiment.
[0122] Among them, computer-readable storage media may include, but are not limited to, any type of disk, including floppy disks, optical disks, DVDs, CD-ROMs, microdrives and magneto-optical disks, ROMs, RAMs, EPROMs, EEPROMs, DRAMs, VRAMs, flash memory devices, magnetic or optical cards, nanosystems (including molecular memory ICs), or any type of medium or device suitable for storing instructions and / or data.
[0123] According to another aspect of the embodiment of the present application, an electronic device for implementing the above-mentioned re-judgment test method based on automated optical detection is also provided. The electronic device can be a server, a terminal, or a combination thereof.
[0124] Figure 6 is a schematic diagram of the structure of an optional electronic device according to an embodiment of the present application, such as Figure 6 As shown, it includes a processor 602, a communication interface 604, a memory 606 and a communication bus 608, wherein the processor 602, the communication interface 604, and the memory 606 communicate with each other through the communication bus 608, wherein,
[0125] Memory 606, used to store computer programs;
[0126] The processor 602 is used to implement the following steps when executing the computer program stored in the memory 606:
[0127] S1, inspecting an object to be inspected by a main camera to determine inspection information of the object to be inspected, wherein the inspection information includes a first coordinate of an abnormal point in the object to be inspected, and the abnormal point is a point at a defect in the object to be inspected.
[0128] S2, converting the first coordinate into a second coordinate based on the detection information, wherein the second coordinate is a coordinate in a world coordinate system.
[0129] S3, controlling the re-judgment camera to move to the position indicated by the second coordinate, and re-judging the abnormal point of the object to be detected.
[0130] Optionally, the communication bus may be a PCI (Peripheral Component Interconnect) bus, or an EISA (Extended Industry Standard Architecture) bus, etc. The communication bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 6 The communication interface is used for communication between the electronic device and other devices.
[0131] The memory may include RAM, or may include nonvolatile memory, such as at least one disk memory. Optionally, the memory may also be at least one storage device located away from the aforementioned processor.
[0132] As an example, the memory 606 may include, but is not limited to, the first determination unit 502, the conversion unit 504, and the control movement unit 506 in the re-judgment test device based on automated optical detection. In addition, it may also include, but is not limited to, other module units in the re-judgment test device based on automated optical detection, which will not be repeated in this example.
[0133] The above-mentioned processor can be a general-purpose processor, which can include but not be limited to: CPU (Central Processing Unit), NP (Network Processor), etc.; it can also be DSP (Digital Signal Processing), ASIC (Application Specific Integrated Circuit), FPGA (Field-Programmable Gate Array) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.
[0134] Optionally, the specific examples in this embodiment may refer to the examples described in the above embodiments, and this embodiment will not be described in detail here.
[0135] It should be noted that, for the aforementioned method embodiments, for the sake of simplicity, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the described order of actions, because according to the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.
[0136] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.
[0137] In the several embodiments provided in the present application, it should be understood that the disclosed devices can be implemented in other ways. For example, the device embodiments described above are only schematic, such as the division of the units, which is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some service interfaces, and the indirect coupling or communication connection of devices or units can be electrical or other forms.
[0138] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0139] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.
[0140] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable memory. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a memory, including a number of instructions to enable a computer device (which can be a personal computer, server or network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned memory includes: U disk, read-only memory (ROM), random access memory (RAM), mobile hard disk, disk or optical disk and other media that can store program code.
[0141] A person of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable memory, which can include: a flash drive, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.
[0142] The above is only an exemplary embodiment of the present disclosure, and the scope of the present disclosure cannot be limited thereto. That is, any equivalent changes and modifications made according to the teachings of the present disclosure are still within the scope of the present disclosure. After considering the specification and practicing the disclosure here, those skilled in the art will easily think of the implementation scheme of the present disclosure. This application is intended to cover any modification, use or adaptation of the present disclosure, which follows the general principles of the present disclosure and includes common knowledge or customary technical means in the technical field not recorded in the present disclosure. The description and examples are regarded as exemplary only, and the scope and spirit of the present disclosure are defined by the claims.
[0143] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0144] It will be easily understood by those skilled in the art that the above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the protection scope of the present invention.
Claims
1. A re-judgment test method based on automated optical detection, characterized in that: include: Detecting the object to be detected by a main camera to determine detection information of the object to be detected, wherein the detection information includes a first coordinate of an abnormal point in the object to be detected, and the abnormal point is a point at a defect in the object to be detected; Converting the first coordinate into a second coordinate based on the detection information, wherein the second coordinate is a coordinate in a world coordinate system; The re-judgment camera is controlled to move to the position indicated by the second coordinate to re-judgment the abnormal point of the object to be detected.
2. The re-judgment test method based on automated optical detection according to claim 1, characterized in that: The converting the first coordinate into a second coordinate based on the detection information comprises: Determine a first image coordinate and a second image coordinate in the first coordinate in the detection information; converting the first image coordinates into first world coordinates in the second coordinates according to a rotation coefficient; The second image coordinates are converted to second world coordinates in the second coordinates according to the rotation coefficient.
3. The re-judgment test method based on automated optical detection according to claim 1, characterized in that: After detecting the object to be detected by the main camera and determining the detection information of the object to be detected, the method further includes: When there are at least two abnormal points of the object to be detected, obtaining at least two first coordinates corresponding to the object to be detected; When the parameter distance between the at least two first coordinates does not exceed a preset value, controlling the re-judgment camera to move to a position indicated by any one of the at least two first coordinates after the first coordinate is converted into the second coordinate; The abnormal points of the object to be detected are re-judged by the re-judgment camera.
4. The re-judgment test method based on automated optical detection according to claim 3, characterized in that: In the case where there are at least two abnormal points of the object to be detected, after obtaining at least two first coordinates corresponding to the object to be detected, the method further includes: When the parameter distance between the at least two first coordinates exceeds a preset value, controlling the re-judgment camera to move to the position indicated by each of the at least two first coordinates after the first coordinates are converted into the second coordinates; The abnormal points of the object to be detected are re-judged by the re-judgment camera.
5. The re-judgment test method based on automated optical detection according to claim 2, characterized in that: Before converting the first image coordinates into first world coordinates in the second coordinates according to the rotation coefficient, the method further includes: Rotate the test calibration screen to the main camera, and obtain pixel coordinates of a plurality of calibration points in the calibration map through the main camera, wherein the test calibration screen is used to display the calibration map; Rotate the test calibration screen to the re-judgment camera, move the re-judgment camera to the top of the multiple calibration points in sequence, and obtain the world coordinates corresponding to the multiple calibration points calibrated by the re-judgment camera; Solving the affine transformation matrix between the pixel coordinates and the world coordinates; The rotation coefficients are determined based on the radial transformation matrix.
6. The re-judgment test method based on automated optical detection according to claim 1, characterized in that: Controlling the re-judgment camera to move to the position indicated by the second coordinate to re-judgment the abnormal point of the object to be detected includes: Control the re-judgment camera to move along the X-axis direction according to the second coordinate by an X-axis servo linear motor in a linear servo motor; Control the placement table to move along the Y-axis direction according to the second coordinate by using a Y-axis servo linear motor in a linear servo motor; The abnormal point of the object to be detected is re-judged based on the re-judgment camera at the second coordinate position.
7. A re-judgment test system based on automated optical detection, applying the re-judgment test method based on automated optical detection according to any one of claims 1 to 6, comprising: Main camera, review camera, storage table and linear servo motor; Among them, the linear servo motor includes an X-axis servo linear motor, a Y-axis servo linear motor, and a Z-axis servo linear motor. The X-axis servo linear motor is used to control the movement of the re-judgment camera along the X-axis direction, the Y-axis servo linear motor is used to control the movement of the storage table along the Y-axis direction, and the Z-axis servo linear motor is used to control the movement of the re-judgment camera along the Z-axis direction.
8. A re-judgment test device based on automated optical detection, characterized in that: include: A first determining unit, configured to detect an object to be detected by a main camera, and determine detection information of the object to be detected, wherein the detection information includes a first coordinate of an abnormal point in the object to be detected, and the abnormal point is a point at a defect in the object to be detected; A conversion unit, configured to convert the first coordinate into a second coordinate based on the detection information, wherein the second coordinate is a coordinate in a complex camera coordinate system; The moving unit is used to control the re-judgment camera to move to the position indicated by the second coordinate to re-judgment the abnormal point of the object to be detected.
9. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes a stored program, wherein the program executes the method according to any one of claims 1 to 6 when executed.
10. An electronic device comprising a memory and a processor, characterized in that: A computer program is stored in the memory, and the processor is configured to execute the method according to any one of claims 1 to 6 through the computer program.
Citation Information
Patent Citations
AOI (Automated Optical Inspection)-based display panel micro defect judgment method and device
CN109856156A
Mask defect detection method and device, electronic equipment and storage medium
CN114881990A
Screen detection method and device based on visual technology and computer equipment
CN115222728A
Defect detection method, defect detection device and computer readable storage medium
CN115524347A
Defect detection method, device and equipment for printed circuit board and storage medium
CN115908420A
