Processing method, processing device, and nonvolatile computer-readable storage medium

Abstract

The application discloses a processing method, a processing device and a nonvolatile computer readable storage medium. The processing method comprises the following steps: acquiring a display image of an operation interface of a machine table, wherein the display image displays at least part of a workpiece and a cutter mark line, and a center mark line in the cutter mark line represents a cutting center line of a cutter; identifying the center mark line in the cutter mark line in the display image; acquiring the position of the cutting center line of the workpiece in the display image; and moving the center mark line in the display image, so that the center mark line coincides with the cutting center line, thereby controlling the cutting center line of the cutter to coincide with the cutting center line of the workpiece on the machine table. After the positions of the center mark line and the cutting center line are acquired, the center mark line is made to coincide with the cutting center line, thereby controlling the cutting center line of the cutter to coincide with the cutting center line of the workpiece, so that the cutter can always cut along the interval between application units, and the application units are ensured to be not damaged.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of semiconductor technology, and more particularly, to a processing method, a processing device, and a nonvolatile computer readable storage medium. BACKGROUND

[0002] A workpiece, such as a wafer, usually has multiple application units, such as dies, and in actual use, the application units need to be cut off for application to various industries. In the cutting process, the cutting knife needs to cut along the interval between the application units. However, in actual cutting, the cutting knife is not always able to cut along the interval between the application units, so as to cut the application units and damage the application units. SUMMARY

[0003] The embodiments of the present application provide a processing method, a processing device, and a nonvolatile computer readable storage medium.

[0004] The processing method of the embodiments of the present application comprises: acquiring a display image of an operation interface of a machine table, the display image displaying at least part of a workpiece and a cutting knife mark line, a center mark line in the cutting knife mark line representing a cutting center line of a cutting knife; identifying the center mark line in the cutting knife mark line in the display image; acquiring a position of the cutting center line of the workpiece in the display image; and moving the center mark line in the display image, so that the center mark line coincides with the cutting center line, to control the cutting center line of the cutting knife to coincide with the cutting center line of the workpiece on the machine table.

[0005] In some embodiments, the acquiring of the display image of the operation interface of the machine table comprises: taking a screenshot of the operation interface of the machine table; and taking a region of interest in the screenshot as the display image, the region of interest having the workpiece and the cutting knife mark line, and the cutting knife mark line penetrating through the region of interest.

[0006] In some embodiments, the identifying of the center mark line in the cutting knife mark line in the display image comprises: performing a first binarization processing on the display image to obtain a first binarization image; counting the number of white pixel points in each row of the first binarization image; and taking the row with the maximum number of white pixel points as the position of the center mark line.

[0007] In some embodiments, the center identification line is in a first color, and the first binarization of the display image to obtain a first binarized image comprises: separating the display image into multiple color channels to obtain multiple frames of single-color image data; performing grayscale processing on each frame of single-color image data to obtain grayscale image data corresponding to each frame of single-color image data; and obtaining a new grayscale value for each pixel point according to a grayscale value in the grayscale image data corresponding to the first color image data and grayscale values in the grayscale image data corresponding to other color image data to form the first binarized image.

[0008] In some embodiments, the obtaining the position of the cutting center line of the workpiece in the display image comprises:

[0009] obtaining the position of a cutting path and / or a cutting mark of the workpiece in the display image; and taking the center line position of the cutting path or the center line position of the cutting mark as the position of the cutting center line of the workpiece in the display image.

[0010] In some embodiments, the acquiring the position of the kerf and / or the cut mark of the workpiece in the display image comprises: performing a second binarization on the display image to obtain a second binarized image; obtaining a binary matrix according to the number of white pixel points in each row of the second binarized image and a preset threshold, the binary matrix comprising n*1 elements, where n is the number of rows of pixel points in the second binarized image; in the binary matrix, if the value of the current row element is less than the value of the next row element, the current row is taken as a first candidate row; if the value of the current row element is greater than the value of the next row element, the current row is taken as a second candidate row; performing a first pairing step on each of the first candidate rows, the first pairing step comprising: taking the selected first candidate row as a first to-be-paired row, selecting the second candidate row located on the first side of the first to-be-paired row as a second to-be-paired row from the plurality of second candidate rows, and taking the first to-be-paired row and each corresponding second to-be-paired row as a first to-be-tested dotted line pair; performing a second pairing step on each of the second candidate rows, the second pairing step comprising: taking the selected second candidate row as a third to-be-paired row, selecting the first candidate row located on the first side of the third to-be-paired row as a fourth to-be-paired row from the plurality of first candidate rows, and taking the third to-be-paired row and each corresponding fourth to-be-paired row as a second to-be-tested dotted line pair; acquiring a first center line between each of the first to-be-tested dotted line pairs and a second center line between each of the second to-be-tested dotted line pairs; and calculating the distance difference between each first center line and all second center lines, selecting the first to-be-tested dotted line corresponding to the first center line with the smallest difference value as a first dotted line pair, and selecting the second to-be-tested dotted line corresponding to the second center line with the smallest difference value as a second dotted line pair; and taking one of the position of the first dotted line pair and the position of the second dotted line pair as the position of the kerf of the workpiece, and taking the other as the position of the cut mark of the workpiece.

[0011] In some embodiments, the obtaining the binary matrix according to the number of white pixel points in each row of the second binarized image and a preset threshold comprises: counting the number of white pixel points in each row of the second binarized image row by row, and arranging the number of white pixel points of all rows in the order along the column to form a number matrix, the first direction being the row and the second direction being the column; and traversing the number in the number matrix row by row, if the number of the current row is greater than the preset threshold, the corresponding row element in the binary matrix is a first value; if the number of the current row is less than the preset threshold, the corresponding row element in the binary matrix is a second value.

[0012] In some embodiments, the moving the center identification line in the display image to coincide with the cutting center line comprises: obtaining a deviation between the center identification line and a cutting center line of the workpiece in the display image; and controlling the center identification line to compensate for the deviation according to a user input, so as to coincide the center identification line with the cutting center line.

[0013] The processing device of some embodiments of the present application comprises a machine table, an image collector, a cutting tool mounted on the machine table, a display unit, and one or more processors. The image collector is configured to collect an image of a workpiece. The cutting tool is configured to cut the workpiece. The display unit is configured to display an operation interface of the machine table. The image collected by the image collector can be displayed on the operation interface of the machine table. The one or more processors are configured to execute the processing method of any of the above embodiments.

[0014] A non-volatile computer readable storage medium containing a computer program, when the computer program is executed by one or more processors, causes the processor to execute the processing method of any of the above embodiments.

[0015] In the processing method, the processing device, and the non-volatile computer readable storage medium of some embodiments of the present application, the display image is used to display the workpiece and the cutting tool mark line, the center identification line in the cutting tool mark line in the display image is identified, the position of the cutting center line of the workpiece in the display image is obtained, and the center identification line in the display image is moved to coincide with the cutting center line, so as to control the cutting center line of the cutting tool to coincide with the cutting center line of the workpiece on the machine table. In this way, the cutting tool can always cut along the interval between the application units (wafers), and the application units are not damaged, which ensures that the application units are not damaged.

[0016] Additional aspects and advantages of the embodiments of the present application will be in part apparent and in part pointed out hereinafter in the description of the embodiments of the present application. BRIEF DESCRIPTION OF DRAWINGS

[0017] The above and / or additional aspects and advantages of the present application can become apparent and be readily understood from the following description, considered in conjunction with the accompanying drawings, in which:

[0018] Figure 1 is a flowchart of the processing method of some embodiments of the present application;

[0019] Figure 2 is a structural schematic diagram of the processing device of some embodiments of the present application;

[0020] Figure 3 is a flowchart of the processing method of some embodiments of the present application;

[0021] Figure 4 is a schematic diagram of the principle of the processing method of some embodiments of the present application;

[0022] Figure 5 is a schematic diagram of the flow of the processing method of some embodiments of the present application;

[0023] Figure 6 is a schematic diagram of the principle of the processing method of some embodiments of the present application;

[0024] Figure 7 is a schematic diagram of the flow of the processing method of some embodiments of the present application;

[0025] Figure 8 is a schematic diagram of the principle of the processing method of some embodiments of the present application;

[0026] Figure 9 is a schematic diagram of the flow of the processing method of some embodiments of the present application;

[0027] Figure 10 is a schematic diagram of the principle of the processing method of some embodiments of the present application;

[0028] Figure 11 is a schematic diagram of the flow of the processing method of some embodiments of the present application;

[0029] Figure 12 is a schematic diagram of the principle of the processing method of some embodiments of the present application;

[0030] Figure 13 is a schematic diagram of the principle of the processing method of some embodiments of the present application;

[0031] Figure 14 is a schematic diagram of the flow of the processing method of some embodiments of the present application;

[0032] Figure 15 is a schematic diagram of the flow of the processing method of some embodiments of the present application;

[0033] Figure 16 is a schematic diagram of the structure of the non-volatile computer readable storage medium connected with the processor of some embodiments of the present application.

[0034] Main element number: processing device 100, machine table 10, image collector 20, cutter 30, display unit 40, processor 50, workpiece 200, operation interface P1, screenshot P2, display image P3, first binary image P4, cutter mark line L1, first width mark line L11, second width mark line L12, center mark line C1, cutting path M1, cutting mark M2, second binary image P5, binary matrix I, computer program 301, readable storage medium 300, first direction X, second direction Y Detailed Implementation

[0035] The embodiments of this application are described in detail below. Examples of these embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the embodiments of this application, and should not be construed as limiting the embodiments of this application.

[0036] Please refer to the following: Figure 1 , Figure 2 , Figure 4 and Figure 6 This application provides a processing method, which includes:

[0037] 01: Obtain the display image P3 of the operation interface P1 of the machine tool 10. The display image P3 shows at least part of the workpiece 200 and the cutting mark line L1. The center mark line C1 in the cutting mark line L1 represents the cutting center line of the cutting blade 30.

[0038] 03: Identify the center marker line C1 in the cutter marker line L1 in the displayed image P3;

[0039] 05: Obtain the position of the cutting center line of workpiece 200 in the displayed image P3; and

[0040] 07: Move the center marker line C1 in the display image P3 so that the center marker line C1 coincides with the cutting center line, so as to control the cutting center line of the cutter 30 to coincide with the cutting center line of the workpiece 200 on the machine table 10.

[0041] Please continue reading. Figure 1 , Figure 2 , Figure 4 and Figure 6The present embodiment provides a processing device 100, which comprises a machine table 10, an image collector 20, a cutter 30 installed on the machine table 10, a display unit 40, and one or more processors 50. The image collector 20 is configured to collect an image of a workpiece 200. The cutter 30 is configured to cut the workpiece 200. The display unit 40 is configured to display an operation interface P1 of the machine table 10. The image collected by the image collector 20 can be displayed on the operation interface P1 of the machine table 10. The one or more processors 50 are configured to perform the methods in 01, 03, 05, and 07. That is, the one or more processors 50 are configured to acquire a display image P3 of the operation interface P1 of the machine table 10, the display image P3 displays at least part of the workpiece 200 and a cutter mark line L1, a center identification line C1 in the cutter mark line L1 represents a cutting center line of the cutter 30; identify the center identification line C1 in the cutter mark line L1 in the display image P3; acquire a position of the cutting center line of the workpiece 200 in the display image P3; and move the center identification line C1 in the display image P3, so that the center identification line C1 coincides with the cutting center line, to control the cutting center line of the cutter 30 to coincide with the cutting center line of the workpiece 200 on the machine table 10.

[0042] The workpiece 200 usually has a plurality of application units arranged thereon. In actual use, the plurality of application units on the workpiece 200 need to be cut off for application in various industries. For example, in some embodiments, the workpiece 200 can be a wafer, and the application units on the wafer are dies. In order to facilitate accurate cutting, the workpiece 200 is usually subjected to preliminary cutting, that is, a pair of cutting paths M1 (as shown in Figure 10 ) and / or a pair of cutting marks M2 (as shown in Figure 10 ) are left between the plurality of application units. In this way, the cutter 30 only needs to cut along the positions between the cutting paths M1 and / or the cutting marks M2 to obtain a plurality of complete application units.

[0043] For example, in some embodiments, the workpiece 200 after processing, that is, the workpiece 200 containing a pair of cutting paths M1 and / or a pair of cutting marks M2, is placed on the machine table 10 of the processing device 100. The image collector 20 is configured to collect an image of the workpiece 200 placed on the machine table 10, and the image collected by the image collector 20 can be displayed on the operation interface P1 of the machine table 10.

[0044] After the collected image is displayed on the operation interface P1 of the machine table 10, the processor 50 acquires a display image P3 of the operation interface P1 of the machine table 10. In the display image P3, at least part of the workpiece 200 and the cutter mark line L1 are displayed, and the center mark line C1 in the cutter mark line L1 represents the cutting center line of the cutter 30 in the machining device 100. That is to say, the cutting center of the cutter 30 in the machining device 100 will cut the workpiece 200 along the center mark line C1, that is, when the cutter 30 in the machining device 100 cuts the workpiece 200, the cutting center line of the cutter 30 will coincide with the center mark line C1.

[0045] In the machining method and the machining device 100 of the embodiments of the present application, the display image P3 is used to display the workpiece 200 and the cutter mark line L1, the center mark line C1 in the cutter mark line L1 in the display image P3 is identified, the position of the cutting center line of the workpiece 200 in the display image P3 is acquired, and the center mark line C1 in the display image P3 is moved to coincide with the cutting center line, so as to control the cutter 30 to cut along the cutting center line of the workpiece 200 on the machine table 10, so that the cutter 30 can always cut along the interval between the application units (wafers), avoiding cutting into the application units, and ensuring that the application units are not damaged.

[0046] Please refer to Figure 3 , Figure 4 and Figure 6 In some embodiments, 01: acquiring the display image P3 of the operation interface P1 of the machine table 10 can include:

[0047] 011: taking a screenshot P2 of the operation interface P1 of the machine table 10; and

[0048] 013: taking a region of interest in the screenshot P2 as the display image P3, the region of interest having the workpiece 200 and the cutter mark line L1, and the cutter mark line L1 penetrating the region of interest.

[0049] Please refer to Figure 2 One or more processors 50 are configured to execute the methods in 011 and 013. That is, the one or more processors 50 are configured to: take a screenshot P2 of the operation interface P1 of the machine table 10; and take a region of interest in the screenshot P2 as the display image P3, the region of interest having the workpiece 200 and the cutter mark line L1, and the cutter mark line L1 penetrating the region of interest.

[0050] Specifically, the screenshot P2 includes a region of interest and a region of non-interest, the region of interest contains at least part of the workpiece 200 and the cutter mark line L1, and the cutter mark line L1 penetrates the region of interest. Since only the region of interest containing the workpiece 200 and the cutter mark line L1 in the screenshot P2 is taken as the display image P3, only the region of interest with a smaller area needs to be processed in the subsequent processing process, without the need to process the entire screenshot P2, which can reduce the processing time of the display image P3, thereby improving the processing efficiency. It should be noted that the region of the screenshot P2 other than the region of interest is the region of non-interest.

[0051] After obtaining the display image P3, the processor 50 identifies a center identification line C1 in the cutter mark line L1 in the display image P3. For example, please refer to Figure 5 and Figure 6 In some embodiments, 03: identifying the center identification line C1 in the cutter mark line L1 in the display image P3 can include:

[0052] 031: performing a first binarization processing on the display image P3 to obtain a first binarization image P4;

[0053] 033: counting the number of white pixel points in each row of the first binarization image P4, and the extension direction of the row is the first direction X; and

[0054] 035: taking the row with the maximum number of white pixel points as the position of the center identification line C1.

[0055] Please refer to Figure 2 The one or more processors 50 are configured to perform the methods in 031, 033 and 035. That is, the one or more processors 50 are configured to: perform a first binarization processing on the display image P3 to obtain a first binarization image P4; count the number of white pixel points in each row of the first binarization image P4, and the extension direction of the row is the first direction X; and take the row with the maximum number of white pixel points as the position of the center identification line C1.

[0056] For example, in some embodiments, the center identification line C1 is a solid line extending along the first direction X in the display image P3 and is in a first color. After obtaining the display image P3, the processor 50 performs a first binarization processing on the display image P3 to obtain a first binarization image P4. In this embodiment, the first color is green, and in other embodiments, the first color can be other colors, such as red, blue, yellow, magenta, etc., which are not listed here.

[0057] Specifically, please refer to Figure 6 and Figure 7In some embodiments, 031: performing a first binarization process on the display image P3 to obtain a first binarized image P4, including:

[0058] 0311: separating the multi-color channels in the display image P3 to obtain a plurality of single-color image data;

[0059] 0313: performing a grayscale process on each of the single-color image data to obtain grayscale image data corresponding to each of the single-color image data; and

[0060] 0315: obtaining a new grayscale value for each pixel point according to the grayscale value in the grayscale image data corresponding to the first color image data and the grayscale value in the grayscale image data corresponding to the other color image data, to form the first binarized image P4.

[0061] Please refer to Figure 2 , the one or more processors 50 are configured to perform the methods in 0311, 0313 and 0315. That is, the one or more processors 50 are configured to: separate the multi-color channels in the display image P3 to obtain a plurality of single-color image data; perform a grayscale process on each of the single-color image data to obtain grayscale image data corresponding to each of the single-color image data; and obtain a new grayscale value for each pixel point according to the grayscale value in the grayscale image data corresponding to the first color image data and the grayscale value in the grayscale image data corresponding to the other color image data, to form the first binarized image P4.

[0062] After obtaining the display image P3, the processor 50 separates the multi-color channels in the display image P3 to obtain a plurality of single-color image data. For example, in some embodiments, please refer to Figure 4 and Figure 8 , the processor 50 performs an interpolation process on each pixel in the display image P3 to obtain an interpolated display image P3. In the interpolated display image P3, the first color channel data, the second color channel data and the third color channel data at each pixel point position (it is noted that Figure 8 A+B+C in the above equation does not represent the sum of the first color channel data, the second color channel data and the third color channel data, but represents that the pixel point position includes the first color channel data, the second color channel data and the third color channel data). All the first color channel data are arranged according to the corresponding positions to form the first color image data (as shown in the upper diagram in the middle of Figure 8 ), for example, the first color channel data at the first row and the first column of the interpolated display image P3 is placed at the first row and the first column of the first color image data. Similarly, all the second color channel data are arranged according to the corresponding positions to form the second color image data (as shown in the lower diagram in the middle of Figure 8(As shown in the middle image); arrange all third color channel data according to their corresponding positions to form third color image data ( Figure 8 (As shown in the lower middle figure). It should be noted that in some embodiments, the first color A can be green, the second color B can be red, and the third color C can be blue; of course, other colors can also be used without limitation, and the same applies to the first color A, the second color B, and the third color C mentioned below.

[0063] After obtaining multiple frames of single-color image data (e.g.) Figure 8 The three frames of single-color image data shown in the upper, middle, and lower figures are used to perform grayscale processing on the multiple frames of single-color image data to obtain grayscale image data corresponding to each frame of single-color image data. Then, based on the grayscale values ​​in the grayscale image data corresponding to the first color image data and the grayscale image data corresponding to other color image data, a new grayscale value for each pixel is obtained to form the first binarized image P4.

[0064] For example, please continue reading Figure 8 The first color image data is processed to obtain the first color grayscale image data. Figure 8 As shown in the upper right image); grayscale processing is performed on the second color image data to obtain the second color grayscale image data. Figure 8 (As shown in the middle image on the right); grayscale processing is performed on the third color image data to obtain the third color grayscale image data. Figure 8The new gray value of the pixel point is 255, and the new gray value of the pixel point is arranged in the corresponding position of the first binary image P4, that is, the gray value of the pixel point corresponding to the position in the first binary image is 255; if the ratio of the gray value of the pixel point in the first color gray image data to the gray value of the pixel point in the corresponding position of the second color gray image data is less than the preset value, or the ratio of the gray value of the pixel point in the first color gray image data to the gray value of the pixel point in the corresponding position of the third color gray image data is less than the preset value, the new gray value of the pixel point is 0, and the new gray value of the pixel point is arranged in the corresponding position of the first binary image P4, that is, the gray value of the pixel point corresponding to the position in the first binary image is 0. For example, assuming that the gray value of the pixel point in the second row and the second column of the first color gray image data is m1, the gray value of the pixel point in the second row and the second column of the second color gray image data is m2, the gray value of the pixel point in the second row and the second column of the third color gray image data is m3, and the preset value is k. Wherein, the ratio of m1 and m2 is greater than k, and the ratio of m1 and m3 is also greater than k, the gray value of the pixel point in the second row and the second column of the first binary image P4 is 255, that is, the pixel point in the second row and the second column of the first binary image P4 is a white pixel point. Assuming that the gray value of the pixel point in the second row and the third column of the first color gray image data is n1, the gray value of the pixel point in the second row and the third column of the second color gray image data is n2, the gray value of the pixel point in the second row and the third column of the third color gray image data is n3, and the preset value is k. Wherein, the ratio of n1 and n2 is greater than k, the ratio of n1 and n3 is less than k, the gray value of the pixel point in the second row and the third column of the first binary image P4 is 0, that is, the pixel point in the second row and the third column of the first binary image P4 is a black pixel point. Assuming that the gray value of the pixel point in the second row and the first column of the first color gray image data is q1, the gray value of the pixel point in the second row and the first column of the second color gray image data is q2, the gray value of the pixel point in the second row and the first column of the third color gray image data is q3, and the preset value is k.The ratio of q1 to q2 is less than k, and the ratio of q1 to q3 is also less than k, so the gray value of the pixel point located at the first row and the first column of the second binary image P5 is 0, that is, the pixel point located at the first row and the fourth column of the second binary image P5 is a black pixel point. After obtaining the new gray value of the pixel point, the next pixel point is extracted for the above operation, and all pixel points are traversed in this way until all pixel points are processed, that is, the new gray values corresponding to all pixel points are obtained, and finally the second binary image P5 is obtained.

[0065] Since the center identification line C1 is an extended line along the first direction X and has a solid line with the first color, it can be understood that the gray value of the pixel corresponding to the position of the center identification line C1 in the first color gray image data is the largest. However, since the pixels around the center identification line C1 also have a first color channel data that can be relatively large, that is, the gray value of the pixel corresponding to the position around the center identification line C1 in the first color gray image data can also be relatively large. If only whether the gray value of the pixel in the first gray image data is greater than the preset value is used to judge whether the pixel point is a white pixel point, the pixels around the center identification line C1 are easily misjudged as white pixel points, thereby affecting the accuracy of identifying the center identification line C1. Therefore, in the embodiments of the present application, only the new gray value of the pixel point corresponding to the pixel point whose gray value in the first color gray image data is greater than the preset value and the gray value of the pixel point in the same position in the second color gray image data is also greater than the preset value, and the gray value of the pixel point in the same position in the third color gray image data is also greater than the preset value is set to 255, that is, the pixel point is considered as a white pixel point. In this way, a more accurate center identification line C1 can be obtained, thereby improving the accuracy of the subsequent cutter 30 cutting and avoiding damage to the application unit on the workpiece 200 by the cutter 30.

[0066] It should be noted that in the first binary image P4, if the gray value of a certain pixel point is 255, the pixel point is considered as a white pixel point; in the first binary image P4, if the gray value of a certain pixel point is 0, the pixel point is considered as a black pixel point.

[0067] After obtaining the first binary image P4, the number of white pixel points (i.e. pixel points with a gray value of 255) in each row of the first binary image P4 is counted, the extension direction of the row is the first direction X, and the row with the maximum number of white pixel points is taken as the center identification line C1. For example, assuming that the first binary image P4 has 5 rows, and the first row has 0 white pixel points; the second row has 8 white pixel points; the third row has 20 white pixel points; the fourth row has 8 white pixel points; and the fifth row has 0 white pixel points, the third row is taken as the position of the center identification line C1.

[0068] In some embodiments, the cutter mark line L1 further comprises a first width mark line L11 and a second width mark line L12, which together represent the cutting width of the cutter 30 in the machining device 100 in the second direction Y. That is, when the cutter 30 in the machining device 100 cuts the workpiece 200, the distance between the first width mark line L11 and the second width mark line L12 is the same as the width of the cutter 30 in the second direction Y. The first width mark line L11 and the second width mark line L12 are both dashed lines extending in the first direction X in the display image P3, and are both in the first color. Since the first width mark line L11 and the second width mark line L12 are in the first color in the display image P3 as the center mark line C1, and the first width mark line L11 and the second width mark line L12 are both dashed lines, the first width mark line L11 and the second width mark line L12 can be obtained according to the number of white pixel points in each row in the first binary image P4 and the number of white pixel points in the row where the center mark line C1 is located in the first binary image P4.

[0069] For example, after the center identification line C1 is obtained, the number of white pixel points of the first binary image P4 is counted row by row upward from the center identification line C1, and when the number of white pixel points of a certain row is greater than the product of the number of white pixel points of the row where the center identification line C1 is located and the predetermined ratio, it is considered that the row is the first width mark line L11. Similarly, the number of white pixel points of the first binary image P4 is counted row by row downward from the center identification line C1, and when the number of white pixel points of a certain row is greater than the product of the number of white pixel points of the row where the center identification line C1 is located and the predetermined ratio, it is considered that the row is the second width mark line L12, and the distance from the first width mark line L11 to the center identification line C1 is equal to the distance from the second width mark line L12 to the center identification line C1. For example, assuming that the first binary image P4 has 5 rows, and the 1st row has 0 white pixel points; the 2nd row has 8 white pixel points; the 3rd row has 20 white pixel points; the 4th row has 8 white pixel points; and the 5th row has 0 white pixel points, and the preset ratio is 1 / 4. At this time, the 3rd row with the most white pixel points is taken as the center identification line C1, and the product of the maximum number 20 and the preset ratio 1 / 4 is 5. The number of white pixel points of the first binary image P4 is counted row by row upward from the 3rd row where the center identification line C1 is located, and since the number of white pixel points of the 2nd row is greater than the product of the number of white pixel points of the row where the center identification line C1 is located and the predetermined ratio, i.e., the number of white pixel points of the 2nd row is greater than 5, the 2nd row is taken as the first width mark line L11. The number of white pixel points of the first binary image P4 is counted row by row downward from the 3rd row where the center identification line C1 is located, and since the number of white pixel points of the 4th row is greater than the product of the number of white pixel points of the row where the center identification line C1 is located and the predetermined ratio, i.e., the number of white pixel points of the 4th row is greater than 5, the 4th row is taken as the second width mark line L12.

[0070] Please refer to Figure 4 , Figure 9 and Figure 10 In some embodiments, 05: obtaining the position of the cutting center line of the workpiece 200 in the display image P3, comprising:

[0071] 051: obtaining the position of the cutting groove M1 and / or the cutting mark M2 of the workpiece 200 in the display image P3; and

[0072] 053: taking the center line position of the cutting groove M1 or the center line position of the cutting mark M2 as the position of the cutting center line of the workpiece 200 in the display image P3.

[0073] Please refer to Figure 2, the one or more processors 50 are configured to perform the method of 051 and 053. That is, the one or more processors 50 are configured to: acquire the position of the kerf M1 and / or the scar M2 of the workpiece 200 in the display image P3; and take the center line position of the kerf M1 or the center line position of the scar M2 as the position of the cutting center line of the workpiece 200 in the display image P3.

[0074] In particular, referring to Figure 10 In one example, after acquiring the position of the kerf M1 of the workpiece 200 in the display image P3, the center line position of the kerf M1 can be taken as the position of the cutting center line of the workpiece 200 in the display image P3. In another example, after acquiring the position of the scar M2 of the workpiece 200 in the display image P3, the center line position of the scar M2 can be taken as the position of the cutting center line of the workpiece 200 in the display image P3. In yet another example, after acquiring the position of the kerf M1 and the position of the scar M2 of the workpiece 200 in the display image P3, the center line position of the kerf M1 coincides with the center line position of the scar M2, and the coincided position (both the center line position of the kerf M1 and the center line position of the scar M2) can be taken as the position of the cutting center line of the workpiece 200 in the display image P3.

[0075] More particularly, referring to Figures 11 to 13 In some embodiments, 051: acquiring the position of the kerf M1 and / or the scar M2 of the workpiece 200 in the display image P3, comprises:

[0076] 0511: performing a second binarization processing on the display image P3 to obtain a second binarization image P5;

[0077] 0512: obtaining a binary matrix I according to the number of white pixel points in each row of the second binarization image P5 and a preset threshold, the binary matrix I comprising n*1 elements, where n is the number of rows of pixel points in the second binarization image P5;

[0078] 0513: in the binary matrix I, if the current row element value is less than the next row element value, the current row is taken as a first candidate row; if the current row element value is greater than the next row element value, the current row is taken as a second candidate row;

[0079] 0514: performing a first pairing step on each first candidate row, the first pairing step comprising: taking the selected first candidate row as a first to-be-paired row, selecting a second candidate row located on the first side of the first to-be-paired row from a plurality of second candidate rows as a second to-be-paired row, and taking the first to-be-paired row and each corresponding second to-be-paired row as a first to-be-tested dotted line pair;

[0080] 0515: performing a second pairing step on each of the second candidate lines, the second pairing step comprising: taking the selected second candidate line as a third to-be-paired line, taking a first candidate line located on the first side of the third to-be-paired line from the plurality of first candidate lines as a fourth to-be-paired line, and taking the third to-be-paired line and each corresponding fourth to-be-paired line as a second to-be-tested dotted line pair;

[0081] 0516: obtaining a first center line between each first to-be-tested dotted line pair and a second center line between each second to-be-tested dotted line pair;

[0082] 0517: calculating a distance difference between each first center line and all second center lines, taking a first to-be-tested dotted line corresponding to a first center line with the smallest difference value as a first dotted line pair, and taking a second to-be-tested dotted line corresponding to a second center line with the smallest difference value as a second dotted line pair; and

[0083] 0518: taking one of the positions of the first dotted line pair and the second dotted line pair as the position of the cutting trace M1 of the workpiece 200, and taking the other as the position of the cutting mark M2 of the workpiece 200.

[0084] Please refer to Figure 2, the one or more processors 50 are configured to perform the method in 0511, 0512, 0513, 0514, 0515, 0516, 0517, 0518. Namely, the one or more processors 50 are configured to: perform a second binarization process on the display image P3 to obtain a second binarized image P5; obtain a binary matrix I according to a number of white pixel points in each row of the second binarized image P5 and a preset threshold, the binary matrix I including n*1 elements, where n is a number of rows of pixel points in the second binarized image P5; in the binary matrix I, if a current row element value is less than a next row element value, the current row is taken as a first candidate row; if the current row element value is greater than the next row element value, the current row is taken as a second candidate row; perform a first pairing step on each first candidate row, the first pairing step including: taking a selected first candidate row as a first to-be-paired row, selecting a second candidate row located on a first side of the first to-be-paired row from a plurality of second candidate rows as a second to-be-paired row, and taking the first to-be-paired row and each corresponding second to-be-paired row as a first to-be-tested dotted line pair; perform a second pairing step on each second candidate row, the second pairing step including: taking a selected second candidate row as a third to-be-paired row, selecting a first candidate row located on a first side of the third to-be-paired row from a plurality of first candidate rows as a fourth to-be-paired row, and taking the third to-be-paired row and each corresponding fourth to-be-paired row as a second to-be-tested dotted line pair; obtaining a first center line between each first to-be-tested dotted line pair and a second center line between each second to-be-tested dotted line pair; calculating a distance difference value between each first center line and all second center lines, selecting a first to-be-tested dotted line corresponding to a first center line with a minimum difference value as a first dotted line pair, and selecting a second to-be-tested dotted line corresponding to a second center line with a minimum difference value as a second dotted line pair; and taking one of a position of the first dotted line pair and a position of the second dotted line pair as a position of a cutting trace M1 of the workpiece 200, and taking the other as a position of a cutting mark M2 of the workpiece 200.

[0085] The processor 50 performs a second binarization process on the display image P3 to obtain a second binarization image P5. First, the processor 50 separates the multi-color channels in the display image P3 to obtain a plurality of single-color image data. The specific implementation of obtaining the plurality of single-color image data is the same as the specific implementation of obtaining the plurality of single-color image data in the above-mentioned embodiment, and is not repeated here. After obtaining the plurality of single-color image data, that is, after obtaining the first color image data, the second color image data and the third color image data, the image data corresponding to the colors different from the color of the center identification line C1 presented in the display image P3 is processed in grayscale. For example, if the center identification line C1 is in the first color in the display image P3, the second color image is processed in grayscale to obtain second color grayscale image data. The gray value of each pixel point in the second color grayscale image data is obtained, and if the gray value of a certain pixel point is greater than a preset gray value, the new gray value of the pixel point is 255, and the new gray value of the pixel point is arranged in the corresponding position of the second binarization image P5 to obtain the second binarization image P5. Of course, the third color image data can also be processed in grayscale to obtain third color grayscale image data, and then the second binarization image P5 can be obtained according to the gray value of the pixel point in the third color grayscale image data and the preset gray value, which is not repeated here.

[0086] It should be noted that in some embodiments, the first color is green, the second color is blue, the third color is red, and the center identification line is green in the display image P3. Then the second color image data (i.e. blue) is processed in grayscale to obtain second color grayscale image data, and then the second binarization image P5 is obtained according to the gray value of the pixel point in the second color grayscale image data and the preset gray value. Since the influence of the green channel data on the blue channel data is smaller than the influence of the green channel data on the red channel data, the second binarization image P5 is obtained according to the blue image data, which can more effectively avoid the influence of the green center identification line C1, thereby facilitating the subsequent obtaining of the position of the cutting trace M1 and / or the cutting mark M2 of the workpiece 200 in the display image P3 according to the second binarization image P5.

[0087] After obtaining the second binarization image P5, a binary matrix I is obtained according to the number of white pixel points in each row of the second binarization image P5 and a preset threshold. The binary matrix I includes n*1 elements, where n is the number of rows of pixel points in the second binarization image P5.

[0088] Specifically, please refer to Figure 11 and Figure 14 In some embodiments, 0512: obtaining a binary matrix I according to the number of white pixel points in each row of the second binarization image P5 and a preset threshold, including:

[0089] 05121: counting the number of white pixel points in each row of the second binarized image P5 row by row, taking the first direction X of the second binarized image P5 as the row and the second direction Y of the second binarized image P5 as the column, and arranging the number of white pixel points of all rows in the order along the column to form a number matrix, the first direction X being perpendicular to the second direction Y; and

[0090] 05123: traversing the number in the number matrix row by row, if the number of the current row is greater than a preset threshold, the corresponding row element in the binary matrix I is a first value; if the number of the current row is less than the preset threshold, the corresponding row element in the binary matrix I is a second value.

[0091] Please refer to Figure 2 , the one or more processors 50 are configured to perform the method in 05121 and 05123. That is, the one or more processors 50 are configured to: count the number of white pixel points in each row of the second binarized image P5 row by row, taking the first direction X of the second binarized image P5 as the row and the second direction Y of the second binarized image P5 as the column, and arranging the number of white pixel points of all rows in the order along the column to form a number matrix, the first direction X being perpendicular to the second direction Y; and traverse the number in the number matrix row by row, if the number of the current row is greater than a preset threshold, the corresponding row element in the binary matrix I is a first value; if the number of the current row is less than the preset threshold, the corresponding row element in the binary matrix I is a second value.

[0092] After obtaining the second binarized image P5, the number of white pixel points in each row of the second binarized image P5 is counted row by row, taking the first direction X of the second binarized image P5 as the row and the second direction Y of the second binarized image P5 as the column, and arranging the number of white pixel points of all rows in the order along the column to form a number matrix, the first direction X being perpendicular to the second direction Y. Traverse the number in the number matrix row by row, if the number of the current row is greater than a preset threshold, the corresponding row element in the binary matrix I is a first value; if the number of the current row is less than the preset threshold, the corresponding row element in the binary matrix I is a second value.

[0093] For example, in some embodiments, the first value can be 255, and the second value can be 0. For instance, if the number of white pixels in a row is less than a preset threshold, the value of the element corresponding to that row in the binary matrix I is 0; if the number of white pixels in a row is greater than the preset threshold, the value of the element corresponding to that row in the binary matrix I is 255. For example, suppose the second binarized image P5 includes 5 rows of pixels: the first row has 18 white pixels; the second row has 20 white pixels; the third row has 2 white pixels; the fourth row has 24 white pixels; and the fifth row has 10 white pixels, with a preset threshold of 15. Then the binary matrix I includes 5*1 elements, with the first row having a value of 0, the second row having a value of 255, the third row having a value of 0, the fourth row having a value of 255, and the fifth row having a value of 0. It should be noted that in some embodiments, if the number of white pixels in a row is equal to a preset threshold, the value of the element corresponding to that row in the binary matrix I can be 0 or 255, and no restriction is imposed here.

[0094] In a binary matrix I, if the value of an element in the current row is less than the value of an element in the next row, then the current row is selected as the first candidate row; if the value of an element in the current row is greater than the value of an element in the next row, then the current row is selected as the second candidate row. For example... Figure 13 As shown, assuming the second binarized image P5 has 15 rows, the binary matrix I includes 15*1 elements, with the elements in the first row being 0, the second row being 255, the third row being 255, the fourth row being 0, the fifth row being 0, the sixth row being 255, the seventh row being 255, the eighth row being 0, the ninth row being 0, the tenth row being 0, the eleventh row being 255, the twelfth row being 255, the thirteenth row being 0, the fourteenth row being 0, and the fifteenth row being 255. Since the element value in row 1 is less than the element value in row 2; the element value in row 5 is less than the element value in row 6; the element value in row 10 is less than the element value in row 11; and the element value in row 14 is less than the element value in row 15, rows 1, 5, 10, and 14 are all selected as the first candidate rows. Since the element value in row 3 is greater than the element value in row 4; the element value in row 7 is greater than the element value in row 8; and the element value in row 12 is greater than the element value in row 13, rows 3, 7, and 12 are all selected as the second candidate rows.

[0095] After the first candidate row and the second candidate row are obtained, the first pairing step is performed on each first candidate row. The selected first candidate row is taken as a first to-be-paired row, the second candidate row located on the first side of the first to-be-paired row is taken as a second to-be-paired row, and the first to-be-paired row and each corresponding second to-be-paired row are taken as a first to-be-tested virtual line pair. The second pairing step is performed on each second candidate row, and the second pairing step includes: the selected second candidate row is taken as a third to-be-paired row, the first candidate row located on the first side of the third to-be-paired row is taken as a fourth to-be-paired row, and the third to-be-paired row and each corresponding fourth to-be-paired row are taken as a second to-be-tested virtual line pair.

[0096] It is assumed that the first candidate row includes the 1st row, the 5th row, the 10th row and the 14th row, and the second candidate row includes the 3rd row, the 7th row and the 12th row. In some embodiments, the first side of the first to-be-paired row represents the row arranged below the first to-be-paired row. It should be noted that in the embodiments of the present application, the row with a larger value is arranged below the row with a smaller value, for example, the 5th row and the 8th row are both below the 2nd row. The following takes the 1st row in the first candidate row as the first to-be-paired row to perform the first pairing step as an example. Since the 3rd row, the 7th row and the 12th row in the second candidate row are all below the 1st row, that is, the 3rd row, the 7th row and the 12th row in the second candidate row are all on the first side of the 1st row, the 3rd row, the 7th row and the 12th row can all be taken as the second to-be-paired row corresponding to the 1st row, and the 1st row and the 3rd row, the 1st row and the 7th row, and the 1st row and the 12th row are taken as the first to-be-tested virtual line pair, respectively. That is, the 1st row and the 3rd row form a first to-be-tested virtual line pair, the 1st row and the 7th row form a first to-be-tested virtual line pair, and the 1st row and the 12th row form a first to-be-tested virtual line pair. Thus, the first pairing step performed on the 1st row is completed, and then the 5th row, the 10th row and the 14th row are taken as the first to-be-paired row, and the above first pairing step is repeatedly performed to obtain the 5th row and the 7th row as a first to-be-tested virtual line pair, the 5th row and the 12th row as a first to-be-tested virtual line pair, and the 10th row and the 12th row as a first to-be-tested virtual line pair. The specific process is not described herein.

[0097] Assume the first candidate rows include rows 1, 5, 10, and 14, and the second candidate rows include rows 3, 7, and 12. In some embodiments, the first side of the third pairing row represents the rows arranged below the third pairing row. It should be noted that in this embodiment, rows with larger values ​​are arranged below rows with smaller values; for example, rows 5 and 8 are both below row 2. The following explanation uses the selection of row 3 from the second candidate rows as the third pairing row to illustrate the second pairing step. Since rows 5, 10, and 14 from the first candidate rows are all below row 3, i.e., rows 5, 10, and 14 from the first candidate rows are all on the first side of row 3, rows 5, 10, and 14 can all be used as the fourth pairing row corresponding to row 3, and row 3 is paired with rows 5, 10, and 14 as the second test dotted line pairs. That is, rows 3 and 5 are considered as a second pair of dotted lines to be tested; rows 3 and 10 are considered as a second pair of dotted lines to be tested; and rows 3 and 14 are considered as a second pair of dotted lines to be tested. This completes the second pairing step performed on row 3. Then, rows 7 and 12 are considered as the third pairing rows, and the above second pairing step is repeated to obtain rows 7 and 10 as a second pair of dotted lines to be tested; rows 7 and 14 as a second pair of dotted lines to be tested; and rows 12 and 14 as a second pair of dotted lines to be tested. The specific process is not described in detail.

[0098] like Figure 12 As shown, in the second binarized image, the black and white differences on both sides of the location of the tangent M1 and / or the cut M2 are large. By counting the number of white pixels in each row and the black and white abrupt changes between adjacent rows, it is possible to find all the first and second pairs of dashed lines that may be the location of the tangent M1 and / or the cut M2.

[0099] Subsequently, a first center line between each first to-be-tested dotted line pair and a second center line between each second to-be-tested dotted line pair are obtained, and a distance difference between each first center line and all second center lines is calculated, a first to-be-tested dotted line corresponding to a first center line with a minimum distance difference is selected as a first dotted line pair, and a second to-be-tested dotted line corresponding to a second center line with a minimum distance difference is selected as a second dotted line pair. For example, assuming that there are a first center line a1, a first center line a2, a first center line a3, a second center line b1, and a second center line b2, a distance between the first center line a1 and the second center line b1, a distance between the first center line a1 and the second center line b2, a distance between the first center line a2 and the second center line b1, a distance between the first center line a2 and the second center line b2, a distance between the first center line a3 and the second center line b1, and a distance between the first center line a3 and the second center line b2 are calculated, and assuming that the distance between the first center line a1 and the second center line b1 is the smallest, the first to-be-tested dotted line corresponding to the first center line a1 is selected as the first dotted line pair, and the second to-be-tested dotted line corresponding to the second center line b1 is selected as the second dotted line pair. The first dotted line pair and the second dotted line pair are identified as the cutting path M1 and / or the cutting mark M2. Since the center positions of the pairs of cutting paths M1 and the pairs of cutting marks M2 almost coincide, in a plurality of pairs of first to-be-tested dotted line pairs and second to-be-tested dotted line pairs, a first to-be-tested dotted line pair with a minimum distance difference between a first center line of the first to-be-tested dotted line pair and a second center line of a second to-be-tested dotted line pair is searched for as the first to-be-tested dotted line pair and the second to-be-tested dotted line pair as the cutting path M1 and / or the cutting mark M2, which is beneficial to obtaining the accurate positions of the cutting path M1 and / or the cutting mark M2. It should be noted that, as shown in Figure 12 the width of the cutting mark M2 is greater than the width of the cutting path M1, in some embodiments, a dotted line pair with a larger interval in the first dotted line pair and the second dotted line pair is identified as the cutting mark M2, and a dotted line pair with a smaller interval is identified as the cutting path M1.

[0100] In some embodiments, the second binary image P5 is divided into three equal-interval intervals along the second direction Y, if a certain first center line is not in the middle region of the second binary image P5, it is directly considered that the first to-be-tested dotted line pair corresponding to the first center line is not likely to be the cutting path M1 and / or the cutting mark M2, which can be directly excluded, that is, there is no need to calculate the distance between the first center line and the remaining second center lines; similarly, if a certain second center line is not in the middle region of the second binary image P5, it is directly considered that the second to-be-tested dotted line pair corresponding to the second center line is not likely to be the cutting path M1 and / or the cutting mark M2, which can be directly excluded, that is, there is no need to calculate the distance between the second center line and the remaining first center lines, which can improve the processing speed.

[0101] Please refer to Figure 15In some embodiments, 07: moving the center marker line C1 in the display image P3 so that the center marker line C1 coincides with the cutting center line may include:

[0102] 071: Obtain the deviation between the center marker line C1 and the cutting center line of workpiece 200 in the displayed image P3; and

[0103] 073: Based on the user input, control the center marker line C1 to compensate for the deviation, so that the center marker line C1 coincides with the cutting center line.

[0104] Please combine Figure 2 One or more processors 50 are used to execute the methods in 071 and 073. That is, one or more processors 50 are used to: obtain the deviation between the center marker line C1 and the cutting center line of the workpiece 200 in the display image P3; and control the center marker line C1 to compensate for the deviation according to user input so that the center marker line C1 coincides with the cutting center line.

[0105] After acquiring the center marker line C1 in the display image P3 and the cutting center line of the workpiece 200 in the display image P3, the deviation between the center marker line C1 and the cutting center line can be obtained first. The deviation can be obtained by the processor 50 using a ruler measurement. The deviation can be a vector, that is, the deviation includes the deviation direction and the deviation value. After obtaining the deviation, the processor 50 can control the center marker line C1 to compensate for the deviation according to the user input, so that the center marker line C1 coincides with the cutting center line. Specifically, the user input can be clicking any position in the display unit 40, and the center marker line C1 will automatically jump to the position that coincides with the cutting center line. Correspondingly, the cutter 30 can be aligned with the cutting center line of the workpiece 200. At this time, the cutter 30 can cut along the interval between the application units (wafers), so as not to cut the application units and ensure that the application units are not damaged.

[0106] To further prevent the cutter 30 from cutting the application unit, in some embodiments, the processing method further includes: identifying paired cuts M1 and / or paired cut marks M2 of the workpiece 200 in the display image P3; and moving the first width marker line L11 and the second width marker line L12 between the paired cuts M1, or moving the first width marker line L11 and the second width marker line L12 between the paired cut marks M2. Thus, the width of the cutter 30 is less than or equal to the cut M1, or the width of the cutter 30 is less than or equal to the cut mark M2, which can prevent the cutter 30 from contacting the application unit during the cutting process, thereby further ensuring that the application unit is not damaged. It should be noted that in any of the above embodiments, the cutter 30 can be a high-energy light beam, such as using a laser to cut the workpiece 200, and this is not limited thereto.

[0107] Please see Figure 16The embodiments of the present application further provide a non-transitory computer readable storage medium 300 containing a computer program which, when executed by one or more processors 50, causes the processors 50 to perform the processing method of any of the above embodiments.

[0108] For example, the computer program, when executed by one or more processors 50, causes the one or more processors 50 to perform the following processing method:

[0109] 01: Obtain a display image P3 of an operation interface P1 of a machine table 10, the display image P3 showing at least part of a workpiece 200 and a cutter mark line L1, the cutter mark line L1 representing a cutting center line of a cutter 30;

[0110] 03: Identify a center identification line C1 in the cutter mark line L1 in the display image P3;

[0111] 05: Obtain a position of the cutting center line of the workpiece 200 in the display image P3; and

[0112] 07: Move the center identification line C1 in the display image P3 so that the center identification line C1 coincides with the cutting center line, to control the cutting center line of the cutter 30 to coincide with the cutting center line of the workpiece 200 on the machine table 10.

[0113] For another example, the computer program, when executed by one or more processors 50, causes the one or more processors 50 to perform the following processing method:

[0114] 011: Take a screenshot P2 of the operation interface P1 of the machine table 10; and

[0115] 013: Take an area of interest in the screenshot P2 as the display image P3, the area of interest having the workpiece 200 and the cutter mark line L1, the cutter mark line L1 penetrating through the area of interest.

[0116] For another example, the computer program, when executed by one or more processors 50, causes the one or more processors 50 to perform the following processing method:

[0117] 031: Perform a first binarization processing on the display image P3 to obtain a first binarization image P4;

[0118] 033: Count the number of white pixel points in each row of the first binarization image P4, the extension direction of the row being a first direction X; and

[0119] 035: Take the row having the maximum number of white pixel points as the position of the center identification line C1.

[0120] For another example, the computer program, when executed by one or more processors 50, causes the one or more processors 50 to perform the following processing method:

[0121] 0311: separating the multi-color channels in the display image P3 to obtain a plurality of single-color image data;

[0122] 0313: performing a grayscale processing on each of the single-color image data to obtain grayscale image data corresponding to each of the single-color image data; and

[0123] 0315: obtaining a new grayscale value for each pixel point according to a grayscale value in the grayscale image data corresponding to the first color image data and a grayscale value in the grayscale image data corresponding to the other color image data to form a first binary image P4.

[0124] For example, when the computer program is executed by the one or more processors 50, the one or more processors 50 are caused to perform the following processing method:

[0125] 051: obtaining a position of the cutting trace M1 and / or the cutting mark M2 of the workpiece 200 in the display image P3; and

[0126] 053: taking the center line position of the cutting trace M1 or the center line position of the cutting mark M2 as the position of the cutting center line of the workpiece 200 in the display image P3.

[0127] For example, when the computer program is executed by the one or more processors 50, the one or more processors 50 are caused to perform the following processing method:

[0128] 0511: performing a second binary processing on the display image P3 to obtain a second binary image P5;

[0129] 0512: obtaining a binary matrix I according to a number of white pixel points in each row in the second binary image P5 and a preset threshold value, the binary matrix I including n*1 elements, where n is a number of rows of pixel points in the second binary image P5;

[0130] 0513: in the binary matrix I, if a current row element value is less than a next row element value, taking the current row as a first candidate row; if the current row element value is greater than the next row element value, taking the current row as a second candidate row;

[0131] 0514: performing a first pairing step on each of the first candidate rows, the first pairing step including: taking a selected first candidate row as a first to-be-paired row, selecting a second candidate row located on a first side of the first to-be-paired row as a second to-be-paired row from a plurality of second candidate rows, and taking the first to-be-paired row and each of the corresponding second to-be-paired rows as a first to-be-tested dotted line pair;

[0132] 0515: performing a second pairing step on each of the second candidate lines, the second pairing step comprising: taking the second candidate line as a third to-be-paired line, taking a first candidate line located on a first side of the third to-be-paired line as a fourth to-be-paired line from the plurality of first candidate lines, and taking the third to-be-paired line and each corresponding fourth to-be-paired line as a second to-be-tested virtual line pair;

[0133] 0516: obtaining a first center line between each of the first to-be-tested virtual line pairs and a second center line between each of the second to-be-tested virtual line pairs;

[0134] 0517: calculating a distance difference between each of the first center lines and all of the second center lines, taking a first to-be-tested virtual line corresponding to a first center line with a minimum distance difference as a first virtual line, and taking a second to-be-tested virtual line corresponding to a second center line with a minimum distance difference as a second virtual line; and

[0135] 0518: taking one of a position of the first virtual line and a position of the second virtual line as a position of the cutting trace M1 of the workpiece 200, and taking the other as a position of the cutting mark M2 of the workpiece 200.

[0136] For example, when the computer program is executed by the one or more processors 50, the one or more processors 50 perform the following processing method:

[0137] 05121: taking a first direction X of the second binary image P5 as a row and a second direction Y of the second binary image P5 as a column, counting a number of white pixel points in each row, and arranging the numbers of white pixel points in all rows in a column order to form a number matrix, the first direction X being perpendicular to the second direction Y; and

[0138] 05123: traversing the numbers in the number matrix row by row, if a current row number is greater than a preset threshold, taking a first value as a corresponding row element in the binary matrix I; if the current row number is less than the preset threshold, taking a second value as the corresponding row element in the binary matrix I.

[0139] For example, when the computer program is executed by the one or more processors 50, the one or more processors 50 perform the following processing method:

[0140] 071: obtaining a deviation between the center identification line C1 and a cutting center line of the workpiece 200 in the display image P3; and

[0141] 073: compensating for the deviation of the center identification line C1 according to a user input control, so that the center identification line C1 coincides with the cutting center line.

[0142] In the description of the specification, the description of the terms "one embodiment", "some embodiments", "exemplary embodiment", "example", "specific example" or "some examples" etc. means that the specific features, structures, materials or characteristics described in connection with the embodiment or example are included in at least one embodiment or example of the present application. In the specification, the exemplary description of the above terms does not necessarily refer to the same embodiment or example. Also, the specific features, structures, materials or characteristics described can be combined in any one or more embodiments or examples in an appropriate manner. In addition, the person skilled in the art can combine and combine the different embodiments or examples described in the specification and the features of the different embodiments or examples without contradiction.

[0143] Any process or method descriptions or descriptions of the flow diagrams in the flow charts described herein or otherwise described in this specification can be understood as representing code modules, segments, or portions of code which include one or more executable instructions for performing specific logic functions or steps in the process, and that the various embodiments of the application include the use of one or more of these code modules, segments or portions of code. The computer-readable media can include the same or different computer-readable media for each code module, segment, or portion of code. The processes described can be implemented in a computer program product tangibly embodied in a machine-readable storage medium (e.g., a non-transitory machine-readable storage medium) including instructions that can be executed by a processing unit or processor. The computer-readable media can include computer program code.

[0144] Although the embodiments of the present application have been shown and described above, it is understood that the above-described embodiments are exemplary, and should not be construed as limiting the present application, and those skilled in the art can make changes, modifications, replacements and variations to the above-described embodiments within the scope of the present application.

Claims

1. A method of processing, characterized by, The method comprises: acquiring a display image of an operation interface of a machine, the display image displaying at least part of a workpiece and a cutter mark line, a center mark line in the cutter mark line representing a cutting center line of a cutter; identifying the center mark line in the cutter mark line in the display image; acquiring a position of the cutting center line of the workpiece in the display image; and moving the center mark line in the display image so that the center mark line coincides with the cutting center line to control the cutting center line of the cutter to coincide with the cutting center line of the workpiece on the machine; wherein the identifying the center mark line in the cutter mark line in the display image comprises: performing first binarization processing on the display image to obtain a first binarization image; counting the number of white pixel points in each row of the first binarization image; and taking the row with the maximum number of white pixel points as the position of the center mark line; wherein the center mark line is in a first color, and the first binarization processing on the display image comprises: separating multiple color channels in the display image to obtain multiple frames of single-color image data, the multiple frames of single-color image data comprising first color image data, second color image data and third color image data; performing grayscale processing on each frame of single-color image data to obtain grayscale image data corresponding to each frame of single-color image data; and obtaining a new grayscale value of each pixel point according to the grayscale value in the grayscale image data corresponding to the first color image data and the grayscale values in the grayscale image data corresponding to other color image data to form the first binarization image; wherein the grayscale processing on each frame of single-color image data to obtain grayscale image data corresponding to each frame of single-color image data comprises: performing grayscale processing on the first color image data, the second color image data and the third color image data respectively to obtain first color grayscale image data, second color grayscale image data and third color grayscale image data; wherein the obtaining of the new grayscale value of each pixel point according to the grayscale value in the grayscale image data corresponding to the first color image data and the grayscale values in the grayscale image data corresponding to other color image data to form the first binarization image comprises: in a case where the ratio of the grayscale value of a pixel point in the first color grayscale image data to the grayscale value of a corresponding pixel point in the second color grayscale image data is greater than a preset value, and the ratio of the grayscale value of the pixel point in the first color grayscale image data to the grayscale value of a corresponding pixel point in the third color grayscale image data is greater than the preset value, setting the new grayscale value of the pixel point to 255; in a case where the ratio of the grayscale value of a pixel point in the first color grayscale image data to the grayscale value of a corresponding pixel point in the second color grayscale image data is less than the preset value, or the ratio of the grayscale value of the pixel point in the first color grayscale image data to the grayscale value of a corresponding pixel point in the third color grayscale image data is less than the preset value, setting the new grayscale value of the pixel point to 0. ​ According to a corresponding position of each pixel point in the first color gray image, new gray values of the pixel points are arranged to form the first binary image.

2. The method of claim 1 wherein, The display image of the operation interface of the machine is obtained, including: capturing the operation interface of the machine; and an area of interest in the captured image is intercepted as the display image, the area of interest having the workpiece and the cutter mark line, and the cutter mark line penetrating through the area of interest.

3. The method of claim 1 wherein, The position of the cutting center line of the workpiece in the display image is obtained, including: the position of the cutting path and / or the cutting mark of the workpiece in the display image is obtained; and the center line position of the cutting path or the center line position of the cutting mark is taken as the position of the cutting center line of the workpiece in the display image.

4. The method of claim 3, wherein The position of the cutting path and / or the cutting mark of the workpiece in the display image is obtained, including: the display image is subjected to a second binaryzation process to obtain a second binary image; a binary matrix is obtained according to the number of white pixel points in each row of the second binary image and a preset threshold value, the binary matrix including n*1 elements, where n is the number of rows of pixel points in the second binary image; in the binary matrix, if a current row element value is less than a next row element value, the current row is taken as a first candidate row; if the current row element value is greater than the next row element value, the current row is taken as a second candidate row; a first pairing step is performed on each first candidate row, the first pairing step including: taking a selected first candidate row as a first to-be-paired row, selecting a second candidate row located on a first side of the first to-be-paired row from a plurality of second candidate rows as a second to-be-paired row, and taking the first to-be-paired row and each corresponding second to-be-paired row as a first to-be-tested dotted line pair; a second pairing step is performed on each second candidate row, the second pairing step including: taking a selected second candidate row as a third to-be-paired row, selecting a first candidate row located on a first side of the third to-be-paired row from a plurality of first candidate rows as a fourth to-be-paired row, and taking the third to-be-paired row and each corresponding fourth to-be-paired row as a second to-be-tested dotted line pair; a first center line between each first to-be-tested dotted line pair and a second center line between each second to-be-tested dotted line pair are obtained; a distance difference value between each first center line and all second center lines is calculated, a first to-be-tested dotted line corresponding to a first center line with a minimum difference value is selected as a first dotted line pair, and a second to-be-tested dotted line corresponding to a second center line with a minimum difference value is selected as a second dotted line pair; and one of the position of the first dotted line pair and the position of the second dotted line pair is taken as the position of the cutting path of the workpiece, and the other is taken as the position of the cutting mark of the workpiece.

5. The method of claim 4, wherein, The binary matrix is obtained according to the number of white pixel points in each row of the second binary image and a preset threshold value, including: counting the number of white pixel points in each row of the second binary image in a first direction as rows and in a second direction as columns, the first direction being perpendicular to the second direction, and arranging the numbers of white pixel points in all rows in order along the columns to form a number matrix; traversing the numbers in the number matrix row by row, if the number in a current row is greater than a preset threshold, setting a corresponding row element in the binary matrix to a first value, and if the number in the current row is less than the preset threshold, setting the corresponding row element in the binary matrix to a second value.

6. The method of claim 1 wherein, The moving the center mark line in the display image to coincide with the cutting center line includes: obtaining a deviation between the center mark line and a cutting center line of the workpiece in the display image; and controlling the center mark line to compensate for the deviation according to a user input, so as to coincide the center mark line with the cutting center line.

7. A processing device, characterized by comprise: a machine table; an image collector configured to collect an image of a workpiece; a cutting tool mounted on the machine table and configured to cut the workpiece; a display unit configured to display an operation interface of the machine table, and the image collected by the image collector can be displayed on the operation interface of the machine table; and one or more processors configured to perform the processing method of any one of claims 1-6.

8. A non-volatile computer-readable storage medium containing a computer program, which, when executed by one or more processors, causes the processors to perform the processing method of any one of claims 1-6.

Images