Layered positioning method and device of display panel, equipment and storage medium

Abstract

The invention discloses a layering positioning method, device and equipment for a display panel and a storage medium, and relates to the technical field of automatic optical detection of the display panel, and the layering positioning method for the display panel comprises the steps: positioning a target region of an image, and carrying out the black-cap operation of the target region to obtain a black-cap image; counting the number of pixels projected by the black-cap image to obtain a black-cap projection curve; and calculating a gradient curve of the black cap projection curve, and determining hierarchical information of the image according to extreme value coordinates in the gradient curve. Layered positioning of the concave detection area can be quickly realized, and the stability and the precision are relatively high.

Description

Technical Field

[0001] This application relates to the technical field of automatic optical inspection of display panels, and specifically relates to a hierarchical positioning method, device, equipment and storage medium for a display panel. Background Art

[0002] AOI (Automated Optical Inspection) of a display panel is a process of automatically detecting defects of the display panel using high-tech imaging technology, and this process is crucial for ensuring the quality of the display panel.

[0003] During the automatic optical inspection process of LCD / OLED display panels, structural analysis of the target detection area is usually involved. When it comes to the structural positioning of the system concave area, the commonly used positioning methods are edge extraction and line detection, and the boundary of the target detection area is determined by fitting the edge lines. However, this method has weak anti-interference ability, and abnormal situations such as irregular shapes of the edge area, large proportions of protrusions or depressions need to be preprocessed and filtered. Summary of the Invention

[0004] This application provides a hierarchical positioning method, device, equipment and storage medium for a display panel, which can quickly realize the hierarchical positioning of the concave detection area, and has high stability and accuracy.

[0005] In a first aspect, an embodiment of this application provides a hierarchical positioning method for a display panel, and the hierarchical positioning method for the display panel includes:

[0006] Locate the target area of the image, and perform a black hat operation on the target area to obtain a black hat image;

[0007] Count the number of pixels in the projection of the black hat image to obtain a black hat projection curve;

[0008] Calculate the gradient curve of the black hat projection curve, and determine the hierarchical information of the image according to the maximum and minimum coordinate values in the gradient curve.

[0009] In combination with the first aspect, in an implementation manner, the performing a black hat operation on the target area to obtain a black hat image includes:

[0010] Set an auxiliary line above or below the target area;

[0011] Starting from the auxiliary line, perform a black hat operation along the vertical direction of the image downward or upward until reaching the last layer to be analyzed beyond the target area to obtain a black hat image.

[0012] In combination with the first aspect, in an implementation manner, the target area of the image is located by means of threshold segmentation.

[0013] In combination with the first aspect, in one implementation, the step of obtaining the black hat projection curve by counting the number of pixels in the black hat map projection includes:

[0014] Rotate the black hat map by 90°, count the number of pixels in the vertical projection of the rotated black hat map, and obtain the black hat projection curve.

[0015] In combination with the first aspect, in one implementation, the step of calculating the gradient curve of the black hat projection curve and determining the hierarchical information of the image according to the maximum and minimum coordinate values in the gradient curve includes:

[0016] Derive the black hat projection curve to obtain the gradient curve;

[0017] When an auxiliary line is set above the target area, determine the hierarchical information of the image according to the minimum coordinate value in the gradient curve;

[0018] When an auxiliary line is set below the target area, determine the hierarchical information of the image according to the maximum coordinate value in the gradient curve.

[0019] In combination with the first aspect, in one implementation, before positioning the target area of the image, it further includes:

[0020] Perform a closing operation along the horizontal direction of the image to merge the target areas.

[0021] In combination with the first aspect, in one implementation, it further includes:

[0022] Set an area threshold, and delete areas with an area smaller than the area threshold to remove interference near the target area.

[0023] In a second aspect, an embodiment of the present application provides a hierarchical positioning device for a display panel. The hierarchical positioning device for the display panel includes:

[0024] A black hat operation module, which is used to locate the target area of the image and perform a black hat operation on the target area to obtain a black hat map;

[0025] A statistics module, which is used to count the number of pixels in the black hat map projection to obtain a black hat projection curve;

[0026] A positioning module, which is used to calculate the gradient curve of the black hat projection curve and determine the hierarchical information of the image according to the maximum and minimum coordinate values in the gradient curve.

[0027] In a third aspect, an embodiment of the present application provides a hierarchical positioning device for a display panel. The hierarchical positioning device for the display panel includes a processor, a memory, and a hierarchical positioning program for the display panel that is stored on the memory and can be executed by the processor. When the hierarchical positioning program for the display panel is executed by the processor, the steps of the above-mentioned hierarchical positioning method for the display panel are implemented.

[0028] In a fourth aspect, a computer-readable storage medium has a hierarchical positioning program for a display panel stored thereon. When the hierarchical positioning program for the display panel is executed by a processor, the steps of the above-described hierarchical positioning method for the display panel are implemented.

[0029] The beneficial effects brought by the technical solution provided in the embodiments of the present application at least include:

[0030] In the hierarchical positioning method for the display panel in the present application, by positioning a target area of an image, a black hat operation is performed on the target area to obtain a black hat image; the number of pixels projected in the black hat image is counted to obtain a black hat projection curve; the gradient curve of the black hat projection curve is calculated, and the hierarchical information of the image is determined according to the maximum and minimum coordinate values in the gradient curve.

[0031] That is, in the present application, the hierarchical information of the area to be measured is transferred to the black hat area for analysis to calculate the height of each area in the area to be measured. Using the method in the present application, the hierarchical positioning of the concave detection area can be quickly achieved, with the advantages of high stability and high precision. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] Figure 1 Schematic diagram of the relative position between the display panel and the inked area when the display panel is tilted;

[0033] Figure 2 Schematic diagram of the relative position between the display panel and the inked area after the angle of the display panel is corrected;

[0034] Figure 3 Schematic flowchart of an embodiment of the hierarchical positioning method for the display panel of the present application;

[0035] Figure 4 Schematic diagram of the target area positioning and black hat image of the present application;

[0036] Figure 5 Schematic diagram of the black hat projection curve of the present application;

[0037] Figure 6 Schematic diagram of the gradient curve of the black hat projection curve of the present application;

[0038] Figure 7 Schematic block diagram of an embodiment of the hierarchical positioning device for the display panel of the present application;

[0039] Figure 8 Schematic diagram of the hardware structure of the hierarchical positioning device for the display panel involved in the solution of the embodiment of the present application. DETAILED DESCRIPTION

[0040] To enable those skilled in the art to better understand the solution of this application, the following will clearly and completely describe the technical solution in the embodiments of this application in conjunction with the accompanying drawings in the embodiments of this application. Obviously, the described embodiments are only a part of the embodiments of this application, rather than all the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without making creative efforts fall within the scope of protection of this application.

[0041] It should be noted that the inner screen side of the display panel needs to be coated with ink for light shielding to prevent light from leaking out during dot screen. Refer to Figure 1 As shown, the position of the green frame is the area that needs to be coated with ink. After coating with ink, a picture needs to be taken to judge the ink coating situation by positioning the green frame.

[0042] However, since the display panel is usually fixed on the carrier by vacuum adsorption, the dust on the carrier and the adsorption force will cause the display panel to tilt, making it difficult to position the green frame. Specifically, it can be seen in Figure 1 that the protective film of the display panel has a downward bulge. There is a gap between the position of the lower right corner of the first green frame and the white area below (the side of the display panel, that is, the image in the thickness direction of the display panel). Therefore, the display panel needs to be angle-corrected. The final effect can be seen in Figure 2 as shown. Figure 2 It can be seen from

[0043] that the green frame and the white area are basically fitted.

[0044] In addition, due to the limitations of the display panel material, its surface cannot be absolutely smooth and there will be particles or burrs, that is, the display panel has unevenly changing inclined edges. The purpose of this application is to screen and filter the unevenly changing inclined edges to improve the accuracy of angle correction.

[0045] After angle correction, in order to install a camera, an inner screen, a type-c socket and some other sockets on the display panel, the shape of the edge area will be irregular, and a large proportion will have abnormal situations such as protrusion or depression. The purpose of this application is to perform structural analysis on these irregular areas to be measured for layer-by-layer positioning, so as to prepare for subsequent judgment of the ink coating situation.

[0046] It should be noted that the above introduces the relevant usage scenarios, but the solution in this application is not limited to the above scenarios. As long as structural analysis is performed on irregular areas to be measured, the solution in this application is also applicable.

[0046] To make the purpose, technical solution and advantages of this application clearer, the following will further describe the embodiments of this application in detail in conjunction with the accompanying drawings.

[0047] In a first aspect, an embodiment of the present application provides a method for hierarchical positioning of a display panel.

[0048] In one embodiment, referring to Figure 3 , Figure 3 is a schematic flowchart of an embodiment of the method for hierarchical positioning of the display panel of the present application. As Figure 3 shown, the method for hierarchical positioning of the display panel includes:

[0049] S1. Locate the target area of the image, and perform a black hat operation on the target area to obtain a black hat image;

[0050] Referring to Figure 4 shown, it shows the side of the display panel, that is, the image in the thickness direction of the display panel. In order to install the camera, the inner screen, the type c socket, and some other sockets, the shape of the edge area will be irregular, and a large proportion will have abnormal situations such as protrusions or depressions. These areas are the areas to be measured in this embodiment, that is, the target area. Figure 4 In, the target area described in this embodiment refers to the area surrounded by two green lines, and the purpose is to perform hierarchical positioning on the target area.

[0051] Specifically, in this embodiment, the target area of the image is roughly located by using the method of threshold segmentation. Threshold segmentation is a basic technique in image processing. It divides the pixels in the image into two or more parts, usually separating the foreground object from the background. This process involves selecting one or more thresholds and classifying the pixels according to their gray values.

[0052] Further, in one embodiment, before locating the target area of the image, a closing operation is also performed along the horizontal direction of the image to merge the target area. Closing is a morphological operation in image processing, usually used to eliminate small holes in the image, fill small defects, and connect adjacent objects in the image. The closing operation consists of two basic morphological operations: dilation and erosion, and the execution order is to perform the dilation operation first and then the erosion operation.

[0053] After locating the target area, a black hat operation can be performed on the target area to obtain a black hat image. The black hat operation is a kind of morphological operation, which is usually used in the field of image processing. In mathematical morphology, the black hat operation is composed of the dilation and erosion operations of the image.

[0054] Specifically, the black hat operation mainly includes the following steps:

[0055] First, perform a dilation operation on the image, and then subtract the original image from the obtained dilated image. The obtained difference image is the result of the black hat operation.

[0056] Specifically, in this embodiment, first, an auxiliary line (not shown in the figure) is set above or below the target area, and then, starting from the auxiliary line, a black hat operation is performed downward or upward along the vertical direction of the image until it exceeds the last layer to be analyzed in the target area to obtain a black hat image.

[0057] See Figure 4 As shown, taking the case where the auxiliary line is set above the target area as an example, the black hat operation means starting from the auxiliary line and moving downward along the vertical direction of the image until it exceeds the last layer to be analyzed L2, so that the information of layer L2 can be read at the beginning.

[0058] It can be understood that the auxiliary line can also be set below the target area. Figure 2 In the image shown, there is interference (a narrow white area) below the target area, so an area threshold needs to be set to delete the areas with an area smaller than the area threshold to remove the interference near the target area.

[0059] S2. Count the number of pixels in the projection of the black hat image to obtain a black hat projection curve;

[0060] See Figure 4 As shown, for the convenience of counting the number of pixels in the projection of the black hat image, in this embodiment, the black hat image is first rotated by 90°, and then the number of pixels in the vertical projection of the rotated black hat image is counted to obtain a black hat projection curve. The black hat projection curve can be seen in Figure 5 As shown, where X is the coordinate position and Y is the number of pixels.

[0061] S3. Calculate the gradient curve of the black hat projection curve, and determine the hierarchical information of the image according to the maximum and minimum coordinate values in the gradient curve.

[0062] When specifically implemented, first, the derivative of the black hat projection curve is obtained to get the gradient curve. The gradient curve can be seen in Figure 6 As shown, where X is the coordinate position and Y represents the gradient.

[0063] When the auxiliary line is set above the target area, the hierarchical information of the image is determined according to the minimum coordinate value in the gradient curve; when the auxiliary line is set below the target area, the hierarchical information of the image is determined according to the maximum coordinate value in the gradient curve.

[0064] Taking the case where the auxiliary line is set above the target area and the black hat image is rotated counterclockwise by 90° as an example, see Figure 6 As shown, the first peak represents the relevant information of the auxiliary line, and then the first trough encountered to the right is the information of layer L1, and the second trough encountered to the right is the information of layer L2.

[0065] It should be noted that since the black hat image is rotated in the above steps, Figure 6The X coordinate actually reflects the vertical position in the original image. That is, after determining the X coordinate, the height of each region in the area to be measured can be calculated.

[0066] It can be understood that if an auxiliary line is set below the target area, the trough represents the information related to the auxiliary line, and the subsequent two peaks represent the information of the L2 layer and the L3 layer. The principle is the same as above.

[0067] This embodiment is not limited to only analyzing the L1 layer and the L2 layer, which can be determined by the cut-off position during the black hat operation. This embodiment will not be elaborated here.

[0068] In summary, for the hierarchical positioning method of the display panel in this application, by positioning the target area of the image, performing a black hat operation on the target area to obtain a black hat image; counting the number of pixels in the projection of the black hat image to obtain a black hat projection curve; calculating the gradient curve of the black hat projection curve, and determining the hierarchical information of the image according to the maximum and minimum coordinate values in the gradient curve.

[0069] That is, this application transfers the hierarchical information of the area to be measured to the black hat area for analysis to calculate the height of each area in the area to be measured. Using the method in this application, the hierarchical positioning of the concave detection area can be quickly realized, with the advantages of high stability and high precision.

[0070] In a second aspect, an embodiment of this application further provides a hierarchical positioning device for a display panel.

[0071] In one embodiment, referring to Figure 7 , Figure 7 is a schematic diagram of the functional modules of an embodiment of the hierarchical positioning device for the display panel of this application. As Figure 7 shown, the hierarchical positioning device for the display panel includes a black hat operation module, a statistics module, and a positioning module.

[0072] Among them, the black hat operation module is used to position the target area of the image and perform a black hat operation on the target area to obtain a black hat image;

[0073] The statistics module is used to count the number of pixels in the projection of the black hat image to obtain a black hat projection curve;

[0074] The positioning module is used to calculate the gradient curve of the black hat projection curve and determine the hierarchical information of the image according to the maximum and minimum coordinate values in the gradient curve.

[0075] Furthermore, in one embodiment, the black hat operation module performing a black hat operation on the target area to obtain a black hat image includes:

[0076] Setting an auxiliary line above or below the target area;

[0077] Starting from the auxiliary line, perform a black hat operation vertically downward or upward along the image to exceed the last layer to be analyzed in the target area to obtain a black hat image.

[0078] Further, in one embodiment, the black hat operation module locates the target area of the image by means of threshold segmentation.

[0079] Further, in one embodiment, the statistical module counts the number of pixels in the projection of the black hat image to obtain a black hat projection curve, including:

[0080] Rotate the black hat image by 90°, and count the number of pixels in the vertical projection of the rotated black hat image to obtain a black hat projection curve.

[0081] Further, in one embodiment, the positioning module calculates the gradient curve of the black hat projection curve, and determines the hierarchical information of the image according to the maximum and minimum coordinate values in the gradient curve, including:

[0082] Derive the black hat projection curve to obtain a gradient curve;

[0083] When the auxiliary line is set above the target area, determine the hierarchical information of the image according to the minimum coordinate value in the gradient curve;

[0084] When the auxiliary line is set below the target area, determine the hierarchical information of the image according to the maximum coordinate value in the gradient curve.

[0085] Further, in one embodiment, before the black hat operation module locates the target area of the image, it is also used for:

[0086] Perform a closing operation along the horizontal direction of the image to merge the target area.

[0087] Further, in one embodiment, the black hat operation module is also used for:

[0088] Set an area threshold, and delete areas with an area smaller than the area threshold to remove interference near the target area.

[0089] Among them, the function implementation of each module in the above display panel hierarchical positioning device corresponds to each step in the above display panel hierarchical positioning method embodiment, and its function and implementation process will not be elaborated here one by one.

[0090] In a third aspect, an embodiment of the present application provides a display panel hierarchical positioning device. The display panel hierarchical positioning device can be a device with data processing functions such as a personal computer (PC), a laptop computer, a server, etc.

[0091] Refer to Figure 8 , Figure 8It is a schematic diagram of the hardware structure of the hierarchical positioning device for the display panel involved in the solution of the embodiment of the present application. In the embodiment of the present application, the hierarchical positioning device for the display panel may include a processor, a memory, a communication interface, and a communication bus.

[0092] Among them, the communication bus can be of any type and is used to interconnect the processor, the memory, and the communication interface.

[0093] The communication interface includes interfaces such as input / output (I / O) interfaces, physical interfaces, and logical interfaces for interconnecting components inside the hierarchical positioning device of the display panel, as well as interfaces for interconnecting the hierarchical positioning device of the display panel with other devices (such as other computing devices or user devices). The physical interface can be an Ethernet interface, a fiber optic interface, an ATM interface, etc.; the user device can be a display screen (Display), a keyboard (Keyboard), etc.

[0094] The memory can be various types of storage media, such as random access memory (RAM), read-only memory (ROM), non-volatile RAM (NVRAM), flash memory, optical memory, hard disk, programmable ROM (PROM), erasable PROM (EPROM), electrically erasable PROM (EEPROM), etc.

[0095] The processor can be a general-purpose processor, and the general-purpose processor can call the hierarchical positioning program for the display panel stored in the memory and execute the hierarchical positioning method for the display panel provided by the embodiment of the present application. For example, the general-purpose processor can be a central processing unit (CPU). Among them, the method executed when the hierarchical positioning program for the display panel is called can refer to each embodiment of the hierarchical positioning method for the display panel of the present application, which will not be elaborated here.

[0096] Those skilled in the art can understand that Figure 8 the hardware structure shown in

[0097] does not constitute a limitation to the present application, and may include more or fewer components than shown in the figure, or combine certain components, or have different component arrangements.

[0098] A hierarchical positioning program for a display panel is stored on a readable storage medium of the present application. When the hierarchical positioning program of the display panel is executed by a processor, the steps of the hierarchical positioning method of the display panel as described above are implemented.

[0099] Among them, the method implemented when the hierarchical positioning program of the display panel is executed can refer to each embodiment of the hierarchical positioning method of the display panel of the present application, which will not be elaborated here.

[0100] It should be noted that the serial numbers of the embodiments of the present application above are only for description and do not represent the advantages or disadvantages of the embodiments.

[0101] Through the description of the above embodiments, those skilled in the art can clearly understand that the above embodiment methods can be implemented by means of software plus a necessary general hardware platform. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium as described above (such as ROM / RAM, magnetic disk, optical disc) and includes several instructions for causing a terminal device to execute the methods described in each embodiment of the present application.

[0102] The terms "including" and "having" and any variations thereof in the specification, claims and drawings of the present application are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally further includes steps or units not listed, or optionally further includes other steps or units inherent to these processes, methods, products or devices. The descriptions of terms such as "first", "second" and "third" are used to distinguish different objects, etc., and do not represent a sequence, nor do they limit that "first", "second" and "third" are of different types.

[0103] In the description of the embodiments of the present application, "exemplary", "for example" or "for instance" etc. are used to indicate examples, illustrations or explanations. Any embodiment or design solution described as "exemplary", "for example" or "for instance" in the embodiments of the present application should not be construed as being more preferred or having more advantages than other embodiments or design solutions. Rather, the use of words such as "exemplary", "for example" or "for instance" is intended to present related concepts in a specific manner.

[0104] In the description of the embodiments of the present application, unless otherwise specified, " / " means "or". For example, A / B may mean A or B. The "and / or" in the text is merely a description of the association relationship between associated objects, indicating that there can be three relationships. For example, A and / or B may mean: A exists alone, A and B exist simultaneously, and B exists alone. In addition, in the description of the embodiments of the present application, "a plurality of" means two or more than two.

[0105] In some processes described in the embodiments of the present application, there are multiple operations or steps that appear in a specific order. However, it should be understood that these operations or steps may not be executed in the order in which they appear in the embodiments of the present application or may be executed in parallel. The serial numbers of the operations are only used to distinguish different operations, and the serial numbers themselves do not represent any execution order. In addition, these processes may include more or fewer operations, and these operations or steps may be executed in order or in parallel, and these operations or steps may be combined.

[0106] The above are only the preferred embodiments of the present application, and do not limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made by using the specification and drawings of the present application, or directly or indirectly applied in other related technical fields, shall be equally included in the patent protection scope of the present application.

Claims

1. A layered positioning method for a display panel, characterized in that: The layered positioning method of the display panel includes: Locate the target area of ​​the image, and perform black hat operation on the target area to obtain a black hat image; Count the number of pixels of the black hat image projection to obtain the black hat projection curve; The gradient curve of the black hat projection curve is calculated, and the hierarchical information of the image is determined according to the maximum coordinates in the gradient curve.

2. The layered positioning method of a display panel according to claim 1, wherein: The performing black hat operation on the target area to obtain a black hat graph includes: Set auxiliary lines above or below the target area; Starting from the auxiliary line, black hat operation is performed along the vertical direction of the image downward or upward to the last layer to be analyzed beyond the target area to obtain a black hat image.

3. The layered positioning method of a display panel according to claim 1 or 2, characterized in that: Threshold segmentation is used to locate the target area of ​​the image.

4. The layered positioning method of a display panel according to claim 1, wherein: The method of counting the number of pixels of the black hat image projection to obtain the black hat projection curve includes: The black hat image is rotated 90°, and the number of pixels of the vertical projection of the rotated black hat image is counted to obtain the black hat projection curve.

5. The layered positioning method of a display panel according to claim 1 or 4, characterized in that: The step of calculating the gradient curve of the black hat projection curve and determining the hierarchical information of the image according to the maximum coordinates in the gradient curve includes: The gradient curve is obtained by taking the derivative of the black hat projection curve; When auxiliary lines are set above the target area, the layer information of the image is determined according to the minimum value coordinates in the gradient curve; When auxiliary lines are set below the target area, the layering information of the image is determined according to the maximum value coordinates in the gradient curve.

6. The layered positioning method of a display panel according to claim 1, wherein: Before locating the target area of ​​the image, the method further includes: The target area is merged by closing operation along the horizontal direction of the image.

7. The layered positioning method of a display panel according to claim 1, wherein: Also includes: Set an area threshold and delete areas with an area smaller than the area threshold to remove interference near the target area.

8. A layered positioning device for a display panel, characterized in that: The layered positioning device of the display panel comprises: A black hat operation module is used to locate the target area of ​​the image and perform black hat operation on the target area to obtain a black hat image; A statistical module is used to count the number of pixels of the black hat image projection to obtain a black hat projection curve; The positioning module is used to calculate the gradient curve of the black hat projection curve and determine the hierarchical information of the image according to the maximum coordinates in the gradient curve.

9. A layered positioning device for a display panel, characterized in that: The layered positioning device of the display panel includes a processor, a memory, and a layered positioning program of the display panel stored in the memory and executable by the processor, wherein when the layered positioning program of the display panel is executed by the processor, the steps of the layered positioning method of the display panel as described in any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a layered positioning program for a display panel, wherein when the layered positioning program for a display panel is executed by a processor, the steps of the layered positioning method for a display panel as claimed in any one of claims 1 to 7 are implemented.

Images