Mura defect positioning method and system, computer device and storage medium

Abstract

The application relates to a mura defect positioning method, a system, computer equipment and a storage medium. The mura defect positioning method comprises the following steps: acquiring first position information of a mura defect in an oblique view image of a display area of a to-be-tested screen body according to the oblique view image, wherein the oblique view image is a display area image under an oblique viewing angle; converting the first position information into second position information in an orthographic view image according to a position conversion relationship between the oblique view image and the orthographic view image, wherein the orthographic view image is a display area image under a vertical viewing angle; and acquiring target position information of the mura defect according to the second position information. Through the above mura defect positioning method, the mura defect in the oblique view image can be converted into the orthographic view image, so that defects that cannot be observed under the vertical viewing angle are avoided from being missed; and the target position information of the mura defect can be acquired according to the second position information, so that the position corresponding to the mura defect can be accurately positioned.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of optical detection, in particular to a mura defect positioning method and system, computer device and storage medium. BACKGROUND

[0002] At present, in the process of detecting the mura defect of a to-be-detected screen body, an imaging device is used to capture a front view image of the to-be-detected screen body at a vertical viewing angle, and the position information of the mura defect of the display area of the screen body is obtained based on the front view image.

[0003] However, the above method can only detect the mura defect of the to-be-detected screen body observed at the vertical viewing angle, and may miss the mura defect of the to-be-detected screen body that cannot be observed at the vertical viewing angle.

[0004] If the front view image and the oblique view image of the to-be-detected screen body at the vertical viewing angle and at the inclined viewing angle are captured by the imaging assembly, since the sizes of the display areas of the screen body corresponding to the front view image and the oblique view image are different, the coordinate information of the same mura defect in the front view image and the oblique view image is different, the position of the same mura defect determined based on the front view image and the oblique view image may be different, which may result in that the same mura defect corresponds to two different positions, and thus the position corresponding to the mura defect cannot be accurately positioned. SUMMARY

[0005] Therefore, it is necessary to provide a mura defect positioning method, system, computer device, computer readable storage medium and computer program product capable of accurately positioning the position corresponding to the mura defect in view of the above technical problems.

[0006] In a first aspect, the present application provides a mura defect positioning method, comprising:

[0007] obtaining first position information of a mura defect in an oblique view image of a display area of a to-be-detected screen body, wherein the oblique view image is an image of the display area at an inclined viewing angle;

[0008] converting the first position information into second position information in a front view image of the display area of the to-be-detected screen body according to a position conversion relationship between the oblique view image and the front view image of the display area of the to-be-detected screen body, wherein the front view image is an image of the display area at a vertical viewing angle;

[0009] obtaining target position information of the mura defect according to the second position information.

[0010] In one embodiment, the mura defect positioning method further comprises:

[0011] obtaining a front-view pixel image of the to-be-tested screen body, wherein the front-view pixel image comprises sub-pixel images of a display area of the to-be-tested screen body;

[0012] locating a sub-pixel with a mura defect corresponding to the target position information according to a position mapping relationship between the front-view image and the front-view pixel image.

[0013] In one embodiment, before the locating of the sub-pixel with the mura defect corresponding to the target position information according to the position mapping relationship between the front-view image and the front-view pixel image, the method further comprises:

[0014] obtaining screen display area contours and feature points of the front-view image and the front-view pixel image;

[0015] matching the screen display area contours and feature points of the front-view image and the front-view pixel image to obtain a position mapping relationship between the front-view image and the front-view pixel image.

[0016] In one embodiment, before the obtaining of the first position information of the mura defect in the oblique-view image of the display area of the to-be-tested screen body, the method further comprises:

[0017] calibrating the first imaging device and the second imaging device according to a standard checkerboard, wherein the first imaging device is used to collect the front-view image, and the second imaging device is used to collect the oblique-view image;

[0018] obtaining a position conversion relationship between the oblique-view image and the front-view image according to a calibration result.

[0019] In a second aspect, the present application provides a mura defect positioning system, comprising:

[0020] a first imaging assembly configured to collect an oblique-view image and a front-view image of a display area of a to-be-tested screen body, wherein the oblique-view image is an image of the display area under an oblique viewing angle, and the front-view image is an image of the display area under a vertical viewing angle;

[0021] a processing assembly connected to the first imaging assembly and configured to obtain first position information of a mura defect in the oblique-view image, convert the first position information into second position information in the front-view image according to a position conversion relationship between the oblique-view image and the front-view image, and obtain target position information of the mura defect according to the second position information.

[0022] In one embodiment, the mura defect positioning system further comprises:

[0023] a second imaging component configured to acquire a front-view pixel image of a display area of the to-be-tested screen body, wherein the front-view pixel image comprises a sub-pixel image of the display area of the to-be-tested screen body;

[0024] The processing component is connected with the second imaging component, and the processing component is further configured to locate a sub-pixel with a mura defect corresponding to the target position information according to a position mapping relationship between the front-view image and the front-view pixel image.

[0025] In an embodiment, the processing component is further configured to acquire a screen display area contour and a feature point of the front-view image and the front-view pixel image, match the screen display area contour and the feature point of the front-view image and the front-view pixel image, and acquire the position mapping relationship between the front-view image and the front-view pixel image.

[0026] In an embodiment, the first imaging component comprises:

[0027] a front-view camera configured to acquire a front-view image of the to-be-tested screen body;

[0028] an oblique-view camera configured to acquire an oblique-view image of the to-be-tested screen body.

[0029] In a third aspect, the present application further provides a computer device. The computer device comprises a memory and a processor, the memory stores a computer program, and the processor implements the following steps when executing the computer program:

[0030] acquire first position information of a mura defect in an oblique-view image of a display area of a to-be-tested screen body, wherein the oblique-view image is a display area image under an oblique viewing angle;

[0031] convert the first position information into second position information in a front-view image of the display area of the to-be-tested screen body according to a position conversion relationship between the oblique-view image and the front-view image of the display area of the to-be-tested screen body, wherein the front-view image is a display area image under a vertical viewing angle;

[0032] acquire target position information of a mura defect according to the second position information.

[0033] In a fourth aspect, the present application further provides a computer readable storage medium. The computer readable storage medium stores a computer program, and the computer program is executed by a processor to implement the following steps:

[0034] acquire first position information of a mura defect in an oblique-view image of a display area of a to-be-tested screen body, wherein the oblique-view image is a display area image under an oblique viewing angle;

[0035] According to a position conversion relationship between the oblique view image and a normal view image of the display area of the to-be-tested screen body, the first position information is converted into second position information in the normal view image, wherein the normal view image is a display area image under a normal viewing angle.

[0036] According to the second position information, target position information of the mura defect is obtained.

[0037] In a fifth aspect, the present application further provides a computer program product. The computer program product comprises a computer program which, when executed by a processor, implements the following steps:

[0038] According to the oblique view image of the display area of the to-be-tested screen body, first position information of a mura defect in the oblique view image is obtained, wherein the oblique view image is a display area image under an oblique viewing angle.

[0039] According to a position conversion relationship between the oblique view image and a normal view image of the display area of the to-be-tested screen body, the first position information is converted into second position information in the normal view image, wherein the normal view image is a display area image under a normal viewing angle.

[0040] According to the second position information, target position information of the mura defect is obtained.

[0041] The mura defect positioning method, system, computer device, storage medium and computer program product described above, by obtaining first position information of a mura defect in an oblique view image, according to a position conversion relationship between the oblique view image and a normal view image, the first position information can be converted into second position information in the normal view image, so as to convert the mura defect in the oblique view image to the normal view image, avoiding missing defects that cannot be observed under a normal viewing angle. According to the second position information, target position information of the mura defect can be obtained, so as to accurately position the position corresponding to the mura defect. BRIEF DESCRIPTION OF DRAWINGS

[0042] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings needed to be used in the embodiments or the prior art description. Obviously, the drawings in the following description only some embodiments of the present application, and for those skilled in the art, without creative labor, other drawings can also be obtained from these drawings.

[0043] Figure 1 A scene schematic diagram for shooting a normal view image and an oblique view image of a to-be-tested screen body in an embodiment;

[0044] Figure 2 A flowchart of a mura defect positioning method in an embodiment;

[0045] Figure 3 A schematic diagram of an orthographic image in one embodiment;

[0046] Figure 4 A schematic diagram of an oblique image in one embodiment;

[0047] Figure 5 A schematic diagram of an orthographic pixel image in one embodiment;

[0048] Figure 6 A partial enlarged view of an orthographic pixel image in one embodiment;

[0049] Figure 7 A schematic diagram of a sub-pixel in an orthographic pixel image in one embodiment;

[0050] Figure 8 A structural block diagram of a mura defect positioning system in one embodiment;

[0051] Figure 9 A structural block diagram of a mura defect positioning system in another embodiment;

[0052] Figure 10 An internal structural diagram of a computer device in one embodiment.

[0053] Explanation of reference signs:

[0054] 11-orthographic imaging assembly, 12-oblique imaging assembly, 13-screen to be measured, 21-orthographic image, 22-oblique image, 23-orthographic pixel image, 31-first imaging assembly, 32-processing assembly, 33-second imaging assembly. DETAILED DESCRIPTION

[0055] In order to facilitate the understanding of the present application, the present application will be described in more detail below with reference to the relevant drawings. The drawings show embodiments of the present application. However, the present application can be implemented in many different forms, and is not limited to the embodiments described herein. On the contrary, the purpose of providing these embodiments is to make the disclosure of the present application more thorough and comprehensive.

[0056] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which the present application belongs. The terms used in the specification of the present application herein are only for the purpose of describing specific embodiments and are not intended to limit the present application.

[0057] It can be understood that the terms "first", "second", etc. used in the present application can be used herein to describe various elements, but these elements are not limited by these terms. These terms are only used to distinguish the first element from another element.

[0058] Spatially relative terms, such as "beneath", "below", "lower", "under", "above", "upper" and the like, can be used herein for ease of description to describe one element or feature's relationship to another element(s) or feature(s) as illustrated in the figures. It will be understood that the spatially relative terms are intended to encompass different orientations of the device in use or operation in addition to the orientation depicted in the figures. For example, if a device in the figures is inverted, objects or features described as "below" or "beneath" other objects or features would then be oriented "above" the other objects or features. Thus, the exemplary term "below" can encompass both an orientation of above and below. The devices can be otherwise oriented (e.g., rotated 90 degrees or at other orientations) and the spatially relative descriptors used herein interpreted accordingly.

[0059] It is noted that when an element is referred to as being "connected", "coupled", or "adjacent" to another element, it can be directly connected, coupled, or adjacent to the other element, or it can be connected, coupled, or adjacent to the other element via intervening elements. In addition, "connected", "coupled", or "adjacent" in the following embodiments, if there is a transmission of electrical signals or data between the connected objects, should be understood as "electrically connected", "communicatively connected", etc.

[0060] As used herein, the singular forms "a", "an" and "the" include plural referents unless the context clearly dictates otherwise. It is to be understood that the terms "comprises", "comprising", "includes", "including", or "has", "having" or the like are specifically intended to be open-ended terms i.e., to mean including but not limited to. Also, the term "consisting of" is intended to be construed as a functional limitation of the claim to encompassing only the recited elements. Similarly, the term "consisting essentially of shall have the meaning ascribed in 35 U.S.C. 112, paragraph 6. Also, the use of "and / or", "and", "or", "either" and "or" are intended to include all possible combinations of the stated terms. Also, the terms "first", "second", "third", etc. are used merely as labels, and are not intended to impose numerical requirements on their objects.

[0061] As described in the background, in the process of detecting the mura defect of the to-be-tested screen body, the orthographic image of the to-be-tested screen body is captured by the imaging device at the vertical viewing angle, and the position information of the mura defect of the display area of the screen body is obtained based on the orthographic image. However, the above-mentioned method can only detect the mura defect of the to-be-tested screen body observed at the vertical viewing angle, and is easy to miss the mura defect of the to-be-tested screen body that cannot be observed at the vertical viewing angle.

[0062] If the orthographic image and the oblique image of the to-be-tested screen body at the vertical viewing angle and at the inclined viewing angle are captured by the imaging assembly, because the sizes of the display areas of the screen body corresponding to the orthographic image and the oblique image are different, the coordinate information of the same mura defect in the orthographic image and the oblique image is different, the positions of the same mura defect determined based on the orthographic image and the oblique image can be different, and the same mura defect can correspond to two different positions, so that the position corresponding to the mura defect cannot be accurately positioned.

[0063] For the above reasons, in one embodiment, as shown in Figures 1 to 4 The application provides a mura defect positioning method, comprising:

[0064] S201: obtaining first position information of a mura defect in an oblique view image according to the oblique view image of the display area of the to-be-tested screen body, wherein the oblique view image is an image of the display area under an oblique viewing angle;

[0065] S202: converting the first position information into second position information in an orthographic view image according to the position conversion relationship between the oblique view image and the orthographic view image, wherein the orthographic view image is an image of the display area under a vertical viewing angle;

[0066] S203: obtaining target position information of the mura defect according to the second position information.

[0067] In the application, as shown in Figure 1 The orthographic view image of the to-be-tested screen body 13 under a vertical viewing angle can be captured by the orthographic imaging assembly 11, the oblique view image of the to-be-tested screen body 13 under an oblique viewing angle can be captured by the oblique imaging assembly 12, and the mura defect of the to-be-tested screen body can be obtained based on the orthographic view image 21 and the oblique view image 22 respectively. It can be understood that the orthographic view image 21 and the oblique view image 22 of the to-be-tested screen body 13 can also be collected by the same imaging camera in the forward direction and the oblique direction.

[0068] In S201, the detection of the mura defect can be realized by an existing algorithm, which is not limited herein. In S202, the first imaging assembly 31 can be calibrated by using a standard checkerboard calibration plate to obtain the position conversion relationship between the orthographic view image 21 and the oblique view image 22.

[0069] Specifically, after the oblique view image 22 and the orthographic view image 21 of the to-be-tested screen body 13 are obtained, the mura defect in the oblique view image 22 can be obtained by detecting the oblique view image 22, and then the first position information of the mura defect in the oblique view image 22 is obtained. Then, the first position information is converted into second position information in the orthographic view image 21 according to the position conversion relationship between the oblique view image 22 and the orthographic view image 21. The target position information can be obtained by processing the second position information, that is, the position information of the mura defect of the display area of the screen body is obtained.

[0070] The mura defect positioning method can convert the first position information of the mura defect in the oblique view image 22 into second position information in the front view image 21 according to the position conversion relationship between the oblique view image 22 and the front view image 21, so as to transfer the mura defect in the oblique view image 22 to the front view image 21, thereby avoiding missing defects that cannot be observed under the vertical viewing angle. The target position information of the mura defect can be obtained according to the second position information, and then the position corresponding to the mura defect in the to-be-tested screen body 13 can be comprehensively and accurately positioned.

[0071] In one embodiment, as shown in Figure 3 、 Figures 5 to 7 The mura defect positioning method further includes: obtaining a front view pixel image of the to-be-tested screen body, wherein the front view pixel image includes sub-pixel images of a display area of the to-be-tested screen body; and positioning a sub-pixel having the mura defect corresponding to the target position information according to a position mapping relationship between the front view image and the front view pixel image.

[0072] As shown in Figure 6 and Figure 7 The front view pixel image includes sub-pixel images of the display area of the to-be-tested screen body, and each sub-pixel has corresponding position information. Therefore, the position information of the defect sub-pixel corresponding to the target position information is obtained.

[0073] In the application, the front view pixel image 23 needs to be obtained by processing the original image to remove noise. However, the noise removal process can easily remove weak mura defects. Therefore, the position information of the mura area cannot be accurately detected based on the front view pixel image 23. The position information of the defect sub-pixel corresponding to the mura defect in the front view image 21 needs to be determined based on the position mapping relationship between the front view image 21 and the front view pixel image 23, that is, the position information of the defect sub-pixel corresponding to the target information is obtained according to the position mapping relationship.

[0074] In this embodiment, after the front view pixel image 23 of the to-be-tested screen body 13 is obtained, the position information corresponding to the target position information in the front view pixel image 23 can be determined according to the position mapping relationship between the front view image 21 and the front view pixel image 23. Since the front view pixel image 23 includes sub-pixel images of the display area of the screen body, the position information of the defect sub-pixel corresponding to the target position information can be determined according to the position mapping relationship between the front view image 21 and the front view pixel image 23, so as to comprehensively and accurately position the sub-pixel position corresponding to the mura defect.

[0075] In one embodiment, before the mura defect locating method locates the sub-pixel corresponding to the target position information according to the position mapping relationship between the front view image and the front view pixel image, the mura defect locating method further comprises: obtaining the screen display area contour and the feature point of the front view image and the front view pixel image; matching the screen display area contour and the feature point of the front view image and the front view pixel image to obtain the position mapping relationship between the front view image and the front view pixel image.

[0076] The edge line of the screen display area of the front view image 21 and the front view pixel image 23 can be determined by detecting the color value of the pixel in the front view image 21 and the front view pixel image 23, so as to obtain the screen display area contour of the front view image 21 and the front view pixel image 23. The feature point in the front view image 21 can be the edge point of the screen display area of the front view image 21, and similarly, the feature point in the front view pixel image 23 can be the edge point of the screen display area of the front view pixel image 23. It should be noted that the feature point in the front view image 21 and the corresponding feature point in the front view pixel image 23 should correspond to the same point of the screen display area.

[0077] It can be understood that the proportional relationship between the front view image 21 and the front view pixel image 23 can be determined according to the screen display area contour of the front view image 21 and the screen display area contour of the front view pixel image 23, and the position conversion relationship between the front view image 21 and the front view pixel image 23 can be determined according to the position information of the feature point in the front view image 21 and the position information of the corresponding feature point in the front view pixel image 23, and the position mapping relationship between the front view image 21 and the front view pixel image 23, i.e. the position correspondence relationship between the pixel of the front view image 21 and the screen sub-pixel of the front view pixel image 23, can be determined according to the proportional relationship and the position conversion relationship between the front view image 21 and the front view pixel image 23. Therefore, based on the position mapping relationship, the position information of the defective sub-pixel corresponding to the target position information can be obtained, and the sub-pixel position corresponding to the mura defect can be accurately located.

[0078] In one embodiment, before the mura defect locating method obtains the first position information of the mura defect in the oblique view image according to the oblique view image of the to-be-tested screen display area, the mura defect locating method further comprises: calibrating the first imaging device and the second imaging device according to the standard checkerboard, wherein the first imaging device is used to collect the front view image, and the second imaging device is used to collect the oblique view image; obtaining the position conversion relationship between the oblique view image and the front view image according to the calibration result.

[0079] The first imaging device and the second imaging device can both be a camera. The calibration of the first imaging device can obtain the conversion relationship between the coordinate system of the first imaging device and the world coordinate system, and the calibration of the second imaging device can obtain the conversion relationship between the coordinate system of the second imaging device and the world coordinate system.

[0080] Specifically, the first imaging device is calibrated by a standard chessboard calibration plate to obtain a conversion relationship between a coordinate system of the first imaging device and a world coordinate system; the second imaging device is calibrated by the standard chessboard calibration plate to obtain a conversion relationship between a coordinate system of the second imaging device and the world coordinate system, and the conversion relationship between the coordinate system of the first imaging device and the coordinate system of the second imaging device, i.e., the position conversion relationship between the oblique view image 22 and the front view image 21, can be obtained according to the conversion relationship between the coordinate system of the first imaging device and the world coordinate system and the conversion relationship between the coordinate system of the second imaging device and the world coordinate system.

[0081] It should be understood that, although Figure 2 the steps in the flowchart of FIG. 1 are shown in a sequential order following the arrows, the steps are not necessarily executed in the order shown by the arrows. Unless otherwise specified herein, the execution of the steps is not necessarily limited to the order shown, and the steps can be executed in other orders. Moreover, Figure 2 at least a part of the steps in the flowchart of FIG. 1 can include multiple steps or multiple stages, which are not necessarily executed at the same time, but can be executed at different times, and the execution order of the steps or stages is not necessarily sequential, but can be round-robin or alternately executed with other steps or steps or stages in other steps.

[0082] Based on the same inventive concept, in one embodiment, as Figure 3 , Figure 4 and Figure 8 indicated, the present application provides a mura defect positioning system, comprising: a first imaging component 31 and a processing component 32. The first imaging component 31 is used to acquire an oblique view image 22 and a front view image 21 of a to-be-tested screen body 13, wherein the oblique view image 22 is a display area image under an oblique viewing angle, and the front view image 21 is a display area image under a vertical viewing angle; the processing component 32 is connected with the first imaging component 31, and is used to obtain first position information of a mura defect in the oblique view image 22, convert the first position information into second position information in the front view image 21 according to a position conversion relationship between the oblique view image 22 and the front view image 21, and obtain target position information of the mura defect according to the second position information.

[0083] The first imaging assembly 31 can include an imaging camera, which is used to collect the image of the screen 13 in the normal direction and the oblique direction to obtain the normal view image 21 and the oblique view image 22 of the screen 13. The first imaging assembly 31 can also include a normal view camera and an oblique view camera. The optical axis of the normal view camera is perpendicular to the screen 13, and the optical axis of the oblique view camera is arranged obliquely relative to the screen 13. Thus, the normal view image 21 of the screen 13 is collected by the normal view camera, and the oblique view image 22 of the screen 13 is collected by the oblique view camera. In the application, the first imaging assembly 31 can be calibrated by using a standard chessboard calibration board to obtain the position transformation relationship of the normal view image 21 and the oblique view image 22.

[0084] Specifically, after the first imaging assembly 31 collects the oblique view image 22 and the normal view image 21 of the screen 13, the oblique view image 22 and the normal view image 21 are transmitted to the processing assembly 32. When the processing assembly 32 receives the oblique view image 22 and the normal view image 21 collected by the first imaging assembly 31, the processing assembly 32 detects the mura defect in the oblique view image 22 to obtain the first position information of the mura defect in the oblique view image 22. Then, according to the position transformation relationship of the oblique view image 22 and the normal view image 21, the first position information is converted into the second position information in the normal view image 21, and the target position information is obtained by processing the second position information, that is, the position of the mura defect in the display area of the screen is obtained, and then the position corresponding to the mura defect in the screen can be positioned comprehensively and accurately.

[0085] The mura defect positioning system described above can obtain the first position information of the mura defect in the oblique view image 22 through the processing assembly 32 after the first imaging assembly 31 collects the oblique view image 22 and the normal view image 21 of the screen 13. According to the position transformation relationship of the oblique view image 22 and the normal view image 21, the first position information can be converted into the second position information in the normal view image 21, so that the mura defect in the oblique view image 22 is converted into the normal view image 21, and the defects that cannot be observed in the normal view angle are avoided from being missed. According to the second position information, the target position information of the mura defect can be obtained, and the position corresponding to the mura defect in the screen can be positioned comprehensively and accurately.

[0086] In one embodiment, as shown in FIG. 1, the mura defect positioning system further includes a second imaging assembly 33, which is used to collect a normal view pixel image 23 of the screen 13. The normal view pixel image 23 includes sub-pixel images of the display area of the screen. The processing assembly 32 is connected with the second imaging assembly 33, and the processing assembly 32 is further used to locate the sub-pixel with the mura defect corresponding to the target position information according to the position mapping relationship of the normal view image 21 and the normal view pixel image 23. Figure 3 Figures 5 to 7 Figure 9 In one embodiment, as shown in FIG. 1, the mura defect positioning system further includes a second imaging assembly 33, which is used to collect a normal view pixel image 23 of the screen 13. The normal view pixel image 23 includes sub-pixel images of the display area of the screen. The processing assembly 32 is connected with the second imaging assembly 33, and the processing assembly 32 is further used to locate the sub-pixel with the mura defect corresponding to the target position information according to the position mapping relationship of the normal view image 21 and the normal view pixel image 23.​​

[0087] The second imaging component 33 can include a high-resolution camera.

[0088] Specifically, after the second imaging component 33 collects the front-view pixel image 23 of the screen body 13, the front-view pixel image 23 is transmitted to the processing component 32. The processing component 32 determines the position information of the target position information in the front-view pixel image 23 according to the position mapping relationship between the front-view image 21 and the front-view pixel image 23. Since the front-view pixel image 23 includes the sub-pixel images of the screen display area, the position information of the defective sub-pixel corresponding to the target position information can be determined according to the position mapping relationship between the front-view image 21 and the front-view pixel image 23, and the defective sub-pixel is the sub-pixel corresponding to the mura defect. Therefore, the position of the sub-pixel corresponding to the mura defect is determined, and the position of the sub-pixel corresponding to the mura defect is accurately located.

[0089] In an embodiment, the processing component 32 is further configured to obtain the screen display area contour and feature points of the front-view image 21 and the front-view pixel image 23, match the screen display area contour and feature points of the front-view image 21 and the front-view pixel image 23, and obtain the position mapping relationship between the front-view image 21 and the front-view pixel image 23.

[0090] The edge line of the screen display area of the front-view image 21 and the front-view pixel image 23 can be determined by detecting the color value of the pixels in the front-view image 21 and the front-view pixel image 23, so as to obtain the screen display area contour of the front-view image 21 and the front-view pixel image 23. The feature points in the front-view image 21 can be the edge points of the screen display area of the front-view image 21, and similarly, the feature points in the front-view pixel image 23 can be the edge points of the screen display area of the front-view pixel image 23. It should be noted that the feature points in the front-view image 21 and the corresponding feature points in the front-view pixel image 23 should correspond to the same point of the screen display area.

[0091] It can be understood that the proportional relationship between the front-view image 21 and the front-view pixel image 23 can be determined according to the screen display area contour of the front-view image 21 and the screen display area contour of the front-view pixel image 23, and the position conversion relationship between the front-view image 21 and the front-view pixel image 23 can be determined according to the position information of the feature points in the front-view image 21 and the position information of the corresponding feature points in the front-view pixel image 23, and the position mapping relationship between the front-view image 21 and the front-view pixel image 23, i.e., the position correspondence relationship between the pixels of the front-view image 21 and the screen sub-pixels of the front-view pixel image 23, can be determined according to the proportional relationship and the position conversion relationship between the front-view image 21 and the front-view pixel image 23. Therefore, based on the position mapping relationship, the position information of the defective sub-pixel corresponding to the target position information can be obtained, and the position of the sub-pixel corresponding to the mura defect is accurately located.

[0092] It should be noted that the position information in the present application can include coordinate information.

[0093] In one embodiment, a computer device is provided, which can be a terminal, and an internal structure diagram thereof can be as shown in Figure 10 The computer device includes a processor, a memory, an input / output interface, a communication interface, a display unit, and an input device. The processor, the memory, and the input / output interface are connected through a system bus, and the communication interface, the display unit, and the input device are connected to the system bus through the input / output interface. The processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for running the operating system and the computer program in the non-volatile storage medium. The input / output interface of the computer device is configured to exchange information between the processor and external devices. The communication interface of the computer device is configured to perform wired or wireless communication with external terminals. The wireless communication can be achieved through WIFI, mobile cellular network, NFC (Near Field Communication), or other technologies. The computer program is executed by the processor to implement a mura defect positioning method. The display unit of the computer device is configured to form a visually visible picture, which can be a display screen, a projection device, or a virtual reality imaging device. The display screen can be a liquid crystal display screen or an electronic ink display screen. The input device of the computer device can be a touch layer overlaid on the display screen, or a key, trackball, or touchpad arranged on the shell of the computer device, or an external keyboard, touchpad, or mouse, etc.

[0094] Those skilled in the art can understand that Figure 10 The structure shown in the above embodiment is only a block diagram of part of the structure related to the scheme of the present application, and does not constitute a limitation on the computer device to which the scheme of the present application is applied. Specifically, the computer device can include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0095] In one embodiment, a computer device is provided, which includes a memory and a processor. The memory stores a computer program, and the processor executes the computer program to implement the following steps:

[0096] According to the oblique view image of the display area of the to-be-tested screen body, first position information of the mura defect in the oblique view image is acquired, wherein the oblique view image is an image of the display area under an inclined viewing angle;

[0097] According to the position conversion relationship between the oblique view image and the front view image, the first position information is converted into second position information in the front view image, wherein the front view image is an image of the display area under a vertical viewing angle;

[0098] According to the second position information, target position information of the mura defect is obtained.

[0099] In one embodiment, when the processor executes the computer program, the following steps are further implemented: obtaining a front view pixel image of the to-be-tested screen body, wherein the front view pixel image comprises sub-pixel images of a display area of the to-be-tested screen body; and according to a position mapping relationship between the front view image and the front view pixel image, obtaining position information of a defective sub-pixel corresponding to the target position information.

[0100] In one embodiment, when the processor executes the computer program, the following steps are further implemented: obtaining screen display area contours and feature points of the front view image and the front view pixel image; matching the screen display area contours and feature points of the front view image and the front view pixel image to obtain a position mapping relationship between the front view image and the front view pixel image.

[0101] In one embodiment, when the processor executes the computer program, the following steps are further implemented: calibrating the first imaging device and the second imaging device according to a standard checkerboard, wherein the first imaging device is used to collect the front view image and the second imaging device is used to collect the oblique view image; and obtaining a position conversion relationship between the oblique view image and the front view image according to a calibration result.

[0102] In one embodiment, a computer readable storage medium is provided, and the computer readable storage medium stores a computer program. When the computer program is executed by a processor, the following steps are implemented:

[0103] According to an oblique view image of a display area of the to-be-tested screen body, first position information of a mura defect in the oblique view image is obtained, wherein the oblique view image is an image of the display area under an oblique viewing angle;

[0104] According to a position conversion relationship between the oblique view image and the front view image, the first position information is converted into second position information in the front view image, wherein the front view image is an image of the display area under a vertical viewing angle;

[0105] According to the second position information, target position information of the mura defect is obtained.

[0106] In one embodiment, when the processor executes the computer program, the following steps are further implemented: obtaining a front view pixel image of the to-be-tested screen body, wherein the front view pixel image comprises sub-pixel images of a display area of the to-be-tested screen body; and according to a position mapping relationship between the front view image and the front view pixel image, obtaining position information of a defective sub-pixel corresponding to the target position information.

[0107] In one embodiment, when the processor executes the computer program, the following steps are further implemented: obtaining screen display area contours and feature points of the front view image and the front view pixel image; matching the screen display area contours and feature points of the front view image and the front view pixel image to obtain a position mapping relationship between the front view image and the front view pixel image.

[0108] In one embodiment, the computer program, when executed by the processor, further implements the following steps: calibrating the first imaging device and the second imaging device according to a standard checkerboard, wherein the first imaging device is used to collect the front view image, and the second imaging device is used to collect the oblique view image; and obtaining a position conversion relationship between the oblique view image and the front view image according to a calibration result.

[0109] In one embodiment, a computer program product is provided, comprising a computer program which, when executed by the processor, implements the following steps:

[0110] obtaining first position information of the mura defect in the oblique view image according to an oblique view image of a display area of the to-be-tested screen body, wherein the oblique view image is an image of the display area under an oblique viewing angle;

[0111] converting the first position information into second position information in the front view image according to the position conversion relationship between the oblique view image and the front view image, wherein the front view image is an image of the display area under a vertical viewing angle;

[0112] obtaining target position information of the mura defect according to the second position information.

[0113] In one embodiment, the computer program, when executed by the processor, further implements the following steps: obtaining a front view pixel image of the to-be-tested screen body, wherein the front view pixel image comprises sub-pixel images of the display area of the to-be-tested screen body; and obtaining position information of a defective sub-pixel corresponding to the target position information according to a position mapping relationship between the front view image and the front view pixel image.

[0114] In one embodiment, the computer program, when executed by the processor, further implements the following steps: obtaining a screen body display area contour and a feature point of the front view image and the front view pixel image; matching the screen body display area contour and the feature point of the front view image and the front view pixel image to obtain a position mapping relationship between the front view image and the front view pixel image.

[0115] In one embodiment, the computer program, when executed by the processor, further implements the following steps: calibrating the first imaging device and the second imaging device according to a standard checkerboard, wherein the first imaging device is used to collect the front view image, and the second imaging device is used to collect the oblique view image; and obtaining a position conversion relationship between the oblique view image and the front view image according to a calibration result.

[0116] It should be noted that the user information (including but not limited to user equipment information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in the present application are all information and data authorized by the user or authorized by all parties, and the collection, use and processing of related data need to comply with relevant laws, regulations and standards of relevant countries and regions.

[0117] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a non-volatile computer readable storage medium, and when the computer program is executed, the processes of the above-mentioned embodiments of the methods can be included. Any reference to memory, storage, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory or optical memory. Volatile memory can include random access memory (RAM) or external cache memory. As an illustration but not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM).

[0118] In the description of the present specification, the description of the terms "some embodiments", "other embodiments", "ideal embodiments" and the like means that the specific features, structures, materials or characteristics described in conjunction with the embodiments or examples are included in at least one embodiment or example of the present application. In the present specification, the illustrative description of the above terms does not necessarily refer to the same embodiment or example.

[0119] The technical features of the above embodiments can be combined arbitrarily. In order to make the description simple, all possible combinations of the technical features in the above embodiments are not described, but as long as the combination of the technical features does not exist, it should be considered as the scope of the present specification.

[0120] The above embodiments only express several implementation manners of the present application, and the description is more specific and detailed, but it should not be understood as a limitation on the scope of the patent. It should be pointed out that for ordinary skilled in the art, without departing from the concept of the present application, a number of modifications and improvements can be made, which are all within the scope of the present application. Therefore, the protection scope of the patent of the present application should be subject to the appended claims.

Claims

1. A mura defect positioning method, characterized in that, The method comprises the following steps: obtaining first position information of a mura defect in a slant view image of a display area of a to-be-tested screen body, wherein the slant view image is a display area image under a slant viewing angle; converting the first position information into second position information in an orthographic view image according to a position conversion relationship between the slant view image and the orthographic view image of the display area of the to-be-tested screen body, wherein the orthographic view image is a display area image under a vertical viewing angle; obtaining target position information of the mura defect according to the second position information; obtaining an orthographic pixel image of the to-be-tested screen body, wherein the orthographic pixel image comprises sub-pixel images of the display area of the to-be-tested screen body; obtaining a screen body display area contour and a feature point of the orthographic view image and the orthographic pixel image; determining a proportional relationship between the orthographic view image and the orthographic pixel image according to the screen body display area contour of the orthographic view image and the screen body display area contour of the orthographic pixel image, determining a position conversion relationship between the orthographic view image and the orthographic pixel image according to position information of the feature point of the orthographic view image and position information of the corresponding feature point of the orthographic pixel image, and determining a position mapping relationship between the orthographic view image and the orthographic pixel image according to the proportional relationship and the position conversion relationship between the orthographic view image and the orthographic pixel image; locating a sub-pixel with the mura defect corresponding to the target position information according to the position mapping relationship between the orthographic view image and the orthographic pixel image.

2. The mura defect positioning method of claim 1, wherein, The method further comprises the following steps before the step of obtaining the first position information of the mura defect in the slant view image of the display area of the to-be-tested screen body: calibrating a first imaging device and a second imaging device according to a standard checkerboard, wherein the first imaging device is used to collect the orthographic view image, and the second imaging device is used to collect the slant view image; 3. The mura defect positioning method according to claim 1 or 2, characterized in that, obtaining the position conversion relationship between the slant view image and the orthographic view image according to a calibration result. The method further comprises the following steps before the step of obtaining the first position information of the mura defect in the slant view image of the display area of the to-be-tested screen body: calibrating a first imaging device and a second imaging device according to a standard checkerboard, wherein the first imaging device is used to collect the orthographic view image, and the second imaging device is used to collect the slant view image; 4. The mura defect positioning method of claim 3, wherein, obtaining the position conversion relationship between the slant view image and the orthographic view image according to a calibration result. The method further comprises the following steps before the step of obtaining the first position information of the mura defect in the slant view image of the display area of the to-be-tested screen body: calibrating a first imaging device and a second imaging device according to a standard checkerboard, wherein the first imaging device is used to collect the orthographic view image, and the second imaging device is used to collect the slant view image; obtaining the position conversion relationship between the slant view image and the orthographic view image according to a calibration result.

5. A mura defect localization system, comprising: The method further comprises the following steps before the step of obtaining the first position information of the mura defect in the slant view image of the display area of the to-be-tested screen body: calibrating a first imaging device and a second imaging device according to a standard checkerboard, wherein the first imaging device is used to collect the orthographic view image, and the second imaging device is used to collect the slant view image; obtaining the position conversion relationship between the slant view image and the orthographic view image according to a calibration result. The method further comprises the following steps before the step of obtaining the first position information of the mura defect in the slant view image of the display area of the to-be-tested screen body: calibrating a first imaging device and a second imaging device according to a standard checkerboard, wherein the first imaging device is used to collect the orthographic view image, and the second imaging device is used to collect the slant view image; obtaining the position conversion relationship between the slant view image and the orthographic view image according to a calibration result. The method further comprises the following steps before the step of obtaining the first position information of the mura defect in the slant view image of the display area of the to-be-tested screen body: calibrating a first imaging device and a second imaging device according to a standard checkerboard, wherein the first imaging device is used to collect the orthographic view image, and the second imaging device is used to collect the slant view image; obtaining the position conversion relationship between the slant view image and the orthographic view image according to a calibration result. The method further comprises the following steps before the step of obtaining the first position information of the mura defect in the slant view image of the display area of the to-be-tested screen body: calibrating a first imaging device and a second imaging device according to a standard checkerboard, wherein the first imaging device is used to collect the orthographic view image, and the second imaging device is used to collect the slant view image; obtaining the position conversion relationship between the slant view image and the orthographic view image according to a calibration result. a second imaging component configured to acquire each orthographic pixel image of a display area of the to-be-tested screen body, wherein the orthographic pixel image comprises each sub-pixel image of the display area of the to-be-tested screen body; a processing component connected to the first imaging component, configured to acquire first position information of the mura defect in the oblique view image, convert the first position information into second position information in the orthographic view image according to a position conversion relationship between the oblique view image and the orthographic view image, and acquire target position information of the mura defect according to the second position information; acquire screen display area contours and feature points of the orthographic view image and the orthographic pixel image, determine a proportional relationship between the orthographic view image and the orthographic pixel image according to the screen display area contours of the orthographic view image and the screen display area contours of the orthographic pixel image, determine a position conversion relationship between the orthographic view image and the orthographic pixel image according to position information of the feature points of the orthographic view image and position information of corresponding feature points of the orthographic pixel image, and determine a position mapping relationship between the orthographic view image and the orthographic pixel image according to the proportional relationship and the position conversion relationship between the orthographic view image and the orthographic pixel image; and locate the sub-pixel with the mura defect corresponding to the target position information according to the position mapping relationship between the orthographic view image and the orthographic pixel image.

6. The mura defect localization system of claim 5, wherein, The first imaging component comprises: an orthographic camera configured to acquire an orthographic view image of the to-be-tested screen body; an oblique camera configured to acquire an oblique view image of the to-be-tested screen body.

7. The mura defect localization system of claim 6, wherein, An optical axis of the orthographic camera is perpendicular to the to-be-tested screen body, and an optical axis of the oblique camera is arranged obliquely relative to the to-be-tested screen body.

8. A computer device comprising a memory and a processor, the memory storing a computer program, characterized in that, The processor implements the steps of the method of any one of claims 1 to 4 when executing the computer program.

9. A computer-readable storage medium having stored thereon a computer program, characterized in that, The computer program, when executed by the processor, implements the steps of the method of any one of claims 1 to 4.

10. A computer program product comprising a computer program, characterized in that, The computer program, when executed by the processor, implements the steps of the method of any one of claims 1 to 4.

Images