Mini LED Lens glue layer morphology measurement method and system

Abstract

The present invention provides a method and system for measuring the topography of a Mini LED lens adhesive layer. The method comprises: capturing a Mini LED with a distributed camera to obtain multiple first target images; processing the multiple first target images to obtain a second target image; and determining a topography measurement result of the Mini LED lens adhesive layer based on the second target image. The aforementioned method makes lens adhesive layer topography measurement more efficient and convenient, facilitating large-area lens adhesive layer topography inspection.

Description

Technical Field

[0001] The present application relates to the general field of image data processing technology, and in particular to a method and system for measuring the glue layer morphology of a Mini LED Lens. Background Art

[0002] Mini LEDs are a more efficient and energy-efficient backlighting solution for liquid crystal displays (LCDs). Compared to standard LEDs, Mini LEDs have a chip size of 0.008 inches (200 μm), approximately one-fifth the size of standard LEDs. This smaller size allows for more Mini LEDs to be packed together within a single area. Compared to traditional LCDs, this provides a greater number of discrete dimming zones, enabling more targeted and precise backlight control. This improves LCD backlight leakage and uneven backlighting, providing greater contrast. Adding a transparent gel to the Mini LED surface as an optical lens allows for more uniform light distribution and a wider illumination range, meeting the industry's trend toward larger Mini LED panel sizes.

[0003] During Mini LED product production, it is necessary to perform topographical measurement of the lens adhesive layer on the Mini LED to determine whether it meets the standards. However, there is currently no convenient and efficient method to perform topographical measurement of the lens adhesive layer on the Mini LED, making it impossible to perform topographical measurement of the lens adhesive layer on a large area after product production. Summary of the Invention

[0004] The embodiments of the present application provide a method and system for measuring the morphology of a Mini LED Lens adhesive layer. 2D and 3D images are obtained by photographing the Mini LED with a distributed camera, and the morphology measurement results of the Mini LED Lens adhesive layer are determined accordingly. This makes the morphology measurement of the Lens adhesive layer more efficient and convenient, and facilitates large-area morphology detection of the Lens adhesive layer.

[0005] In a first aspect, an embodiment of the present application provides a method for measuring the morphology of a Mini LED Lens glue layer, the method comprising: photographing a Mini LED with a distributed camera to obtain multiple first target images, wherein the Mini LED is covered with a Lens glue layer and the Mini LED is illuminated by a composite light source, the composite light source comprising a line laser light source and a natural light source, and each first target image comprises a first area corresponding to the line laser light source and a second area corresponding to the natural light source; processing the multiple first target images to obtain a second target image, wherein the second target image comprises a 3D image corresponding to the Mini LED composed of multiple first areas, and a 2D image corresponding to the Mini LED composed of multiple second areas; determining a morphology measurement result of the Lens glue layer of the Mini LED based on the second target image, wherein the morphology measurement result comprises a first measurement result corresponding to the 3D image and a second measurement result corresponding to the 2D image.

[0006] As can be seen, in the embodiment of the present application, a distributed camera captures the Mini LED to obtain multiple first target images; these multiple first target images are processed to obtain a second target image; and the topography measurement results of the Mini LED lens adhesive layer are determined based on the second target image. The aforementioned method makes the topography measurement of the lens adhesive layer more efficient and convenient, facilitating large-scale lens adhesive layer topography inspection.

[0007] In a second aspect, embodiments of the present application provide a Mini LED Lens glue layer profile measurement system, which includes an acquisition device, a processor, and a memory. The acquisition device includes distributed cameras, each of which is equipped with a composite light source. The composite light source includes a line laser light source and a natural light source, wherein:

[0008] The acquisition device captures the Mini LED along its capture path, thereby obtaining a plurality of first target images, and storing the plurality of first target images in a memory. The Mini LED is covered with a lens adhesive layer, and during the capture process, a composite light source on the acquisition device is used to illuminate the Mini LED. Each first target image includes a first region corresponding to the line laser light source and a second region corresponding to the natural light source.

[0009] The processor calls multiple first target images in the memory and processes the multiple first target images to obtain a second target image, and then determines the morphology measurement result of the Mini LED Lens glue layer based on the second target image, wherein the second target image includes a 3D image corresponding to the Mini LED composed of multiple first areas and a 2D image corresponding to the Mini LED composed of multiple second areas. The morphology measurement result includes a first measurement result corresponding to the 3D image and a second measurement result corresponding to the 2D image.

[0010] In a third aspect, an embodiment of the present application provides a computer-readable storage medium, in which program data is stored. When the program data is executed by a processor, the program data is used to execute the program data to implement some or all of the steps described in the first aspect of the embodiment of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0012] Figure 1 A schematic diagram of the structure of a collection device provided in an embodiment of the present application;

[0013] Figure 2 A schematic diagram of a process for measuring the glue layer morphology of a Mini LED Lens provided in an embodiment of the present application;

[0014] Figure 3 A schematic diagram of the structure of a distributed shooting system provided in an embodiment of the present application;

[0015] Figure 4 A schematic diagram of the structure of a laser imaging system provided in an embodiment of the present application;

[0016] Figure 5 A schematic diagram of the structure of a 2D stitched image provided in an embodiment of the present application;

[0017] Figure 6 A schematic diagram of a 3D imaging structure provided in an embodiment of the present application;

[0018] Figure 7 A schematic diagram of the structure of a 2D image provided in an embodiment of the present application;

[0019] Figure 8 A schematic diagram of the edge profile of a lens adhesive layer provided in an embodiment of the present application;

[0020] Figure 9 This is a structural schematic diagram of a Mini LED Lens glue layer morphology measurement system provided in an embodiment of the present application. DETAILED DESCRIPTION

[0021] In order to enable those skilled in the art to better understand the present invention, the following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0022] The terms "first," "second," and so on, in the specification and claims of this application and the accompanying drawings are used to distinguish between different objects, not to describe a specific order. Furthermore, the terms "including," "having," and any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or apparatus comprising a series of steps is not limited to the listed steps but may optionally include steps not listed, or may optionally include other steps inherent to the process, method, product, or apparatus.

[0023] References herein to "embodiments" mean that a particular feature, structure, or characteristic described in connection with the embodiments may be included in at least one embodiment of the present application. The appearance of this phrase in various places in the specification does not necessarily refer to the same embodiment, nor does it constitute an independent or alternative embodiment that is mutually exclusive of other embodiments. It is understood, both explicitly and implicitly, by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0024] See also Figure 1 , Figure 1 A schematic diagram of the structure of a collection device provided in an embodiment of the present application is shown in FIG. Figure 1 As shown, the acquisition device includes a line laser light source 101, a camera 102, and a natural light source 103. The line laser light source 101, the camera 102, and the natural light source 103 are fixed on the same frame, and the shooting angle or illumination angle between the three can be freely adjusted. However, the adjustment of the angle is before the detection work occurs, that is, when the detection work is carried out, the angle between the three is fixed. When the line laser light source 101 and the natural light source 103 are working, there will be a position offset a when they illuminate the Mini LED 12, wherein the Mini LED 12 is covered with a lens glue layer 11, and the visual width of the camera 102 on the object is b, b>a, and the visual width b of the camera 102 is greater than the imaging width when the line laser light source 101 and the natural light source 103 illuminate the object.

[0025] Figure 1 The acquisition device shown is a description of the structure of a single camera in the distributed camera in the acquisition device mentioned in this application, that is, the distributed camera mentioned in this application has multiple cameras such as Figure 1 The camera 102 is shown, and multiple cameras are arranged in a row along the x-axis, and each camera is fixed with a linear laser light source and a natural light source.

[0026] Based on this, an embodiment of the present application provides a method for measuring the glue layer morphology of a Mini LED Lens. The embodiment of the present application is described in detail below with reference to the accompanying drawings.

[0027] See also Figure 2 , Figure 2 A schematic diagram of a process for measuring the morphology of a Mini LED Lens adhesive layer provided in an embodiment of the present application is shown in FIG. Figure 2 As shown, the method includes the following steps:

[0028] Step 201: photograph Mini LEDs using a distributed camera to obtain multiple first target images.

[0029] The Mini LED is covered with a lens adhesive layer and illuminated by a composite light source consisting of a line laser light source and a natural light source. Each first target image includes a first region corresponding to the line laser light source and a second region corresponding to the natural light source. The width of the line laser light source is smaller than that of the natural light source. This Mini LED refers to an LED device with a chip size within the 0.008-inch (200 μm) range.

[0030] The distributed cameras are arranged in a row along the x-axis, with adjacent cameras offset by a fixed amount along the x-axis. This offset is smaller than the field of view of each distributed camera. The field of view covered by the distributed cameras along the x-axis is larger than the lens adhesive layer covering the Mini LEDs, enabling complete x-axis capture of the Mini LEDs and lens adhesive layer, and forming a complete first target image along the x-axis. After completing the x-axis capture, the distributed cameras simultaneously move along the y-axis to fully capture the Mini LEDs and lens adhesive layer along the y-axis, forming multiple first target images.

[0031] For example, see Figure 3 , Figure 3 A structural diagram of a distributed shooting system provided in an embodiment of the present application is shown as follows: Figure 3 As shown, Figure 3It includes a distributed shooting system, wherein the distributed shooting system includes multiple cameras 301, each camera 301 is also fixed with a wired laser light source and a natural light source, the multiple cameras 301 are arranged in a row along the x-axis direction, and there is a fixed offset position between adjacent cameras. The multiple cameras shoot the object at the same time to form a complete target image on the x-axis, and then move horizontally along the y-axis direction to achieve complete shooting of the object on the y-axis to form multiple target images.

[0032] Step 202: Process the multiple first target images to obtain a second target image.

[0033] The second target image includes a 3D image corresponding to the Mini LEDs composed of multiple first areas, and a 2D image corresponding to the Mini LEDs composed of multiple second areas.

[0034] In a feasible embodiment, multiple first target images are processed to obtain a second target image, including: calibrating the distributed camera to determine the y-axis offset, x-axis offset, and overlap between adjacent cameras in the distributed camera; splicing the first areas and the second areas in the multiple first target images along the y-axis direction according to the y-axis offset, x-axis offset, overlap between adjacent cameras, and the correspondence between the distributed camera and the first target image, to obtain a 3D image corresponding to the Mini LED composed of the multiple first areas, and a 2D image corresponding to the Mini LED composed of the multiple second areas; obtaining a position offset between the line laser light source and the natural light source, and aligning the 2D image and the 3D image according to the position offset to obtain the second target image.

[0035] Among them, the distributed cameras are arranged in a row along the x-axis, and there is an x-axis offset between adjacent cameras. Since the viewing width of a single camera is greater than the offset on the x-axis, there is an overlap between adjacent cameras. When the distributed cameras complete the x-axis shooting at the same time, they will move horizontally along the y-axis to form an offset in the y-axis direction. Based on the correspondence between the distributed cameras and the first target image, the first and second areas in the multiple first target images are spliced ​​along the y-axis respectively to generate the complete 2D image and 3D image corresponding to the Mini LED. In industrial production imaging, the 2D image of the Mini LED lens glue layer is elliptical, and the 3D image is semi-ellipsoidal.

[0036] For example, see Figure 4 , Figure 4 A schematic diagram of the structure of a laser imaging system provided in an embodiment of the present application is shown in FIG. Figure 4 As shown, Figure 4It includes the image 401 under the illumination of the line laser light source and the image 402 under the illumination of the natural light source, which are taken by the distributed camera. The first area in the first target image corresponds to the image 401 under the illumination of the line laser light source, and the second area in the first target image corresponds to the image 402 under the illumination of the natural light source. Each pixel in the image 401 under the illumination of the line laser light source corresponds to a different grayscale value, which is determined based on the height data of the position, while the grayscale value corresponding to each pixel in the image 402 under the illumination of the natural light source is determined based on the contour of the position. The offset between the image 401 under the illumination of the line laser light source and the image 402 under the illumination of the natural light source is c. If Figure 4 The imaging in the Figure 1 If the camera is shot at the angle shown, the offset c is equal to the offset a. As can be seen in the figure, the image 401 under the line laser light source and the image 402 under the natural light source are imaged in the x-axis direction. After the camera completes the image in the x-axis direction, it moves horizontally along the y-axis to capture images at other positions along the y-axis. The images in the y-axis direction are then stitched together according to their corresponding shooting positions on the y-axis to form a complete image.

[0037] For example, see Figure 5 , Figure 5 A structural diagram of a 2D spliced ​​image provided in an embodiment of the present application is shown as follows: Figure 5 As shown, Figure 5 It includes multiple natural light source imaging areas 511, and the natural light source imaging area 511 is the above-mentioned Figure 4 The image 402 under the natural light source is the second area in the first target image. Figure 5 The second regions of the multiple first target patterns are stitched together along the y-axis to form a 2D image of the lens adhesive layer. It should be noted that the quasi-circular image of the lens adhesive layer shown below the imaging area 511 in the image is for ease of understanding of the technical solution of this application. The stitched 2D image can reveal the appearance of the lens adhesive layer.

[0038] Among them, for the generation of 2D images, since the product may be uneven on the horizontal plane, such as warping, the bottom plate height of the product will be inconsistent. During the camera shooting process, the height between different positions of the product and the camera will change, resulting in an impact on the image quality in the final image. In this case, during the camera shooting process, the y-axis can be offset from the previous shooting on the y-axis to obtain multiple rows of images, which are spliced ​​into other 2D images, and the image with the largest grayscale mean is selected from all the obtained 2D images as the final 2D image. For example, the first shot is taken at positions 1, 2, 3, etc. corresponding to the y-axis. Then, the second shot can be taken at positions 1.5, 2.5, 3.5, etc., which are offset from the previous shot.

[0039] For example, for the generation of 3D images, please refer to Figure 6 , Figure 6 A schematic diagram of a 3D imaging structure provided in an embodiment of the present application is shown in FIG. Figure 6 As shown, Figure 6 Including a line laser light source irradiating an imaging area 60 on the Mini LED. In the imaging area 60, there is a main reflection light bar 601. That is, when irradiating the Mini LED, due to the light transmittance of the Lens glue layer covering the Mini LED, a main reflection light bar 601 is formed in the bottom area of ​​the Lens glue layer. At this time, we first extract the main reflection light bar 601, and then search upward for a light bar that meets the linear laser light intensity distribution based on the main reflection light bar 601. The light bar that best meets the linear laser light intensity distribution is the Lens glue layer surface reflection light bar 602. Then, the height data of the Lens glue layer surface reflection light bar 602 is analyzed, and finally a 3D image is generated based on multiple rows of height data. In the above Figure 4 As can be seen from the imaging diagram, the imaging of the line laser light source at this time is different from the above Figure 4 The imaging of the line laser light source is because, for the above Figure 4 The imaging in is to convert the height data of each position into the corresponding grayscale value, and Figure 6 The height data of the imaging is determined by the height of the protrusion of the reflected light strip 602 on the surface of the lens glue layer, and is not converted into a corresponding grayscale value.

[0040] Because there is a fixed offset on the y-axis between the line laser light source imaging and the natural light source imaging when the acquisition device is shooting, it is only necessary to adjust the fixed offset on the y-axis of the 3D image to achieve registration of the 2D image and the 3D image. For example, the 3D image and the 2D image are on the same coordinate axis. If there is a fixed offset d on the y-axis between the line laser light source imaging and the natural light source imaging, and there are n coordinates (xi,yi,zi) in the 3D image, (1<i<n), and to achieve registration of the 2D image and the 3D image, it is only necessary to adjust the fixed offset d on the y-axis of the 3D image. At this time, the n coordinates in the 3D image are (xi,yi+d,zi), (1<i<n).

[0041] In the embodiment of the present application, multiple first target images are processed based on the y-axis offset and x-axis offset between distributed cameras, as well as the overlap between adjacent cameras, to obtain 2D and 3D images corresponding to the Mini LED. These 2D and 3D images are then registered based on the positional offset between the line laser light source and the natural light source. This makes 2D and 3D image registration more convenient and efficient, facilitating the acquisition of 2D and 3D images of large-area diodes.

[0042] Step 203: Determine the topography measurement result of the Mini LED lens glue layer based on the second target image.

[0043] The topography measurement result includes a first measurement result corresponding to the 3D image and a second measurement result corresponding to the 2D image.

[0044] In a feasible embodiment, four image regions of interest (ROIs) are obtained in a 2D image, where two adjacent ROIs among the four ROIs are symmetrical to the remaining two adjacent ROIs; the centroid coordinates of the four ROIs are respectively obtained according to their distribution positions in the 2D image; the coverage coordinates of the 2D image are determined according to the coordinates in the range covered by the distribution of the centroid coordinates of the four ROIs in the x-axis and y-axis directions; the coverage coordinates of the 3D image are obtained according to the coverage coordinates of the 2D image; second priori information of the lens glue layer is obtained, the second priori information including a grayscale value threshold and a lens glue layer height threshold; non-glue points are eliminated from the coverage coordinates of the 2D image and the coverage coordinates of the 3D image according to the second priori information to obtain the initial positioning coordinates of the 2D image and the 3D image, where the non-glue points include coverage coordinates with grayscale values ​​greater than the grayscale value threshold in the coverage coordinates of the 2D image, and coverage coordinates with a lens glue layer thickness less than the lens glue layer height threshold in the coverage coordinates of the 3D image.

[0045] Among them, before calculating the morphology measurement result of the Mini LED Lens glue layer based on the second target image, it is necessary to first determine the initial positioning coordinates of the 2D image and 3D image in the second target image, and perform subsequent calculations based on the initial positioning coordinates.

[0046] First, four regions of interest (ROIs) need to be selected in the 2D image. The relationship between the four ROIs is symmetrical, such that two adjacent ROIs are symmetrical with the other two adjacent ROIs. An ROI is an area to be processed that is outlined in the image being processed using a box, circle, ellipse, irregular polygon, or other method. In this embodiment, the ROI size is primarily determined based on the pixel size. However, since the ROI is selected for a single lens layer in the 2D image, the pixel size corresponding to the ROI is the pixel size of the single lens layer in the 2D image, and its outline is primarily a circle or an ellipse.

[0047] After selecting four ROIs, the centroid coordinates corresponding to the four ROIs are found according to their distribution in the 2D image, and the coverage coordinates of the 2D image are determined according to the coordinates of the centroid coordinates of the four ROIs in the range covered by the x-axis and y-axis directions.

[0048] For example, see Figure 7 , Figure 7 A schematic diagram of a 2D image structure provided in an embodiment of the present application is shown in FIG. Figure 7 As shown, Figure 7 A 2D image 70 is included, wherein the 2D image is an image of 20 diodes. Four ROIs 701 can be selected, each of which is symmetrical with two adjacent ROIs and two other adjacent ROIs. After the four ROIs 701 are selected, the coverage coordinates of the 2D image are determined based on the coordinates of the centroids of the four ROIs 701 within the range covered by the x-axis and y-axis directions. That is, the coverage coordinates of the 2D image are the coordinates within this coverage range.

[0049] Since the 2D and 3D images have already been registered, the corresponding coverage coordinates in the 3D image can be obtained based on the coverage coordinates of the 2D image. That is, the coordinates corresponding to the positions in the 3D image corresponding to the coverage coordinates of the 2D image. Here, second prior information of the lens adhesive layer is obtained, that is, basic information of the standard product known before product inspection. The second prior information includes the grayscale value threshold of the 2D image and the height threshold of the lens adhesive layer. The height threshold of the lens adhesive layer is a threshold set based on the prior height of the lens adhesive layer. For example, if the prior height of the lens adhesive layer is h, then a height threshold of 0.6h can be set based on the prior height of the lens adhesive layer. The coverage coordinates of the 2D and 3D images corresponding to grayscale values ​​greater than the grayscale value threshold and the coverage coordinates corresponding to 3D image height values ​​less than the diode height threshold are removed from the coverage coordinates of the 2D and 3D images to obtain the initial positioning coordinates of the 2D and 3D images.

[0050] In the embodiment of the present application, the coverage coordinates of the 2D image are determined based on the centroid coordinates of the four ROIs in the 2D image. The coverage coordinates of the 3D image are then determined based on the coverage coordinates of the 2D image. The coverage coordinates of the obtained 2D and 3D images are then verified based on the second prior information of the lens adhesive layer. The coordinates of non-adhesive points are removed to obtain the initial positioning coordinates of the 2D and 3D images. Using this method, more accurate positioning coordinates of the 2D and 3D images can be obtained, facilitating subsequent topography measurement of the lens adhesive layer.

[0051] In a feasible embodiment, the morphological measurement result of the lens glue layer of the Mini LED is determined according to the second target image, including: obtaining the first prior information of the 2D image of the lens glue layer of the Mini LED and the pixel size of the Mini LED, the first prior information of the 2D image includes the morphological parameters, pixel size and grayscale value of the standard 2D image of the lens glue layer; generating a matching model according to the first prior information of the 2D image and the pixel size of the Mini LED, matching the matching model with the 2D image to generate a matching result, and determining the centroid position of the Mini LED according to the matching result; performing gradient calculation on the 2D image, and determining the pixel coordinates of the edge contour of the lens glue layer corresponding to the Mini LED in the 2D image according to the change of the gradient value; determining the edge contour of the lens glue layer corresponding to the Mini LED in the 2D image according to the pixel coordinates of the edge contour, and obtaining the centroid position, major axis diameter and minor axis diameter of the lens glue layer according to the edge contour of the lens glue layer corresponding to the Mini LED; according to the Mini The centroid position, major axis diameter, and minor axis diameter of the LED and lens adhesive layer are used to calculate a second measurement result corresponding to the 2D image. The second measurement result includes one or more of the following: roundness, diameter, area, and eccentricity of the lens adhesive layer.

[0052] Among them, based on the morphological parameters, pixel size and grayscale value of the standard 2D image of the lens glue layer and the pixel size of the Mini LED, the grayscale value and pixel size corresponding to the Mini LED in the standard 2D image can be known, and the image of the Mini LED corresponding to the standard 2D image is used as a matching model. The matching model is matched with the obtained 2D image. This matching can be a template matching based on grayscale value, that is, the matching model and the 2D image are matched for grayscale value similarity. The grayscale value similarity can be determined based on the size of the sum of the absolute values ​​of the pixel grayscale value differences between the images. That is, the smaller the size of the sum of the absolute values ​​of the pixel grayscale value differences between the images, the greater the grayscale value similarity. Based on this method, the image area with the greatest grayscale value similarity with the matching model can be matched, and the centroid position of this image area is used as the centroid position of the Mini LED. The centroid coordinates (x1, y1) of the Mini LED can also be obtained based on the corresponding coordinates of the Mini LED centroid position in the initial positioning coordinates of the 2D image obtained by the above embodiment.

[0053] Perform gradient calculation on the 2D image, and determine the pixel coordinates of the edge contour of the lens glue layer corresponding to the Mini LED in the 2D image based on the change in the gradient value. There are many ways to determine the pixel coordinates of its edge contour through gradient calculation, such as determining the pixel coordinates of its edge contour through the Soble operator, or determining the pixel coordinates of its edge contour through the Laplace algorithm, which are not listed here. After determining the pixel coordinates of the edge contour of the lens glue layer corresponding to the Mini LED in the 2D image, the edge contour of the lens glue layer corresponding to the Mini LED in the 2D image is determined based on the pixel coordinates of the edge contour. According to the edge contour of the lens glue layer, the centroid position, major axis diameter, and minor axis diameter of the lens glue layer can be determined, and the centroid coordinates (x2, y2) of the lens glue layer are determined based on the initial positioning coordinates of the 2D image obtained by the above embodiment.

[0054] For example, see Figure 8 , Figure 8 This is a schematic diagram of the edge profile of a lens adhesive layer provided in an embodiment of the present application, as shown in FIG. Figure 8 As shown, Figure 8 It includes the image area 80 where the grayscale value similarity between the matching model and the 2D image is the greatest, and the centroid position 801 of the Mini LED obtained based on the image area 80. The gradient value is calculated with the centroid position 801 of the Mini LED as the origin to determine the pixel coordinates of the edge contour corresponding to the position 81 in the 2D image.

[0055] After determining the centroid coordinates, major axis diameter, and minor axis diameter of the lens glue layer, the eccentricity of the lens glue layer is determined based on the centroid coordinates (x2, y2) of the lens glue layer and the centroid coordinates (x1, y1) of the Mini LED. The roundness of the lens layer is , where D1 is the major axis diameter and D2 is the minor axis diameter. The area of ​​the Lens glue layer is .

[0056] In an embodiment of the present application, a matching model is generated based on first prior information of the 2D image of the lens adhesive layer and the pixel size of the Mini LED. This model is then matched with the 2D image and the centroid position of the Mini LED in the 2D image is determined based on the matching result. A gradient calculation is performed on the 2D image to determine the pixel values ​​of the edge contour. The edge contour of the lens adhesive layer corresponding to the Mini LED in the 2D image is then determined based on the pixel values ​​of the edge contour. The centroid position, major axis diameter, and minor axis diameter of the lens adhesive layer are then determined based on this edge contour, and a second measurement result is calculated based on this. Using the aforementioned method, the edge contour of the lens adhesive layer in the 2D image can be accurately located and the second measurement result can be obtained.

[0057] In a feasible embodiment, the morphological measurement results of the lens glue layer of the Mini LED are determined based on the second target image, including: determining the highest point in the 3D image, and determining the thickness of the lens glue layer based on the distance from the highest point to the bottom surface of the lens glue layer; obtaining the first measurement result corresponding to the 3D image based on the thickness and the major axis diameter and the minor axis diameter, and the first measurement result includes one or more of the following: the thickness and volume of the lens glue layer.

[0058] After the initial positioning coordinates of the 3D image are determined according to the above embodiment, the coordinates (x3, y3, z3) of the highest point of the lens adhesive layer in the 3D image are found, and the thickness of the lens adhesive layer is determined based on the distance from the highest point to the bottom surface of the lens adhesive layer. , where A, B, C, and D are the parameters of the bottom surface of the lens glue layer. After determining the thickness Hg of the lens glue layer, the volume of the lens glue layer is determined based on the minor axis diameter D2 and the major axis diameter D1. .

[0059] In the present embodiment, the thickness of the lens adhesive layer is determined based on the distance from the highest point of the lens adhesive layer to its bottom surface in the 3D image. The volume of the lens adhesive layer is then calculated based on the thickness, major axis diameter, and minor axis diameter of the lens adhesive layer. This method accurately determines the thickness and volume of the lens adhesive layer even when the bottom surface of the lens adhesive layer is not at the same level as the horizontal plane, thereby improving the accuracy of the second measurement result.

[0060] In a feasible embodiment, under the premise of ensuring that the distributed camera can fully capture the imaging of the line laser light source and the natural light source, the shooting angle of the camera in the distributed camera is adjusted, the MiniLED is photographed at different camera shooting angles, and the captured images are processed as described above to obtain multiple other morphology measurement results; the third priori information of the lens glue layer is obtained, and the third priori information includes the thickness of the lens glue layer; the thickness of the lens glue layer existing in the multiple other morphology measurement results is compared with the thickness of the lens glue layer in the third priori information, and the target other morphology measurement result corresponding to the data closest to the thickness of the lens glue layer in the third priori information is used as the morphology measurement result of the lens glue layer.

[0061] Among them, since the camera in the distributed camera is between the line laser light source and the natural light source, changing the camera angle can change the shooting angle of the line laser light source and the natural light source. Different from dual cameras shooting two light sources, if the angle needs to be adjusted, it is necessary to consider the impact of the adjusted angles of the two cameras on the data. It can be understood that each adjusted angle needs to be highly calibrated to obtain the true height corresponding to the distance on the image, specifically the actual height corresponding to the imaging distance of the image obtained by the camera at each angle. Shooting at different angles can avoid the obstruction of objects that causes incomplete imaging of the line laser light source and natural light source captured by the camera, and the imaging of the line laser light source captured at different angles on the object will also change. You can refer to here. Figure 6 That is, different angles will cause the height between the main reflection light strip 601 and the reflection light strip 602 on the surface of the lens glue layer to change. If the data obtained under a certain angle is shot, the height displayed on the image is very small, which will lead to a decrease in measurement accuracy, resulting in a large error in the final morphological parameter data. In addition, due to the influence of the transmittance of the lens glue layer, the error in the obtained data is even greater.

[0062] After obtaining multiple data from different angles, since the thickness of the lens adhesive layer is directly affected by the shooting at different angles, the thickness of the lens adhesive layer in the multiple other topography measurement results can be compared with the thickness of the lens adhesive layer in the third prior information. To eliminate the impact of measurement errors on the measurement results and lead to a determination of product quality failure, in this embodiment, the target other topography measurement result corresponding to the lens adhesive layer thickness data among the multiple other topography measurement results that is closest to the lens adhesive layer thickness data in the third prior information is used as the final lens adhesive layer topography measurement result.

[0063] In an embodiment of the present application, by adjusting the angle of the camera, it is possible to simultaneously capture the line laser light source and the natural light source at different angles, and based on this, multiple shots are performed to obtain multiple other topography measurement results. A set of target other topography measurement results whose thickness of the lens adhesive layer is closest to the thickness of the standard lens adhesive layer among the multiple other topography measurement results is used as the topography measurement result of the lens adhesive layer, thereby eliminating measurement errors that may lead to the determination that the product quality is unqualified.

[0064] As can be seen, in the embodiment of the present application, a distributed camera captures the Mini LED to obtain multiple first target images; these multiple first target images are processed to obtain a second target image; and the topography measurement results of the Mini LED lens adhesive layer are determined based on the second target image. The aforementioned method makes lens adhesive layer topography measurement more efficient and convenient, facilitating large-area lens adhesive layer topography inspection.

[0065] In accordance with the above-mentioned embodiment, please refer to Figure 9 , Figure 9 This is a schematic diagram of the structure of a Mini LED Lens glue layer profile measurement system provided in an embodiment of the present application. The Mini LED Lens glue layer profile measurement system 90 includes an acquisition device 901, a processor 902, a memory 903, and a controller 904. The acquisition device 901 includes distributed cameras, each of which is equipped with a composite light source. The composite light source includes a line laser light source and a natural light source. The system includes:

[0066] The acquisition device 901 captures the Mini LED along its capture path, thereby obtaining a plurality of first target images, and stores the plurality of first target images in the memory 903. The Mini LED is covered with a lens adhesive layer, and during the capture process, the composite light source on the acquisition device 901 is used to illuminate the Mini LED. Each first target image includes a first region corresponding to the line laser light source and a second region corresponding to the natural light source.

[0067] The processor 902 calls the multiple first target images in the memory 903 and processes the multiple first target images to obtain a second target image. The processor 902 then determines a topographical measurement result of the Mini LED lens glue layer based on the second target image. The second target image includes a 3D image corresponding to the Mini LED composed of the multiple first regions and a 2D image corresponding to the Mini LED composed of the multiple second regions. The topographical measurement result includes a first measurement result corresponding to the 3D image and a second measurement result corresponding to the 2D image.

[0068] The controller 904 determines whether the Mini LED Lens glue layer meets the customer standard based on the customer standard and the morphology measurement result of the Mini LED Lens glue layer.

[0069] In a feasible embodiment, the processor 902 processes multiple first target images to obtain a second target image, including: the processor 902 calibrates the distributed camera in the acquisition device 901 to determine the y-axis offset, x-axis offset, and overlap between adjacent cameras in the distributed camera; the processor 902 splices the first areas and the second areas in the multiple first target images along the y-axis direction according to the y-axis offset, x-axis offset, overlap between adjacent cameras, and the correspondence between the distributed camera and the first target image, to obtain a 3D image corresponding to the Mini LED composed of the multiple first areas, and a 2D image corresponding to the Mini LED composed of the multiple second areas; the processor 902 determines the position offset between the line laser light source and the natural light source based on the first target image, and aligns the 2D image and the 3D image according to the position offset to obtain the second target image.

[0070] In a feasible embodiment, the processor 902 determines the topography measurement result of the Mini LED lens glue layer based on the second target image, including:

[0071] The processor 902 obtains the first prior information of the 2D image of the Mini LED Lens glue layer and the pixel size of the Mini LED from the memory 903. The first prior information of the 2D image includes the morphological parameters, pixel size and grayscale value of the standard 2D image of the Lens glue layer; the processor 902 generates a matching model based on the first prior information of the 2D image and the pixel size of the Mini LED, matches the matching model with the 2D image to generate a matching result, and determines the centroid position of the Mini LED based on the matching result; the processor 902 performs gradient calculation on the 2D image, and determines the pixel coordinates of the edge contour of the Lens glue layer corresponding to the Mini LED in the 2D image based on the change in the gradient value; the processor 902 determines the edge contour of the Lens glue layer corresponding to the Mini LED in the 2D image based on the pixel coordinates of the edge contour, and obtains the centroid position, major axis diameter and minor axis diameter of the Lens glue layer based on the edge contour of the Mini LED; the processor 902 calculates the centroid position, major axis diameter and minor axis diameter of the Lens glue layer based on the Mini LED The centroid position, major axis diameter, and minor axis diameter of the LED and lens adhesive layer are used to calculate a second measurement result corresponding to the 2D image. The second measurement result includes one or more of the following: roundness, diameter, area, and eccentricity of the lens adhesive layer.

[0072] In a feasible embodiment, the processor 902 determines the morphological measurement results of the Mini LED lens glue layer based on the second target image, including: the processor 902 determines the highest point in the 3D image based on the 3D image, and determines the thickness of the lens glue layer based on the distance from the highest point to the bottom surface of the lens glue layer; the processor 902 obtains the first measurement result corresponding to the 3D image based on the thickness and the major axis diameter and the minor axis diameter, and the first measurement result includes one or more of the following: the thickness and volume of the lens glue layer.

[0073] In a feasible embodiment, before the processor 902 matches the matching model with the 2D image to generate a matching result, the processor 902 is further configured to: the processor 902 obtains four image regions of interest (ROIs) in the 2D image according to the 2D image, wherein two adjacent ROIs among the four ROIs are symmetrical with the remaining two adjacent ROIs; the processor 902 obtains the centroid coordinates of the four ROIs according to the distribution positions of the four ROIs in the 2D image; the processor 902 determines the coverage coordinates of the 2D image according to the coordinates of the range covered by the distribution of the centroid coordinates of the four ROIs in the x-axis and y-axis directions ... and the processor 902 obtains the centroid coordinates of the four ROIs according to the distribution positions of the centroid coordinates of the four ROIs in the 2D image. 02 obtains the coverage coordinates of the 3D image according to the coverage coordinates of the 2D image; the processor 902 obtains the second priori information of the lens glue layer from the memory 903, and the second priori information includes a grayscale value threshold and a lens glue layer height threshold; the processor 902 removes non-glue points from the coverage coordinates of the 2D image and the coverage coordinates of the 3D image according to the second priori information to obtain the initial positioning coordinates of the 2D image and the 3D image, and the non-glue points include the coverage coordinates of the 2D image whose grayscale value is greater than the grayscale value threshold, and the coverage coordinates of the 3D image whose thickness of the lens glue layer is less than the diode height threshold.

[0074] An embodiment of the present application provides a computer-readable storage medium, wherein program data is stored in the computer-readable storage medium. When the program data is executed by a processor, the program data is used to execute part or all of the steps of any Mini LED Lens glue layer morphology measurement method recorded in the above method embodiments.

[0075] It should be noted that for any of the aforementioned Mini LED Lens glue layer morphology measurement method embodiments, for the sake of simplicity, they are all expressed as a series of action combinations, but those skilled in the art should be aware that this application is not limited by the order of the actions described, because according to this application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by this application.

[0076] Although the present application is described herein in conjunction with various embodiments, in the process of implementing the claimed application, those skilled in the art may understand and implement other variations of the disclosed embodiments by reviewing the drawings, the disclosure, and the appended claims. In the claims, the word "comprising" does not exclude other components or steps, and "a" or "an" does not exclude a plurality of components or steps. The fact that certain measures are recited in different dependent claims does not mean that these measures cannot be combined to produce good results.

[0077] The above is a detailed introduction to the embodiments of the present application. This article uses specific examples to illustrate the principles and implementation methods of a MiniLEDLens glue layer morphology measurement method and system of the present application. The description of the above embodiments is only used to help understand the method and core idea of ​​the present application; at the same time, for general technical personnel in this field, based on the idea of ​​a MiniLED Lens glue layer morphology measurement method and system of the present application, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

[0078] The present application is described with reference to the flowcharts and / or block diagrams of the methods, hardware products, and computer program products of the embodiments of the present application. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 a process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0079] These computer program instructions may also be stored in a computer readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 a process or multiple processes and / or boxes Figure 1 The function specified in one or more boxes.

[0080] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing the instructions executed on the computer or other programmable device for implementing the process. Figure 1a process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0081] It can be understood that any product that is controlled or configured to execute the processing method of the flowchart described in the method embodiment of a Mini LED Lens glue layer morphology measurement method of the present application, such as the terminal and computer program product in the above flowchart, falls within the scope of the related products described in this application.

[0082] Obviously, those skilled in the art can make various changes and modifications to the Mini LED Lens glue layer morphology measurement method and system provided in this application without departing from the spirit and scope of this application. Thus, if these modifications and variations of this application fall within the scope of the claims of this application and their equivalents, this application also intends to include these modifications and variations.

Claims

1. A method for measuring the morphology of a Mini LED Lens glue layer, characterized in that: The method comprises: A distributed camera is used to photograph Mini LEDs to obtain multiple first target images, wherein the Mini LEDs are covered with a lens adhesive layer and illuminated by a composite light source, the composite light source including a line laser light source and a natural light source, and each first target image includes a first area corresponding to the line laser light source and a second area corresponding to the natural light source; Processing the multiple first target images to obtain a second target image, wherein the second target image includes a 3D image corresponding to the Mini LED composed of the multiple first areas and a 2D image corresponding to the Mini LED composed of the multiple second areas; Determining a topographic measurement result of the Mini LED lens glue layer according to the second target image, wherein the topographic measurement result includes a first measurement result corresponding to the 3D image and a second measurement result corresponding to the 2D image; The step of processing the plurality of first target images to obtain a second target image includes: Calibrate the distributed camera to determine a y-axis offset, an x-axis offset, and an overlap between adjacent cameras in the distributed camera; Based on the y-axis offset and x-axis offset of the distributed camera, the overlap between adjacent cameras, and the correspondence between the distributed camera and the first target image, the first regions and the second regions in the multiple first target images are stitched together along the y-axis direction to obtain a 3D image corresponding to the Mini LED composed of the multiple first regions and a 2D image corresponding to the Mini LED composed of the multiple second regions; obtaining a position offset between the line laser light source and the natural light source, and registering the 2D image and the 3D image according to the position offset to obtain the second target image; The step of determining the topography measurement result of the lens glue layer of the Mini LED according to the second target image includes: Obtaining first a priori information of a 2D image of the lens glue layer of the Mini LED and a pixel size of the Mini LED, wherein the first a priori information of the 2D image includes morphological parameters, pixel size, and grayscale values ​​of a standard 2D image of the lens glue layer; generating a matching model based on the first prior information of the 2D image and the pixel size of the Mini LED, matching the matching model with the 2D image to generate a matching result, and determining the centroid position of the Mini LED based on the matching result; Performing gradient calculation on the 2D image, and determining the pixel coordinates of the edge contour of the lens glue layer corresponding to the Mini LED in the 2D image according to the change in the gradient value; Determine the edge contour of the lens adhesive layer corresponding to the Mini LED in the 2D image according to the pixel coordinates of the edge contour, and calculate the centroid position, major axis diameter, and minor axis diameter of the lens adhesive layer according to the edge contour of the lens adhesive layer corresponding to the Mini LED; A second measurement result corresponding to the 2D image is calculated based on the centroid position, major axis diameter, and minor axis diameter of the Mini LED and lens adhesive layer, where the second measurement result includes one or more of the following: roundness, diameter, area, and eccentricity of the lens adhesive layer; The first measurement result includes one or more of the following: thickness and volume of the lens glue layer.

2. The method according to claim 1, characterized in that The determining, according to the second target image, a topography measurement result of the lens glue layer of the MiniLED, includes: Determine the highest point in the 3D image, and determine the thickness of the lens adhesive layer according to the distance from the highest point to the bottom surface of the lens adhesive layer; A first measurement result corresponding to the 3D image is obtained according to the thickness, the major axis diameter, and the minor axis diameter.

3. The method according to claim 1, characterized in that Before matching the matching model with the 2D image to generate a matching result, the method further includes: Acquire four regions of interest (ROIs) in the 2D image, wherein two adjacent ROIs among the four ROIs are symmetrical to the remaining two adjacent ROIs, and the 2D image is an imaging of a diode; Obtaining centroid coordinates of the four ROIs respectively according to distribution positions of the four ROIs in the 2D image; Determining the coverage coordinates of the 2D image according to the coordinates of the centroid coordinates of the four ROIs in the range covered by the distribution in the x-axis and y-axis directions; Obtaining coverage coordinates of the 3D image according to the coverage coordinates of the 2D image; Acquire second priori information of the lens glue layer, where the second priori information includes a grayscale value threshold and a lens glue layer height threshold; According to the second prior information, non-glue points are eliminated from the coverage coordinates of the 2D image and the coverage coordinates of the 3D image to obtain the initial positioning coordinates of the 2D image and the 3D image, where the non-glue points include the coverage coordinates of the 2D image whose grayscale values ​​are greater than the grayscale value threshold, and the coverage coordinates of the 3D image whose thickness of the lens glue layer is less than the diode height threshold.

4. A Mini LED Lens glue layer profile measurement system, comprising an acquisition device, a processor, and a memory. The acquisition device includes distributed cameras, each of which is equipped with a composite light source comprising a line laser light source and a natural light source. The system is characterized by: The acquisition device captures the Mini LED along its capture path, thereby obtaining a plurality of first target images, and stores the plurality of first target images in the memory, wherein the Mini LED is covered with a lens adhesive layer, and during the capture process, the composite light source on the acquisition device is used to illuminate the Mini LED, and each first target image includes a first area corresponding to the line laser light source and a second area corresponding to the natural light source; The processor calls a plurality of first target images in the memory, processes the plurality of first target images to obtain a second target image, and then determines a topographical measurement result of the lens glue layer of the Mini LED based on the second target image, wherein the second target image includes a 3D image corresponding to the Mini LED composed of a plurality of first regions and a 2D image corresponding to the Mini LED composed of a plurality of second regions, and the topographical measurement result includes a first measurement result corresponding to the 3D image and a second measurement result corresponding to the 2D image; The processor processes the plurality of first target images to obtain a second target image, comprising: The processor calibrates the distributed cameras in the acquisition device to determine the y-axis offset and x-axis offset of the distributed cameras, and the overlap between adjacent cameras in the distributed cameras; The processor stitches the first regions and the second regions in the plurality of first target images in the y-axis direction according to the y-axis offset and the x-axis offset of the distributed cameras, the overlap between adjacent cameras, and the correspondence between the distributed cameras and the first target image, to obtain a 3D image corresponding to the Mini LED composed of the plurality of first regions and a 2D image corresponding to the Mini LED composed of the plurality of second regions; The processor determines a position offset between the line laser light source and the natural light source according to the first target image, and registers the 2D image and the 3D image according to the position offset to obtain the second target image; The processor determines the topography measurement result of the lens glue layer of the Mini LED according to the second target image, including: The processor calls first a priori information of the 2D image of the lens glue layer of the Mini LED and the pixel size of the Mini LED from the memory, where the first a priori information of the 2D image includes morphological parameters, pixel size, and grayscale value of the standard 2D image of the lens glue layer; The processor generates a matching model based on the first prior information of the 2D image and the pixel size of the Mini LED, matches the matching model with the 2D image to generate a matching result, and determines the centroid position of the Mini LED based on the matching result; The processor performs gradient calculation on the 2D image and determines the pixel coordinates of the edge contour of the lens glue layer corresponding to the Mini LED in the 2D image according to the change in the gradient value; The processor determines the edge contour of the lens adhesive layer corresponding to the Mini LED in the 2D image according to the pixel coordinates of the edge contour, and calculates the centroid position, major axis diameter, and minor axis diameter of the lens adhesive layer according to the edge contour of the lens adhesive layer corresponding to the Mini LED; The processor calculates a second measurement result corresponding to the 2D image based on the centroid position, major axis diameter, and minor axis diameter of the Mini LED and lens glue layer, where the second measurement result includes one or more of the following: roundness, diameter, area, and eccentricity of the lens glue layer; The first measurement result includes one or more of the following: thickness and volume of the lens glue layer.

5. The system according to claim 4, characterized in that The processor determines, based on the second target image, a topography measurement result of the lens glue layer of the Mini LED, including: The processor determines the highest point in the 3D image according to the 3D image, and determines the thickness of the lens glue layer according to the distance from the highest point to the bottom surface of the lens glue layer; The processor obtains a first measurement result corresponding to the 3D image according to the thickness, the major axis diameter, and the minor axis diameter.

6. The system according to claim 4, characterized in that Before the processor matches the matching model with the 2D image to generate a matching result, the processor is further configured to: The processor acquires four image regions of interest (ROIs) in the 2D image according to the 2D image, wherein two adjacent ROIs and the remaining two adjacent ROIs among the four ROIs are symmetrical to each other, and the 2D image is an imaging of a diode; The processor obtains the centroid coordinates of the four ROIs respectively according to the distribution positions of the four ROIs in the 2D image; The processor determines the coverage coordinates of the 2D image according to the coordinates of the centroid coordinates of the four ROIs in the range covered by the distribution in the x-axis and y-axis directions; The processor obtains the coverage coordinates of the 3D image according to the coverage coordinates of the 2D image; The processor calls the second priori information of the lens glue layer in the memory, where the second priori information includes a gray value threshold and a lens glue layer height threshold; The processor eliminates non-glue points on the coverage coordinates of the 2D image and the coverage coordinates of the 3D image based on the second prior information to obtain the initial positioning coordinates of the 2D image and the 3D image, where the non-glue points include coverage coordinates in the coverage coordinates of the 2D image whose grayscale values ​​are greater than the grayscale value threshold, and coverage coordinates in the coverage coordinates of the 3D image whose thickness of the lens glue layer is less than the diode height threshold.

Images