Lamination position detection method and system, storage medium, and electronic device

Abstract

The present invention relates to the field of dimension detection, and provides a lamination position detection method and system, a storage medium, and an electronic device. The method comprises: acquiring a regional image of any corner region of a member to be detected, and on the basis of the regional image, respectively determining two adjacent display screen outer contour straight lines and two adjacent glass outer contour straight lines on the member to be detected; respectively extending the display screen outer contour straight lines and the glass outer contour straight lines to determine a display screen right angle and a glass right angle, and determining a display screen angle bisector and a glass angle bisector; determines a display screen outer contour arc line and a glass outer contour arc line by means of a preset method, respectively determines intersection points of the angle bisectors and the corresponding outer contour arc lines, and determines the distance between the two intersection points as a verification distance; and determines the included angle between the two angle bisectors as a verification included angle, and on the basis of the verification distance, the verification included angle, and calibration data, determines whether a lamination position of the member to be detected meets a standard. The present invention solves the problem in the prior art of lacking a lamination position detection method having high detection efficiency and accuracy.

Description

A method, system, storage medium, and electronic device for detecting fit position. Technical Field

[0001] This invention relates to the field of dimensional inspection, and in particular to a method, system, storage medium, and electronic device for detecting fitting position. Background Technology

[0002] With the development of display technology, large-size touch displays are increasingly widely used in various devices with display functions. When a user approaches or touches the surface of the touch display with their finger or a conductive object, the touch position is sensed by changes in the internal circuitry or capacitance of the touch display, and a response is generated. The structure of a common touch display is usually multi-layered, that is, multiple glass panels are bonded together with solid adhesives, such as touchpad and LCD screen being bonded together to form a touch-controlled LCD screen.

[0003] The installation process for the display screen includes the mounting of the display screen to the outer protective glass. To ensure mounting quality and display effect, the distance between the outer contour of the display screen and the outer contour of the outer protective glass must be within a certain range, that is, to ensure that the bonding position between the two is centered. Therefore, after the mounting is completed, the distance between the outer contours of the two needs to be checked to ensure mounting quality.

[0004] In existing technologies, a single area on one side of the screen of the bonded product is selected for inspection. The outer contour lines of the display screen and glass within the area are obtained, and the distance between each point on the two lines is obtained to judge the bonding tolerance. However, the two lines are usually not parallel. Therefore, even if the distance between the two lines meets the preset range, the bonding tolerance between the display screen and the glass may not meet the requirements on the other side of the same side. Therefore, it is necessary to select multiple areas for inspection. Usually, the areas on the four adjacent sides of the four corners of the display screen are selected, that is, eight areas are inspected. Although this inspection method can improve the accuracy of inspection, the inspection efficiency is low due to the large number of selected areas. Moreover, when selecting the contour lines within the area, it is difficult to directly obtain the true outer contour lines, which has a certain impact on the inspection accuracy. Summary of the Invention

[0005] Based on this, the purpose of the present invention is to provide a fitting position detection method, which aims to solve the problem that the prior art lacks a fitting position detection method with high detection efficiency and accuracy.

[0006] A fitting position detection method according to an embodiment of the present invention includes:

[0007] The image of any corner of the test piece is obtained by a preset image acquisition device, and the outer contour lines of two adjacent display screens on the test piece and the outer contour lines of two adjacent glass panes on the test piece are determined based on the image of the area.

[0008] The outer contour lines of the two displays and the outer contour lines of the two glass are extended to determine the right angles of the displays and the glass, respectively. The angle bisectors of the displays and the glass are determined based on the right angles of the displays and the glass, respectively.

[0009] The outer contour arc of the display screen and the outer contour arc of the glass are determined by a preset method. The intersection points of the angle bisector of the display screen and the outer contour arc of the display screen, as well as the intersection points of the angle bisector of the glass and the outer contour arc of the glass, are determined respectively. The distance between the two intersection points is determined as the verification distance.

[0010] The angle between the bisector of the display screen angle and the bisector of the glass angle is determined as the verification angle. The verification distance and the verification angle are compared with the verification data to determine whether the bonding position of the part to be tested meets the requirements.

[0011] In addition, the fitting position detection method according to the above embodiments of the present invention may also have the following additional technical features:

[0012] Further, the step of determining the outer contour lines of two adjacent display screens on the test piece and the outer contour lines of two adjacent glass panes on the test piece based on the region image includes:

[0013] Select a partial image within a first preset range on both sides of the object to be detected within the region image;

[0014] Based on the pixel distribution within the local image, a group of pixels with the largest color difference from the inner side of the object to be detected and the background pixels of the object to be detected are determined by a preset algorithm.

[0015] The outer contour line of the display screen and the outer contour line of the glass are obtained by fitting multiple groups of pixels respectively.

[0016] Furthermore, the step of determining the outer contour arc line of the display screen and the outer contour arc line of the glass using a preset method includes:

[0017] Based on standard size information, chamfer the right angles of the display screen and the right angles of the glass respectively to determine the outline of the target display screen and the outline of the target glass.

[0018] The overlapping portions of the target display screen outline and the outer outline line of the display screen, as well as the target glass outline and the outer outline line of the glass, are removed to obtain the outer outline arc of the display screen and the outer outline arc of the glass.

[0019] Furthermore, the verification data includes at least a verification distance range value, and the step of acquiring an image of the region at any vertices of the object to be inspected through a preset image acquisition device includes:

[0020] The standard part image is acquired by a preset image acquisition device, and the outer contour line of the standard display screen and the outer contour line of the standard glass are determined based on the standard part image.

[0021] Calculate the distance between the outer contour line of the standard display screen and the outer contour line of the standard glass, determine the standard distance range value, and determine the verification distance range value based on the standard distance range value and the allowable tolerance.

[0022] Further, the verification data includes at least a verification angle range value. Following the step of calculating the distance between the standard display screen outer contour line and the standard glass outer contour line, determining the standard distance range value, and determining the verification distance range value based on the standard distance range value and the allowable tolerance, the following steps are included:

[0023] The outer contour line of the standard display screen is adjusted according to the two extreme values ​​of the verification distance range to determine the outer contour line of the display screen with two extreme values;

[0024] The angles between the angle bisectors of the outer contours of the two extreme value displays and the angle bisectors of the corresponding areas of the outer contours of the standard glass are determined, and the range of the verification angles is determined.

[0025] Further, the step of determining the angle bisectors of the display screen and the glass based on the right angle of the display screen and the right angle of the glass respectively includes:

[0026] Select a partial image of the top corner of the object to be detected within a second preset range in the image area;

[0027] Based on the pixel distribution within the local image at the top corner, the pixel group of the top corner outline of the display screen and the pixel group of the top corner outline of the glass are determined respectively using the preset algorithm.

[0028] The top corner pixel of the display screen is determined to coincide with the pixel group of the top corner outline of the display screen. The first average value is obtained by averaging the sum of the distances between each top corner pixel of the display screen and the vertex of the right angle of the display screen. The top corner pixel of the display screen whose distance value to the vertex of the right angle of the display screen is closest to the first average value is determined as the first target point.

[0029] The glass top corner pixels that coincide with the glass top corner contour pixel group are identified. The average of the distances between each glass top corner pixel and the vertex of the glass right angle is calculated to obtain a second average value. The glass top corner pixel whose distance value to the vertex of the glass right angle is closest to the second average value is identified as the second target point.

[0030] The distance between the first target point and the second target point is determined as the verification distance, and the angle between the angle bisector of the display screen and the angle bisector of the glass is determined as the verification angle. The verification distance and the verification angle are compared with the verification data to determine whether the bonding position of the part to be tested meets the requirements.

[0031] Further, after the step of comparing the verification distance and the verification angle with the verification data to determine whether the fitting position of the part to be tested meets the requirements, the following steps are included:

[0032] For the tested items that have passed the verification, perform multi-point selection and ranging sampling inspection, and determine whether the sampling pass rate is greater than a preset threshold.

[0033] If not, adjust the preset algorithm based on the sampling results.

[0034] Another objective of this invention is to provide a fitting position detection system, the system comprising:

[0035] The outer contour line determination module is used to acquire an image of an area at any top corner of the test piece through a preset image acquisition device, and to determine the outer contour lines of two adjacent display screens on the test piece and the outer contour lines of two adjacent glass panes on the test piece based on the area image.

[0036] The angle bisector determination module extends the outer contour lines of the two displays and the outer contour lines of the two glass to determine the right angles of the displays and the glass, respectively, and determines the angle bisectors of the displays and the glass based on the right angles of the displays and the glass, respectively.

[0037] The intersection point determination module is used to determine the outer contour arc line of the display screen and the outer contour arc line of the glass through a preset method, and to determine the intersection point of the angle bisector of the display screen and the outer contour arc line of the display screen, as well as the intersection point of the angle bisector of the glass and the outer contour arc line of the glass, and to determine the distance between the two intersection points as the verification distance.

[0038] The verification and judgment module is used to determine the angle between the angle bisector of the display screen and the angle bisector of the glass as the verification angle, and compare the verification distance and the verification angle with the verification data to determine whether the bonding position of the part to be tested meets the requirements.

[0039] Another objective of this invention is to provide a storage medium storing a computer program that, when executed by a processor, implements the steps of the above-described fitting position detection method.

[0040] Another objective of this invention is to provide an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the steps of the above-described fitting position detection method.

[0041] This invention acquires an image of an area at any vertices of the component under test, and extracts the outer contour lines of the adjacent sides of the display screen and the outer glass based on the image. Then, it obtains the corresponding right angles of the display screen and the glass using these outer contour lines. By comparing the angle bisectors of the two right angles, the overall relative deflection between the display screen and the glass can be determined, i.e., whether each side of the display screen is parallel to the corresponding side of the glass and the degree of deflection. Furthermore, by determining the intersection points of the two angle bisectors and the corresponding outer contour arcs, and the distance between the two intersection points, and since the outer contours of both the display screen and the glass are rectangular, the relative angles between the display screen and the glass can be accurately determined using only the distance between the two intersection points and the angle bisectors. This method determines the positional relationship between the display screen and the glass, thus completing the detection of the bonding position. Since it only requires determining the distance between two points and the two angle bisectors, it is more efficient than existing technologies that require obtaining distances from multiple points on the two contour lines in multiple areas. Furthermore, due to lighting issues during photography, existing technologies struggle to ensure accurate point selection during distance measurement and require multiple point selections and measurements. This application, however, only performs point selection once when confirming the outer contour line. Once the line is confirmed, the two right angles, their corresponding angle bisectors, and the included angle between the angle bisectors are all determined, eliminating the need for selection based on image pixels. The outer contour arc line is also determined through right angles, meaning the intersection point is also fixed. This avoids the cumulative error from multiple point selections and improves detection accuracy. Furthermore, since the tolerance range for positional distance verification is in the millimeter or even micrometer range, high measurement accuracy is required. Therefore, even if the true position of each pixel can be accurately obtained, the measurement accuracy is limited by the device's measurement precision, making it difficult to guarantee the accuracy of the measurement. However, by introducing angle-assisted judgment, the difficulty of angle measurement can be reduced by extending the length of the two straight lines, thereby greatly improving the overall detection accuracy. Therefore, this invention solves the problem of the lack of a high-efficiency and high-precision fitting position detection method in the prior art. Attached Figure Description

[0042] Figure 1 is a flowchart of the fitting position detection method in the first embodiment of the present invention;

[0043] Figure 2 is a structural block diagram of the fitting position detection system in the second embodiment of the present invention;

[0044] Figure 3 is a schematic diagram of the structure of the electronic device in the third embodiment of the present invention;

[0045] The following detailed description, in conjunction with the accompanying drawings, will further illustrate the present invention. Detailed Implementation

[0046] To facilitate understanding of the present invention, a more complete description will be given below with reference to the accompanying drawings. Several embodiments of the invention are illustrated in the drawings. However, the invention can be implemented in many different forms and is not limited to the embodiments described herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete.

[0047] It should be noted that when a component is said to be "fixed to" another component, it can be directly on the other component or there may be an intervening component. When a component is said to be "connected to" another component, it can be directly connected to the other component or there may be an intervening component. The terms "vertical," "horizontal," "left," "right," and similar expressions used in this document are for illustrative purposes only.

[0048] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention pertains. The terminology used herein in the description of the invention is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. The term "and / or" as used herein includes any and all combinations of one or more of the associated listed items. Example

[0049] Please refer to Figure 1, which shows the fitting position detection method in the first embodiment of the present invention. The method specifically includes steps S01-S04.

[0050] Step S01: Obtain an image of any corner of the component to be inspected using a preset image acquisition device, and determine the outer contour lines of two adjacent display screens on the component to be inspected and the outer contour lines of two adjacent glass panes on the component to be inspected based on the image of the area.

[0051] Specifically, a local image within a first preset range adjacent to the object to be inspected within the image area is selected. Based on the pixel distribution within the local image, a preset algorithm is used to determine multiple pixel groups with the largest color difference from the inner side of the object to be inspected and the background pixels of the object to be inspected. These multiple pixel groups are then fitted to obtain the outer contour line of the display screen and the outer contour line of the glass. In practice, the object to be inspected is typically entirely black. Because the display screen is smaller than the glass, under external lighting, the outer contour of the display screen will appear as a white line, resulting in a significant color difference between the outer contour of the display screen and the inner side of the object to be inspected. Furthermore, when taking the photograph, the object to be inspected is usually placed on a support plate with a large color difference from the object to be inspected. Therefore, when extracting the contour lines, the outer contour lines of the display screen and the glass can be accurately determined based on the color difference.

[0052] Furthermore, the verification data includes at least a verification distance range value. Before the step of acquiring an image of an area at any vertices of the test piece using a preset image acquisition device, the process includes: acquiring a pre-provided standard part image using the preset image acquisition device; determining the standard display screen outer contour line and the standard glass outer contour line based on the standard part image; calculating the distance between the standard display screen outer contour line and the standard glass outer contour line to determine a standard distance range value; and determining a verification distance range value based on the standard distance range value and the allowable tolerance. The standard display screen outer contour line is adjusted according to the extreme values ​​at both ends of the verification distance range value to determine two extreme display screen outer contour lines; and the angles between the angle bisectors of each angle of the two extreme display screen outer contour lines and the angle bisectors of the corresponding areas of the standard glass outer contour line are determined to determine the verification angle range value. In practical implementation, because the client's measurement system differs from our own, we typically use the provided standard part and allowable tolerances to perform precise measurements to determine the verification data under our own measurement system, ensuring that the measurement results meet the client's requirements.

[0053] Step S02: Extend the outer contour lines of the two displays and the outer contour lines of the two glass to determine the right angles of the displays and the glass, respectively, and determine the angle bisectors of the displays and the glass based on the right angles of the displays and the glass.

[0054] Specifically, once the two right angles are determined, the two angle bisectors can be accurately determined. When measuring the angle between the two angle bisectors, the measurement difficulty can be reduced by infinitely extending the length of the two angle bisectors. Compared to judging the fit position by distance alone, the measurement difficulty is lower, and thus the measurement accuracy is higher under the same conditions.

[0055] Step S03: Determine the outer contour arc of the display screen and the outer contour arc of the glass using a preset method, and determine the intersection point of the angle bisector of the display screen and the outer contour arc of the display screen, as well as the intersection point of the angle bisector of the glass and the outer contour arc of the glass, and determine the distance between the two intersection points as the verification distance.

[0056] Specifically, based on standard size information, the right angles of the display screen and the glass are chamfered to determine the target display screen outline and the target glass outline. The overlapping portions of the target display screen outline and the outer contour line of the display screen, as well as the target glass outline and the outer contour line of the glass, are then removed to obtain the outer contour arc lines of the display screen and the glass. In practice, the arc lines are determined using two right angles, rather than by performing pixel extraction and fitting on the photograph again, reducing the cumulative error from multiple pixel extractions and improving detection accuracy.

[0057] Step S04: Determine the angle between the angle bisector of the display screen and the angle bisector of the glass as the verification angle, and compare the verification distance and the verification angle with the verification data to determine whether the bonding position of the component to be tested meets the requirements.

[0058] Specifically, after step S04, the process further includes performing multi-point sampling and ranging on the qualified test pieces, and determining whether the sampling pass rate is greater than a preset threshold; if not, adjusting the preset algorithm based on the sampling results. In actual production, to further ensure the accuracy and quality of the inspection, it is necessary to perform a second sampling inspection on the qualified products to prevent false detections, missed detections, or equipment malfunctions. Furthermore, by using sampling inspections, the algorithm is adjusted in real time, thereby further ensuring the accuracy of the inspection.

[0059] As an example, and not a limitation, in some optional embodiments, after the step of determining the angle bisector of the display screen and the angle bisector of the glass based on the right angle of the display screen and the right angle of the glass respectively, the method includes: selecting a partial image of the apex corner of the device to be detected within a second preset range in the area image; determining the pixel group of the apex corner of the display screen and the pixel group of the apex corner of the glass respectively based on the pixel distribution in the partial image of the apex corner using the preset algorithm; determining the apex corner pixels of the display screen that coincide with the pixel group of the apex corner of the display screen and the angle bisector of the display screen; averaging the sum of the distances between each apex corner pixel of the display screen and the vertex of the right angle of the display screen to obtain a first average value; and determining the distance from the vertex of the right angle of the display screen. The top corner pixel of the display screen whose distance value is closest to the first average value is designated as the first target point; the top corner pixel of the glass that coincides with the glass corner profile pixel group is determined, and the average of the distances between each glass top corner pixel and the vertex of the glass right angle is calculated to obtain the second average value, and the top corner pixel of the glass whose distance value to the vertex of the glass right angle is closest to the second average value is designated as the second target point; the distance between the first target point and the second target point is determined as the verification distance, and the angle between the two angle bisectors is determined as the verification angle, and the verification distance and the verification angle are compared with the verification data to determine whether the bonding position of the test piece meets the requirements.

[0060] Specifically, in other embodiments, the intersection of the outer contour arc and the angle bisector can be determined without using right-angle chamfering. This is to prevent the error factor in determining the contour line from being too large, which would greatly affect the accuracy of all subsequent steps. Instead, when determining the intersection, the vertices contour pixels that coincide with the angle bisector and the vertices contour pixel group are first identified, and then the vertices contour pixels are filtered according to the distance relationship to determine the required intersection. This avoids the cumulative error of the fitting step and greatly reduces the amount of data processing and improves the detection efficiency by judging the filtered pixels.

[0061] In summary, the fitting position detection method in the above embodiments of the present invention acquires an image of an area at any apex of the component to be tested, extracts the outer contour lines of the adjacent sides of the display screen and the outer glass based on the area image, and then obtains the corresponding right angles of the display screen and the glass through the outer contour lines. By comparing the angle between the angle bisectors of the two right angles, the overall relative deflection between the display screen and the glass can be determined, that is, whether each side of the display screen is parallel to the corresponding side of the glass and the deflection status. Furthermore, by determining the intersection points of the two angle bisectors and the corresponding outer contour arcs, and the distance between the two intersection points, since the main body of the outer contour of the display screen and the glass is rectangular, the method can accurately determine the relative deflection status by only using the distance between the two intersection points and the angle bisectors. This method determines the positional relationship between the display screen and the glass, thereby detecting the bonding position between them. Since it only requires determining the distance between two points and the two angle bisectors, it is more efficient than existing technologies that require obtaining distances from multiple points along the two contour lines in multiple areas. Furthermore, due to lighting issues during photography, existing technologies struggle to ensure accurate point selection during distance measurement and require multiple point selections and measurements. This application, however, only performs point selection once when confirming the outer contour line. Once the line is confirmed, the two right angles, their corresponding angle bisectors, and the included angle between the angle bisectors are all determined, eliminating the need for selection based on image pixels. The outer contour arc line is also determined through right angles, meaning the intersection point is also fixed. This avoids the cumulative error from multiple point selections and improves detection accuracy. Furthermore, since the tolerance range for positional distance verification is in the millimeter or even micrometer range, high measurement accuracy is required. Therefore, even if the true position of each pixel can be accurately obtained, the measurement accuracy is limited by the device's measurement precision, making it difficult to guarantee the accuracy of the measurement. However, by introducing angle-assisted judgment, the difficulty of angle measurement can be reduced by extending the length of the two straight lines, thereby greatly improving the overall detection accuracy. Therefore, this invention solves the problem of the lack of a high-efficiency and high-precision fitting position detection method in the prior art.

[0062] Example 2

[0063] Please refer to Figure 2, which shows a structural block diagram of the fitting position detection system proposed in the second embodiment of the present invention. The fitting position detection system 200 includes: an outer contour line determination module 21, an angle bisector determination module 22, an intersection point determination module 23, and a verification and judgment module 24, wherein:

[0064] The outer contour line determination module 21 is used to acquire an image of an area at any top corner of the test piece through a preset image acquisition device, and determine the outer contour lines of two adjacent display screens on the test piece and the outer contour lines of two adjacent glass panes on the test piece based on the area image.

[0065] The angle bisector determination module 22 extends the two outer contour lines of the display screen and the two outer contour lines of the glass to determine the right angle of the display screen and the right angle of the glass, respectively, and determines the angle bisector of the display screen and the angle bisector of the glass based on the right angle of the display screen and the right angle of the glass, respectively.

[0066] The intersection point determination module 23 is used to determine the outer contour arc line of the display screen and the outer contour arc line of the glass through a preset method, and to determine the intersection point of the angle bisector of the display screen and the outer contour arc line of the display screen, as well as the intersection point of the angle bisector of the glass and the outer contour arc line of the glass, and to determine the distance between the two intersection points as the verification distance.

[0067] The verification and judgment module 24 is used to determine the angle between the angle bisector of the display screen and the angle bisector of the glass as the verification angle, and compare the verification distance and the verification angle with the verification data to determine whether the bonding position of the test piece meets the requirements.

[0068] Furthermore, the outer contour line determination module 21 includes:

[0069] A local image determination unit is used to select local images within a first preset range on both sides of the object to be detected within the region image;

[0070] The pixel group determination unit is used to determine, based on the pixel distribution in the local image, multiple pixel groups with the largest color difference from the inner side of the object to be detected and the background pixels of the object to be detected by a preset algorithm.

[0071] The outer contour line determination unit is used to fit the multiple pixel point groups to obtain the outer contour line of the display screen and the outer contour line of the glass, respectively.

[0072] Furthermore, in other embodiments of the present invention, the intersection point determination module 23 includes:

[0073] The target outline determination unit is used to chamfer the right angle of the display screen and the right angle of the glass according to standard size information, and determine the target display screen outline and the target glass outline.

[0074] The arc line determination unit is used to remove the overlapping portions of the target display screen outline and the display screen outer contour line, as well as the target glass outline and the glass outer contour line, to obtain the display screen outer contour arc line and the glass outer contour arc line.

[0075] Furthermore, in other embodiments of the present invention, the verification data includes at least verification angle range values ​​and verification distance range values, and the fitting position detection system 200 includes:

[0076] The standard contour line determination module is used to acquire a pre-provided standard part image through a preset image acquisition device, and determine the outer contour line of the standard display screen and the outer contour line of the standard glass based on the standard part image;

[0077] The verification distance determination module is used to calculate the distance between the outer contour line of the standard display screen and the outer contour line of the standard glass, determine the standard distance range value, and determine the verification distance range value based on the standard distance range value and the allowable tolerance.

[0078] The extreme value display screen outer contour line determination module is used to adjust the outer contour line of the standard display screen according to the two extreme values ​​of the verification distance range value to determine the outer contour lines of the two extreme value display screens;

[0079] The verification angle determination module is used to determine the angle between each angle bisector of the outer contour of the two extreme value display screens and the angle bisector of the corresponding area of ​​the outer contour of the standard glass, and to determine the range value of the verification angle.

[0080] Furthermore, in other embodiments of the present invention, the fitting position detection system 200 further includes:

[0081] The top corner partial image determination module is used to select a top corner partial image within a second preset range at the top corner of the object to be detected in the region image;

[0082] The top corner contour pixel group determination module is used to determine the top corner contour pixel group of the display screen and the top corner contour pixel group of the glass respectively based on the pixel distribution in the top corner local image and the preset algorithm.

[0083] The first target point determination module is used to determine the top corner pixel of the display screen that coincides with the pixel group of the top corner outline of the display screen, calculate the average of the sum of the distances between each top corner pixel of the display screen and the vertex of the right angle of the display screen to obtain a first average value, and determine the top corner pixel of the display screen whose distance value to the vertex of the right angle of the display screen is closest to the first average value as the first target point.

[0084] The second target point determination module is used to determine the glass top corner pixel point that coincides with the glass top corner contour pixel point group, calculate the average of the sum of the distances between each glass top corner pixel point and the vertex of the glass right angle to obtain a second average value, and determine the glass top corner pixel point whose distance value to the vertex of the glass right angle is closest to the second average value as the second target point;

[0085] The verification module is used to determine the distance between the first target point and the second target point as the verification distance, and to determine the angle between the angle bisector of the display screen and the angle bisector of the glass as the verification angle. The verification distance and the verification angle are compared with the verification data to determine whether the bonding position of the part to be tested meets the requirements.

[0086] Furthermore, in other embodiments of the present invention, the fitting position detection system 200 further includes:

[0087] The sampling inspection module is used to perform multi-point selection and ranging sampling inspection on the qualified test pieces and determine whether the sampling inspection pass rate is greater than a preset threshold.

[0088] The algorithm adjustment module is used to adjust the preset algorithm based on the sampling results when the pass rate of the sampling inspection is less than or equal to a preset threshold.

[0089] The functions or operation steps implemented by the above modules are largely the same as those in the above method embodiments, and will not be repeated here.

[0090] Example 3

[0091] In another aspect, the present invention also proposes an electronic device. Please refer to FIG3, which is a schematic diagram of the electronic device in the third embodiment of the present invention. It includes a memory 20, a processor 10, and a computer program 30 stored in the memory and executable on the processor. When the processor 10 executes the computer program 30, it implements the fitting position detection method as described above.

[0092] In some embodiments, the processor 10 may be a central processing unit (CPU), controller, microcontroller, microprocessor or other data processing chip, used to run program code stored in memory 20 or process data, such as executing access restriction programs.

[0093] The memory 20 includes at least one type of readable storage medium, such as flash memory, hard disk, multimedia card, card-type memory (e.g., SD or DX memory), magnetic memory, magnetic disk, optical disk, etc. In some embodiments, the memory 20 can be an internal storage unit of an electronic device, such as the hard disk of the electronic device. In other embodiments, the memory 20 can also be an external storage device of the electronic device, such as a plug-in hard disk, smart media card (SMC), secure digital (SD) card, flash card, etc. Furthermore, the memory 20 can include both internal and external storage units of the electronic device. The memory 20 can be used not only to store application software and various types of data of the electronic device, but also to temporarily store data that has been output or will be output.

[0094] It should be noted that the structure shown in Figure 3 does not constitute a limitation on the electronic device. In other embodiments, the electronic device may include fewer or more components than shown, or combine certain components, or have different component arrangements.

[0095] This invention also proposes a computer-readable storage medium storing a computer program that, when executed by a processor, implements the above-described fitting position detection method.

[0096] Those skilled in the art will understand that the logic and / or steps represented in the flowcharts or otherwise described herein, for example, can be considered as a ordered list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by, or in conjunction with, an instruction execution system, apparatus, or device (such as a computer-based system, a processor-included system, or other system that can fetch and execute instructions from, an instruction execution system, apparatus, or device). For the purposes of this specification, "computer-readable medium" can mean any means that can contain, store, communicate, propagate, or transmit programs for use by, or in conjunction with, an instruction execution system, apparatus, or device.

[0097] More specific examples of computer-readable media (a non-exhaustive list) include: electrical connections (electronic devices) having one or more wires, portable computer disk drives (magnetic devices), random access memory (RAM), read-only memory (ROM), erasable and editable read-only memory (EPROM or flash memory), fiber optic devices, and portable optical disc read-only memory (CDROM). Furthermore, computer-readable media can even be paper or other suitable media on which the program can be printed, because the program can be obtained electronically, for example, by optically scanning the paper or other medium, followed by editing, interpreting, or otherwise processing as necessary, and then stored in computer memory.

[0098] It should be understood that various parts of the present invention can be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, multiple steps or methods can be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented using any one or a combination of the following techniques known in the art: discrete logic circuits having logic gates for implementing logical functions on data signals, application-specific integrated circuits (ASICs) having suitable combinational logic gates, programmable gate arrays (PGAs), field-programmable gate arrays (FPGAs), etc.

[0099] In the description of this specification, references to terms such as "one embodiment," "some embodiments," "example," "specific example," or "some examples," etc., indicate that a specific feature, structure, material, or characteristic described in connection with that embodiment or example is included in at least one embodiment or example of the invention. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples.

[0100] The above embodiments merely illustrate several implementation methods of the present invention, and their descriptions are relatively specific and detailed, but they should not be construed as limiting the scope of the present invention. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of the present invention, and these all fall within the protection scope of the present invention. Therefore, the protection scope of this patent should be determined by the appended claims.

Claims

1. A method of detecting a fitting position, characterized by, The method includes: The image of any corner of the test piece is obtained by a preset image acquisition device, and the outer contour lines of two adjacent display screens on the test piece and the outer contour lines of two adjacent glass panes on the test piece are determined based on the image of the area. The outer contour lines of the two displays and the outer contour lines of the two glass are extended to determine the right angles of the displays and the glass, respectively. The angle bisectors of the displays and the glass are determined based on the right angles of the displays and the glass, respectively. The outer contour arc of the display screen and the outer contour arc of the glass are determined by a preset method. The intersection points of the angle bisector of the display screen and the outer contour arc of the display screen, as well as the intersection points of the angle bisector of the glass and the outer contour arc of the glass, are determined respectively. The distance between the two intersection points is determined as the verification distance. The angle between the bisector of the display screen angle and the bisector of the glass angle is determined as the verification angle. The verification distance and the verification angle are compared with the verification data to determine whether the bonding position of the part to be tested meets the requirements.

2. The attach position detection method according to claim 1, characterized by, The step of determining the outer contour lines of two adjacent display screens on the test piece and the outer contour lines of two adjacent glass panes on the test piece based on the region image includes: Select a partial image within a first preset range on both sides of the object to be detected within the region image; Based on the pixel distribution within the local image, a group of pixels with the largest color difference from the inner side of the object to be detected and the background pixels of the object to be detected are determined by a preset algorithm. The outer contour line of the display screen and the outer contour line of the glass are obtained by fitting multiple groups of pixels respectively.

3. The attach position detection method according to claim 1, characterized by, The step of determining the outer contour arc of the display screen and the outer contour arc of the glass using a preset method includes: Based on standard size information, chamfer the right angles of the display screen and the right angles of the glass respectively to determine the outline of the target display screen and the outline of the target glass. The overlapping portions of the target display screen outline and the outer outline line of the display screen, as well as the target glass outline and the outer outline line of the glass, are removed to obtain the outer outline arc of the display screen and the outer outline arc of the glass.

4. The attach position detection method according to claim 1, characterized by, The verification data includes at least a verification distance range value. Prior to the step of acquiring an image of the region at any vertices of the object to be inspected using a preset image acquisition device, the following steps are included: The standard part image is acquired by a preset image acquisition device, and the outer contour line of the standard display screen and the outer contour line of the standard glass are determined based on the standard part image. Calculate the distance between the outer contour line of the standard display screen and the outer contour line of the standard glass, determine the standard distance range value, and determine the verification distance range value based on the standard distance range value and the allowable tolerance.

5. The method of claim 4, wherein The verification data includes at least a verification angle range value. Following the steps of calculating the distance between the standard display screen outer contour line and the standard glass outer contour line, determining the standard distance range value, and determining the verification distance range value based on the standard distance range value and the allowable tolerance, the following steps are included: The outer contour line of the standard display screen is adjusted according to the two extreme values ​​of the verification distance range to determine the outer contour line of the display screen with two extreme values; The angles between the angle bisectors of the outer contours of the two extreme value displays and the angle bisectors of the corresponding areas of the outer contours of the standard glass are determined, and the range of the verification angles is determined.

6. The attach position detection method according to claim 2, characterized by, The step of determining the angle bisectors of the display screen and the glass based on the right angle of the display screen and the right angle of the glass, respectively, includes: Select a partial image of the top corner of the object to be detected within a second preset range in the image area; Based on the pixel distribution within the local image at the top corner, the pixel group of the top corner outline of the display screen and the pixel group of the top corner outline of the glass are determined respectively using the preset algorithm. The top corner pixel of the display screen is determined to coincide with the pixel group of the top corner outline of the display screen. The first average value is obtained by averaging the sum of the distances between each top corner pixel of the display screen and the vertex of the right angle of the display screen. The top corner pixel of the display screen whose distance value to the vertex of the right angle of the display screen is closest to the first average value is determined as the first target point. The glass top corner pixels that coincide with the glass top corner contour pixel group are identified. The average of the distances between each glass top corner pixel and the vertex of the glass right angle is calculated to obtain a second average value. The glass top corner pixel whose distance value to the vertex of the glass right angle is closest to the second average value is identified as the second target point. The distance between the first target point and the second target point is determined as the verification distance, and the angle between the angle bisector of the display screen and the angle bisector of the glass is determined as the verification angle. The verification distance and the verification angle are compared with the verification data to determine whether the bonding position of the part to be tested meets the requirements.

7. The attach position detection method according to claim 2, characterized by, The step of comparing the verification distance and the verification angle with the verification data to determine whether the fitting position of the test piece meets the requirements includes: For the tested items that have passed the verification, perform multi-point selection and ranging sampling inspection, and determine whether the sampling pass rate is greater than a preset threshold. If not, adjust the preset algorithm based on the sampling results.

8. A fitting position detection system characterized by comprising: For implementing the fitting position detection method as described in any one of claims 1 to 7, the system comprises: The outer contour line determination module is used to acquire an image of an area at any top corner of the test piece through a preset image acquisition device, and to determine the outer contour lines of two adjacent display screens on the test piece and the outer contour lines of two adjacent glass panes on the test piece based on the area image. The angle bisector determination module extends the outer contour lines of the two displays and the outer contour lines of the two glass to determine the right angles of the displays and the glass, respectively, and determines the angle bisectors of the displays and the glass based on the right angles of the displays and the glass, respectively. The intersection point determination module is used to determine the outer contour arc line of the display screen and the outer contour arc line of the glass through a preset method, and to determine the intersection point of the angle bisector of the display screen and the outer contour arc line of the display screen, as well as the intersection point of the angle bisector of the glass and the outer contour arc line of the glass, and to determine the distance between the two intersection points as the verification distance. The verification and judgment module is used to determine the angle between the angle bisector of the display screen and the angle bisector of the glass as the verification angle, and compare the verification distance and the verification angle with the verification data to determine whether the bonding position of the part to be tested meets the requirements.

9. A computer readable storage medium having stored thereon a computer program, characterized in that, When the program is executed by the processor, it implements the steps of the fitting position detection method as described in any one of claims 1 to 7.

10. An electronic device, comprising: It includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor, when executing the program, implements the fitting position detection method as described in any one of claims 1-7.

Images