Laminating position detection method and system, storage medium and electronic equipment

By obtaining the outer contour straight lines and angle bisectors of the display screen and glass, and calculating the intersection distance and angle angle, the problem of low detection efficiency and accuracy in the prior art is solved, and efficient and accurate fit position detection is achieved.

CN119151930AActive Publication Date: 2024-12-17NANCHANG IND ROBOT CO LTD

Patent Information

Application Number
CN202411641686.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-11-18
Publication Date
2024-12-17
Estimated Expiration
2044-11-18

AI Technical Summary

Technical Problem

When detecting the fitting position between the display screen and the outer protective glass, the detection efficiency is low and the accuracy is not high, making it difficult to accurately obtain the outer contour lines, resulting in errors in determining the fitting tolerance.

Method used

By obtaining the area picture at any top corner of the part to be detected, determine the outer contour line of the display screen and glass, extend the line to determine the angle bisector, calculate the intersection distance and angle, and compare it with the verification data to determine whether the fitting position is Meets the requirements and avoids cumulative errors in multiple point selection ranging and pixel fitting.

Benefits of technology

The detection efficiency and accuracy are improved, and the accuracy of the fitting position is ensured, especially within the micron tolerance range of position distance, which reduces the difficulty of angle measurement and enhances the overall detection accuracy.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119151930A_ABST
    Figure CN119151930A_ABST
Patent Text Reader

Abstract

The invention provides a fitting position detection method and system, a storage medium and electronic equipment, and relates to the field of size detection.The method comprises the steps that an area picture at any vertex angle of a to-be-detected piece is obtained, and two adjacent display screen outer contour straight lines and two adjacent glass outer contour straight lines on the to-be-detected piece are determined according to the area picture; respectively extending the display screen outer contour straight line and the glass outer contour straight line to determine a display screen right angle and a glass right angle, and determining a display screen angular bisector and a glass angular bisector; a display screen outer contour arc line and a glass outer contour arc line are determined through a preset method, intersection points of angular bisectors and the corresponding outer contour arc lines are determined respectively, the distance between the two intersection points is determined as a verification distance, and the included angle between the two angular bisectors is determined as a verification included angle. According to the verification distance, the verification included angle and the verification data, whether the fitting position of the to-be-detected piece is qualified or not is judged. According to the invention, the problem that the prior art lacks a fitting position detection method with high detection efficiency and precision is solved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of size detection, and in particular to a method, system, storage medium and electronic device for detecting a fitting position. Background Art

[0002] With the development of display technology, large-size touch screens are increasingly widely used in various devices with display functions. When a user approaches or touches the surface of the touch screen with a finger or a conductive object, the touch position is sensed and responded to through the change of the internal circuit or capacitance of the touch screen. The structure of a common touch screen is usually multi-layer, that is, multiple glass panels are bonded together by solid glue, such as a touch panel and an LCD screen bonded together to form a touch-controlled LCD screen.

[0003] The process of mounting the display screen includes mounting the display screen and the outer protective glass. In order to ensure the mounting quality and display effect, it is necessary to ensure that the distance between the outer contour of the display screen and the outer contour of the outer protective glass is within a certain range, that is, to ensure that the fitting position between the two is centered. Therefore, after the mounting is completed, the outer contour distance between the two needs to be tested to ensure the mounting quality.

[0004] In the prior art, an area on one side of the screen is selected for detection of the product after bonding, and the outer contour straight lines of the display screen and the glass in the area are obtained respectively, and then the distance between each point of the two straight lines is obtained, so as to judge the bonding tolerance. However, the two straight lines are usually not parallel, and even if the distance between the two straight lines here meets the preset range, the bonding tolerance between the display screen and the glass may not be met at the other end of the same side. Therefore, it is necessary to select multiple areas for detection, usually the areas on both sides of the four corners of the display screen are selected, that is, eight areas are detected. Although such a detection method can improve the accuracy of detection, due to the large number of selected areas, the detection efficiency is low, and when the contour line is selected in the area, it is difficult to directly obtain the real outer contour line, which has a certain impact on the detection accuracy. Summary of the invention

[0005] Based on this, the purpose of the present invention is to provide a method for detecting a fitting position, aiming to solve the problem that the prior art lacks a method for detecting a fitting position with high detection efficiency and accuracy.

[0006] A method for detecting a fitting position according to an embodiment of the present invention includes: Obtain a regional image at any vertex of the object to be inspected by a preset image acquisition device, and determine two adjacent straight lines of outer contours of the display screen on the object to be inspected and two adjacent straight lines of outer contours of the glass on the object to be inspected according to the regional image; Extending the two straight lines of the outer contour of the display screen and the two straight lines of the outer contour of the glass respectively to determine the right angle of the display screen and the right angle of the glass, and determining the angle bisector of the display screen and the angle bisector of the glass respectively according to the right angle of the display screen and the right angle of the glass; Determine the display screen outer contour arc line and the glass outer contour arc line by a preset method, and respectively determine the intersection point of the display screen angle bisector and the display screen outer contour arc line, and the intersection point of the glass angle bisector and the glass outer contour arc line, and determine the distance between the two intersection points as the calibration distance; The angle between the display screen angle bisector and the glass angle bisector is determined as the verification angle, and the verification distance and the verification angle are compared with the calibration data to determine whether the fitting position of the to-be-tested part meets the requirements.

[0007] In addition, a method for detecting a fitting position according to the above embodiment of the present invention may also have the following additional technical features: Furthermore, the step of respectively determining two adjacent straight lines of outer contours of the display screen on the to-be-detected object and two adjacent straight lines of outer contours of the glass on the to-be-detected object according to the regional image comprises: Selecting a local image within a first preset range on two adjacent sides of the to-be-detected component in the regional image; According to the pixel distribution in the local image, a plurality of pixel point groups with the largest color difference with the inner side of the to-be-detected part and the background pixels of the to-be-detected part are determined by a preset algorithm; The plurality of pixel point groups are fitted respectively to obtain the outer contour straight line of the display screen and the outer contour straight line of the glass.

[0008] Furthermore, the step of determining the arc line of the outer contour of the display screen and the arc line of the outer contour of the glass by a preset method includes: Chamfering the right angles of the display screen and the right angles of the glass respectively according to the standard size information to determine a target display screen contour line and a target glass contour line; The overlapping parts of the target display screen contour line and the display screen outer contour straight line, and the target glass contour line and the glass outer contour straight line are removed respectively to obtain the display screen outer contour arc line and the glass outer contour arc line.

[0009] Furthermore, the verification data at least includes a verification distance range value, and the step of obtaining a picture of an area at any vertex of the to-be-detected part by a preset image acquisition device includes: Acquire a pre-provided standard component image through a preset image acquisition device, and determine the outer contour line of a standard display screen and the outer contour line of a standard glass according to the standard component image; The distance between the outer contour line of the standard display screen and the outer contour line of the standard glass is calculated to determine a standard distance range value, and a verification distance range value is determined according to the standard distance range value and an allowable tolerance.

[0010] Further, the calibration data at least includes a calibration angle range value, and the steps of calculating the distance between the outer contour line of the standard display screen and the outer contour line of the standard glass, determining the standard distance range value, and determining the calibration distance range value according to the standard distance range value and the allowable tolerance include: The outer contour line of the standard display screen is adjusted respectively according to the two extreme values ​​of the verification distance range value to determine the outer contour lines of the two extreme value display screens; The angles between the angle bisectors of the two extreme display screen outer contour lines and the angle bisectors of the corresponding areas of the standard glass outer contour lines are determined respectively to determine the calibration angle range value.

[0011] Furthermore, after the step of respectively determining the display screen angle bisector and the glass angle bisector according to the display screen right angle and the glass right angle, the step further comprises: Selecting a local image of a vertex within a second preset range at a vertex of the to-be-detected component in the regional image; According to the pixel distribution in the local image of the top corner, the pixel point group of the top corner outline of the display screen and the pixel point group of the top corner outline of the glass are determined respectively by the preset algorithm; Determine the display screen vertex corner pixel point where the display screen angle bisector coincides with the display screen vertex corner contour pixel point group, average the sum of the distances between each of the display screen vertex corner pixel points and the vertex of the right angle of the display screen to obtain a first average value, and determine the display screen vertex corner pixel point whose distance value to the vertex of the right angle of the display screen is closest to the first average value as the first target point; Determine the glass vertex pixel point where the glass angle bisector coincides with the glass vertex contour pixel point group, average the sum of the distances between each of the glass vertex pixel points and the vertex of the glass right angle to obtain a second average value, and determine the glass vertex pixel point whose distance value to the vertex of the glass right angle is closest to the second average value as the second target point; Determine the distance between the first target point and the second target point as the verification distance, determine the angle between the display screen angle bisector and the glass angle bisector as the verification angle, and compare the verification distance and the verification angle with the calibration data to determine whether the fitting position of the part to be inspected meets the requirements.

[0012] Furthermore, after the step of comparing the verification distance and the verification angle with the calibration data to determine whether the fitting position of the to-be-tested part meets the requirements, the step includes: Perform multi-point selection and ranging sampling on the qualified parts to be tested, and determine whether the sampling pass rate is greater than a preset threshold; If not, adjust the preset algorithm according to the sampling results.

[0013] Another object of an embodiment of the present invention is to provide a fitting position detection system, the system comprising: An outer contour straight line determination module is used to obtain a regional image at any vertex of the to-be-detected part through a preset image acquisition device, and determine the outer contour straight lines of two adjacent display screens on the to-be-detected part and the outer contour straight lines of two adjacent glass panels on the to-be-detected part according to the regional image; An angle bisector determination module, which respectively extends the two display screen outer contour straight lines and the two glass outer contour straight lines to determine the display screen right angle and the glass right angle, and determines the display screen angle bisector and the glass angle bisector according to the display screen right angle and the glass right angle; An intersection determination module is used to determine the display screen outer contour arc line and the glass outer contour arc line by a preset method, and respectively determine the intersection point of the display screen angle bisector and the display screen outer contour arc line, and the intersection point of the glass angle bisector and the glass outer contour arc line, and determine the distance between the two intersection points as the calibration distance; The verification and judgment module is used to determine that the angle between the display screen angle bisector and the glass angle bisector is the verification angle, and compare the verification distance and the verification angle with the calibration data to determine whether the fitting position of the to-be-detected part meets the requirements.

[0014] Another object of an embodiment of the present invention is to provide a storage medium having a computer program stored thereon, wherein the program, when executed by a processor, implements the steps of the above-mentioned method for detecting the fitting position.

[0015] Another object of an embodiment of the present invention is to provide an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the above-mentioned method for detecting the fitting position when executing the program.

[0016] The present invention obtains a regional image at any vertex of the to-be-detected component, and extracts the outer contour straight lines of the adjacent two sides of the display screen and the outer glass according to the regional image, and then obtains the corresponding right angle of the display screen and the glass through the outer contour straight lines, and then compares the angle between the angle bisectors of the two right angles to determine the overall relative deflection condition between the display screen and the glass, that is, to determine whether each side of the display screen is parallel to each corresponding side of the glass and the deflection condition, and then determines the intersection of the two angle bisectors and the corresponding outer contour arc, and the distance between the two intersections. Since the outer contours of the display screen and the glass are both rectangular, the relative deflection condition between the display screen and the glass can be accurately determined only by the distance between the two intersections and the angle between the angle bisectors. , so as to complete the detection of the fitting position between the display screen and the glass. Since only the distance between two points and two angle bisectors need to be determined, the detection efficiency is higher than that of the prior art which needs to obtain the distance between two contour lines and multiple points in multiple areas. In addition, due to the problem of lighting for photography, it is difficult to ensure the accuracy of point selection when the prior art is performing distance measurement, and the prior art requires multiple point selection and distance measurement, while the present application only performs one point selection when confirming the outer contour line. When the line is confirmed, the two right angles and their corresponding two angle bisectors and the angle between the two angle bisectors are all determined, without the need to select according to the picture pixels, and the outer contour arc line is also determined by the right angle, that is, the intersection point is also determined. This avoids the cumulative error of multiple point selections and improves the detection accuracy. In addition, since the tolerance range of the position distance verification is at the millimeter level or even the micron level, a higher measurement accuracy is required. Therefore, even if the true position of each pixel point can be accurately obtained, it is limited to the measurement accuracy of the equipment, and it is difficult to ensure the accuracy of the measurement. By introducing angle-assisted judgment, the difficulty of angle measurement can be reduced by extending the length of two straight lines during angle measurement, and thus the overall detection accuracy can be greatly improved. Therefore, the present invention solves the problem that the prior art lacks a method for detecting the fitting position with high detection efficiency and accuracy. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 is a flow chart of a method for detecting a fitting position in a first embodiment of the present invention; Figure 2 is a structural block diagram of a lamination position detection system in a second embodiment of the present invention; Figure 3 is a schematic structural diagram of an electronic device in a third embodiment of the present invention; The following specific implementation manner will further illustrate the present invention in conjunction with the above-mentioned drawings. DETAILED DESCRIPTION

[0018] In order to facilitate the understanding of the present invention, the present invention will be described more fully below with reference to the relevant drawings. Several embodiments of the present invention are given in the drawings. However, the present invention can be implemented in many different forms and is not limited to the embodiments described herein. On the contrary, the purpose of providing these embodiments is to make the disclosure of the present invention more thorough and comprehensive.

[0019] It should be noted that when an element is referred to as being "fixed to" another element, it may be directly on the other element or there may be a central element. When an element is considered to be "connected to" another element, it may be directly connected to the other element or there may be a central element at the same time. The terms "vertical", "horizontal", "left", "right" and similar expressions used herein are for illustrative purposes only.

[0020] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which the present invention belongs. The terms used herein in the specification of the present invention are only for the purpose of describing specific embodiments and are not intended to limit the present invention. The term "and / or" used herein includes any and all combinations of one or more of the related listed items.

[0021] Embodiment 1 See also Figure 1 , which shows a method for detecting a fitting position in a first embodiment of the present invention, and the method specifically includes steps S01 to S04.

[0022] Step S01, obtaining a regional image at any vertex of the inspected object through a preset image acquisition device, and determining two adjacent display screen outer contour lines of the display screen on the inspected object and two adjacent glass outer contour lines of the glass on the inspected object according to the regional image.

[0023] Specifically, a local image within the first preset range on both adjacent sides of the part to be detected in the regional image is selected; based on the pixel distribution in the local image, a plurality of pixel point groups with the largest color difference with the inner side of the part to be detected and the background pixel of the part to be detected are determined by a preset algorithm; and a plurality of the pixel point groups are fitted to obtain the outer contour straight line of the display screen and the outer contour straight line of the glass. In a specific implementation, the part to be detected is usually black as a whole. Since the size of the display screen is smaller than the glass, the outer contour of the display screen will show white lines under the effect of external lighting, and thus there is a large color difference between the outer contour of the display screen and the inner side of the part to be detected. In addition, when taking pictures, the part to be detected is usually placed on a support plate with a large color difference with the part to be detected. Therefore, when extracting contour lines, the outer contour line of the display screen and the outer contour line of the glass can be accurately determined according to the color difference.

[0024] In addition, the calibration data at least includes a calibration distance range value, and the step of obtaining a picture of the area at any vertex of the part to be inspected by a preset image acquisition device includes obtaining a pre-provided standard part image by a preset image acquisition device, and determining the outer contour line of the standard display screen and the outer contour line of the standard glass according to the standard part image; calculating the distance between the outer contour line of the standard display screen and the outer contour line of the standard glass to determine the standard distance range value, and determining the calibration distance range value according to the standard distance range value and the allowable tolerance; adjusting the outer contour line of the standard display screen according to the extreme values ​​at both ends of the calibration distance range value to determine the outer contour lines of the two extreme values ​​of the display screen; respectively determining the angle between each angle bisector of the two extreme value outer contour lines of the display screen and the angle bisector of the corresponding area of ​​the standard glass outer contour line to determine the calibration angle range value. In specific implementation, since the measurement system of the demander is different from its own measurement system, it is usually necessary to perform precise measurements based on the provided standard parts and allowable tolerances to determine the calibration data under its own measurement system to ensure that the measurement results meet the requirements of the demander.

[0025] Step S02, respectively extending the two display screen outer contour straight lines and the two glass outer contour straight lines to determine the display screen right angle and the glass right angle, and respectively determining the display screen angle bisector and the glass angle bisector according to the display screen right angle and the glass right angle.

[0026] Specifically, after determining the two right angles, the two angle bisectors can be accurately determined, and when measuring the angle between the two angle bisectors, the difficulty of measuring the angle can be reduced by infinitely extending the length of the two angle bisectors. Compared with judging the fitting position only by distance, the required measurement difficulty is lower, and thus under the same conditions, the measurement accuracy is higher.

[0027] Step S03, determining the arc line of the outer contour of the display screen and the arc line of the outer contour of the glass by a preset method, and respectively determining the intersection point of the display screen angle bisector and the arc line of the outer contour of the display screen, and the intersection point of the glass angle bisector and the arc line of the outer contour of the glass, and determining the distance between the two intersection points as the verification distance.

[0028] Specifically, the right angles of the display screen and the right angles of the glass are chamfered according to the standard size information to determine the target display screen contour line and the target glass contour line; the overlapping parts of the target display screen contour line and the display screen outer contour straight line, and the target glass contour line and the glass outer contour straight line are removed to obtain the display screen outer contour arc line and the glass outer contour arc line. In the specific implementation, the arc line is determined by two right angles instead of determining the arc line by pixel extraction and fitting of the photo again, which reduces the cumulative error of multiple pixel extractions and improves the accuracy of detection.

[0029] Step S04, determining the angle between the angle bisector of the display screen and the angle bisector of the glass as the verification angle, and comparing the verification distance and the verification angle with the calibration data to determine whether the fitting position of the to-be-tested component meets the requirements.

[0030] Specifically, after step S04, it also includes performing multi-point selection and ranging sampling on the qualified parts to be tested, and judging whether the sampling pass rate is greater than the preset threshold; if not, adjusting the preset algorithm according to the sampling result. In actual production, in order to further ensure the accuracy and quality of the test, it is necessary to conduct a second sampling inspection on the qualified products to prevent false detection, missed detection or detection equipment failure. In addition, through the method of sampling inspection, the algorithm is adjusted in real time, thereby further ensuring the accuracy of the test.

[0031] By way of example but not limitation, in some optional embodiments, the step of respectively determining the display screen angle bisector and the glass angle bisector according to the display screen right angle and the glass right angle comprises: selecting a vertex angle local image within a second preset range at the vertex angle of the to-be-detected component in the regional image; determining a display screen vertex angle contour pixel point group and a glass vertex angle contour pixel point group respectively by the preset algorithm according to the pixel distribution in the vertex angle local image; determining the display screen vertex angle pixel point group where the display screen angle bisector coincides with the display screen vertex angle contour pixel point group, averaging the sum of the distances between each of the display screen vertex angle pixel points and the vertex of the display screen right angle to obtain a first average value, and determining the vertex distance to the right angle of the display screen. The pixel point at the top corner of the display screen whose distance value is closest to the first average value is the first target point; the glass top corner pixel point whose glass angle bisector coincides with the glass top corner contour pixel point group is determined, the sum of the distances between each of the glass top corner pixel points and the vertex of the glass right angle is averaged to obtain a second average value, and the glass top corner pixel point whose distance value to the vertex of the glass right angle is closest to the second average value is determined as the second target point; the distance between the first target point and the second target point is determined as the verification distance, the angle between the two angle bisectors is determined as the verification angle, and the verification distance and the verification angle are compared with the calibration data to determine whether the fitting position of the part to be inspected meets the requirements.

[0032] Specifically, in other embodiments, the intersection of the outer contour arc line and the angle bisector may not be determined by right-angle chamfering to prevent the error factor of the step of determining the contour straight line from being too large, which would greatly affect the accuracy of all subsequent steps. Furthermore, when determining the intersection, the vertex contour pixel points where the angle bisector and the vertex contour pixel point group overlap are first determined, and then the vertex contour pixel points are screened according to the distance relationship to determine the required intersection points. This not only avoids the cumulative error of the fitting step, but also greatly reduces the amount of data processing and improves detection efficiency by judging the screened pixel points.

[0033] In summary, the method for detecting the fitting position in the above embodiment of the present invention obtains a regional image at any vertex of the part to be detected, and extracts the outer contour straight lines of the adjacent two sides of the display screen and the outer glass according to the regional image, and then obtains the corresponding right angle of the display screen and the glass through the outer contour straight lines, and then determines the overall relative deflection condition between the display screen and the glass by comparing the angle between the angle bisectors of the two right angles, that is, determines whether the sides of the display screen are parallel to the corresponding sides of the glass and the deflection condition, and then determines the intersection of the two angle bisectors and the corresponding outer contour arc, and the distance between the two intersections. Since the outer contours of the display screen and the glass are both rectangular, the distance between the two intersections and the angle between the angle bisectors can be used to accurately determine the relative deflection condition between the display screen and the glass. Determine the positional relationship between the display screen and the glass, so as to complete the detection of the fitting position between the display screen and the glass. Since only the distance between two points and two angle bisectors need to be determined, the detection efficiency is higher than that of the prior art, which needs to obtain the distance between two contour lines and multiple points in multiple areas. In addition, due to the problem of lighting for photography, it is difficult to ensure the accuracy of point selection when performing distance measurement and point selection in the prior art, and the prior art requires multiple point selection and distance measurement, while the present application only selects points once when confirming the outer contour straight line. When the straight line is confirmed, the two right angles and their corresponding two angle bisectors and the angle between the two angle bisectors are all determined, without the need to select according to the pixels of the picture, and the outer contour arc line is also determined by the right angle, that is, the intersection point is also determined. This avoids the cumulative error of multiple point selections and improves the detection accuracy. In addition, since the tolerance range of the position distance verification is at the millimeter level or even the micron level, a higher measurement accuracy is required. Therefore, even if the true position of each pixel point can be accurately obtained, it is limited to the measurement accuracy of the equipment, and it is difficult to ensure the accuracy of the measurement. By introducing angle-assisted judgment, the difficulty of angle measurement can be reduced by extending the length of two straight lines during angle measurement, and thus the overall detection accuracy can be greatly improved. Therefore, the present invention solves the problem that the prior art lacks a method for detecting the fitting position with high detection efficiency and accuracy.

[0034] Embodiment 2 See also Figure 2, which is a structural block diagram of a bonding position detection system proposed in a second embodiment of the present invention, the bonding position detection system 200 comprises: an outer contour straight line determination module 21, an angle bisector determination module 22, an intersection determination module 23, and a verification and judgment module 24, wherein: The outer contour straight line determination module 21 is used to obtain a regional image at any vertex of the to-be-detected part through a preset image acquisition device, and determine the outer contour straight lines of two adjacent display screens on the to-be-detected part and the outer contour straight lines of two adjacent glass panels on the to-be-detected part according to the regional image; An angle bisector determination module 22, which respectively extends the two display screen outer contour straight lines and the two glass outer contour straight lines to determine the display screen right angle and the glass right angle, and determines the display screen angle bisector and the glass angle bisector according to the display screen right angle and the glass right angle; The intersection determination module 23 is used to determine the display screen outer contour arc line and the glass outer contour arc line by a preset method, and respectively determine the intersection point of the display screen angle bisector and the display screen outer contour arc line, and the intersection point of the glass angle bisector and the glass outer contour arc line, and determine the distance between the two intersection points as the calibration distance; The verification judgment module 24 is used to determine that the angle between the display screen angle bisector and the glass angle bisector is the verification angle, and compare the verification distance and the verification angle with the calibration data to determine whether the fitting position of the to-be-tested part meets the requirements.

[0035] Furthermore, the outer contour straight line determination module 21 includes: A local image determination unit, used for selecting a local image within a first preset range of two adjacent sides of the to-be-detected component in the regional image; A pixel point group determination unit, configured to determine, according to the pixel distribution in the local image, a plurality of pixel point groups having the largest color difference with the inner side of the to-be-detected part and the background pixel of the to-be-detected part by a preset algorithm; The outer contour line determination unit is used to respectively fit the plurality of pixel point groups to obtain the outer contour straight line of the display screen and the outer contour straight line of the glass.

[0036] Furthermore, in other embodiments of the present invention, the intersection determination module 23 includes: A target contour line determination unit, used to chamfer the right angles of the display screen and the right angles of the glass according to standard size information, and determine a target display screen contour line and a target glass contour line; The arc line determination unit is used to remove the overlapping parts of the target display screen contour line and the display screen outer contour straight line, and the target glass contour line and the glass outer contour straight line, respectively, to obtain the display screen outer contour arc line and the glass outer contour arc line.

[0037] Furthermore, in other embodiments of the present invention, the calibration data at least includes a calibration angle range value and a calibration distance range value, and the lamination position detection system 200 includes: A standard contour line determination module is used to obtain a pre-provided standard component image through a preset image acquisition device, and determine a standard display screen outer contour line and a standard glass outer contour line according to the standard component image; The calibration distance determination module is used to calculate the distance between the outer contour line of the standard display screen and the outer contour line of the standard glass, determine the standard distance range value, and determine the calibration distance range value according to the standard distance range value and the allowable tolerance.

[0038] An extreme value display screen outer contour line determination module, used to adjust the standard display screen outer contour line according to the extreme values ​​at both ends of the verification distance range value, and determine two extreme value display screen outer contour lines; The calibration angle determination module is used to respectively determine the angles between the angle bisectors of the two extreme display screen outer contour lines and the angle bisectors of the corresponding areas of the standard glass outer contour line, and determine the calibration angle range value.

[0039] Furthermore, in other embodiments of the present invention, the lamination position detection system 200 further includes: A vertex corner local image determination module, used to select a vertex corner local image within a second preset range at the vertex corner of the to-be-detected component in the regional image; A vertex corner outline pixel point group determination module, used to determine the display screen vertex corner outline pixel point group and the glass vertex corner outline pixel point group respectively through the preset algorithm according to the pixel distribution in the vertex corner local image; a first target point determination module, configured to determine a display screen vertex corner pixel point where the display screen angle bisector coincides with the display screen vertex corner contour pixel point group, average the sum of distances between each of the display screen vertex corner pixel points and the vertex of the right angle of the display screen to obtain a first average value, and determine the display screen vertex corner pixel point whose distance value to the vertex of the right angle of the display screen is closest to the first average value as the first target point; A second target point determination module is used to determine the glass vertex corner pixel point where the glass angle bisector coincides with the glass vertex corner contour pixel point group, average the sum of the distances between each of the glass vertex corner pixel points and the vertex of the glass right angle to obtain a second average value, and determine the glass vertex corner pixel point whose distance value to the vertex of the glass right angle is closest to the second average value as the second target point; The verification module is used to determine the distance between the first target point and the second target point as the verification distance, determine the angle between the display screen angle bisector and the glass angle bisector as the verification angle, and compare the verification distance and the verification angle with the verification data to determine whether the fitting position of the part to be inspected meets the requirements.

[0040] Furthermore, in other embodiments of the present invention, the lamination position detection system 200 further includes: A sampling inspection module is used to perform multi-point selection and ranging sampling inspection on the qualified parts to be inspected, and determine whether the sampling inspection pass rate is greater than a preset threshold; The algorithm adjustment module is used to adjust the preset algorithm according to the sampling inspection result when the sampling inspection pass rate is less than or equal to the preset threshold.

[0041] The functions or operation steps implemented when the above modules are executed are substantially the same as those in the above method embodiments, and will not be repeated here.

[0042] Embodiment 3 Another aspect of the present invention provides an electronic device, see Figure 3 , shown is a schematic diagram of an electronic device in the third embodiment of the present invention, including a memory 20, a processor 10, and a computer program 30 stored in the memory and executable on the processor. When the processor 10 executes the computer program 30, the above-mentioned fitting position detection method is implemented.

[0043] In some embodiments, the processor 10 may be a central processing unit (CPU), a controller, a microcontroller, a microprocessor or other data processing chip, used to run program codes or process data stored in the memory 20, such as executing access restriction programs.

[0044] Among them, the memory 20 includes at least one type of readable storage medium, and the readable storage medium includes a flash memory, a hard disk, a multimedia card, a card-type memory (for example, an SD or DX memory, etc.), a magnetic memory, a magnetic disk, an optical disk, etc. In some embodiments, the memory 20 can be an internal storage unit of an electronic device, such as a hard disk of the electronic device. In other embodiments, the memory 20 can also be an external storage device of an electronic device, such as a plug-in hard disk equipped on the electronic device, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (FlashCard), etc. Further, the memory 20 can also include both an internal storage unit of the electronic device and an external storage device. The memory 20 can not only be used to store application software and various types of data of the electronic device, but also can be used to temporarily store data that has been output or is to be output.

[0045] It should be pointed out that Figure 3 The structure shown does not constitute a limitation on the electronic device. In other embodiments, the electronic device may include fewer or more components than those shown in the figure, or combine certain components, or arrange the components differently.

[0046] The embodiment of the present invention further provides a computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, the above-mentioned method for detecting the fitting position is implemented.

[0047] Those skilled in the art will appreciate that the logic and / or steps represented in the flowchart or otherwise described herein, for example, may be considered as an ordered list of executable instructions for implementing logical functions, and may be specifically implemented in any computer-readable medium for use by an instruction execution system, device or apparatus (such as a computer-based system, a system including a processor, or other system that can fetch instructions from an instruction execution system, device or apparatus and execute instructions), or in conjunction with such instruction execution systems, devices or apparatuses. For purposes of this specification, "computer-readable medium" may be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution system, device or apparatus, or in conjunction with such instruction execution systems, devices or apparatuses.

[0048] More specific examples of computer-readable media (a non-exhaustive list) include the following: an electrical connection with one or more wires (electronic device), a portable computer disk case (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be a paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium, followed by editing, deciphering or, if necessary, processing in another suitable manner, and then stored in a computer memory.

[0049] It should be understood that the various parts of the present invention can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, multiple steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or a combination thereof: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0050] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "examples", "specific examples", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.

[0051] The above embodiments only express several implementation methods of the present invention, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present invention. It should be pointed out that, for a person of ordinary skill in the art, several modifications and improvements can be made without departing from the concept of the present invention, and these all belong to the protection scope of the present invention. Therefore, the protection scope of the present invention patent shall be subject to the attached claims.

Claims

1. A method for detecting a fitting position, characterized in that: The method comprises: Obtain a regional image at any vertex of the object to be inspected by a preset image acquisition device, and determine two adjacent straight lines of outer contours of the display screen on the object to be inspected and two adjacent straight lines of outer contours of the glass on the object to be inspected according to the regional image; Extending the two straight lines of the outer contour of the display screen and the two straight lines of the outer contour of the glass respectively to determine the right angle of the display screen and the right angle of the glass, and determining the angle bisector of the display screen and the angle bisector of the glass respectively according to the right angle of the display screen and the right angle of the glass; Determine the display screen outer contour arc line and the glass outer contour arc line by a preset method, and respectively determine the intersection point of the display screen angle bisector and the display screen outer contour arc line, and the intersection point of the glass angle bisector and the glass outer contour arc line, and determine the distance between the two intersection points as the calibration distance; The angle between the display screen angle bisector and the glass angle bisector is determined as the verification angle, and the verification distance and the verification angle are compared with the calibration data to determine whether the fitting position of the to-be-tested part meets the requirements.

2. The method for detecting the fitting position according to claim 1, characterized in that: The step of respectively determining two adjacent straight lines of outer contours of the display screen on the to-be-detected object and two adjacent straight lines of outer contours of the glass on the to-be-detected object according to the regional image comprises: Selecting a local image within a first preset range on two adjacent sides of the to-be-detected component in the regional image; According to the pixel distribution in the local image, a plurality of pixel point groups with the largest color difference with the inner side of the to-be-detected part and the background pixels of the to-be-detected part are determined by a preset algorithm; The plurality of pixel point groups are fitted respectively to obtain the outer contour straight line of the display screen and the outer contour straight line of the glass.

3. The method for detecting the fitting position according to claim 1, characterized in that: The step of determining the arc line of the outer contour of the display screen and the arc line of the outer contour of the glass by a preset method comprises: Chamfering the right angles of the display screen and the right angles of the glass respectively according to the standard size information to determine a target display screen contour line and a target glass contour line; The overlapping parts of the target display screen contour line and the display screen outer contour straight line, and the target glass contour line and the glass outer contour straight line are removed respectively to obtain the display screen outer contour arc line and the glass outer contour arc line.

4. The method for detecting the bonding position according to claim 1, characterized in that: The verification data at least includes a verification distance range value, and the step of obtaining a picture of an area at any vertex of the to-be-detected part by a preset image acquisition device includes: Acquire a pre-provided standard component image through a preset image acquisition device, and determine the outer contour line of a standard display screen and the outer contour line of a standard glass according to the standard component image; The distance between the outer contour line of the standard display screen and the outer contour line of the standard glass is calculated to determine a standard distance range value, and a verification distance range value is determined according to the standard distance range value and an allowable tolerance.

5. The method for detecting the fitting position according to claim 4, characterized in that: The calibration data at least includes a calibration angle range value, and the steps of calculating the distance between the outer contour line of the standard display screen and the outer contour line of the standard glass, determining the standard distance range value, and determining the calibration distance range value according to the standard distance range value and the allowable tolerance include: The outer contour line of the standard display screen is adjusted respectively according to the two extreme values ​​of the verification distance range value to determine the outer contour lines of the two extreme value display screens; The angles between the angle bisectors of the two extreme display screen outer contour lines and the angle bisectors of the corresponding areas of the standard glass outer contour lines are determined respectively to determine the calibration angle range value.

6. The method for detecting the bonding position according to claim 2, characterized in that: After the step of determining the display screen angle bisector and the glass angle bisector according to the display screen right angle and the glass right angle respectively, the following steps are included: Selecting a local image of a vertex within a second preset range at a vertex of the to-be-detected component in the regional image; According to the pixel distribution in the local image of the top corner, the pixel point group of the top corner outline of the display screen and the pixel point group of the top corner outline of the glass are determined respectively by the preset algorithm; Determine the display screen vertex corner pixel point where the display screen angle bisector coincides with the display screen vertex corner contour pixel point group, average the sum of the distances between each of the display screen vertex corner pixel points and the vertex of the right angle of the display screen to obtain a first average value, and determine the display screen vertex corner pixel point whose distance value to the vertex of the right angle of the display screen is closest to the first average value as the first target point; Determine the glass vertex pixel point where the glass angle bisector coincides with the glass vertex contour pixel point group, average the sum of the distances between each of the glass vertex pixel points and the vertex of the glass right angle to obtain a second average value, and determine the glass vertex pixel point whose distance value to the vertex of the glass right angle is closest to the second average value as the second target point; Determine the distance between the first target point and the second target point as the verification distance, determine the angle between the display screen angle bisector and the glass angle bisector as the verification angle, and compare the verification distance and the verification angle with the calibration data to determine whether the fitting position of the part to be inspected meets the requirements.

7. The method for detecting the fitting position according to claim 2, characterized in that: After the step of comparing the verification distance and the verification angle with the calibration data to determine whether the bonding position of the to-be-tested part meets the requirements, the following steps are included: Perform multi-point selection and ranging sampling on the qualified parts to be tested, and determine whether the sampling pass rate is greater than a preset threshold; If not, adjust the preset algorithm according to the sampling results.

8. A fitting position detection system, characterized in that: For implementing the method for detecting the fitting position according to any one of claims 1 to 7, the system comprises: An outer contour straight line determination module is used to obtain a regional image at any vertex of the to-be-detected part through a preset image acquisition device, and determine the outer contour straight lines of two adjacent display screens on the to-be-detected part and the outer contour straight lines of two adjacent glass panels on the to-be-detected part according to the regional image; An angle bisector determination module, which respectively extends the two display screen outer contour straight lines and the two glass outer contour straight lines to determine the display screen right angle and the glass right angle, and determines the display screen angle bisector and the glass angle bisector according to the display screen right angle and the glass right angle; An intersection determination module is used to determine the display screen outer contour arc line and the glass outer contour arc line by a preset method, and respectively determine the intersection point of the display screen angle bisector and the display screen outer contour arc line, and the intersection point of the glass angle bisector and the glass outer contour arc line, and determine the distance between the two intersection points as the calibration distance; The verification and judgment module is used to determine that the angle between the display screen angle bisector and the glass angle bisector is the verification angle, and compare the verification distance and the verification angle with the calibration data to determine whether the fitting position of the to-be-detected part meets the requirements.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the steps of the bonding position detection method according to any one of claims 1 to 7 are implemented.

10. An electronic device, characterized in that: The method comprises a memory, a processor and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the method for detecting the fitting position as claimed in any one of claims 1 to 7 is implemented.

Citation Information

Patent Citations

  • Glass defect detection method and device, electronic equipment and storage medium

    CN115953373A

  • Display screen edge detection method, device and equipment based on deep learning

    CN116309655A

  • Automatic display partitioning based on user number and orientation

    US20140298246A1

Cited By

  • Cam shaft pin hole positioning method and system, storage medium and electronic equipment

    CN120791361A

  • Camshaft pin hole positioning method, system, storage medium and electronic device

    CN120791361B

  • Lamination position detection method and system, storage medium, and electronic device

    WO2026103060A1