FPC wire image positioning method and device, equipment and storage medium

Abstract

The invention discloses an FPC wire image positioning method, device and equipment and a storage medium, and relates to the technical field of display panel automatic optical detection.The FPC wire image positioning method comprises the steps that an FPC wire image is collected, and image coordinates of a positioning piece on an FPC wire are set; carrying out area interception according to the image coordinates of the positioning piece, segmenting binary pictures of the FPC wire and the positioning piece, screening the binary pictures of the positioning piece, and determining an initial area where the positioning piece is located; determining a final area of the positioning piece according to the distance between each area in the initial area and the image coordinate of the positioning piece; and determining the positioning state of the FPC wire according to the size parameter of the positioning piece in the final area. The position information of the FPC wire rod is calculated by taking the positioning piece of the FPC wire rod as a reference, the positioning result of the FPC wire rod is finally output according to the positioning standard, and the positioning precision and the stability are relatively high.

Description

Technical Field

[0001] The present application relates to the technical field of automatic optical detection of display panels, and in particular to a method, device, equipment and storage medium for positioning an image of an FPC wire. Background Art

[0002] In display panels, FPC (Flexible Printed Circuit Board) plays a vital role. FPC is a circuit board made of a flexible substrate that is lightweight, bendable, and foldable, making it very useful in electronic devices with small spaces or irregular shapes.

[0003] In the LCD / OLED and AMOLED screen display panels of smartphones, FPC is used to connect the display panel and other electronic components, ensuring that the circuit board can adapt to complex electronic device designs and provide flexible connection solutions while keeping the device light and portable.

[0004] During the LCD / OLED display panel inspection process, it is necessary to detect and locate the FPC wires on the display panel. The existing commonly used positioning methods mostly use direct calculation to calculate the parameter information of the ROI (Region of Interest). When the background interference is serious, the positioning accuracy and stability are not high. Summary of the invention

[0005] The present application provides an FPC wire image positioning method, device, equipment and storage medium, which uses the positioning piece of the FPC wire as a reference, calculates the position information of the FPC wire, and finally outputs the positioning result of the FPC wire according to the positioning standard, and has high positioning accuracy and stability.

[0006] In a first aspect, an embodiment of the present application provides a method for positioning an image of an FPC wire, the method comprising the following steps:

[0007] Collect the FPC wire image and set the image coordinates of the positioning parts on the FPC wire;

[0008] Performing region interception according to the image coordinates of the positioning member, segmenting the binary images of the FPC wire and the positioning member, screening the binary images of the positioning member, and determining the initial region where the positioning member is located;

[0009] Determining a final area of ​​the positioning element according to the distance between each area in the initial area and the image coordinates of the positioning element;

[0010] The positioning state of the FPC wire is determined according to the size parameters of the positioning piece in the final area.

[0011] In combination with the first aspect, in one implementation, the region is intercepted according to the image coordinates of the positioning member to segment the binary image of the FPC wire and the positioning member, including:

[0012] Taking the image coordinates of the positioning piece as the center, an initial region of interest with a width of several pixels to the left and right of the center is intercepted in the FPC wire image;

[0013] The initial region of interest is segmented using an adaptive threshold value to segment a binary image of the FPC wire and the positioning member.

[0014] In combination with the first aspect, in one implementation, the method further includes:

[0015] Morphological processing is performed on the binary image of the positioning element to filter out interference areas.

[0016] In combination with the first aspect, in one implementation, screening the binary image of the positioning element to determine the initial area where the positioning element is located includes:

[0017] According to the image coordinates of the positioning elements, the area between the positioning elements is set to zero to obtain a first area;

[0018] Screening out an area greater than a set threshold from the first area to obtain a second area;

[0019] The first region and the second region are subtracted, and the initial region where the positioning member is located is screened out according to the aspect ratio and the strength parameter.

[0020] In combination with the first aspect, in one implementation, determining the final area of ​​the positioning element according to the distance between each area in the initial area and the image coordinates of the positioning element includes:

[0021] Calculating and sorting the Euclidean distances between each area in the initial area and the image coordinates of the positioning element;

[0022] The region with the smallest distance in the sorting is taken as the final region of the positioning element.

[0023] In combination with the first aspect, in one embodiment, determining the positioning state of the FPC wire according to the size parameters of the positioning piece in the final area includes:

[0024] The positioning state of the FPC wire is determined according to the area, roundness and aspect ratio of the positioning piece in the final area.

[0025] In combination with the first aspect, in one implementation, when the area of ​​the positioning piece in the final region is greater than 1120 pixels, the roundness is greater than 0.6, and the aspect ratio is greater than 0.85, it is determined that the positioning requirement is met.

[0026] In a second aspect, an embodiment of the present application provides an FPC wire image positioning device, the FPC wire image positioning device comprising:

[0027] An acquisition module, which is used to acquire an image of the FPC wire and set the image coordinates of the positioning parts on the FPC wire;

[0028] A capture module, which performs region capture according to the image coordinates of the positioning member, segments a binary image of the FPC wire and the positioning member, screens the binary image of the positioning member, and determines an initial region where the positioning member is located;

[0029] The interception module further determines the final area of ​​the positioning member according to the distance between each area in the initial area and the image coordinates of the positioning member;

[0030] A calculation module determines the positioning state of the FPC wire according to the size parameters of the positioning piece in the final area.

[0031] In a third aspect, an embodiment of the present application provides an FPC wire image positioning device, comprising a processor, a memory, and an FPC wire image positioning program stored in the memory and executable by the processor, wherein when the FPC wire image positioning program is executed by the processor, the steps of the above-mentioned FPC wire image positioning method are implemented.

[0032] In a fourth aspect, a computer-readable storage medium stores an FPC wire image positioning program, wherein when the FPC wire image positioning program is executed by a processor, the steps of the above-mentioned FPC wire image positioning method are implemented.

[0033] The beneficial effects brought by the technical solution provided by the embodiment of the present application include at least:

[0034] The FPC wire image positioning method in the present application collects the FPC wire image and sets the image coordinates of the positioning piece on the FPC wire; performs region interception according to the image coordinates of the positioning piece, segments the binary image of the FPC wire and the positioning piece, screens the binary image of the positioning piece, and determines the initial region where the positioning piece is located; determines the final region of the positioning piece according to the distance between each region in the initial region and the image coordinates of the positioning piece; and determines the positioning state of the FPC wire according to the size parameters of the positioning piece in the final region.

[0035] That is, the present application uses the positioning piece of the FPC wire as a reference, calculates the position information of the FPC wire, and finally outputs the positioning result of the FPC wire according to the positioning standard, and its positioning accuracy and stability are high. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] Figure 1 This is a flow chart of an embodiment of the FPC wire image positioning method of the present application;

[0037] Figure 2 Schematic diagram of each region of interest image generated in the FPC wire image positioning method of the present application;

[0038] Figure 3 This is a structural block diagram of an embodiment of the FPC wire image positioning device of the present application;

[0039] Figure 4 This is a schematic diagram of the hardware structure of the FPC wire image positioning device involved in the embodiment of the present application. DETAILED DESCRIPTION

[0040] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0041] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below with reference to the accompanying drawings.

[0042] In a first aspect, an embodiment of the present application provides a method for positioning an image of an FPC wire.

[0043] In one embodiment, referring to Figure 1 , Figure 1 This is a flow chart of an embodiment of the FPC wire image positioning method of the present application. Figure 1 As shown, the FPC wire image positioning method includes:

[0044] S1, collect the FPC wire image, and set the image coordinates of the positioning parts on the FPC wire;

[0045] It is worth noting that in this embodiment, the FPC wire on the display panel is mainly detected and positioned. According to the characteristics of the FPC wire image, the position information of the FPC wire is calculated based on the positioning member, and finally the positioning result of the FPC wire is output according to the positioning standard. Among them, the positioning member is a round pin, and of course it can also be other types of positioning structures, which is not limited in this embodiment.

[0046] There are two positioning holes on the FPC wire. The FPC wire is photographed at a fixed camera angle, and the positioning of the FPC wire is determined by calculating the parameters of the circular pins in the positioning holes.

[0047] S2, performing region interception according to the image coordinates of the positioning member, segmenting the binary images of the FPC wire and the positioning member, screening the binary images of the positioning member, and determining the initial region where the positioning member is located;

[0048] Specifically, in this embodiment, the image coordinates of the positioning piece are taken as the center, and an initial region of interest with a width of several pixels to the left and right of the center is intercepted in the FPC wire image; the initial region of interest is adaptively threshold segmented to segment the binary image of the FPC wire and the positioning piece.

[0049] For example, an area with a width of 400 pixels on the left and right of the center can be intercepted in the FPC wire image as the initial region of interest. It is worth noting that the original image and the intercepted initial region of interest are both grayscale or color images. The segmentation threshold of the image is obtained by an adaptive threshold algorithm (global threshold), and the binary images of the FPC wire and the circular pins are segmented for processing in subsequent steps.

[0050] Preferably, in order to filter out the interference area, in some embodiments, morphological processing is also performed on the binary image of the positioning element, such as image enhancement, to improve the image quality by removing noise or highlighting specific structures.

[0051] In addition, the binary image of the positioning element is screened to determine the initial area where the positioning element is located. In specific implementation, it includes:

[0052] According to the image coordinates of the positioning parts, the area between the positioning parts is set to zero to obtain a first area; the area area greater than a set threshold is screened out from the first area to obtain a second area; the first area and the second area are subtracted, and the initial area where the positioning parts are located is screened out according to the aspect ratio and intensity parameters.

[0053] This embodiment uses a fixed coordinate interception method to set the area between the positioning members to zero. Specifically, the circular pin will have two standard coordinates in the image, and the fixed coordinates are calculated based on the two standard coordinates, such as +100 or -100 pixels on the vertical coordinates of the two circular pins. Setting the area intercepted by the fixed coordinates to zero can reduce interference in the middle area of ​​the FPC and improve the calculation speed.

[0054] This embodiment uses area screening to filter out small areas, sets an area screening threshold, and sets the diameter of a circular pin to be approximately 45-50 pixels. The area threshold is set to 1120*5 pixels, and 1120 pixels is the circular pin area threshold. Areas larger than the area threshold will be retained.

[0055] The difference between the first area and the second area can obtain an image containing the circular pin area. The area with an aspect ratio greater than 0.4 and an average intensity greater than 0.3 will be retained.

[0056] S3, determining the final area of ​​the positioning element according to the distance between each area in the initial area and the image coordinates of the positioning element;

[0057] In specific implementation, step S3 includes:

[0058] The Euclidean distances between each area in the initial area and the image coordinates of the positioning element are calculated and sorted; and the area with the smallest distance in the sorting is used as the final area of ​​the positioning element.

[0059] It is worth noting that after the binary image is processed and filtered in the previous steps, the area including the circular pins will be retained, which still contains some other interference areas, so the Euclidean distance needs to be calculated for further screening.

[0060] S4. Determine the positioning state of the FPC wire according to the size parameters of the positioning piece in the final area.

[0061] Once the final area is determined, the positioning state of the FPC wire can be determined based on the size parameters of the positioning piece.

[0062] In this embodiment, the positioning state of the FPC wire is determined based on the area, roundness and aspect ratio of the positioning piece in the final area. For example, when the area of ​​the positioning piece in the final area is greater than 1120 pixels, the roundness is greater than 0.6, and the aspect ratio is greater than 0.85, it is determined that the positioning requirements are met.

[0063] Combine the following Figure 2 The algorithm principle in this embodiment is further explained:

[0064] 1. Set the image coordinates of the circular pin;

[0065] 2. Intercept the FPC wire fixed ROI1 area;

[0066] 3. Adaptive threshold segmentation to obtain ROI2 area;

[0067] 4. Morphological processing is used to filter out the interference area to obtain the ROI3 area;

[0068] 5. Use fixed coordinates to intercept ROI3 area to obtain ROI4 area;

[0069] 6. Area screening filters out small areas and obtains ROI5 area;

[0070] 7. Subtract ROI4 from ROI5, and preliminarily screen ROI6 based on aspect ratio and intensity parameters;

[0071] 8. Calculate the Euclidean distance between each area in the ROI6 area and the standard coordinates of the pin and sort them to obtain the final pin area ROI7;

[0072] 9. Calculate the parameters of the two pins in the ROI7 area, including area, roundness, and aspect ratio, and determine the final positioning status based on the detection standards.

[0073] In summary, the FPC wire image positioning method in the present application collects the FPC wire image and sets the image coordinates of the positioning piece on the FPC wire; performs region interception according to the image coordinates of the positioning piece, segments the binary image of the FPC wire and the positioning piece, screens the binary image of the positioning piece, and determines the initial region where the positioning piece is located; determines the final region of the positioning piece according to the distance between each region in the initial region and the image coordinates of the positioning piece; and determines the positioning state of the FPC wire according to the size parameters of the positioning piece in the final region.

[0074] That is, the present application uses the positioning piece of the FPC wire as a reference, calculates the position information of the FPC wire, and finally outputs the positioning result of the FPC wire according to the positioning standard, and its positioning accuracy and stability are high.

[0075] In a second aspect, an embodiment of the present application also provides an FPC wire image positioning device.

[0076] In one embodiment, referring to Figure 3 , Figure 3 This is a functional module diagram of an embodiment of the FPC wire image positioning device of the present application. Figure 3 As shown, the FPC wire image positioning device includes a collection module, a capture module and a calculation module.

[0077] Among them, the acquisition module is used to acquire the FPC wire image and set the image coordinates of the positioning parts on the FPC wire;

[0078] A capture module, which performs region capture according to the image coordinates of the positioning member, segments a binary image of the FPC wire and the positioning member, screens the binary image of the positioning member, and determines an initial region where the positioning member is located;

[0079] The interception module further determines the final area of ​​the positioning member according to the distance between each area in the initial area and the image coordinates of the positioning member;

[0080] A calculation module determines the positioning state of the FPC wire according to the size parameters of the positioning piece in the final area.

[0081] Furthermore, in one embodiment, the interception module performs region interception according to the image coordinates of the positioning member to segment the binary image of the FPC wire and the positioning member, including:

[0082] Taking the image coordinates of the positioning piece as the center, an initial region of interest with a width of several pixels to the left and right of the center is intercepted in the FPC wire image;

[0083] The initial region of interest is segmented using an adaptive threshold value to segment a binary image of the FPC wire and the positioning member.

[0084] Furthermore, in one embodiment, the interception module is also used for:

[0085] Morphological processing is performed on the binary image of the positioning element to filter out interference areas.

[0086] Furthermore, in one embodiment, the interception module screens the binary image of the positioning element to determine the initial area where the positioning element is located, including:

[0087] According to the image coordinates of the positioning elements, the area between the positioning elements is set to zero to obtain a first area;

[0088] Screening out an area greater than a set threshold from the first area to obtain a second area;

[0089] The first region and the second region are subtracted, and the initial region where the positioning member is located is screened out according to the aspect ratio and the strength parameter.

[0090] Furthermore, in one embodiment, the interception module determines the final area of ​​the positioning element according to the distance between each area in the initial area and the image coordinates of the positioning element, including:

[0091] Calculating and sorting the Euclidean distances between each area in the initial area and the image coordinates of the positioning element;

[0092] The region with the smallest distance in the sorting is taken as the final region of the positioning element.

[0093] Further, in one embodiment, the calculation module determines the positioning state of the FPC wire according to the size parameters of the positioning member in the final area, including:

[0094] The positioning state of the FPC wire is determined according to the area, roundness and aspect ratio of the positioning piece in the final area.

[0095] Furthermore, in one embodiment, the calculation module is also used for:

[0096] When the area of ​​the positioning piece in the final region is greater than 1120 pixels, the roundness is greater than 0.6, and the aspect ratio is greater than 0.85, it is determined that the positioning requirement is met.

[0097] Among them, the functional implementation of each module in the above-mentioned FPC wire image positioning device corresponds to the various steps in the above-mentioned FPC wire image positioning method embodiment, and its functions and implementation processes are no longer repeated here one by one.

[0098] In a third aspect, an embodiment of the present application provides an FPC wire image positioning device, which may be a personal computer (PC), a laptop computer, a server, or other device with data processing capabilities.

[0099] Reference Figure 4 , Figure 4 Schematic diagram of the hardware structure of the FPC wire image positioning device involved in the embodiment of the present application. In the embodiment of the present application, the FPC wire image positioning device may include a processor, a memory, a communication interface and a communication bus.

[0100] The communication bus may be of any type and is used to interconnect the processor, the memory, and the communication interface.

[0101] The communication interface includes input / output (I / O) interface, physical interface and logical interface, etc., which are used to realize the interconnection of devices inside the FPC wire image positioning device, and the interface used to realize the interconnection of the FPC wire image positioning device with other devices (such as other computing devices or user devices). The physical interface can be an Ethernet interface, a fiber optic interface, an ATM interface, etc.; the user device can be a display, a keyboard, etc.

[0102] The memory can be various types of storage media, such as random access memory (RAM), read-only memory (ROM), non-volatile RAM (NVRAM), flash memory, optical storage, hard disk, programmable ROM (PROM), erasable PROM (EPROM), electrically erasable PROM (EEPROM), etc.

[0103] The processor may be a general-purpose processor, and the general-purpose processor may call the FPC wire image positioning program stored in the memory and execute the FPC wire image positioning method provided in the embodiment of the present application. For example, the general-purpose processor may be a central processing unit (CPU). The method executed when the FPC wire image positioning program is called may refer to the various embodiments of the FPC wire image positioning method of the present application, which will not be repeated here.

[0104] Those skilled in the art will understand that Figure 4 The hardware structure shown in the figure does not constitute a limitation on the present application, and may include more or less components than shown in the figure, or combine certain components, or arrange the components differently.

[0105] In a fourth aspect, an embodiment of the present application also provides a readable storage medium.

[0106] The readable storage medium of the present application stores an FPC wire image positioning program, wherein when the FPC wire image positioning program is executed by a processor, the steps of the FPC wire image positioning method as described above are implemented.

[0107] Among them, the method implemented when the FPC wire image positioning program is executed can refer to the various embodiments of the FPC wire image positioning method of the present application, and will not be repeated here.

[0108] It should be noted that the serial numbers of the above-mentioned embodiments of the present application are only for description and do not represent the advantages or disadvantages of the embodiments.

[0109] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, disk, CD) as described above, and includes a number of instructions for a terminal device to execute the methods described in each embodiment of the present application.

[0110] The terms "including" and "having" and any variations thereof in the specification and claims of this application and the above-mentioned drawings are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally includes steps or units that are not listed, or optionally includes other steps or units inherent to these processes, methods, products or devices. The terms "first", "second" and "third" are used to distinguish different objects, etc., and do not represent a sequence, nor do they limit "first", "second" and "third" to different types.

[0111] In the description of the embodiments of the present application, "exemplary", "for example" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary", "for example" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary", "for example" or "for example" is intended to present related concepts in a specific way.

[0112] In the description of the embodiments of the present application, unless otherwise specified, “ / ” means or, for example, A / B can mean A or B; the “and / or” in the text is merely a description of the association relationship of associated objects, indicating that three relationships may exist, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, “multiple” refers to two or more than two.

[0113] In some processes described in the embodiments of the present application, multiple operations or steps that appear in a specific order are included, but it should be understood that these operations or steps may not be executed in the order in which they appear in the embodiments of the present application or in parallel, and the sequence number of the operation is only used to distinguish the different operations, and the sequence number itself does not represent any execution order. In addition, these processes may include more or fewer operations, and these operations or steps may be executed in sequence or in parallel, and these operations or steps may be combined.

[0114] The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

[0115] The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A method for positioning an FPC wire image, characterized in that: The FPC wire image positioning method comprises: Collect the FPC wire image and set the image coordinates of the positioning parts on the FPC wire; Performing region interception according to the image coordinates of the positioning member, segmenting the binary images of the FPC wire and the positioning member, screening the binary images of the positioning member, and determining the initial region where the positioning member is located; Determining a final area of ​​the positioning element according to the distance between each area in the initial area and the image coordinates of the positioning element; The positioning state of the FPC wire is determined according to the size parameters of the positioning piece in the final area.

2. The FPC wire image positioning method according to claim 1, characterized in that: The method of performing region interception according to the image coordinates of the positioning member to segment the binary images of the FPC wire and the positioning member includes: Taking the image coordinates of the positioning piece as the center, an initial region of interest with a width of several pixels to the left and right of the center is intercepted in the FPC wire image; The initial region of interest is segmented using an adaptive threshold value to segment a binary image of the FPC wire and the positioning member.

3. The FPC wire image positioning method according to claim 2, characterized in that: Also includes: Morphological processing is performed on the binary image of the positioning element to filter out interference areas.

4. The FPC wire image positioning method according to claim 1 or 3, characterized in that: The screening of the binary image of the positioning element to determine the initial area where the positioning element is located includes: According to the image coordinates of the positioning elements, the area between the positioning elements is set to zero to obtain a first area; Screening out an area greater than a set threshold from the first area to obtain a second area; The first region and the second region are subtracted, and the initial region where the positioning member is located is screened out according to the aspect ratio and the strength parameter.

5. The FPC wire image positioning method according to claim 1, characterized in that: The step of determining the final area of ​​the positioning element according to the distance between each area in the initial area and the image coordinates of the positioning element comprises: Calculating and sorting the Euclidean distances between each area in the initial area and the image coordinates of the positioning element; The region with the smallest distance in the sorting is taken as the final region of the positioning element.

6. The FPC wire image positioning method according to claim 1, characterized in that: Determining the positioning state of the FPC wire according to the size parameters of the positioning piece in the final area includes: The positioning state of the FPC wire is determined according to the area, roundness and aspect ratio of the positioning piece in the final area.

7. The FPC wire image positioning method according to claim 6, characterized in that: When the area of ​​the positioning piece in the final region is greater than 1120 pixels, the roundness is greater than 0.6, and the aspect ratio is greater than 0.85, it is determined that the positioning requirement is met.

8. An FPC wire image positioning device, characterized in that: The FPC wire image positioning device comprises: An acquisition module, which is used to acquire an image of the FPC wire and set the image coordinates of the positioning parts on the FPC wire; A capture module, which performs region capture according to the image coordinates of the positioning member, segments a binary image of the FPC wire and the positioning member, screens the binary image of the positioning member, and determines an initial region where the positioning member is located; The interception module further determines the final area of ​​the positioning member according to the distance between each area in the initial area and the image coordinates of the positioning member; A calculation module determines the positioning state of the FPC wire according to the size parameters of the positioning piece in the final area.

9. An FPC wire image positioning device, characterized in that: The FPC wire image positioning device includes a processor, a memory, and an FPC wire image positioning program stored in the memory and executable by the processor, wherein when the FPC wire image positioning program is executed by the processor, the steps of the FPC wire image positioning method as described in any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores an FPC wire image positioning program, wherein when the FPC wire image positioning program is executed by a processor, the steps of the FPC wire image positioning method according to any one of claims 1 to 7 are implemented.

Images