Gold wire top height measurement method, device, equipment and storage medium

Abstract

The embodiment of the present application is applicable to the field of chip detection technology, and provides a method, device, equipment and storage medium for measuring the height of the top of the gold wire. The method is applied to a terminal device, including: controlling a light-emitting device to illuminate a first area of ​​the top of the gold wire; obtaining an image to be processed obtained by performing image acquisition on the top of the gold wire at the current measurement height; the image to be processed includes a first image area corresponding to the first area illuminated by the light-emitting device, and a second image area corresponding to the second area of ​​the top of the gold wire that is not illuminated by the light-emitting device; calculating the clarity of the image to be processed based on the pixel values ​​in the first image area and the second image area; if the clarity is greater than a threshold, fitting the current measurement height based on the clarity to calculate the height of the top of the gold wire. The above method can accurately measure the height of the top of the gold wire in the chip.

Description

Technical Field

[0001] The present application belongs to the field of chip detection technology, and in particular, relates to a method, device, equipment and storage medium for measuring the height of a gold wire top. Background Art

[0002] At present, chips are widely used in electronic devices such as smart phones, tablets, and personal computers. The gold wires on the chip can connect the electrodes on the chip surface to the hardware devices in the electronic devices. When the power is turned on, the current can enter the chip through the gold wires to make the chip work. Therefore, chip gold wire detection plays a very important role in the production and manufacturing process of chips.

[0003] During the chip gold wire inspection process, the gold wire bending angle, the height of the gold wire from the reference plane (the height of the top of the gold wire) and the number of gold wires are inspected to determine whether the chip gold wire has quality problems such as broken wires, missed wires or touched wires.

[0004] However, when measuring the height of the top of the gold wire on the chip, the measurement personnel use a common measurement microscope (50x objective lens) for imaging and visual measurement. However, since the top of the gold wire on the chip is very small, the measurement personnel need to have rich on-site measurement experience when visually measuring, otherwise the measured height is prone to errors greater than 5 microns. Therefore, in the prior art, there is a large error when measuring the height of the top of the gold wire on the chip. Summary of the invention

[0005] The embodiments of the present application provide a method, an apparatus, a terminal device and a storage medium for measuring the height of the top of the gold wire, which can solve the problem of large errors when measuring the height of the top of the gold wire of a chip.

[0006] In a first aspect, an embodiment of the present application provides a method for measuring the height of a gold wire top, which is applied to a terminal device, and the method includes:

[0007] Controlling the light emitting device to illuminate a first area on the top of the gold wire;

[0008] Acquire an image to be processed obtained by performing image acquisition on the top of the gold wire at the current measurement height; the image to be processed includes a first image area corresponding to a first area illuminated by the light-emitting device, and a second image area corresponding to a second area of ​​the top of the gold wire not illuminated by the light-emitting device;

[0009] Calculating the clarity of the image to be processed according to the pixel values ​​in the first image area and the second image area;

[0010] If the clarity is greater than the threshold, the current measured height is fitted based on the clarity to calculate the height of the top of the gold wire.

[0011] In a second aspect, an embodiment of the present application provides a device for measuring the height of a gold wire top, which is applied to a terminal device, and the device includes:

[0012] A control module, used for controlling the light emitting device to illuminate a first area on the top of the gold wire;

[0013] An acquisition module is used to acquire an image to be processed obtained by acquiring an image of the top of the gold wire at a current measurement height; the image to be processed includes a first image area corresponding to a first area illuminated by the light-emitting device, and a second image area corresponding to a second area of ​​the top of the gold wire not illuminated by the light-emitting device;

[0014] A clarity calculation module, used to calculate the clarity of the image to be processed according to the pixel values ​​in the first image area and the second image area;

[0015] The fitting module is used to fit the current measured height based on the clarity if the clarity is greater than a threshold value, and calculate the height of the top of the gold wire.

[0016] In a third aspect, an embodiment of the present application provides a terminal device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the method of the first aspect described above when executing the computer program.

[0017] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the method of the first aspect described above is implemented.

[0018] In a fifth aspect, an embodiment of the present application provides a computer program product, which, when executed on a terminal device, enables the terminal device to execute the method of the first aspect.

[0019] Compared with the prior art, the beneficial effect of the embodiment of the present application is that by controlling the light-emitting device to illuminate the first area of ​​the top of the gold wire, the terminal device collects the top of the gold wire at the current measurement height to obtain a first image area corresponding to the first area illuminated by the light-emitting device, and a second image area corresponding to the second area of ​​the top of the gold wire that is not illuminated by the light-emitting device. Therefore, the pixel value size of the first image area will form a relatively obvious difference with the pixel value size of the second image area. Afterwards, the terminal device can accurately calculate the clarity of the image to be processed based on the pixel values ​​of the two image areas with relatively obvious differences. Finally, when the clarity is greater than the threshold, the terminal device can preliminarily determine that the current measurement height at this time is close to the actual height of the top of the gold wire. And, in this case, the terminal device can further fit the current measurement height based on the clarity to obtain the actual height of the top of the gold wire, so as to further improve the accuracy of the gold wire measurement of the height of the top of the gold wire. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0021] Figure 1 It is a structural schematic diagram of a height measurement device for the top of a gold wire provided in one embodiment of the present application;

[0022] Figure 2 An embodiment of the present application provides Figure 1 A partial enlarged schematic diagram of the top of a gold wire of the chip at A;

[0023] Figure 3 A schematic diagram of the structure of a chip provided in one embodiment of the present application;

[0024] Figure 4 A schematic diagram of an image to be processed acquired at multiple measurement heights provided in an embodiment of the present application;

[0025] Figure 5 This is a flow chart of a method for measuring the height of a gold wire top provided in one embodiment of the present application;

[0026] Figure 6 is a top view of a light emitting device and a gold wire top structure provided by an embodiment of the present application;

[0027] Figure 7 This is a schematic diagram of an implementation method of S102 of a method for measuring the height of a gold wire top provided in an embodiment of the present application;

[0028] Figure 8 This is a schematic diagram of an implementation method of S102 of a method for measuring the height of a gold wire top provided in another embodiment of the present application;

[0029] Fig. 9 This is a schematic diagram of an implementation method of S103 of a method for measuring the height of a gold wire top provided in an embodiment of the present application;

[0030] Fig.10 This is a schematic diagram of an implementation method of S104 of a method for measuring the height of a gold wire top provided in an embodiment of the present application;

[0031] Fig.11 is a flow chart of a method for measuring the height of a gold wire top provided in another embodiment of the present application;

[0032] Fig.12 is a flowchart of a method for measuring the height of a gold wire top provided by another embodiment of the present application;

[0033] Fig.13 is a structural schematic diagram of a height measurement device for a gold wire top provided in another embodiment of the present application;

[0034] Fig.14 It is a structural diagram of a terminal device provided in one embodiment of the present application. DETAILED DESCRIPTION

[0035] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present application.

[0036] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, wholes, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or combinations thereof.

[0037] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0038] The method for measuring the height of the top of the gold wire provided in the embodiment of the present application can be applied to terminal devices such as tablet computers, notebook computers, and ultra-mobile personal computers (UMPCs). The embodiment of the present application does not impose any restrictions on the specific type of the terminal device.

[0039] It should be noted that the terminal device needs to be connected to and control a microscope and a camera device for measuring the height of the top of the gold wire. Specifically, the microscope can be a microscope with a 50x objective lens, and the camera device can be a digital industrial camera.

[0040] Reference Figure 1, wherein the chip 1 is placed on a stage 2, the stage 2 itself can move in the horizontal direction (x-axis direction), and the stage 2 is arranged on a y-motion axis 3, so that the stage can move in the xy direction (i.e., in the horizontal direction and in the vertical direction); the y-motion axis 3 is mounted to the upper end of a base 4, and the base 4 is connected to a marble mounting frame 5; a z-motion axis 6 is mounted on the marble mounting frame 5, and a microscope barrel 7 is mounted on the z-motion axis 6, and the z-motion axis 6 can control the movement of the microscope barrel 7 in the vertical direction; a microscope objective lens 8 and a light-emitting device 9 are mounted below the microscope barrel 7; wherein a light beam 13 emitted by the light-emitting device 9 irradiates the top of the gold wire and forms a reflected light beam 12; refer to Figure 2 , Figure 2 for Figure 1 The schematic diagram of the top of a gold wire of the chip at A is a partial enlarged schematic diagram, specifically a partial enlarged schematic diagram of the top of the gold wire when it is illuminated by the light emitting device 9. A lens barrel 10 and a digital industrial camera 11 are installed above the microscope lens barrel 7.

[0041] When measuring the height of the top of the gold wire, the terminal device can send a motion instruction to the PLC controller in the microscope (not shown in the figure), and the PLC controller controls the z motion axis 6 to rise according to the motion instruction to form multiple measurement heights of the top of the gold wire. Among them, multiple measurement heights can ensure that the microscope objective 8 and the light emitting device 9 are higher than the top of the gold wire in the chip 1. In addition, at each measurement height, the terminal device can send a shooting instruction to control the digital industrial camera to shoot the image of the top of the gold wire to form an image to be processed at the measurement height.

[0042] Specifically, refer to Figure 3 and Figure 4 , Figure 3 The image on the left is a schematic diagram of the structure of the chip 1 ; wherein the top height of the gold wire is specifically the vertical height from the top of the gold wire to the stage 2 . Figure 3 The right side is a partial enlarged schematic diagram of the top structure of the gold wire at B in chip 1. The image to be processed collected at each measurement height can be referred to Figure 4 As shown, Figure 4 Contains images to be processed taken at 8 measurement heights.

[0043] See also Figure 5 , Figure 5 A flowchart of a method for measuring the height of a gold wire top provided in an embodiment of the present application is shown. The method comprises the following steps:

[0044] S101 , a terminal device controls a light-emitting device to illuminate a first area on a top of a gold wire.

[0045] In one embodiment, the light emitting device may be a LED light source, wherein the types of LED light sources include but are not limited to bar light sources, ring light sources or coaxial light sources, and this embodiment does not limit the types of LED light sources.

[0046] In one embodiment, the first area is specifically an area illuminated by the light emitting device. Figure 6 , Figure 6 is a top view of the light emitting device and the gold wire top structure, wherein: Figure 6 The annular area in the middle can be considered as a light-emitting device, the black fan-shaped area in the annular area can be considered as an illuminated area on the top of the gold wire, and the white fan-shaped area can be considered as an unilluminated area on the top of the gold wire.

[0047] Based on this, it can be understood that for the above-mentioned LED light source, there may be multiple LED light sources, forming a ring-shaped light source arranged on the microscope objective lens. Moreover, when controlling the LED device to irradiate the first area on the top of the gold wire, one or more LED light source devices can be controlled to irradiate the top of the gold wire to form one or more first areas.

[0048] S102, the terminal device obtains an image to be processed obtained by capturing an image of the top of the gold wire at a current measurement height; the image to be processed includes a first image area corresponding to a first area illuminated by the light-emitting device, and a second image area corresponding to a second area of ​​the top of the gold wire not illuminated by the light-emitting device.

[0049] In one embodiment, the image to be processed is an image generated by photographing the top of the gold wire with a digital industrial camera. The first area has been described in S101. It is understandable that, for the top of the gold wire, the area not illuminated by the light-emitting device is the second area. When photographing the top of the gold wire to generate the image to be processed, the first area corresponds to the first image area in the image to be processed, and the second area corresponds to the second image area in the image to be processed.

[0050] In another embodiment, in order to better process the image to be processed, the generated first image area and the second image area may have multiple ones, and therefore, the above-mentioned light emitting device may be provided in multiple ones. Figure 7 In S102, the image to be processed is obtained by acquiring the image of the top of the gold wire at the current measurement height, which can be specifically implemented by the following sub-steps S1021-S1022:

[0051] S1021. The terminal device divides a plurality of light-emitting devices into a plurality of first light-emitting device groups and a plurality of second light-emitting device groups; the plurality of first light-emitting device groups are respectively interactively arranged with the plurality of second light-emitting device groups.

[0052] S1022: The terminal device controls the first light-emitting device group or the second light-emitting device group to emit light toward the top of the gold wire to generate a plurality of first image areas and a plurality of second image areas.

[0053] In one embodiment, the first light-emitting device group and the second light-emitting device group each include at least one light-emitting device. Generally, the number and model of the light-emitting devices included in the first light-emitting device group are consistent with the number and model of the light-emitting devices included in the second light-emitting device group. In this way, the range of each first image area in the image to be processed in the image to be processed can be almost consistent with the range of the second image area in the image to be processed.

[0054] Among them, the interactive setting of the first light-emitting device group and the second light-emitting device group can make the illuminated area and the unilluminated area in the image to be processed have light and dark differences, and the existing light and dark differences are more obvious, which is conducive to the subsequent calculation of the top height of the gold wire based on the image area with obvious light and dark differences.

[0055] It is understandable that when the first light-emitting device group emits light, the second light-emitting device group will not emit light; and when the first light-emitting device group does not emit light, the second light-emitting device group emits light. At this time, the area illuminated by the second light-emitting device group when emitting light is the first area. That is, the "first", "second", etc. in the above terms are only used to distinguish descriptions and cannot be understood as indicating or implying relative importance.

[0056] In a specific embodiment, when the terminal device controls the light-emitting device to illuminate the first area on the top of the gold wire, it is also necessary to adjust the orientation angle of the light-emitting device. Specifically, the terminal device can calculate the orientation angle of the first light-emitting device group or the second light-emitting device group; if any orientation angle is outside the preset angle range, the orientation angle of the first light-emitting device group or the second light-emitting device group is controlled to be changed.

[0057] In one embodiment, the above-mentioned orientation angle is the angle of the light toward the top of the gold wire when the first light-emitting device group or the second light-emitting device group illuminates the top of the gold wire. It can be understood as the angle between the light emitted by the first light-emitting device group or the second light-emitting device group and the horizontal direction. Among them, the above-mentioned preset angle range can be 10° to 60°. Specifically, in this embodiment, the above-mentioned orientation angle can be 45°. At this time, after the first area of ​​the top of the gold wire of the light-emitting device, the brightness distinction between the first image area and the second image area in the collected image to be processed is more obvious.

[0058] It should be added that, because the specific height of the top of the gold wire is not determined, when measuring the height of the top of the gold wire, the surveyor usually sets multiple measurement heights based on the approximate range of the top height of the gold wire to accurately measure the top height of the gold wire. Based on this, among the images to be processed collected at multiple measurement heights, there may be images to be processed that do not contain the top of the gold wire. For example, the measurement height is too low to capture the top of the gold wire; or the measurement height is too high, and the clarity of the top of the gold wire in the image to be processed that contains the top of the gold wire is too blurred.

[0059] Based on this, in this embodiment, refer to Figure 8 In S102, the image to be processed obtained by acquiring the image of the top of the gold wire at the current measurement height can be specifically implemented through the following sub-steps S1023-S1025:

[0060] S1023. The terminal device collects images to be processed at multiple measurement heights respectively.

[0061] S1024. For any image to be processed, if the image to be processed does not include the top of the gold line, the terminal device deletes the image to be processed.

[0062] In one embodiment, the above-mentioned multiple measurement heights can be set according to the specifications of the gold wire produced. Usually, for each specification of the gold wire, the height of the top of the gold wire is usually fixed, and the error is usually within the first error range. For example, the first error range is usually 5 microns. Therefore, after determining the specifications of the gold wire, the standard height of the top of the gold wire can be determined accordingly. Afterwards, the second error range is added and subtracted on the standard height to obtain the measurement height area range. At this time, the second error range can be greater than the first error range. Furthermore, it can be ensured that the multiple measurement heights set within the measurement height area range include the actual measurement height of the top of the gold wire.

[0063] Among them, for the above-mentioned multiple measurement heights, the difference between adjacent measurement heights can be set to be fixed, so as to gradually adjust the measurement height.

[0064] In one embodiment, if the image to be processed does not include the top of the gold wire, it can be considered that the measured height at this time is too low or too high, that is, the measured height is not the exact height of the top of the gold wire. Based on this, the terminal device can delete the image to be processed taken at the measured height.

[0065] S1025. If the image to be processed includes the top of the gold wire, the terminal device determines the measured height of the image to be processed as the current measured height, and determines the image to be processed as the image to be processed obtained by capturing the top of the gold wire at the current measured height; the current measured height includes at least one.

[0066] In one embodiment, if the image to be processed includes the top of the gold wire, it can be considered that the measured height at this time is at or close to the real height of the top of the gold wire, so the terminal device can retain the image to be processed taken at the measured height. That is, the measured height is determined as the current measured height, and the image to be processed captured at the measured height is determined as the image to be processed captured at the current measured height.

[0067] It is understandable that, because the difference in the measured height adjusted each time is usually small, there may be multiple images to be processed collected at multiple measured heights that all contain the top of the gold wire. Based on this, the current measured height may also include multiple ones.

[0068] S103: The terminal device calculates the clarity of the image to be processed according to the pixel values ​​in the first image area and the second image area.

[0069] In one embodiment, the first image area and the second image area have been explained in S101 and S102 above, and will not be described again. It can be understood that the first image area is the image area illuminated by the light-emitting device, and the second image area is the second image area not illuminated by the light-emitting device. Therefore, the pixel value of the pixel point in the first image area is usually greater than the pixel value of the pixel point in the second image area.

[0070] In a specific embodiment, referring to Fig. 9 The terminal device can specifically calculate the clarity of the image to be processed through the following sub-steps S1031-S1033:

[0071] S1031. The terminal device respectively determines a first pixel point and a second pixel point located at the boundary between a first image area and a second image area.

[0072] In one embodiment, the image clarity may be calculated using a grayscale variance algorithm or a grayscale difference absolute value sum variance algorithm, which is not limited thereto.

[0073] For example, the clearer the image is, the more high-frequency components there are in the image. Based on this, when calculating the clarity, the grayscale average value of all pixels in the image to be processed can be used as a reference, and the grayscale value of each pixel is subtracted and then the square sum is calculated. Based on this, the obtained value can be used to characterize the grayscale change degree of the image to be processed. Among them, the greater the grayscale change degree, the clearer the image to be processed, and the smaller the grayscale change degree, the more blurred the image to be processed.

[0074] The above method is only an example of calculating the clarity. In this embodiment, there is no limitation on the method for calculating the clarity.

[0075] In this embodiment, if the pixel values ​​of the pixels of the entire first image area are respectively calculated with the pixel values ​​of the pixels of the entire second image area, the computing resources of the terminal device will be increased. Based on this, when ensuring that the calculated clarity can accurately represent the clarity of the image to be processed, the terminal device can calculate the clarity only based on the first pixel and the second pixel at the junction of the first image area and the second image area.

[0076] It is understandable that the junction is usually the boundary between the light and dark areas, that is, the average pixel value between the pixel value of the first pixel point and the pixel value of the second pixel point in the junction is usually the largest. Therefore, the clarity calculated based on the first pixel point and the second pixel point at the junction is also closer to the clarity between the first image area and the second image area.

[0077] S1032. The terminal device calculates an average pixel value of the first pixel and the second pixel based on the pixel value of the first pixel and the pixel value of the second pixel.

[0078] In one embodiment, the average pixel value may be obtained by calculating the sum of the pixel value of each first pixel point and the pixel value of each second pixel point, and then averaging the sum.

[0079] Specifically, the terminal device can calculate the average pixel value by the following calculation formula:

[0080]

[0081] Where A is the average pixel value; x and y are the image coordinates of the pixel point (the first pixel point or the second pixel point) at the intersection; N x *N y is the total number of pixels; f(x, y) is the pixel value of the pixel at the coordinate (x, y).

[0082] S1033. The terminal device calculates the clarity of the boundary in the image to be processed based on the average pixel value; the clarity of the boundary is used to characterize the clarity of the image to be processed.

[0083] In one embodiment, after obtaining the average pixel value, the terminal device can calculate the variance of the pixel value of each first pixel point and the pixel value of each second pixel point at the junction and the average pixel value, respectively, to obtain the grayscale change degree at the junction. That is, the clarity of the junction. The grayscale change degree (clarity) calculation formula is as follows:

[0084]

[0085] It should be noted that, since the first image area is adjacent to the second image area and there are multiple of them, the calculated sharpness will also be multiple. Based on this, after obtaining multiple sharpnesses, the terminal device can determine the average value of the multiple sharpnesses as the final sharpness of the image to be processed.

[0086] S104: If the clarity is greater than the threshold, the terminal device fits the current measured height based on the clarity and calculates the height of the top of the gold wire.

[0087] In one embodiment, the above threshold can be set according to actual conditions and is not limited thereto. When the clarity of the image to be processed including the top of the gold wire is greater than the threshold, it can be determined that the current measured height is closer to the actual height of the top of the gold wire. Therefore, when there is only one current measured height obtained after the above steps, and when there is only one image to be processed collected at the current measured height whose clarity is greater than the threshold, the terminal device can directly determine the current measured height as the actual height of the top of the gold wire.

[0088] However, when the top of the gold wire is photographed using a microscope and a camera, the clarity at other measurement heights may also be greater than the threshold. That is, there are cases where the clarity of the images to be processed taken at multiple measurement heights is different, but all greater than the above threshold. Therefore, there may be multiple current measurement heights obtained after the above steps, and the clarity of the images to be processed collected at multiple current measurement heights may be greater than the threshold.

[0089] Based on this, in this embodiment, when the clarity of the to-be-processed images collected at multiple current measurement heights is greater than the threshold, refer to Fig.10 The terminal device can specifically calculate the height of the top of the gold wire according to the following sub-steps S1041-S1042:

[0090] S1041. The terminal device performs Gaussian fitting on the clarity and the current measured height to generate a Gaussian function.

[0091] S1042. The terminal device calculates the mean of the Gaussian function as the height of the top of the gold line.

[0092] In one embodiment, the Gaussian fitting of the clarity and the current measured height is specifically as follows: the terminal device uses the current measured height and the clarity corresponding to the current measured height as a set of data. Since the clarity of the image to be processed at multiple current measured heights is greater than the threshold, the terminal device can obtain multiple sets of data. After that, the terminal device can construct a Gaussian function based on the multiple sets of data, and perform Gaussian fitting on multiple current measured heights and corresponding clarity based on the Gaussian function system of the Gaussian function, and calculate each characteristic parameter in the Gaussian function. In this way, an expression for representing the functional relationship between clarity and measured height is generated.

[0093] Based on this, after generating the Gaussian function, the terminal device can calculate the mean of the Gaussian function and determine the mean as the height of the top of the gold wire to improve the accuracy of calculating the actual height of the top of the gold wire. Among them, calculating the mean of a known Gaussian function is an existing technology and will not be described in detail.

[0094] In this embodiment, by controlling the light-emitting device to illuminate the first area of ​​the top of the gold wire, the terminal device collects the top of the gold wire at the current measurement height to obtain a first image area corresponding to the first area illuminated by the light-emitting device, and a second image area corresponding to the second area of ​​the top of the gold wire that is not illuminated by the light-emitting device. Therefore, the pixel value size of the first image area will form a relatively obvious difference with the pixel value size of the second image area. Afterwards, the terminal device can accurately calculate the clarity of the image to be processed based on the pixel values ​​of the two image areas with relatively obvious differences. Finally, when the clarity is greater than the threshold, the terminal device can preliminarily determine that the current measurement height at this time is close to the actual height of the top of the gold wire. And, in this case, the terminal device can further fit the current measurement height based on the clarity to obtain the actual height of the top of the gold wire, so as to further improve the accuracy of the gold wire measurement of the height of the top of the gold wire.

[0095] In another embodiment, the above S103 calculates the clarity of the image to be processed based on the pixel values ​​in the first image area and the second image area. Specifically, based on the above steps S1031-S1033, it can be known that the terminal device calculates the clarity of the image to be processed based on the pixel values ​​of the pixels at the junction of the first image area and the second image area. However, when the light-emitting device illuminates the first area on the top of the gold wire, light diffusion may occur, so that the junction of the first image area and the second image area in the final collected image to be processed may not be obvious.

[0096] Based on this, after obtaining the image to be processed by collecting the image of the top of the gold wire at the current measurement height in S102, refer to Fig.11 The terminal device can also process the image to be processed through the following steps S121-S122:

[0097] S121: For any pixel point in any image to be processed, if the pixel value of the pixel point is greater than the first pixel value, the terminal device changes the pixel value of the pixel point to the second pixel value. And,

[0098] S122. If the pixel value of the pixel point is less than or equal to the second pixel value, the terminal device changes the pixel value of the pixel point to a third pixel value.

[0099] In one embodiment, the first pixel value, the second pixel value and the third pixel value can be set according to actual conditions and are not limited thereto.

[0100] Exemplarily, the terminal device can count the sum of the pixel values ​​of each pixel point in the image to be processed; then, calculate the pixel average value according to the sum of the pixel values, and determine the pixel average value as the first pixel value. Among them, the second pixel value can be set to 255, and the third pixel value can be set to 0. At this time, the light and dark boundaries at the junction of the first image area and the second image area processed by the above steps will become obvious. Then, the terminal device can accurately calculate the clarity of the image to be processed based on the pixel value at the junction.

[0101] In another embodiment, the size of the top of the gold wire is usually relatively thin, so the area occupied by the top of the gold wire in the image to be processed is usually small. In addition, even if the captured image to be processed includes the top of the gold wire, the clarity of the top of the gold wire in the final captured image to be processed may be poor due to the measurement height being far from the top of the gold wire.

[0102] Based on this, refer to Fig.12 Before calculating the definition of the image to be processed according to the pixel values ​​in the first image area and the second image area in S103, the terminal device may further process the image to be processed through the following steps S131-S135 to further delete the image to be processed that does not meet the requirements from the multiple images to be processed:

[0103] S131. The terminal device determines the image position of the top of the gold wire in the image to be processed.

[0104] In one embodiment, the terminal device can determine any pixel point of the image to be processed as the coordinate origin to construct a two-dimensional coordinate system. Afterwards, the image to be processed is recognized based on an existing image position recognition model to determine the image position of the top of the gold line in the image to be processed. Alternatively, the coordinate position input by the measurement personnel is received and the coordinate position is determined as the image position of the top of the gold line in the image to be processed, which is not limited.

[0105] S132. The terminal device selects an image window in the image to be processed with the image position as the center, and generates a local image to be processed including the top of the gold wire.

[0106] In one embodiment, the width and length of the image window can be preset in the terminal device. Afterwards, the terminal device determines the image position as the center, and determines the four vertices of the image window according to the image position, the preset width and length. Finally, the image area enclosed by the four vertices is selected to generate a local image to be processed including the top of the gold wire.

[0107] It should be noted that whether the image to be processed contains the top of the gold line can be determined based on the above-mentioned partial image to be processed. If the determination is based on the complete image to be processed, the performance resources required by the terminal device to calculate the image to be processed will increase.

[0108] S133, the terminal device calculates the similarity between the local image to be processed and a preset feature image; the preset feature image is a standard image taken of the top of the gold wire of known height.

[0109] In one embodiment, the preset characteristic image is a standard image captured by the terminal device controlling the microscope and the digital industrial camera to capture the top of the gold wire of known height. Specifically, when the height of the top of the gold wire is known, the terminal device can control the height of the z motion axis in the microscope to be consistent with the known height; or slightly higher than the known height (for example, 1 micron higher than the known height). Afterwards, the digital industrial camera is controlled to capture the top of the gold wire. At the same time, when capturing the height of the top of the gold wire, it is also necessary to control the light-emitting device to illuminate the first area of ​​the top of the gold wire, so that the preset characteristic image obtained is the standard image.

[0110] In one embodiment, the similarity can be obtained by identification based on a pre-trained similarity identification model. The similarity identification model and the image position identification model can be obtained by model training using known training methods, which will not be described in detail.

[0111] S134: If the similarity is greater than a preset similarity, the terminal device executes a step of calculating the clarity of the image to be processed.

[0112] S135. Otherwise, the terminal device deletes the image to be processed.

[0113] In one embodiment, the above-mentioned preset similarity can be set by the measurement personnel in advance according to the actual situation, and there is no limitation on this. It can be understood that when the similarity is greater than the preset similarity, it indicates that the current measured height may be the actual height of the top of the gold wire. Based on this, the terminal device can perform the subsequent steps of calculating the clarity of the image to be processed. Otherwise, the terminal device may believe that although the image to be processed collected at the current measurement height contains the top of the gold wire, the measured height is much higher than the height of the top of the gold wire. That is, the terminal device does not need to perform subsequent clarity calculation processing on it, so as to reduce the number of processing of the image to be processed by the terminal device.

[0114] See also Fig.13 , Fig.13 : is a structural block diagram of a gold wire top height measurement device provided in an embodiment of the present application. The gold wire top height measurement device in this embodiment includes modules for executing Figure 5 , Figures 7 to 12 For details, please refer to the steps in the corresponding embodiment. Figure 5 , Figures 7 to 12 as well as Figure 5 , Figures 7 to 12 For the convenience of explanation, only the parts related to this embodiment are shown. Fig.13 The gold wire top height measuring device 1300 may include: a control module 1310, an acquisition module 1320, a clarity calculation module 1330 and a fitting module 1340, wherein:

[0115] The control module 1310 is used to control the light emitting device to illuminate the first area on the top of the gold wire.

[0116] The acquisition module 1320 is used to obtain the image to be processed obtained by capturing the image of the top of the gold wire at the current measurement height; the image to be processed includes a first image area corresponding to the first area illuminated by the light-emitting device, and a second image area corresponding to the second area of ​​the top of the gold wire not illuminated by the light-emitting device.

[0117] The clarity calculation module 1330 is used to calculate the clarity of the image to be processed according to the pixel values ​​in the first image area and the second image area.

[0118] The fitting module 1340 is used to fit the current measured height based on the clarity to calculate the height of the top of the gold wire if the clarity is greater than a threshold.

[0119] In one embodiment, there are multiple light emitting devices; the acquisition module 1320 is further used for:

[0120] The multiple light-emitting devices are divided into multiple first light-emitting device groups and multiple second light-emitting device groups; the multiple first light-emitting device groups are respectively interactively arranged with the multiple second light source device groups; the first light-emitting device group or the second light-emitting device group is controlled to emit light toward the top of the gold wire to generate multiple first image areas and multiple second image areas.

[0121] In one embodiment, the acquisition module 1320 is further used to:

[0122] The images to be processed are respectively acquired at a plurality of measuring heights; for any image to be processed, if the image to be processed does not contain the top of the gold wire, the image to be processed is deleted; if the image to be processed contains the top of the gold wire, the measuring height of the image to be processed is determined as the current measuring height, and the image to be processed is determined as the image to be processed obtained by acquiring the image of the top of the gold wire at the current measuring height; the current measuring height includes at least one.

[0123] In one embodiment, the gold wire top height measuring device 1300 further includes:

[0124] A first changing module is used for changing the pixel value of any pixel point in any image to be processed to a second pixel value if the pixel value of the pixel point is greater than the first pixel value. And,

[0125] The second changing module is used for changing the pixel value of the pixel point to a third pixel value if the pixel value of the pixel point is less than or equal to the second pixel value.

[0126] In one embodiment, the gold wire top height measuring device 1300 further includes:

[0127] The determination module is used to determine the image position of the top of the gold wire in the image to be processed.

[0128] The selection module is used to select an image window in the image to be processed with the image position as the center, and generate a local image to be processed including the top of the gold wire.

[0129] The similarity calculation module is used to calculate the similarity between the local image to be processed and the preset feature image; the preset feature image is a standard image taken of the top of the gold wire with a known height.

[0130] The execution module is used to execute the step of calculating the clarity of the image to be processed if the similarity is greater than a preset similarity.

[0131] The deletion module is used to delete the image to be processed otherwise.

[0132] In one embodiment, the clarity calculation module 1330 is further configured to:

[0133] Determine a first pixel point and a second pixel point at the junction of a first image area and a second image area respectively; calculate an average pixel value of the first pixel point and the second pixel point according to the pixel value of the first pixel point and the pixel value of the second pixel point; calculate the clarity of the junction in the image to be processed based on the average pixel value; the clarity of the junction is used to characterize the clarity of the image to be processed.

[0134] In one embodiment, the fitting module 1340 is further configured to:

[0135] Perform Gaussian fitting on the clarity and the current measured height to generate a Gaussian function; calculate the mean of the Gaussian function as the height of the top of the gold line.

[0136] When it is understood that Fig.13 In the structural block diagram of the gold wire top height measurement device shown, each module is used to perform Figure 5 , Figures 7 to 12 The steps in the corresponding embodiments, and for Figure 5 , Figures 7 to 12 Each step in the corresponding embodiment has been explained in detail in the above embodiment. Figure 5 , Figures 7 to 12 as well as Figure 5 , Figures 7 to 12 The relevant descriptions in the corresponding embodiments are not repeated here.

[0137] Fig.14 1 is a block diagram of a terminal device provided by an embodiment of the present application. Fig.14 As shown, the terminal device 1400 of this embodiment includes: a processor 1410, a memory 1420, and a computer program 1430 stored in the memory 1420 and executable on the processor 1410, such as a program for a method for measuring the height of a gold wire top. When the processor 1410 executes the computer program 1430, the steps in each embodiment of the method for measuring the height of a gold wire top are implemented, such as Figure 5 Alternatively, the processor 1410 implements the above when executing the computer program 1430 Fig.13 The functions of each module in the corresponding embodiment are, for example, Fig.13 For details on the functions of modules 1310 to 1340, please refer to Fig.13 Related description in the corresponding embodiment.

[0138] Exemplarily, the computer program 1430 may be divided into one or more modules, one or more modules are stored in the memory 1420, and are executed by the processor 1410 to implement the method for measuring the height of the top of the gold wire provided in the embodiment of the present application. One or more modules may be a series of computer program instruction segments capable of completing specific functions, and the instruction segments are used to describe the execution process of the computer program 1430 in the terminal device 1400. For example, the computer program 1430 may implement the method for measuring the height of the top of the gold wire provided in the embodiment of the present application.

[0139] The terminal device 1400 may include, but is not limited to, a processor 1410 and a memory 1420. Those skilled in the art will appreciate that Fig.14 It is only an example of the terminal device 1400 and does not constitute a limitation of the terminal device 1400. It may include more or fewer components than shown in the figure, or a combination of certain components, or different components. For example, the terminal device may also include input and output devices, network access devices, buses, etc.

[0140] The processor 1410 may be a central processing unit, or other general-purpose processors, digital signal processors, application-specific integrated circuits, off-the-shelf programmable gate arrays or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc.

[0141] The memory 1420 may be an internal storage unit of the terminal device 1400, such as a hard disk or memory of the terminal device 1400. The memory 1420 may also be an external storage device of the terminal device 1400, such as a plug-in hard disk, a smart memory card, a flash memory card, etc. equipped on the terminal device 1400. Further, the memory 1420 may also include both an internal storage unit of the terminal device 1400 and an external storage device.

[0142] An embodiment of the present application provides a terminal device, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, a method for measuring the height of the top of a gold wire as described in the above-mentioned embodiments is implemented.

[0143] An embodiment of the present application provides a computer-readable storage medium, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, a method for measuring the height of the top of a gold wire as in the above-mentioned embodiments is implemented.

[0144] An embodiment of the present application provides a computer program product. When the computer program product is run on a terminal device, the terminal device executes the method for measuring the height of the top of the gold wire in each of the above embodiments.

[0145] The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. A method for measuring the height of the top of a gold wire, It is characterized in that Applied to a terminal device, the method comprises: Controlling the light emitting device to illuminate a first area on the top of the gold wire; Acquire an image to be processed obtained by performing image acquisition on the top of the gold wire at the current measurement height; the image to be processed includes a first image area corresponding to the first area illuminated by the light-emitting device, and a second image area corresponding to a second area of ​​the top of the gold wire not illuminated by the light-emitting device; Calculating the clarity of the image to be processed according to the pixel values ​​in the first image area and the second image area; If the clarity is greater than a threshold, fitting the current measured height based on the clarity to calculate the height of the top of the gold wire; The calculating the clarity of the image to be processed according to the pixel values ​​in the first image area and the second image area includes: Determine a first pixel point and a second pixel point located at the boundary between the first image area and the second image area respectively; calculate an average pixel value of the first pixel point and the second pixel point according to the pixel value of the first pixel point and the pixel value of the second pixel point; calculate the clarity of the boundary in the image to be processed based on the average pixel value; the clarity of the boundary is used to characterize the clarity of the image to be processed; The step of fitting the current measured height based on the clarity to calculate the height of the top of the gold wire includes: Performing Gaussian fitting on the clarity and the current measured height to generate a Gaussian function; and calculating a mean value of the Gaussian function as the height of the top of the gold wire.

2. The method according to claim 1, It is characterized in that The light emitting device has a plurality of; The step of acquiring the image to be processed obtained by collecting the image of the top of the gold wire at the current measurement height includes: Divide a plurality of light emitting devices into a plurality of first light emitting device groups and a plurality of second light emitting device groups; the plurality of first light emitting device groups are respectively arranged in an interactive manner with the plurality of second light source device groups; The first light emitting device group or the second light emitting device group is controlled to emit light toward the top of the gold wire to generate a plurality of the first image areas and a plurality of the second image areas.

3. The method according to claim 1, It is characterized in that The step of acquiring the image to be processed obtained by collecting the image of the top of the gold wire at the current measurement height includes: respectively collecting the images to be processed at multiple measuring heights; For any of the images to be processed, if the image to be processed does not include the top of the gold wire, deleting the image to be processed; If the image to be processed includes the top of the gold wire, the measured height of the image to be processed is determined as the current measured height, and the image to be processed is determined as the image to be processed obtained by capturing the image of the top of the gold wire at the current measured height; the current measured height includes at least one.

4. The method according to claim 1, It is characterized in that After acquiring the image to be processed obtained by collecting the image of the top of the gold wire at the current measurement height, the method further includes: For any pixel point in any of the to-be-processed images, if the pixel value of the pixel point is greater than the first pixel value, the pixel value of the pixel point is changed to a second pixel value; and, If the pixel value of the pixel point is less than or equal to the first pixel value, the pixel value of the pixel point is changed to a third pixel value.

5. The method according to any one of claims 1 to 4, It is characterized in that Before calculating the clarity of the image to be processed according to the pixel values ​​in the first image area and the second image area, the method further includes: Determine the image position of the top of the gold wire in the image to be processed; An image window is selected in the image to be processed with the image position as the center to generate a local image to be processed including the top of the gold wire; Calculating the similarity between the local image to be processed and a preset characteristic image; the preset characteristic image is a standard image taken of the top of the gold wire at a known height; If the similarity is greater than a preset similarity, executing the step of calculating the clarity of the image to be processed; Otherwise, the image to be processed is deleted.

6. A device for measuring the height of the top of a gold wire, It is characterized in that Applied to a terminal device, the device comprises: A control module, used for controlling the light emitting device to illuminate a first area on the top of the gold wire; an acquisition module, used to acquire an image to be processed obtained by performing image acquisition on the top of the gold wire at a current measurement height; the image to be processed includes a first image area corresponding to the first area illuminated by the light-emitting device, and a second image area corresponding to a second area of ​​the top of the gold wire not illuminated by the light-emitting device; A clarity calculation module, used for calculating the clarity of the image to be processed according to the pixel values ​​in the first image area and the second image area; A fitting module, configured to fit the current measured height based on the clarity to calculate the height of the top of the gold wire if the clarity is greater than a threshold; The clarity calculation module is also used for: Determine a first pixel point and a second pixel point located at the boundary between the first image area and the second image area respectively; calculate an average pixel value of the first pixel point and the second pixel point according to the pixel value of the first pixel point and the pixel value of the second pixel point; calculate the clarity of the boundary in the image to be processed based on the average pixel value; the clarity of the boundary is used to characterize the clarity of the image to be processed; The fitting module is also used for: Performing Gaussian fitting on the clarity and the current measured height to generate a Gaussian function; and calculating a mean value of the Gaussian function as the height of the top of the gold wire.

7. A terminal device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, It is characterized in that When the processor executes the computer program, the method according to any one of claims 1 to 5 is implemented.

8. A computer-readable storage medium storing a computer program. It is characterized in that When the computer program is executed by a processor, the method according to any one of claims 1 to 5 is implemented.

Images