Method for detecting wear on ultrasonic tools
The method employs a 2D camera for image-based wear detection in ultrasonic tools, allowing for timely and cost-effective monitoring and replacement, addressing the complexity and cost issues of existing methods by using image processing to assess tool wear accurately.
Patent Information
- Application Number
- PCT/DE2024/100429
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-17
- Filing Date
- 2024-05-13
- Publication Date
- 2024-11-21
AI Technical Summary
Existing methods for detecting wear in ultrasonic tools are complex and costly, making them difficult to integrate into production operations, often requiring special tools and expensive devices.
A method using a high-resolution 2D camera to record and compare images of the ultrasonic tool's profiled working side with stored reference images, determining actual wear through image processing, allowing for timely replacement and reducing unnecessary tool changes.
This approach enables cost-effective and efficient wear monitoring during manufacturing, reducing material costs and increasing productivity by accurately identifying when to replace ultrasonic tools, thus avoiding premature replacements.
Smart Images

Figure DE2024100429_21112024_PF_FP_ABST
Abstract
Description
[0001] Method for detecting wear in ultrasonic tools
[0002] The invention relates to a method for the optical detection of wear in ultrasonic tools. Furthermore, the invention relates to the use of the method in the ultrasonic-assisted joining of metallic components, for example, in ultrasonic wire bonding or ultrasonic welding.
[0003] Ultrasonic tools, such as those used in ultrasonic wire bonding and ultrasonic welding, are subject to considerable wear due to the stress they are subjected to. In practice, ultrasonic tools are typically replaced after a fixed number of welds. A safety margin is regularly taken into account to ensure that the ultrasonic tool is always in sufficiently good condition and that the connections are produced with high quality. For example, it is common practice to replace an ultrasonic tool nominally designed for 25,000 ultrasonic connections after approximately 20,000 connections as a precautionary measure.It is also known to measure the wear of an ultrasonic tool or to assess it according to user-specific criteria such as the visual appearance determined by visual inspection or the strength of the connections and to replace it if necessary.
[0004] For example, EP 3 871 822 A1 describes a method for monitoring the wear condition of an ultrasonic machining system. To determine the wear condition, the ultrasonic tool is pressed with a working surface against a test specimen and subjected to a force. The ultrasonic tool is then excited to ultrasonic vibrations. During the vibration excitation phase, measurement parameters of electrical and / or mechanical quantities are recorded and compared with previously stored reference parameters. The wear condition of the ultrasonic tool is determined by comparing the measurement parameters with the reference parameters.
[0005] WO 2017 / 079085 A1 discloses determining the wear of an ultrasonic tool by evaluating the impression created by the ultrasonic tool with its profiled working surface on the joining partner when establishing the connection. The way in which the impression of the ultrasonic tool on the joining partner changes provides information about the wear of the tool.
[0006] Eichwald describes a process in which the working face of the ultrasonic tool is measured using a laser-assisted 3D scanning process (Paul Eichwald: Process-appropriate design of tools based on wear simulations using ultrasonic bonding as an example. Shaker Verlag, 2021). The measured values are used to calculate wear-related volume removal on the working face of the ultrasonic tool and to determine the wear state.
[0007] WO 2019 / 161902 A1 discloses a method for monitoring wear on ultrasonic tools. Wear marks incorporated into the ultrasonic tool for wear monitoring are optically detected. The change in the wear mark can then be used to determine the wear of the ultrasonic tool. Previously known methods for determining wear on ultrasonic tools are all comparatively complex. They are difficult to integrate economically into production operations and / or require the use of special ultrasonic tools and / or expensive measuring devices.
[0008] The object of the present invention is to provide an improved and cost-effective method for detecting wear in ultrasonic tools with a profiled working side.
[0009] To achieve this object, the invention has the features of patent claim 1. Accordingly, the method for detecting wear in ultrasonic tools comprises the following method steps: A movable and / or rotatable ultrasonic tool of an ultrasonic joining machine is positioned relative to at least one camera of the ultrasonic joining machine such that a profiled working side of the ultrasonic tool and / or a profile of the working side is provided within a detection range of the at least one camera. Then, at least one high-resolution 2D image of the profiled working side of the ultrasonic tool and / or the profile of the working side in a worn state is recorded with the at least one camera.The at least one high-resolution 2D image of the profiled working side of the ultrasonic tool and / or the profile of the working side in the wear state is then compared with at least one stored reference image of the profiled working side of the ultrasonic tool and / or the profile of the working side, and an actual wear value for the ultrasonic tool is determined by image processing. The actual wear state of the ultrasonic tool determined in this way is then compared with a tool-specific wear limit. If the actual wear value reaches, passes, or exceeds the wear limit, measures are initiated to replace or maintain the ultrasonic tool. According to the invention, the wear value can be defined such that it increases or decreases with increasing wear.
[0010] The particular advantage of the invention is that the wear of the ultrasonic tool can be recorded and monitored during the ongoing production process using a 2D camera and a suitable image processing routine. The ultrasonic tool can therefore be replaced or serviced as needed. A worn or defective ultrasonic tool can be identified and replaced in this way. At the same time, a preventative, premature replacement of the ultrasonic tool is avoided. As shown below, this results in a significant cost advantage and productivity gain.
[0011] Assuming that an average of 25,000 ultrasonic connections can be made with one ultrasonic tool, and that the ultrasonic tool is replaced as a precaution after 20,000 connections without suitable monitoring measures, the advantage per 1,000,000 connections is that 40 instead of 50 ultrasonic tools are worn out. This corresponds to a material cost reduction of 20%. Furthermore, an additional time advantage results if one assumes that the wear status of the ultrasonic tool is optically monitored using the method according to the invention after every 1,000 connections are made. The acquisition of at least one high-resolution 2D image of the profiled working side of the ultrasonic tool will typically take 5 seconds. Changing the ultrasonic tool, including maintenance time and subsequent calibration, typically takes 10 minutes.In this case, eliminating 10 tool changes results in a gain of 100 minutes. This is offset by an additional 83 minutes for the monitoring routine, resulting in a time saving of just under 17 minutes, or 17%.
[0012] The reference image of the profiled working side of the ultrasonic tool and / or the profile of the working side used for the comparison can show the working side in any defined and known condition. In particular, the reference image is based on the new condition of the ultrasonic tool or a limiting wear condition. Advantageously, comparing the actual wear condition with the new condition of the ultrasonic tool allows for reliable and reproducible statements regarding the wear of the ultrasonic tool.
[0013] According to the invention, the measures initiated when the wear limit is reached or exceeded can include, for example, replacing or servicing the ultrasonic tool itself. For example, it can be provided that the operating personnel or a control center are informed of the need to take action. According to a preferred embodiment of the invention, the actual wear value and optionally the at least one high-resolution 2D image of the profiled working side of the ultrasonic tool and / or the profile of the working side in the wear state are stored together with further information on the actual wear state and in particular the number of joining operations that have already been carried out with the ultrasonic tool at the time the at least one high-resolution 2D image was recorded.Based on the stored values for one or more wear states of the ultrasonic tool, a forecast value for the remaining service life of the ultrasonic tool can then be determined, for example. By calculating the forecast value, the monitoring interval for visually determining wear can be extended, if necessary, in the early stages of the tool's service life. This reduces the time required for wear monitoring and further improves productivity.
[0014] According to a further development of the invention, the at least one high-resolution 2D image of the profiled working side of the ultrasonic tool and / or the profile of the working side in the wear state is compared with the reference image of the ultrasonic tool, and the actual wear value is determined using cross-correlation, edge detection, and / or neural networks. These methods advantageously allow a quick and reliable comparison of the ultrasonic tool in the actual wear state with the reference or original state of the ultrasonic tool.
[0015] When using and training a neural network, the classification of the progressive wear of various ultrasonic tools by experts can be used. Such a neural network can then be made available in a central database for various ultrasonic joining machines. In all three approaches, the depth composition can be determined. Height information can also be evaluated. Such methods are known, for example, from digital microscopes.
[0016] According to a further development of the invention, a plurality of high-resolution 2D images of the profiled working side of the ultrasonic tool and / or the profile of the working side in a similar state of wear are compared with a plurality of reference images of the working side of the ultrasonic tool in its reference state. The plurality of high-resolution 2D images of the working side in the state of wear show it from different directions or perspectives. This advantageously improves wear detection. For example, the plurality of high-resolution 2D images can be compared with several reference images each taken from the same direction and / or perspective.
[0017] For example, the multiple high-resolution 2D images of the working side of the ultrasonic tool can be recorded by one or more stationary cameras. For this purpose, the ultrasonic tool is moved into the detection range of the at least one camera and aligned so that the at least one camera can capture the working side of the ultrasonic tool. The kinematics of the ultrasonic joining machine can be used, in particular, to move the ultrasonic tool and to position and align it within the detection range of the one or more stationary cameras. For example, such an ultrasonic joining machine has 3-axis kinematics for positioning the ultrasonic tool in space and a rotational degree of freedom for rotating the ultrasonic tool around its longitudinal axis.Alternatively or additionally, it can be provided that the camera is installed in a movable or movable manner and, with knowledge of the position of the ultrasonic tool for generating the at least one high-resolution 2D image, is aligned such that the ultrasonic tool is provided in the detection range of the camera.
[0018] According to a further development of the invention, a single camera can be used to generate the multiple high-resolution 2D images of the ultrasonic tool. For this purpose, the ultrasonic tool can be moved within the detection range of one camera and repeatedly realigned there, so that the high-resolution 2D images of the profiled working side of the ultrasonic tool are sequentially acquired from different perspectives or directions using one camera. Advantageously, the method for wear detection can be implemented very cost-effectively in terms of hardware by using a single camera. Images taken with different exposures, which are recorded under the same lighting and camera position, can also be used for image-based determination and evaluation of wear – individually or after combining them to create a high dynamic range (HDR) image.The different exposure can be achieved by using different exposure times or different camera sensitivity.
[0019] According to a further development of the invention, two or more cameras can be provided to capture the plurality of high-resolution 2D images of the profiled working side of the ultrasonic tool and / or the profile of the working side from different directions or perspectives in the state of wear. The multiple high-resolution 2D images can then be captured simultaneously by the different cameras. Depending on the position of the camera relative to the ultrasonic tool, the high-resolution 2D images thus captured show the profiled working side of the ultrasonic tool in the state of wear from different directions or perspectives.
[0020] According to a further development of the invention, the working side of the ultrasonic tool and / or the profile of the working side can be illuminated by means of a lighting unit at the time of generating the at least one high-resolution 2D image. Illuminating the working side of the ultrasonic tool advantageously improves the accuracy and reliability of the method according to the invention.
[0021] According to a further development of the invention, the lighting unit can be used to create a defined lighting situation on the profiled working side of the ultrasonic tool and / or the profile of the working side. For example, a striped light pattern or another lighting pattern advantageous for wear detection can be generated.
[0022] When providing a lighting situation, it is particularly important to ensure consistent and reproducible lighting. The orientation of the lighting units, their assignment to the at least one camera, the intensity and polarity of the light, as well as its spectrum and / or wavelength, are particularly important in this regard. In particular, the intensity of the light should be selected such that the working side of the ultrasonic tool is well illuminated and the ambient light has only a negligible influence during the acquisition of the at least one high-resolution 2D image. Measures to reduce the incident ambient light can also contribute to this, for example, the automated switching off or dimming of light sources during the acquisition of the at least one high-resolution 2D image or the shielding of the working side of the ultrasonic tool against ambient light.In this way, it is possible to obtain high-resolution 2D images of the working side of the ultrasonic tool that are virtually independent of the ambient light conditions.
[0023] Optionally, in addition to the at least one camera and / or the at least one lighting unit, optical elements such as lenses and / or mirrors can be used to generate the high-resolution 2D images of the working side of the ultrasonic tool or to optimally illuminate it.
[0024] According to a further development of the invention, at least one high-resolution 2D image of the profiled working side of the ultrasonic tool and / or the profile of the working side is generated at a time delay in a first and at least one further wear state of the ultrasonic tool. For example, the wear state of the ultrasonic tool can be recorded at regular or irregular time intervals. For example, the wear state of the ultrasonic tool can be recorded after a predetermined number of joining operations. For example, the wear state of the ultrasonic tool can be recorded in an event-driven manner.In event-driven recording, for example, it can be provided that a wear condition of the ultrasonic tool is determined if a deviation, a faulty connection or a critical process condition is detected by parallel process monitoring of a joining process, which may be due to a worn ultrasonic tool or whose cause is initially unknown.
[0025] The method according to the invention is used for ultrasonically assisted joining of metal components. In particular, ultrasonic spot welding machines and / or ultrasonic wire bonders serve as ultrasonic joining machines.
[0026] Further advantages, features, and details of the invention can be gathered from the further subclaims and the following description. The features mentioned therein may be essential to the invention individually or in any combination. The drawings serve merely as examples to clarify the invention and are not limiting in nature.
[0027] They show:
[0028] Fig. 1 a comparison of a perspective representation of an ultrasonic tool with a profiled working side a) in an unworn initial state and b) in a first wear state,
[0029] Fig. 2 is a side view (profile) of the ultrasonic tool according to Fig. 1 in the first wear state,
[0030] Fig. 3 a comparison of a first and a second side view of the ultrasonic tool with the profiled working side in the initial state and a second wear state,
[0031] Fig. 4 is a schematic diagram of a first measuring arrangement for detecting wear in ultrasonic tools,
[0032] Fig. 5 is a schematic diagram of a second measuring arrangement for detecting wear in ultrasonic tools,
[0033] Fig. 6 is a schematic diagram of a third measuring arrangement for detecting wear in ultrasonic tools in a first measuring configuration,
[0034] Fig. 7 is a schematic diagram of the third measuring arrangement for detecting wear in ultrasonic tools in a second measuring configuration and Fig. 8 is a schematic diagram of the third measuring arrangement for detecting the
[0035] Wear on ultrasonic tools in a third measuring configuration.
[0036] Using the method for optical wear detection according to the invention, the wear status of an ultrasonic tool 1 can be closely monitored during the manufacturing process. Different wear statuses of the ultrasonic tool are illustrated below using Figs. 1 to 3 as examples. Figs. 4 to 8 then show three measurement setups for wear detection in ultrasonic tools.
[0037] Fig. 1 shows the ultrasonic tool 1 with its profiled working side 2 in an unworn initial state (Fig. 1a) and in a first comparison state (Fig. 1b). In the unworn initial state, the profiled working side 2 provides a plurality of profile pyramids 4 arranged regularly offset from one another. In the first wear state according to Fig. 1b, a breakout 3 is formed laterally on the working side 2, which requires replacement of the ultrasonic tool 1. Fig. 2 shows a side view of the ultrasonic tool 1 in the first wear state in the profile, correlating to the breakout situation according to Fig. 1b.
[0038] A breakout, as shown in Figs. 1b and 2, can be detected by optical wear detection as part of a regular optical inspection of the profiled working side 2 of the ultrasonic tool 1, as well as during an event-driven special inspection. The breakout situation can be anticipated, for example, in the manufacturing process based on an unusually high momentary power consumption. The high power consumption can then be used as a trigger to initiate a wear check outside of a possibly time-controlled or predefined period based on the number of joining operations.
[0039] Wear condition monitoring to record the wear condition of the ultrasonic tool 1 in a situation- and event-driven manner.
[0040] Figs. 3a to 3d show the ultrasonic tool 1 unworn (Figs. 3a and 3c) and worn (Figs. 3b and 3d) in a first side view (Figs. 3a and 3b) and in a second side view (Figs. 3c and 3d). The wear situation of the ultrasonic tool 1 on its profiled working side 2 is particularly evident in the edge wear of the profile pyramids 4. A comparison of the high-resolution 2D images of the ultrasonic tool 1 with the profiled working side 2 in the wear state according to Figs. 3b and 3d with the reference images (Figs. 3a and 3c) can therefore be used to determine the actual wear value for the ultrasonic tool 1 by means of image processing and to compare this actual wear value with a tool-specific limit wear value.If the actual wear value reaches or exceeds the limit wear value, a change of the ultrasonic tool 1 is initiated or the ultrasonic tool 1 is sent for maintenance or reconditioning.
[0041] Fig. 4 shows a first measuring arrangement for detecting wear on the ultrasonic tool 1. In the first measuring arrangement, the ultrasonic tool 1, which is designed as a reversible tool, is arranged with its working side 2 within the detection range of a first camera 7.1 and a second camera 7.2. The cameras 7.1, 7.2 take high-resolution 2D images of two side views of the same ultrasonic tool 1 with the profiled working side 2. The side views are rotated by 90° due to the orientation of the cameras 7.1, 7.2. For example, the side views according to Figs. 3a to 3d could have been recorded with this first measuring arrangement.
[0042] The ultrasonic tool 1 is excited to ultrasonic vibrations by a transducer 5. In the example shown, in addition to the wear-monitored working side 2, it provides an additional working side 6, which is disengaged and not used in the configuration shown. Therefore, wear monitoring of the additional working side 6 is not performed.
[0043] A second measuring arrangement according to Fig. 5 now provides a total of three cameras 8.1, 8.2, 8.3, each rotated by 90° and viewing the profiled working side 2 of the ultrasonic tool 1 from different directions. Additionally, a total of five lighting units 9.1, 9.2, 9.3, 9.4, 9.5 are provided, which serve to illuminate the profiled working side 2 of the ultrasonic tool 1 while capturing the high-resolution 2D images of the working side 2 of the ultrasonic tool 1 using the three cameras 8.1, 8.2, 8.3. For example, the profiled working side 2 can be evenly illuminated using the lighting units 9.1, 9.2, 9.3, 9.4, 9.5. Alternatively, a pattern illumination advantageous for detecting the wear situation, for example a stripe pattern, can be provided by means of all or individual lighting units 9.1, 9.2, 9.3, 9.4, 9.5.
[0044] While a plurality of high-resolution 2D images of the profiled working side 2 of the ultrasonic tool 1 can be produced simultaneously by means of the first measuring arrangement according to Fig. 4 and the second measuring arrangement according to Fig. 5, a single camera 10 is provided in the third measuring arrangement according to Figs. 6 to 8, which serves to sequentially record several high-resolution 2D images of the working side 2 of the ultrasonic tool 1 in a identical state of wear. For this purpose, the ultrasonic tool 1 is positioned in the detection range of the single camera 10 by means of travel kinematics provided by the ultrasonic joining machine. The position of the ultrasonic tool 1 is different in each case, so that in the present embodiment of the invention, three high-resolution 2D images of the profiled working side 2 of the ultrasonic tool 1 in the same state of wear are sequentially recorded by the single camera 10.To achieve optimal illumination of the profiled working side 2, the camera 10 provides, for example, a ring-shaped illumination unit 11. Camera 10 and illumination unit 11 are, in particular, installed in a fixed location.
[0045] Identical components and component functions are identified by the same reference symbols.
Claims
Patent claims 1. Method for detecting wear in ultrasonic tools, comprising the following method steps: a movable and / or rotatable ultrasonic tool (1) of an ultrasonic joining machine is positioned relative to at least one camera (7.1, 7.2, 8.1, 8.2, 8.3, 10) of the ultrasonic joining machine such that a profiled working side (2) of the ultrasonic tool (1) and / or a profile of the working side (2) is provided in a detection range of the at least one camera (7.1, 7.2, 8.1, 8.2, 8.3, 10); then, the at least one camera (7.1, 7.2, 8.1, 8.2, 8.3, 10) at least one high-resolution 2D image of the profiled working side (2) of the ultrasonic tool (1) and / or of the profile of the working side (2) in a state of wear is generated; then, the at least one high-resolution 2D image of the profiled working side (2) of the ultrasonic tool (1) and / or of the profile of the working side (2) in the state of wear is compared with at least one reference image of the profiled working side (2) of the ultrasonic tool (1), and an actual wear value for the ultrasonic tool (1) is determined by means of image processing; then, the actual wear value of the ultrasonic tool (1) is compared with a tool-specific wear limit value; if the actual wear value reaches or exceeds the wear limit value, measures for replacing or servicing the ultrasonic tool (1) are initiated.
2. Method according to claim 1, characterized in that the at least one reference image shows the ultrasonic tool (1) with the profiled working side (2) and / or the profile of the working side (2) in a new state and / or in a limit wear state.
3. Method according to claim 1 or 2, characterized in that the actual wear value and optionally the at least one high-resolution 2D image of the profiled working side (2) of the ultrasonic tool (1) and / or the profile of the working side (2) in the wear state are stored together with further information on the actual wear state, in particular a number of joining operations that have been carried out with the ultrasonic tool (1) so far.
4. Method according to one of claims 1 to 3, characterized in that several high-resolution 2D images of the profiled working side (2) of the ultrasonic tool (1) and / or of the profile of the working side (2) are generated in a same state of wear and that the several high-resolution 2D images of the profiled working side (2) of the ultrasonic tool (1) and / or of the profile of the working side (2) are recorded in the same state of wear from different directions and / or perspectives.
5. Method according to one of claims 1 to 4, characterized in that the at least one camera (7.1, 7.2, 8.1, 8.2, 8.3, 10) is installed in a stationary manner and the ultrasonic tool (1) is brought into the detection range of the at least one camera (7.1, 7.2, 8.1, 8.2, 8.3, 10) in order to produce the at least one high-resolution 2D image.
6. Method according to one of claims 1 to 5, characterized in that the comparison of the at least one high-resolution 2D image of the profiled working side (2) of the ultrasonic tool (1) and / or the profile of the working side (2) in the state of wear with the at least one reference image during image processing and the determination of the actual wear value by means of cross-correlation and / or edge detection and / or neural networks.
7. Method according to one of claims 1 to 6, characterized in that the profiled working side (2) of the ultrasonic tool (1) and / or the profile of the working side (2) is illuminated by means of an illumination unit (9.1, 9.2, 9.3, 9.4) at the time of generating the at least one high-resolution 2D image, wherein the illumination is preferably designed such that a light intensity emanating from the illumination unit (9.1, 9.2, 9.3, 9.4) at the non-shaded points of the ultrasonic tool (1) located in a camera image exceeds a light intensity of the incident ambient light by at least a factor of 10, preferably by a factor of 100.
8. Method according to one of claims 1 to 7, characterized in that the wear state of the working side (2) of the ultrasonic tool (1) and / or the profile of the working side (2) is detected by means of a single camera (10), wherein the single camera (10) sequentially generates a plurality of 2D images which show the ultrasonic tool (1) with the profiled working side (2) in at least two different orientations.
9. Method according to one of claims 1 to 8, characterized in that at least one high-resolution 2D image of the profiled working side (2) of the ultrasonic tool (1) and / or of the profile of the working side (2) in a first and at least one further wear state of the ultrasonic tool (1) is generated with a time delay.
10. Method according to one of claims 1 to 9, characterized in that a prognostic value for a remaining service life of the ultrasonic tool (1) is determined on the basis of the actual wear value and / or stored wear values for the ultrasonic tool (1) and / or the number of joining operations previously carried out for the ultrasonic tool (1) associated with the actual wear value and / or the stored wear values.
11. Method according to one of claims 1 to 10, characterized in that the wear state of the ultrasonic tool (1) is recorded at regular and / or irregular time intervals.
12. Method according to one of claims 1 to 11, characterized in that the wear state of the ultrasonic tool (1) is detected after a predetermined number of joining operations.
13. Method according to one of claims 1 to 12, characterized in that the wear state of the ultrasonic tool (1) is detected in an event-controlled manner.
14. Use of a method according to one of claims 1 to 13 in the ultrasonically assisted joining of metallic joining partners, in particular by means of an ultrasonic spot welding machine and / or an ultrasonic wire bonder as an ultrasonic joining machine.
Citation Information
Patent Citations
Vibration processing system, method for monitoring the state of a vibration processing system and method for determining a reference value
EP3871822A1
Ribbon bonding tools, and methods of designing ribbon bonding tools
WO2017079085A1
Apparatus and method of determining ultrasonic joining tool
JP2010207837A
Ultrasonic bonding monitoring apparatus and method
JP5470789B2
Device for processing workpieces by means of vibrations
WO2019161902A1
