Soldering device and program
The soldering device and program enable real-time defect detection in solder joints by capturing images with and without illumination, creating a brightness difference image to assess defects, thus reducing the time needed for determination and improving accuracy by avoiding the need for solidification.
Patent Information
- Application Number
- PCT/JP2024/019044
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-26
- Filing Date
- 2024-05-23
- Publication Date
- 2024-12-05
AI Technical Summary
Current soldering devices require waiting for solder joints to solidify before imaging, leading to increased time for defect determination due to high light reflectance making it difficult to accurately recognize the shape of the solder joint through image processing.
A soldering device and program that captures images of the solder joint with and without illumination, creating a brightness difference image to detect excessive or insufficient defects without waiting for solidification, using a soldering iron, imaging device, and illumination device to acquire images from specific angles and process them to determine defects.
This approach allows for immediate defect determination without waiting for the solder joint to solidify, reducing the time required for the process and improving accuracy by preventing reflections and enhancing image clarity.
Smart Images

Figure JP2024019044_05122024_PF_FP_ABST
Abstract
Description
Soldering device and program
[0001] The present invention relates to a soldering apparatus and a program.
[0002] A soldering device according to the background art is disclosed in Patent Document 1. The soldering device acquires image data by capturing an image of a target area where soldering is being performed, and then performs image processing to compare the image data with image data representing a criterion, thereby determining whether or not there is a defect in the soldering process.
[0003] Before solidification, solder has a glossy finish and a high reflectivity. Therefore, when an image of a solder joint before solidification is taken, the printed circuit board or surrounding mounted components are likely to be reflected on the surface of the solder joint, making it difficult to accurately recognize the shape of the solder joint through image processing. Therefore, with the soldering device according to the background art, it is necessary to wait until the solder joint solidifies and loses its gloss before taking an image, which lengthens the time required for the defect determination process.
[0004] Patent No. 6550082
[0005] An object of the present invention is to provide a soldering device and a program that can reduce the time required for the process of determining whether a solder joint is defective.
[0006] A soldering apparatus according to one aspect of the present invention comprises a solder joint forming device having a soldering iron and forming a solder joint in a target area for soldering; an imaging device that images the solder joint formed in the target area from a predetermined direction; an illumination device that illuminates the solder joint formed in the target area from the predetermined direction; and a control device, wherein the control device acquires a first image of the solder joint by having the imaging device perform the imaging while the illumination device is performing the illumination; acquires a second image of the solder joint by having the imaging device perform the imaging while the illumination device is stopped; creates a brightness difference image showing the difference in brightness between the first image and the second image; and determines at least one of an over-defect and an under-defect of the solder joint based on the brightness difference image.
[0007] Another aspect of the present invention provides a program for causing an information processing device mounted on a control device to execute processing in a soldering apparatus including a solder joint forming device having a soldering iron and forming a solder joint in a target area for soldering, an imaging device that images the solder joint formed in the target area from a predetermined direction, an illumination device that illuminates the solder joint formed in the target area from the predetermined direction, and a control device, wherein the processing includes: acquiring a first image of the solder joint by having the imaging device perform the imaging while the illumination device is performing the illumination; acquiring a second image of the solder joint by having the imaging device perform the imaging while the illumination device is stopped; creating a brightness difference image showing the difference in brightness between the first image and the second image; and determining at least one of an over-defect and an under-defect of the solder joint based on the brightness difference image.
[0008] 1 is a perspective view showing a simplified configuration of a soldering apparatus; FIG. 2 is a side view showing a simplified configuration of a soldering apparatus; FIG. 3 is a side view showing a schematic positional relationship between a solder joint forming apparatus, an imaging device, and an illumination device; FIG. 4 is a simplified view of a configuration of a control device; FIG. 5 is a simplified view of a functional configuration of a processing unit; FIG. 6 is a flowchart showing processing executed by a processing unit; FIG. 7 is a side view showing a schematic side view of processing executed by a processing unit; FIG. 8 is a side view showing a schematic side view of processing executed by a processing unit; FIG. 9 is a side view showing a schematic side view of processing executed by a processing unit; FIG. 10 is a diagram showing a first example of a first image of a solder joint; FIG. 11 is a diagram showing a second example of a first image of a solder joint; FIG. 12 is a diagram showing a first example of a brightness difference image; FIG. 13 is a diagram showing a second example of a brightness difference image; FIG. 14 is a diagram showing an image of a solder joint; FIG. 15 is a diagram showing an image of a solder joint; FIG. 16 is a diagram showing an image of a solder joint; FIG. 17 is a diagram showing an example of a first image of a solder joint in which poor wetting has occurred. FIG. 10 is a diagram showing an example of a color component image corresponding to the color components of a land.
[0009] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. Note that elements with the same reference numerals in different drawings indicate the same or corresponding elements.
[0010] 1 and 2 are respectively a perspective view and a side view showing a simplified configuration of a soldering apparatus 100 according to an embodiment of the present invention. The soldering apparatus 100 includes a solder joint forming device 1, an imaging device 2, an illumination device 3, and a control device 4. The solder joint forming device 1 has a solder iron 11 and a solder supply device 12. The soldering apparatus 100 is capable of transporting the solder joint forming device 1 to a desired position using a transport mechanism. The soldering apparatus 100 is also capable of transporting the imaging device 2 and the illumination device 3 to desired positions using the transport mechanism. The transport mechanism is capable of performing a retraction operation to retract the solder joint forming device 1 from the target area 20 while maintaining the positional relationship between the imaging device 2 and the illumination device 3 and the solder joint forming device 1. Note that the transport mechanism may be capable of transporting the imaging device 2 and the illumination device 3 and the solder joint forming device 1 independently. In this case, the transport mechanism may be capable of performing an evacuation operation to evacuate the solder joint forming device 1 from the target area 20 while maintaining the positional relationship between the imaging device 2 and the lighting device 3 and the target area 20.
[0011] 3 is a side view schematically showing the positional relationship between the solder joint forming apparatus 1, the imaging device 2, and the lighting device 3. The target area 20 is an area where the soldering process is to be performed by the solder joint forming apparatus 1. The target area 20 includes the lands 22 and leads 23 on the printed circuit board 21. As shown in FIG. 3 , an axis Z0 is defined that extends along the extension direction of the leads 23 (or the normal direction to the top surface of the printed circuit board 21), an axis Z1 is defined that extends along the optical axis direction of the imaging device 2, and an axis Z2 is defined that extends along the longitudinal direction of the soldering iron 11.
[0012] The solder joint forming device 1 is disposed on the opposite side of the target area 20 from the imaging device 2 and the lighting device 3. The angle formed by the axis Z0 and the axis Z1 is, for example, 60 degrees. However, this is not limited to this example and may be other than 60 degrees. The angle formed by the axis Z0 and the axis Z2 is, for example, 45 degrees. However, this is not limited to this example and may be other than 45 degrees.
[0013] The lighting device 3 is a ring light arranged coaxially with the imaging device 2, and the imaging direction of the imaging device 2 and the lighting direction of the lighting device 3 are the same as the extension direction of the axis Z1. However, the lighting device 3 may be something other than a ring light, and the imaging direction of the imaging device 2 and the lighting direction of the lighting device 3 may be offset within a predetermined range.
[0014] 1 to 3, the soldering iron 11 heats the solder 31 supplied from the solder supply device 12 to form a solder joint 32 (see, for example, FIG. 7A ) in the target area 20 to be soldered. The control device 4 controls the operation of the solder joint forming device 1. The imaging device 2 is configured with an image sensor such as a CMOS or CCD and an optical system, and captures an image of the solder joint 32 formed in the target area 20 from a predetermined direction (axis Z1 direction). The control device 4 controls the imaging operation of the imaging device 2. The lighting device 3 is configured with a ring light or the like, and illuminates the solder joint 32 formed in the target area 20 from the predetermined direction (axis Z1 direction). The control device 4 controls the operation of the lighting device 3 (turning on or off illumination).
[0015] FIG. 4 is a simplified diagram showing the configuration of the control device 4. The control device 4 includes a processing unit 41, an input unit 42, a display unit 43, and a storage unit 44. The processing unit 41 is configured using a processor (information processing device) such as a CPU. The input unit 42 is configured using operation switches or the like. The display unit 43 is configured using a liquid crystal display, an organic EL display, or the like. The input unit 42 and the display unit 43 may be integrated using a touch panel display or the like. The storage unit 44 is configured using a HDD, SSD, semiconductor memory, or the like. A program 51 and control data 52 are stored in the storage unit 44. The storage unit 44 has a computer-readable non-volatile storage medium such as a ROM, and the program 51 is stored in the storage medium.
[0016] 5 is a simplified diagram showing the functional configuration of the processing unit 41. As functions realized by the processor executing the program 51 read from the storage unit 44, the processing unit 41 includes a control unit 61, an acquisition unit 62, an image processing unit 63, a determination unit 64, and an output unit 65. The processing content executed by each unit will be described later.
[0017] Fig. 6 is a flowchart showing the processing executed by the processing unit 41. Figs. 7A to 7D are side views schematically showing the processing executed by the processing unit 41.
[0018] 7A , first, in step SP01, the control unit 61 causes the transport mechanism to perform a transport process, thereby transporting the solder joint forming apparatus 1, the imaging device 2, and the lighting device 3 to a desired position. The control unit 61 also causes the solder joint forming apparatus 1 to perform a soldering process, thereby forming a solder joint 32 in the target area 20. The soldering iron 11 forms the solder joint 32 in the target area 20 by heating the solder 31 supplied from the solder supply device 12.
[0019] 7B , next, in step SP02, the control unit 61 causes the transport mechanism to execute a retraction operation for the solder joint forming apparatus 1, thereby retracting the solder joint forming apparatus 1 from the target area 20 while maintaining the positional relationship between the imaging device 2 and the lighting device 3 and the solder joint forming apparatus 1. As a result, the imaging device 2 and the lighting device 3 are transported to a desired position where they can image and illuminate the solder joints 32.
[0020] 7C , next, in step SP03, the control unit 61 causes the imaging device 2 to capture an image while the illumination device 3 is turned on. As a result, the acquisition unit 62 acquires a first image of the solder joint portion 32.
[0021] 7D , next, in step SP04, the control unit 61 causes the imaging device 2 to capture an image while the illumination device 3 is turned off. As a result, the acquisition unit 62 acquires a second image of the solder joint 32. Note that, throughout steps SP03 and SP04, the ambient lighting, such as a ceiling light, remains on without any change.
[0022] In steps SP03 and SP04, after the control unit 61 has retracted the solder joint forming apparatus 1 from the target area 20, the control unit 61 controls the imaging device 2 and the lighting device 3 to cause the acquisition unit 62 to acquire the first image and the second image before the predetermined time corresponding to the solidification time of the solder joint 32 has elapsed. In other words, the imaging device 2 images the solder joint 32 without waiting until the solder joint 32 solidifies.
[0023] 8A is a diagram showing a first image G1 as a first example of a first image of the solder joint 32. In the drawings of the present application, the image of the solder joint 32 is shown as a monochrome image, but in reality it is a color image. For example, the solder joint 32 is silver, the printed circuit board 21 is green, and the land 22 is orange. Because the solder joint 32 before solidification is glossy, when the solder joint 32 before solidification is imaged with the lighting device 3 turned on, the center of the solder joint 32 is overexposed and blown out due to light reflected from the surface of the solder joint 32.
[0024] 8B is a diagram showing a first image G2 as a second example of the first image of the solder joint 32. When capturing an image of the solder joint 32 with the lighting device 3 turned on, the control unit 61 reduces the sensitivity of the imaging device 2 to an extent that no overexposure occurs in the center of the solder joint 32. As a result, the center of the solder joint 32 is properly exposed, and the sloped portions of the solder joint 32 included in the regions R1 on the left and right of the center are underexposed. In step SP03, the acquisition unit 62 acquires the first image G2.
[0025] FIG. 9 shows a second image G3 as an example of the second image of the solder joint 32. When the solder joint 32 is imaged with the lighting device 3 off, the entire solder joint 32 is illuminated with low contrast by ambient lighting, such as a ceiling light, resulting in a properly exposed overall image of the solder joint 32. The control unit 61 appropriately sets the sensitivity of the imaging device 2 to prevent overexposure and underexposure from occurring across the entire solder joint 32. The sensitivity of the imaging device 2 when imaging the solder joint 32 with the lighting device 3 off is set higher than the sensitivity of the imaging device 2 when imaging the solder joint 32 with the lighting device 3 on. Note that even when imaging the solder joint 32 with the lighting device 3 on, the solder joint 32 is illuminated by ambient lighting, such as a ceiling light. In step SP04, the acquisition unit 62 acquires the second image G3.
[0026] Next, in step SP05, the image processing unit 63 performs image processing on the first image G2 acquired in step SP03 and the second image G3 acquired in step SP04 to create a brightness difference image showing the difference in brightness between the first image G2 and the second image G3.
[0027] FIG. 10A illustrates a brightness difference image G4 as a first example of a brightness difference image. The brightness difference image G4 is created based on the first image G2 and the second image G3. The image processing unit 63 calculates the brightness difference for each corresponding pixel by subtracting the brightness value of the first image G2 from the brightness value of the second image G3. The image processing unit 63 assigns a pixel value of "1" to pixels whose brightness difference is equal to or greater than a predetermined first threshold, and a pixel value of "0" to pixels whose brightness difference is less than the first threshold, thereby creating a binarized brightness difference image G4. In the brightness difference image G4, pixels whose pixel value is "1" correspond to white pixels, and pixels whose pixel value is "0" correspond to black pixels. The brightness difference image G4 clearly reveals the shape of the inclined portion of the solder joint 32 included in region R1. The brightness difference image G4 corresponds to an inspection image for overfill defects and underfill defects in the solder joint 32. An excess defect is a defect caused by an excessive supply of solder 31, and an insufficient defect is a defect caused by an insufficient supply of solder 31. A first reference image corresponding to a brightness difference image of the upper allowable limit value of the solder joint 32 and a second reference image corresponding to a brightness difference image of the lower allowable limit value of the solder joint 32 are created in advance and stored in the storage unit 44 as part of the control data 52.
[0028] 10B shows a brightness difference image G5 as a second example of a brightness difference image. The brightness difference image G5 is an image obtained by binarizing the first image G1. Region R2 of the brightness difference image G5 contains white pixels that differ from the shape of the inclined portion of the solder joint 32. This is because the solder smoke contained in the first image G1 is made visible in the brightness difference image G5. The white pixels in region R2 do not appear in the brightness difference image G4.
[0029] In generating the brightness difference image G4, the image processing unit 63 may exclude pixels in the first image G2 and the second image G3 that correspond to the color components of the printed circuit board 21 from the pixels to be used in generating the brightness difference image G4. For example, the image processing unit 63 converts the color space of the first image G2 and the second image G3 from RGB to HSV, and excludes the green component (45≦H≦90) of the printed circuit board 21 from the calculation. This limits the pixels to be used in generating the brightness difference image G4, thereby reducing the processing load.
[0030] Furthermore, the image processing unit 63 may clip a region R1 of the first image G2 and the second image G3, which is an image region corresponding to the inclined portion of the solder joint 32, and create a brightness difference image G4 for the clipped region R1. Coordinate information of the region R1 to be clipped is set in advance according to the position of the solder joint 32 within the printed circuit board 21, and is included in the control data 52 and stored in the storage unit 44. This allows the targets for which the brightness difference image G4 is created to be limited, thereby reducing the processing load.
[0031] The soldering apparatus 100 further includes a safety cover that covers the entire apparatus, and the safety cover may be formed of a frosted or translucent material. The control device 4, which has an input unit 42 and a display unit 43 that require operator access, is located outside the safety cover. The solder joint forming device 1, the imaging device 2, and the lighting device 3 are housed within the interior space of the safety cover. The frosted or translucent cover member prevents operators around the soldering apparatus 100 from being reflected on the surface of the solder joint 32 before solidification, thereby further improving the accuracy of defect determination.
[0032] Next, in step SP06, the determination unit 64 determines whether the solder joints 32 are over- or under-defective (over- or under-defective) based on the brightness difference image G4, which is the image to be inspected, and the first and second reference images.
[0033] The determination unit 64 identifies, for each corresponding pixel, pixels having a pixel value of "1" in the brightness difference image G4 and a pixel value of "0" in the first reference image (hereinafter referred to as "excess pixels"), and calculates a first evaluation value by counting the number of identified excess pixels. The determination unit 64 determines that an excessive defect has occurred when the first evaluation value is equal to or greater than a predetermined first reference value. The first reference value is set in advance, included in the control data 52, and stored in the storage unit 44.
[0034] Furthermore, for each corresponding pixel, the determination unit 64 identifies pixels (hereinafter referred to as "missing pixels") that have a pixel value of "1" in the second reference image and a pixel value of "0" in the brightness difference image G4, and calculates a second evaluation value by counting the number of identified missing pixels. The determination unit 64 determines that a shortage defect has occurred when the second evaluation value is equal to or greater than a predetermined second reference value. The second reference value is set in advance, included in the control data 52, and stored in the storage unit 44.
[0035] The determining unit 64 determines that neither an excess defect nor an insufficient defect has occurred when the first evaluation value is less than the first reference value and the second evaluation value is less than the second reference value.
[0036] The determination unit 64 may determine only one of an excess defect and an insufficiency defect. Alternatively, the determination unit 64 may determine an excess defect or an insufficiency defect by comparing the total number of pixels having a pixel value of "1" in the brightness difference image G4 with a predetermined upper and lower allowable limits.
[0037] The determination unit 64 may also determine whether an excessive defect or an insufficient defect is present based on the average pixel value. In determining whether an excessive defect is present, the determination unit 64 may identify, for each pixel, pixels having a pixel value of "1" in the brightness difference image G4 and a pixel value of "0" in the first reference image (hereinafter referred to as "excess pixels"), and calculate a first average evaluation value by dividing the total number of the identified excess pixels by the area of the brightness difference image G4. The determination unit 64 determines whether an excessive defect has occurred when the first average evaluation value is equal to or greater than a predetermined first average reference value. In determining whether an insufficient defect is present, the determination unit 64 may identify, for each pixel, pixels having a pixel value of "1" in the second reference image and a pixel value of "0" in the brightness difference image G4 (hereinafter referred to as "insufficient pixels"), and calculate a second average evaluation value by dividing the total number of the identified insufficient pixels by the area of the brightness difference image G4. The determination unit 64 determines whether an insufficient defect has occurred when the second average evaluation value is equal to or greater than a predetermined second average reference value. Here, the sizes of the brightness difference image G4, the first reference image, and the second reference image are all set to the same size in advance. By making a judgment based on the average pixel value, the same standard can be used even if the image size changes.
[0038] Furthermore, instead of creating the first and second reference images separately, a common third reference image may be created in advance. The determination unit 64 may use, for example, 120% of the pixel value of the third reference image as the first reference value and, for example, 80% of the pixel value of the third reference image as the second reference value. The determination unit 64 may determine an excessive defect when the sum of the pixels in the brightness difference image G4 is equal to or greater than the first reference value and a deficient defect when the sum is equal to or less than the second reference value. Since there is no need to determine whether an excessive defect or a deficient defect is required separately, the determination time can be shortened. The numerical values of the first and second reference values are not limited to the above example. For example, the first reference value may be any value between 101 and 130% of the pixel value of the third reference image, and the second reference value may be any value between 70 and 99% of the pixel value of the third reference image. The determination unit 64 may also use the third reference image and determine whether an excessive defect or a deficient defect is required based on the average pixel value. The method of determining whether the determining unit 64 is an over-defective or under-defective is not limited to the above example, and any method may be used.
[0039] 11A to 11D are diagrams showing images G6A to G6D of various solder joints 32 with different amounts of solder 31 supplied. The first reference image, which corresponds to a brightness difference image of the upper allowable limit of the solder joint 32, is created, for example, based on image G6C shown in FIG. 11C. The second reference image, which corresponds to a brightness difference image of the lower allowable limit of the solder joint 32, is created, for example, based on image G6B shown in FIG. 11B. The first and second reference images can be arbitrarily set by the user of the soldering apparatus 100. Image G6D shown in FIG. 11D corresponds to an over-defective solder joint 32. Image G6A shown in FIG. 11A corresponds to an under-defective solder joint 32.
[0040] Next, in step SP07, the judgment unit 64 judges whether there is a wetting defect in the solder joint 32 based on the first image acquired in step SP03. Specifically, the image processing unit 63 creates a color component image corresponding to the color components of the land 22 based on the first image, and the judgment unit 64 judges whether there is a wetting defect based on the color component image. The color component image is an image in which color components within a specific range are extracted and visualized from the various color components contained in the image.
[0041] 12 shows a first image G7 as an example of a first image of a solder joint 32 in which a wetting defect has occurred. As described above, the solder joint forming apparatus 1 is disposed on the opposite side of the target area 20 from the imaging device 2 and the lighting device 3. Therefore, the imaging device 2 cannot image the solder joint forming apparatus 1 side of the solder joint 32. However, since the likelihood of a wetting defect occurring on the solder joint forming apparatus 1 side is low, it is sufficient to image only the imaging device 2 and the lighting device 3 side. In the first image G7, a portion of the land 22 is exposed due to a wetting defect.
[0042] FIG. 13 shows a color component image G8 as an example of a color component image corresponding to the color component of the land 22. The image processing unit 63 extracts and binarizes pixels corresponding to the color component of the land 22 from the first image G7 to create the color component image G8. For example, the image processing unit 63 converts the color space of the first image G2 from RGB to HSV and extracts the orange color component (0≦H≦30) of the land 22. The image processing unit 63 assigns a pixel value of “1” to pixels that extract the color component of the land 22 and a pixel value of “0” to other pixels to create the binarized color component image G8. In the color component image G8, pixels with a pixel value of “1” correspond to white pixels, and pixels with a pixel value of “0” correspond to black pixels. It can be seen from the color component image G8 that the shape of the land 22 exposed due to poor wetting is clearly visible. The color component image G8 corresponds to an inspection image for poor wetting of the solder joint 32.
[0043] The image processing unit 63 may create a color component image corresponding to the color component of the land 22 based on the second image acquired in step SP04 instead of the first image acquired in step SP03.
[0044] Furthermore, the image processing unit 63 may clip a region R3 of the first image or the second image, which is an image region corresponding to the position of the land 22 (i.e., the position where the land 22 is arranged), and create a color component image for the clipped region R3. Coordinate information of the region R3 to be clipped is set in advance according to the position of the solder joint 32 in the printed circuit board 21, and is included in the control data 52 and stored in the storage unit 44. This makes it possible to limit the targets for which color component images are to be created, thereby reducing the processing load.
[0045] The determination unit 64 calculates a third evaluation value by counting the number of pixels having a pixel value of "1" in the color component image G8. The determination unit 64 determines that a wetting defect has occurred when the third evaluation value is equal to or greater than a predetermined second threshold value. The second threshold value is set in advance and is stored in the storage unit 44 as part of the control data 52.
[0046] Next, in step SP08, the output unit 65 outputs the result of the determination of excess / insufficiency defects and wetting defects by the determination unit 64. The determination result is provided to the user by being displayed on the display unit 43 of the control device 4, for example.
[0047] Next, in step SP09, the control unit 61 determines whether or not there is an unformed soldering target, that is, whether or not there is a solder joint to be formed next.
[0048] If there is a next solder joint (step SP09: YES), the processing unit 41 updates the soldering target to be processed and repeats the processing from step SP01 onwards.
[0049] If there is no next solder joint (step SP09: NO), the processing unit 41 ends the process.
[0050] In the above embodiment, inspections for excess defects, insufficient defects, and wetting defects of the solder joints 32 are all performed, but it is also possible to perform only one of these inspections.
[0051] According to this embodiment, the control device 4 acquires a first image G2 of the solder joint 32 by having the imaging device 2 capture an image while the lighting device 3 is illuminating, and acquires a second image G3 of the solder joint 32 by having the imaging device 2 capture an image while the lighting device 3 is turned off. The control device 4 also creates a brightness difference image G4 that indicates the difference in brightness between the first image G2 and the second image G3, and determines whether the solder joint 32 is an over-defect or an under-defect based on the created brightness difference image G4. This eliminates the need to wait until the solder joint 32 solidifies and loses its gloss before capturing an image, thereby shortening the time required for determining whether the solder joint 32 is defective.
[0052] The present invention discloses various aspects of the technology as described above, but the main technologies among them are summarized below.
[0053] A soldering apparatus according to a first aspect of the present invention comprises a solder joint forming device having a soldering iron and forming a solder joint in a target area for soldering; an imaging device that images the solder joint formed in the target area from a predetermined direction; an illumination device that illuminates the solder joint formed in the target area from the predetermined direction; and a control device, wherein the control device acquires a first image of the solder joint by having the imaging device perform the imaging while the illumination device is performing the illumination; acquires a second image of the solder joint by having the imaging device perform the imaging while the illumination device is stopped; creates a brightness difference image showing the difference in brightness between the first image and the second image; and determines at least one of an over-defect and an under-defect of the solder joint based on the brightness difference image.
[0054] According to the first aspect, it is not necessary to wait until the solder joint solidifies and loses its luster before capturing an image, which makes it possible to reduce the time required for the process of determining whether a solder joint is defective.
[0055] In the soldering apparatus of the second aspect of the present invention, in the first aspect, the solder joint forming device forms the solder joint on a land included in the target area, and the control device further determines poor wetting of the solder joint based on the first image or the second image.
[0056] According to the second aspect, it is possible to determine not only excess defects and insufficient defects of the solder joints but also wetting defects.
[0057] In the soldering device of the third aspect of the present invention, in the second aspect, in determining the wetting defect, the control device creates a color component image corresponding to the color component of the land based on the first image or the second image, and determines the wetting defect based on the color component image.
[0058] According to the third aspect, it is possible to easily and accurately determine whether or not wetting is poor.
[0059] A fourth aspect of the present invention is a soldering apparatus in which, in the third aspect, in creating the color component image, the control device clips an image area of the first image or the second image that corresponds to the position of the land, and creates the color component image for the clipped image area.
[0060] According to the fourth aspect, it is possible to limit the targets for which color component images are to be created, thereby reducing the processing load.
[0061] In a soldering apparatus according to a fifth aspect of the present invention, in any one of the first to fourth aspects, in acquiring the first image and the second image, the control device acquires the first image and the second image after retracting the solder joint forming device from the target area and before a predetermined time corresponding to the solidification time of the solder joint has elapsed.
[0062] According to the fifth aspect, the first image and the second image are acquired before a predetermined time corresponding to the solidification time of the solder joint has elapsed, thereby making it possible to shorten the time required for the defect determination process of the solder joint.
[0063] A soldering apparatus according to a sixth aspect of the present invention is any one of the first to fifth aspects, further comprising a frosted or translucent cover member that houses the solder joint forming device, the imaging device, and the lighting device in an internal space.
[0064] According to the sixth aspect, it is possible to prevent workers around the soldering device from being reflected on the surface of the solder joint before solidification, thereby making it possible to further improve the accuracy of defect determination.
[0065] A seventh aspect of the present invention is a soldering apparatus in any one of the first to sixth aspects, wherein the solder joint forming device forms the solder joint on a printed circuit board, and in creating the brightness difference image, the control device excludes pixels in the first image and the second image that correspond to the color components of the printed circuit board from the targets for creating the brightness difference image.
[0066] According to the seventh aspect, it is possible to limit the targets for which a brightness difference image is to be created, thereby reducing the processing load.
[0067] In the soldering device of the eighth aspect of the present invention, in any one of the first to seventh aspects, in creating the brightness difference image, the control device clips image areas of the first image and the second image that correspond to the inclined portion of the solder joint, and creates the brightness difference image for the clipped image areas.
[0068] According to the eighth aspect, it is possible to limit the targets for which a brightness difference image is to be created, thereby reducing the processing load.
[0069] A soldering apparatus according to a ninth aspect of the present invention comprises a solder joint forming device having a soldering iron and forming a solder joint on a land included in a target area for soldering, an imaging device that images the solder joint formed in the target area from a predetermined direction, and a control device, wherein the control device acquires an image of the solder joint by having the imaging device perform the imaging after the solder joint forming device has completed forming the solder joint but before starting to form the next solder joint, and determines whether the solder joint has a poor wetting ability based on the image.
[0070] According to the ninth aspect, it is possible to sequentially determine the wetting defects of each solder joint in-line while forming a plurality of solder joints in sequence using the solder joint forming device. Furthermore, since it is not necessary to wait until the solder joints have solidified and lost their gloss before imaging, it is possible to shorten the time required to determine the wetting defects of the solder joints.
[0071] A program according to a tenth aspect of the present invention is a program for causing an information processing device mounted on a control device to execute processing in a soldering apparatus comprising: a solder joint forming device having a soldering iron and forming a solder joint in a target area for soldering; an imaging device that images the solder joint formed in the target area from a predetermined direction; an illumination device that illuminates the solder joint formed in the target area from the predetermined direction; and a control device, wherein the processing comprises: acquiring a first image of the solder joint by having the imaging device perform the imaging while the illumination device is performing the illumination; acquiring a second image of the solder joint by having the imaging device perform the imaging while the illumination device is stopped; creating a brightness difference image showing the difference in brightness between the first image and the second image; and determining at least one of an excess defect and an under-defect of the solder joint based on the brightness difference image.
[0072] According to the tenth aspect, since it is not necessary to wait until the solder joint solidifies and loses its luster before imaging, it is possible to shorten the time required for the process of determining whether the solder joint is defective.
Claims
1. A soldering apparatus comprising: a solder joint forming device having a soldering iron and forming a solder joint in a target area for soldering; an imaging device for imaging the solder joint formed in the target area from a predetermined direction; an illumination device for illuminating the solder joint formed in the target area from the predetermined direction; and a control device, wherein the control device: obtains a first image of the solder joint by having the imaging device perform the imaging while the illumination device is performing the illumination; obtains a second image of the solder joint by having the imaging device perform the imaging while the illumination device is stopped performing the illumination; creates a brightness difference image showing the difference in brightness between the first image and the second image; and determines at least one of an excess defect and an under-defect of the solder joint based on the brightness difference image.
2. The soldering device according to claim 1, wherein the solder joint forming device forms the solder joint on a land included in the target area, and the control device further determines wetting defects of the solder joint based on the first image or the second image.
3. The soldering device of claim 2, wherein in determining the wetting defect, the control device creates a color component image corresponding to the color component of the land based on the first image or the second image, and determines the wetting defect based on the color component image.
4. The soldering device of claim 3, wherein in creating the color component image, the control device clips an image area of the first image or the second image that corresponds to the position of the land, and creates the color component image for the clipped image area.
5. The soldering device of claim 1, wherein in acquiring the first image and the second image, the control device acquires the first image and the second image after retracting the solder joint forming device from the target area and before a predetermined time corresponding to the solidification time of the solder joint has elapsed.
6. The soldering apparatus according to claim 1, further comprising a frosted or semi-transparent cover member that houses the solder joint forming device, the imaging device, and the lighting device in an internal space.
7. The soldering device according to claim 1, wherein the solder joint forming device forms the solder joint on a printed circuit board, and in creating the brightness difference image, the control device excludes pixels of the first image and the second image that correspond to color components of the printed circuit board from the brightness difference image creation target.
8. The soldering device according to claim 1, wherein in creating the brightness difference image, the control device clips image areas of the first image and the second image that correspond to the inclined portion of the solder joint, and creates the brightness difference image for the clipped image areas.
9. A soldering apparatus comprising: a solder joint forming device having a soldering iron and forming a solder joint on a land included in a target area for soldering; an imaging device which images the solder joint formed in the target area from a predetermined direction; and a control device, wherein the control device obtains an image of the solder joint by causing the imaging device to perform the imaging after the solder joint forming device has completed formation of the solder joint and before starting to form the next solder joint, and determines wetting defects of the solder joint based on the image.
10. A program for causing an information processing device mounted on a control device to execute processing in a soldering apparatus comprising: a solder joint forming device having a soldering iron and forming a solder joint in a target area for soldering; an imaging device that images the solder joint formed in the target area from a predetermined direction; an illumination device that illuminates the solder joint formed in the target area from the predetermined direction; and a control device, the program comprising: acquiring a first image of the solder joint by having the imaging device execute the imaging while the illumination device is performing the illumination; acquiring a second image of the solder joint by having the imaging device execute the imaging while the illumination device is stopped; creating a brightness difference image showing the difference in brightness between the first image and the second image; and determining at least one of an excess defect and an under-defect of the solder joint based on the brightness difference image.
Citation Information
Patent Citations
Inspecting apparatus for position of component after mounting
JP1993113409A
Appearance inspection method and apparatus
JP1993272938A
Solder-paste printing testing device
JP1998209635A
Inspection system and inspection method
JP2008076277A
Image inspection method and inspection area setting method
JP2013191064A
