Component placement device
The component mounting device addresses inefficiencies in conventional recognition methods by simultaneously using multiple illumination patterns and combining images, resulting in faster and more accurate component recognition and improved mounting efficiency.
Patent Information
- Application Number
- JP2020064357
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2020-03-31
- Publication Date
- 2024-11-01
- Estimated Expiration
- 2040-03-31
AI Technical Summary
Conventional component mounting devices require multiple imaging operations with different illumination patterns to recognize components accurately, leading to reduced efficiency due to the need for repeated movement of components above the recognition camera.
A component mounting device that captures images of components using multiple illumination patterns simultaneously by switching between reflected, transmitted, and side illumination during a single pass, combining these images to generate composite images for accurate recognition.
Improves recognition efficiency and reduces the time required for component recognition, thereby enhancing the overall mounting efficiency and productivity of the manufacturing line.
Smart Images

Figure 0007576768000001 
Figure 0007576768000002 
Figure 0007576768000003
Abstract
Description
[Technical field]
[0001] The present disclosure relates to a component mounting apparatus. [Background technology]
[0002] In a semiconductor or other substrate manufacturing factory, multiple mounting substrate production lines are provided, and multiple component mounting devices are arranged on each mounting substrate production line. Each component mounting device mounts electronic components or other components at positions on the substrate where solder paste has been printed. In recent years, in order to increase the productivity of substrate manufacturing factories, there has been a demand for improving the operating efficiency of these component mounting devices.
[0003] A conventional component mounting device is known in the form of a component recognition device for a component mounting device in which a nozzle is mounted on a moving head, and an electronic component held by the nozzle is illuminated by an illumination unit, and then an image of the electronic component is captured by a component recognition camera to perform image recognition of the electronic component (see, for example, Patent Document 1). This component recognition device includes an illumination unit having a first illumination unit for reflected illumination, a second illumination unit for transmitted illumination, and a third illumination unit for lateral illumination. A light shield is disposed between the illumination units and the illumination target (for example, a component) to prevent illumination light emitted from each illumination unit from being irradiated on a portion other than the predetermined illumination target portion. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] JP 2001-94299 A Summary of the Invention [Problem to be solved by the invention]
[0005] However, when the illumination unit disclosed in Patent Document 1 is used to image and recognize a component picked up by a nozzle mounted on a moving head while moving (scanning) above a component recognition camera, problems with mounting efficiency may occur. That is, when imaging is performed using the illumination patterns of multiple illumination units individually in order to detect each of the different states or postures of the component, it is necessary to move the component at least twice above the component recognition camera. Therefore, there is a problem that it takes time to recognize the component. There are also problems with image recognition.
[0006] The image recognition problem will be described with reference to Figs. 10(A) and (B) and Figs. 11(A) and (B). Figs. 10(A) and (B) are example images obtained by imaging an electronic component with reflected illumination and transparent illumination. Figs. 11(A) and (B) are example images obtained by imaging a BGA component with side illumination and transparent illumination. BGA is an abbreviation for Ball Grid Array.
[0007] For example, when a component is held by a moving head and moved while being photographed by a component recognition camera to obtain an image, if the component is an electronic component such as an IC or transistor and reflective lighting is used as the lighting pattern of the lighting unit, everything other than the electrodes of the component will appear as a dark image, as shown in Figure 10(A). Therefore, the position and shape of the electrodes will appear as a bright image and can be easily recognized. On the other hand, with reflective lighting, it is difficult to distinguish the shape of the mold outline (in other words, the silhouette) that shows the overall outline of the component, so it was necessary to use transmitted lighting. When transmitted lighting is used for an electronic component, the silhouette appears as a bright image, as shown in Figure 10(B), and the mold outline of the component can be easily recognized.
[0008] Additionally, when the component is a BGA component, as shown in Figure 11(A), when side lighting is used as the lighting pattern of the lighting unit, everything other than the electrode pattern of the BGA component becomes a dark image, so the position and shape of the electrode pattern become a bright image and can be easily recognized. On the other hand, when side lighting is used, the polarity mark indicating the front and back of the electrode pattern of the BGA component becomes a dark image and cannot be captured by the component recognition camera, so it was necessary to use reflected lighting. When reflected lighting is used for a BGA component, the polarity mark M of the polarity pattern becomes a bright image and can be easily recognized, as shown in Figure 11(B).
[0009] Due to such problems in image recognition, it is necessary to appropriately switch the illumination pattern to capture the image of the components, which takes time to recognize the components and reduces the efficiency of mounting the components. In other words, there is room for improvement in the recognition efficiency and mounting efficiency of the component mounting of Patent Document 1.
[0010] The present disclosure provides a component mounting device that improves the efficiency of recognizing different states or orientations of components by appropriately switching between multiple illumination patterns depending on the component while capturing images, thereby suppressing a decrease in component mounting efficiency. [Means for solving the problem]
[0011] The present disclosure provides an imaging system including an imaging unit that images a component held by a head from below, an imaging control unit that controls imaging by the imaging unit and an illumination pattern by illumination during imaging, a component recognition unit that recognizes the component from an image captured by the imaging unit, and a component mounting unit that mounts the component on a board with the head based on a recognition result by the component recognition unit, wherein the imaging control unit acquires a first image by turning on the illumination in a first pattern and causing the imaging unit to capture an image at a first timing when the component is moving above the imaging unit, and acquires a second image by turning on the illumination in a second pattern and causing the imaging unit to capture an image at a second timing when the component is moving above the imaging unit, the component recognition unit recognizes the component based on the first image and the second image, and the imaging control unit combines a plurality of consecutive first images captured with the illumination turned on in the first pattern to obtain a first image. Including the whole of the above parts A first composite image is generated, and a plurality of consecutive second images captured with the illumination turned on in the second pattern are composited to generate the first composite image. Including the whole of the above parts A component mounting device is provided which generates a second composite image, and the component recognition unit recognizes the component based on the first composite image and the second composite image. Effect of the Invention
[0012] According to the present disclosure, by appropriately switching between a plurality of illumination patterns depending on the component while capturing images, it is possible to improve the efficiency of recognizing different states or orientations of the component and suppress a decrease in component mounting efficiency. [Brief description of the drawings]
[0013] [Figure 1] FIG. 1 is a top view illustrating a mechanical configuration of a component mounting device according to a first embodiment; [Diagram 2] FIG. 2 is a side view illustrating a mechanical configuration of the component mounting device shown in FIG. [Diagram 3] FIG. 3 is a perspective view illustrating the operation of the moving head shown in FIG. [Figure 4] FIG. 3 is a side view illustrating a mechanical configuration of the part recognition camera shown in FIG. [Diagram 5] FIG. 2 is a block diagram illustrating a functional configuration of a control unit of the component mounting device shown in FIG. [Figure 6] A schematic diagram of multiple images of the moving part shown in Figure 2, taken consecutively and arranged in chronological order. [Figure 7] An example of an image in which multiple images of the moving part shown in Figure 2 are captured in succession and then combined into one. [Figure 8] 6 is a flowchart illustrating an example of an operation flow executed by the control unit shown in FIG. 5. [Figure 9] FIG. 9 is a schematic diagram illustrating the illumination and imaging performed by the steps shown in FIG. [Figure 10] (A) and (B) Example images of an electronic component captured with reflected and transparent illumination. [Figure 11] (A) and (B) Example images of a BGA component captured with side illumination and transparent illumination. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0014] Hereinafter, with reference to the drawings as appropriate, an embodiment specifically disclosing the component mounting apparatus according to the present disclosure will be described in detail. However, more detailed description than necessary may be omitted. For example, detailed description of already well-known matters or duplicate description of substantially the same configuration may be omitted. This is to avoid the following description becoming unnecessarily redundant and to facilitate understanding by those skilled in the art. Also, each of the attached drawings will be referred to according to the direction of the reference numerals. Note that the attached drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.
[0015] For example, the term "unit" or "device" in the embodiments is not limited to a physical configuration that is mechanically realized by hardware, but also includes a configuration whose functions are realized by software such as a program. Also, the functions of one configuration may be realized by two or more physical configurations, or the functions of two or more configurations may be realized by, for example, one physical configuration.
[0016] <Mechanical configuration of the component mounting device> First, the mechanical configuration of component mounting device 1 will be described with reference to Fig. 1 and Fig. 2. Fig. 1 is a top view illustrating the mechanical configuration of component mounting device 1 according to embodiment 1. Fig. 2 is a side view illustrating the mechanical configuration of component mounting device 1 shown in Fig. 1. In Fig. 1 and Fig. 2, the front side of component mounting device 1 (the lower side on the paper surface of Fig. 1, the left side on the paper surface of Fig. 2) is also referred to as the front side, and the back side of component mounting device 1 (the upper side on the paper surface of Fig. 1, the right side on the paper surface of Fig. 2) is also referred to as the rear side.
[0017] One or more component mounting devices 1 are arranged in a mounting board production line for attaching various components P to a board W to manufacture the board, and mount the components P in a predetermined position and attitude on the board W transported from upstream of the mounting board production line.
[0018] As shown in Figures 1 and 2, the component mounting apparatus 1 is mainly configured to include a main body mechanism section 10 (an example of a component mounting section) that mounts components P (e.g., electronic components such as ICs (Integrated Circuits), transistors, capacitors, or BGA components) on a board W by the operation of each section mechanism, and a control section 40 that controls the operation of the main body mechanism section 10. The main body mechanism section 10 has a mounting machine main body 11 composed of a base 12 and the like, and a head unit 23 (an example of a component mounting section) that is configured to be movable relative to the mounting machine main body 11. The control section 40 is housed inside the base 12 (see below) of the component mounting apparatus 1, and controls various mechanisms such as the mounting machine main body 11 and the head unit 23.
[0019] 1 (the conveying direction of the board W). The board conveying mechanism 13 has a pair of conveyor units 14 extending along the X direction, and conveys the board W placed on the pair of conveyor units 14, and positions and holds the board W at a predetermined mounting position.
[0020] A pair of component supply mechanisms 15 are disposed facing each other on both the front and rear sides of the board transport mechanism 13 (top and bottom sides in the plane of FIG. 1, left and right sides in the plane of FIG. 2). Each of the pair of component supply mechanisms 15 has a feeder base 16 in which a slot 17 is provided, and a plurality of tape feeders 18 are attached in parallel to the slot 17 as part feeders.
[0021] The component mounting device 1 further includes a feeder cart 19. The feeder cart 19 includes a carriage unit 20 having a plurality of wheels disposed on its underside, and a plurality of reel stock units (not shown) disposed on the upper side of the carriage unit 20. A reel 21 is housed in each of the plurality of reel stock units. A carrier tape 22 containing a component P is pulled out from each of the reels 21, and the component P is supplied to a tape feeder 18 of the component supply mechanism 15. As a result, the tape feeder 18 of the component supply mechanism 15 pitch-feeds the carrier tape 22 in the tape feed direction, thereby supplying the component P to a pick-up position where pick-up is performed by a moving head 26 of a head unit 23 described below.
[0022] Head unit 23 is disposed above base 12, and configured to be movable between a mounting position and a removal position where component supply mechanism 15 and substrate W are disposed. Specifically, head unit 23 is capable of linear movement along the X and Y directions by X-axis table mechanism 25 and Y-axis table mechanism 24 that are disposed orthogonal to each other on a plane substantially parallel to the surface of substrate W.
[0023] A Y-axis table mechanism 24 is disposed on the upper surface of the base 12 along the Y direction. A pair of front and rear X-axis table mechanisms 25 are disposed along the X direction, and are attached to the Y-axis table mechanism 24 so as to be slidable along the Y direction. A moving head 26 is attached to the tip of each of the pair of front and rear X-axis table mechanisms 25 so as to be slidable along the X direction. That is, in the first embodiment, the moving head 26 is mounted on the head unit 23, and the moving head 26 is provided so as to be movable independently of each other by the X-axis table mechanism 25 and the Y-axis table mechanism 24. As a result, the moving head 26 is arbitrarily positioned on a plane approximately parallel to the surface of the substrate W, that is, on a horizontal plane (XY plane). Both the X-axis table mechanism 25 and the Y-axis table mechanism 24 are configured by linear guide drive mechanisms.
[0024] A component recognition camera 28 (an example of an imaging unit) is disposed between the pair of front and rear component supply mechanisms 15 and the board transport mechanism 13. A component holding nozzle 27 (see below) attached to the moving head 26 while taking out and holding a component P from the component supply mechanism 15 moves and passes above the component recognition camera 28. At this time, the component recognition camera 28 images the component P sucked and held by the component holding nozzle 27 passing by it multiple times at a predetermined timing and with a predetermined illumination pattern (see below). In other words, the component recognition camera 28 images the component P held by the component holding nozzle 27, and while the illumination pattern is changed multiple times by the control unit 40 while the component P is moving above it, the component recognition camera 28 continuously images the component P at a timing corresponding to each illumination pattern (see below). Each of these imaging results is integrated and subjected to recognition processing, thereby enabling identification and position detection of the component P to be performed with high accuracy.
[0025] Furthermore, a nozzle holder 38 and a waste box 37 are disposed between the pair of front and rear component supply mechanisms 15 and the board transport mechanism 13. The nozzle holder 38 stores a plurality of types of component holding nozzles 27 of the moving head 26 corresponding to the components P to be held. By having the moving head 26 access the nozzle holder 38 and performing a predetermined nozzle replacement operation, a component holding nozzle 27 (described below) suitable for the object to be held is attached to the moving head 26. The waste box 37 is formed in a box shape and has an internal space, in which components P determined to be defective as a result of image capture by the component recognition camera 28 are discarded.
[0026] <About the configuration and operation of the moving head> Next, the configuration and operation of the moving head 26 will be described with reference to Fig. 3. Fig. 3 is a perspective view illustrating the operation of the moving head 26 shown in Fig. 2.
[0027] 3, the moving head 26 is a multiple head (not shown) having a plurality of moving heads 26, and a plurality of component holding nozzles 27 are arranged side by side at the lower end of each moving head 26. In addition, a reflector (not shown) for reflecting illumination light emitted from a transmitted illumination unit 34 (see below) is fixed to the moving head 26. The reflector is disposed above the held component P.
[0028] Each of the component holding nozzles 27 vacuum-sucks and holds a component P from the tape feeder 18 of the component supply mechanism 15, for example, by using air pressure, and moves up and down individually. The moving head 26 further includes a Z-axis lifting mechanism (not shown) for individually lifting and lowering each of the component holding nozzles 27, and a θ-axis rotation mechanism (not shown) for individually rotating each of the component holding nozzles 27 about the nozzle axis. The Y-axis table mechanism 24 and the X-axis table mechanism 25 are driven to position the moving head 26 arbitrarily in the horizontal plane (XY plane). By this movement, the moving head 26 sucks up the component P by the component holding nozzle 27 from the take-out position of the tape feeder 18 of the component supply mechanism 15 and takes it out.
[0029] A board recognition camera 36 (see FIG. 1) is fixed to the moving head 26. The board recognition camera 36 is disposed on the underside of the X-axis table mechanism 25 and moves integrally with the moving head 26. As the moving head 26 moves, the board recognition camera 36 passes above the board W positioned by the board transport mechanism 13 and captures an image of the board W. The image capture result (image capture information) is similarly subjected to recognition processing to detect the position and posture of the board W.
[0030] As a result of detecting the position of the board W, the moving head 26 places the components P at their respective mounting points (e.g., the mounting positions and mounting orientations on the board W where the components P are to be placed) using their component holding nozzles 27 in accordance with instructions from the control unit 40. This mounting of the components P at one time is continued until all of the components P sucked and held by each of the component holding nozzles 27 of the moving head 26 are placed on the board W. In this manner, the components P are held and moved by the component holding nozzles 27 of the moving head 26 between the removal position and the mounting operation position, and are finally placed on the board W.
[0031] The component mounting device 1 repeatedly executes a series of operations of picking up and mounting multiple components P using the component holding nozzle 27 of the moving head 26, and then moving the moving head 26 back to the pick-up position, until mounting is completed at all of the multiple mounting points on the board W. By repeating this operation, a large number of components P are sequentially mounted on each of the boards W that are transported in sequence, and after mounting, the boards W on which all of the components P have been mounted are transported to a downstream process. In this manner, the mounting machine main body 11 and the head unit 23 operate in cooperation with each other, and this cooperative operation is executed in accordance with instructions from the control unit 40.
[0032] In the first embodiment, a series of work units consisting of the forward movement from the removal of component P at the removal position to the mounting work position and the subsequent return movement to the removal position is also referred to as a work unit of "one turn." The forward movement from the removal position to the mounting work position in one turn is also referred to simply as "forward movement in one turn" below.
[0033] <About the configuration of the parts recognition camera> Next, the configuration of the component recognition camera 28 will be described with reference to Fig. 4. Fig. 4 is a side view illustrating an example of the mechanical configuration of the component recognition camera 28 shown in Fig. 2. For ease of explanation, Fig. 4 also illustrates the moving head 26 that moves above the component recognition camera 28 and on its optical axis, and also illustrates a schematic diagram of the internal structure of the illumination unit of the component recognition camera 28, as described below.
[0034] 4, component recognition camera 28 has an imaging sensor section 29 and an illumination unit section 31. In just one turn of component recognition camera 28 (i.e., a one-way outward movement), illumination unit section 31 is turned on for component P held by moving head 26 multiple times, and images are continuously taken from below by the imaging camera section in accordance with each of the timings.
[0035] The imaging sensor unit 29 has a substantially cylindrical housing 30 and an imaging element (not shown) built into the housing 30. The imaging element is, for example, a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS). The imaging sensor unit 29 is disposed so that its optical axis is along the vertical direction (Z direction) and is capable of imaging a component P moving above the component recognition camera 28. The imaging sensor unit 29 also has a shutter function and is configured to be able to capture an image at a predetermined timing in accordance with a command from an imaging processing unit 47 (see below) of the control unit 40. The imaging sensor unit 29 transmits the result of imaging by the imaging element (imaging information) to the control unit 40.
[0036] The lighting unit section 31 has a box-shaped housing 32, and is arranged in a stacked and connected state on the upper side of the housing 30 of the image pickup sensor section 29. The lighting unit section 31 has a plurality of reflective lighting sections 33, a plurality of transmitted lighting sections 34, and a plurality of side lighting sections 35, which are respectively arranged inside the housing 32. By appropriately using the plurality of reflective lighting sections 33, the plurality of transmitted lighting sections 34, and the plurality of side lighting sections 35, the component mounting device 1 lights up the moving component P in a plurality of lighting patterns and captures an image of the component P.
[0037] Each of the multiple reflective illumination sections 33 is disposed approximately parallel to the bottom wall of the housing 32 of the illumination unit section 31, and its irradiation direction is set along the optical axis of the image sensor section 29. When the reflective illumination section 33 is turned on, its illumination light is emitted in the vertical direction.
[0038] The component P held by the component holding nozzle 27 is illuminated by the reflective illumination unit 33 at a first timing when the component P moves above the component recognition camera 28, and the bottom surface of the component P is illuminated. In response to this illumination timing, the imaging sensor unit 29 captures an image of the illuminated bottom surface of the component P to detect a reflected image R (an example of a first image) (see Figs. 6 and 9). The reflected image R is ultimately used to allow the component recognition unit 50 (see below) of the control unit 40 to recognize the polarity indicating the front and back of the electrode pattern of the component P (hereinafter simply referred to as "polarity of the component P"). The first timing, the second timing described below, and the third timing described below are all set within the time of the outward movement (see above) in one turn, and are set differently from each other in time series.
[0039] Each of the multiple transmitted illumination units 34 is disposed obliquely with respect to the bottom wall and side walls of the housing 32, and its irradiation direction is provided so as to obliquely intersect with the optical axis of the image sensor unit 29. The multiple transmitted illumination units 34 are disposed above the reflective illumination unit 33, and a shielding plate B is disposed between each of the reflective illumination units 33 and the transmitted illumination units 34. The shielding plate B is also disposed obliquely with respect to both the bottom wall and side walls of the housing 32.
[0040] When the transmitted illumination unit 34 is turned on, the illumination light passes through the transmitted glass G (described below) and is irradiated obliquely in the vertical and horizontal directions. At a second timing when the component P held by the component holding nozzle 27 is moving above the component recognition camera 28, the transmitted illumination unit 34 turns on the reflector of the moving head 26, so that the component P is illuminated. In response to this lighting timing, the imaging sensor unit 29 similarly captures an image of the component P and detects a transmitted image (an example of a second image) (see FIG. 9). Note that the second timing is different from the first timing. The transmitted image S is ultimately used to allow the component recognition unit 50 of the control unit 40 to recognize the mold outline (silhouette) of the component P.
[0041] Each of the side illumination sections 35 is disposed approximately parallel to the side wall of the housing 32 of the illumination unit section 31, and the illumination direction thereof is provided so as to perpendicularly intersect with the optical axis of the image sensor section 29. The side illumination sections 35 are disposed above the transmitted illumination section 34, and the transmitted glass G is disposed horizontally between the transmitted illumination section 34 and the side illumination section 35. When the side illumination section 35 is turned on, the illumination light is irradiated along a horizontal plane.
[0042] The component P held by the component holding nozzle 27 is illuminated by the side illumination unit 35 at a third timing when the component P moves above the component recognition camera 28, and the side of the component P is illuminated. In response to this illumination timing, the imaging sensor unit 29 similarly captures an image of the component P to detect a side image (third image). The side image is ultimately used to cause the component recognition unit 50 of the control unit 40 to recognize the position and orientation of the component P. Note that the third timing is different from the first timing or the second timing.
[0043] In this way, the component recognition camera 28 detects multiple types of images by switching the lighting between multiple patterns (reflected lighting, transmitted lighting, or side lighting patterns) and taking images at each of multiple times when the component P is moving above it in accordance with the instructions of the control unit 40.
[0044] <Software configuration of component placement device> Next, the software configuration (functional configuration) of the control unit 40 of the component mounting device 1 and the operation of the image capturing processing unit 47 of the control unit 40 will be described with reference to Fig. 5. Fig. 5 is a block diagram illustrating an example of the functional configuration of the control unit 40 of the component mounting device 1 shown in Fig. 1. Fig. 6 is a schematic diagram in which a plurality of images obtained by successively capturing images of the moving component P shown in Fig. 2 are arranged in chronological order. Fig. 7 is an example of an image obtained by combining a plurality of images obtained by successively capturing images of the moving component P shown in Fig. 2 into one.
[0045] The control unit 40 of the component mounting device 1 is configured by a general-purpose computer, and a program as software stored in a storage device such as a ROM (Read Only Memory) or a RAM (Random Access Memory) of the computer is executed by an arithmetic unit such as a CPU (Central Processing Unit). That is, each block shown in the control unit 40 in Fig. 5 represents a function realized by software such as a program. However, the function represented by each block is not limited to software, and each may be configured by hardware as a physical configuration of an "apparatus."
[0046] 5, the control unit 40 includes a storage unit 41, a mechanism driving unit 46, and an image processing unit 47. The mechanism driving unit 46 controls the main body mechanism unit 10, and controls the driving of, for example, the board transport mechanism 13, the component supply mechanism 15, and the head unit 23 so that they operate in coordination with one another.
[0047] The storage unit 41 stores and holds at least mounting information 42, component information 43, and imaging timing information 45. The mounting information 42 stores information such as the type of component P to be mounted on each board W, and the mounting position and mounting posture of the component P on the board W. The component information 43 stores information such as the external shape of each type of component P, and the presence or absence of electrodes and the number of electrodes, and also stores illumination switching information 44.
[0048] The lighting switching information 44 stores information on an illumination pattern (either a reflected illumination, a transmitted illumination, or a side illumination pattern) suitable for each component P. The camera control unit 48 (see below) of the imaging processing unit 47 reads the lighting switching information 44 from the storage unit 41 and controls the imaging timing of the component recognition camera 28 with an illumination pattern corresponding to the type of component P held by the head unit 23. The imaging timing information 45 stores information on the imaging timing (shutter timing) corresponding to each illumination pattern of the component P. The camera control unit 48 of the imaging processing unit 47 controls the imaging timing information 45 from the storage unit 41 to cause the component recognition camera 28 to capture an image of the moving component P by synchronizing the illumination pattern and the imaging timing.
[0049] The imaging processing unit 47 includes a camera control unit 48 (an example of an imaging control unit), an image synthesis unit 49 (an example of an imaging control unit), and a component recognition unit 50.
[0050] The camera control unit 48 controls the imaging by the imaging sensor unit 29 of the component recognition camera 28 and the illumination pattern (reflected illumination, transmitted illumination, or side illumination) by the illumination unit unit 31 during the imaging. As a specific example, in one turn of forward movement, the camera control unit 48 turns on the illumination in the reflected illumination pattern of the reflective illumination unit 33 at a first timing T1 when the component P is moving above the component recognition camera 28, to obtain a reflected image R. Similarly, in one turn of forward movement, the camera control unit 48 turns on the illumination in the transmitted illumination pattern of the transmitted illumination unit 34 at a second timing T2 immediately (after a very short time) after the first timing T1, to obtain a transmitted image S. Note that, hereinafter, a case where reflected illumination and transmitted illumination are used as illumination patterns will be described as an example, but various combinations of illumination patterns to be used may be applied depending on the type of the component P, and are set before the component mounting device 1 is actually operated.
[0051] The camera control unit 48 causes the component recognition camera 28 to capture the reflected images R and transmitted images S alternately one by one, and to capture three consecutive sets of each reflected image R and transmitted image S. This imaging control enables the imaging processing unit 47 to acquire, from the component recognition camera 28, three consecutive reflected images R and three consecutive transmitted images S of the moving component P that are different from each other in time series.
[0052] Specifically, when the images are three consecutive reflected images (specifically, a first reflected image R1, a second reflected image R2, and a third reflected image R3), as shown in Fig. 6, the first reflected image R1 is an image of the tip portion (e.g., the left portion) of the part P along the moving direction of the moving head 26. The next reflected image R2 is an image of the middle portion (e.g., the center portion) of the part P. The last reflected image R3 is an image of the end portion (e.g., the right portion) of the part P.
[0053] In addition, the arrows extending in the left-right direction of the paper in Fig. 6 indicate the time series of the forward movement in one turn. The same is true in Fig. 9. That is, the moving part P is imaged by the moving head 26 in the order of the first reflected image R1, the second reflected image R2, and the third reflected image R3 in chronological order.
[0054] The three consecutive reflected images (specifically, the first reflected image R1, the second reflected image R2, and the third reflected image R3) and the three consecutive transmitted images (specifically, the first transmitted image S1, the second transmitted image S2, and the third transmitted image S3) thus captured are each processed by the image synthesis unit 49. That is, when the images are three consecutive reflected images (specifically, the first reflected image R1, the second reflected image R2, and the third reflected image R3), the image synthesis unit 49 synthesizes the three consecutive reflected images (specifically, the first reflected image R1, the second reflected image R2, and the third reflected image R3) illuminated in a reflected illumination pattern to generate a first synthesized image U1, as shown in FIG. Similarly, when the image is three consecutive transmission images (specifically, the first transmission image S1, the second transmission image S2, and the third transmission image S3), the image synthesis unit 49 synthesizes the three consecutive transmission images (specifically, the first transmission image S1, the second transmission image S2, and the third transmission image S3) illuminated in the transmission illumination pattern to generate a second synthetic image U2 (see FIG. 9). The first synthetic image U1 and the second synthetic image U2 are transmitted to the component recognition unit 50.
[0055] The component recognition unit 50 recognizes the position, orientation, and polarity of the component P based on a first composite image U1 consisting of three consecutive reflected images (specifically, a first reflected image R1, a second reflected image R2, and a third reflected image R3) and a second composite image U2 consisting of three consecutive transmitted images (specifically, a first transmitted image S1, a second transmitted image S2, and a third transmitted image S3). Based on the recognition result by the component recognition unit 50, the head unit 23 mounts the component P on the board W at a predetermined position and orientation with its moving head 26.
[0056] In addition, the imaging information of the board recognition camera 36 is also transmitted to the imaging processing unit 47, which, like the component recognition unit 50, recognizes the position and posture of the board W from the imaging information (image) and transmits the recognition result to the mechanism driving unit 46.
[0057] <Operation flow of the control unit 40> Next, an operation flow of the control unit 40 according to the first embodiment will be described with reference to Fig. 8 and Fig. 9. Fig. 8 is a flowchart illustrating an operation flow executed by the control unit 40 shown in Fig. 5. Fig. 9 is a schematic diagram illustrating illumination and imaging executed by the steps shown in Fig. 8. As described above, in order to have the component recognition camera 28 perform three consecutive sets of detection using a set (combination) of reflected image R and transmitted image S, a counter n (integer type variable) for counting the number of sets is stored and held in the memory unit 41 of the control unit 40.
[0058] 8, the mechanism driving unit 46 transmits an instruction to the head unit 23 to have the moving head 26 pick up and pick up the component P from the pick-up position (St1). The head unit 23 picks up the component P from the pick-up position. Then, from the time of transmission, the forward movement (head movement) in one turn is started, and the mechanism driving unit 46 moves the moving head 26 of the head unit 23 above the component recognition camera 28 while holding the component P (St2). Then, the control unit 40 initializes the counter n (i.e., assigns the integer "1" to the counter n) and counts that the number of imaging sets is the first (St3).
[0059] The camera control unit 48 of the imaging processing unit 47 judges whether or not it is the timing to capture an image of the component P with a reflective illumination pattern (polarity imaging timing) in order to recognize the position and posture of the component P (St4). If it is judged that it is not the polarity imaging timing as a result of the judgment, the camera control unit 48 judges again whether or not it is the polarity imaging timing, and continues the judgment repeatedly until it is the polarity imaging timing (St4, NO). Then, if it is judged that it is the polarity imaging timing (St4, YES), the camera control unit 48 turns on the illumination with a reflective illumination pattern at the first timing T1, which is the polarity imaging timing, during the forward movement in one turn in which the component P moves above the component recognition camera 28. At the same time, the camera control unit 48 controls the component recognition camera 28 to capture an image (imaging control) (St5). As a result, the camera control unit 48 can acquire the first reflected image R1 at the first timing T1 of the first set (see FIG. 9).
[0060] Next, the camera control unit 48 judges whether it is the timing to capture an image with a transmitted illumination pattern (imaging timing for the outline) in order to recognize the mold outline (silhouette) of the part P (St6). If it is judged that it is not the timing to capture an image for the outline, the camera control unit 48 judges again whether it is the timing to capture an image for the outline, and continues to repeat the judgment until it is the timing (St6, NO).
[0061] Then, when it is determined that it is the timing for capturing an external image (St6, YES), the camera control unit 48 turns on the illumination in a pattern of transmitted illumination at the second timing T2, which is the timing for capturing an external image, during the forward movement in one turn. At the same time, the camera control unit 48 controls the component recognition camera 28 to capture an image (imaging control) (St7). This allows the camera control unit 48 to obtain a first transmission image S1 at the second timing T2 of the first set (see FIG. 9). That is, the camera control unit 48 switches the illumination to the pattern of transmitted illumination of the transmitted illumination unit 34 and turns it on at the second timing T2, which is immediately (after a short time) after the first timing T1, during the first set of imaging, and obtains the first transmission image S1.
[0062] After the camera control unit 48 acquires the first reflected image R1 at the first timing T1 and the first transmitted image S1 at the second timing T2 in the first set (n=1), the image capturing processing unit 47 of the control unit 40 judges whether the counter n is 3 (n=3) or not (St8). If the result of the judgment is that n is not 3 (St8, NO), the image capturing processing unit 47 adds an integer "1" to the counter n (St9). After adding 1 to the counter n, the image capturing processing unit 47 returns to step St4 and executes each of the processes up to step St7 until the counter n becomes 3.
[0063] That is, the camera control unit 48 alternately captures the reflected images R and the transmitted images S one by one in this manner, and the first reflected images R1 and the first transmitted images S1 are regarded as a first set of images. After capturing the first set of images, the camera control unit 48 continues to control the component recognition camera 28 until three consecutive sets of images, including the first set, are captured.
[0064] 9, through this imaging control, the camera control unit 48 acquires a second reflected image R2 at timing T3 and a second transmitted image S2 at timing T4 in the second set. Also, the camera control unit 48 acquires a third reflected image R3 at timing T5 and a third transmitted image S3 at timing T6 in the third set.
[0065] 8, when the imaging processing unit 47 of the control unit 40 determines that the counter n is 3 (St8, YES), that is, when imaging is completed up to the third set, the camera control unit 48 transmits three consecutive reflected images (specifically, the first reflected image R1, the second reflected image R2, and the third reflected image R3) and three consecutive transmitted images (specifically, the first transmitted image S1, the second transmitted image S2, and the third transmitted image S3) independently to the image synthesis unit 49. The image synthesis unit 49 acquires each of the individually transmitted images, and synthesizes the three consecutive reflected images (specifically, the first reflected image R1, the second reflected image R2, and the third reflected image R3) captured with the illumination turned on in the reflected illumination pattern to generate a first synthesized image U1. Similarly, the image synthesis unit 49 synthesizes three consecutive transmission images (specifically, the first transmission image S1, the second transmission image S2, and the third transmission image S3) captured under illumination in a transmission illumination pattern to generate a second composite image U2 (St10). The image synthesis unit 49 transmits the first composite image U1 and the second composite image U2 to the component recognition unit 50.
[0066] The component recognition unit 50 acquires the first composite image U1 and the second composite image U2 from the image synthesis unit 49, recognizes the polarity of the component P based on the first composite image U1, and recognizes the mold outline of the component P based on the second composite image U2, and transmits the recognition result to the mechanism driving unit 46 (St11). The mechanism driving unit 46 commands the moving head 26 of the head unit 23 to mount the component P at a predetermined position and attitude on the board W based on the recognition result by the component recognition unit 50. The head unit 23 mounts the component P on the board W with the moving head 26 in accordance with the command from the mechanism driving unit 46 (St12). At this time, the head unit 23 has mounted the component P on the board W at the mounting operation position, thereby completing the forward movement in one turn.
[0067] As described above, the component mounting device 1 of embodiment 1 comprises a component recognition camera 28 (an example of an imaging unit) that images the component P held by the moving head 26 (an example of a head) from below, a camera control unit 48 (an example of an imaging control unit) that controls the imaging by the component recognition camera 28 and the lighting pattern by the lighting during imaging, a component recognition unit 50 that recognizes the component P from the image captured by the component recognition camera 28, and a head unit 23 (an example of a component mounting unit) that mounts the component P on the board W by the moving head 26 based on the recognition result by the component recognition unit 50. Furthermore, the camera control unit 48 turns on the illumination with reflected illumination (an example of a first pattern) at a first timing T1 when the component P is moving above the imaging unit and causes the component recognition camera 28 to capture an image, thereby obtaining a reflected image R (an example of a first image), and turns on the illumination with transmitted illumination (an example of a second pattern) at a second timing T2 when the component P is moving above the component recognition camera 28 and causes the component recognition camera 28 to capture an image, thereby obtaining a transmitted image S (an example of a second image). Furthermore, the component recognition unit 50 recognizes the component P based on the reflected image R and the transmitted image S.
[0068] Therefore, the component mounting device 1 can capture images of the component P with multiple illumination patterns and acquire each of the images in just one forward movement of the moving head 26 in one turn. This allows the component mounting device 1 to capture images while appropriately switching between multiple illumination patterns according to the component P, thereby improving the efficiency of recognizing different states or postures of the component P. Furthermore, because the component mounting device 1 acquires the images required for recognizing the component P in just one movement of the moving head 26, it is possible to reduce the time required for recognizing the component P and suppress a decrease in the mounting efficiency of the component P.
[0069] In addition, in the component mounting device 1, the image synthesis unit 49 (an example of an imaging control unit) synthesizes a plurality of reflected images R (an example of a first image) captured by lighting in a reflective lighting pattern (an example of a first pattern) to generate a first synthetic image U1, and synthesizes a plurality of transmitted images S (an example of a second image) captured by lighting in a transmitted lighting pattern (an example of a second pattern) to generate a second synthetic image U2. In addition, the component recognition unit 50 recognizes the component P based on the first synthetic image U1 and the second synthetic image U2. Therefore, the component mounting device 1 does not perform each recognition process of the component P using a plurality of consecutive images individually for each illumination pattern, but synthesizes a plurality of consecutive images into one image before recognizing the component P, and then recognizes the component P for the one image. This allows the component mounting device 1 to shorten the processing time for recognizing the component P and improve the recognition accuracy.
[0070] In addition, in the component mounting device 1, the camera control unit 48 (an example of an imaging control unit) causes the component recognition camera 28 (an example of an imaging unit) to alternately capture the reflected image R (an example of a first image) and the transmitted image S (an example of a second image). Therefore, when the image synthesis unit 49 synthesizes the first composite image U1 and the second composite image U2 based on each of a plurality of consecutive reflected images (specifically, the first reflected image R1, the second reflected image R2, and the third reflected image R3) and a plurality of consecutive transmitted images (specifically, the first transmitted image S1, the second transmitted image S2, and the third transmitted image S3), the image synthesis unit 49 can reduce the difference in the imaging range between the first composite image U1 and the second composite image U2. This allows the component mounting device 1 to suppress a decrease in the accuracy of image synthesis, and as a result, to suppress a total decrease in the recognition accuracy of the component P.
[0071] Furthermore, in the component mounting device 1, the camera control unit 48 (an example of an imaging control unit) performs transmitted illumination to illuminate a reflector arranged above the component P as one of the illumination patterns (an example of a first pattern), and performs reflected illumination to illuminate the underside of the component P as another of the illumination patterns (an example of a second pattern). Here, the reflected image R acquired using reflected illumination is suitable for recognizing the polarity of the component P, and the transmitted image S acquired using transmitted illumination is suitable for recognizing the polarity of the component P. Therefore, when the component recognition unit 50 recognizes the polarity of the component P and further the mold outer shape, it can perform these recognitions comprehensively with high accuracy, thereby further improving the recognition efficiency.
[0072] Moreover, the component mounting apparatus 1 further includes a head unit 23 (an example of a component mounting section) that mounts the component P at a position on the board W corresponding to the component P based on the recognition result of the component P thus recognized. Therefore, in the component mounting apparatus 1, the head unit 23 holds the component P with its moving head 26 and mounts it at a predetermined position on the board W in a state in which the time required for recognizing the component P is shortened, so that the mounting efficiency of the production line can be improved and the productivity of the mounted board production line can be increased.
[0073] Although the embodiments have been described above with reference to the drawings, it goes without saying that the present disclosure is not limited to such examples. It is clear that a person skilled in the art can conceive of various modifications, corrections, substitutions, additions, deletions, and equivalents within the scope of the claims, and it is understood that these also naturally belong to the technical scope of the present disclosure. In addition, the components in the above-mentioned embodiments may be arbitrarily combined within the scope of the invention.
[0074] In addition, the camera control unit 48 (an example of an imaging control unit) performs reflective illumination that illuminates a reflector placed above the component P as one of the illumination patterns (an example of a first pattern), and performs side illumination that illuminates the side of the component P as another of the illumination patterns (an example of a second pattern), but the combination of illumination patterns is not limited to this.
[0075] For example, the camera control unit 48 (an example of an imaging control unit) may be configured to perform side illumination as a first pattern to illuminate the side of the component P, and to perform reflected illumination as a second pattern to illuminate the bottom surface of the component P. This allows the component mounting device 1 to perform recognition of the posture of the component P at the time of pickup and further the polarity of the front and back of the component P comprehensively with high accuracy, thereby further improving the recognition efficiency.
[0076] Furthermore, the camera control unit 48 (an example of an imaging control unit) may be configured to perform, as a first pattern, transillumination that illuminates a reflector arranged above the component P, and to perform, as a second pattern, side illumination that illuminates the side of the component P. This allows the component mounting device 1 to perform recognition of the front and back polarities of the component P and further the mold outer shape of the component P with high overall accuracy, thereby further improving the recognition efficiency. [Industrial Applicability]
[0077] The present disclosure is useful as a component mounting device in a mounting board production line for manufacturing various components by attaching them to a board, which captures images while appropriately switching between multiple lighting patterns depending on the component, thereby improving the efficiency of recognizing different states or postures of the components and suppressing a decrease in component mounting efficiency. [Explanation of symbols]
[0078] 1 Component placement device 10 Main body mechanism section 11 Mounting machine body 12 Foundation 13 Substrate transport mechanism 14 Conveyor section 15 Parts supply mechanism 16 Feeder Base 17 Slots 18 Tape Feeder 19 Feeder Cart 20 Bogie section 21 Reel 22 Carrier Tape 23 Head Unit 24 Y-axis table mechanism 25 X-axis table mechanism 26 Moving Head 27 Part holding nozzle 28 Parts Recognition Camera 29 Image sensor section 30 Case 31 Lighting unit section 33 Reflection lighting section 34 Transillumination unit 35 Side lighting section 36 Circuit Board Recognition Camera 37 Disposal Box 38 Nozzle holder 40 Control section 41 Storage section 42 Implementation Information 43 Parts Information 44 Lighting switching information 45 Imaging timing information 46 Mechanism drive unit 47 Imaging processing section 48 Camera control unit 49 Image synthesis section 50 Parts Recognition Unit B Shielding plate G Transparent glass P parts W substrate
Claims
1. an imaging unit that images the component held by the head from below; an imaging control unit that controls imaging by the imaging unit and an illumination pattern by illumination during imaging; a component recognition unit that recognizes the component from the image captured by the imaging unit; a component mounting unit that mounts the component on a board using the head based on a recognition result by the component recognition unit, the imaging control unit acquires a first image by turning on the illumination in a first pattern at a first timing when the part is moving above the imaging unit and by causing the imaging unit to capture an image, and acquires a second image by turning on the illumination in a second pattern at a second timing when the part is moving above the imaging unit and by causing the imaging unit to capture an image, the component recognition unit recognizes the component based on the first image and the second image; the imaging control unit synthesizes a plurality of consecutive first images captured with the illumination turned on in the first pattern to generate a first composite image including the entire part, and synthesizes a plurality of consecutive second images captured with the illumination turned on in the second pattern to generate a second composite image including the entire part, the component recognition unit recognizes the component based on the first composite image and the second composite image. Parts mounting device.
2. The imaging control unit causes the imaging unit to alternately capture the first image and the second image. R, 2. The component mounting apparatus according to claim 1.
3. The imaging control unit illuminates a reflector disposed above the component as the first pattern. and a second pattern of reflected illumination that illuminates the underside of the component. conduct, 2. The component mounting apparatus according to claim 1.
4. The imaging control unit performs side illumination for illuminating a side of the component as the first pattern. and performing reflected illumination to illuminate the bottom surface of the component as the second pattern.
2. The component mounting apparatus according to claim 1.
5. The imaging control unit illuminates a reflector disposed above the component as the first pattern. and performing side illumination to illuminate the side of the component as the second pattern. conduct, 2. The component mounting apparatus according to claim 1.
6. Based on the result of the component recognition, a component to be mounted at a position on the board corresponding to the component is selected. a mounting portion; 2. The component mounting apparatus according to claim 1.
Citation Information
Patent Citations
Part carrying device and part carrying method
JP1995235800A
Recognition method and device of electronic component
JP1999266100A
Electronic parts recognizer in electronic parts mounter
JP2001094299A
Imaging device, and imaging object moving device with the imaging device
JP2005107716A
Illumination condition specifying method, component recognition device, and surface mounting equipment and component testing device provided the device
JP2005315749A
