Component mounting device and component mounting system
The component mounting apparatus addresses the challenge of varying mounting heights by adjusting image cropping based on component and suction position information, ensuring accurate imaging and reduced data volume, thus enhancing efficiency and storage management.
Patent Information
- Application Number
- JP2023084893
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-23
- Publication Date
- 2024-12-05
AI Technical Summary
Existing component mounting apparatuses struggle to accurately verify the state of imaged components due to variations in mounting height positions caused by board warpage or component type, leading to potential protrusions from cut-out image portions, which complicates data reduction and storage.
A component mounting apparatus that adjusts the position at which a partial image is cut out based on component position, suction position, and height information, using an imaging unit with a diagonally downward optical axis, to ensure accurate inclusion of the imaging target within the captured image, thereby reducing data volume and storage needs.
The apparatus effectively reduces image data volume while ensuring the imaged object is reliably included in the captured image, minimizing additional processing time and storage requirements, and preventing interference with the mounting head's vertical movement.
Smart Images

Figure 2024168328000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to a component mounting apparatus and a component mounting system. [Background technology]
[0002] Component mounting devices are known in the art (see, for example, Patent Document 1).
[0003] The above-mentioned Patent Document 1 discloses a component mounting device that includes a head unit including a mounting head that mounts components on a board, an imaging unit provided in the head unit that captures an image of the area around the mounting position of the component by the mounting head, and a control unit that performs processing to cut out the central portion where the component is mounted from the image captured by the imaging unit. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] JP 2019-161249 A Summary of the Invention [Problem to be solved by the invention]
[0005] In the component mounting device of the above-mentioned Patent Document 1, the control unit performs a process of cutting out the central part where the component is mounted from the captured image captured by the imaging unit. Therefore, it is possible to reduce the amount of data of the captured image, shorten the image transfer time, and suppress the increase in capacity when saving the image. However, when the mounting height position is not constant due to warping of the board on which the component is mounted, or when the top surface height position is not constant depending on the type of component, when the central part of the captured image is cut out, the component may protrude from the cut-out part. In this case, it is difficult to accurately verify the state of the captured component. Therefore, a component mounting device that can reduce the amount of data of the image captured of the target and can reliably include the target in the image captured by the imaging unit is desired.
[0006] The present invention has been made to solve the above-mentioned problems, and one object of the present invention is to provide a component mounting device and a component mounting system that are capable of reducing the amount of data in an image of an object to be imaged, and that are capable of reliably including the object to be imaged in an image captured by an imaging unit. [Means for solving the problem]
[0007] A component mounting device according to a first aspect of the present invention comprises a head unit including a mounting head that mounts components on a substrate, an imaging section provided in the head unit that images at least one of an area around the component pickup position and an area around the mounting position by the mounting head, and a control section that performs control to adjust the position at which a partial image corresponding to an image target is cut out from an image captured by the imaging section based on at least one of information on the component position, height information on the pickup position or the mounting position, and height information on the component.
[0008] In the component mounting device according to the first aspect of the present invention, as described above, a control unit is provided that performs control to adjust the position at which a partial image corresponding to the imaging target is cut out from the captured image captured by the imaging unit based on at least one of the component position information, the height information of the suction position or mounting position, and the height information of the component. As a result, the cut-out position of the partial image is adjusted based on at least one of the height information of the suction position or mounting position, and the height information of the component, so that a partial image at a position where the imaging target is reflected can be cut out with high accuracy from the captured image captured by the imaging unit. As a result, the amount of data of the image captured of the imaging target can be reduced, and the imaging target can be reliably included in the image captured by the imaging unit.
[0009] In the component mounting device according to the first aspect, the imaging unit is preferably configured to image the imaging target in parallel with the component pick-up operation or component mounting operation by the mounting head, and the partial image cut out after the position is adjusted by the control unit is stored in the storage unit. With this configuration, the imaging target is imaged in parallel with the component pick-up operation or component mounting operation by the mounting head, so that it is possible to suppress the need for additional processing time for imaging by the imaging unit. In addition, it is possible to suppress the data amount of the partial image cut out after the position is adjusted from increasing, so that it is possible to suppress the data amount stored in the storage unit from increasing.
[0010] In this case, preferably, the imaging unit is arranged with its optical axis facing diagonally downward, and the control unit is configured to acquire an adjustment amount for the position of the partial image to be cut out based on the positional shift of the imaging target caused by the position on the image shifting at different height positions due to the optical axis of the imaging unit facing diagonally downward. With this configuration, it is possible to easily prevent the imaging unit from interfering with the vertical movement of the mounting head by facing the optical axis of the imaging unit diagonally downward. In addition, since the adjustment amount for the position of the partial image to be cut out can be adjusted based on the positional shift caused by the imaging unit imaging the imaging target from a diagonal direction, the imaging target imaged from a diagonal direction can be reliably included in the partial image.
[0011] In the component mounting device according to the first aspect, preferably, the control unit adjusts the position of the partial image based on at least one of component height information, suction position adjustment information, information on the tape containing the components, information on the feeder feeding the tape containing the components, and height information on the suction position in the captured image captured by the imaging unit around the suction position of the components by the mounting head. With this configuration, by adjusting the position of the partial image based on the component height information, it is possible to adjust the position of the partial image so that the component to be imaged is surely included in the partial image even if the reflected position of the component in the captured image is shifted due to a difference in the height of the component. Furthermore, by adjusting the position of the partial image based on the suction position adjustment information, it is possible to adjust the position of the partial image so that the component to be imaged is surely included in the partial image even if the reflected position of the component in the captured image is shifted due to the adjustment of the suction position to correspond to the shift in the supply position of the component. Furthermore, by adjusting the position of the partial image based on the information on the tape containing the components, it is possible to adjust the position of the partial image so that the component to be imaged is surely included in the partial image according to the difference in height due to the thickness of the tape and the shape of the component storage unit. In addition, by adjusting the position of the partial image based on information about the feeder that feeds the tape that contains the components, the position of the partial image can be adjusted so that the component to be imaged is surely included in the partial image according to the difference in the height position of the components supplied from each feeder. In addition, by adjusting the position of the partial image based on information about the height of the suction position, the position of the partial image can be adjusted so that the component to be imaged is surely included in the partial image even if the reflected position of the component in the captured image is shifted due to the difference in the height of the suction position.
[0012] In the component mounting device according to the first aspect, preferably, the control unit adjusts the position of the partial image based on at least one of the component height information, the board reference height information, the mounting position height information, and the component position information in the captured image captured by the imaging unit around the mounting position of the component by the mounting head. With this configuration, by adjusting the position of the partial image based on the component height information, the position of the partial image can be adjusted so that the component to be imaged is surely included in the partial image even if the reflected position of the component in the captured image is shifted due to a difference in the height of the component. Furthermore, by adjusting the position of the partial image based on the board reference height information, the position of the partial image can be adjusted so that the component to be imaged is surely included in the partial image even if the reflected position of the component in the captured image is shifted due to a difference in the board reference height. Furthermore, by adjusting the position of the partial image based on the mounting position height information, the position of the partial image can be adjusted so that the component to be imaged is surely included in the partial image even if the reflected position of the component in the captured image is shifted due to a difference in the height of the mounting position. Furthermore, by adjusting the position of the partial image based on information about the component position, even if the reflected position of the component in the captured image shifts due to a shift from the center of the component pickup position by the mounting head, the position of the partial image can be adjusted so that the component being imaged is reliably contained in the partial image.
[0013] In this case, the control unit is preferably configured to obtain component position information including the amount of deviation of the component pickup position based on the result of recognizing the picked-up component, and to obtain an adjustment amount for the position of cutting out the partial image based on the amount of deviation of the component pickup position. With this configuration, even if the reflected position of the component in the captured image is shifted due to the amount of deviation of the component pickup position by the mounting head, the position of the partial image can be easily adjusted so that the component to be imaged is reliably included in the partial image.
[0014] In the component mounting device according to the first aspect, the control unit preferably includes an image processing unit that processes the image captured by the imaging unit, and performs processing to cut out a partial image by the image processing unit or the imaging unit. With this configuration, since the partial image is cut out in the imaging processing, it is possible to perform imaging with a small imaging range.
[0015] In this case, preferably, the image processing unit of the control unit transmits the adjusted position of the partial image to the imaging unit and causes the imaging unit to capture the partial image. With this configuration, the partial image can be easily captured by the imaging unit so that the imaging target is reflected in the partial image based on the position information transmitted by the image processing unit.
[0016] In the above-mentioned configuration in which the image processing unit transmits the adjusted positions of the partial images to the imaging unit, the control unit preferably transmits the adjusted positions of the partial images to the imaging unit all at once for one cycle when the adjusted positions of the partial images can be obtained in advance before the start of the cycle of the component pickup operation and the component mounting operation, and transmits the adjusted positions of the partial images to the imaging unit for each component pickup operation and component mounting operation when the adjusted positions of the partial images can be obtained immediately before the component pickup operation and the component mounting operation. With this configuration, before imaging multiple imaging targets, information on the positions for cutting out the partial images is transmitted all at once for one cycle to the imaging unit, so there is no need to transmit and receive information for each imaging. This allows the imaging process to be performed smoothly.
[0017] In the component mounting device according to the first aspect, the control unit preferably acquires component position information, height information of the suction position or mounting position, and component height information collectively in advance by measurement. With this configuration, component position information, height information of the suction position or mounting position, and component height information that need to be acquired by measurement are acquired collectively in advance, so that the process for acquiring information can be prevented from becoming complicated.
[0018] A component mounting system according to a second aspect of the present invention comprises a component mounting device including a head unit including a mounting head that mounts components on a substrate, an imaging unit provided in the head unit that images at least one of an area around the component pickup position and an area around the mounting position by the mounting head, and a control unit that performs control to adjust the position at which a partial image corresponding to an image target is cut out from an image captured by the imaging unit based on at least one of information on the component position, height information on the pickup position or the mounting position, and height information on the component, and a memory unit that stores the partial image whose position has been adjusted by the control unit and cut out.
[0019] In the component mounting system according to the second aspect of the present invention, as described above, a control unit is provided that performs control to adjust the position at which a partial image corresponding to the imaging target is cut out from the captured image captured by the imaging unit based on at least one of the component position information, the height information of the pickup position or mounting position, and the height information of the component. As a result, the cut-out position of the partial image is adjusted based on at least one of the height information of the pickup position or mounting position, and the height information of the component, so that a partial image at a position where the imaging target is reflected can be cut out with high accuracy from the captured image captured by the imaging unit. As a result, it is possible to provide a component mounting system that can reduce the amount of data of an image captured of the imaging target and can reliably include the imaging target in the image captured by the imaging unit. Effect of the Invention
[0020] According to the present invention, as described above, it is possible to reduce the amount of data of an image of an imaging target, and to reliably include the imaging target in the image captured by the imaging section. [Brief description of the drawings]
[0021] [Figure 1] 1 is a diagram showing an overall configuration of a component mounting apparatus according to an embodiment of the present invention; [Diagram 2] 2 is a front view showing a head unit of the component mounting apparatus according to the embodiment of the present invention. FIG. [Diagram 3]FIG. 2 is a block diagram showing a control configuration of the component mounting apparatus according to the embodiment of the present invention. [Figure 4] 5A and 5B are diagrams for explaining partial images cut out by an imaging section according to an embodiment of the present invention. [Diagram 5] 13A and 13B are diagrams for explaining a shift according to center position adjustment information when a component is picked up according to an embodiment of the present invention. [Figure 6] 11A and 11B are diagrams for explaining a shift in response to tape type, tape thickness, and component height information when a component is picked up according to an embodiment of the present invention. [Figure 7] 11A and 11B are diagrams for explaining a shift according to a height position of a component when the component is picked up according to an embodiment of the present invention. [Figure 8] 13A and 13B are diagrams for explaining adjustment of the cut-out range according to the height position when a component supplied from a paper tape is picked up in an embodiment of the present invention. [Figure 9] 13A and 13B are diagrams for explaining adjustment of the cut-out range according to the height position when a component supplied from an embossed tape is picked up according to an embodiment of the present invention. [Figure 10] 11A and 11B are diagrams showing examples of image cut-out ranges during component pickup according to an embodiment of the present invention. [Figure 11] 11A and 11B are diagrams for explaining a shift according to pickup position information when mounting components according to an embodiment of the present invention. [Figure 12] 13A and 13B are diagrams for explaining adjustment of a cut-out range in accordance with a pickup position during component mounting according to an embodiment of the present invention. [Figure 13] 11A and 11B are diagrams for explaining a shift according to board height information when mounting a component according to an embodiment of the present invention. [Figure 14] 13A and 13B are diagrams for explaining adjustment of the cut-out range according to the mounting height position when a component is mounted according to an embodiment of the present invention. [Figure 15] FIG. 13 is a diagram showing an example of an image cut-out range during component mounting according to the embodiment of the present invention. [Figure 16] 4 is a flow diagram for explaining a component mounting process by a control unit of the component mounting apparatus according to the embodiment of the present invention. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0022] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings.
[0023] (Configuration of component mounting equipment) The configuration of a component mounting apparatus 100 according to an embodiment of the present invention will be described with reference to Fig. 1. The component mounting apparatus 100 is provided in a component mounting system 300 including an external server 200. The external server 200 is an example of a "storage unit" in the claims.
[0024] As shown in FIG. 1, component mounting apparatus 100 is a component mounting apparatus that transports a board P in the X direction by a pair of conveyors 2 and mounts components 31 on board P at a mounting position M.
[0025] The component mounting apparatus 100 includes a base 1, a pair of conveyors 2, a component supply section 3, a head unit 4, a support section 5, a pair of rail sections 6, a component recognition camera 7, an imaging section 8, and a control section 9.
[0026] The pair of conveyors 2 are installed on a base 1 and configured to transport the substrate P in the X direction. The pair of conveyors 2 are provided with a holding mechanism that holds the substrate P during transportation in a stopped state at the mounting work position M. The pair of conveyors 2 are also configured so that the distance in the Y direction can be adjusted to match the dimensions of the substrate P.
[0027] The component supply unit 3 is disposed on the outer sides (Y1 side and Y2 side) of the pair of conveyors 2. A plurality of tape feeders 3a are also disposed in the component supply unit 3. The component supply unit 3 is configured to supply components 31 to a mounting head 42, which will be described later.
[0028] The tape feeder 3a holds a reel (not shown) around which a tape 32 is wound, holding a plurality of components 31 at predetermined intervals. The tape feeder 3a is configured to feed the tape 32 holding the components 31 to rotate the reel and supply the components 31 from the tip of the tape feeder 3a. Here, the components 31 include electronic components such as ICs, transistors, capacitors, and resistors.
[0029] The head unit 4 is positioned above the pair of conveyors 2 and the component supply section 3, and includes multiple mounting heads 42 with nozzles 41 (see Figure 2) attached to their lower ends, a board recognition camera 43, and a height measurement sensor 44.
[0030] The mounting head 42 is configured to mount the components 31 on the board P. Specifically, the mounting head 42 is configured to pick up the components 31 supplied by the component supply unit 3, and mount the picked up components 31 on the board P arranged at the mounting work position M. The mounting head 42 is configured to be movable up and down (movable in the Z direction), and is configured to pick up and hold the components 31 supplied from the tape feeder 3a by a negative pressure generated at the tip of the nozzle 41 by a negative pressure generator (not shown), and mount (mount) the components 31 at the mounting position on the board P. The multiple mounting heads 42 are provided in an annular shape on the head unit 4 so as to be rotatable around a vertical axis of rotation.
[0031] The board recognition camera 43 is configured to capture an image of the fiducial mark F of the board P in order to recognize the position and posture of the board P. Then, by capturing an image of the position of the fiducial mark F and recognizing it, it is possible to accurately obtain the mounting position of the component 31 on the board P.
[0032] The height measuring sensor 44 measures the height position of the upper surface of the board P and the height position of the component supply unit 3. For example, the height measuring sensor 44 measures the height in a non-contact manner. The height measuring sensor 44 includes, for example, a laser distance measuring device.
[0033] The support portion 5 includes a motor 51. The support portion 5 is configured to move the head unit 4 in the X direction along the support portion 5 by driving the motor 51. The support portion 5 is supported at both ends by a pair of rail portions 6.
[0034] The pair of rail portions 6 are fixed onto the base 1. The rail portion 6 on the X1 side includes a motor 61. The rail portion 6 is configured to move the support portion 5 in a Y direction perpendicular to the X direction along the pair of rail portions 6 by driving the motor 61. The head unit 4 is movable in the X direction along the support portion 5, and the support portion 5 is movable in the Y direction along the rail portions 6, so that the head unit 4 is movable in the horizontal direction (XY direction).
[0035] The component recognition camera 7 is fixed on the upper surface of the base 1. The component recognition camera 7 is disposed on the outer side (Y1 side and Y2 side) of the pair of conveyors 2. The component recognition camera 7 is configured to capture an image of the component 31 picked up by the nozzle 41 of the mounting head 42 from the lower side (Z2 side) in order to recognize the suction state (suction posture) of the component 31 prior to mounting the component 31. This allows the control unit 9 to acquire the suction state of the component 31 picked up by the nozzle 41 of the mounting head 42.
[0036] The imaging unit 8 is provided on the head unit 4. As a result, the imaging unit 8 is configured to move in the horizontal direction (XY direction) together with the head unit 4 by the movement of the head unit 4 in the XY direction. A pair of imaging units 8 is provided for the head unit 4. The imaging unit 8 captures at least one of the periphery of the pickup position and the periphery of the mounting position of the component 31 by the mounting head 42. The imaging unit 8 is also arranged with its optical axis facing diagonally downward as shown in FIG. 2. That is, the imaging unit 8 can capture an image of the position below the mounting head 42 that has been rotated to a lifting position where the component can be picked up and mounted, from an oblique angle. For example, the mounting head 42 can be lifted and lowered at each of the positions at both ends in the X direction. A pair of imaging units 8 are provided so as to capture the lower part of the mounting head 42 at the X1 direction end in the X direction and the lower part of the mounting head 42 at the X2 direction end in the X direction. The imaging units 8 are also offset from the mounting head 42 so as not to interfere with the vertical movement of the mounting head 42. Moreover, the imaging unit 8 is configured to be able to image the position to which the mounting head 42 descends, without moving the head unit 4. For example, the imaging unit 8 is disposed so that the imaging center is at the position of the descending tip of the mounting head 42 at the reference height position.
[0037] The imaging unit 8 captures an image of an imaging target in parallel with the pickup operation of the component 31 by the mounting head 42 or the mounting operation of the component 31. The imaging target of the imaging unit 8 includes the component 31 to be mounted and its periphery, and the component 31 to be picked up and its periphery. The imaging unit 8 includes an imaging sensor, and is capable of not only capturing an image using all pixels of the entire imaging element, but also performing imaging processing at high speed with the imaging area reduced. As shown in FIG. 4, the imaging unit 8 is capable of cutting out a partial image (ROI image) of a region required for the image to be output from the entire image captured by the imaging sensor. The imaging unit 8 cuts out the partial image based on information on the start point (ROI start point (x0, y0)) of the partial image (ROI image) and the ROI size (xR and yR).
[0038] 3, the control unit 9 includes an apparatus control unit 91 and an image reception processing unit 81. The apparatus control unit 91 includes a CPU, and is configured to control the overall operation of the component mounting apparatus 100, such as the transport operation of the board P by the pair of conveyors 2, the mounting operation by the head unit 4, the imaging operation by the component recognition camera 7, the imaging unit 8 and the board recognition camera 43, and the height measurement operation by the height measurement sensor 44. The image reception processing unit 81 is an example of the "image processing unit" in the claims.
[0039] The device control unit 91 includes an image receiving unit 92, a storage processing unit 93, a data management unit 94, and a sensor / camera control unit 97. The image receiving unit 92 receives an image captured by the imaging unit 8 via the image reception processing unit 81. The storage processing unit 93 performs a storage process for storing the image received by the image receiving unit 92 in the external server 200. The data management unit 94 manages board / component data 95 and adjustment information data 96. The board / component data 95 and adjustment information data 96 are information registered or acquired in advance. The sensor / camera control unit 97 controls each of the height measurement sensor 44, the component recognition camera 7, and the board recognition camera 43. The sensor / camera control unit 97 acquires measurement system data captured and measured by the height measurement sensor 44, the component recognition camera 7, or the board recognition camera 43.
[0040] The image reception processing unit 81 includes a communication data control unit 82, a size determination unit 83, and a shift amount determination unit 84. The communication data control unit 82 controls the transmission of data of an image captured by the imaging unit 8 to the device control unit 91. The communication data control unit 82 also controls the imaging operation by the imaging unit 8. The size determination unit 83 determines the size of the range captured by the imaging unit 8. The shift amount determination unit 84 determines the shift amount of the range captured by the imaging unit 8 (the movement amount of the ROI).
[0041] Here, in this embodiment, the control unit 9 performs control to adjust the position at which a partial image corresponding to an imaging target is cut out from the captured image captured by the imaging unit 8 based on at least one of the information on the component position, the height information on the pickup position or mounting position, and the height information on the component. The partial image whose position is adjusted and cut out by the control unit 9 is configured to be stored in the external server 200. That is, an image recording the state of the pickup operation or mounting operation of the component 31 is stored and accumulated in the external server 200. The image data accumulated in the external server 200 can be used when a malfunction occurs or for statistics. The image data may be stored and accumulated in the storage unit of the component mounting device 100.
[0042] Then, a process of cutting out the partial image whose cut-out position has been adjusted is performed by the image reception processing unit 81 or the imaging unit 8. That is, the image reception processing unit 81 of the control unit 9 transmits the adjusted position of the partial image to the imaging unit 8, and causes the imaging unit 8 to capture the partial image.
[0043] In addition, the control unit 9 is configured to obtain an adjustment amount for the position from which the partial image is cut out based on the positional shift of the imaging target caused by the shift in the position on the image at different height positions due to the optical axis of the imaging unit 8 facing diagonally downward.
[0044] In addition, the control unit 9 adjusts the position of the partial image based on at least one of the height information of the component, the adjustment information of the suction position, the information of the tape containing the component 31, the information of the feeder that feeds the tape 32 containing the component 31, and the height information of the suction position in the captured image captured by the imaging unit 8 around the suction position of the component 31 by the mounting head 42.
[0045] Here, when the mounting head 42 picks up the component 31, it is possible to more accurately calculate the component center position in the image by using the pickup center position adjustment information. As shown in Fig. 5, when the center position adjustment information is used, the horizontal position of the component 31 differs, so the position of the component 31 in the image shifts in the left-right direction (x direction) and the up-down direction (y direction) of the image. Also, as shown in Fig. 6, when the tape type, tape thickness, and component height information is used, the height position of the component 31 differs, so the position of the component 31 in the image shifts in the left-right direction (x direction) of the image.
[0046] 7, when the pickup height position of component 31 deviates from the reference height, the position in the image of imaging unit 8, which captures an image from an oblique direction, shifts. For example, when the optical axis of imaging unit 8 has an angle θ with respect to the horizontal direction and the difference from the reference height is Δza, the amount of positional deviation Δxa in the left-right direction (x direction) in the image is calculated by Δxa=Δza / tan θ. Note that when the difference from the reference height is a positive value upward and a negative value downward, the amount of positional deviation in the left-right direction (x direction) in the image is a positive value in the right direction and a negative value in the left direction.
[0047] As shown in FIG. 8, when components 31 are supplied from paper tape 32, the height of the supply position (suction position) of components 31 changes depending on the thickness of tape 32. When the tape thickness in FIG. 8(A) is standard, there is no need to shift the position from which the image is cut out. When the tape thickness in FIG. 8(B) is thick, the supply position of components 31 shifts upward, so the position from which the partial image is cut out is shifted to the left (the direction opposite to the imaging unit 8 side with respect to mounting head 42) by Δxa. When the tape thickness in FIG. 8(C) is thin, the supply position of components 31 shifts downward, so the position from which the partial image is cut out is shifted to the right (the direction toward the imaging unit 8 side with respect to mounting head 42) by Δxa.
[0048] As shown in FIG. 9, when components 31 are supplied from an embossed tape, the height of the supply position (suction position) of components 31 changes depending on the thickness of tape 32 (depth of the storage section). When the tape thickness in FIG. 9(A) is standard thickness, there is no need to shift the position from which the image is cut out. When the tape thickness in FIG. 9(B) is thick (the storage section is shallow), the supply position of components 31 shifts upward, so the position from which the partial image is cut out is shifted leftward (in the direction opposite to the imaging unit 8 side with respect to the mounting head 42) by Δxa. When the tape thickness in FIG. 9(C) is thin (the storage section is deep), the supply position of components 31 shifts downward, so the position from which the partial image is cut out is shifted rightward (in the direction toward the imaging unit 8 side with respect to the mounting head 42) by Δxa.
[0049] 10, it is possible to extract an appropriate ROI (partial image) by determining the pickup position of component 31 based on component height information, pickup position adjustment information, information on the tape containing component 31, information on the feeder that feeds tape 32 containing component 31, and pickup position height information. On the other hand, if consideration is not given to the effect of the pickup position height or to the XY position effect, an inappropriate ROI (partial image) will be extracted.
[0050] Height information of the components, information about the tape containing the components 31, and information about the feeder that feeds the tape 32 containing the components 31 are obtained from board / component data 95 (see FIG. 3). Pickup position information of the components 31 is obtained from adjustment information data 96 (see FIG. 3). Adjustment information of the pickup position is obtained by capturing an image of the component supply position with the board recognition camera 43. Height information of the pickup position is obtained by measuring the height of the pickup position with the height measurement sensor 44.
[0051] In addition, the control unit 9 adjusts the position of the partial image based on at least one of the component height information, the reference height information of the board, the height information of the mounting position, and the component position information in the captured image captured by the imaging unit 8 around the mounting position of the component 31 by the mounting head 42.
[0052] In addition, the control unit 9 is configured to obtain information on the position of the component 31, including the amount of deviation of the pickup position of the component 31, based on the result of recognizing the picked-up component 31, and to obtain an adjustment amount for the position to cut out the partial image, based on the amount of deviation of the pickup position of the component 31.
[0053] 11, in accordance with the pickup position information, the horizontal position of the component 31 differs, and therefore the position of the component 31 in the image shifts in the left-right direction (x direction) and the up-down direction (y direction) of the image. That is, the horizontal position of the component 31 with respect to the imaging unit 8 changes between when the mounting head 42 picks up the center of the component 31 and performs a mounting operation and when the mounting head 42 picks up a position away from the center of the component 31 and performs a mounting operation. Therefore, the position from which the ROI (partial image) is cut out is shifted based on the pickup position by the mounting head 42.
[0054] As shown in Fig. 12(A), when the mounting head 42 picks up the center position of the component 31, there is no need to shift the position from which the image is cut out. As shown in Fig. 12(B), when the mounting head 42 picks up a position away from the center position of the component 31, the horizontal position of the component 31 during mounting shifts relative to the imaging unit 8, so the position from which the partial image is cut out is shifted by Δxb in the horizontal direction in which the component 31 has shifted. Similarly, in the y direction, the position from which the partial image is cut out is shifted by the amount by which the component 31 has shifted.
[0055] As shown in FIG. 13, when the board height information is used, the mounting height position of the component 31 differs, so that the position of the component 31 in the image shifts in the left-right direction (x direction) of the image.
[0056] As shown in Fig. 14(A), when the height of the mounting position on the board P is the standard height position, there is no need to shift the position from which the image is cut out. As shown in Fig. 14(B), when the height of the mounting position on the board P is the standard height position, the mounting position of the component 31 shifts in the vertical direction, so the position from which the partial image is cut out is shifted in the horizontal direction by Δxa.
[0057] 15, it is possible to extract an appropriate ROI (partial image) based on component height information, board reference height information, mounting position height information, and component position information. On the other hand, if consideration is not given to the effect of the mounting position height or to the XY position effect, an inappropriate ROI (partial image) will be extracted.
[0058] Component height information and component size information are obtained from board / component data 95 (see FIG. 3). Board reference height information is obtained from adjustment information data 96 (see FIG. 3). Component position information is obtained by capturing an image of the suction state of component 31 with component recognition camera 7. Mounting position height information is obtained by measuring the height and warpage of board P with height measurement sensor 44.
[0059] In addition, when the control unit 9 can obtain the position of the adjusted partial image in advance before the start of the cycle of the pickup operation of the component 31 and the mounting operation of the component 31, it transmits one cycle's worth of images to the imaging unit 8 all at once, and when the control unit 9 can obtain the position of the adjusted partial image just before the pickup operation of the component 31 and the mounting operation of the component 31, it transmits the position of the adjusted partial image to the imaging unit 8 for each pickup operation of the component 31 and each mounting operation of the component 31.
[0060] Furthermore, the control unit 9 acquires component position information, height information of the pickup position or mounting position, and component height information collectively in advance by measurement.
[0061] (Component mounting processing) Next, the component mounting process performed by the control unit 9 will be described with reference to FIG.
[0062] In step S1 of Fig. 16, the control unit 9 reads the board data. This allows the information (start point, size) of the partial image (ROI) to be acquired. For example, the ROI size (xR, yR) = (x, y), and the ROI start point (x0, y0) = (ax / 2, by / 2) (where (a, b) are the image center) are acquired. In step S2, the control unit 9 judges whether or not to use advance data. Advance data is information that has been prepared in advance, such as machine settings and board data. If it is to be used, proceed to step S3, and if it is not to be used, proceed to step S5.
[0063] In step S3, the control unit 9 determines the correction value of the ROI as the advance data. That is, the size of the partial image (ROI) is corrected for each component 31 to be mounted. Specifically, for a large component, the ROI size is corrected to a large size, and for a small component, the ROI size is corrected to a small size. First, the ROI size is corrected according to the size of the component 31 from the component size information of the board data. For example, the ROI size is corrected as (xR, yR)=(xx, yy), and the ROI start point (x0, y0)=(a-xx / 2, b-yy / 2). Next, adjustment data is read from the machine setting and the ROI center is corrected. For example, the ROI size is corrected as (xR, yR)=(xx, yy), and the ROI start point (x0, y0)=(a+Δx1-xx / 2, b+Δy1-yy / 2). Then, the board data is read and the ROI center is corrected. For example, the ROI size is corrected as (xR, yR) = (xx, yy), and the ROI start point is corrected as (x0, y0) = (a + Δx1 + Δx2 - xx / 2, b + Δy1 + Δy2 - yy / 2).
[0064] In step S4, the control unit 9 registers the correction value of the ROI as advance data. For example, the ROI size is corrected as (xR, yR)=(xx, yy), and the ROI start point is corrected as (x0, y0)=(aa-xx / 2, bb-yy / 2) (where (aa, bb) are the center of the image after correction). In addition, the correction value for one adsorption cycle is registered by communicating with the imaging unit 8.
[0065] In step S5, the control unit 9 determines whether or not to use the previously acquired measurement data. If it is to be used, the process proceeds to step S6, and if it is not to be used, the process proceeds to step S9.
[0066] In step S6, the control unit 9 measures correction data for the pickup operation or the mounting operation as measurement system data, for example, by measuring the pickup height position and the mounting height position to obtain the correction data.
[0067] In step S7, the control unit 9 determines a correction value for the center of the ROI based on the measurement data. For example, the ROI size is corrected as (xR, yR)=(xx, yy), and the ROI start point is corrected as (x0, y0)=(aa+Δx3-xx / 2, bb+Δy3-yy / 2).
[0068] In step S8, the control unit 9 registers the correction value of the ROI as the measurement data. For example, the ROI size is corrected as (xR, yR)=(xx, yy), and the ROI start point is corrected as (x0, y0)=(aaa-xx / 2, bbb-yy / 2) (where (aaa, bbb) is the center of the image after correction).
[0069] In step S9, the control unit 9 starts a suction / attachment cycle. In step S10, the control unit 9 judges whether or not to use the measurement data acquired immediately before. For example, the measurement data acquired immediately before is component position information in the suction operation (information on the component position in the pocket) and the component recognition result in the mounting operation. If it is to be used, the process proceeds to step S11, and if it is not to be used, the process proceeds to step S14.
[0070] In step S11, the control unit 9 measures correction data in the pickup operation or the mounting operation as measurement system data.
[0071] In step S12, the control unit 9 determines a correction value for the center of the ROI based on the measurement data. For example, the ROI size is corrected as (xR, yR)=(xx, yy), and the ROI start point is corrected as (x0, y0)=(aaa+Δx4-xx / 2, bbb+Δy4-yy / 2).
[0072] In step S13, the control unit 9 registers the correction value of the ROI as the measurement data. For example, the ROI size is corrected as (xR, yR)=(xx, yy), and the ROI start point is corrected as (x0, y0)=(aaaa-xx / 2, bbbb-yy / 2) (where (aaaa, bbbb) are the center of the image after correction).
[0073] In step S14, the control unit 9 captures an image of the suction point or attachment point based on the determined size and position of the ROI using the imaging unit 8. The processes of steps S9 to S15 are repeated until the suction / attachment cycle is completed.
[0074] In step S16, the control unit 9 judges whether or not the mounting operation of the components 31 on the board P is completed. If completed, the component mounting process is terminated. If not completed, the process returns to step S2.
[0075] (Effects of the embodiment) In this embodiment, the following effects can be obtained.
[0076] In this embodiment, as described above, a control unit 9 is provided that performs control to adjust the position at which a partial image corresponding to the imaging target is cut out from the captured image captured by the imaging unit 8 based on at least one of the component position information, the height information of the pickup position or mounting position, and the height information of the component. As a result, the cut-out position of the partial image is adjusted based on at least one of the height information of the pickup position or mounting position, and the height information of the component, so that a partial image at a position where the imaging target is reflected can be cut out with high accuracy from the captured image captured by the imaging unit 8. As a result, it is possible to reduce the amount of data of the image captured of the imaging target, and it is possible to reliably include the imaging target in the image captured by the imaging unit 8.
[0077] In the present embodiment, as described above, the imaging unit 8 images the imaging target in parallel with the suction operation of the component 31 by the mounting head 42 or the mounting operation of the component 31. The partial image cut out after the position is adjusted by the control unit 9 is configured to be stored in the external server 200. This makes it possible to prevent the imaging target from being imaged in parallel with the suction operation of the component 31 by the mounting head 42 or the mounting operation of the component 31, thereby preventing the need for additional processing time for imaging by the imaging unit 8. Also, since it is possible to prevent the amount of data of the partial image cut out after the position is adjusted from increasing, it is possible to prevent the amount of data stored in the external server 200 from increasing.
[0078] In addition, in this embodiment, as described above, the imaging unit 8 is disposed with its optical axis facing diagonally downward, and the control unit 9 is configured to acquire an adjustment amount of the position for cutting out the partial image based on the positional shift of the imaging target caused by the position on the image shifting at different height positions due to the optical axis of the imaging unit 8 facing diagonally downward. In this way, by facing the optical axis of the imaging unit 8 diagonally downward, it is possible to easily suppress the imaging unit 8 from interfering with the vertical movement of the mounting head 42. In addition, since the adjustment amount of the position for cutting out the partial image can be adjusted based on the positional shift caused by the imaging unit 8 imaging the imaging target from a diagonal direction, it is possible to reliably include the imaging target imaged from a diagonal direction in the partial image.
[0079] In the present embodiment, as described above, the control unit 9 adjusts the position of the partial image based on at least one of the component height information, the suction position adjustment information, the information of the tape containing the component 31, the information of the feeder feeding the tape 32 containing the component 31, and the height information of the suction position in the captured image captured by the imaging unit 8 around the suction position of the component 31 by the mounting head 42. By adjusting the position of the partial image based on the component height information, the position of the partial image can be adjusted so that the component 31 to be imaged is surely included in the partial image even if the reflected position of the component 31 in the captured image is shifted due to a difference in the height of the component 31. In addition, by adjusting the position of the partial image based on the suction position adjustment information, the position of the partial image can be adjusted so that the component 31 to be imaged is surely included in the partial image even if the reflected position of the component 31 in the captured image is shifted due to the adjustment of the suction position to correspond to the shift in the supply position of the component 31. In addition, by adjusting the position of the partial image based on information about the tape containing the components 31, the position of the partial image can be adjusted so that the components 31 to be imaged are surely included in the partial image in accordance with the difference in height caused by the thickness of the tape 32 and the shape of the component storage section. In addition, by adjusting the position of the partial image based on information about the feeder that feeds the tape 32 containing the components 31, the position of the partial image can be adjusted so that the components 31 to be imaged are surely included in the partial image in accordance with the difference in the supply height position of the components 31 for each feeder. In addition, by adjusting the position of the partial image based on information about the height of the suction position, the position of the partial image can be adjusted so that the components 31 to be imaged are surely included in the partial image even if the reflected position of the components 31 in the captured image is shifted due to the difference in the height of the suction position.
[0080] In the present embodiment, as described above, the control unit 9 adjusts the position of the partial image based on at least one of the height information of the component, the reference height information of the board, the height information of the mounting position, and the information of the component position in the captured image captured by the imaging unit 8 around the mounting position of the component 31 by the mounting head 42. As a result, by adjusting the position of the partial image based on the height information of the component, the position of the partial image can be adjusted so that the component 31 to be imaged is surely included in the partial image even if the reflected position of the component 31 in the captured image is shifted due to a difference in the height of the component 31. Also, by adjusting the position of the partial image based on the reference height information of the board P, the position of the partial image can be adjusted so that the component 31 to be imaged is surely included in the partial image even if the reflected position of the component 31 in the captured image is shifted due to a difference in the reference height of the board P. Also, by adjusting the position of the partial image based on the height information of the mounting position, the position of the partial image can be adjusted so that the component 31 to be imaged is surely included in the partial image even if the reflected position of the component in the captured image is shifted due to a difference in the height position of the mounting position. Furthermore, by adjusting the position of the partial image based on information about the component position, even if the reflected position of the component 31 in the captured image shifts due to a shift from the center of the pickup position of the component 31 by the mounting head 42, the position of the partial image can be adjusted so that the component 31 to be captured is reliably included in the partial image.
[0081] Furthermore, in this embodiment, as described above, the control unit 9 is configured to obtain component position information including the amount of deviation of the pickup position of the component 31 based on the result of recognizing the picked-up component 31, and to obtain an adjustment amount for the position to cut out the partial image based on the amount of deviation of the pickup position of the component 31. This makes it possible to easily adjust the position of the partial image so that the component 31 to be imaged is reliably included in the partial image, even if the reflected position of the component 31 in the captured image is shifted due to the amount of deviation of the pickup position of the component 31 by the mounting head 42.
[0082] Furthermore, in this embodiment, as described above, the control unit 9 includes the image reception processing unit 81 that processes the image captured by the imaging unit 8, and performs processing to cut out a partial image by the image reception processing unit 81 or the imaging unit 8. As a result, a partial image is cut out in the imaging process, so that imaging can be performed with a smaller imaging range.
[0083] Furthermore, in this embodiment, as described above, the image reception processing unit 81 of the control unit 9 transmits the adjusted position of the partial image to the imaging unit 8, and causes the imaging unit 8 to capture the partial image. This allows the imaging unit 8 to easily capture the partial image so that the imaging target is reflected in it, based on the position information transmitted by the image reception processing unit 81.
[0084] Furthermore, in this embodiment, as described above, when the adjusted positions of the partial images can be obtained in advance before the start of a cycle of the pickup operation of component 31 and the mounting operation of component 31, control unit 9 transmits the positions of the partial images for one cycle to imaging unit 8 in a lump, and when the adjusted positions of the partial images can be obtained immediately before the pickup operation of component 31 and the mounting operation of component 31, control unit 9 transmits the positions of the partial images for each pickup operation of component 31 and the mounting operation of component 31 to imaging unit 8. As a result, before imaging multiple imaging targets, position information for cutting out partial images is transmitted in a lump to imaging unit 8 in a lump for one cycle, eliminating the need to transmit and receive information for each imaging. This allows imaging processing to be performed smoothly.
[0085] In this embodiment, as described above, the control unit 9 acquires component position information, pickup position or mounting position height information, and component height information collectively in advance by measurement. This makes it possible to prevent the process for acquiring information from becoming complicated, since component position information, pickup position or mounting position height information, and component height information that need to be acquired by measurement are acquired collectively in advance.
[0086] (Modification) The embodiments disclosed herein should be considered to be illustrative and not restrictive in all respects. The scope of the present invention is indicated by the claims, not by the description of the embodiments above, and further includes all modifications (variations) within the meaning and scope of the claims.
[0087] For example, in the above embodiment, a pair of imaging units are provided to capture an image of the periphery of the pickup position or the periphery of the mounting position, but the present invention is not limited to this. In the present invention, one or three or more imaging units may be provided to capture an image of the periphery of the pickup position and the periphery of the mounting position.
[0088] In the above embodiment, an example of a configuration in which a plurality of mounting heads are rotatably arranged in a circular ring shape has been shown, but the present invention is not limited to this. In the present invention, a plurality of mounting heads may be arranged in a linear shape. In this case, an imaging unit that images the periphery of the pickup position or the periphery of the mounting position may be provided for each of the plurality of mounting heads, or one imaging unit may be moved to image the periphery of the pickup position or the periphery of the mounting position at a position corresponding to each of the plurality of mounting heads.
[0089] In the above embodiment, the height measurement sensor measures the height of the board and the height of the component pickup position, but the present invention is not limited to this. In the present invention, the height of the board and the height of the component pickup position may be measured by imaging with an imaging unit such as a stereo camera.
[0090] In the above embodiment, the imaging unit is configured to capture images of both the component pickup position and the component mounting position, but the present invention is not limited to this. In the present invention, it is sufficient that the imaging unit is capable of capturing images of at least one of the component pickup position and the component mounting position.
[0091] In the above embodiment, the components held on the tape are supplied to the component supply position, but the present invention is not limited to this. In the present invention, the components placed on a tray or the like may be supplied to the component supply position.
[0092] In the above embodiment, for convenience of explanation, the control process is described using a flow-driven flow in which the control process is performed in order according to the processing flow, but the present invention is not limited to this. In the present invention, the control process may be performed by an event-driven process in which the process is executed on an event-by-event basis. In this case, the control process may be performed completely in an event-driven manner, or may be performed by combining event-driven and flow-driven processes. [Explanation of symbols]
[0093] 4 Head Unit 8. Imaging unit 9. Control Unit 31 parts 42 Mounting head 81 Image receiving processing unit (image processing unit) 100 Component mounting equipment 200 External server (storage unit) 300 Component Mounting System P board
Claims
1. a head unit including a mounting head that mounts components on a substrate; an imaging section provided in the head unit for imaging at least one of an area around a pickup position and an area around a mounting position of the mounting head; and a control unit that performs control to adjust a position at which a partial image corresponding to an imaging target is cut out from an image captured by the imaging unit based on at least one of information on the component position, height information on the suction position or mounting position, and height information on the component.
2. the imaging unit images the imaging target in parallel with a component suction operation or a component mounting operation by the mounting head, The component mounting device according to claim 1 , wherein the partial image cut out after position adjustment by the control unit is stored in a storage unit.
3. The imaging unit is disposed with its optical axis directed obliquely downward, 3. The component mounting device according to claim 2, wherein the control unit is configured to acquire an adjustment amount for a position for cutting out the partial image based on a position shift of the imaging target caused by a shift in the position on the image at different height positions due to an optical axis of the imaging unit facing diagonally downward.
4. 2. The component mounting device according to claim 1, wherein the control unit adjusts the position of the partial image based on at least one of height information of the component, adjustment information of the suction position, information of the tape containing the component, information of a feeder that feeds the tape containing the component, and height information of the suction position in the captured image captured by the imaging unit around the position where the component is suctioned by the mounting head.
5. 2. The component mounting device according to claim 1, wherein the control unit adjusts the position of the partial image based on at least one of component height information, board reference height information, mounting position height information, and component position information in the captured image captured by the imaging unit around the component mounting position by the mounting head.
6. 6. The component mounting device according to claim 5, wherein the control unit is configured to obtain information on the component position including an amount of deviation of the component pickup position based on a result of recognizing the picked-up component, and to obtain an adjustment amount for a position for cutting out the partial image based on the amount of deviation of the component pickup position.
7. The control unit includes an image processing unit that processes an image captured by the imaging unit, The component mounting device according to claim 1 , wherein the image processing unit or the imaging unit performs processing to cut out the partial image.
8. The component mounting device according to claim 7 , wherein the image processing unit of the control unit transmits the adjusted position of the partial image to the imaging unit, and causes the imaging unit to capture the partial image.
9. 9. The component mounting device according to claim 8, wherein the control unit transmits the adjusted partial image to the imaging unit in one cycle at a time when the adjusted position of the partial image can be obtained in advance before the start of a cycle of component pickup operation and component mounting operation, and transmits the adjusted partial image to the imaging unit for each component pickup operation and component mounting operation when the adjusted position of the partial image can be obtained immediately before the component pickup operation and component mounting operation.
10. The component mounting device according to claim 1 , wherein the control unit acquires component position information, height information of the pickup position or mounting position, and height information of the component all together in advance by measurement.
11. a component mounting device including: a head unit including a mounting head that mounts components on a board; an imaging unit provided in the head unit that images at least one of an area around a component pickup position and an area around a mounting position of the component by the mounting head; and a control unit that performs control to adjust a position at which a partial image corresponding to an image pickup target is cut out from an image captured by the imaging unit based on at least one of information on component position, height information on the pickup position or the mounting position, and height information on the component; a storage unit that stores the partial image whose position has been adjusted and cut out by the control unit.
Citation Information
Patent Citations
Image processing device, mounting device, image processing method, and program
JP2019161249A
