Information processing device

The device uses a two-dimensional camera with area-specific thresholds and orientation adjustment to accurately identify and handle components on a stage, addressing overlap issues and preventing nozzle damage.

WO2026239544A1PCT designated stage Publication Date: 2026-11-19FUJI CORP
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
PCT/JP2025/017631
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Filing Date
2025-05-15
Publication Date
2026-11-19

AI Technical Summary

Technical Problem

Existing information processing devices struggle to accurately determine whether components on a stage overlap, particularly when using two-dimensional cameras due to issues with parallax and orientation, leading to improper identification and potential damage to suction nozzles.

Method used

The device employs a two-dimensional camera to image components scattered on a stage, using different thresholds for various areas and a predetermined width determination area around the component outlines to identify overlaps, and adjusts the component orientation before pickup.

Benefits of technology

This approach allows for precise identification and proper handling of components, reducing the risk of misidentification and nozzle damage by accounting for component orientation and parallax effects.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure JP2025017631_19112026_PF_FP_ABST
    Figure JP2025017631_19112026_PF_FP_ABST
Patent Text Reader

Abstract

This information processing device determines, on the basis of whether or not the difference between imaged data of components scattered on a stage and preset model data of the components is greater than or equal to a threshold value, the presence or absence of overlap between the components on the stage. The components are classified into a plurality of areas, and the information processing device determines, by using the threshold value different for each of the plurality of areas, the presence or absence of overlap between the components on the stage.
Need to check novelty before this filing date? Find Prior Art

Description

Information processing device

[0001] This invention relates to an information processing device for processing image data of components placed on a stage.

[0002] The following patent document describes an information processing device for processing image data of parts.

[0003] International Publication No. 2017 / 208325

[0004] The present invention aims to process imaging data of components on a stage to appropriately determine whether or not components overlap on the stage.

[0005] To solve the above problems, this specification discloses an information processing device that determines whether or not there is overlap of parts on a stage based on whether or not the difference between imaging data of parts scattered on a stage and pre-set model data of the parts is greater than or equal to a threshold, wherein the parts are divided into multiple areas, and the information processing device determines whether or not there is overlap of parts on the stage using different thresholds for each of the multiple areas.

[0006] Furthermore, in order to solve the above problems, this specification discloses an information processing device that determines whether or not there is overlap of parts on the stage based on imaging data of a predetermined width determination area surrounding the outline of a part from among the imaging data of parts scattered on the stage.

[0007] In this disclosure, the components are divided into multiple areas, and different thresholds are used for each area to determine whether or not the components overlap on the stage. Furthermore, the presence or absence of component overlap on the stage is determined based on the image data of a predetermined width determination area surrounding the outline of the components, from among the image data of the components scattered on the stage. This makes it possible to appropriately determine whether or not the components overlap on the stage.

[0008] This is a perspective view of a component mounting machine. This is a perspective view of the component mounting device of a component mounting machine. This is a perspective view of a loose component supply device. This is a perspective view of a component supply unit. This is a transparent view of a component supply unit. This is a transparent view of a component supply unit. This is a perspective view of a component scattering device. This is a perspective view of a component scattering device. This is a perspective view of a component holding head. This is a diagram of a component receiving member in which electronic circuit components are stored. This is a block diagram of the control device of a component mounting machine. This is a diagram showing lead components of the same shape scattered on a stage. This is a diagram showing reference data used for pattern matching. This is a schematic diagram of a two-dimensional camera that images multiple lead components placed at different positions on the stage. This is a schematic diagram of a two-dimensional camera that images lead components illuminated by LED lights positioned to the side. This is a schematic diagram of a two-dimensional camera that images lead components illuminated by LED lights positioned to the side. This is a diagram showing lead components placed on the stage in the center, upper left, lower left, lower right, and upper right, each with the leads extending at 0°. This diagram shows leaded components placed on the stage with their leads extending at 90° angles to the center, upper left, lower left, lower right, and upper right. This diagram shows leaded components placed on the stage with their leads extending at 180° angles to the center, upper left, lower left, lower right, and upper right. This diagram shows leaded components placed on the stage with their leads extending at 270° angles to the center, upper left, lower left, lower right, and upper right. This diagram shows images of leaded components divided into 100 areas. This diagram shows a leaded component color map. This diagram shows a stage color map. This diagram explains a method for identifying the outline of leaded components. This diagram explains a method for identifying the outline of leaded components. This diagram shows the overall map data. This diagram shows two-tone leaded components. This diagram shows two-tone leaded components overlapping. This diagram shows two-tone leaded components overlapping. This diagram shows the judgment area of ​​leaded components. This diagram shows the situation in which the judgment area is used to determine component overlap. This diagram shows the judgment area of ​​leaded components. This diagram shows the situation in which the judgment area is used to determine component overlap. This diagram shows how overlapping parts are determined using the judgment area.This diagram shows the classification image. This diagram shows the situation in which the judgment area is divided into multiple classification areas using the classification image. This diagram shows the judgment area divided into multiple classification areas. This diagram shows the judgment area corresponding to the white stage.

[0009] Hereinafter, embodiments of the present invention will be described in detail with reference to the figures, as embodiments for carrying out the present invention.

[0010] Figure 1 shows a component mounting machine 10. The component mounting machine 10 is a device for mounting components onto a circuit board 12. The component mounting machine 10 comprises a main unit 20, a substrate transport and holding device 22, a component mounting device 24, imaging devices 26 and 28, a component supply device 30, a loose component supply device 32, and a control device (see Figure 11) 34. The circuit board 12 can be a circuit board or a three-dimensional structured substrate, and the circuit board can be a printed wiring board or a printed circuit board.

[0011] The main body of the device 20 is composed of a frame 40 and a beam 42 suspended on the frame 40. The substrate transport and holding device 22 is located in the center of the frame 40 in the front-rear direction and has a transport device 50 and a clamping device 52. The transport device 50 is a device for transporting the circuit substrate 12, and the clamping device 52 is a device for holding the circuit substrate 12. As a result, the substrate transport and holding device 22 transports the circuit substrate 12 and also holds the circuit substrate 12 fixedly in a predetermined position. In the following description, the transport direction of the circuit substrate 12 is referred to as the X direction, the horizontal direction perpendicular to that direction is referred to as the Y direction, and the vertical direction is referred to as the Z direction. In other words, the width direction of the component mounting machine 10 is the X direction, and the front-rear direction is the Y direction.

[0012] The component mounting device 24 is mounted on the beam 42 and has two work heads 60 and 62 and a work head moving device 64. Each work head 60 and 62 has a suction nozzle (see Figure 2) 66, which holds the component. The work head moving device 64 also has an X-direction moving device 68, a Y-direction moving device 70, and a Z-direction moving device 72. The X-direction moving device 68 and the Y-direction moving device 70 move the two work heads 60 and 62 together to any position on the frame 40. In addition, as shown in Figure 2, each work head 60 and 62 is detachably mounted on sliders 74 and 76, and the Z-direction moving device 72 moves the sliders 74 and 76 individually in the vertical direction. In other words, the work heads 60 and 62 move individually in the vertical direction by the Z-direction moving device 72.

[0013] The imaging device 26 is mounted on the slider 74 with its orientation facing downwards and moves in the X, Y, and Z directions together with the work head 60. This allows the imaging device 26 to image any position on the frame 40. As shown in Figure 1, the imaging device 28 is positioned with its orientation facing upwards between the substrate transport and holding device 22 and the parts supply device 30 on the frame 40. This allows the imaging device 28 to image the parts held by the suction nozzles 66 of the work heads 60 and 62.

[0014] The parts supply device 30 is located at one end of the frame 40 in the front-rear direction. The parts supply device 30 includes a tray-type parts supply device 78 and a feeder-type parts supply device (not shown). The tray-type parts supply device 78 is a device that supplies parts in a state where they are placed on a tray. The feeder-type parts supply device is a device that supplies parts by tape feeder (not shown) or stick feeder (not shown).

[0015] The loose parts supply device 32 is located at the other end of the frame 40 in the front-rear direction. The loose parts supply device 32 is a device that aligns multiple parts that are scattered loosely and supplies the parts in an aligned state. In other words, it is a device that aligns multiple parts in any orientation to a predetermined orientation and supplies the parts in that predetermined orientation. The configuration of the parts supply device 32 will be described in detail below. The parts supplied by the parts supply device 30 and the loose parts supply device 32 include electronic circuit components, solar cell components, and power module components. Furthermore, electronic circuit components include parts with leads and parts without leads.

[0016] As shown in Figure 3, the loose parts supply device 32 includes a main body 80, a parts supply unit 82, an imaging device 84, and a parts transfer device 86.

[0017] The parts supply unit 82 includes a parts feeder 88, a parts scattering device (see Figure 4) 90, and a parts return device (see Figure 4) 92, with the parts feeder 88, parts scattering device 90, and parts return device 92 being integrally configured. The parts supply unit 82 is detachably mounted to the base 96 of the main body 80, and in the loose parts supply device 32, five parts supply units 82 are arranged in a single row in the X direction.

[0018] The parts feeder 88 is generally shaped like a rectangular box and is arranged to extend in the Y direction, as shown in Figures 4 and 5. The Y direction is described as the front-to-back direction of the parts feeder 88, and in the parts supply unit 82, the direction toward the side where the parts return device 92 is located is described as the front, and the direction toward the side where the parts feeder 88 is located is described as the rear.

[0019] The parts feeder 88 has openings on its top and front. The top opening serves as the parts input port 97, and the front opening serves as the parts discharge port 98. A slanted plate 104 is positioned below the input port 97 of the parts feeder 88. The slanted plate 104 is positioned so as to be inclined downward from the rear end face of the parts feeder 88 toward the center.

[0020] Furthermore, a conveyor device 106 is installed on the front side of the inclined plate 104, as shown in Figure 5. The conveyor device 106 is installed so as to be inclined upward from the front end of the inclined plate 104 toward the front of the parts feeder 88. The conveyor belt 112 of the conveyor device 106 rotates counterclockwise in Figure 5. In other words, the conveying direction by the conveyor device 106 is diagonally upward toward the front from the front end of the inclined plate 104.

[0021] Furthermore, an inclined plate 126 is provided below the front end of the conveyor device 106. The inclined plate 126 is positioned from the front end face of the parts feeder 88 toward the bottom of the conveyor device 106, with its rear end inclined diagonally downwards. In addition, an inclined plate 128 is provided below the inclined plate 126. The inclined plate 128 is inclined so that its front end is positioned downwards from below the central part of the conveyor device 106 toward the discharge port 98 of the parts feeder 88.

[0022] Furthermore, as shown in Figure 4, a pair of side frames 130 are assembled to the base 96. The pair of side frames 130 are positioned facing each other, parallel to each other, and extending in the Y direction. The distance between the pair of side frames 130 is slightly greater than the width dimension of the parts feeder 88, and the parts feeder 88 is detachably mounted between the pair of side frames 130.

[0023] The parts distribution device 90 includes a parts support member 150 and a parts support member moving device 152. The parts support member 150 is composed of a stage 156 and a pair of side wall portions 158. The stage 156 is generally a long plate shape and is positioned to extend forward from below the parts feeder 88 mounted between a pair of side frames 130. The upper surface of the stage 156 is generally horizontal and, as shown in Figure 5, is positioned with a small clearance from the front end of the inclined plate 128 of the parts feeder 88. The pair of side wall portions 158 are fixed upright on both sides of the longitudinal direction of the stage 156, as shown in Figure 4, and the upper ends of each side wall portion 158 extend upward from the upper surface of the stage 156.

[0024] Furthermore, the component support member moving device 152 slides the component support member 150 in the Y direction by the operation of the air cylinder (see Figure 11) 166. During this process, the component support member 150 moves between a stored state where it is stored below the component feeder 88 (see Figure 6) and an exposed state where it is exposed from below the component feeder 88 (see Figure 5).

[0025] As shown in Figure 7, the parts return device 92 includes a parts storage container 180 and a container swinging device 181. The parts storage container 180 is generally box-shaped, with an arc-shaped bottom. The parts storage container 180 is swingably held at the front end of the stage 156 of the parts support member 150 and swings when the container swinging device 181 is operated. During this time, the parts storage container 180 swings between a storage position with its opening facing upward (see Figure 7) and a return position with its opening facing the upper surface of the stage 156 of the parts support member 150 (see Figure 8).

[0026] As shown in Figure 3, the imaging device 84 includes a two-dimensional camera 290, a camera moving device 292, and an LED light (see Figure 11) 294. The camera moving device 292 includes a guide rail 296 and a slider 298. The guide rail 296 is fixed to the main body 80 above the parts feeder 88 and extends in the width direction (X direction) of the loose parts feeder 32. The slider 298 is slidably mounted on the guide rail 296 and slides to any position by the operation of an electromagnetic motor (see Figure 11) 299. The two-dimensional camera 290 is mounted on the slider 298 facing downwards. Note that the two-dimensional camera 290 is not a three-dimensional camera or equipped with a three-dimensional image processing device that can detect height information and depth information of three-dimensional objects, but rather a color camera that captures two-dimensional images in which height information and depth information of three-dimensional objects cannot be detected. In other words, the 2D camera 290 is a color camera that captures a 2D image of a three-dimensional object projected onto the XY plane. Furthermore, the 2D camera 290 does not use a telecentric lens where the aperture diaphragm is at the focal point of the lens, but rather a general-purpose lens, that is, a lens with a field of view that is not 0 degrees. The LED light 294 is the light source for the 2D camera 290 and is located on the side of the component transfer device 86 next to the 2D camera 290. In other words, the 2D camera 290 captures a 2D image of an object illuminated by the LED light 294 from the side.

[0027] As shown in Figure 3, the parts transfer device 86 includes a parts holding head moving device 300, a parts holding head 302, and two shuttle devices 304.

[0028] The component holding head moving device 300 includes an X-direction moving device 310, a Y-direction moving device 312, and a Z-direction moving device 314. The Y-direction moving device 312 has a Y-slider 316 positioned above the component supply unit 82 so as to extend in the X direction, and the Y-slider 316 moves to any position in the Y direction by being driven by an electromagnetic motor (see Figure 11) 319. The X-direction moving device 310 has an X-slider 320 positioned on the side of the Y-slider 316, and the X-slider 320 moves to any position in the X direction by being driven by an electromagnetic motor (see Figure 11) 321. The Z-direction moving device 314 has a Z-slider 322 positioned on the side of the X-slider 320, and the Z-slider 322 moves to any position in the Z direction by being driven by an electromagnetic motor (see Figure 11) 323.

[0029] As shown in Figure 9, the part holding head 302 includes a head body 330, a suction nozzle 332, a nozzle swivel device 334, and a nozzle rotation device 335. The head body 330 is integrally formed with the Z slider 322. The suction nozzle 332 holds the part and is detachably mounted on the lower end of the holder 340. The holder 340 is bendable on the support shaft 344, and the holder 340 bends 90 degrees upward when the nozzle swivel device 334 is operated. As a result, the suction nozzle 332 mounted on the lower end of the holder 340 swivels 90 degrees and is positioned in the swiveled position. In other words, the suction nozzle 332 swivels between the non-swiveled position and the swiveled position when the nozzle swivel device 334 is operated. Of course, it is also possible to position and stop it at an angle between the non-swiveled position and the swiveled position. The nozzle rotation device 335 rotates the suction nozzle 332 around its axis.

[0030] Furthermore, as shown in Figure 3, each of the two shuttle devices 304 includes a parts carrier 388 and a parts carrier moving device 390, and is fixed to the main body 80, arranged laterally in front of the parts supply unit 82. Five parts receiving members 392 are mounted on the parts carrier 388 in a single row in the lateral direction, and parts are placed on each of the parts receiving members 392.

[0031] The loose parts supply device 32 is capable of supplying various parts, and various types of parts receiving members 392 are available depending on the shape of the parts. Here, as an example of an electronic circuit component supplied by the loose parts supply device 32, we will describe a parts receiving member 392 that corresponds to a leaded component 410, as shown in Figure 10. The leaded component 410 consists of a block-shaped component body 412 and two leads 414 protruding from the bottom surface of the component body 412.

[0032] Furthermore, the component receiving member 392 has a component receiving recess 416 shaped to match the lead component 410. The component receiving recess 416 is a stepped recess and consists of a main body receiving recess 418 that opens on the upper surface of the component receiving member 392 and a lead receiving recess 420 that opens on the bottom surface of the main body receiving recess 418. The lead component 410 is then inserted into the component receiving recess 416 with the lead 414 facing downwards. As a result, the lead 414 is inserted into the lead receiving recess 420, and the lead component 410 is placed inside the component receiving recess 416 with the component body 412 inserted into the main body receiving recess 418.

[0033] Furthermore, as shown in Figure 3, the parts carrier moving device 390 is a plate-shaped longitudinal member and is positioned on the front side of the parts supply unit 82 so as to extend in the front-rear direction. A parts carrier 388 is slidably mounted on the upper surface of the parts carrier moving device 390 in the front-rear direction and slides to any position in the front-rear direction by the drive of an electromagnetic motor (see Figure 11) 430. When the parts carrier 388 slides toward the parts supply unit 82, it slides to a parts receiving position located within the movement range of the parts holding head 302 by the parts holding head moving device 300. On the other hand, when the parts carrier 388 slides toward the parts supply unit 82, it slides to a parts supply position located within the movement range of the work heads 60 and 62 by the work head moving device 64.

[0034] Furthermore, as shown in Figure 11, the control device 34 includes a central control device 450, a plurality of individual control devices (only one is shown in the figure) 452, and an image processing device 454. The central control device 450 is mainly composed of a computer and is connected to the substrate transport and holding device 22, the component mounting device 24, the imaging device 26, the imaging device 28, the component supply device 30, and the loose component supply device 32. In this way, the central control device 450 controls the substrate transport and holding device 22, the component mounting device 24, the imaging device 26, the imaging device 28, the component supply device 30, and the loose component supply device 32 in a centralized manner. The plurality of individual control devices 452 are mainly composed of computers and are provided corresponding to the substrate transport and holding device 22, the component mounting device 24, the imaging device 26, the imaging device 28, the component supply device 30, and the loose component supply device 32 (only the individual control device 452 corresponding to the loose component supply device 32 is shown in the figure).

[0035] The individual control device 452 of the loose parts supply device 32 is connected to the imaging device 84, the parts scattering device 90, the parts returning device 92, the parts holding head moving device 300, the parts holding head 302, and the shuttle device 304. This allows the individual control device 452 of the loose parts supply device 32 to control the imaging device 84, the parts scattering device 90, the parts returning device 92, the parts holding head moving device 300, the parts holding head 302, and the shuttle device 304. Furthermore, the image processing device 454 is connected to the two-dimensional camera 290 and processes the image data captured by the two-dimensional camera 290. This image processing device 454 is connected to the individual control device 452 of the loose parts supply device 32. As a result, the individual control device 452 of the loose parts supply device 32 acquires the image data captured by the two-dimensional camera 290.

[0036] Furthermore, the loose parts supply device 32 has a storage device 458. The storage device 458 is connected to an individual control device 452 and stores various information according to commands from the individual control device 452.

[0037] With the above-described configuration, the component mounter 10 performs a component mounting operation on the circuit substrate 12 held by the substrate conveyance and holding device 22. Specifically, the circuit substrate 12 is conveyed to a work position, and is fixedly held by the clamp device 52 at that position. Next, the imaging device 26 moves above the circuit substrate 12 and images the circuit substrate 12. Thereby, information relating to an error in the holding position of the circuit substrate 12 is obtained. In addition, the component supply device 30 or the bulk component supply device 32 supplies components at a predetermined supply position. Note that the supply of components by the bulk component supply device 32 will be described in detail later. Then, one of the work heads 60 and 62 moves above the component supply position, and holds the component by the suction nozzle 66. Subsequently, the work heads 60 and 62 holding the components move above the imaging device 28, and the component held by the suction nozzle 66 is imaged by the imaging device 28. Thereby, information relating to an error in the holding position of the component is obtained. Then, the work heads 60 and 62 holding the components move above the circuit substrate 12, correct the error in the holding position of the circuit substrate 12, the error in the holding position of the component, and the like for the held component, and mount the component onto the circuit substrate 12.

[0038] Next, the supply of components by the bulk component supply device 32 will be described. In the bulk component supply device 32, the lead components 410 are loaded by an operator from the loading port 97 of the component supplier 88, and the loaded lead components 410 are supplied in a state of being placed on the component receiving member 392 of the component carrier 388 by the operation of the component supply unit 82 and the component transfer device 86.

[0039] Specifically, the operator loads a plurality of lead components 410 of the same type, that is, a plurality of lead components 410 of the same shape, from the loading port 97 on the upper surface of the component supplier 88. At this time, the component support member 150 is moved below the component supplier 88 by the operation of the component support member moving device 152, and is in a retracted state (see FIG. 6). When the component support member 150 is retracted, the component storage container 180 disposed at the front end of the component support member 150 is positioned in front of the component supplier 88, and assumes a posture (storage posture) in which the opening of the component storage container 180 faces upward.

[0040] The lead component 410 fed from the inlet 97 of the component feeder 88 falls onto the inclined plate 104 of the component feeder 88, and rolls down to the lower end on the front side of the inclined plate 104. At this time, the lead components 410 that have rolled down to the lower end on the front side of the inclined plate 104 are piled up between the lower end on the front side of the inclined plate 104 and the lower end on the rear side of the conveyor device 106. Then, the conveyor belt 112 of the conveyor device 106 circulates counterclockwise in FIG. 6. As a result, the lead components 410 piled up between the inclined plate 104 and the conveyor belt 112 are conveyed obliquely upward by the conveyor belt 112.

[0041] Then, the lead component 410 conveyed by the conveyor belt 112 falls from the upper end on the front side of the conveyor device 106 onto the inclined plate 126. The lead component 410 that has fallen onto the inclined plate 126 rolls rearward on the inclined plate 126 and falls onto the inclined plate 128. The lead component 410 that has fallen onto the inclined plate 128 rolls down toward the front, and is discharged from the discharge port 98 on the front side of the component feeder 88.

[0042] As a result, the lead component 410 discharged from the discharge port 98 of the component feeder 88 is stored inside the component storage container 180. Then, when a predetermined amount of lead components 410 are discharged from the component feeder 88, that is, when the conveyor device 106 has operated for a certain amount, the conveyor device 106 stops. Next, the component support member 150 moves forward from the retracted state by the operation of the component support member moving device 152.

[0043] Then, at the timing when the component support member 150 has moved forward by a predetermined amount from the retracted state, the container swinging device 181 of the component returning device 92 operates, and the component storage container 180 swings. As a result, the posture of the component storage container 180 vigorously changes from the posture with the opening facing upward (storage posture) to the posture with the opening facing the stage 156 (return posture). At this time, the lead components 410 stored in the component storage container 180 are vigorously ejected toward the stage 156. As a result, the lead components 410 of the same shape are scattered from the component storage container 180 onto the stage 156, as shown in FIG. 12.

[0044] The lead components 410 of the same shape are scattered on the stage 156, but the lead components 410 are scattered on the stage 156 in roughly four orientations. Specifically, in the first orientation, the lead components 410 are scattered with the protruding surfaces of the leads 414 facing sideways and the two leads 414 generally aligned horizontally. In the second orientation, the lead components 410 are scattered with the protruding surfaces of the leads 414 facing sideways and the two leads 414 generally aligned vertically. In the third orientation, the lead components 410 are scattered with the protruding surfaces of the leads 414 facing upward. In the fourth orientation, the lead components 410 are scattered with two or more lead components 410 overlapping. The four positions in which the lead components 410 are scattered will be described as lead component 410a in the first position, lead component 410b in the second position, lead component 410c in the third position, and lead component 410d in the fourth position.

[0045] When the lead components 410 are scattered on the stage 156 as described above, the two-dimensional camera 290 of the imaging device 84 moves above the component support member 150 by the operation of the camera moving device 292. Then, the two-dimensional camera 290 images the lead components 410 of the same shape that are scattered on the stage 156. Since the field of view of the two-dimensional camera 290, that is, the imaging range, is wider than the stage 156, the two-dimensional camera 290 images the entire stage 156, that is, all the lead components 410 scattered on the stage 156, at once. In other words, the two-dimensional camera 290 images all the lead components 410 scattered on the stage 156 at once while keeping them within its imaging range. When the two-dimensional camera 290 images the lead components 410 on the stage 156, the LED light 294 shines light toward the upper surface of the stage 156. Then, based on the imaging data captured by the two-dimensional camera 290, the individual control device 452 identifies the lead component to be picked up using a pattern matching method.

[0046] Specifically, the individual control device 452 identifies the outline of the lead component 410 based on the image data of the lead component 410 captured by the two-dimensional camera 290, and calculates the shape of the top surface of the lead component 410, that is, the shape from a viewpoint above the lead component 410. Meanwhile, as shown in Figure 13, the storage device 458 stores reference data corresponding to the outline of the lead component 410a in the first orientation.

[0047] The individual control unit 452 then calculates the shape of the top surface of the lead component 410 based on the image data of the lead component 410 captured by the two-dimensional camera 290, and determines whether the calculated shape of the top surface of the lead component 410 matches the reference data stored in the storage device 458. If the calculated shape of the top surface of the lead component 410 matches the reference data, the individual control unit 452 sets the lead component 410 that matches the shape of the top surface as the component to be picked up.

[0048] In other words, the lead component 410a in the first position is set as the component to be picked up, while the lead component 410b in the second position, the lead component 410c in the third position, and the lead component 410d in the fourth position are not set as components to be picked up. This is because, in the case of the lead component 410b in the second position, the upper surface area is small, making it impossible to properly hold the lead component 410b with the suction nozzle 332. Also, in the case of the lead component 410c in the third position, the lead 414 is arranged on the upper surface, and the lead 414 gets in the way, making it impossible to properly hold the lead component 410c with the suction nozzle 332. Furthermore, in the case of the lead component 410d in the fourth position, the upper surface of the lead component 410d is not horizontal, or for other reasons, making it impossible to properly hold the lead component 410d with the suction nozzle 332.

[0049] The individual control device 452 then calculates the position information of the lead component 410, which has been set as the component to be picked up, based on the imaging data. Next, based on the calculated position information of the component to be picked up, the component holding head 302 moves above the component to be picked up by the operation of the component holding head moving device 300, and the suction nozzle 332 picks up and holds the component to be picked up. Note that when the component to be picked up is picked up and held by the suction nozzle 332, the suction nozzle 332 is in a non-rotating position.

[0050] Next, after the suction nozzle 332 has grasped the lead component 410, which is the part to be picked up, the part holding head 302 moves above the part carrier 388. At this time, the part carrier 388 is moved to the part receiving position by the operation of the part carrier moving device 390. Also, as the part holding head 302 moves above the part carrier 388, the suction nozzle 332 rotates to the pivot position. The suction nozzle 332 rotates by the operation of the nozzle rotating device 335 so that the lead 414 of the lead component 410 held by the suction nozzle 332 in the pivot position faces downward in the vertical direction.

[0051] As the part holding head 302 moves above the part carrier 388, the part holding head 302 descends, inserting the lead part 410, with its lead 414 facing downward in the vertical direction, into the part receiving recess 416 of the part receiving member 392. As a result, the lead part 410 is placed on the part receiving member 392 with its lead 414 facing downward in the vertical direction, as shown in Figure 10.

[0052] Then, when the lead component 410 is placed on the component receiving member 392, the component carrier 388 moves to the component supply position by the operation of the component carrier moving device 390. Since the component supply position is located within the movement range of the work heads 60 and 62, the loose component supply device 32 supplies the lead component 410 to the component mounting machine 10 at this position. In this way, the individual control device 452 in the loose component supply device 32 identifies the component to be picked up from among the multiple lead components 410 scattered on the stage 156 based on one reference data. Then, the component holding head 302 holds the lead component 410 that has been identified as the component to be picked up and places it on the component receiving member 392, thereby supplying the lead component 410.

[0053] Therefore, the individual control device 452 needs to appropriately identify the lead component 410a in the first orientation from among the multiple lead components 410 scattered on the stage 156, based on reference data. However, when the individual control device 452 identifies the lead component in the first orientation based on reference data, it may mistakenly identify a lead component in an orientation other than the first orientation as the component to be picked up. For example, if the color of the lead component is similar to the color of the stage, the individual control device 452 may not be able to appropriately calculate the outline of the lead component based on the imaging data, and may mistakenly identify a lead component in an orientation other than the first orientation as the component to be picked up. In this way, if a lead component in an orientation other than the first orientation is identified as the component to be picked up, the lead component cannot be properly held by the suction nozzle 332. In particular, if a lead component in a fourth orientation is identified as the component to be picked up, not only will the lead component not be properly held by the suction nozzle 332, but there is also a risk that the suction nozzle 332 may be damaged. In other words, in the fourth orientation, the lead components are scattered on the stage 156 with two or more lead components overlapping, and the upper surface position of the lead components resting on top of each other is higher than the upper surface position of the lead components in the first orientation. Therefore, when the suction nozzle 332 attempts to hold the lead components in the fourth orientation, the suction nozzle 332 may forcefully strike the lead components, potentially damaging the suction nozzle 332.

[0054] Furthermore, since the parts to be picked up are identified based on the imaging data captured by the two-dimensional camera 290, there is a risk that the parts to be picked up may not be properly identified due to the parallax of the two-dimensional camera 290.

[0055] More specifically, as shown in Figure 14, the two-dimensional camera 290 is fixedly positioned at a predetermined height and location on the stage 156, for example, above the center of the stage 156. The two-dimensional camera 290 moves to any position in the X direction by the camera moving device 292 at the predetermined height, but when imaging multiple lead parts scattered on the stage, it stops above the center of the stage 156 that is being imaged, and is therefore fixedly positioned at a predetermined height and above the center of the stage 156. The two-dimensional camera 290 then images multiple lead parts 410 scattered at multiple locations on the stage 156 at once. In this case, for example, if the two-dimensional camera 290 images lead component 410A and lead component 410B at the same time, the image of lead component 410A will show the surface 460 from which the lead 414 extends, but the image of lead component 410B will show the surface 462 opposite to the surface 460 from which the lead 414 extends. Therefore, the image of lead component 410A and the image of lead component 410B will have different shapes. In this way, when a two-dimensional camera 290 positioned in a fixed location images multiple objects at different locations, the images of the objects will have different shapes. However, the difference between the images of objects at different locations is not a large difference, but a relatively small difference. Nevertheless, even if the difference is relatively small, there is a risk that the part to be picked up may not be properly identified from among the multiple lead components 410 scattered at different locations on the stage 156.

[0056] Furthermore, the LED light 294, which illuminates the object being imaged by the 2D camera 290, shines light from the side of the 2D camera 290 toward the stage 156, and the light reflected from the light emitted by the LED light 294 differs depending on the orientation of the lead component 410. Specifically, for example, as shown in Figure 15, when the 2D camera 290 images lead components 410C scattered on the stage 156 with the lead 414 facing away from the LED light 294, the 2D camera 290 images the reflected light 470 that the lead component 410C has reflected from the light emitted by the LED light 294. On the other hand, for example, as shown in Figure 16, when the 2D camera 290 images lead components 410D scattered on the stage 156 with the lead 414 facing the LED light 294, the 2D camera 290 images the reflected light 480 that the lead component 410D has reflected from the light emitted by the LED light 294. Thus, since the reflected light 470 reflected by lead component 410C and the reflected light 480 reflected by lead component 410D are different, the image captured of the reflected light 470 reflected by lead component 410C and the image captured of the reflected light 480 reflected by lead component 410D will have different shapes. In this way, when imaging objects with different orientations are captured using light irradiated from the side as the light source, the images of the objects will have different shapes. However, the difference in images of objects with different orientations is not a large difference, but a relatively small difference. Nevertheless, even if the difference is relatively small, there is a risk that the component to be picked up may not be properly identified from among the multiple lead components 410 scattered on the stage 156 in different orientations.

[0057] Thus, there is a risk that the part to be picked up may not be properly identified due to the parallax of the two-dimensional camera 290. In view of this, the loose part supply device 32 creates judgment data for determining overlapping parts based on imaging data of multiple lead parts 410 placed in the same first orientation at multiple positions on the stage, and imaging data of multiple lead parts 410 placed in orientations different from the first orientation at multiple positions on the stage. Specifically, as shown in Figure 17, the operator places one lead part 410 in the center of the stage 156. At this time, the operator places one lead part 410 on the stage so that the direction in which the lead 414 of the lead part 410 extends is in a predetermined direction. In Figure 17, the direction in which the lead 414 of the lead part 410 extends is defined as 0°. The two-dimensional camera 290 then images the one lead part 410 placed in the center of the stage in an orientation where the lead 414 extends at 0°. The imaging position of the 2D camera 290 is always at a predetermined height above the center of the stage when creating the model data.

[0058] In this way, when the two-dimensional camera 290 images a single leaded component 410 placed in the center of the stage with the lead 414 extended at 0°, the component holding head 302 holds the single leaded component 410. The component holding head 302 then places the held single leaded component 410 on the upper left of the stage 156 with the lead 414 extended at 0°. The two-dimensional camera 290 then images the leaded component 410 placed on the upper left of the stage with the lead 414 extended at 0°.

[0059] Next, the two-dimensional camera 290 images a single leaded component 410 placed on the upper left of the stage with the lead 414 extended at 0°, and the component holding head 302 holds the single leaded component 410. The component holding head 302 then places the held single leaded component 410 on the lower left of the stage 156 with the lead 414 extended at 0°. The two-dimensional camera 290 then images the leaded component 410 placed on the lower left of the stage with the lead 414 extended at 0°.

[0060] Next, the two-dimensional camera 290 images a single leaded component 410 placed on the lower left of the stage with the lead 414 extended at 0°, and the component holding head 302 holds the single leaded component 410. The component holding head 302 then places the held single leaded component 410 on the lower right of the stage 156 with the lead 414 extended at 0°. The two-dimensional camera 290 then images the leaded component 410 placed on the lower right of the stage with the lead 414 extended at 0°.

[0061] Next, the two-dimensional camera 290 images a single leaded component 410 placed on the lower right of the stage with the lead 414 extended at 0°, and the component holding head 302 holds the single leaded component 410. The component holding head 302 then places the held single leaded component 410 on the upper right of the stage 156 with the lead 414 extended at 0°. The two-dimensional camera 290 then images the leaded component 410 placed on the upper right of the stage with the lead 414 extended at 0°.

[0062] Thus, when a lead component is imaged with the lead 414 positioned at 0° in each of the five locations on the stage 156 (center, upper left, lower left, lower right, and upper right), a lead component is also imaged with the lead 414 positioned at each of the five locations on the stage 156 (center, upper left, lower left, lower right, and upper right) in a direction rotated 90° counterclockwise from 0°. Note that 90° is defined as the direction in which the lead 414 extends, rotated 90° counterclockwise from 0°.

[0063] In other words, when the two-dimensional camera 290 images a single leaded component 410 placed on the upper right of the stage with the lead 414 extended at 0°, the component holding head 302 holds that single leaded component 410. Then, as shown in Figure 18, the component holding head 302 places the held single leaded component 410 on the stage 156 in the order of center, upper left, lower left, lower right, and upper right, with the lead 414 extended at 90°. At this time, each time the component holding head 302 places a single leaded component 410 with the lead 414 extended at 90°, the two-dimensional camera 290 images the single leaded component 410 placed with the lead 414 extended at 90°.

[0064] Thus, when a lead component is imaged with the lead 414 positioned at five locations on the stage 156 (center, upper left, lower left, lower right, and upper right) with the lead 414 extending at a 90° angle, a lead component is also imaged with the lead 414 positioned at five locations on the stage 156 (center, upper left, lower left, lower right, and upper right) with the lead 414 extending in a direction rotated 180° counterclockwise from 0°. Note that 180° is defined as the direction in which the lead 414 extends, rotated 180° counterclockwise from 0°.

[0065] In other words, when the two-dimensional camera 290 images a single leaded component 410 placed on the upper right of the stage with the lead 414 extended at 90°, the component holding head 302 holds that single leaded component 410. Then, as shown in Figure 19, the component holding head 302 places the held single leaded component 410 on the stage 156 in the order of center, upper left, lower left, lower right, and upper right, with the lead 414 extended at 180°. At this time, each time the component holding head 302 places a single leaded component 410 with the lead 414 extended at 180°, the two-dimensional camera 290 images the single leaded component 410 placed with the lead 414 extended at 180°.

[0066] Thus, when a lead component is imaged with the lead 414 positioned so that it extends 180° at each of the five locations on the stage 156 (center, upper left, lower left, lower right, and upper right), a lead component is imaged with the lead 414 positioned so that it extends in a direction rotated 270° counterclockwise from 0° at each of the five locations on the stage 156. Note that 270° is defined as the direction in which the lead 414 extends, rotated 270° counterclockwise from 0°.

[0067] In other words, when the 2D camera 290 images a single leaded component 410 placed on the upper right of the stage with the lead 414 extended at 180°, the component holding head 302 holds that single leaded component 410. Then, as shown in Figure 20, the component holding head 302 places the held single leaded component 410 on the stage 156 in the order of center, upper left, lower left, lower right, and upper right, with the lead 414 extended at 270°. At this time, each time the component holding head 302 places a single leaded component 410 with the lead 414 extended at 270°, the 2D camera 290 images the single leaded component 410 placed with the lead 414 extended at 270°.

[0068] Hereafter, for example, a lead component 410 placed on the stage 156 in the center of Figure 17 with the lead 414 extending at 0° will be described as a lead component with a 0° orientation in the center of the stage. Also, for example, a lead component 410 placed on the stage 156 in the lower right of Figure 18 with the lead 414 extending at 90° will be described as a lead component with a 90° orientation in the lower right of the stage. Also, for example, a lead component 410 placed on the stage 156 in the lower left of Figure 19 with the lead 414 extending at 180° will be described as a lead component with a 180° orientation in the lower left of the stage. Also, a lead component 410 placed on the stage 156 in the upper right of Figure 20 with the lead 414 extending at 270° will be described as a lead component with a 270° orientation in the upper right of the stage.

[0069] As shown in Figures 17 to 20, when the two-dimensional camera 290 images the lead components in four different orientations—0°, 90°, 180°, and 270°—placed on each of the five locations on the stage 156, the individual control device 452 creates imaging data for 20 (= 5 × 4) types of lead components 410. These 20 types of imaging data for lead components 410 are imaging data for lead components 410 in which at least one of the orientation or placement position of the lead component 410 is different.

[0070] Furthermore, the two-dimensional camera 290 images the stage 156 without the lead component at each of the five different locations where the lead component was imaged. At this time, the two-dimensional camera 290 images the stage 156 at each of the five different locations according to the orientation in which the lead component is planned to be placed. In other words, the two-dimensional camera 290 images the positions at each of the five different locations on the stage 156 where the lead component is planned to be placed in four different orientations. As a result, the individual control device 452 creates 20 (= 5 × 4) types of image data of the stage 156.

[0071] The individual control unit 452 then creates a lead component color map based on the imaging data of the 20 types of lead components. Specifically, the individual control unit 452 divides the imaging data of each of the 20 types of lead components into 100 areas of 10 rows and 10 columns, for example, as shown in Figure 21. The individual control unit 452 then extracts color information indicating the color contained in the imaging data of one type of lead component for each area and creates the lead component color map shown in Figure 22. The individual control unit 452 extracts hue H, saturation S, and lightness V as color information. In the lead component color map shown in Figure 22, the color information (H, S, V) for each of the 100 areas of one type of surface lead component is recorded. The individual control unit 452 then creates 20 types of lead component color maps corresponding to the imaging data of the 20 types of lead components.

[0072] Furthermore, the individual control unit 452 creates a stage color map based on the imaging data of the 20 types of stages 156. Specifically, the individual control unit 452 divides the imaging data of each of the 20 types of stages 156 into 100 areas of 10 rows and 10 columns, similar to the imaging data of lead components. Then, similar to the lead component color map, the individual control unit 452 extracts color information indicating the colors contained in the imaging data of one type of stage for each area, and creates the stage color map shown in Figure 23. Finally, the individual control unit 452 creates 20 different stage color maps corresponding to the imaging data of the 20 types of stages.

[0073] In the above explanation, the individual control device 452 divides the imaging data into 100 areas when creating the lead component color map and stage color map. However, in reality, it divides the data into more than 20,000 areas to create the lead component color map and stage color map.

[0074] Next, the individual control device 452 identifies the outline of each of the 20 types of lead parts based on the 20 types of lead part color maps and the 20 types of stage color maps. At this time, the individual control device 452 compares the lead part color map with the stage color map of the same stage as the lead part in that color map, in terms of imaging position and imaging orientation. That is, for example, the individual control device 452 compares the lead part color map of a lead part at 0° orientation in the center of the stage with the stage color map of stage 156 at 0° orientation in the center of the stage. At this time, the individual control device 452 compares the color information of the same area. That is, for example, the individual control device 452 compares the color information of area 1 of the lead part color map with the color information of area 1 of the stage color map. Then, as shown in Figure 24, the individual control device 452 compares the color information of the lead part color map with the color information of the stage color map area by area, starting from the leftmost area in the uppermost area and moving towards the rightmost area. In other words, the individual control unit 452 compares the color information of the leftmost area in the first row, and then compares the color information of the area to the right of the leftmost area in the first row. After the comparison of the color information of the areas in the first row is complete, the individual control unit 452 compares the color information of the leftmost area in the second row. At this time, if the difference between the color information of the lead component color map for each area and the color information of the stage color map exceeds a threshold, the individual control unit 452 identifies that area as the outline of the lead component. Once the individual control unit 452 identifies the area as the outline of the lead component, it ends the comparison of the row for that area and compares the color information of the next row. In other words, when the individual control unit 452 identifies the Mth area in the Nth row as the outline of the lead component, it ends the comparison of the color information of the Nth row and compares the color information of the 1st area (the leftmost area) in the N+1th row. By comparing the color information in this way, the individual control unit 452 identifies the left outline of the lead component.

[0075] Furthermore, as shown in Figure 25, when the individual control device 452 compares color information row by row from the left area to the right area, that is, when comparing color information in the direction of arrow 510a, it also compares color information in the upward direction, that is, in the direction of arrow 512a. In addition, when the individual control device 452 compares color information in the direction of arrow 512a, it also compares color information in the left-right direction, that is, in the direction of arrow 514a. Furthermore, when the individual control device 452 compares color information in the direction of arrow 510b, for example, it also compares color information in the direction of arrow 512b. Furthermore, when the individual control device 452 compares color information in the direction of arrow 512b, it also compares color information in the direction of arrow 514b. Note that in this explanation, when comparing color information row by row from the left area to the right area, color information is also compared in the upward direction, but color information is also compared in the downward direction as well as the upward direction. In this way, by branching vertically and comparing color information, and then further branching horizontally after the vertical branching and comparing color information, the upper and lower outlines of the lead component can be identified. In particular, by branching vertically and then further branching horizontally and comparing color information, the outline can be appropriately identified even if the outline is inclined with respect to the row and column directions.

[0076] Furthermore, the individual control device 452 compares the color information row by row from the left area to the right area, and then compares the color information row by row from the rightmost area to the left area using the same method as described above. This identifies the right-side outline of the lead component. In this way, the individual control device 452 identifies the overall outline of the lead component by identifying the left, top, bottom, and right outlines of each lead component. Then, the individual control device 452 identifies the outline of each of the 20 lead component color maps by comparing each of the 20 stage color maps. Note that when the individual control device 452 compares the color information for each area, it remembers the position of the area where the color information comparison has been completed, and avoids repeating the color information comparison in an area where the color information comparison has already been completed.

[0077] In this way, by comparing the lead component color map with the stage color map, the outline of the lead component can be identified appropriately. In other words, due to color unevenness of the stage, the degree of light reflection on the stage, etc., it may not be possible to properly recognize the boundary between the stage and the lead component. Also, if the color of the stage and the color of the lead component are similar, it may not be possible to properly recognize the boundary between the stage and the lead component. However, by comparing the lead component color map with the stage color map, it becomes possible to recognize the boundary between the stage and the lead component, taking into account the color unevenness of the stage and the degree of light reflection on the stage. Furthermore, even if the color of the stage and the color of the lead component are similar, it becomes possible to recognize the boundary between the stage and the lead component. As a result, the outline of the lead component can be identified appropriately.

[0078] Furthermore, when the individual control unit 452 identifies the outlines of 20 types of leaded components (hereinafter referred to as "component outlines"), it creates a comprehensive map data of the inside of those component outlines. Specifically, the individual control unit 452 creates comprehensive map data by grouping each of the 20 types of leaded component color maps created earlier into areas. In this case, the individual control unit 452 creates comprehensive map data of the areas located inside the previously identified component outlines. In other words, as shown in Figure 26, the individual control unit 452 extracts the color information of area 1 of the 20 types of leaded component color maps and identifies the range of the extracted color information of area 1 of the 20 types of leaded component color maps as the color range. In this case, for example, the individual control unit 452 identifies "V: 20 to 30" as the color range of area 1. Note that in Figure 26, only the lightness V is listed as color information, but in the actual comprehensive map data, hue H, saturation S, and lightness V are extracted as color information, and the color range of hue H, saturation S, and lightness V is identified. The individual control unit 452 then extracts color information for each area located within the outline of the component and identifies the range of color information for each extracted area as a color range. In this way, the individual control unit 452 creates a comprehensive map data of the leaded component and registers this comprehensive map data in the storage device 458 as model data for determining component overlap.

[0079] Once the model data is registered in the storage device 458, the individual control device 452 uses the model data to determine whether or not multiple lead components scattered on the stage 156 overlap. Specifically, as shown in Figure 12, when multiple lead components are scattered on the stage 156, the two-dimensional camera 290 images these multiple lead components. The individual control device 452 then compares the image data of each of these multiple lead components with the model data area by area. In other words, the model data is the comprehensive map data shown in Figure 26, where the comprehensive map data has a color range for color information set for each area. The individual control device 452 also divides the image data of each of the multiple lead components into 100 areas, as shown in Figure 21. The individual control device 452 then extracts the color information contained in the image data for each area and compares the color information contained in the image data with the color range of the comprehensive map data for the same areas. At this time, the individual control device 452 determines whether or not the lead components overlap based on whether or not the difference between the color information contained in the image data and the color range of the comprehensive map data is greater than or equal to a threshold.

[0080] Specifically, for example, if the color information of area 10 included in the imaging data is "V: 25" and the color range of area 10 in the overall map data is "V: 19 to 30", the individual control device 452 calculates the difference between the color information included in the imaging data and the color range of the overall map data as 0. In other words, if the color information of area 10 included in the imaging data, "V: 25", is included in the color range of area 10 in the overall map data, "V: 19 to 30", the individual control device 452 calculates the difference between the color information of area 10, "V: 25", and the color range of area 10, "V: 19 to 30", as 0.

[0081] Furthermore, for example, if the color information of area 20 included in the imaging data is "V: 55" and the color range of area 20 in the overall map data is "V: 15 to 32", the individual control device 452 calculates the difference between the color information included in the imaging data and the color range of the overall map data as 23 (= 55 - 32). Also, for example, if the color information of area 30 included in the imaging data is "V: 108" and the color range of area 30 in the overall map data is "V: 20 to 35", the individual control device 452 calculates the difference between the color information included in the imaging data and the color range of the overall map data as 73 (= 108 - 35).

[0082] The individual control unit 452 then calculates the difference between the color information contained in the imaging data and the color range of the overall map data for each area, and determines whether the calculated difference is greater than or equal to a threshold, for example, 50. In the explanation of comparing color ranges, only brightness V is used, but in reality, the respective color ranges of hue H, saturation S, and brightness V are used. In other words, the individual control unit 452 determines whether the difference between the respective color information of hue H, saturation S, and brightness V contained in the imaging data and the respective color ranges of hue H, saturation S, and brightness V in the overall map data is greater than or equal to a threshold. In this case, the individual control unit 452 determines that the difference between the color information contained in the imaging data and the color range of the overall map data is greater than or equal to a threshold if the difference between hue H, saturation S, and brightness V is greater than or equal to a threshold for any one of them. Note that the thresholds for the difference in brightness V, the difference in saturation S, and the difference in hue H are set individually.

[0083] The individual control unit 452 then determines whether the difference between the color information contained in the imaging data and the color range of the overall map data is greater than or equal to a threshold in all areas. Next, the individual control unit 452 calculates the ratio of the number of areas where the difference between the color information contained in the imaging data and the color range of the overall map data is greater than or equal to a threshold to the number of areas where the individual control unit 452 has made a determination. In this case, if the calculated ratio is 3% or more, the individual control unit 452 determines that lead components are overlapping. On the other hand, if the calculated ratio is less than 3%, the individual control unit 452 determines that lead components are not overlapping.

[0084] In this way, by using the integrated map data, it is possible to determine whether or not parts overlap based on the color information inside the outline, thus enabling accurate determination of overlap. In particular, the integrated map data is created based on imaging data for five different mounting positions of the stage 156 and four different mounting orientations of the lead parts. Therefore, the color information for each area of ​​the integrated map data includes color information from imaging data for all five different mounting positions of the stage 156 and four different mounting orientations of the lead parts. For this reason, by using the integrated map data, it is possible to accurately determine whether or not parts overlap regardless of the mounting position and orientation of the lead parts.

[0085] However, the above method may not be able to properly determine the overlap of two-tone lead parts. More specifically, as shown in Figure 27, there is a lead part 550 divided into multiple areas for each color. This lead part 550 is divided into a black area 552 for black parts and a white area 554 for white parts. The lead 556 of the lead part 550 is included in the white area 554. Furthermore, the white area 554 does not have to be composed solely of white, but may be composed of multiple colors close to white, such as milky white, light gray, light pink, etc. On the other hand, the black area 552 does not have to be composed solely of black, but may be composed of multiple colors close to black, such as dark ultramarine, dark deep green, etc.

[0086] In a lead component 550 divided into multiple areas by color, as shown in Figure 28, for example, two lead components 550 may overlap in the white area 554. In such cases, the shadow of the upper lead component 550 can be recognized on the upper surface of the lower lead component 550, making it easy to determine the overlap of the lead components 550. On the other hand, as shown in Figure 29, for example, two lead components 550 may overlap in the black area 552. In such cases, the shadow of the upper lead component 550 is difficult to recognize on the upper surface of the lower lead component 550, making it difficult to determine the overlap of the lead components 550.

[0087] Thus, in a lead component 550 divided into multiple areas for each color, the accuracy of overlap detection of the lead components 550 differs depending on the overlapping parts of the lead components 550. For this reason, if a single threshold is used as the threshold for determining the overlap of the lead components 550, regardless of the color of the parts of the lead components 550, it will not be possible to properly determine the overlap of the lead components 550.

[0088] Specifically, for example, when two lead components 550 overlap in a white area 554, it is easier to determine the overlap of the lead components 550, so a large threshold, for example, 100, can be used. In other words, when two lead components 550 overlap in a white area 554, the shadow is easily discernible, so the difference between the color information contained in the imaging data and the color range of the overall map data is large. For this reason, when two lead components 550 overlap in a white area 554, the overlap of the lead components 550 can be appropriately determined even if the threshold is set to 100. However, when two lead components 550 overlap in a black area 552, the shadow is difficult to discern, so the difference between the color information contained in the imaging data and the color range of the overall map data is small. For this reason, when two lead components 550 overlap in a black area 552, if the threshold is set to 100, there is a risk that the difference between the color information contained in the imaging data and the color range of the overall map data will fall below the threshold. In such cases, there is a risk that the lead components 550 may be judged not to be overlapping, even though they are actually overlapping.

[0089] Furthermore, for example, if two lead components 550 overlap in the black area 552, it is difficult to determine the overlap of the lead components 550, so it is conceivable to use a small threshold, for example, 10. In other words, when two lead components 550 overlap in the black area 552, the shadow is difficult to discern, so the difference between the color information contained in the imaging data and the color range of the overall map data is small. For this reason, when two lead components 550 overlap in the black area 552, setting the threshold to 10 allows for appropriate determination of the overlap of the lead components 550. However, if the lead components 550 do not overlap, but the overlap of the lead components 550 is determined using a threshold of 10 for the white area 554 of the lead components 550, the threshold is too small, and there is a risk that the difference between the color information contained in the imaging data and the color range of the overall map data will exceed the threshold due to light reflection, etc. In such cases, the lead components 550 will be judged to be overlapping even though they do not.

[0090] In light of this, the individual control device 452 uses different thresholds for the black area 552 and the white area 554 of the lead component 550 to determine overlap of the lead component 550. Specifically, a threshold of 10 is set for determining overlap of the lead component 550 in the black area 552, and a threshold of 100 is set for determining overlap of the lead component 550 in the white area 554. The individual control device 452 then recognizes the black area 552 and the white area 554 of the lead component 550 based on the color information contained in the imaging data. Next, the individual control device 452 calculates the difference between the color information contained in the imaging data of the area recognized as the black area 552 and the color range of the overall map data, and determines whether the calculated difference is greater than or equal to the threshold of 10. The individual control device 452 also calculates the difference between the color information contained in the imaging data of the area recognized as the white area 554 and the color range of the overall map data, and determines whether the calculated difference is greater than or equal to the threshold of 100. In this way, the individual control device 452 can appropriately determine the overlap of two-tone lead components 550 by using different thresholds for the black area 552 and the white area 554 of the lead component 550.

[0091] Furthermore, in the comprehensive map data described above, overlapping of lead parts is determined based on image data inside the outline of the lead part, but it is also possible to determine overlapping of lead parts based on image data of a determination area set outside the outline of the lead part. Specifically, as shown in Figure 30, a determination area 562 (the area shown by the diagonal lines) that surrounds the entire lead part 560 is set in advance. This determination area 562 is the area between the rectangular outer frame 564 and the outline 566 of the lead part 560. Then, as shown in Figure 12, when multiple lead parts are scattered on the stage 156, the 2D camera 290 images these multiple lead parts. The individual control device 452 then performs a binarization process that assigns each pixel of the determination area 562 to two colors, black and white, based on the image data. In other words, the individual control device 452 calculates the binarized values ​​of the determination area 562 based on the image data. The determination area 562 surrounds the outline of the lead component 560. For example, if there is no overlap in the lead component 560, the binarized value of the determination area 562 will be the same as the binarized value of the stage 156. Therefore, the individual control device 452 compares the binarized value of the determination area 562 with the binarized value of the stage 156. The binarized value of the stage 156 is stored in the storage device 458. If the difference between the binarized value of the determination area 562 and the binarized value of the stage 156 is greater than or equal to a threshold, the individual control device 452 determines that there is overlap in the lead component 560.

[0092] However, since the outer frame 564 of the determination area 562 is rectangular, the outer frame 564 of the determination area 562 is separated from the outer outline 566 of the lead part 560 around the lead part 568 of the lead part 560. For this reason, as shown in Figure 31, if lead parts 570 different from lead part 560 are scattered around the lead part 568 of lead part 560, a part of the lead part 570 enters the determination area 562 of lead part 560. In this way, when a part of the lead part 570 enters the determination area 562 of lead part 560, it is judged that lead part 560 and lead part 570 are overlapping, even though they are not overlapping. In this way, when lead parts are judged to be overlapping even though there is no overlap, the number of parts to be picked up decreases, and it becomes impossible to efficiently pick up parts from the stage 156.

[0093] In light of the above, as shown in Figure 32, a predetermined width area surrounding the component outline 566 of the lead component 560 is set as the determination area 580 of the lead component 560. Specifically, the individual control device 452 identifies the component outline 566 of the lead component 560 according to the method described above, that is, the method explained using Figures 21 to 25. The individual control device 452 then calculates an outer frame 582 at a predetermined distance, for example, 1 mm away from the component outline 566 of the lead component 560. The outer frame 582 is not a rectangle, but is 1 mm larger than the component outline 566 of the lead component 560. The individual control device 452 then sets the area enclosed by the component outline 566 and the outer frame 582 as the determination area 580. In other words, the individual control device 452 sets a 1 mm wide area surrounding the component outline 566 as the determination area 580. Then, the individual control device 452 registers the determination area 580 in the storage device 458.

[0094] The individual control device 452 then performs overlapping detection of parts in the determination area 580. In this case, for example, as shown in Figure 33, even if lead parts 570 are scattered around the leads 568 of lead part 560, the lead parts 570 will not enter the determination area 580 of lead part 560. This makes it possible to properly determine overlapping parts even when lead parts 570 are scattered around the leads 568 of lead part 560.

[0095] Furthermore, when the individual control device 452 performs overlapping component determination in the determination area 580, as shown in Figure 34, it is desirable that it be determined that lead component 570 overlaps lead component 560 if lead component 570 enters the determination area 580 of lead component 560. However, as shown in Figure 35, it is undesirable that it be determined that lead component 570 overlaps lead component 560 if lead component 570 enters the determination area 580 of lead component 560 but does not overlap lead component 560. In view of this, the determination area 580 is divided into multiple sub-regions, and the individual control device 452 performs overlapping component determination in each of these sub-regions.

[0096] Specifically, the segmentation image 600 shown in Figure 36 is stored in the storage device 458. The segmentation image 600 is a rectangular image larger than the outer dimensions of the lead component 560, and a rectangular frame 610 with the same dimensions as the outer dimensions of the component body (see Figure 37) 569 of the lead component 560 is drawn in the center of the segmentation image 600. The segmentation image 600 is also composed of four segmented images 602, 604, 606, and 608, and the inside of the frame 610 is divided into four segmented images 602, 604, 606, and 608 along the diagonal. The outside of the frame 610 is also divided into four segmented images 602, 604, 606, and 608. Then, as shown in Figure 37, the individual control device 452 positions the lead component 560 in the segmentation image 600 so that the frame 610 and the component body 569 of the lead component 560 overlap. In this process, the individual control device 452 divides the determination area 580 of the lead component 560 into areas that overlap with each of the four divided images 602, 604, 606, and 608. As a result, as shown in Figure 38, the determination area 580 is divided into a divided area 620 that overlaps with divided image 602, a divided area 622 that overlaps with divided image 604, a divided area 624 that overlaps with divided image 606, and a divided area 626 that overlaps with divided image 608. The arrangement of the lead component 560 in the division image 600 and the division of the determination area 580 into divided areas 620, 622, 624, and 626 are performed by the calculation processing of the individual control device 452.

[0097] In this way, when the determination area 580 is divided into sectioned areas 620, 622, 624, and 626, the individual control device 452 performs overlapping of parts based on the imaging data of each sectioned area 620, 622, 624, and 626. Specifically, the individual control device 452 performs binarization processing on each sectioned area 620, 622, 624, and 626 based on the imaging data. The individual control device 452 then calculates the area where the difference between the binarized value of sectioned area 620 and the binarized value of stage 156 corresponding to sectioned area 620 is greater than or equal to a threshold. The individual control device 452 also calculates the area where the difference between the binarized value of sectioned area 622 and the binarized value of stage 156 corresponding to sectioned area 622 is greater than or equal to a threshold. Furthermore, the individual control device 452 calculates the area where the difference between the binarized value of the partitioned area 624 and the binarized value of the stage 156 corresponding to the partitioned area 624 is greater than or equal to a threshold. Furthermore, the individual control device 452 calculates the area where the difference between the binarized value of the partitioned area 626 and the binarized value of the stage 156 corresponding to the partitioned area 626 is greater than or equal to a threshold.

[0098] Then, the individual control device 452 determines whether the calculated area in at least one of the divided regions 620, 622, 624, and 626 is greater than or equal to a predetermined area, for example, 3 mm 2 It is determined whether or not the above is true. In this case, in at least one of the divided regions 620, 622, 624, 626, the calculated area is 3 mm². 2 If the above is true, it is assumed that lead component 570 overlaps lead component 560, as shown in Figure 34. In other words, the determination area 580 is divided into four partitioned areas 620, 622, 624, and 626, and the area of ​​each partitioned area 620, 622, 624, and 626 is relatively small. The area calculated in these small partitioned areas 620, 622, 624, and 626 is 3 mm². 2 If the result is greater than or equal to 3 mm², the calculated area is 3 mm². 2 It is assumed that the lead component 570 significantly encroaches on the above-mentioned partitioned region. Therefore, in at least one of the partitioned regions 620, 622, 624, and 626, the calculated area is 3 mm². 2If the above condition is satisfied, the individual control device 452 determines that the lead component 570 overlaps the lead component 560.

[0099] On the other hand, in any of the divided regions 620, 622, 624, and 626, the calculated area is 3 mm 2 If it is less than the above value, as shown in FIG. 35, it is assumed that the lead component 570 does not overlap the lead component 560. That is, when the area calculated in each of the divided regions 620, 622, 624, and 626 is 3 mm 2 If it is less than the above value, the 3 mm of the lead component 570 2 Only the portion corresponding to an area less than the above value enters each of the divided regions 620, 622, 624, and 626. In other words, the 3 mm of the lead component 570 2 Only the portion corresponding to an area less than the above value enters each of the divided regions 620, 622, 624, and 626, and it is assumed that the lead component 570 hardly enters any of the divided regions 620, 622, 624, and 626. Therefore, in any of the divided regions 620, 622, 624, and 626, the calculated area is 3 mm 2 If it is less than the above value, the individual control device 452 determines that the lead component 570 does not overlap the lead component 560.

[0100] In this way, the determination region 580 is divided into a plurality of divided regions 620, 622, 624, and 626, and the individual control device 452 performs component overlap determination in each of the plurality of divided regions 620, 622, 624, and 626, whereby the component overlap determination can be appropriately performed.

[0101] Furthermore, the judgment area for determining overlapping parts differs for each color of the stage 156. For details, the judgment area 580 explained earlier using Figure 32 corresponds to the black stage 156. On the other hand, as the judgment area corresponding to the white stage 156, as shown in Figure 39, a predetermined width area surrounding the part outline 632 of the lead part 630 is set as the judgment area. Specifically, the individual control device 452 identifies the part outline 632 of the lead part 630 according to the method described above, that is, the method explained using Figures 21 to 25. Then, the individual control device 452 calculates an inner frame 634 at a predetermined distance, for example, 1 mm away from the part outline 632 of the lead part 630. Furthermore, the individual control device 452 calculates an outer frame 636 at a predetermined distance, for example, 1 mm away from the inner frame 634. Then, the individual control device 452 sets the area enclosed by the inner frame 634 and the outer frame 636 as the judgment area 638 corresponding to the white stage 156. In other words, the individual control unit 452 sets a 1 mm wide area surrounding the component outline 632, at a distance of 1 mm from the component outline 632, as the determination area 638. Then, the individual control unit 452 registers the determination area 638 in the storage device 458.

[0102] In this way, a 1 mm wide area surrounding the component outline 632, while being 1 mm away from the component outline 632, is set as the determination area 638 corresponding to the white stage 156. On the white stage 156, the shadow of the lead component 630 is projected near the edge of the lead component 630, that is, near the component outline 632. Therefore, if the determination area 638 is set near the component outline 632, the projected shadow of the lead component 630 may be mistakenly identified as another component. In such cases, it is mistakenly determined that the components are overlapping even though there is no overlap. Therefore, a 1 mm wide area surrounding the component outline 632, while being 1 mm away from the component outline 632, is set as the determination area 638 corresponding to the white stage 156. This allows for proper overlap detection of lead components even on the white stage 156.

[0103] Incidentally, stage 156 is an example of a stage. Lead components 410, 550, 560, and 630 are examples of components. Individual control device 452 is an example of an information processing device. Black area 552 is an example of an area. White area 554 is an example of an area. Judgment areas 580 and 638 are examples of judgment areas. Section areas 620, 622, 624, and 626 are examples of section areas.

[0104] In the embodiments described above, the following effects are achieved.

[0105] The individual control unit 452 determines whether there is overlap of lead parts 550 on the stage 156 based on whether the difference between the image data of the lead parts 550 scattered on the stage 156 and the overall map data of the lead parts 550 set in advance as model data is greater than or equal to a threshold. The lead parts 550 are divided into black areas 552 and white areas 554, and the individual control unit 452 uses different thresholds for each area to determine whether there is overlap of lead parts 550 on the stage 156. This makes it possible to appropriately determine the overlap of two-tone lead parts 550.

[0106] Furthermore, the individual control device 452 determines whether or not the lead components 550 overlap on the stage 156 based on whether or not the difference between the color information contained in the imaging data of the lead components 550 and the color information contained in the overall map data is greater than or equal to a threshold. This makes it possible to appropriately determine whether or not the lead components 550 overlap.

[0107] Furthermore, the individual control device 452 determines whether or not there is overlap of lead components on the stage 156 based on the image data of determination areas 580, 638 of a predetermined width that surround the outlines 566, 632 of the lead components 560, 630, which are scattered on the stage 156. This makes it possible to appropriately determine whether or not there is overlap of lead components.

[0108] Furthermore, the judgment area includes a judgment area 580 corresponding to the black stage 156 and a judgment area 638 corresponding to the white stage 156. In other words, the judgment area differs for each color of the stage 156. This makes it possible to appropriately detect overlapping lead components regardless of the color of the stage 156.

[0109] Furthermore, the determination area 580 corresponding to the black stage 156 is the area between the component outline 566 and the outer frame 582 of the lead component 560, as shown in Figure 32. On the other hand, the determination area 638 corresponding to the white stage 156 is the area between the inner frame 634 and the outer frame 636 of the lead component 630, which is a predetermined distance from the component outline 632, as shown in Figure 39. In other words, the whiter the color of the stage 156, the further the determination area is from the component outline of the lead component. This makes it possible to appropriately determine the overlap of lead components without being affected by the shadow of the lead components.

[0110] Furthermore, the determination area 580 is divided into multiple sub-regions 620, 622, 624, and 626. The individual control device 452 then determines whether or not there is overlap of lead components on the stage 156 based on the imaging data from each of the sub-regions 620, 622, 624, and 626. This makes it possible to appropriately determine whether or not there is overlap of lead components.

[0111] It should be noted that the present invention is not limited to the above embodiments, and can be implemented in various modified or improved forms based on the knowledge of those skilled in the art. Specifically, for example, in the above embodiments, the lead component 550 is divided into a black area 552 and a white area 554, but it may be divided into various colors other than black and white, such as red, yellow, blue, etc., and different thresholds may be set for each color. Alternatively, the lead component may be divided not by color, but by various factors such as material, shape, reflectivity, etc., and different thresholds may be set for each factor.

[0112] Furthermore, in the above embodiment, the individual control device 452 determines whether the parts overlap based on whether the difference between the color information of the integrated map data and the color information included in the imaging data of the lead part 550 is greater than or equal to a threshold. Alternatively, the individual control device 452 may create integrated map data using numerical values ​​different from the color information, for example, binarized numerical values, and determine whether the parts overlap based on whether the difference between the binarized numerical values ​​of the integrated map data and the binarized numerical values ​​included in the imaging data of the lead part 550 is greater than or equal to a threshold.

[0113] Furthermore, in the above embodiment, the individual control device 452 performs part overlap determination based on the binarized numerical values ​​of the determination regions 580 and 638. On the other hand, the individual control device 452 may also perform part overlap determination based on numerical values ​​different from the binarized numerical values ​​of the determination regions 580 and 638, for example, color information.

[0114] Furthermore, in the above embodiment, hue H, saturation S, and lightness V are used as color information, but at least one of hue H, saturation S, and lightness V may be used.

[0115] Furthermore, in the above embodiment, the individual control device 452 of the component mounting machine 10 creates the model data and the determination areas 580 and 638, but an information processing device different from the component mounting machine 10 may also create the model data and the determination areas 580 and 638. The model data and determination areas 580 and 638 created by an information processing device different from the component mounting machine 10 are registered in the storage device 458.

[0116] Furthermore, although the present invention is applied to leaded components in the above embodiment, it can be applied to various types of components. Specifically, for example, the present invention can be applied to components of solar cells, components of power modules, and electronic circuit components without leads.

[0117] 156: Stage 410: Lead component (part) 452: Individual control device (information processing device) 550: Lead component (part) 552: Black area (area) 554: White area (area) 560: Lead component (part) 580: Judgment area 620: Classification area 622: Classification area 624: Classification area 626: Classification area 630: Lead component (part) 638: Judgment area

Claims

1. An information processing device that determines whether or not there is overlap of parts on a stage based on whether or not the difference between image data of parts scattered on a stage and pre-set model data of the parts is greater than or equal to a threshold, wherein the parts are divided into multiple areas, and the information processing device determines whether or not there is overlap of parts on the stage using different thresholds for each of the multiple areas.

2. The information processing apparatus according to claim 1, which determines whether or not the components overlap on the stage based on whether or not the difference between the color information contained in the imaging data and the color information contained in the model data is greater than or equal to the threshold.

3. The information processing apparatus according to claim 1 or claim 2, wherein the components are divided into a plurality of areas according to color, and the presence or absence of overlap of the components on the stage is determined using different thresholds for each of the plurality of areas.

4. The information processing apparatus according to claim 3, wherein the component is divided into two areas, a black area and an area of ​​a color other than black, and different thresholds are used for each of the two areas to determine whether or not the component overlaps on the stage.

5. An information processing device that determines whether or not there is overlap between components on the stage, based on imaging data of a predetermined width determination area surrounding the outline of a component from among the imaging data of components scattered on the stage.

6. The information processing apparatus according to claim 5, wherein the determination area differs for each color of the stage.

7. The information processing apparatus according to claim 6, wherein the determination area is further away from the outline of the component as the color of the stage becomes whiter.

8. The information processing apparatus according to any one of claims 5 to 7, wherein the determination area is divided into a plurality of partitioned areas, and the presence or absence of overlap of the components on the stage is determined based on the imaging data of each of the plurality of partitioned areas.