Inspection image display system and inspection image display method

The inspection image display system addresses the challenge of defect analysis by graphically overlaying mounting information on inspection images, facilitating efficient defect cause inference.

JP7954205B2Active Publication Date: 2026-11-19FUJI CORP
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
JP2024530076
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2022-06-27
Publication Date
2026-11-19
Estimated Expiration
2042-06-27

AI Technical Summary

Technical Problem

Existing inspection technologies struggle to facilitate easy inference of defect causes and circumstances in component mounting, requiring significant effort and time to investigate defects on boards.

Method used

An inspection image display system that graphically overlays mounting information, including positional and angular relationships, onto inspection images to support defect analysis.

Benefits of technology

Enables inspectors to infer defect causes and histories by visualizing the relative positional relationship between components and mounting tools, enhancing defect investigation efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007954205000001
    Figure 0007954205000001
  • Figure 0007954205000002
    Figure 0007954205000002
  • Figure 0007954205000003
    Figure 0007954205000003
Patent Text Reader

Abstract

This inspection image display system comprises: an information acquisition unit that acquires mounting information including positional information that represents the relative positional relationship between a component mounting tool that performs mounting operation to mount a component at a predetermined mounting position set on a substrate and the component held by the component mounting tool, the positional information being used to correct the position of the component mounting tool when performing the mounting operation; an image acquisition unit that acquires an inspection image by capturing an image of the substrate on which the component is mounted; and an image display unit that diagrammatizes the mounting information and overlays the result on the inspection image to display same.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present specification relates to a system for displaying an inspection image used for inspecting a board on which components are mounted, and a method for displaying the inspection image.

Background Art

[0002] Technologies for mass-producing board products by performing board-related work on boards on which circuit patterns are formed have become widespread. Examples of board-related work machines that perform board-related work include component mounters that mount components on boards using component mounting tools, and board inspection machines responsible for inspecting boards on which components are mounted. In general, a board inspection machine captures an image of a board on which components are mounted to acquire an inspection image, and performs image processing on the inspection image to determine the quality of the component mounting state (such as mounting position and mounting posture). One example of a technology for inspecting a board using an inspection image is disclosed in Patent Document 1.

[0003] The NG component display method of Patent Document 1 superimposes and displays on a screen an image of a component that has a feature portion usable for direction inspection and is determined to be unacceptable (defective) in board appearance inspection, a component shape frame arranged at an equal magnification at the ideal position of the component, and a feature emphasizing portion that highlights the ideal position of the feature portion. According to this, it is said that an operator can easily confirm on the screen the difference between the ideal component mounting state and the mounting state of the component that has been determined to be unacceptable in the board appearance inspection.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] Incidentally, in the technical example of Patent Document 1, it is preferable that the inspector can easily confirm how much the position of the part determined to be defective deviates from the ideal position. However, even if the inspector can confirm the condition determined to be defective, it is often difficult to infer the cause and circumstances under which the defect occurred. This type of defect can occur due to various factors at various stages of substrate processing. For this reason, a great deal of effort and time is often spent investigating the cause of the defect and considering measures to prevent recurrence.

[0006] Therefore, this specification aims to provide an inspection image display system and inspection image display method that support the investigation of the causes and circumstances of defects in the mounting condition of components mounted on a substrate. [Means for solving the problem]

[0007] This specification discloses an inspection image display system comprising: a component mounting device that performs a mounting operation to mount a component to a predetermined mounting position set on a substrate; an information acquisition unit that acquires mounting information including position information representing the relative positional relationship between the component held by the component mounting device and the component, and which is used to correct the position of the component mounting device when performing the mounting operation; an image acquisition unit that captures an image of the substrate on which the component is mounted to acquire an inspection image; and an image display unit that displays the mounting information graphically overlaid on the inspection image.

[0008] Furthermore, this specification discloses an inspection image display method comprising: a component mounting device that performs a mounting operation to mount a component to a predetermined mounting position set on a substrate; an information acquisition step of acquiring mounting information which includes position information representing the relative positional relationship between the component held by the component mounting device and the component, and which is used to correct the position of the component mounting device when performing the mounting operation; an image acquisition step of capturing an inspection image by imaging the substrate on which the component is mounted; and an image display step of displaying the mounting information graphically overlaid on the inspection image.

[0009] Furthermore, this specification discloses the technical idea of ​​changing "the inspection image display system described in claim 2" to "the inspection image display system described in any one of claims 2 to 5" in claim 6 of the original application; the technical idea of ​​changing "the inspection image display system described in any one of claims 1 to 6" to "the inspection image display system described in any one of claims 1 to 8" in claim 9 of the original application; the technical idea of ​​changing "the inspection image display system described in any one of claims 1 to 6" to "the inspection image display system described in any one of claims 1 to 10" in claim 11 of the original application; and the technical idea of ​​changing "the inspection image display system described in any one of claims 1 to 6" to "the inspection image display system described in any one of claims 1 to 11" in claim 12 of the original application. [Effects of the Invention]

[0010] In the disclosed inspection image display system and inspection image display method, positional information representing the relative positional relationship between the component mounting fixture and the component is graphically represented and overlaid on the inspection image. This allows, for example, an inspector to infer the cause and history of a defect in the component's mounting condition by referring to the relative positional relationship displayed in the inspection image. Therefore, the inspection image display system and inspection image display method can support the investigation of the cause and history of defects. [Brief explanation of the drawing]

[0011] [Figure 1] This figure schematically shows the line configuration of a component mounting line that includes the inspection image display system of the first embodiment. [Figure 2] This is a schematic perspective view showing an example configuration of a parts mounting machine. [Figure 3] This is a view of the nozzle tool and suction nozzle from below, and corresponds to an image acquired by a component camera when it captures the suction nozzle holding the component. [Figure 4] This is a plan view illustrating a circuit board with components mounted on it, and corresponds to an inspection image acquired by an inspection camera capturing the circuit board. [Figure 5] This is a diagram illustrating the operation flow of the inspection image display system according to the first embodiment. [Figure 6] This figure shows an example of an examination image. [Figure 7] This figure shows an example of displaying fitting information graphically overlaid on an inspection image. [Figure 8] This figure shows another example where fitting information is visualized and overlaid on the inspection image. [Figure 9] This figure schematically shows the configuration of the inspection image display system of the second embodiment. [Figure 10] This figure shows an example of selecting the installation information to display based on whether or not there is a possibility of interference. [Modes for carrying out the invention]

[0012] 1. Line configuration of parts mounting line 9 First, the line configuration of the component mounting line 9, which includes the inspection image display system 1 of the first embodiment, will be explained with reference to Figure 1. In Figure 1, the left side is the upstream side of the line, and the right side is the downstream side of the line. The component mounting line 9 is a line that produces circuit board products by mounting components onto a circuit board on which a circuit pattern has been formed. The component mounting line 9 consists of four modular component mounting machines 92, a large component mounting machine 93, a circuit board inspection machine 94, and a production information server 96, etc. The four component mounting machines 92 have the same structure and are arranged in a row on a common base 91.

[0013] Upstream from the component mounting machine 92, a solder printing machine and a printing inspection machine (not shown) are arranged side by side. The solder printing machine prints paste-like solder onto the lands (electrodes to which components are soldered) of the circuit board on which the circuit pattern is formed. The printing inspection machine inspects the solder printing condition. Circuit boards that are judged to be good by the printing inspection machine are fed into the component mounting machine 92. Each of the four component mounting machines 92 performs a mounting operation in which components are attached to the circuit board using a suction nozzle equivalent to a component mounting tool. The four component mounting machines 92 share the task of mounting a large number of small and medium-sized components.

[0014] The large component mounter 93 is arranged side by side on the downstream side of the component mounter 92. The component mounter 93 performs a component mounting operation using a large suction nozzle corresponding to a component mounting tool, or a mechanically driven component mounting tool having a chuck for gripping a component. The component mounter 93 is in charge of mounting operations for large components and special-shaped components. The component mounter 93 may be provided with a tray-type component supply device (not shown).

[0015] The board inspection machine 94 is arranged side by side on the downstream side of the component mounter 93. The board inspection machine 94 uses an inspection camera to capture an image of the board on which components are mounted, and acquires an inspection image. Further, the board inspection machine 94 performs image processing on the inspection image to determine whether the mounting state of each of the plurality of components is good or defective. A reflow machine (not shown) is arranged on the downstream side of the board inspection machine 94. The reflow machine heats and melts the paste-like solder, and further cools it, thereby stabilizing the soldering state of the components.

[0016] The production information server 96 is communicatively connected to the component mounters (92, 93) and the board inspection machine 94 via a LAN 95 (local area network). The production information server 96 exchanges information with the component mounters (92, 93) and the board inspection machine 94 as necessary, and performs production management of board products. The production information server 96 stores component data 971, device data 972, job data 973, and operation history data 974 in the attached memory 97, and updates them sequentially.

[0017] The component data 971 is data storing information on various types of components to be mounted on a board. The component data 971 includes component outer shape information representing the shape of various components, the size of the outer profile, electrodes and the like, the appearance color, and the like. Further, the component data 971 includes information such as electrical characteristics, manufacturer, packaging form, and handling conditions of various components. The device data 972 is data storing the structure, performance, and the like of the component mounters (92, 93) and the board inspection machine 94. The device data 972 includes information on tools such as component mounting tools used by the component mounters (92, 93) and tools such as an inspection camera used by the board inspection machine 94, for example, information such as the shape, performance, and usage conditions of the tools.

[0018] The job data 973 is data storing the work content of board-related work to be performed on a board. The job data 973 includes design data representing the type of the board, as well as the type of components to be mounted and mounting coordinates. The job data 973 also includes production data that defines the mounting order of a plurality of components in the component mounters (92, 93) and the component mounting tools to be used. Further, the job data 973 includes imaging conditions of the inspection camera that captures an inspection image in the board inspection machine 94, image processing conditions of the inspection image, pass / fail judgment conditions, and the like. The job data 973 is created for each type of board product. The operation history data 974 is data storing the history of operations when the component mounters (92, 93) and the board inspection machine 94 are operated.

[0019] The production information server 96 transmits the job data 973 to the component mounters (92, 93) and the board inspection machine 94 respectively when producing a board. The component mounters (92, 93) and the board inspection machine 94 perform board-related work in accordance with the received job data 973. The component mounters (92, 93) and the board inspection machine 94 refer to the component data 971 and the device data 972 as necessary based on the description of the job data 973. The component mounters (92, 93) and the board inspection machine 94 convert the operations during operation into data, and transmit the data to the production information server 96. The production information server 96 sequentially updates the operation history data 974 using the received data.

[0020] 2. Example configuration of the component mounting machine 92 Next, an example of the configuration of the component mounting machine 92 will be described with reference to Figure 2. In the example shown in Figure 2, two component mounting machines 92 are arranged adjacent to each other on a common base 91, and the remaining two component mounting machines 92 are not shown. The direction in which the four component mounting machines 92 are arranged coincides with the X-axis direction for transporting the substrate, and the horizontal direction perpendicular to the X-axis direction is the Y-axis direction. The component mounting machine 92 includes a mounting machine housing 20, a substrate transport device 22, a head moving device 24, a mounting head 26, a component supply device 28, a nozzle station 30, a component camera 32, and a control device 34, etc.

[0021] The mounting machine housing 20 consists of a frame section 201 and a beam section 202 that spans the upper part of the frame section 201. Furthermore, an openable and closable cover 203 is provided above the beam section 202. The cover 203 is shown in the left component mounting machine 92, but is omitted in the right component mounting machine 92.

[0022] The substrate transport device 22 comprises two sets of conveyor devices (221, 222) and a substrate holding mechanism (not shown). The two conveyor devices (221, 222) are mounted on the frame 201 so as to be parallel to each other and extending in the X-axis direction. Each of the conveyor devices (221, 222) is rotary-driven by a motor (not shown) to transport the substrate it supports in the X-axis direction. The two substrate holding mechanisms are located approximately in the lower center of each of the conveyor devices (221, 222). Each of the substrate holding mechanisms holds the substrate in a predetermined mounting position.

[0023] As shown in Figure 2, the parts supply device 28 is configured with a plurality of tape feeders 29 arranged in the X-axis direction. Each tape feeder 29 rotatably holds a tape reel. A carrier tape, each containing parts in a row of storage pockets, is wound around the tape reel. Each tape feeder 29 feeds the carrier tape to the supply position in a pitch-by-pitch manner using a tape feeding mechanism (not shown). In this way, the tape feeder 29 supplies parts at the supply position. Note that a reel holding mechanism for rotatably holding the tape reel may be configured separately from the tape feeder 29.

[0024] The head movement device 24 is an XY robot type device. The head movement device 24 includes an X-axis motor (not shown) for sliding the slider 25 in the X-axis direction, and a Y-axis motor (not shown) for sliding the slider 25 in the Y-axis direction. A mounting head 26 is attached to the side of the slider 25 in the negative Y-axis direction. The mounting head 26 is driven by the X-axis motor and the Y-axis motor to move to any position on the frame portion 201. A nozzle tool 27 is detachably provided on the underside of the mounting head 26. The mounting head 26 is not limited to this, and may be a rotary type head on which the nozzle tool 27 is permanently attached. A plurality of suction nozzles 4 are provided on the underside of the nozzle tool 27 (details will be described later). The suction nozzles 4 are a form of component mounting device that performs a mounting operation to mount components to predetermined mounting positions set on the substrate.

[0025] A substrate camera (not shown) with a downward-facing optical axis is provided below the slider 25 or mounting head 26. The substrate camera captures position reference marks attached to the substrate held in the mounting position and acquires image data. The acquired image data is processed to accurately determine the mounting position of the substrate. This calibrates the relative positional relationship between the first XY coordinate system of the head moving device 24 and the second XY coordinate system representing the mounting position of the component on the substrate.

[0026] The nozzle station 30 is located adjacent to the parts supply device 28. The nozzle station 30 houses multiple suction nozzles 4 in an interchangeable manner. The suction nozzles 4 housed in the nozzle station 30 are automatically replaced with the suction nozzles 4 attached to the mounting head 26 as needed.

[0027] The component camera 32 is installed between the substrate transport device 22 and the component supply device 28. The component camera 32 is positioned so that its optical axis is facing upward. The component camera 32 captures image data by photographing the suction nozzle 4 holding the component. The component camera 32 takes images when the mounting head 26 is temporarily stopped above it. Alternatively, the component camera 32 may take images at the moment the mounting head 26 passes above it by increasing the shutter speed. The relative positional relationship between the suction nozzle 4 and the held component is detected by image processing of the image data and reflected in the mounting operation (details will be described later). As the component camera 32, a digital imaging device having an image sensor such as a CCD or CMOS can be exemplified.

[0028] The control device 34 is assembled to the frame section 201, and its position is not particularly limited. The control device 34 is configured using a computer device having a CPU, memory, input / output section, etc. The control device 34 may also be configured with multiple CPUs distributed within the machine and connected via communication. The control device 34 controls the substrate transport device 22 and the component supply device 28 based on the job data 973. The control device 34 includes an imaging control unit 35 that controls the imaging operation of the component camera 32, and an image processing unit 36 ​​that performs image processing on the image data acquired by the component camera 32. Furthermore, the control device 34 includes a mounting control unit 37 that coordinately controls the mounting head 26, nozzle tool 27, and suction nozzle 4, etc., to perform mounting operations.

[0029] 3. Configuration and Function of Nozzle Tool 27 Next, the configuration and function of the nozzle tool 27 will be explained with reference to Figure 3. Note that Figure 3 is a view from below, and the positive and negative directions of the Y-axis are reversed compared to Figure 2. The nozzle tool 27 has a roughly cylindrical outer shape and is formed as a rotating body that rotates around the vertical central axis AV. The nozzle tool 27 rotates driven by an R-axis rotation drive mechanism (not shown). The nozzle tool 27 has multiple (eight in the example of Figure 3) suction nozzles 4 that revolve around the vertical central axis AV due to its own rotation.

[0030] The suction nozzle 4 is selectively supplied with negative and positive pressure air from an air supply system (not shown). The suction nozzle 4 also rotates, driven by a Q-axis rotation drive mechanism (not shown). Furthermore, the suction nozzle 4 moves up and down, driven by a Z-axis drive mechanism 261 provided on the mounting head 26. In other words, the suction nozzle 4 can move up and down when it has revolved and entered the position below the Z-axis drive mechanism 261. The suction nozzle 4 remains in the raised position except when it is in the position below the Z-axis drive mechanism 261.

[0031] The suction nozzle 4 performs a suction operation to pick up component P from the tape feeder 29 and a mounting operation to attach component P to the substrate, in accordance with coordinated control combining the selective supply of negative and positive pressure air and its lifting and lowering movement. In Figure 3, the suction nozzle 4 located below the Z-axis drive mechanism 261 is conveniently designated as the first suction nozzle 41, and the second suction nozzle 42 to the eighth suction nozzle 48 are designated clockwise thereafter. Furthermore, in accordance with the description in job data 973, the suction operation and mounting operation of component P are performed sequentially in the mounting order from the first suction nozzle 41 to the eighth suction nozzle 48. Component P is a rectangular component in plan view, and has a pair of electrodes for connection on its bottom and top surfaces. However, the suction nozzle 4 is not limited to this and can perform mounting operations for components with shapes other than rectangles.

[0032] 4. Functions of the imaging control unit 35, image processing unit 36, and mounting control unit 37 The imaging control unit 35 controls the component camera 32 to perform imaging and acquires image data representing the image shown in Figure 3. If the imaging field of view of the component camera 32 is limited, the imaging control unit 35 causes the component camera 32 to perform imaging multiple times to acquire multiple image data. Furthermore, the imaging control unit 35 can combine the multiple image data to acquire image data corresponding to Figure 3. The imaging control unit 35 then passes the acquired image data to the image processing unit 36.

[0033] The image processing unit 36 ​​performs image processing on the image data to calculate position information and angle information for each part P. The position information represents the relative positional relationship between the suction nozzles (41-48) and the held part P. More specifically, the position information is information that represents the relative positional relationship between the center position 4A of the opening at the tip 49 (corresponding to the holding point) of the suction nozzle (41-48) and the center of the part P, expressed in coordinate values ​​of the local xy coordinate system. In this embodiment, both the outer shape of the tip 49 and the opening shape of the opening are circular. However, it is not limited to this, and for example, the opening shape of the opening may be oval or elliptical.

[0034] The local xy coordinate system is defined with the center position 4A of each tip 49 of the suction nozzles (41-48) as the origin, the x-axis direction being tangent to the circumferential direction of the nozzle tool 27, and the positive y-axis direction being toward the vertical central axis AV of the nozzle tool 27. The position information is then represented by the coordinate values ​​of the center of the part P. According to this definition, when the suction nozzles (4, 41-48) move into the lower position of the Z-axis drive mechanism 261 by orbit and perform the part mounting operation, the axis directions of the local xy coordinate system and the XY coordinate system of the substrate are parallel. For mechanically driven part mounting devices, for example, a similar definition can be made with the center position of multiple chucks as the origin.

[0035] Furthermore, the angle information represents the relative rotational angle relationship between the suction nozzles (41-48) and part P. For example, the angle information is represented by the angle that the longer side of a rectangular part makes with the x-axis direction. For parts other than rectangles, a reference direction for the part can be defined, and the angle obtained by rotating this reference direction relative to the suction nozzles (41-48) can be used as the angle information.

[0036] In the example shown in Figure 3, the center position 4A of the tip 49 coincides with the center of the held part P in the first suction nozzle 41, second suction nozzle 42, third suction nozzle 43, fifth suction nozzle 45, and eighth suction nozzle 48. Therefore, the position information is represented as (0,0). Also, in these suction nozzles (41, 42, 43, 45, 48), the long side of the part P is parallel to the x-axis. Therefore, the angle information is represented as 0.

[0037] On the other hand, in the sixth suction nozzle 46, the center of part P is displaced by an amount dx in the positive x-axis direction relative to the center position 4A. Therefore, the position information is represented by (dx, 0), which represents the amount of displacement. Also, the long side of part P is parallel to the x-axis, and the angle information is represented by 0. In the seventh suction nozzle 47, the center of part P is displaced by an amount -dy in the negative y-axis direction relative to the center position 4A. Therefore, the position information is represented by (0, -dy), which represents the amount of displacement. Also, the long side of part P, which is a rectangular part, is parallel to the x-axis, and the angle information is represented by 0. On the other hand, in the fourth suction nozzle 44, the center position 4A and the center of part P coincide, and the position information is represented by (0, 0). Also, the long side of part P has an angle dA with respect to the x-axis. Therefore, the angle information is represented by dA.

[0038] Non-zero position information arises when the component P is displaced from the center of the storage pocket on the carrier tape used by the tape feeder 29. Non-zero angle information arises when the component P is rotating within the storage pocket. Furthermore, non-zero position and angle information can also arise from vibrations, airflow, and other factors that are incidentally superimposed when the suction nozzles (41-48) pick up the component P. The image processing unit 36 ​​passes the calculated position and angle information to the mounting control unit 37.

[0039] The mounting control unit 37 uses the received position information and angle information to correct the position and rotation angle of the suction nozzles (41-48) when performing the mounting operation. More specifically, when both the position information and angle information are zero, the mounting control unit 37 controls the center position 4A of the tip 49 of the suction nozzles (41, 42, 43, 45, 48) to align with a predetermined mounting position, and performs the mounting operation by lowering the suction nozzles (41, 42, 43, 45, 48) without rotating them. Furthermore, when the position information is not zero, the mounting control unit 37 adjusts the position of the mounting head 26 so that the suction nozzles (46, 47) are displaced from a predetermined mounting position by the amount of the position information, and performs the mounting operation by lowering the suction nozzles 4 without rotating them.

[0040] Furthermore, if the angle information is not zero, the mounting control unit 37 controls the fourth suction nozzle 44 to a predetermined mounting position, and then rotates the fourth suction nozzle 44 by the amount of the angle information before lowering it to perform the mounting operation. Also, if both the position information and angle information are not zero, the mounting control unit 37 performs a correction by adjusting the position of the mounting head 26 and rotating the suction nozzle 4 in combination. The mounting control unit 37 associates the position information and angle information used for correction during the mounting operation with the individual identification information of the suction nozzles (41-48) to create mounting information, and transmits this mounting information to the production information server 96. The production information server 96 stores the received mounting information in the operation history data 974.

[0041] The mounting control unit 37 may rotate the suction nozzle 4 depending on the mounting direction of the component P. For example, the mounting control unit 37 does not rotate the suction nozzle 4 when the longer side of the rectangular component is parallel to the X-axis direction, while the mounting control unit 37 rotates the suction nozzle 4 by 90° when the longer side of the rectangular component is parallel to the Y-axis direction. In this case, if the angle information is not zero, the mounting control unit 37 performs a correction by adding or subtracting the angle information from 90°.

[0042] The mounting operation controlled by the mounting control unit 37 mounts the component P onto the substrate K, for example, as shown in Figure 4. In the substrate K illustrated in Figure 4, four component P are mounted in the first area AR1 and the second area AR2, which are spaced apart from each other, and the long sides of the component P are parallel to the X-axis direction. Furthermore, in each of the first area AR1 and the second area AR2, the mounting positions of the four component P are determined to be at the vertices of a rectangle.

[0043] The eight components P were attached in order by the first suction nozzle 41 to the eighth suction nozzle 48 (shown by dashed lines for convenience) as described above. In other words, the component P in the lower left of the second area was attached first, and the components P were attached in a clockwise order thereafter. The attachment state of each component P is good, which means that the positional error of the attachment position and the rotational angle error of the attachment direction of the component P are within the acceptable range. Therefore, it can be seen that the correction of the displacement amount dx in the attachment operation of the sixth suction nozzle 46, the correction of the displacement amount -dy in the attachment operation of the seventh suction nozzle 47, and the correction of the angle dA in the attachment operation of the fourth suction nozzle 44 were performed well.

[0044] However, the corrections performed during the mounting operation described above do not always work well. Furthermore, there are cases where the mounting operation becomes unstable due to unexpected factors, or positional errors exceeding expectations occur. In these cases, component P may not be mounted. Alternatively, a mounting defect of component P, such as misalignment of component P, may occur. To assist inspectors in investigating the cause and circumstances of non-mounting or mounting defects of component P, the inspection image display system 1 of the first embodiment is used.

[0045] 5. Configuration of the inspection image display system 1 of the first embodiment As shown in Figure 1, the inspection image display system 1 of the first embodiment consists of four functional units, namely an information acquisition unit 5, an image acquisition unit 6, an image inspection unit 7, and an image display unit 8. The four functional units are provided in the board inspection machine 94. However, it is not limited to this, and at least one of the four functional units may be provided in other parts of the communication-connected component mounting line 9.

[0046] The information acquisition unit 5 acquires the mounting information (position information and angle information) stored in the operation history data 974 by the mounting control unit 37. Therefore, the information acquisition unit 5 is substantially composed of the component camera 32, imaging control unit 35, image processing unit 36, and memory 97 of the component mounting machine 92. In addition, the information acquisition unit 5 acquires mounting tool external shape information from the equipment data 972 based on the individual identification information of the suction nozzle 4 included in the mounting information. This mounting tool external shape information represents the external shape of the suction nozzles (4, 41~48) used by the component mounting machines (92, 93) for mounting the component P. The mounting tool external shape information includes the external shape and size of the tip 49 of the suction nozzle (4, 41~48), as well as the opening shape and size of the opening of the tip 49. In addition, the mounting tool external shape information includes the external shape information of mechanically driven component mounting tools used by the large component mounting machine 93. Furthermore, the information acquisition unit 5 acquires mounting order information from the job data 973, which represents the mounting order of multiple components P to be mounted on the substrate K.

[0047] The image acquisition unit 6 uses an inspection camera to image the substrate K on which the components P are mounted and acquires an inspection image. Figure 4 is an example of an acquired inspection image. However, the suction nozzles (41-48) shown by the dashed lines are not captured in the inspection image. The image inspection unit 7 performs image processing on the inspection image to determine whether the mounting state of each of the multiple components P is good or bad. In addition to the aforementioned failure to mount and misalignment of components P, mounting defects may include rotational misalignment in the mounting direction of components P, tilting, and tipping of components P.

[0048] The image display unit 8 displays mounting information graphically and overlays it on the inspection image. Specifically, the image display unit 8 graphically represents the center position 4A of the tip 49 of the suction nozzle 4 and displays the symbol at a position that satisfies the relative positional relationship with respect to the image of the part P in the inspection image. In this embodiment, a dashed "cross shape" is used as the symbol to graphically represent the center position 4A. The intersection of the two line segments forming the "cross shape" represents the center position 4A. Furthermore, the image display unit 8 rotates the "cross shape" symbol in the inspection image based on angle information and displays it. In addition, the image display unit 8 graphically represents the external shape information of the mounting device such as the suction nozzle 4 and displays it in correspondence with the "cross shape" symbol in the inspection image.

[0049] Furthermore, the image display unit 8 selects the installation information to display based on the judgment result of the image inspection unit 7. Specifically, the image display unit 8 displays only the installation information for the parts determined to be defective by the image inspection unit 7, and for surrounding parts located within a predetermined distance from the parts determined to be defective. In addition, the image display unit 8 displays the installation order of the corresponding parts in the vicinity of each of the multiple part images in the inspection image, based on the installation order information acquired by the information acquisition unit 5. Finally, the image display unit 8 transmits the image data of the displayed image to the production information server 96 and stores it in the operation history data 974. The functions of the image inspection unit 7 and the image display unit 8 will be described in detail with specific examples in the following operation description.

[0050] 6. Operation of the Inspection Image Display System 1 Next, the operation of the inspection image display system 1 will be explained with reference to Figures 5 to 7. The operation flow shown in Figure 5 includes not only the operation of the inspection image display system 1 but also the overall operation of the component mounting line 9. In step S1 of Figure 5, the production information server 96 transmits job data 973 to the component mounting machines (92, 93) and the board inspection machine 94, respectively. The component mounting machines (92, 93) and the board inspection machine 94 start production of the board product according to the received job data 973.

[0051] In the next step S2, the suction nozzle 4 of the component mounting machine 92 moves horizontally to above the tape feeder 29, then descends to pick up the component P (suction operation). In the next step S3, first, the mounting head 26 and the suction nozzle 4 move above the component camera 32. Next, the component camera 32 operates under control from the imaging control unit 35 to image the suction nozzle 4 holding the component P and acquire image data. Then, the image processing unit 36 ​​operates to perform image processing on the image data and calculates position information and angle information for each component P. Then, the mounting information, including the position information and angle information, is stored in the operation history data 974. The information acquisition unit 5 acquires mounting information, mounting tool external shape information, and mounting order information as described above. Step S3 corresponds to the information acquisition process in which the information acquisition unit 5 acquires mounting information including position information. Note that the information acquisition process may be performed at any time before step S8.

[0052] In the next step, S4, the suction nozzle 4 moves horizontally to above the substrate K, then descends to attach the component P to the substrate K (attachment operation). If there are many components P to be attached, steps S2 to S4 are repeated. Steps S2 to S4 are also performed similarly in the large component attachment machine 93. Once the attachment operation of all components P in the component attachment machines (92, 93) is completed, the operation flow proceeds to step S5.

[0053] In step S5, the substrate K with the components P mounted is transported to the substrate inspection machine 94. In the next step S6, the image acquisition unit 6 operates to image the transported substrate K and acquire the inspection image GT1 exemplified in Figure 6. Step S6 corresponds to the image acquisition process in which the image acquisition unit 6 acquires the inspection image GT1. The substrate K that was the target of the inspection image GT1 shown in Figure 6 is of the same type as the substrate K shown in Figure 4, but it is a different substrate. Therefore, the mounting information (position information and angle information) of the eight components P shown in Figure 6 differs from that in Figure 3, and the mounting state of the eight components P shown in Figure 6 differs from that in Figure 4.

[0054] In the next step S7, the image inspection unit 7 operates to perform image processing on the inspection image GT1 and inspect the mounting status of each of the multiple parts P. In the example of the inspection image GT1 shown in Figure 6, the image inspection unit 7 determines that the part PB in the lower left of the first area AR1 is defective and displays "NG" in the vicinity of the upper left of the part image. The image inspection unit 7 also determines that the other seven parts P are good and displays "OK" in the vicinity of the upper left of the images of those parts.

[0055] Furthermore, the image inspection unit 7 displays "TOLERANCE ERROR," indicating a faulty mounting condition, near the left side of the part image of the part PB that has been determined to be defective. In addition, the image inspection unit 7 displays the position error in the X-axis direction "X: -20 μm," the position error in the Y-axis direction "Y: -30 μm," and the rotation angle error "Q: 10 deg." The part PB in question was determined to be defective because at least one of the position errors in the X-axis direction and the Y-axis direction exceeded the allowable tolerance relative to the predetermined mounting position shown by the dashed line in Figure 6. The predetermined mounting position may or may not be displayed in the inspection image GT1. The allowable tolerance for the mounting position is set by multiplying the dimension of a specific part of the part P (for example, the dimension of the long side of a rectangular part) by a predetermined ratio (for example, 10 to 30%).

[0056] On the other hand, whether a rotational angle error of 10 degrees in the mounting direction of this component PB is acceptable depends on the set value of the angle tolerance. The inspector can visually examine the inspection image GT1 to confirm that this component PB has been determined to be defective. This type of defect can occur due to various factors such as vibrations, airflow disturbances, and control errors in various situations, such as when the suction nozzle 4 (component holder) picks up or mounts the component PB, when the suction nozzle 4 holding the component PB moves, and when the substrate K with the component PB mounted is transported. However, the conditions during the suction operation and mounting operation of the component PB in question are unknown. Therefore, even if the inspector visually examines the inspection image GT1, it is often difficult to infer the cause and circumstances of the defect.

[0057] In the next step S8, the image display unit 8 operates and displays a "cross shape" representing the center position 4A of the opening of the tip 49 of the suction nozzle 4, and the outer shape of the tip 49 of the suction nozzle 4, in such a way that the relative positional relationship with respect to the image of part P in the inspection image is satisfied. However, the image display unit 8 limits the parts (P, PB) to be displayed. Specifically, the image display unit 8 displays only installation information for part PB that has been determined to be defective by the image inspection unit 7, and for surrounding parts P that are located within a predetermined distance from the defective part PB.

[0058] In the example of inspection image GT1 shown in Figure 6, the surrounding parts P located within a predetermined distance from the part PB determined to be defective correspond to the three parts P within the first area AR1. Accordingly, the image display unit 8 displays the inspection image GT2 exemplified in Figure 7. Inspection image GT2 displays the four parts (P, PB) in the first area AR1, but does not display the four parts P in the second area AR2 that were determined to be good. This makes it possible to enlarge and display only the vicinity of the part PB determined to be defective, making it easier for inspectors to see. In Figure 7, the center position 4A of the suction nozzle 4 is shown as a dashed "cross shape," and the outer shape of the tip 49 of the suction nozzle 4 is shown as a dashed circle. The dashed circle corresponding to the outer shape of the tip 49 and its diameter are based on the attachment outer shape information acquired by the information acquisition unit 5.

[0059] Furthermore, the image display unit 8 displays the corresponding component mounting order in the vicinity of each component image of the four components (P, PB) in the inspection image GT2, based on the mounting order information acquired by the information acquisition unit 5. Specifically, "3", "4", "5", and "6", indicating the mounting order, are displayed in the vicinity of the lower right of the component images of the four components (P, PB). If there are no defects in the inspection result in step S7, step S8 is omitted. After the completion of step S8, or after the completion of step S7 if there are no defects, steps S2 and onward are repeated for the next substrate K.

[0060] Inspection image GT2 displays the relative positional relationship during the suction operation in which the suction nozzle 4 picks up the parts (P, PB). Specifically, for part PB in the lower left of area AR1, which was judged to be defective due to mounting order "3", the positional and angular information is approximately zero, indicating that the relative positional relationship between part PB and the suction nozzle 4 was good. By visually observing this display, the inspector can infer that the suction and mounting operations for part PB were performed correctly.

[0061] On the other hand, for part P in the upper left of area AR1, where the mounting sequence was judged as "4" and good, position information is displayed showing that part P is shifted relative to the suction nozzle 4 in the positive Y-axis direction. By visually observing this display, the inspector can infer that the suction nozzle 4 interfered with the already mounted part PB. In other words, the inspector can infer the cause and progression of the defect as follows: In the third mounting operation, part PB was initially mounted well in the predetermined mounting position. In the following fourth mounting operation, in order to compensate for the displacement of part P during the suction operation, the position of the suction nozzle 4 was corrected in the negative Y-axis direction based on the position information. As a result, the suction nozzle 4 approached the already mounted part PB, and when it descended, its tip 49 pushed part PB, causing it to slide laterally from the predetermined mounting position.

[0062] Furthermore, even if a component PB is determined to be defective in the mounting order "3", if the component PB is picked up by the suction nozzle 4 in the 4th or later mounting order, the positional displacement of the component PB may be slight, making interference unlikely. In this case, the inspector can infer causes other than interference and the circumstances of its occurrence, such as a control error in the mounting operation or lateral slippage of the component PB due to an accidental shock that occurred during the transport of the substrate K.

[0063] Furthermore, for part P in the upper right of area AR1, which was judged good with an installation order of "5", it is indicated that the position information was approximately zero and the angle information was not zero. An inspector who sees this indication can infer that the correction based on angle information was performed well during the installation of part P. In addition, for part P in the lower right of area AR1, which was judged good with an installation order of "6", it is indicated that the position information was not zero and the angle information was approximately zero. An inspector who sees this indication can infer that the correction based on position information was performed well during the installation of part P.

[0064] As described above, by overlaying mounting information onto the inspection image GT2, it becomes possible to infer the conditions during the suction and mounting operations of the suction nozzle 4. Furthermore, if a defect is detected by the image inspection unit 7, it becomes possible to infer the cause and progression of the defect. In other words, it provides support to the inspector in investigating the cause and progression of the defect. In addition, the display of the mounting order makes it easier for the inspector to make inferences and improves the accuracy of those inferences. If the mounting order is not displayed, the arrangement of already mounted parts P during the mounting operation of a certain suction nozzle 4 is unknown, making inferences difficult and tending to decrease in accuracy.

[0065] 7. Application Operation of Inspection Image Display System 1 Next, the applied operation of the inspection image display system 1 will be explained with reference to Figure 8. In the applied operation, we assume a case where a defect occurs in the lower left of the first area AR1 of the substrate K, where a component PC is not mounted. In step S7 of this case, the image inspection unit 7 displays the inspection image GT3 as exemplified in Figure 8. Naturally, the unmounted component PC is not captured in the inspection image GT3. Therefore, the image inspection unit 7 displays the predetermined mounting position of the component PC with a conspicuous thick red dashed line, and displays "NOTPLACING ERROR" to the left of it in a nearby position, indicating that it is not mounted.

[0066] In the next step S8, the image display unit 8 considers the red dashed line as a part image and displays the mounting information overlaid with a dashed line. Furthermore, the image display unit 8 displays not only the outer shape of the tip 49 of the suction nozzle 4, but also the opening shape of the opening of the tip 49, both with a dashed line. As a result, a double circle with a dashed line is displayed on the inspection image GT3.

[0067] Specifically, in the case of component PC that was determined to be defective due to the mounting order being "3," the display shows that the opening of the suction nozzle 4 is shifted outward relative to the side of component PC. An inspector who sees this display can recognize that a negative pressure air leak occurred due to the shift in the opening of the suction nozzle 4. Furthermore, the inspector can infer that the holding state of component PC became unstable, and that component PC fell somewhere along the way as the suction nozzle 4 moved from component camera 32 to circuit board K.

[0068] Furthermore, the image processing unit 36 ​​may not be able to calculate the mounting information (position information and angle information) of the component PC. In other words, the component PC may not be captured in the image data from the component camera 32. In this case, the image display unit 8 does not display the mounting information. If the mounting information is not superimposed on the inspection image GT3, the inspector can infer that the suction nozzle 4 failed to pick up the component PC, or that even if it was picked up, the component PC fell before it could reach the component camera 32.

[0069] According to the inspection image display system 1 of the first embodiment and its applied operation, positional information representing the relative positional relationship between the suction nozzles (4, 41-48) and the parts (P, PB, PC) is plotted and overlaid on the inspection images (GT2, GT3). As a result, for example, an inspector can refer to the relative positional relationship displayed in the inspection images (GT2, GT3) to infer the cause and history of the defect in the mounting state of the parts. Therefore, the inspection image display system 1 and the inspection image display method shown in Figure 5 can support the investigation of the cause and history of defects.

[0070] 8. Inspection image display system 1A of the second embodiment Next, the differences between the inspection image display system 1A of the second embodiment and the first embodiment will be mainly explained with reference to Figures 9 and 10. As shown in Figure 9, an interference determination unit 75 is added in the second embodiment. In addition, the functions of the information acquisition unit 5A and the image display unit 8A are modified.

[0071] The information acquisition unit 5A acquires mounting information (position information and angle information), mounting device outline information, and mounting sequence information, similar to the first embodiment. However, unlike the first embodiment, the information acquisition unit 5A acquires multiple part outline information representing the size and shape of each of the multiple parts from the part data 971. Furthermore, the information acquisition unit 5A acquires multiple mounting position information representing the mounting position of each of the multiple parts from the job data 973.

[0072] The interference determination unit 75 determines, based on the information acquired by the information acquisition unit 5A, whether there is a possibility that the component mounter will interfere with a component that has already been mounted. For example, the interference determination unit 75 determines whether there is a possibility that the mounting operation of the suction nozzle 4, which mounts a second component to the substrate, will interfere with a first component that has already been mounted to the substrate. The determination of the possibility of interference is made based on the size of the suction nozzle 4 and the component, as well as the distance between adjacent mounted components, taking into account the dimensional tolerances of these components and the maximum possible positional error. Furthermore, the interference determination unit 75 may also consider a predetermined safe distance and determine the possibility of interference on the safe side.

[0073] The substrate KA shown in the inspection image GT4 of Figure 10 is of a different type from the substrate K shown in the first embodiment, and there is no mounting position in the lower left of the first area AR1. The component mounting machine 92 first mounts component P in the upper left of the first area, then component P1 in the upper right of the first area, and then component P2 in the lower right of the first area. As shown in the figure, the mounting positions of components P1 and P2 are set to be relatively far apart in the positive X-axis direction from the mounting position of component P which is mounted first. Therefore, the suction nozzle 4 for mounting component P1 and the suction nozzle 4 for mounting component P2 do not have the possibility of interfering with the already mounted component P.

[0074] On the other hand, the mounting position of part P2 is determined to be closer to the mounting position of part P1, which is mounted first, in the negative Y-axis direction. Therefore, the suction nozzle 4 that mounts part P2 may interfere with the already mounted part P1. The interference determination unit 75 automatically determines whether or not there is a possibility of the above-mentioned interference. Note that the interference determination unit 75 does not use mounting order information in the above explanation. However, the interference determination unit 75 can improve its determination accuracy by considering mounting order information when the sizes of the multiple parts to be mounted are different, or when the suction nozzle 4 used is changed midway through the process.

[0075] Similar to the first embodiment, the image display unit 8A displays installation information regarding the part determined to be defective and the surrounding parts. In addition, even if there are no parts determined to be defective, the image display unit 8A displays installation information regarding the first and second parts that the interference determination unit 75 has determined to have a potential for interference. For example, the image display unit 8A displays the inspection image GT4 shown in Figure 10. In the inspection image GT4, installation information for part P is not displayed, but the installation information is overlaid on the part image of part P1, which corresponds to the first part, and the installation information is overlaid on the part image of part P2, which corresponds to the second part.

[0076] In the second embodiment, similar to the first embodiment, the display of mounting information superimposed on the inspection image GT4 can assist in investigating the cause and progression of defects in the mounting state of the component P. Furthermore, even if there are no defects, mounting information is superimposed on the inspection image GT4 at locations where the suction nozzle 4 may interfere with the mounted component P. Therefore, by visually inspecting the inspection image GT4, it is possible to recognize the actual margin dimensions against interference and to estimate the likelihood of interference occurring.

[0077] 9. Applications and Variations of Embodiments Furthermore, the component mounting machines (92, 93) may not have a nozzle tool 27, but instead have a single suction nozzle 4 on the underside of the mounting head 26 that can be raised and lowered and rotated. Also, a symbol other than the dashed "cross shape" can be used as the symbol illustrating the center position 4A of the suction nozzle 4. In addition, the mounting order of the components displayed in the inspection images (GT2~GT4) may be omitted. Furthermore, mounting information may be directly transferred from the component mounting machines (92, 93) to the board inspection machine 94 without going through the operation history data 974 in the memory 97. Moreover, the image display units (8, 8A) may overlay and display the mounting information of all components P on the inspection images (GT2~GT4), regardless of the judgment results of the image inspection unit 7 and the interference determination unit 75. The first and second embodiments can be applied and modified in various other ways. [Explanation of Symbols]

[0078] 1, 1A: Inspection image display system 26: Mounting head 27: Nozzle tool 32: Part camera 36: Image processing unit 37: Mounting control unit 4, 41~48: Suction nozzle 49: Tip 4A: Center position 5, 5A: Information acquisition unit 6: Image acquisition unit 7: Image inspection unit 75: Interference determination unit 8, 8A: Image display unit 9: Part mounting line 92, 93: Part mounting machine 94: Board inspection machine 96: Production information server 971: Part data 972: Equipment data 973: Job data 974: Operation history data K, KA: Board P, PB, PC, P1, P2: Parts GT1, GT2, GT3, GT4: Inspection image

Claims

1. A component mounting device that performs a mounting operation to mount a component to a predetermined mounting position set on a circuit board; and an information acquisition unit that acquires mounting information including position information representing the relative positional relationship between the component held by the component mounting device and the component, and which is used to correct the position of the component mounting device when performing the mounting operation. An image acquisition unit that captures an image of the circuit board on which the aforementioned components are mounted and acquires an inspection image, The system includes an image display unit that displays the aforementioned mounting information graphically overlaid on the inspection image, The information acquisition unit acquires mounting order information representing the mounting order of the plurality of components mounted on the substrate, The image acquisition unit captures an image of the substrate on which the plurality of components are mounted and acquires the inspection image. The image display unit displays the corresponding installation order of the component in the vicinity of each of the multiple component images in the inspection image, based on the installation order information. Inspection image display system.

2. A component mounting device that performs a mounting operation to mount a component to a predetermined mounting position set on a circuit board; and an information acquisition unit that acquires mounting information including position information representing the relative positional relationship between the component held by the component mounting device and the component, and which is used to correct the position of the component mounting device when performing the mounting operation. An image acquisition unit that captures an image of the circuit board on which the aforementioned components are mounted and acquires an inspection image, The system includes an image display unit that displays the aforementioned mounting information graphically overlaid on the inspection image, The information acquisition unit acquires a plurality of mounting position information representing the mounting position of each of the plurality of parts, a plurality of part external shape information representing the size and shape of each of the plurality of parts, and mounting tool external shape information included in the mounting information, which represents the shape and size of the holding portion of the part mounting tool that holds the parts. The system further includes an interference determination unit that determines whether or not the mounting operation of the component mounting device for mounting the second component to the substrate may interfere with the first component already mounted on the substrate, based on a plurality of mounting position information, a plurality of component outline information, and the mounting device outline information. The image display unit displays the installation information for the first and second parts when the interference determination unit determines that there is a possibility of interference, and does not display the installation information for the first and second parts when it determines that there is no possibility of interference. Inspection image display system.

3. The image acquisition unit captures an image of the substrate on which the plurality of components are mounted and acquires the inspection image. The inspection image display system includes an image inspection unit that performs image processing on the inspection image to determine whether the mounting state of each of the multiple components is good or bad. The image display unit selects the installation information to be displayed based on the determination result of the image inspection unit. The inspection image display system according to claim 1 or 2.

4. A component mounting device that performs a mounting operation to mount a component to a predetermined mounting position set on a circuit board; and an information acquisition unit that acquires mounting information including position information representing the relative positional relationship between the component held by the component mounting device and the component, and which is used to correct the position of the component mounting device when performing the mounting operation. An image acquisition unit that captures an image of the circuit board on which the aforementioned components are mounted and acquires an inspection image, The system includes an image display unit that displays the aforementioned mounting information graphically overlaid on the inspection image, The image acquisition unit captures an image of the substrate on which the plurality of components are mounted and acquires the inspection image. The system further includes an image inspection unit that performs image processing on the inspection image to determine whether the mounting state of each of the multiple components is good or bad. The image display unit selects the installation information to be displayed based on the determination result of the image inspection unit, The image display unit displays only the installation information relating to the part determined to be defective by the image inspection unit, and surrounding parts located within a predetermined distance from the part determined to be defective. Inspection image display system.

5. The position information represents the relative positional relationship between the center position of the holding location of the component holder that holds the component and the component held at the holding location. The image display unit visualizes the central position of the holding location as a symbol and displays the symbol at a position that satisfies the relative positional relationship with respect to the part image in the inspection image. The inspection image display system according to any one of claims 1, 2, or 4.

6. The information acquisition unit acquires the mounting device external shape information included in the mounting information, which represents the shape and size of the holding portion of the component mounting device. The image display unit displays the external shape information of the fitting device in a diagram, corresponding it to the symbols in the inspection image. The inspection image display system according to claim 5.

7. The aforementioned component holder is a suction nozzle that uses negative pressure air to attract and hold the component at its tip opening, The shape and size of the holding portion are the external shape and size of the tip of the suction nozzle. The inspection image display system according to claim 6.

8. The aforementioned component holder is a suction nozzle that uses negative pressure air to attract and hold the component at its tip opening, The shape and size of the holding portion are the opening shape and size of the opening of the suction nozzle. The inspection image display system according to claim 6.

9. The mounting information includes angle information representing the relative rotational angle relationship between the component mounting device and the component, The image display unit rotates and displays the symbol within the inspection image based on the angle information. The inspection image display system according to claim 5.

10. The inspection image display system according to any one of claims 1, 2, or 4, wherein the information acquisition unit includes a camera that captures an image of the component holder holding the component and acquires image data, and an image processing unit that performs image processing on the image data to calculate the position information.

11. The information acquisition unit is provided in the component mounting machine having the component mounting device, The image acquisition unit and the image display unit are provided in a substrate inspection machine located on the downstream side of the component mounting machine. The inspection image display system according to any one of claims 1, 2, or 4.

12. An information acquisition step involves acquiring mounting information which includes a component mounting tool that performs a mounting operation to mount a component to a predetermined mounting position set on a substrate, and position information that represents the relative positional relationship between the component held by the component mounting tool and the component, and which is used to correct the position of the component mounting tool when performing the mounting operation. An image acquisition step involves taking an image of the substrate on which the aforementioned components are mounted to obtain an inspection image, The system includes an image display step in which the aforementioned mounting information is visualized and overlaid on the inspection image, In the information acquisition step, mounting order information representing the mounting order of the multiple components mounted on the substrate is acquired. In the image acquisition step, the substrate on which the multiple components are mounted is imaged to acquire the inspection image. In the image display step, the mounting order of the corresponding part is displayed in the vicinity of each of the multiple part images in the inspection image, based on the mounting order information. Method for displaying inspection images.

13. An information acquisition step involves acquiring mounting information which includes a component mounting tool that performs a mounting operation to mount a component to a predetermined mounting position set on a substrate, and position information that represents the relative positional relationship between the component held by the component mounting tool and the component, and which is used to correct the position of the component mounting tool when performing the mounting operation. An image acquisition step involves taking an image of the substrate on which the aforementioned components are mounted to obtain an inspection image, The system includes an image display step in which the aforementioned mounting information is visualized and overlaid on the inspection image, In the information acquisition step, the following are acquired: a plurality of mounting position information representing the mounting position of each of the plurality of parts, a plurality of part external shape information representing the size and shape of each of the plurality of parts, and mounting tool external shape information included in the mounting information, which represents the shape and size of the holding portion of the part mounting tool that holds the parts. The system further includes an interference determination step that determines whether or not the mounting operation of the component mounting device for mounting the second component to the substrate may interfere with the first component already mounted on the substrate, based on a plurality of mounting position information, a plurality of component outline information, and the mounting device outline information. In the image display step, if the interference determination step determines that there is a possibility of interference, the installation information relating to the first and second parts is displayed; if it determines that there is no possibility of interference, the installation information relating to the first and second parts is not displayed. Method for displaying inspection images.

14. An information acquisition step involves acquiring mounting information which includes a component mounting tool that performs a mounting operation to mount a component to a predetermined mounting position set on a substrate, and position information that represents the relative positional relationship between the component held by the component mounting tool and the component, and which is used to correct the position of the component mounting tool when performing the mounting operation. An image acquisition step involves taking an image of the substrate on which the aforementioned components are mounted to obtain an inspection image, The system includes an image display step in which the aforementioned mounting information is visualized and overlaid on the inspection image, In the image acquisition step, the substrate on which the multiple components are mounted is imaged to acquire the inspection image. The process further includes an image inspection step in which image processing is applied to the inspection image to determine whether the mounting state of each of the multiple components is good or bad. In the image display step, the mounting information to be displayed is selected based on the determination result of the image inspection step. In the image display step, only the installation information relating to the part determined to be defective in the image inspection step, and surrounding parts located within a predetermined distance from the part determined to be defective, is displayed. Method for displaying inspection images.

Citation Information

Patent Citations

  • Electronic component mounting device, and electronic component mounting method

    JP2011253974A

  • Manufacturing management system for component mounting line

    WO2018100717A1