Transport device information teaching system and transport device information teaching method

Abstract

This conveyance apparatus information teaching system comprises an acquisition unit and a display unit. The acquisition unit acquires conveyance apparatus information including information concerning the movement of a conveyance apparatus that conveys an article for use in on-substrate work to a substrate production line comprising an on-substrate work machine for producing a substrate product by performing predetermined on-substrate work on a substrate. When a worker has visually recognized a target region that is at least a part of a region of the substrate production line via an augmented reality device capable of displaying virtual information together with the real world being visually recognized by the worker, the display unit displays, in a superimposing manner, virtual information including the conveyance apparatus information acquired by the acquisition unit on the reality target region being visually recognized by the worker via the augmented reality device.

Description

[Technical field]

[0001] This specification discloses a technique relating to a conveyance device information teaching system and a conveyance device information teaching method. [Background technology]

[0002] The board production support system described in Patent Document 1 recognizes at least some of the boards on which electronic components are mounted, the board production device that produces the boards, and the functional units that are replaceably mounted on the board production device, and provides production information of the recognition objects to an operator who manages the production of the boards. The board production support system includes a production information management device and an augmented reality terminal device. The production information management device manages the production information of each recognition object.

[0003] The augmented reality terminal device has an imaging unit, a marker recognition unit, and an augmented reality display unit. The imaging unit captures an image of a recognition target that is within the field of view of the worker to obtain a field of view image. The marker recognition unit recognizes an identification marker that is in the field of view image and is unique to the recognition target. The augmented reality display unit displays production information of the recognition target identified by the identification marker in the field of view image by superimposing it on the field of view image or the field of view of the worker.

[0004] The transmissive display device described in Patent Document 2 includes an image display unit, an interference danger area calculation unit, a risk level identification unit, and a display control unit. The image display unit displays an image so that the image can be seen together with the outside scene through the image display unit. The interference danger area calculation unit calculates an interference danger area that is an area where there is a risk of interference between a user of the transmissive display device and a moving object. The risk level identification unit identifies the level of risk of interference based on the relative positional relationship between the user and the moving object. The display control unit causes the image display unit to display an image showing the interference danger area in a display mode according to the identified risk level. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2014-235704 A [Patent Document 2] JP 2019-109850 A Summary of the Invention [Problem to be solved by the invention]

[0006] A substrate production line may be provided with a transport device that transports items used in substrate-related operations. The transport device moves in the substrate production line and stops when a worker approaches. The more times the transport device stops, the more likely it is that the production efficiency of substrate products in the substrate production line will decrease. Therefore, there is a demand for providing information regarding the movement of the transport device to workers to reduce the number of times the transport device stops due to the worker approaching.

[0007] In consideration of the above circumstances, this specification discloses a conveying device information teaching system and a conveying device information teaching method capable of providing a worker with information related to the movement of a conveying device. [Means for solving the problem]

[0008] This specification discloses a transport device information teaching system including an acquisition unit and a display unit. The acquisition unit acquires transport device information including information related to movement of a transport device that transports an item used in a substrate-related operation to a substrate production line equipped with a substrate-related operation machine that performs a predetermined substrate-related operation on a substrate to produce a substrate product. When a worker views a target area that is at least a partial area of ​​the substrate production line through an augmented reality device that can display virtual information in accordance with the real world viewed by the worker, the display unit displays the virtual information including the transport device information acquired by the acquisition unit by superimposing it on the real target area viewed by the worker through the augmented reality device.

[0009] This specification also discloses a method for teaching transport device information, the method including an acquisition step and a display step. The acquisition step acquires transport device information including information regarding movement of a transport device that transports an item used in a substrate-related operation to a substrate production line equipped with a substrate-related operation machine that performs a predetermined substrate-related operation on a substrate to produce a substrate product. The display step displays the virtual information including the transport device information acquired by the acquisition step by superimposing it on the real target area viewed by the worker through the augmented reality device when the worker views a target area that is at least a part of the substrate production line through an augmented reality device that can display virtual information in accordance with the real world viewed by the worker. Effect of the Invention

[0010] The above-mentioned conveying device information teaching system includes an acquisition unit and a display unit. Therefore, the conveying device information teaching system can provide information (conveying device information) related to the movement of the conveying device to the worker. The above description of the conveying device information teaching system can also be applied to the conveying device information teaching method. [Brief description of the drawings]

[0011] [Figure 1] FIG. 2 is a plan view showing a configuration example of a board production line. [Diagram 2] 2 is a perspective view showing a configuration example of the replacement system and the component mounting machine of FIG. 1. [Diagram 3] 11 is a plan view showing an example of a feeder replacement operation between a conveying device and a component supplying device of a component mounting machine. FIG. [Figure 4] FIG. 2 is a block diagram showing an example of a control block of the conveyance device information teaching system. [Diagram 5] 11 is a flowchart showing an example of a control procedure performed by the transport device information teaching system. [Figure 6] FIG. 1 is a perspective view showing a configuration example of an augmented reality device. [Figure 7] 11 is a schematic diagram showing an example of a display on a display unit when a worker visually recognizes a target area through an augmented reality device. FIG. [Figure 8] 13 is a schematic diagram showing another example of display by the display unit when a worker visually recognizes a target area through an augmented reality device. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] 1. Embodiment 1-1. Example of circuit board production line WL0 configuration The transport device information teaching system 70 of this embodiment is applied to a board production line WL0. As shown in Fig. 1, the board production line WL0 includes at least one component mounting machine 10, an exchange system 30, a transport device 40, a storage device 50, and a line management device 60. In the figure, for convenience of illustration, four component mounting machines 10 are shown, but in reality, four or more component mounting machines 10 are provided.

[0013] The component mounting machines 10 are installed along the transport direction (X direction) of the board 90 shown in Fig. 2. The component mounting machines 10 are included in a board-related operation machine WM0 that performs a predetermined board-related operation on the board 90 to produce a board product 900. The board-related operations performed by the component mounting machines 10 include operations of loading and unloading the board 90, and operations of supplying, picking, and mounting components. The component mounting machine 10 is provided with, for example, a detachable cassette-type feeder 20.

[0014] On the board carry-in side of board production line WL0 (the left side of the paper in FIG. 1), for example, a storage device 50 is installed which is used to store feeders 20. Board production line WL0 is also provided with an exchange system 30 and a transport device 40, which perform supplying, exchanging and recovering operations for feeders 20. The configuration of board production line WL0 can be changed as appropriate depending on, for example, the type of board products 900 to be produced.

[0015] Specifically, the board production line WL0 may be appropriately equipped with substrate-related operation machines WM0, such as a solder printer, a solder inspection machine, a reflow oven, a visual inspection machine, etc. In this manner, the board production line WL0 uses the various substrate-related operation machines WM0 to sequentially transport the boards 90 and perform production processes including inspection processes to produce the board products 900.

[0016] The substrate-related operating machine WM0 constituting the substrate production line WL0 is configured to be capable of inputting and outputting various data to and from the line management device 60 via a network. For example, the storage device 50 has a plurality of slots. The storage device 50 stocks the feeders 20 installed in the plurality of slots. The feeders 20 installed in the slots of the storage device 50 are capable of communicating with the line management device 60. As a result, the slots of the storage device 50 and the identification information of the feeders 20 installed in the slots are associated with each other and recorded in the line management device 60.

[0017] Furthermore, the line management device 60 monitors the operating status of the board production line WL0, and controls the substrate-related operation machines WM0 such as the component mounting machine 10, the replacement system 30, the transport device 40, and the storage device 50. The line management device 60 stores various data for controlling the substrate-related operation machines WM0, the replacement system 30, the transport device 40, and the storage device 50. The line management device 60 transmits various data such as a production program when the component mounting machine 10 executes the component mounting process, for example.

[0018] 1-2. Example of the configuration of the component placement machine 10 As shown in Fig. 2, each of the multiple component mounting machines 10 includes a board transport device 11, a component supply device 12, and a head drive device 13. In this specification, the transport direction of the board 90 is defined as the X direction. The direction perpendicular to the X direction in a horizontal plane is defined as the Y direction. Furthermore, the vertical direction perpendicular to the X and Y directions (the up-down direction on the paper surface of Fig. 2) is defined as the Z direction.

[0019] The board transport device 11 is composed of, for example, a belt conveyor and a positioning device. The board transport device 11 sequentially transports the board 90 in a transport direction (X direction) and positions the board 90 at a predetermined position within the machine. After the mounting process by the component mounting machine 10 is completed, the board transport device 11 takes the board 90 out of the component mounting machine 10.

[0020] The component supplying device 12 supplies components to be mounted on the board 90. The component supplying device 12 includes a first slot 12a and a second slot 12b that can accommodate a plurality of feeders 20. In this embodiment, the first slot 12a is disposed at the top of the tip side of the component mounting machine 10 and operably holds the mounted feeder 20. The operation of the feeder 20 mounted in the first slot 12a is controlled in the mounting process by the component mounting machine 10, and the feeder 20 supplies components at a take-out section provided at a predetermined position above the feeder 20. In this manner, the first slot 12a can hold the feeder 20 used in the production of the board product 900.

[0021] In this embodiment, the second slot 12b is disposed below the first slot 12a and stocks the installed feeders 20. Specifically, the second slot 12b reserves the feeders 20 to be used in the production of the board products 900. The second slot 12b also temporarily reserves the feeders 20 that are no longer needed in the production of the board products 900. The transfer device 40 exchanges the feeders 20 between the first slot 12a and the second slot 12b.

[0022] As shown in FIG. 2, feeder 20 includes feeder body 21 and drive device 22. Feeder body 21 in this embodiment is formed in a flat box shape. Feeder body 21 detachably (replaceably) holds reel 23 around which carrier tape accommodating a large number of components is wound. Drive device 22 includes sprocket 22a that engages with feed holes provided in the carrier tape. Drive device 22 rotates sprocket 22a to feed and move the carrier tape.

[0023] The operation of the drive unit 22 of the feeder 20 is controlled by a control device of the component mounting machine 10. When the feeder 20 is installed in the first slot 12a of the component mounting machine 10, the feeder 20 receives power from the component mounting machine 10 via a connector and is capable of communicating with the component mounting machine 10. This allows the component mounting machine 10 to detect the supply or withdrawal of the feeder 20 in the first slot 12a. What has been described above about the first slot 12a also applies to the second slot 12b.

[0024] The feeder 20 installed in the first slot 12a controls the feeding operation of the carrier tape that stores the components based on the control command from the component mounting machine 10. As a result, the feeder 20 supplies the components in a manner that allows them to be picked up by the holding member of the mounting head 13b at the take-out section provided at the top of the feeder 20.

[0025] The head driving device 13 moves the movable stage 13a in the horizontal direction (X direction and Y direction) by a linear motion mechanism. The mounting head 13b is fixed to the movable stage 13a in a replaceable (detachable) manner by a clamp member. The mounting head 13b is moved in the X direction and Y direction together with the movable stage 13a by the linear motion mechanism of the head driving device 13. The mounting head 13b uses a holding member to pick up the components supplied by the component supply device 12. The holding member can be, for example, a suction nozzle that sucks up the components by supplied negative pressure air, a chuck that grips the components, or the like.

[0026] The mounting head 13b holds the holding member so that it can move in the Z direction and rotate around the Q axis parallel to the Z axis. The mounting head 13b adjusts the position and angle of the holding member depending on the posture of the picked component. Then, the mounting head 13b mounts the component at the mounting position on the board 90 instructed by the production program. The total time of the time required for a predetermined number of cycles of the above-mentioned component pick-and-place cycle and the time required for loading and unloading the board 90 corresponds to the cycle time for one board 90.

[0027] The holding members provided on the mounting head 13b may be changed as appropriate depending on the type of components in a mounting process for mounting components on the board 90. For example, when a suction nozzle to be used in a mounting process to be executed is not attached to the mounting head 13b, the component mounting machine 10 attaches a suction nozzle housed in a nozzle station to the mounting head 13b. The nozzle station is removably provided at a predetermined position inside the component mounting machine 10.

[0028] 1-3. Configuration examples of the exchange system 30 and the transport device 40 1 and 2, the exchange system 30 includes a first rail 31 and a second rail 32. The first rail 31 and the second rail 32 form a track 30R along which the transport device 40 moves. The first rail 31 extends along the transport direction (X direction) of the substrate 90, and is provided between the first slot 12a and the second slot 12b in the vertical direction (Z direction).

[0029] Second rail 32 extends along the conveying direction (X direction) of board 90, and is provided below second slot 12b in the vertical direction (Z direction). First rail 31 and second rail 32 extend over substantially the entire area of ​​board production line WL0 in the conveying direction (X direction) of board 90. The conveying direction (X direction) of board 90 corresponds to the arrangement direction of multiple component mounting machines 10.

[0030] The transport device 40 is provided so as to be movable (runnable) on the track 30R formed by the first rail 31 and the second rail 32. The transport device 40 receives power from a power transmitting unit by non-contact power supply, for example, via a power receiving unit provided opposite the power transmitting unit provided on the first rail 31. The power received by the power receiving unit is used for the travel of the transport device 40, a predetermined operation, and the like, via a power receiving circuit. The transport device 40 detects its position (current position) on the track 30R, for example, by a position detection device. The position detection device can detect the position by, for example, an optical detection method, a detection method using electromagnetic induction, or the like.

[0031] The above-mentioned predetermined operations include an exchange operation for exchanging an item DD0 used in a substrate-related operation by a substrate-related operation machine WM0 such as a component mounting machine 10 with the substrate-related operation machine WM0. The transport device 40 of this embodiment performs an exchange operation of a feeder 20, which supplies components to be mounted on a substrate 90, with the component mounting machine 10, which is the substrate-related operation machine WM0, as the item DD0. The transport device 40 can also perform an exchange operation of a feeder 20 with a storage device 50, as the item DD0.

[0032] The transport device 40 of this embodiment transports the feeder 20 from the storage device 50 to the first slot 12a or the second slot 12b of the component mounting machine 10, and performs a supply operation of the feeder 20. The transport device 40 also performs an exchange operation of the feeder 20 between the first slot 12a and the second slot 12b of the component mounting machine 10. Furthermore, the transport device 40 transports the feeder 20 that is no longer needed in the production of the board product 900 from the component mounting machine 10 to the storage device 50, and performs a recovery operation of the feeder 20.

[0033] 3, the conveying device 40 includes at least one (two in the figure) holding unit 41 and a control device 42. In this embodiment, each of the two holding units 41 can simultaneously clamp a plurality (two in the figure) of feeders 20, and can simultaneously hold a plurality (two) of feeders 20. In addition, each of the two holding units 41 can independently move along the attachment / detachment direction of the feeder 20 (Y direction in this embodiment) by, for example, a linear motion mechanism, and can simultaneously move a plurality (two) of feeders 20 along the Y direction.

[0034] Furthermore, the two holding parts 41 can be moved together in the vertical direction (Z direction) by, for example, a linear motion mechanism, and can simultaneously move a plurality (four) of feeders 20 in the Z direction. The conveying device 40 can also be provided with, for example, a plurality (four) of holding parts 41. In this case, each of the plurality (four) of holding parts 41 can clamp one feeder 20 and independently move the plurality (four) of feeders 20 in the Y direction and the Z direction. The form of the holding part 41 is not limited to a clamp mechanism or a linear motion mechanism, and can take various forms. For example, the holding part 41 can also be provided with a protrusion that can be fitted into a hole provided in the feeder 20. In this case, the protrusion of the holding part 41 fits into the hole of the feeder 20 to hold the feeder 20.

[0035] The control device 42 includes a known arithmetic device and a storage device, and constitutes a control circuit. The control device 42 is communicably connected to the multiple component mounting machines 10, the replacement system 30, the storage device 50, and the line management device 60. The control device 42 controls the movement (travel) of the transport device 40, the operation of the two holding parts 41, and the like. With the above configuration, the transport device 40 can move to a predetermined position along the first rail 31 and the second rail 32, and can perform the replacement work of the feeder 20 at the stop position.

[0036] The storage device 50 can store not only the feeder 20 but also the item DD0 used in the substrate-related operation by the substrate-related operation machine WM0. For example, when the substrate-related operation machine WM0 is a component mounting machine 10, a reel or tray that stores a plurality of components, a tray unit that stores the tray, the mounting head 13b, a holding member (suction nozzle, chuck, etc.), and a nozzle station are included in the item DD0. When the substrate-related operation machine WM0 is a solder printing machine that prints solder on the substrate 90, a solder container, a mask, a squeegee, and a dispense head are included in the item DD0. When the substrate-related operation machine WM0 is an inspection machine, an inspection head is included in the item DD0. The inspection machine includes a solder inspection machine that inspects the solder printed on the substrate 90 and an appearance inspection machine that inspects the components mounted on the substrate 90.

[0037] Furthermore, the transport device 40 can supply the above-mentioned item DD0 to the substrate-related performing operation machine WM0. Specifically, the transport device 40 can supply the item DD0 stored in the storage device 50 to the substrate-related performing operation machine WM0. The transport device 40 can also collect the item DD0 that is no longer needed in the production of the substrate product 900 into the storage device 50. Furthermore, the substrate-related performing operation machine WM0 can be equipped with a first slot 12a and a second slot 12b, not limited to the component mounting machine 10, and the first slot 12a and the second slot 12b can hold the above-mentioned item DD0.

[0038] 1-4. Configuration example of conveyor information teaching system 70 Transport device 40 moves on board production line WL0 and stops when a worker approaches. The more times transport device 40 stops, the more likely it is that the production efficiency of board products 900 on board production line WL0 will decrease. For this reason, there is a demand to provide information regarding the movement of transport device 40 to workers to reduce the number of times transport device 40 stops due to the approach of a worker.

[0039] Therefore, the board production line WL0 of this embodiment is provided with a transport device information teaching system 70. The transport device information teaching system 70 includes an acquisition unit 71 and a display unit 72, and displays virtual information including transport device information. The acquisition unit 71 and the display unit 72 can be provided in various computing devices and control devices. For example, the acquisition unit 71 and the display unit 72 can be provided in the line management device 60, a management device that manages multiple board production lines WL0, etc. The acquisition unit 71 and the display unit 72 can also be formed on the cloud.

[0040] As shown in Fig. 4, in this embodiment, the acquisition unit 71 and the display unit 72 are provided in a control device of the augmented reality device 80. The transport device information teaching system 70 executes control, for example, according to the flowchart shown in Fig. 5. The acquisition unit 71 performs the process shown in step S11. The display unit 72 performs the processes shown in steps S12, S13, and S14.

[0041] 1-4-1. Acquisition part 71 The acquisition unit 71 acquires transport device information including information related to movement of the transport device 40 that transports the item DD0 used in the substrate-related operation to the substrate production line WL0 equipped with the substrate-related operation machine WM0 (step S11). In this embodiment, the substrate-related operation machine WM0 is a component mounting machine 10, and the item DD0 is a feeder 20. However, the substrate-related operation machine WM0 and the item DD0 are not limited to these, and may be the substrate-related operation machine WM0 and the item DD0 described above.

[0042] Moreover, in this embodiment, the transport device 40 is provided so as to be movable on the track 30R extending along the transport direction (X direction) of the substrate 90. As described above, the transport device 40 moves in accordance with the production of the substrate products 900. Therefore, information relating to the movement of the transport device 40 can be managed, for example, by the line management device 60 or a management device that manages a plurality of substrate production lines WL0. In this embodiment, information relating to the movement of the transport device 40 is managed by the line management device 60.

[0043] The transport device information includes various information related to the movement of the transport device 40. For example, the transport device 40 is provided with a human sensor that detects the approach of an operator, an object sensor that detects the entrapment of an object, and the like. For example, when an operator enters the detection range of the human sensor, the human sensor detects the approach of the operator and the transport device 40 stops. The detection range of the human sensor moves together with the movement of the transport device 40 and is included in a movable range AR0 in which the transport device 40 may move. In this embodiment, since the transport device 40 moves on the track 30R, the movable range AR0 is an area extending along the track 30R.

[0044] In this embodiment, the transport device information includes information representing a movable range AR0 within which the transport device 40 may move. The movable range AR0 also includes an evacuation area AR1, which is an area in which a worker should be kept away from the transport device 40 while the transport device 40 is moving. The evacuation area AR1 includes a detection range of a human sensor, and workers are prohibited from entering the evacuation area AR1 during a specified time period. Furthermore, the transport device information may include information representing the movement direction of the transport device 40.

[0045] The transport device information may also include information about the transport device 40 other than the information about the movement of the transport device 40. For example, when multiple transport devices 40 are used, identification information for identifying the multiple transport devices 40 is included in the transport device information. Such transport device information may be acquired in advance from a production plan, a production program, or the like. For example, the acquisition unit 71 may acquire transport device information managed by the line management device 60 using known wireless communication such as a wireless LAN (Local Area Network).

[0046] 1-4-2.Display section 72 When the worker views the target area TA0 through the augmented reality device 80, the display unit 72 displays virtual information including the transport device information acquired by the acquisition unit 71, superimposed on the real target area TA0 viewed by the worker through the augmented reality device 80 (steps S12 to S14). The target area TA0 is at least a part of the board production line WL0, and is any area that corresponds to the field of vision of the worker.

[0047] The augmented reality device 80 refers to a device capable of displaying virtual information in accordance with the real world that the worker is viewing. The technology for displaying virtual information in accordance with the real world that the worker is viewing is called, for example, augmented reality or mixed reality. The augmented reality device 80 may be any device known in the art that is used in the above technology as long as it can display virtual information in accordance with the real world that the worker is viewing.

[0048] 6 shows a configuration example of an augmented reality device 80. As shown in the figure, the augmented reality device 80 of this embodiment is formed in the shape of glasses. A worker can use the augmented reality device 80 by wearing the augmented reality device 80 like glasses (hereinafter, referred to as wearing the augmented reality device 80). The augmented reality device 80 includes at least one imaging unit 81 (one imaging unit 81 in the figure), at least one viewing unit 82 (two viewing units 82, 82 in the figure), and a wireless communication unit 80w.

[0049] A known imaging device can be used for the imaging unit 81. The imaging unit 81 of this embodiment is provided between two viewing units 82, 82, and the imaging range is set according to the field of view of the worker. When the worker visually recognizes the target area TA0, the imaging unit 81 images the target area TA0 to obtain the field of view image PC0 of the worker (step S12). FIG. 7 shows an example of the field of view image PC0. In the field of view image PC0 shown in the figure, seven component mounting machines 10, a conveying device 40, and a storage device 50 are imaged.

[0050] As shown in the figure, a predetermined component mounting machine 10 is provided with an identification marker 80k. The identification marker 80k in this embodiment has a checkered pattern in which white and black rectangles are alternately arranged. The identification marker 80k may be, for example, a one-dimensional code or a two-dimensional code. The identification marker 80k may also be provided on the conveying device 40, the storage device 50, etc. In this way, the identification marker 80k can be provided at a location visible to the worker. The imaging unit 81 can also simultaneously capture the above-mentioned multiple identification markers 80k. This improves the accuracy of recognizing the position of the augmented reality device 80 described later and the viewing direction of the worker.

[0051] 6, the two viewing units 82, 82 are provided at positions corresponding to both eyes of the worker when the worker wears the augmented reality device 80. When the worker wears the augmented reality device 80, the worker can view the real world through the two viewing units 82, 82. Furthermore, when the worker wears the augmented reality device 80, the worker can view the virtual information displayed on the two viewing units 82, 82 through the two viewing units 82, 82.

[0052] The wireless communication unit 80w can communicate with a control device such as the line management device 60 by using known wireless communication such as wireless LAN. As described above, the acquisition unit 71 and the display unit 72 are provided in the control device of the augmented reality device 80. The acquisition unit 71 can acquire the transport device information managed by the line management device 60 by using the wireless communication unit 80w. The wireless communication unit 80w can also transmit image data of the visual field image PC0 captured by the imaging unit 81 to a control device such as the line management device 60. In this way, the wireless communication unit 80w can transmit and receive various information between a control device such as the line management device 60 and the augmented reality device 80.

[0053] The display unit 72 recognizes the position of the augmented reality device 80 and the viewing direction of the worker (step S13). For example, the smaller the distance between the identification marker 80k and the augmented reality device 80, the larger the size of the identification marker 80k included in the field of view image PC0. Conversely, the larger the distance between the identification marker 80k and the augmented reality device 80, the smaller the size of the identification marker 80k included in the field of view image PC0. Even if the distance between the identification marker 80k and the augmented reality device 80 is the same, the shape and size of the identification marker 80k included in the field of view image PC0 vary depending on the viewing direction of the worker.

[0054] Therefore, the display unit 72 can recognize the position of the augmented reality device 80 and the viewing direction of the worker based on the appearance (e.g., arrangement, size, shape, etc.) of the identification marker 80k included in the field of view image PC0. Specifically, the display unit 72 can recognize the position of the augmented reality device 80 and the viewing direction of the worker by comparing the appearance of the identification marker 80k included in the field of view image PC0 with previously acquired appearance information of the identification marker 80k.

[0055] For example, the appearance information includes a template for each position of the augmented reality device 80 and the viewing direction of the worker. The display unit 72 searches for a template that matches the appearance of the identification marker 80k included in the field of view image PC0, and recognizes the position of the augmented reality device 80 and the viewing direction of the worker corresponding to the template. Note that the identification marker 80k in this embodiment has a checkered pattern in which white and black rectangles are alternately arranged. White and black have the largest difference in luminance, making it easy to extract outlines, intersections, and the like. Therefore, the display unit 72 can easily recognize the position of the augmented reality device 80 and the viewing direction of the worker.

[0056] The display unit 72 displays the virtual information including the transport device information acquired by the acquisition unit 71, superimposed on the real target area TA0 viewed by the worker via the augmented reality device 80 (step S14). The display unit 72 can display various virtual information according to the position of the augmented reality device 80 and the viewing direction of the worker. As described above, the transport device information includes information representing the movable range AR0 within which the transport device 40 may move. In this case, as shown in FIG. 7, the display unit 72 can display the virtual information representing the movable range AR0, superimposed on the real target area TA0 viewed by the worker via the augmented reality device 80.

[0057] In this embodiment, the transport device 40 is provided so as to be movable on a track 30R extending along the transport direction (X direction) of the substrate 90. Therefore, the movable range AR0 is an area extending along the track 30R. The display unit 72 enlarges or reduces the virtual information (image) of the movable range AR0 acquired in advance as necessary in accordance with the position of the augmented reality device 80 and the viewing direction of the worker, and rotates and tilts it as necessary to display it. What has been described above about the display of virtual information (image) can be similarly applied to other virtual information.

[0058] Moreover, the movable range AR0 includes an evacuation area AR1, which is an area where the worker should move away from the transport device 40 while the transport device 40 is moving. As shown in the figure, the display unit 72 can display virtual information representing the evacuation area AR1 superimposed on the real target area TA0 viewed by the worker via the augmented reality device 80. Furthermore, the transport device information includes information representing the movement direction of the transport device 40. As shown in the figure, the display unit 72 can display virtual information representing the movement direction of the transport device 40 (an arrow pointing to the right on the paper in the figure) superimposed on the real target area TA0 viewed by the worker via the augmented reality device 80.

[0059] The display unit 72 can also change the virtual information displayed on the augmented reality device 80 in accordance with the progress of the production of the board product 900. This allows the worker to know the virtual information that matches the progress of the production of the board product 900. For example, the display unit 72 can move information representing the evacuation area AR1, which is an area where the worker should move away from the transport device 40 while the transport device 40 is moving, in accordance with the progress of the production of the board product 900. For example, as shown in FIG. 8, in a state where the production of the board product 900 has progressed from the state shown in FIG. 7, the display unit 72 can move and display the information representing the evacuation area AR1 shown in FIG. 7 in accordance with the movement of the transport device 40.

[0060] Furthermore, the display unit 72 can also display virtual information including future transport device information when the production of the board product 900 has progressed, superimposed on the real target area TA0 currently viewed by the worker via the augmented reality device 80. For example, the display unit 72 can move a virtual object that is a schematic representation of the transport device 40 by animation into the real target area TA0 currently viewed by the worker via the augmented reality device 80. This allows the worker to know in advance the future movement state of the transport device 40. The display unit 72 can also display the time when the transport device 40 will approach the worker, etc.

[0061] The worker can carry in the feeders 20 required for the production of the board products 900 into the storage device 50. The worker can also carry out the feeders 20 that are no longer required for the production of the board products 900 from the storage device 50. At this time, the worker enters the movable range AR0 in which the transport device 40 may move. Therefore, it is preferable that the virtual information includes work possibility information that is information representing a permitted state in which the worker is permitted to work, or a prohibited state in which the worker is prohibited from working. In this case, the display unit 72 can display the work possibility information in accordance with the progress of the production of the board products 900.

[0062] For example, in the state shown in FIG. 7, the transport device 40 is approaching the storage device 50, and the evacuation area AR1 is included in the work area of ​​the storage device 50 where the worker works. At this time, the work possibility information includes information representing a prohibited state. Therefore, as shown in FIG. 7, the display unit 72 displays the work prohibited state (prohibition of work). Conversely, in the state shown in FIG. 8, the transport device 40 is away from the storage device 50, and the evacuation area AR1 is not included in the work area of ​​the storage device 50 where the worker works. At this time, the work possibility information includes information representing a permitted state. Therefore, as shown in FIG. 8, the display unit 72 displays the work permitted state (permission of work). From these, the worker can know whether the work is permitted or prohibited.

[0063] The virtual information may include worker-related information, which is information on at least one of the work performed by the worker, the method of operating the substrate-related performing operation machine WM0 performed by the worker, and the method of the worker's response when a malfunction occurs in the substrate-related performing operation machine WM0. For example, the carry-in operation of carrying the feeder 20 into the storage device 50 and the carry-out operation of carrying the feeder 20 out of the storage device 50 are included in the work performed by the worker. The replacement operation of the mounting head 13b of the component mounting machine 10 is included in the work performed by the worker. In addition, the method of giving a predetermined instruction to the substrate-related performing operation machine WM0 is included in the method of operating the substrate-related performing operation machine WM0 performed by the worker. In addition, the method of replacing the mounting head 13b that has malfunctioned is included in the method of the worker's response when a malfunction occurs in the substrate-related performing operation machine WM0.

[0064] The display unit 72 displays worker-related information. For example, the display unit 72 displays virtual information (e.g., a slot number, an arrow indicating the slot position, etc.) representing a slot position in which a feeder 20 is to be installed in the actual storage device 50 viewed by the worker via the augmented reality device 80. When the worker installs multiple feeders 20, the display unit 72 can also display virtual information representing a slot position in which the next feeder 20 is to be installed each time one feeder 20 is installed in a specific slot.

[0065] The display unit 72 can also display virtual information (e.g., a slot number, an arrow indicating the slot position, etc.) indicating the slot position in which the feeder 20 to be collected is installed in the real storage device 50 viewed by the worker via the augmented reality device 80. When the worker collects a plurality of feeders 20, the display unit 72 can also hide the virtual information related to the collected feeder 20 each time one feeder 20 is collected from a specific slot. In addition, when the worker performs the replacement work of the mounting head 13b, the display unit 72 can also display the replacement procedure of the mounting head 13b near the real mounting head 13b viewed by the worker via the augmented reality device 80. This allows the worker to easily perform the work. In addition, the worker can easily deal with the malfunction.

[0066] When the worker gives a predetermined instruction to the substrate-related performing operation machine WM0, the display unit 72 can also display a method for operating the operation panel near the actual operation panel that the worker sees via the augmented reality device 80. This allows the worker to easily operate the substrate-related performing operation machine WM0. Note that when new equipment is installed on the substrate production line WL0, it may take time for the worker to learn how to operate the substrate-related performing operation machine WM0.

[0067] Therefore, when new equipment is installed on the board production line WL0, the display unit 72 may display an operation method for the equipment near the actual equipment viewed by the worker via the augmented reality device 80. In addition, when new equipment is installed on the board production line WL0, the display unit 72 may also display an operation method for a part that has been changed from the conventional equipment near the actual equipment viewed by the worker via the augmented reality device 80.

[0068] 1-5. Transformation In the above embodiment, the transport device 40 is provided so as to be movable on the track 30R extending along the transport direction (X direction) of the substrate 90. However, the transport device 40 may be an unmanned transport vehicle. When the transport device 40 is an unmanned transport vehicle, the track 30R is omitted. In this case, the transport device 40 can transport the item DD0 from the storage device 50 to the first slot 12a or the second slot 12b of the substrate-related operation machine WM0 and perform the supply operation of the item DD0.

[0069] The transport device 40 can also perform an exchange operation of the item DD0 between the first slot 12a and the second slot 12b of the substrate-related operation machine WM0. Furthermore, the transport device 40 can transport the item DD0 that is no longer needed in the production of the substrate product 900 from the substrate-related operation machine WM0 to the storage device 50 and perform a recovery operation of the item DD0. The transport device 40 can also perform a supply operation of the item DD0 to the substrate-related operation machine WM0 directly without going through the storage device 50, and perform a recovery operation of the item DD0.

[0070] In this way, when the conveying device 40 is an unmanned conveying vehicle, the conveying device 40 can move (travel) along any travel route. For this reason, the conveying device information may include route information, which is information about the route along which the conveying device 40 is planned to travel. In this case, the display unit 72 displays the route information. For example, the display unit 72 can display the route information (e.g., an arrow indicating the planned travel route, etc.) in the real target area TA0 visually recognized by the worker via the augmented reality device 80. This allows the worker to easily know the planned travel route of the conveying device 40.

[0071] The display unit 72 can display various types of virtual information in the same manner as described above. The display unit 72 can also change the route information displayed on the augmented reality device 80 in accordance with the progress of the production of the board product 900. The display unit 72 can also display the time when the transport device 40 approaches the worker.

[0072] 2. Method for teaching information about conveying device The above description of the transport device information teaching system 70 also applies to the transport device information teaching method. Specifically, the transport device information teaching method includes an acquisition step and a display step. The acquisition step corresponds to the control performed by the acquisition unit 71. The display step corresponds to the control performed by the display unit 72.

[0073] 3. Examples of Effects of the Embodiments and Modifications The transport device information teaching system 70 includes an acquisition unit 71 and a display unit 72. Therefore, the transport device information teaching system 70 can provide the operator with information (transport device information) related to the movement of the transport device 40. What has been described above about the transport device information teaching system 70 also applies to the transport device information teaching method. [Explanation of symbols]

[0074] 30R: track, 40: conveying device, 70: conveying device information teaching system, 71: Acquisition unit, 72: Display unit, 80: Augmented reality device, 90: Board, 900: PCB product, DD0: Item, TA0: Target area, AR0: Movable range, AR1: Evacuation area, WL0: PCB production line, WM0: PCB processing machine.

Claims

1. an acquisition unit that acquires conveyance device information including information regarding movement of a conveyance device that conveys an article used in a substrate-related operation to a substrate production line that includes a substrate-related operation machine that performs a substrate-related operation on a substrate to produce a substrate product; a display unit that, when the worker views a target area, which is at least a portion of the board production line, through an augmented reality device capable of displaying virtual information in accordance with the real world viewed by the worker, overlays and displays the virtual information, which includes the transport device information acquired by the acquisition unit and work feasibility information, which is information representing a permitted state in which the worker is permitted to work on the board production line or a prohibited state in which the worker is prohibited from working, on the real target area viewed by the worker through the augmented reality device; A conveying device information teaching system comprising:

2. The transport device information teaching system according to claim 1 , wherein the transport device information includes information representing a movable range within which the transport device may move.

3. The conveying device information teaching system according to claim 2 , wherein the movable range includes a retreat area which is an area where the operator should be away from the conveying device while the conveying device is moving.

4. A conveying device information teaching system as described in Claim 3, wherein the work feasibility information is information representing the prohibited state when the evacuation area is included in the work area in which the worker performs the work, and information representing the permitted state when the evacuation area is not included in the work area in which the worker performs the work.

5. 5. The transport device information teaching system according to claim 1, wherein the transport device information includes information representing a moving direction of the transport device.

6. The transport device information teaching system according to any one of claims 1 to 5, wherein the display unit changes the virtual information displayed on the augmented reality device in accordance with the progress of production of the substrate product.

7. The transport device information teaching system of claim 6, wherein the display unit moves information representing an evacuation area, which is an area where the worker should move away from the transport device while the transport device is moving, in accordance with the progress of production of the board products.

8. The virtual information includes work permission information which is information representing a permission state in which the worker is permitted to perform work or a prohibition state in which the worker is prohibited from performing work, 8. The transport device information teaching system according to claim 6, wherein the display unit displays the work possibility information in accordance with a progress status of production of the board products.

9. the virtual information includes worker-related information that is information regarding at least one of a task performed by the worker, a method of operating the substrate-related-operation machine performed by the worker, and a method of dealing with a problem occurring in the substrate-related-operation machine by the worker, 9. The conveying device information teaching system according to claim 1, wherein the display unit displays the operator-related information.

10. 10. The transport device information teaching system according to claim 1, wherein the transport device is provided so as to be movable on a track extending along a transport direction of the substrate.

11. 10. The transport device information teaching system according to claim 1, wherein the transport device is an unmanned transport vehicle.

12. The transportation device information includes route information that is information regarding a route that the transportation device is scheduled to travel, The transport device information teaching system according to claim 11 , wherein the display unit displays the route information.

13. an acquiring step of acquiring conveyance device information including information regarding movement of a conveyance device that conveys an article used in a substrate-related operation to a substrate production line that includes a substrate-related operation machine that performs a substrate-related operation on a substrate to produce a substrate product; a display process for superimposing and displaying virtual information including the transport device information acquired by the acquisition process and work feasibility information which is information representing a permitted state in which the worker is permitted to work on the board production line or a prohibited state in which the worker is prohibited from working, on the real target area viewed by the worker through the augmented reality device when the worker views a target area which is at least a portion of the board production line through an augmented reality device capable of displaying virtual information in accordance with the real world viewed by the worker; A conveying device information teaching method comprising:

Images