Board work system and operation information display method

Abstract

To provide a board work system that makes it possible to easily check whether a defect occurring in a board work device is a defect caused by the work of a worker.SOLUTION: A board work system 100 comprises a board work device (printing device 1, component mounting device 2) configured to perform board manufacturing work to manufacture a board P having components E mounted thereon, a motion capture device 9 that acquires hand movements of a worker W performing work related to the manufacture of the board P on the board work device, a display unit 71, and a client terminal 7 that controls the display unit 71 to display movement information MI based on the hand movements of the worker W acquired by the motion capture device 9.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a board working system and an operation information display method. [Background technology]

[0002] 2. Description of the Related Art Conventionally, a board working system including a board working device is known (see, for example, Patent Document 1).

[0003] The above-mentioned Patent Document 1 discloses a work support system (board work system) equipped with a surface mounting device (board work device) configured to perform work of mounting electronic components on a board (board manufacturing work). This work support system includes an inspection machine including a judgment unit and a result display unit. The inspection machine is configured to acquire imaging data of the electronic components mounted on the board imaged by the surface mounting device. The inspection machine is configured to perform a defect judgment such as a chip floating state judgment by the judgment unit based on the acquired imaging data. The result display unit is configured to display the defect judgment result by the judgment unit.

[0004] The result display section in the above-mentioned Patent Document 1 is configured to display the time when the defect occurred and an image of the defective electronic component mounted on the board that has been determined to be defective, based on the determination result by the determination section. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Patent No. 6666997 Summary of the Invention [Problem to be solved by the invention]

[0006] However, in the work support system of Patent Document 1, a worker who sees the defect image displayed by the result display unit can, for example, confirm a chip floating state in which part of an electronic component is floating above a board, but it is difficult to confirm whether the cause of the chip floating state is a defect caused by the worker's work, such as an incorrect work or carelessness by the worker. Therefore, a system that makes it possible to easily confirm whether a defect that has occurred in a surface mounting device (board work device) is a defect caused by the worker's work is desired.

[0007] The present invention has been made to solve the above-mentioned problems, and one object of the present invention is to provide a board working system that makes it possible to easily check whether a defect that occurs in a board working device is a defect caused by the work of a worker. [Means for solving the problem]

[0008] In order to achieve the above object, a board work system in a first aspect of the present invention comprises a board work device configured to perform board manufacturing work to manufacture boards having components mounted thereon, a motion acquisition device that acquires hand motions of a worker performing work related to board manufacturing on the board work device, a display unit, and a control device that controls the display unit to display motion information based on the hand motions of the worker acquired by the motion acquisition device.

[0009] In the board working system according to the first aspect of the present invention, as described above, a control device is provided that controls the display unit to display motion information based on the hand motion of the worker acquired by the motion acquisition device. This makes it easy to visually check the work of the worker related to defects in the board manufacturing work by checking the motion information displayed on the display unit, and therefore makes it easy to check whether a defect that has occurred in the board working device is due to the work of the worker.

[0010] In the board working system according to the first aspect, the control device preferably controls the display device to display the motion information in a manner that enables identification of the relationship between the motion information and the work performed by the worker on the board working device. With this configuration, the motion information of the worker's hand motion acquired by the motion acquisition device and the work performed by the worker on the board working device are both displayed on the display device in a related manner, making it easier to check whether the worker's hand motion is causing a defect.

[0011] In the above-mentioned board working system according to the first aspect, preferably, a video recording unit is further provided for recording the work of the worker to obtain a video of the work, and the control device controls the display unit to display the work video related to the defect in the board manufacturing work detected by the board working device in a reproducible state, and to display the motion information of the corresponding hand motion of the worker together with the work video on the display unit. With this configuration, both the motion information based on the hand motion of the worker and the work video recorded by recording the work of the worker can be confirmed by displaying it on the display unit, so that it is possible to easily confirm from the video whether the work by the worker is the cause of the defect.

[0012] In the board working system according to the first aspect, the control device preferably performs control to classify hand movements made by the worker during work and display them on the display unit based on the motion information acquired by the motion acquisition device. With this configuration, the type of hand movement made by the worker can be easily confirmed.

[0013] In this case, the control device preferably classifies hand movements made by the worker during work into specific work movements that have been performed for a specific task and non-specific work movements that are not similar to the specific work movements, based on the motion information acquired by the motion acquisition device, and controls the display unit to display the specific work movements and the non-specific work movements in different modes. With this configuration, it is possible to easily check whether the worker has performed a specific task by viewing the different modes of display on the display unit.

[0014] In the circuit board work system in which the control device classifies hand movements made by the worker during work and controls display on the display unit, the control device preferably compares registered motion information of hand movements made by the worker during work acquired in advance with motion information acquired by the motion acquisition device to classify the hand movements made by the worker during work. With this configuration, the hand movements of the worker can be classified based on the hand movements registered in advance, so that the hand movements of the worker can be easily classified by type.

[0015] In the board working system according to the first aspect, the motion acquisition device preferably includes a motion capture member that can be worn on a hand and detects the hand motion of the worker. With this configuration, the hand motion of the worker can be directly acquired by the motion capture member, so that the hand motion of the worker can be acquired with high accuracy.

[0016] In the board work system having the video capture unit, the control device preferably controls the display unit to display a defect information confirmation screen including board identification information of a board in which a defect in the board manufacturing work has been detected, the time when the defect occurred, a defective image in which a defect in the board manufacturing work has been detected among the images captured by the board work device, a work video in a playable state, and motion information of the worker's hand motion. With this configuration, by checking the defect information confirmation screen displayed on the display unit, the board identification information, the time when the defect occurred, the defective image, the work video, and the worker's hand motion can be confirmed, so that the confirmation work of defects in the board manufacturing work can be efficiently performed.

[0017] A method for displaying motion information in a second aspect of the present invention includes the steps of acquiring hand motions of a worker performing work related to the manufacture of a board on a board work device configured to perform board manufacturing work for producing a board having components mounted thereon, and displaying motion information based on the acquired hand motions of the worker on a display unit.

[0018] In the motion information display method according to the second aspect of the present invention, as described above, a step of displaying the motion information based on the acquired hand motion of the worker on the display unit is provided. This allows the motion information displayed on the display unit to be checked to easily visually check the work of the worker related to defects in the board manufacturing work, thereby providing a motion information display method that allows easy confirmation of whether a defect occurring in the board working device is due to the work of the worker.

[0019] In the above-mentioned second aspect of the motion information display method, the step of displaying the motion information on the display unit preferably includes displaying the motion information on the display unit in such a way that the motion information can be identified as being related to the work performed by the worker on the board working device. With this configuration, both the acquired motion information of the worker's hand motion and the work performed by the worker on the board working device are displayed on the display unit in a related manner, so that it is easier to check whether the worker's hand motion is caused by a defect.

[0020] In the above-mentioned motion information display method according to the second aspect, the step of displaying the motion information on the display unit preferably includes displaying on the display unit a work video of a worker's work related to a defect in the board manufacturing work detected by the board working device in a reproducible state, and displaying on the display unit motion information of the corresponding hand motion of the worker together with the work video. With this configuration, both the motion information based on the hand motion of the worker and the work video of the worker's work can be confirmed by displaying on the display unit, so that it is possible to easily confirm from the video whether the work by the worker is the cause of the defect. Effect of the Invention

[0021] According to the present invention, as described above, it is possible to easily check whether or not a defect occurring in a board working device is a defect caused by the work of an operator. [Brief description of the drawings]

[0022] [Figure 1]1 is a schematic diagram of a board working system according to one embodiment; [Diagram 2] FIG. 2 is a block diagram showing a configuration of a printing device of the board working system according to an embodiment. [Diagram 3] 1 is a block diagram showing a configuration of a component mounting device of a board working system according to an embodiment of the present invention; [Figure 4] 2 is a block diagram showing a configuration of a first inspection device of the board working system according to one embodiment. FIG. [Diagram 5] FIG. 4 is a block diagram showing a configuration of a second inspection device of the board working system according to one embodiment. [Figure 6] FIG. 2 is a block diagram showing a configuration of a management server of the board working system according to one embodiment. [Figure 7] FIG. 2 is a block diagram showing a configuration of a client terminal of the board working system according to one embodiment. [Figure 8] FIG. 1 is a block diagram showing a configuration of smart glasses of a board working system according to an embodiment. [Figure 9] FIG. 2 is a block diagram showing a motion capture configuration of the board work system according to one embodiment. [Figure 10] 13 is a schematic diagram showing a defect information confirmation screen displayed on a display unit of a client terminal of the board working system according to one embodiment; FIG. [Figure 11] FIG. 13 is a schematic diagram showing a defect information confirmation screen of the board working system according to the embodiment; [Figure 12] FIG. 11 is a diagram showing an example of operation information of the board working system of the embodiment. [Figure 13] FIG. 13 is a diagram showing an example of a display of a specific work operation of the board working system according to an embodiment. [Figure 14] 13 is a flowchart of a defect information display process executed in a client terminal of a board working system according to an embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0023] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings.

[0024] The configuration of a board working system 100 according to an embodiment of the present invention will be described with reference to FIGS.

[0025] (Configuration of the circuit board processing system) As shown in FIG. 1, a board processing system 100 is a system for mounting components E (electronic components) such as ICs, transistors, capacitors, and resistors on a printed circuit board or the like, and manufacturing a board P on which the components E are mounted.

[0026] The board work system 100 includes a printing device 1, a component mounting device 2, a first inspection device 3, a reflow furnace 4, a second inspection device 5, a management server 6, and a client terminal 7. The printing device 1, the component mounting device 2, the first inspection device 3, the reflow furnace 4, and the second inspection device 5 are configured to perform a board manufacturing operation for manufacturing a board P on which a component E is mounted. The board work system 100 also includes smart glasses 8 and a motion capture device 9. Each of the printing device 1, the component mounting device 2, the first inspection device 3, the reflow furnace 4, and the second inspection device 5 is an example of a "board work device" in the claims. The client terminal 7 is an example of a "control device" in the claims. The motion capture device 9 is an example of a "motion acquisition device" and a "motion capture member" in the claims.

[0027] (Printing device) 1 and 2, the printing device 1 is a device that performs a printing operation of screen-printing solder on a printed circuit board as a board manufacturing operation for manufacturing a board P on which components E are mounted. The printing device 1 includes a screen mask 11, a squeegee 12, a mask imaging unit 13, a print inspection imaging unit 14, a communication unit 15, a CPU (Central Processing Unit) 16, and a storage unit 17.

[0028] The squeegee 12 is configured to spread the solder placed on the screen mask 11 pressed against the printed circuit board, thereby printing (transferring) the solder in a predetermined pattern onto the printed circuit board.

[0029] The mask imaging unit 13 is configured to capture an image of the screen mask 11. In the printing device 1, the screen mask 11 is inspected based on the captured image of the screen mask 11. This makes it possible to detect, for example, clogging of the screen mask 11.

[0030] The print inspection imaging unit 14 is configured to capture an image of the printed circuit board after the printing operation on which the solder has been printed. The printing device 1 inspects the solder on the printed circuit board based on the captured image of the printed circuit board after the printing operation. This makes it possible to inspect, for example, the solder bleeding, fading, and amount of misalignment on the printed circuit board. The printing device 1 also judges whether the solder on the printed circuit board is good or bad based on the inspection results of the solder on the printed circuit board. An image that is judged to be bad is a defective image. In this case, the printing operation as a board manufacturing operation is judged to be bad.

[0031] The communication unit 15 is configured to communicate with devices other than the printing device 1 (the component mounting device 2, the first inspection device 3, the reflow furnace 4, the second inspection device 5, and the management server 6).

[0032] The storage unit 17 stores the captured image captured by the mask imaging unit 13 and the captured image captured by the print inspection imaging unit 14 as image data.

[0033] (Component mounting equipment) 1 and 3, the component mounting apparatus 2 is an apparatus that performs a mounting operation of mounting a component E on a printed circuit board on which solder is printed, as a board manufacturing operation for manufacturing a board P on which the component E is mounted. The component mounting apparatus 2 includes a mounting head 21, a component imaging unit 22, a board imaging unit 23, a communication unit 24, a CPU 25, and a storage unit 26.

[0034] The mounting head 21 is configured so that a nozzle for sucking the component E when mounting the component E on the board P can be detachably attached thereto.

[0035] The component imaging unit 22 is configured to image the component E adsorbed to the nozzle of the mounting head 21 from below. The component mounting device 2 is configured to acquire the position of the component E adsorbed to the nozzle of the mounting head 21 based on the image captured by the component imaging unit 22. This makes it possible to inspect, for example, the adsorption state of the component E as viewed from below, the amount of positional deviation of the component E from the nozzle center, and the size (depth and width) of the component E. Furthermore, the component mounting device 2 judges whether the component E adsorbed to the nozzle of the mounting head 21 is good or bad based on the inspection result of the component E adsorbed to the nozzle of the mounting head 21. An image that is judged to be bad is a defective image. In this case, the adsorption operation as a board manufacturing operation is judged to be bad.

[0036] The board imaging unit 23 is configured to capture an image of an FI mark (Fiducial Mark, not shown) attached to the top surface of the printed board prior to mounting the component E on the printed board. The FI mark is a mark for acquiring the position of the printed board. The component mounting apparatus 2 is configured to acquire the position of the printed board based on the captured image captured by the board imaging unit 23.

[0037] The communication unit 24 is configured to communicate with devices other than the component mounting device 2 (the printing device 1, the first inspection device 3, the reflow furnace 4, the second inspection device 5, and the management server 6).

[0038] The storage unit 26 stores the captured images captured by the component imaging unit 22 and the captured images captured by the board imaging unit 23 as image data.

[0039] (First inspection device) 1 and 4, the first inspection device 3 is an apparatus that performs a pre-reflow inspection operation of components E on a substrate P after a mounting operation on which the components E are mounted, as a substrate manufacturing operation for manufacturing a substrate P on which the components E are mounted. The first inspection device 3 includes an inspection imaging unit 31, a communication unit 32, a CPU 33, and a storage unit 34.

[0040] The inspection imaging unit 31 is configured to image the component E on the printed circuit board after the mounting work on which the component E is mounted. The first inspection device 3 is configured to inspect the component E on the printed circuit board based on the image of the component E on the printed circuit board after the mounting work. This makes it possible to inspect, for example, a lack of solder on the printed circuit board, the amount of misalignment of the component E, and floating of the component E. Furthermore, the first inspection device 3 judges whether the component E on the printed circuit board is good or bad based on the inspection result of the component E on the printed circuit board. An image judged to be bad is a defective image. In this case, the mounting work as a board manufacturing work is judged to be bad.

[0041] The communication unit 32 is configured to communicate with devices other than the first inspection device 3 (the printing device 1, the component mounting device 2, the reflow furnace 4, the second inspection device 5, and the management server 6).

[0042] The storage unit 34 stores the captured image captured by the inspection imaging unit 31 as image data.

[0043] (reflow oven) 1, the reflow furnace 4 performs a reflow operation of joining components E to a printed circuit board by melting and solidifying solder printed on the printed circuit board as a board manufacturing operation for manufacturing a board P on which components E are mounted. Although not shown, the communication unit 52 of the reflow furnace 4 includes a communication unit capable of communicating with other devices other than the reflow furnace 4 (the printing device 1, the component mounting device 2, the first inspection device 3, the second inspection device 5, and the management server 6).

[0044] (Second inspection device) 1 and 5, the second inspection device 5 is a device that performs a post-reflow inspection operation of components E on a printed circuit board after a reflow operation as a board manufacturing operation for manufacturing a board P on which components E are mounted. The second inspection device 5 includes an inspection imaging unit 51, a communication unit 52, a CPU 53, and a storage unit 54.

[0045] The inspection imaging unit 51 is configured to image the component E on the printed circuit board after the mounting operation on which the component E is mounted. The second inspection device 5 is configured to inspect the component E on the printed circuit board based on the image of the component E on the printed circuit board after the reflow operation. This makes it possible to inspect, for example, a lack of solder on the printed circuit board, the amount of misalignment of the component E, and floating of the component E. Furthermore, the second inspection device 5 judges whether the component E on the printed circuit board is good or bad based on the inspection result of the component E on the printed circuit board. An image judged to be bad is a bad image. In this case, at least one of the printing operation, the mounting operation, and the reflow operation as the board manufacturing operation is judged to be bad.

[0046] The communication unit 52 is configured to communicate with devices other than the second inspection device 5 (the printing device 1, the component mounting device 2, the first inspection device 3, the reflow furnace 4, and the management server 6).

[0047] The storage unit 54 stores the captured image captured by the inspection imaging unit 51 as image data.

[0048] (Management Server) As shown in FIG. 1 and FIG. 6, the management server 6 is a control device that manages information about a mounting line in which the printing device 1, the component mounting device 2, the first inspection device 3, the reflow furnace 4, and the second inspection device 5 are arranged in a straight line. The management server 6 includes a communication unit 61, a CPU 62, a storage unit 63, and the like. The communication unit 61 is configured to communicate with the printing device 1, the component mounting device 2, the first inspection device 3, the reflow furnace 4, and the second inspection device 5, the client terminal 7, the smart glasses 8, and the motion capture device 9. The storage unit 63 stores a data management program that manages data about mounting by the mounting line. The storage unit 63 also stores an equipment database Db that is a database of information such as captured images of the printing device 1, the component mounting device 2, the first inspection device 3, the reflow furnace 4, and the second inspection device 5, and a work video Mv captured by a video capture camera 81. The storage unit 63 also stores motion information MI based on the motion of the worker's hands acquired by the motion capture 9.

[0049] (Client terminal) As shown in FIG. 1 and FIG. 7, the client terminal 7 is a terminal such as a stationary personal computer operated by the worker W. The client terminal 7 includes a display unit 71, a communication unit 72, a CPU 73, and a storage unit 74. The display unit 71 is configured with a liquid crystal screen. The display unit 71 is configured to display information transmitted from the management server 6 on the screen. The communication unit 72 is configured to communicate with the management server 6. The storage unit 74 stores a defect information confirmation program Pr that causes the display unit 71 to display a defect information confirmation screen Gc including information on defects detected in the printing device 1, the component mounting device 2, the first inspection device 3, and the second inspection device 5. The defect information confirmation program Pr will be described in detail later.

[0050] (Smart Glasses) 1 and 8, the smart glasses 8 are a head-mounted wearable terminal that can be worn by a worker W. The smart glasses 8 include a video camera 81, a communication unit 82, a CPU 83, and a storage unit 84. The video camera 81 is an example of a "video imaging unit" in the claims.

[0051] The smart glasses 8 are configured to capture the same viewpoint as the worker W. This allows the smart glasses 8 to capture the area around the worker W's hands. The smart glasses 8 are configured to capture the work of the worker W while the worker W is performing work related to the manufacture of the board P using the printing device 1, the component mounting device 2, etc. The work of the worker W includes a supply work of supplying a screen mask 11 to the printing device 1, a supply work of supplying a reel containing components E to the component mounting device 2, an unloading work of unloading an empty reel from the component mounting device 2, and an adjustment work of opening the covers of the printing device 1, the component mounting device 2, etc. and adjusting the configuration inside the device.

[0052] Here, when the worker W performs work on the printing device 1, the component mounting device 2, the first inspection device 3, and the second inspection device 5, he / she needs to perform an operation on the device on which the work is to be performed so that the worker W can perform the work. That is, before performing the work, the worker W performs an operation on the device on which the work is to be performed by inputting the identification ID (Identification) of the worker W registered in advance in the management server 6 and a password associated with the identification ID. When the registered identification ID and password match, the management server 6 is configured to control the device on which the work is to be performed to transmit a signal that allows the worker W to perform the work on the device on which the work is to be performed to the device on which the work is to be performed. The device on which the work is to be performed is configured to unlock the device based on the acquisition of the signal that allows the worker W to perform the work. This enables the worker W to perform the work on the device. This operation is an authentication operation. During this authentication operation, the management server 6 is configured to control the recording of the date and time based on the match of the registered identification ID and password.

[0053] The video camera 81 is a camera for taking a video of the work video Mv of the worker W. The video camera 81 is configured to continue taking a video of the work of the worker W at a low frame rate while the worker W is working. The low frame rate indicates a frame rate of about 2 to 3 fps. The video camera 81 is configured to take a video of the work of the worker W in the form of a video. The communication unit 82 is configured to transmit the work video Mv taken by the video camera 81 to the management server 6 while the worker W is working on the printing device 1, the component mounting device 2, etc., related to the manufacture of the board P. As a result, the work video Mv taken at the low frame rate is stored in the storage unit 63 of the management server 6. The storage unit 84 stores a program for taking a video.

[0054] (Motion Capture) 1 and 9, the motion capture device 9 includes a sensor 91 for detecting the hand motion of the worker W, and a communication unit 82. The motion capture device 9 can be attached to the worker W's hand.

[0055] The motion capture 9 acquires the hand movements of the worker W performing work related to the manufacture of the board using the board work devices (printing device 1, component mounting device 2). Specifically, the motion capture 9 is configured to acquire the hand movements of the worker W throughout the time the worker W is performing work related to the manufacture of the board P using the printing device 1, the component mounting device 2, etc.

[0056] A plurality of sensors 91 are provided on each hand, and can acquire the motion of the fingers of the hand. For example, a sensor 91 is provided for each finger. The sensors 91 are also provided on the palm, the back of the hand, and the wrist. The sensors 91 can detect acceleration in the horizontal X direction, the horizontal Y direction perpendicular to the X direction, and the vertical Z direction. The sensors 91 can also detect angular acceleration around the X direction, angular acceleration around the Y direction, and angular acceleration around the Z direction. The sensors 91 are, for example, capacitance type or piezo-resistance type acceleration sensors.

[0057] The communication unit 92 is configured to transmit the detection result of the hand motion of the worker W acquired by the sensor 91 to the management server 6. As a result, the memory unit 63 of the management server 6 stores motion information MI based on the hand motion of the worker W.

[0058] (Defect information confirmation program) 10 and 11, the client terminal 7 is configured to control display of the work video Mv on the display unit 71 in a playable state based on an operation by the operator on a defect information confirmation screen Gc displayed on the display unit 71 based on the defect information confirmation program Pr. The playable state of the work video Mv indicates that the work video Mv is displayed on the defect information confirmation screen Gc in a state in which it is played based on an operation to start playback by the operator. In FIG. 10, the operation to start playback by the operator is an operation of the operator clicking on a horizontal black triangle.

[0059] Here, in this embodiment, the client terminal 7 is configured to perform control to cause the display unit 71 to display the motion information MI based on the hand motion of the worker W acquired by the motion capture 9.

[0060] Specifically, the client terminal 7 is configured to control the display unit 71 to display the operation information MI in a manner that makes it possible to identify the relationship with the work performed by the worker W on the board work devices (printing device 1, component mounting device 2).

[0061] As shown in FIG. 11, the client terminal 7 is configured to control the display of a defect information confirmation screen Gc on the display unit 71, the defect information including the defect occurrence time Tm, the substrate identification information Sb of the substrate P in which a defect was detected in the substrate manufacturing work, a defective image among the above-mentioned captured images in which a defect was detected in the substrate manufacturing work, and a work video Mv in a playable state.

[0062] The client terminal 7 is configured to control displaying the defect occurrence time Tm and the board identification information Sb and line identification information Li related to the defect occurrence time Tm, which are registered in advance in the equipment database Db, on the defect information confirmation screen Gc. The client terminal 7 is configured to control acquisition of a defect image related to the defect occurrence time Tm and a work video Mv in a playable state, based on an operation of the operator of the client terminal 7 who selects the defect occurrence time Tm. Here, the defect image and the work video Mv are registered in advance in the equipment database Db. The board manufacturing work also includes the above-mentioned printing work, mounting work, pre-reflow inspection work, reflow work, and post-reflow inspection work.

[0063] 11 shows, as an example, a case in which printing device 1 detects a shortage of solder at a predetermined mounting position on a printed circuit board, but component mounting device 2, first inspection device 3, and second inspection device 5 each perform board manufacturing work to produce board P. The contents displayed in FIG. 11 will be explained below.

[0064] The defect occurrence time Tm is displayed on the defect information confirmation screen Gc not only as a date but also as an hour and minute. The board identification information Sb on the defect information confirmation screen Gc displays the number of the board P to be manufactured, which is registered in advance in the management server 6. The line identification information Li on the defect information confirmation screen Gc displays the number of the mounting line, which is registered in advance in the management server 6.

[0065] In Figure 11, as examples of defect images, the defect information confirmation screen Gc displays a defect image G1 captured by the component imaging unit 22, a defect image G2 captured by the inspection imaging unit 31 of the first inspection device 3, and a defect image G3 captured by the second inspection device 5.

[0066] Furthermore, on the defect information confirmation screen Gc, a work video Mv1 of a worker W (first worker W1) who was working on the printing device 1 is displayed in a playable manner.

[0067] Also, a thumbnail image Sa1 of the work video Mv1 of the first worker W1 is displayed below the work video Mv1. The thumbnail images Sa1 are displayed for each date and time when the worker W performed an authentication operation on the device performing the work in the work video Mv1. The "▼" displayed in FIG. 11 indicates the playback start position of the work video Mv1. Also, the thumbnail image Sa1 selected by the operator is shown covered with hatching. As a result, when the operator clicks on the horizontal black triangle, the work video Mv1 is played from the above-mentioned playback start position.

[0068] Also, below the work video Mv1, thumbnail images Sa2 of the work video Mv of the worker W (second worker W2) who worked on the printing device 1 shortly before the first worker W1 is displayed. The thumbnail images Sa2 are displayed in the work video Mv of the second worker W2 for each date and time when the worker W performed an authentication operation on the device on which the work was performed.

[0069] The client terminal 7 is configured to search for information registered in the device database Db based on the defect information confirmation program Pr in order to confirm the work of the worker W described above, and to control the acquisition of the work video Mv. That is, the client terminal 7 is configured to search for candidates for the work video Mv of the worker W related to the defects of the board manufacturing work detected in the board working device based on the defect information confirmation program Pr in order to confirm the work of the worker W described above, and to control the acquisition of the work video Mv searched as the candidate. The board working device includes the printing device 1, the component mounting device 2, the first inspection device 3, the reflow furnace 4, and the second inspection device 5 described above. In FIG. 10, the work video Mv1 of the first worker W1 and the work video Mv of the second worker W2 are acquired.

[0070] Furthermore, the client terminal 7 is configured to perform control to search for a candidate work video Mv of a worker W who worked on a board manufacturing device that performed board manufacturing work on a board P in which a defect in the board manufacturing work was detected before the defect occurrence time Tm, based on a defect occurrence time Tm at which the defect in the board manufacturing work occurred. In the example shown in Fig. 11, the client terminal 7 searches for a candidate work video Mv of a worker W who worked on a printing device 1 in which a printing work defect occurred before the defect occurrence time Tm, based on a defect occurrence time Tm at which the printing work defect occurred.

[0071] The client terminal 7 is configured to control searching for a candidate work video Mv of a worker W who worked on the board manufacturing device that performed the board manufacturing work on the board P where a defect in the board manufacturing work was detected, based on a predetermined range of time between a time going back a predetermined time (e.g., 30 minutes) from the defect occurrence time Tm and the defect occurrence time Tm. In the example shown in Fig. 11, the client terminal 7 is configured to control searching for a candidate work video Mv of a first worker W1 and a second worker W2 who worked on the printing device 1 where a defect in the printing work occurred, based on a predetermined range of time between a time going back a predetermined time from the defect occurrence time Tm and the defect occurrence time Tm.

[0072] In this way, the client terminal 7 is configured to perform control to search for each of the work videos Mv of the multiple workers W as candidates when there are multiple workers W who worked on the board working device that performed the board manufacturing work on the board P on which a defect in the board manufacturing work was detected within a predetermined time range. In the example shown in Fig. 10, the work videos Mv of the first worker W1 and the second worker W2 are searched for as candidates. In addition, the work video Mv1 of the first worker W1 is displayed so as to be playable.

[0073] The client terminal 7 is configured to control the setting of the playback start position of the work video Mv based on the time when the worker W performs an operation on the board working device to enable the worker W to work on the board working device. In the example shown in FIG. 11, the set playback start position of the work video Mv1 of the first worker W1 and the set playback start position of the work video Mv of the second worker W2 are each displayed with a "▼". The set playback start position of the work video Mv1 of the first worker W1 is the time when the first worker W1 performed the authentication operation on the printing device 1. In addition, the set playback start position of the work video Mv of the second worker W2 is the time when the second worker W2 performed the authentication operation on the printing device 1.

[0074] The client terminal 7 is configured to perform control to play back the work video Mv from the playback start position, based on receipt of an operation to start playback from the operator.

[0075] Furthermore, the client terminal 7 is configured to control displaying, on the display unit 71, in a playable state, a work video Mv related to a defect in the board manufacturing work detected in the board work apparatus (printing apparatus 1, component mounting apparatus 2), and displaying, together with the work video Mv, motion information MI of the hand motion of the corresponding worker W on the display unit 71. In the example shown in Fig. 11, the motion information MI is displayed on the display unit 71 together with the work video Mv1 of the first worker W1.

[0076] In other words, the client terminal 7 is configured to control the display of a defect information confirmation screen Gc on the display unit 71, which includes board identification information Sb of the board P in which a defect was detected in the board manufacturing work, the defect occurrence time Tm when the defect occurred, defective images G1, G2, G3 in which a defect was detected in the board manufacturing work among the images captured by the board work devices (printing device 1, component mounting device 2), a work video Mv in a playable state, and movement information MI of the hand movements of the worker W.

[0077] The motion information MI is, for example, a visually visible two-dimensional or three-dimensional image. Also, the motion information MI is, for example, a graph showing the motion of the hand of the worker W against time, as shown in Figs. 12 and 13.

[0078] Furthermore, the client terminal 7 displays the movement information MI of the hand movements of the same worker W on the display unit 71 in synchronization with the playback of the work video Mv for the same time.

[0079] In addition, in this embodiment, the client terminal 7 is configured to control the classification of hand movements made by the worker W during work and displaying them on the display unit 71 based on the movement information MI acquired by the motion capture 9.

[0080] Specifically, based on the movement information MI acquired by the motion capture 9, the client terminal 7 classifies the hand movements of the worker W during work into specific work movements in which a specific task is performed and non-specific work movements that are not similar to the specific work movements, and controls the display unit 71 to display the specific work movements and non-specific work movements in different formats.

[0081] Here, when the worker W performs repetitive movements in succession, the worker W tends to move his / her hands with similar start and force each time because the same movements are repeated. By classifying the hand movements and displaying them on the display unit 71, it becomes possible to easily check different movements among the successive tasks.

[0082] For example, the client terminal 7 displays specific work actions and non-specific work actions on the display unit 71 in different colors.

[0083] As shown in Fig. 12, the client terminal 7 marks specific movement parts of the movement information MI of the hand of the worker W. In the example shown in Fig. 12, markings Mk1 to Mk6 are used. In the example shown in Fig. 12, a graph of the movement amount in the XYZ directions of the hand movement is used as the movement information.

[0084] 12, the portion including MK1 and MK2 is displayed as a specific work motion, and the portion including Mk3 to Mk6 is displayed as a non-specific work motion.

[0085] In addition, the client terminal 7 compares the registered motion information of the hand motions performed by the worker W during work, which has been acquired in advance, with the motion information MI acquired by the motion acquisition device, and classifies the hand motions performed by the worker W during work.

[0086] That is, the client terminal 7 acquires the hand motion of the worker W in advance and stores it as registered motion information in the storage unit 74. In this case, the client terminal 7 may acquire the motion of the worker W multiple times and register the average value as the registered motion information. Also, the client terminal 7 may set a threshold value for the motion value based on the motion of the worker W and determine a motion within the threshold range as a registered motion.

[0087] Furthermore, the client terminal 7 registers the registered action information in association with the work of the board work devices (printing device 1, component mounting device 2) of the worker W. For example, the client terminal 7 registers work actions, such as an action of opening the cover of the board work devices (printing device 1, component mounting device 2), an action of replacing components, an action of replenishing components, an action of preparing components required for setup, and an action of preparing a tape reel that holds components to be mounted on the board, in association with the registered action information.

[0088] (Defect information display processing) With reference to FIG. 14, a defect information display process for displaying the work video Mv in a playable manner on the display unit 71 by the client terminal 7 based on the defect information confirmation program Pr will be described below.

[0089] In step S1, a defect information confirmation screen Gc is displayed on the display unit 71 based on an operation by an operator to execute the defect information confirmation program Pr. At this time, the defect information confirmation screen Gc displays a plurality of defect occurrence times Tm, as well as board identification information Sb and line identification information Li corresponding to each of the plurality of defect occurrence times Tm. In step S2, it is determined whether the operator has selected any of the plurality of defect occurrence times Tm. If the operator has selected one, the process proceeds to step S3, and if the operator has not selected one, step S2 is repeated. In step S3, a defect image related to the defect of the selected defect occurrence time Tm is searched for and displayed on the defect information confirmation screen Gc. That is, the client terminal 7 searches for information registered in the device database Db of the management server 6 to obtain the defect image.

[0090] In step S4, candidates for work videos Mv related to the selected defect at the defect occurrence time Tm are searched for and displayed on the defect information confirmation screen Gc. That is, the client terminal 7 searches for information registered in the device database Db of the management server 6 to obtain work videos Mv related to the defect. In this way, step S4 is a step of searching for candidates for work videos Mv of the worker W related to the defect in the board manufacturing work detected in the board working device from among the work videos Mv captured by the smart glasses 8 of the worker W performing work related to the manufacture of the board P on the board working device configured to perform the board manufacturing work. Also, step S4 is a step of displaying the work videos Mv searched for as candidates on the display unit 71 in a reproducible state.

[0091] In step S5, the motion information MI based on the hand motion of the worker W related to the selected defect having the defect occurrence time Tm is displayed on the defect information confirmation screen Gc. After step S5, the defect information display process ends.

[0092] (Effects of the embodiment) In this embodiment, the following effects can be obtained.

[0093] In this embodiment, as described above, a client terminal 7 is provided that controls displaying the motion information MI based on the hand motion of the worker W acquired by the motion capture 9 on the display unit 71. As a result, by checking the motion information MI displayed on the display unit 71, the work of the worker W related to defects in the board manufacturing work can be easily visually confirmed, and therefore it can be easily confirmed whether or not a defect that has occurred in the board work device (printing device 1, component mounting device 2) is a defect caused by the work of the worker W.

[0094] Furthermore, in this embodiment, as described above, the client terminal 7 controls the display unit 71 to display the motion information MI in a manner that enables identification of the association with the work performed by the worker W on the board working devices (printing device 1, component mounting device 2). As a result, both the motion information MI of the hand motion of the worker W acquired by the motion capture 9 and the work performed by the worker W on the board working devices (printing device 1, component mounting device 2) are displayed on the display unit 71 in association with each other, making it easier to check whether the hand motion of the worker W is due to a defect.

[0095] Furthermore, in this embodiment, as described above, a video recording camera 81 is provided that captures the work video Mv by recording the work of the worker W, and the client terminal 7 controls the display unit 71 to display the work video Mv related to defects in the board manufacturing work detected in the board work devices (printing device 1, component mounting device 2) in a reproducible state, and also controls the display unit 71 to display the corresponding motion information MI of the hand motion of the worker W together with the work video Mv. This allows both the motion information MI based on the hand motion of the worker W and the work video Mv capturing the work of the worker W to be confirmed by displaying it on the display unit 71, making it possible to easily confirm from the video whether the work by the worker W is the cause of the defect.

[0096] In this embodiment, as described above, the client terminal 7 performs control to classify hand movements of the worker W during work based on the motion information MI acquired by the motion capture 9 and display the classified hand movements on the display unit 71. This allows the type of hand movement of the worker W to be easily confirmed.

[0097] Furthermore, in this embodiment, as described above, the client terminal 7 classifies hand movements made by the worker W during work into specific work movements for performing a specific task and non-specific work movements that are not similar to the specific work movements, based on the motion information MI acquired by the motion capture 9, and controls displaying the specific work movements and non-specific work movements in different modes on the display unit 71. This makes it easy to check whether the worker W has performed a specific task by viewing the different displays on the display unit 71.

[0098] Furthermore, in this embodiment, as described above, the client terminal 7 compares the registered motion information of the hand motions performed by the worker W during work acquired in advance with the motion information MI acquired by the motion acquisition device, and classifies the hand motions performed by the worker W during work. This allows the hand motions of the worker W to be classified based on the hand motions registered in advance, and therefore the hand motions of the worker W can be easily classified by type.

[0099] In this embodiment, as described above, the motion capture device 9 detects the hand movements of the worker W and can be worn on the hand. This allows the hand movements of the worker W to be directly acquired by the motion capture device 9, so that the hand movements of the worker W can be acquired with high accuracy.

[0100] In addition, in this embodiment, as described above, the client terminal 7 controls to display a defect information confirmation screen Gc on the display unit 71, the defect information including the board identification information Sb of the board P in which a defect was detected in the board manufacturing work, the defect occurrence time Tm when the defect occurred, the defective images G1, G2, G3 in which a defect was detected in the board manufacturing work among the captured images captured by the board working devices (printing device 1, component mounting device 2), the work video Mv in a playable state, and the motion information MI of the hand motion of the worker W. As a result, by checking the defect information confirmation screen Gc displayed on the display unit 71, the board identification information Sb, the defect occurrence time Tm, the defective images G1, G2, G3, the work video Mv, and the hand motion of the worker can be checked, so that the confirmation work of the defects in the board manufacturing work can be efficiently performed.

[0101] [Variations] The embodiments disclosed herein should be considered to be illustrative and not restrictive in all respects. The scope of the present invention is indicated by the claims, not by the description of the embodiments above, and further includes all modifications (variations) within the meaning and scope of the claims.

[0102] For example, in the above embodiment, an example of a configuration in which motion information of a worker's hand is acquired by a motion capture device attached to the worker's hand is shown, but the present invention is not limited to this. In the present invention, the worker's hand may be photographed by a camera, and the motion information of the worker's hand may be acquired based on the captured image. In other words, the motion acquisition device may include a camera and a computer that calculates the motion information from the image.

[0103] In the above embodiment, the motion information of the worker's hands is displayed on the display unit together with the work video, but the present invention is not limited to this. In the present invention, the motion information may be displayed on the display unit without displaying the work video on the display unit.

[0104] In the above embodiment, an example of a configuration in which the worker's work is captured by using smart glasses as a video capture unit to obtain a work video is shown, but the present invention is not limited to this. In the present invention, the video capture unit may be a camera that is fixed to a building or device and captures the worker's work, rather than a wearable terminal such as smart glasses.

[0105] In the above embodiment, the client terminal as the control device is a terminal such as a stationary personal computer operated by the worker, but the present invention is not limited to this. In the present invention, the control device may be a mobile terminal carried by the worker.

[0106] In the above embodiment, an example was shown in which two work videos Mv were searched as candidates, but the present invention is not limited to this. In the present invention, the number of work videos searched as candidates may be one, or three or more.

[0107] In the above embodiment, for convenience of explanation, the control process of the client terminal (control device) is described using a flow-driven flowchart in which the process is performed in order according to the process flow, but the present invention is not limited to this. In the present invention, the control process of the control device may be performed by an event-driven process in which the process is performed on an event-by-event basis. In this case, the control process may be performed completely event-driven, or may be a combination of event-driven and flow-driven. [Explanation of symbols]

[0108] 1 Printing device (substrate work device) 2 Component mounting equipment (board work equipment) 3. First inspection device (substrate work device) 4 Reflow oven (board processing equipment) 5. Second inspection device (substrate work device) 7 Client terminal (control device) 9 Motion capture (motion capture device, motion capture components) 71 Display section 81 Video camera (video recording unit) 100 PCB Work System E Parts G1, G2, G3 defective images Gc Defect information confirmation screen MI Operation Information Mv, Mv1 work video P board W Worker W1 1st worker (worker) W2 2nd Worker (Worker)

Claims

1. a board working device configured to perform a board manufacturing operation for manufacturing a board on which components are mounted; a motion acquisition device for acquiring hand motions of a worker performing a task related to the manufacture of the board on the board working device; A display unit; A board work system comprising: a control device that controls the display unit to display motion information based on the hand motion of a worker acquired by the motion acquisition device.

2. 2 . The board working system according to claim 1 , wherein the control device controls the display device to display the operation information in a manner that makes it possible to identify a relationship between the operation information and a work performed by a worker on the board working device.

3. A video capture unit is further provided for capturing video of the work of the worker, The board work system of claim 1, wherein the control device controls the display unit to display the work video related to a defect in the board manufacturing work detected in the board work device in a reproducible state, and controls the display unit to display the movement information of the corresponding worker's hand movements together with the work video.

4. The board work system according to claim 1 , wherein the control device performs control to classify hand movements made by a worker during work and display the classified hand movements on the display unit based on the movement information acquired by the movement acquisition device.

5. The board work system of claim 4, wherein the control device classifies hand movements performed by a worker during work into specific work movements in which a specific task is performed and non-specific work movements that are not similar to the specific work movements based on the movement information acquired by the movement acquisition device, and controls the display unit to display the specific work movements and the non-specific work movements in different manners.

6. The board work system of claim 4, wherein the control device compares registered motion information of hand movements performed by the worker during work acquired in advance with the motion information acquired by the motion acquisition device, and classifies the hand movements performed by the worker during work.

7. The board work system according to claim 1 , wherein the motion acquisition device includes a motion capture member that can be worn on a hand and detects the motion of the hand of the worker.

8. The board work system of claim 3, wherein the control device controls the display of a defect information confirmation screen on the display unit, the defect information including board identification information of the board in which a defect was detected in the board manufacturing work, the time when the defect occurred, a defective image in which a defect was detected in the board manufacturing work among the images captured by the board work device, the work video in a playable state, and the movement information of a worker's hand movements.

9. acquiring hand motions of a worker performing work related to the manufacture of a board using a board work device configured to perform a board manufacturing work for manufacturing a board on which components are mounted; and displaying the acquired motion information based on the hand motion of the worker on a display unit.

10. 10. The operation information display method according to claim 9, wherein the step of displaying the operation information on the display unit includes displaying the operation information on the display unit in a manner that makes it possible to identify the relationship between the operation information and the work performed by a worker on the board working apparatus.

11. 10. The method of displaying motion information according to claim 9, wherein the step of displaying the motion information on the display unit includes displaying on the display unit a work video captured of a worker's work related to a defect in the board manufacturing work detected by the board work apparatus in a playable state, and displaying on the display unit the motion information of the corresponding hand movements of the worker together with the work video.

Images