Board work system and defect information display method
The board working system facilitates defect identification by replaying worker videos to determine error causes, optimizing video review complexity and storage, addressing the challenge of confirming defect origins in board manufacturing systems.
Patent Information
- Application Number
- JP2022126829
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2022-08-09
- Publication Date
- 2026-01-26
- Estimated Expiration
- 2042-08-09
AI Technical Summary
Existing board working systems struggle to determine whether defects in board manufacturing are caused by worker errors, making it difficult to confirm the source of defects in surface mounting devices.
A board working system equipped with a video capture unit, control device, and display unit that allows operators to replay work videos to identify defects caused by worker actions, minimizing the number of candidate videos through time-based and worker-specific searches, and utilizing wearable smart glasses for video capture at a low frame rate to reduce data storage needs.
Enables easy identification of defects caused by worker errors, reduces the complexity of video review, and optimizes storage capacity by minimizing unnecessary video data, enhancing defect confirmation efficiency.
Smart Images

Figure 0007805892000001 
Figure 0007805892000002 
Figure 0007805892000003
Abstract
Description
[Technical Field]
[0001] The present invention relates to a board work system and a defect information display method, and more particularly to a board work system including a board work device configured to perform board manufacturing work, and a defect information display method. [Background technology]
[0002] BACKGROUND ART Conventionally, a board working system including a board working device configured to perform board manufacturing work has been known (see, for example, Patent Document 1).
[0003] The above-mentioned Patent Document 1 discloses a work support system (board work system) equipped with a surface mounting device (board work device) configured to perform work of mounting electronic components on a board (board manufacturing work). This work support system includes an inspection machine including a judgment unit and a result display unit. The inspection machine is configured to acquire image data of the electronic components mounted on the board, which is imaged by the surface mounting device. The inspection machine is configured so that the judgment unit judges defects, such as whether the chip is floating, based on the acquired image data. The result display unit is configured to display the defect judgment result by the judgment unit.
[0004] The result display unit of Patent Document 1 is configured to display the time when the defect occurred and an image of the defective electronic component mounted on the board that has been determined to be defective, based on the determination result. [Prior art documents] [Patent documents]
[0005] [Patent Document 1] Patent No. 6666997 Summary of the Invention [Problem to be solved by the invention]
[0006] However, in the work support system of Patent Document 1, while a worker can see the defect image displayed by the result display unit and confirm, for example, a chip floating state in which part of an electronic component is floating above the board, it is difficult to confirm whether the chip floating state is caused by the worker's work, such as incorrect work or carelessness. Therefore, a system is desired that makes it easy to confirm whether a defect that has occurred in a surface mounting device (board work device) is caused by the worker's work.
[0007] The present invention has been made to solve the above-mentioned problems, and one object of the present invention is to provide a board working system that makes it possible to easily check whether a defect that occurs in a board working device is a defect caused by the work of an operator. [Means for solving the problem]
[0008] In order to achieve the above object, a board work system according to a first aspect of the present invention includes a board work device configured to perform board manufacturing work for manufacturing boards on which components are mounted, a video capture unit that captures work video of a worker performing work related to the manufacture of the board on the board work device, a control device that searches for candidate work videos of the worker related to a defect in the board manufacturing work detected on the board work device and controls acquisition of the work videos found as candidates, and a display unit, wherein the control device: From the time when the operator operated the PCB processing device In a playable state The acquired work video It is configured to control the display on the display unit.
[0009] In the board working system according to the first aspect of the present invention, a control device is provided that is configured to control the display of the acquired work video in a reproducible state on the display unit, as described above. This allows the operator operating the control device to play back the work video, thereby allowing the operator to easily check the work of the worker related to the defect in the board manufacturing work, and therefore makes it easy to check whether the defect occurring in the board working device is a defect caused by the worker's work.
[0010] The second aspect of this invention In the board work system according to the aspect a board work device configured to perform board manufacturing work for manufacturing boards on which components are mounted; a video capture unit that captures work videos of workers performing work related to board manufacturing on the board work device; a control device that searches for candidate work videos of workers related to defects in board manufacturing work detected on the board work device and controls the acquisition of the work videos searched for as candidates; and a display unit, wherein the control device is configured to control the display unit to display the acquired work videos in a reproducible state; The control device is configured to control the search for candidate work videos of workers who worked on the board work device that performed the board manufacturing work on the board in which the defect in the board manufacturing work was detected before the time of the defect, based on the time when the defect occurred in the board manufacturing work. This means: Even when a large number of work videos are stored, the number of candidate work videos that are assumed to be related to defects in the board manufacturing work can be minimized, thereby preventing the operator of the control device from having to make complicated checks of the work videos.
[0011] In this case, the control device is preferably configured to perform control to search for candidate work videos of workers who performed work on the board work device that performed the board work on the board where the defect in the board manufacturing work was detected, based on a predetermined range of time between the time that is a predetermined time before the time of the defect and the time of the defect. With this configuration, it is possible to further reduce the number of candidate work videos that are assumed to be related to the defect in the board manufacturing work, thereby further preventing the operator of the control device from having to make complicated checks of the work videos.
[0012] In the board work system, the control device is configured to perform control to search for worker work videos as candidates based on a predetermined time range, preferably, when there are multiple workers who worked on the board work device that performed board work on a board on which a defect in board manufacturing work was detected within the predetermined time range, the control device is configured to perform control to search for each of the multiple workers' work videos as candidates. With this configuration, work videos of multiple workers who are assumed to be related to the defect in board manufacturing work are displayed, allowing the operator to more reliably confirm the work of the worker related to the defect in board manufacturing work.
[0013] In the board work system in which the control device is configured to control searching for worker work videos as candidates based on a predetermined time range, the control device is preferably configured to control setting of the playback start position of the work video based on the time when the worker performs an operation on the board work device to enable the worker to perform work. With this configuration, the playback start position of the work video can be automatically set to the worker's work start position within the predetermined time range, further reducing the complexity of the control device operator's work of checking the work video.
[0014] In the aforementioned board work system according to the first aspect, the video shooting unit preferably includes a wearable terminal configured to be wearable by the worker. With this configuration, the video shooting unit can move with the worker and shoot video of the worker's work, thereby reducing the number of cameras required to shoot video of the worker's work.
[0015] In the circuit board working system according to the first aspect, the video recording unit is preferably configured to continue recording video of the worker's work at a low frame rate while the worker is working, and the system further includes a storage unit that stores the work video recorded at the low frame rate. With this configuration, the amount of data of the work video stored in the storage unit can be relatively small, thereby preventing an increase in the storage capacity required to store the work video in the storage unit.
[0016] In a board work system in which the control device is configured to control searching for candidate work videos of workers who worked on a board work device that performed board work on a board in which a defect in the board manufacturing work was detected before the defect occurred, the control device preferably further includes an imaging unit, and the control device is configured to control displaying on the display unit a defect information confirmation screen including board identification information of the board in which the defect in the board manufacturing work was detected, the defect occurrence time, a defective image in which the defect in the board manufacturing work was detected from among the images captured by the imaging unit, and a playable work video. With this configuration, by checking the defect information confirmation screen displayed on the display unit, the operator can check the board identification information, the defect occurrence time, the defective image, and the work video, thereby enabling the operator to efficiently check defects in the board manufacturing work.
[0017] The first aspect of this invention 3 The defect information display method in this aspect includes the steps of: searching for a candidate work video of a worker related to a defect in the board manufacturing work detected by the board working device from work videos taken by a video taking unit of a worker performing work related to the manufacturing of a board using a board working device configured to perform board manufacturing work for manufacturing a board on which components are mounted; From the time when the operator operated the PCB processing device In a playable state The work videos searched as candidates and a step of displaying the information on a display unit.
[0018] The first aspect of this invention 3 In the defect information display method according to the aspect, as described above, a step of displaying the work videos searched for as candidates on the display unit in a reproducible state is provided. This allows the operator operating the control device to play back the work videos, thereby allowing the operator to easily check the work of the worker related to the defect in the board manufacturing work, thereby providing a defect information display method that makes it possible to easily check whether a defect occurring in the board processing device is a defect caused by the worker's work. [Effects of the Invention]
[0019] According to the present invention, as described above, it is possible to easily check whether or not a defect occurring in a board working device is a defect caused by the work of an operator. [Brief explanation of the drawings]
[0020] [Figure 1] 1 is a schematic diagram of a board working system according to an embodiment; [Figure 2] FIG. 2 is a block diagram showing the configuration of a printing device of the board working system according to the embodiment. [Figure 3] 1 is a block diagram showing a configuration of a component mounting device of a board working system according to an embodiment of the present invention; [Figure 4] FIG. 2 is a block diagram showing the configuration of a first inspection device of the board working system according to the embodiment. [Figure 5] FIG. 3 is a block diagram showing the configuration of a second inspection device of the board working system according to one embodiment. [Figure 6] FIG. 2 is a block diagram showing the configuration of a management server of the board working system according to the embodiment. [Figure 7] FIG. 2 is a block diagram showing a configuration of a client terminal of the board working system according to the embodiment. [Figure 8] FIG. 1 is a block diagram showing the configuration of smart glasses of a board working system according to an embodiment. [Figure 9] 10 is a schematic diagram showing a state in which a defect information confirmation screen is displayed on a display unit of a client terminal of the board working system according to an embodiment; FIG. [Figure 10] FIG. 10 is a schematic diagram showing a defect information confirmation screen of the board working system according to the embodiment; [Figure 11] 10 is a schematic diagram showing a state in which a work video is played on a defect information confirmation screen of the board work system of the embodiment; FIG. [Figure 12] 10 is a flowchart of a defect information display process performed in a client terminal of a board working system according to an embodiment. DETAILED DESCRIPTION OF THE INVENTION
[0021] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, specific embodiments of the present invention will be described with reference to the accompanying drawings.
[0022] The configuration of a board working system 100 according to an embodiment of the present invention will be described with reference to FIGS.
[0023] (Configuration of the circuit board work system) As shown in FIG. 1, the board processing system 100 is a system for mounting components E (electronic components) such as ICs, transistors, capacitors, and resistors onto a printed circuit board or the like, and manufacturing a board P on which the components E are mounted.
[0024] The board work system 100 includes a printing device 1, a component mounting device 2, a first inspection device 3, a reflow furnace 4, a second inspection device 5, a management server 6, a client terminal 7, and smart glasses 8. Each of the printing device 1, the component mounting device 2, the first inspection device 3, the reflow furnace 4, and the second inspection device 5 is an example of a "board work device" in the claims. The client terminal 7 is an example of a "control device" in the claims. The smart glasses 8 are an example of a "video capture unit" in the claims.
[0025] (Printing device) 1 and 2, printing apparatus 1 is an apparatus that performs a printing operation of screen-printing solder on a printed circuit board as a board manufacturing operation for producing a board P on which components E are mounted. Printing apparatus 1 includes a screen mask 11, a squeegee 12, a mask imaging unit 13, a print inspection imaging unit 14, a communication unit 15, a CPU (Central Processing Unit) 16, and a memory unit 17. Each of mask imaging unit 13 and print inspection imaging unit 14 is an example of an "imaging unit" in the claims.
[0026] The squeegee 12 is configured to spread the solder placed on the screen mask 11 pressed against the printed circuit board, thereby printing (transferring) the solder in a predetermined pattern onto the printed circuit board.
[0027] The mask imaging unit 13 is configured to capture an image of the screen mask 11. In the printing device 1, the screen mask 11 is inspected based on the captured image of the screen mask 11. This makes it possible to detect clogging of the screen mask 11, for example.
[0028] The print inspection imaging unit 14 is configured to capture an image of the printed circuit board after printing on which solder has been printed. The printing device 1 inspects the solder on the printed circuit board based on the captured image of the printed circuit board after printing. This makes it possible to inspect, for example, the solder bleeding, fading, and misalignment amount on the printed circuit board. The printing device 1 also determines whether the solder on the printed circuit board is good or bad based on the inspection results of the solder on the printed circuit board. An image that is determined to be bad is a defective image. In this case, the printing work as part of the board manufacturing process is determined to be bad.
[0029] The communication unit 15 is configured to communicate with devices other than the printing device 1 (the component mounting device 2, the first inspection device 3, the reflow furnace 4, the second inspection device 5, and the management server 6).
[0030] The storage unit 17 stores the captured image captured by the mask image capturing unit 13 and the captured image captured by the print inspection image capturing unit 14 as image data.
[0031] (Component mounting equipment) 1 and 3, component mounting apparatus 2 is an apparatus that performs mounting work of mounting components E on a printed circuit board on which solder is printed, as a board manufacturing work for manufacturing a board P on which components E are mounted. Component mounting apparatus 2 includes a mounting head 21, a component imaging unit 22, a board imaging unit 23, a communication unit 24, a CPU 25, and a storage unit 26. Each of component imaging unit 22 and board imaging unit 23 is an example of the "imaging unit" in the claims.
[0032] The mounting head 21 is configured so that a nozzle for sucking the component E when mounting the component E on the board P can be detachably attached.
[0033] The component imaging unit 22 is configured to image the component E picked up by the nozzle of the mounting head 21 from below. The component mounting device 2 is configured to inspect the component E picked up by the nozzle of the mounting head 21 based on the image captured by the component imaging unit 22. This makes it possible to inspect, for example, the pickup state of the component E as viewed from below, the amount of positional deviation of the component E from the nozzle center, and the size (depth and width) of the component E. Furthermore, the component mounting device 2 determines whether the component E picked up by the nozzle of the mounting head 21 is good or bad based on the inspection results of the component E picked up by the nozzle of the mounting head 21. An image that is determined to be bad is a defective image. In this case, the pickup operation as part of the board manufacturing operation is determined to be bad.
[0034] The board imaging unit 23 is configured to capture an image of an FI mark (fiducial mark: not shown) attached to the top surface of the printed circuit board prior to mounting the component E on the printed circuit board. The FI mark is a mark for inspecting the position of the printed circuit board. The component mounting device 2 is configured to inspect the position of the printed circuit board based on the image captured by the board imaging unit 23. This makes it possible to inspect, for example, misalignment of the printed circuit board in the board transport direction. Furthermore, the component mounting device 2 determines whether the position of the printed circuit board is good or bad based on the inspection results of the FI mark. An image that is determined to be bad is a defective image. In this case, the transport operation as part of the board manufacturing process is determined to be bad.
[0035] The communication unit 24 is configured to communicate with devices other than the component mounting device 2 (the printing device 1, the first inspection device 3, the reflow furnace 4, the second inspection device 5, and the management server 6).
[0036] The storage unit 26 stores the captured images taken by the component imaging unit 22 and the captured images taken by the board imaging unit 23 as image data.
[0037] (First inspection device) 1 and 4, the first inspection device 3 is a device that performs a pre-reflow inspection of components E on a substrate P after a mounting operation on the substrate P on which the components E are mounted, as part of a substrate manufacturing operation for manufacturing a substrate P on which the components E are mounted. The first inspection device 3 includes an inspection imaging unit 31, a communication unit 32, a CPU 33, and a storage unit 34. The inspection imaging unit 31 is an example of the "imaging unit" in the claims.
[0038] The inspection imaging unit 31 is configured to capture an image of the component E on the printed circuit board after the mounting work on which the component E has been mounted. The first inspection device 3 is configured to inspect the component E on the printed circuit board based on the captured image of the component E on the printed circuit board after the mounting work. This makes it possible to inspect, for example, a lack of solder on the printed circuit board, the amount of misalignment of the component E, and floating of the component E. Furthermore, the first inspection device 3 determines whether the component E on the printed circuit board is good or bad based on the inspection results of the component E on the printed circuit board. An image determined to be bad is a defective image. In this case, the mounting work as part of the board manufacturing work is determined to be bad.
[0039] The communication unit 32 is configured to communicate with devices other than the first inspection device 3 (the printing device 1, the component mounting device 2, the reflow furnace 4, the second inspection device 5, and the management server 6).
[0040] The storage unit 34 stores the captured image taken by the inspection imaging unit 31 as image data.
[0041] (reflow oven) 1, the reflow furnace 4 performs a reflow operation to melt and solidify solder printed on the printed circuit board to join the components E to the printed circuit board as a board manufacturing operation for manufacturing a board P on which components E are mounted. Although not shown, the communication unit 52 of the reflow furnace 4 includes a communication unit capable of communicating with other devices other than the reflow furnace 4 (the printing device 1, the component mounting device 2, the first inspection device 3, the second inspection device 5, and the management server 6).
[0042] (Second inspection device) 1 and 5, the second inspection device 5 is a device that performs post-reflow inspection of components E on a printed circuit board after a reflow process as part of a board manufacturing process for manufacturing a board P on which components E are mounted. The second inspection device 5 includes an inspection imaging unit 51, a communication unit 52, a CPU 53, and a storage unit 54. The inspection imaging unit 51 is an example of the "imaging unit" in the claims.
[0043] The inspection imaging unit 51 is configured to capture an image of the component E on the printed circuit board after the mounting operation on which the component E is mounted. The second inspection device 5 is configured to inspect the component E on the printed circuit board based on the captured image of the component E on the printed circuit board after the reflow operation. This makes it possible to inspect, for example, a lack of solder on the printed circuit board, the amount of misalignment of the component E, and floating of the component E. Furthermore, the second inspection device 5 determines whether the component E on the printed circuit board is good or bad based on the inspection results of the component E on the printed circuit board. An image determined to be bad is a defective image. In this case, at least one of the printing operation, the mounting operation, and the reflow operation as part of the board manufacturing operation is determined to be bad.
[0044] The communication unit 52 is configured to communicate with devices other than the second inspection device 5 (the printing device 1, the component mounting device 2, the first inspection device 3, the reflow furnace 4, and the management server 6).
[0045] The storage unit 54 stores the captured image taken by the inspection imaging unit 51 as image data.
[0046] (Management Server) As shown in FIGS. 1 and 6 , the management server 6 is a control device that manages information related to the mounting line, which includes the printing device 1, the component mounting device 2, the first inspection device 3, the reflow oven 4, and the second inspection device 5, arranged in a straight line. The management server 6 includes a communication unit 61, a CPU 62, a storage unit 63, and the like. The communication unit 61 is configured to communicate with the printing device 1, the component mounting device 2, the first inspection device 3, the reflow oven 4, the second inspection device 5, the client terminal 7, and the smart glasses 8. The storage unit 63 stores a data management program that manages data related to mounting on the mounting line. The storage unit 63 also stores an equipment database Db that stores information such as captured images of the printing device 1, the component mounting device 2, the first inspection device 3, the reflow oven 4, and the second inspection device 5, as well as a work video Mv captured by a video camera 81.
[0047] (Client terminal) As shown in FIGS. 1 and 7 , the client terminal 7 is a terminal such as a stationary personal computer operated by the worker W. The client terminal 7 includes a display unit 71, a communication unit 72, a CPU 73, and a memory unit 74. The display unit 71 is configured with a liquid crystal screen. The display unit 71 is configured to display information transmitted from the management server 6 on the screen. The communication unit 72 is configured to communicate with the management server 6. The memory unit 74 stores a defect information confirmation program Pr that causes the display unit 71 to display a defect information confirmation screen Gc containing information regarding defects detected in the printing device 1, the component mounting device 2, the first inspection device 3, and the second inspection device 5. The defect information confirmation program Pr will be described in detail later.
[0048] (Smart Glasses) 1 and 8, the smart glasses 8 are head-mounted wearable terminals that can be worn by a worker W. The smart glasses 8 include a video camera 81, a communication unit 82, a CPU 83, and a storage unit 84.
[0049] The smart glasses 8 are configured to capture the same viewpoint as that of the worker W. This allows the smart glasses 8 to capture images of the area around the worker W's hands. The smart glasses 8 are configured to capture images of the worker W's work while the worker W is performing work related to the manufacture of the board P using the printing device 1, the component mounting device 2, etc. The work of the worker W includes a supply work of supplying a screen mask 11 to the printing device 1, a supply work of supplying a reel containing components E to the component mounting device 2, an unloading work of unloading an empty reel from the component mounting device 2, and an adjustment work of opening the covers of devices such as the printing device 1 and the component mounting device 2 and adjusting the configuration inside the device.
[0050] Here, when worker W performs work on the printing device 1, the component mounting device 2, the first inspection device 3, and the second inspection device 5, he or she needs to perform an operation on the device on which he or she will be working to enable the work. That is, before performing work, worker W performs an operation on the device on which he or she will be working by inputting worker W's identification ID (Identification) registered in advance in the management server 6 and a password associated with the identification ID. If the registered identification ID and password match, the management server 6 is configured to control the device on which he or she will be working to send a signal to the device on which he or she will be working that authorizes worker W to work on the device. The device on which he or she will be working is configured to unlock the device based on receiving the signal authorizing worker W to work. This allows worker W to work on the device. This operation is an authentication operation. During this authentication operation, the management server 6 is configured to control recording the date and time based on the match between the registered identification ID and password.
[0051] The video camera 81 is a camera for capturing video of the work video Mv of the worker W. The video camera 81 is configured to continue capturing video of the work of the worker W at a low frame rate while the worker W is working. A low frame rate refers to a frame rate of approximately 2 to 3 fps. The video camera 81 is configured to capture the work of the worker W in the form of a video. The communication unit 82 is configured to transmit the work video Mv captured by the video camera 81 to the management server 6 while the worker W is performing work related to the manufacture of the board P using the printing device 1, the component mounting device 2, etc. As a result, the work video Mv captured at the low frame rate is stored in the memory unit 63 of the management server 6. A program for capturing videos is stored in the memory unit 84.
[0052] (Defect information confirmation program) 9 and 10, the client terminal 7 of this embodiment is configured to control the display of the work video Mv on the display unit 71 in a playable state based on an operation by the operator on the defect information confirmation screen Gc displayed on the display unit 71 based on the defect information confirmation program Pr. The playable state of the work video Mv means that the work video Mv is displayed on the defect information confirmation screen Gc in a state in which it is played based on an operation to start playback by the operator. In FIG. 10, the operation of the operator to start playback is an operation of the operator clicking on a horizontal black triangle.
[0053] As shown in Figure 10, the client terminal 7 is configured to control the display of a defect information confirmation screen Gc on the display unit 71, which includes the defect occurrence time Tm, the substrate identification information Sb of the substrate P in which a defect in the substrate manufacturing work was detected, the defective image in which a defect in the substrate manufacturing work was detected among the above-mentioned captured images, and a work video Mv in a playable state.
[0054] First, the client terminal 7 is configured to control the display of the defect occurrence time Tm, and the board identification information Sb and line identification information Li associated with the defect occurrence time Tm, which are pre-registered in the equipment database Db, on the defect information confirmation screen Gc. The client terminal 7 is configured to control the acquisition of defect images associated with the defect occurrence time Tm and playable work videos Mv, based on the operation of the operator of the client terminal 7 to select the defect occurrence time Tm. Here, the defect images and work videos Mv are pre-registered in the equipment database Db. Furthermore, the board manufacturing work includes the printing work, mounting work, pre-reflow inspection work, reflow work, and post-reflow inspection work described above.
[0055] 10 shows, as an example, a case where printing device 1 detects a lack of solder at a predetermined mounting position on a printed circuit board, but component mounting device 2, first inspection device 3, and second inspection device 5 each perform board manufacturing work to produce board P. The contents displayed in FIG. 10 will be explained below.
[0056] The defect occurrence time Tm is displayed on the defect information confirmation screen Gc not only as a date but also as an hour and minute. The board identification information Sb on the defect information confirmation screen Gc displays the number of the board P to be manufactured, which is registered in advance in the management server 6. The line identification information Li on the defect information confirmation screen Gc displays the number of the above-mentioned mounting line, which is registered in advance in the management server 6.
[0057] In Figure 10, as examples of defective images, the defect information confirmation screen Gc displays a defective image G1 captured by the component imaging unit 22, a defective image G2 captured by the inspection imaging unit 31 of the first inspection device 3, and a defective image G3 captured by the second inspection device 5.
[0058] In addition, on the defect information confirmation screen Gc, a work video Mv1 of worker W (referred to as the first worker in Figure 10, hereinafter referred to as the first worker W1) who was working on the printing device 1 is displayed in a playable manner.
[0059] Additionally, a thumbnail image Sa1 of the work video Mv1 of the first worker W1 is displayed below the work video Mv1. The thumbnail image Sa1 is displayed for each date and time when the worker W performed the authentication operation on the device where the work was performed in the work video Mv1. The "▼" displayed in FIG. 10 indicates the playback start position of the work video Mv1. Additionally, the thumbnail image Sa1 selected by the operator is shown covered with hatching. As a result, when the operator clicks on the horizontal black triangle, the work video Mv1 is played from the playback start position described above.
[0060] Also, below the work video Mv1, thumbnail images Sa2 of the work video Mv of worker W (referred to as the second worker in FIG. 10, hereinafter referred to as the second worker W2) who was working on the printing device 1 shortly before the first worker W1 is displayed. The thumbnail images Sa2 are displayed in the work video Mv of the second worker W2 for each date and time when the worker W performed the authentication operation on the device where the work was being performed.
[0061] In this way, the client terminal 7 is configured to search for information registered in the equipment database Db based on the defect information confirmation program Pr and control the acquisition of the work video Mv in order to confirm the work of the above-mentioned worker W. That is, the client terminal 7 is configured to search for candidate work videos Mv of the worker W related to defects in the board manufacturing work detected in the board work apparatus based on the defect information confirmation program Pr and control the acquisition of the searched candidate work videos Mv in order to confirm the work of the above-mentioned worker W. The board work apparatus includes the printing apparatus 1, component mounting apparatus 2, first inspection apparatus 3, reflow furnace 4, and second inspection apparatus 5 described above. In FIG. 10, the work video Mv1 of the first worker W1 and the work video Mv of the second worker W2 have been acquired.
[0062] Specifically, the client terminal 7 is configured to perform control to search for, as a candidate, a work video Mv of a worker W who was working on a board manufacturing device that performed board manufacturing work on a board P in which a defect in the board manufacturing work was detected before the defect occurrence time Tm, based on the defect occurrence time Tm when the defect in the board manufacturing work occurred. In the example shown in Fig. 10, the client terminal 7 searches for, as a candidate, a work video Mv of a worker W who was working on a printing device 1 in which a defect in the printing work occurred before the defect occurrence time Tm, based on the defect occurrence time Tm when the defect in the printing work occurred.
[0063] The client terminal 7 is configured to control a search for a candidate work video Mv of a worker W who worked on the board manufacturing device that performed the board manufacturing work on the board P where a defect in the board manufacturing work was detected, based on a predetermined range of time between the time going back a predetermined time (e.g., 30 minutes) from the defect occurrence time Tm and the defect occurrence time Tm. In the example shown in Fig. 10, the client terminal 7 is configured to control a search for a candidate work video Mv of a first worker W1 and a second worker W2 who worked on the printing device 1 where a defect in the printing work occurred, based on a predetermined range of time between the time going back a predetermined time from the defect occurrence time Tm and the defect occurrence time Tm.
[0064] In this way, the client terminal 7 is configured to perform control to search for each of the work videos Mv of the multiple workers W as candidates when there are multiple workers W working on the board working device that performed the board manufacturing work on the board P on which a defect in the board manufacturing work was detected within a predetermined time range. In the example shown in Fig. 10, the work videos Mv of the first worker W1 and the second worker W2 are searched for as candidates. In addition, the work video Mv1 of the first worker W1 is displayed so that it can be played.
[0065] The client terminal 7 is configured to control the setting of the playback start position of the work video Mv based on the time when the worker W performs an operation on the board work apparatus to enable the worker W to perform work on the board work apparatus. In the example shown in FIG. 10 , the set playback start positions of the work video Mv1 of the first worker W1 and the set playback start positions of the work video Mv of the second worker W2 are each displayed with a "▼". The set playback start position of the work video Mv1 of the first worker W1 is the time when the first worker W1 performed the authentication operation on the printing device 1. Furthermore, the set playback start position of the work video Mv of the second worker W2 is the time when the second worker W2 performed the authentication operation on the printing device 1.
[0066] The client terminal 7 is configured to perform control to play back the work video Mv from the playback start position, based on receiving an operation to start playback from the operator.
[0067] As a result, as shown in an example in Fig. 11, a scene from the work video Mv1 is displayed that shows the first worker W1 touching part of the predetermined pattern on the screen mask 11. This allows the operator to determine that the printing work defect shown in Fig. 10 as an example is caused by the first worker W1 accidentally touching the screen mask 11. As another example, if a scene from the work video Mv1 is displayed that shows the first worker W1 repeatedly opening and closing the door of the printing device 1, the operator can determine that the printing work defect is caused by foreign matter entering the printing device 1 as a result of the first worker W1 repeatedly opening and closing the door.
[0068] (Defect information display processing) Referring to FIG. 12, a defect information display process for displaying the work moving image Mv on the display unit 71 of the client terminal 7 in a playable manner based on the defect information confirmation program Pr will be described below.
[0069] In step S1, a defect information confirmation screen Gc is displayed on the display unit 71 based on an operation by the operator to execute the defect information confirmation program Pr. At this time, the defect information confirmation screen Gc displays a plurality of defect occurrence times Tm, as well as board identification information Sb and line identification information Li corresponding to each of the plurality of defect occurrence times Tm. In step S2, it is determined whether the operator has selected one of the plurality of defect occurrence times Tm. If the operator has made a selection, the process proceeds to step S3; if the operator has not made a selection, step S2 is repeated. In step S3, a defect image related to the defect of the selected defect occurrence time Tm is searched for and displayed on the defect information confirmation screen Gc. That is, the client terminal 7 retrieves information registered in the device database Db of the management server 6 to acquire the defect image.
[0070] In step S4, candidate work videos Mv related to the defect at the selected defect occurrence time Tm are searched for and displayed on the defect information confirmation screen Gc. That is, the client terminal 7 searches for information registered in the apparatus database Db of the management server 6 to acquire the work videos Mv related to the defect. In this way, step S4 is a step of searching for candidate work videos Mv of the worker W related to the defect in the board manufacturing work detected in the board working apparatus from among the work videos Mv captured by the smart glasses 8 of the worker W performing work related to the manufacture of the board P on the board working apparatus configured to perform the board manufacturing work. Furthermore, step S4 is a step of displaying the searched candidate work videos Mv on the display unit 71 in a playable state. After step S4, the defect information display process ends.
[0071] (Effects of the embodiment) In this embodiment, the following effects can be obtained.
[0072] In this embodiment, as described above, board work system 100 includes client terminal 7 configured to control display of acquired work video Mv in a playable state on display unit 71. As a result, by playing back work video Mv, the operator operating client terminal 7 can easily check the work of worker W related to defects in the board manufacturing work, and can easily check whether a defect that occurred in the board work device is a defect caused by the work of worker W.
[0073] Furthermore, in this embodiment, as described above, the client terminal 7 is configured to control a search for candidate work videos Mv of the worker W who was working on the board work apparatus that performed the board manufacturing work on the board P on which the defect in the board manufacturing work was detected, based on the defect occurrence time Tm at which the defect in the board manufacturing work occurred, prior to the defect occurrence time Tm. This makes it possible to minimize candidate work videos Mv that are assumed to be related to the defect in the board manufacturing work, even when a large number of work videos Mv are stored, thereby preventing the operator of the client terminal 7 from having to review the work videos Mv from becoming cumbersome.
[0074] Furthermore, in this embodiment, as described above, the client terminal 7 is configured to control a search for candidate work videos Mv of the worker W who was working on the board work device that performed the board work on the board on which the defect in the board manufacturing work was detected, based on a predetermined range of time between the time a predetermined time before the defect occurrence time Tm and the defect occurrence time Tm. This makes it possible to further reduce the number of candidate work videos Mv that are assumed to be related to the defect in the board manufacturing work, thereby further preventing the operator of the client terminal 7 from having to review the work videos Mv from becoming complicated.
[0075] Furthermore, in this embodiment, as described above, when there are multiple workers W working on the board working device that performed the board manufacturing work on the board P on which a defect in the board manufacturing work was detected within a predetermined time range, the client terminal 7 is configured to perform control to search for candidate work videos Mv of each of the multiple workers W. This displays the work videos Mv of the multiple workers W who are assumed to be related to the defect in the board manufacturing work, allowing the operator to more reliably check the work of the workers W related to the defect in the board manufacturing work.
[0076] Furthermore, in this embodiment, as described above, the client terminal 7 is configured to perform control to set the playback start position of the work video Mv based on the time when the worker W performed an operation on the board work apparatus to enable the worker W to work on the board work apparatus. This makes it possible to automatically set the playback start position of the work video Mv to the work start position of the worker W within a predetermined time range, further preventing the operator of the client terminal 7 from having to check the work video Mv from becoming complicated.
[0077] Furthermore, in this embodiment, as described above, the smart glasses 8 are wearable terminals configured to be worn by the worker W. This allows the smart glasses 8 to move around with the worker W and capture video of the worker W's work, thereby reducing the number of cameras required to capture video of the worker W's work.
[0078] Furthermore, in this embodiment, as described above, the smart glasses 8 are configured to continue to capture video of the work of the worker W at a low frame rate while the worker W is working. The board work system 100 includes a storage unit 63 that stores the work video Mv captured at a low frame rate. This allows the data capacity of the work video Mv stored in the storage unit 63 to be relatively small, thereby preventing an increase in the storage capacity required to store the work video Mv in the storage unit 63.
[0079] Furthermore, in this embodiment, as described above, board work system 100 includes imaging units (mask imaging unit 13, print inspection imaging unit 14, component imaging unit 22, board imaging unit 23, inspection imaging unit 31, and inspection imaging unit 51). Client terminal 7 is configured to control the display of defect information confirmation screen Gc on display unit 71, which includes board identification information Sb of board P in which a defect in the board manufacturing work has been detected, defect occurrence time Tm, defective images G1, G2, and G3 in which a defect in the board manufacturing work has been detected among the images captured by the imaging units, and a playable work video Mv. As a result, by checking defect information confirmation screen Gc displayed on display unit 71, the operator of client terminal 7 can check board identification information Sb, defect occurrence time Tm, defective images G1, G2, and G3, and work video Mv, thereby enabling the operator to efficiently confirm defects in the board manufacturing work.
[0080] Furthermore, in this embodiment, as described above, the defect information display method includes step S4 of displaying the work video Mv searched for as a candidate in a playable state on display unit 71. This allows the operator operating client terminal 7 to play back the work video Mv, thereby allowing the operator to easily check the work of worker W related to a defect in the board manufacturing work, thereby providing a defect information display method that makes it possible to easily check whether a defect that occurred in a board work device is a defect caused by the work of worker W.
[0081] [Variations] The embodiments disclosed herein should be considered to be illustrative and not restrictive in all respects. The scope of the present invention is defined by the claims rather than the above description of the embodiments, and further includes all modifications (variations) within the meaning and scope of the claims.
[0082] For example, in the above embodiment, the smart glasses 8 are an example of the "video capture unit" in the claims, but the present invention is not limited to this. In the present invention, the video capture unit may be a camera that is fixed to a building or device and captures video of the worker, rather than a wearable device such as smart glasses.
[0083] In the above embodiment, the smart glasses 8 (video capture unit) capture video at a low frame rate, but the present invention is not limited to this. In the present invention, the video capture unit may capture video at a frame rate higher than the low frame rate.
[0084] In the above embodiment, the client terminal 7 (control device) is a terminal such as a stationary personal computer operated by a worker, but the present invention is not limited to this. In the present invention, the control device may be a portable terminal carried by a worker.
[0085] In the above embodiment, the work video Mv1 is arranged below the defect images G1, G2, and G3 on the defect information confirmation screen Gc, but the present invention is not limited to this. In the present invention, the display unit may display a defect information confirmation screen including a work video and a defect information confirmation screen including defect images.
[0086] In the above embodiment, the client terminal 7 searches for a candidate work video Mv of a worker W who worked on the printing device 1 where a printing defect occurred before the defect time Tm based on the defect occurrence time Tm. However, the present invention is not limited to this. In the present invention, the client terminal may be configured to control a search for a candidate work video of a worker who worked on a board manufacturing device that performed board manufacturing work on a board where a defect in the board manufacturing work was detected before the defect occurrence time based on the defect occurrence time in the board manufacturing work. That is, as an example, if a first inspection device detects a defect in the mounting work, the devices that performed the board manufacturing work on the board are the printing device, the component mounting device, and the first inspection device. In this case, the client terminal searches for a candidate work video of a worker who worked on the printing device, a worker who worked on the component mounting device, and a worker who worked on the first inspection device.
[0087] In addition, in the above embodiment, an example was shown in which two work videos Mv were searched as candidates, but the present invention is not limited to this. In the present invention, the number of work videos searched as candidates may be one, or three or more.
[0088] In the above embodiment, for convenience of explanation, the control process of the client terminal 7 (control device) is explained using a flow-driven flowchart in which processing is performed sequentially according to a processing flow, but the present invention is not limited to this. In the present invention, the control process of the control device may be performed by an event-driven process in which processing is performed on an event-by-event basis. In this case, the control process may be performed completely event-driven, or may be performed by combining event-driven and flow-driven processes. [Explanation of symbols]
[0089] 1 Printing device (board work device) 2. Component mounting equipment (board work equipment) 3. First inspection device (board work device) 4 Reflow oven (board processing equipment) 5. Second inspection device (board work device) 7 Client terminal (control device) 8. Smart Glasses 13 Mask imaging unit (imaging unit) 14 Print inspection imaging unit (imaging unit) 22 Parts imaging unit (imaging unit) 23 Board imaging unit (imaging unit) 31 Inspection imaging unit (imaging unit) 51 Inspection imaging unit (imaging unit) 63 Storage section 71 Display section 100 PCB Work System E parts G1, G2, G3 defective images Gc Defect information confirmation screen Mv, Mv1 work video P board Sb Substrate identification information Tm Defect occurrence time W Worker W1 First worker (worker) W2 Second Worker (Worker)
Claims
1. a board working device configured to perform a board manufacturing operation for manufacturing a board on which components are mounted; a video capture unit that captures video of a worker performing work related to the manufacture of the substrate using the substrate work device; a control device that searches for candidates of the work videos of the worker related to the defect in the board manufacturing work detected by the board work device, and controls acquisition of the work videos searched as candidates; a display unit, The control device is configured to control the display of the work video, which is acquired in a reproducible state from the time the worker operates the board work device, on the display unit.
2. A board work device configured to perform board manufacturing work for manufacturing a board on which components are mounted; a video capture unit that captures video of a worker performing work related to the manufacture of the substrate using the substrate work device; a control device that searches for candidates of the work videos of the worker related to the defect in the board manufacturing work detected by the board work device, and controls acquisition of the work videos searched as candidates; a display unit, the control device is configured to control the display of the acquired work video on the display unit in a reproducible state; The control device is configured to control a search for candidate work videos of the workers who worked on the board work device that performed the board manufacturing work on the board in which the defect in the board manufacturing work was detected before the defect occurrence time, based on the defect occurrence time of the board manufacturing work.
3. 3. The board work system of claim 2, wherein the control device is configured to control searching for a candidate work video of the worker who performed work on the board work device that performed the board manufacturing work on the board in which a defect in the board manufacturing work was detected, based on a predetermined range of time between a time that is a predetermined time before the time of the defect and the time of the defect.
4. The board work system of claim 3, wherein the control device is configured to control a search for the work videos of each of the multiple workers as candidates when there are multiple workers who worked on the board work device that performed the board manufacturing work on the board in which a defect in the board manufacturing work was detected within the specified range of time.
5. The board work system of claim 3, wherein the control device is configured to control setting of a start position for playback of the work video based on the time when the worker performs an operation on the board work device to enable the worker to perform work on the board work device.
6. The board working system according to claim 1 , wherein the video capture unit includes a wearable terminal configured to be wearable by the worker.
7. the video capture unit is configured to continue capturing video of the work of the worker at a low frame rate while the worker is working, 3. The board working system according to claim 1, further comprising a storage unit that stores the working video captured at a low frame rate.
8. further comprising an imaging unit; 3. The board work system of claim 2, wherein the control device is configured to control the display unit to display a defect information confirmation screen including board identification information of the board in which a defect in the board manufacturing work was detected, the time of the defect occurrence, a defective image in which a defect in the board manufacturing work was detected from among the images captured by the imaging unit, and the work video in a playable state.
9. a step of searching for a candidate work video of a worker who performs work related to the manufacturing of a board using a board working device configured to perform board manufacturing work for manufacturing a board on which components are mounted, the candidate work video being taken by a video taking unit of the worker, the candidate work video being related to a defect in the board manufacturing work detected by the board working device; A defect information display method comprising a step of displaying on a display unit the work video searched for as a candidate in a reproducible state from the time when the worker performed an operation on the board work device.
Citation Information
Patent Citations
Mounting work area work support system and mounting work area work support method
JP6666997B2
JPP7039654B
Production management device
WO2020174625A1