Image search device, component assembly system and image search method

Abstract

Image search device (20) comprising: an image memory (25) configured to store a plurality of images acquired during an assembly process for mounting a component (E) on a printed circuit board (S); and a controller (21) configured to retrieve an image from the plurality of images stored in the image memory (25) according to a search condition; wherein the controller (21) is configured to perform a control to retrieve the image from the plurality of images in the image memory (25) according to a first search condition specified by a user, and to display, together with a selected image (31) chosen by the user from the retrieved image, a related image (32) that was retrieved according to a second search condition, which differs from the first search condition, based on information about the selected image (31).

Description

Technical field

[0001] The present invention relates to an image search device, a component assembly system and an image search method, and in particular to an image search device, a component assembly system and an image search method for displaying images that are taken during an assembly process for mounting components on a printed circuit board. Technical background

[0002] A configuration is known from the prior art that displays images taken during an assembly process for mounting components on a printed circuit board. Such a configuration is disclosed, for example, in Japanese patent no. 6154120.

[0003] Japanese Patent No. 6154120 discloses a management system comprising an image memory configured to store images captured during the assembly process for mounting electronic components on a printed circuit board (PCB), and a controller configured or programmed to manage the history or progress of the electronic component assembly process in relation to the captured images. In the management system disclosed in Japanese Patent No. 6154120, the controller is configured or programmed to perform a control operation to assign images to a plurality of electronic components mounted on the same PCB and to display the assigned images of the plurality of electronic components mounted on the same PCB on a display. State of the art patent document

[0004] Patent document 1: Japanese patent no. 6154120 Description of the invention Problems to be solved by the invention

[0005] However, in the management system disclosed in Japanese Patent No. 6154120, the assigned images of the multitude of electronic components mounted on the same printed circuit board are displayed. Therefore, the images displayed when confirming the images captured during the assembly process are those of the multitude of electronic components mounted on the same circuit board that have been pre-assigned. Consequently, images captured during the assembly process that have not been pre-assigned cannot be displayed simultaneously. Therefore, a user must perform a separate search to confirm the unassigned images captured during the assembly process, making it difficult to readily confirm a multitude of related images captured during the assembly process that have not been pre-assigned.

[0006] The present invention was proposed to solve the above-mentioned problems, and one object of the present invention is to provide an image search device, a component assembly system and an image search method, each of which makes it possible to readily confirm a multitude of related images that are taken during the assembly process and have not been pre-assigned. Means of solving the problems

[0007] To solve the aforementioned problem, an image search device according to a first aspect of the present invention comprises an image memory configured to store a plurality of images acquired during an assembly process for mounting a component on a printed circuit board, and a controller configured to retrieve an image from the plurality of images stored in the image memory according to a search condition. The controller is configured to perform a control operation to retrieve an image from the plurality of images in the image memory according to a first search condition specified by a user and, together with a selected image chosen by the user from the retrieved image, to display a related image retrieved according to a second search condition, which differs from the first search condition, based on information about the selected image.

[0008] The component assembly system according to the first aspect of the present invention is configured as described above such that the controller retrieves the related image according to the second search condition, which differs from the first search condition used to retrieve the selected image based on information about the selected image. This allows the related image to be extracted without pre-assigning a multitude of images. Consequently, it is not necessary for the user to perform a separate retrieval, and thus it is possible to readily verify a multitude of related images captured during the assembly process that have not been pre-assigned. Furthermore, the selected image and the related image are displayed on the same screen, making it easy to understand the assembly status and identify the cause of any errors.

[0009] In the image search device mentioned above, according to the first aspect, the first search condition is preferably a condition that is determined on the basis of information that includes component information and / or printed circuit board information and / or information about a component mounting position and / or information about a work device operating on the printed circuit board and / or information about a work unit operating on the printed circuit board and / or information about a component feeding unit feeding the component and / or information about a work date and working time.Accordingly, an image can be retrieved according to the first search condition defined by the user based on component information, printed circuit board information, information about a component mounting position, information about a work device operating on the printed circuit board, information about a work unit operating on the printed circuit board, information about a component feeding unit feeding the component, or information about a work date and working time.

[0010] In the aforementioned image search device, as described in the first aspect, the controller is preferably configured to display a variety of related images along with the selected image. Accordingly, the presence of these related images can be verified, making it easier to understand the assembly status and identify the cause of the fault.

[0011] In this case, the controller is preferably configured to store information about the selected related image from the multitude of related images in a memory location and to consider this information when defining the second search condition. Accordingly, the second search condition can be set so that, for example, the frequently selected related image from the multitude of related images is readily retrieved, thus allowing a more suitable related image to be extracted.

[0012] In the aforementioned image search device, according to the first aspect, the controller is preferably configured to retrieve the related image according to the second search condition, based on a specific assembly error, if the image selected by the user relates to an assembly error of the component. Accordingly, the related image can be displayed to identify the cause, depending on the type of assembly error, allowing the user to efficiently confirm the image. In this way, the user can efficiently perform the process of identifying the assembly error. Furthermore, it is possible to prevent the extraction of images with low relevance, depending on the type of assembly error, thus ensuring an efficient retrieval process and reducing retrieval time.

[0013] In the image search device mentioned above, as described in the first aspect, the controller is preferably configured to perform a control action to store the OK / NG result of a component assembly test in memory and to display a related image of another component of the same type with an NG test result alongside the selected image, provided the selected image also has an NG test result. This eliminates the need for the user to retrieve and display another similar image with an NG test result, thus reducing workload. Furthermore, similar images with an NG test result can be displayed in a list, making it easier to understand the assembly status and identify the cause of the defect.

[0014] In the aforementioned image search device, according to the first aspect, the controller is preferably configured to perform a control to display the second search condition along with the related image. Accordingly, the user can visually confirm the search condition of the related image, which is displayed together with the selected image.

[0015] In the image search device mentioned above, according to the first aspect, the controller is preferably configured to retrieve, when a variety of second search conditions are adjustable for the selected image, the related image according to a second search condition selected from the variety of adjustable second search conditions based on a user selection or a predetermined condition. Accordingly, the related image can be retrieved according to a second search condition selected from the variety of second search conditions, and thus the related image can be retrieved according to a more suitable search condition.

[0016] In this case, the controller is preferably configured to perform a control function to display the multiple secondary search conditions in a selectable manner along with the selected image. Accordingly, the user can easily select a desired search condition from the multiple secondary search conditions.

[0017] To solve the aforementioned problem, a component assembly system according to a second aspect of the present invention comprises a component assembly device configured to mount a component on a printed circuit board and an image search device. The image search device comprises an image memory configured to store a plurality of images acquired during an assembly process for mounting the component on the printed circuit board, and a controller configured to retrieve an image from the plurality of images stored in the image memory according to a search condition.The controller is configured to perform a control to retrieve an image from the multitude of images in the image memory according to a first search condition specified by a user, and to display, together with a selected image chosen by the user from the retrieved image, a related image that was retrieved according to a second search condition, which differs from the first search condition, based on information about the selected image.

[0018] The component assembly system according to the second aspect of the present invention is configured as described above such that the controller retrieves the related image according to the second search condition, which differs from the first search condition used to retrieve the selected image based on information about the selected image. Thus, the related image can be extracted without pre-assigning a multitude of images. Consequently, it is not necessary for the user to perform a separate retrieval, and it is therefore possible to provide a component assembly system that allows for the straightforward confirmation of a multitude of related images captured during the assembly process that were not pre-assigned.Furthermore, the selected image and the related image are displayed on the same screen, making it possible to easily understand the assembly status and identify the cause of any error.

[0019] To solve the aforementioned problem, an image search method according to a third aspect of the present invention comprises storing a plurality of images taken during an assembly process for mounting a component on a printed circuit board, retrieving an image from the plurality of stored images according to a first search condition, and displaying a related image retrieved according to a second search condition, which differs from the first search condition, based on information about the selected image, together with an image selected from the retrieved image.

[0020] The image search method according to the third aspect of the present invention is configured as described above to retrieve the related image according to the second search condition, which differs from the first search condition used to retrieve the selected image based on information about the selected image. Thus, the related image can be extracted without pre-assigning a multitude of images. Consequently, it is not necessary for a user to perform a separate retrieval, and the image search method can be provided to readily confirm a multitude of related images that were captured during the assembly process and that were not pre-assigned.Furthermore, the selected image and the related image are displayed on the same screen, making it possible to easily understand the assembly status and identify the cause of any error.

[0021] In the aforementioned image search method according to the third aspect, the first search condition is preferably a condition that is based on information that includes component information and / or printed circuit board information and / or information about a component mounting position and / or information about a work device operating on the printed circuit board and / or information about a work unit operating on the printed circuit board and / or information about a component feeding unit feeding the component and / or information about a work date and working time.Accordingly, an image can be retrieved according to the first search condition defined by the user based on component information, printed circuit board information, information about a component mounting position, information about a work device operating on the printed circuit board, information about a work unit operating on the printed circuit board, information about a component feeding unit feeding the component, or information about a work date and working time.

[0022] In the aforementioned image search method, as described in the third aspect, a large number of related images are preferentially displayed along with the selected image. Accordingly, the large number of related images can be confirmed together with the selected image, making it easier to understand the assembly status and identify the cause of the error.

[0023] In the aforementioned image search procedure, according to the third aspect, the related image is preferentially retrieved according to the second search condition for a type of assembly defect if the selected image is one that relates to an assembly defect of the component. Accordingly, the related image can be displayed to identify the cause according to the type of assembly defect, allowing the user to efficiently confirm the image. In this way, the user can efficiently perform the process of identifying the assembly defect. Furthermore, it is possible to prevent the extraction of images with low relevance depending on the type of assembly defect, thus enabling the retrieval process to be carried out efficiently and the retrieval time to be reduced.

[0024] In the aforementioned image search procedure, as described in the third aspect, the OK / NG status of a component assembly inspection result is preferentially stored. An image of another component of the same type with an NG inspection result is then preferentially displayed as a related image alongside the selected image, provided the selected image also contains an NG inspection result. This eliminates the need for the user to retrieve and display another similar image with an NG inspection result, thus reducing workload. Furthermore, similar images with an NG inspection result can be displayed in a list, facilitating a clearer understanding of the assembly status and enabling identification of the cause of any defects.

[0025] In the aforementioned image search procedure, according to the third aspect, the second search condition is preferentially displayed together with the related image. Accordingly, the user can visually confirm the search condition of the related image, which is displayed alongside the selected image. Effect of the invention

[0026] According to the present invention, as described above, it is possible to readily confirm the multitude of related images that were taken during the assembly process and that were not assigned in advance. Brief description of the drawings; list of figures [ Fig. 1] Block diagram of a component assembly system according to an embodiment of the present invention. [ Fig. 2] A representation showing the overall structure of a component assembly device of the component assembly system according to the embodiment of the present invention. [ Fig. 3] A representation showing a first screen example of an image search device of the component assembly system according to the embodiment of the present invention. [ Fig. 4] A representation showing a second screen example of the image search device of the component assembly system according to the embodiment of the present invention. [ Fig. 5] A representation showing an example of a pull-down display of a second search condition of the component assembly system according to the embodiment of the present invention. Modes for carrying out the invention

[0027] One embodiment of the present invention is described below with reference to the drawings.

[0028] The construction of a component assembly system 100 According to the embodiment of the present invention, with reference to the Fig. 1 and Fig. 2 described. Structure of the component assembly system

[0029] The component assembly system 100 According to this embodiment of the present invention, it is configured to include components. E on a circuit board S to assemble the circuit board S , on which the components E were assembled, to manufacture. As in Fig. As shown in 1, the component assembly system comprises 100 a component assembly line 10 and an image search device 20 .

[0030] A large number of component assembly lines 10 are provided. Each component assembly line 10 comprises a loading device 11, a printer 12, a print inspection machine 13, a discharge device 14, and a large number of component assembly fixtures. 15 , a visual inspection device 16, a remelting device 17, a visual inspection device 18 and an unloading device 19. In the component assembly line 10, the printed circuit board Stransported from the upstream side (left side) to the downstream side (right side) along the production line. Construction of the component assembly line

[0031] The following describes the setup of the individual devices of component assembly line 10.

[0032] The loading device 11 has the task of loading the circuit board (wiring board) S to hold before the components E to be mounted, and the circuit board S to be transported to component assembly line 10. To the components E These include small electronic components such as LSIs, ICs, transistors, capacitors and resistors.

[0033] Printer 12 is a screen printer and its function is to apply solder paste to a mounting surface of the circuit board. S to apply. In addition, the printer 12 includes an imaging device to place registration marks F on the circuit board. Sto image. Printer 12 sends an image, captured by the imaging device along with information about a target to be imaged, to the image search device. 20 .

[0034] The print inspection machine 13 has the function of checking the condition of the solder paste printed by the printer 12. Specifically, the print inspection machine 13 takes the printed circuit board. S The machine uses an imaging device to scan the printed solder paste and inspects the condition of the printed solder paste based on the captured image. Furthermore, the print inspection machine 13 transmits the image captured by the imaging device, along with information about the target to be imaged, to the image search device. 20 .

[0035] The dispensing device 14 has a function for applying solder paste, adhesive, etc. to the circuit board. S .

[0036] The component assembly fixtures 15They have a function in that components are positioned at predetermined mounting positions on the printed circuit board covered with solder paste. S to assemble. A variety of (three) component assembly fixtures. 15 are along the conveyor direction of the circuit board S arranged. The multitude of component assembly fixtures 15 It is similarly structured. As in Fig. The component assembly devices shown in section 2 include 15 each a base 151, a pair of conveying devices 152, component feeding units 153, a head unit 154, a carrier 155, a pair of rails 156 and component recognition imaging devices 157 and a controller 158.

[0037] The pair of conveyor devices 152 is installed on base 151 and transports the printed circuit board. S in the X direction. Furthermore, the pair of conveyor devices 152 holds the currently conveyed circuit board. Sin a stopped state in an assembly position. The distance between the pair of conveyor devices 152 in the Y-direction can be adjusted according to the dimensions of the circuit board. S be adapted.

[0038] The component feed units 153 are arranged outside (Y1 and Y2 sides) of the pair of conveyor devices 152. Furthermore, a plurality of belt feed devices 153a are arranged in the component feed units 153.

[0039] The tape feed devices 153a hold spools on which tapes are wound, containing a variety of components. E at a predetermined distance. The belt feed devices 153a are configured to include the components. E to feed from the tips of the tape feed devices 153a by rotating the coils in order to feed the tapes which contain the components E hold.

[0040] The head unit 154 is configured to move between an area above the pair of conveyors 152 and areas above the component feed units 153. Furthermore, the head unit 154 comprises a plurality of (five) assembly heads 154a, which have nozzles attached to their lower ends, a printed circuit board detection imaging device 154b, and a camera unit 154c.

[0041] The 154a mounting heads are configured to hold the components E on the circuit board S to mount. In particular, the mounting heads 154a are configured to be movable up and down (in the Z direction), and they are configured to mount the components. E , which are supplied by the belt feed devices 153a, to be drawn in and held by a vacuum generated at the tip ends of the nozzles by an air pressure generator, and to hold the components Eat the mounting positions on the circuit board S to assemble.

[0042] The printed circuit board recognition imaging device 154b is configured to detect the fiducial marks F of the printed circuit board. S to depict the position and orientation of the printed circuit board S to recognize. The positions of the registration marks F are mapped and recognized, so that the assembly positions of the components can be determined. E on the circuit board S can be obtained precisely. The PCB recognition imaging device 154b is configured to scan the printed circuit board. S to be imaged from above (side in Z1 direction). The image acquired by the printed circuit board recognition imaging device 154b is transmitted to the image search device together with information about the target to be imaged. 20 transmitted.

[0043] The camera unit 154c is configured to image the components being sucked into the nozzles of the assembly heads 154a from the side. Furthermore, the camera unit 154c is configured to image the nozzles before and after the components are sucked in. E to be imaged from the side. The image captured by camera unit 154c, along with information about the target to be imaged, is sent to the image search device. 20 transmitted.

[0044] The support 155 includes an X-axis motor 155a. The support 155 is configured to move the head unit 154 in the X direction along the support 155 by driving the X-axis motor 155a. Opposite ends of the support 5 are supported by the pair of rails 156.

[0045] The pair of rails 156 is mounted on the base 151. One rail 156 on the X1 side includes a Y-axis motor 156a. The rails 156 are configured to move the carrier 155 in the Y-direction orthogonal to the X-direction along the pair of rails 156 by driving the Y-axis motor 156a. The head unit 154 is movable in the X-direction along the carrier 155, and the carrier 155 is movable in the Y-direction along the rails 156, so that the head unit 154 is movable in both the X and Y directions.

[0046] The component recognition imaging devices 157 are attached to the top of the base 151. The component recognition imaging devices 157 are located outside (on sides Y1 and Y2) of the pair of conveyor devices 152. The component recognition imaging devices 157 are configured to detect the components sucked in by the nozzles of the assembly heads 154a. Eto depict from below (Z2 direction side) in order to show the intake conditions (intake orientations) of the components E before assembling the components E to depict. Therefore, the intake conditions of the components drawn in by the nozzles of the assembly heads 154a can be shown. E The images acquired by the component recognition imaging devices 157 are transmitted, along with information about the target to be imaged, to the image search device. 20 transmitted.

[0047] The Controller 158 includes a CPU and is configured to control the entire operation of the component assembly device. 15 to control, such as the transport process of the printed circuit board carried out by the pair of conveyor devices 152 S, the assembly operation performed by the head unit 154 and the imaging operations performed by the component recognition imaging devices 157 and the printed circuit board recognition imaging device 154b. In addition, the controller 158 is configured to control the transmission of the acquired images to the image search device. 20 to carry out the process. The controller 158 transmits the images of the components. E , the image of the surface of the circuit board S , the image of the registration marks on the circuit board S , the images of the nozzles of the assembly heads 154a and the images of the component feed positions of the belt feed devices 153a to the image search device 20 .

[0048] As in Fig. As shown in Figure 1, the visual inspection device 16 is located downstream of the plurality of component assembly devices. 15The visual inspection device 16 has a function to check the appearance of the printed circuit board. S to check on which the components E through the component assembly devices 15 were mounted. Specifically, the visual inspection device 16 forms the circuit board. S It uses an imaging device and checks the assembly status of the components based on the recorded image. E on the circuit board S Furthermore, the visual inspection device 16 transmits the image captured by the imaging device, along with information about the target to be imaged, to the image search device. 20 .

[0049] The remelting device 17 has a function to melt the solder by means of a heat treatment and to remelt the components. E with the electrode sections of the circuit board Sto connect. The remelting device 17 is configured to perform the heat treatment while it is remelting the printed circuit board. S transported by rail.

[0050] The visual inspection device 18 is provided downstream of the remelting device 17. The visual inspection device 18 has the function of inspecting the appearance of the printed circuit board after it has been heat-treated by the remelting device 17. S to inspect. Specifically, the visual inspection device 18 takes the circuit board. S It uses an imaging device and checks the assembly status of the components based on the recorded image. E on the circuit board S Furthermore, the visual inspection device 18 transmits the image captured by the imaging device, together with information about the target to be imaged, to the image search device. 20 .

[0051] The discharge device 19 has the task of removing the circuit board S , on which the components E were assembled, to be diverted from component assembly line 10. Structure of the image search device

[0052] The structure of the image search device 20 will now be described.

[0053] The image search device 20 includes a personal computer. In addition, the image search device is included. 20 used to retrieve a target image from a multitude of images used in an assembly process for assembling components. E on the circuit board S were recorded. The image search device 20 manages component assembly line 10.

[0054] The image search device 20 includes a main processor (Central Processing Unit, CPU) 21, a memory 22 , a display 23, a control unit 24 and a database (DB) 25 The CPU 21controls each section of the image search device 20 Furthermore, the CPU performs 21 predefined programs are used to perform an image search process and a process for managing the component assembly lines. The memory 22 It is configured to store information. Display 23 shows a screen for operating the image search device. 20 Additionally, an image is displayed on screen 23, which is a result of the image search of the image search device. 20 The control unit 24 receives an input from a user. The control unit 24 includes an input device, such as a keyboard or a mouse. The DB 25 It stores a large number of images used during the assembly process for mounting the components. E on the circuit board S were recorded. That means the DB 25stores the images taken by each device (the printer 12, the print inspection machine 13, the component assembly devices). 15 , the visual inspection device 16 and the visual inspection device 18) of the component assembly line 10 are transferred. The CPU 21 is an example of a "controller" in the sense of the claims. The DB 25 is an example of an "image storage" in the sense of the claims.

[0055] In this embodiment, the CPU 21 configured, images from the multitude in the database 25 to retrieve stored images according to a search condition. The images in the database 25 Stored images are associated with information such as a PCB name, SILK name, PCB ID, component number, lead-in device number, time, head number, and nozzle number. The CPU 21is configured to retrieve images according to the search condition and display a list of information about the corresponding images on display 23. For example, the CPU shows 21 Display 23 shows a list of information, such as the image positions, the targets to be imaged, and the imaging times of a large number of images extracted by the search.

[0056] For example, a print inspection image is retrieved using the PCB name and / or the SILK name. Similarly, a post-assembly inspection image is retrieved using the PCB name and / or the SILK name. A lead setup image is retrieved using the component number and / or the lead setup number. A marker image is retrieved using the time and / or the PCB ID. A nozzle image is retrieved using the head number and / or the nozzle number. Bottom and side component identification images are retrieved using the PCB name and / or the SILK name.

[0057] Specifically, the CPU calls 21 Images from the multitude of images in the DB 25 according to an initial search condition defined by the user. The CPU also displays... 21Display 23 shows a list of information about the retrieved and extracted images. When the user selects an image based on the displayed list of image information, the CPU displays 21 a selected image 31 on a screen 30, as in Fig. 3 shown. In addition, the CPU performs 21 a control process to select images from the multitude of images in the database 25 to retrieve images and related images according to the first search condition set by the user. 32 to display results that, according to a second search condition that differs from the first search condition, are based on information about the selected image 31 together with the image selected by the user from the retrieved images 31 were accessed. That is to say, the CPU 21 retrieves images according to the second search condition, which provides information about the selected image.31 includes results that differ from the first search condition and extracts the related images. 32 from the DB 25 The CPU then displays... 21 the related images 32 together with the selected image 31 30 on the screen.

[0058] If the selected image 31 to get an image of the component E The related images are those relating to a mounting point. 32 For example, a component identification image from the side, identification images of the fiducial marks F of the printed circuit board S , an inspection image of a target component intake nozzle, an image of a target component feed line, a pressure inspection image, a post-assembly inspection image, etc. Furthermore, the information on retrieving the related images includes 32Information such as a circuit board, a mounting point, a machine, a tool, a tool for refilling components, a date and time, etc.

[0059] The first search condition is determined based on information that includes component information, printed circuit board (PCB) information, component mounting position information, information about a tool operating on the PCB, information about a work unit operating on the PCB, information about a component feeder feeding components, and / or information about a work date and time. Component information includes details such as the type, shape, and size of a component to be mounted. PCB information includes details such as the PCB type and PCB ID. Component mounting position information includes details about the component mounting coordinates (X, Y) on the PCB.The information about a working device that operates on the printed circuit board includes information about the type and condition of each device (the printer 12, the pressure testing machine 13, the component assembly devices . 15 , the visual inspection device 16 and the visual inspection device 18). The information about a working unit operating on the circuit board includes information about the assembly heads 154a and the nozzles of the component assembly device. 15 . Information about a component feeding unit includes information such as the type and identifier of the belt feed devices 153a.

[0060] For example, if there is an assembly error in the component E on the circuit board S If the error occurs, the user retrieves images according to the first search condition and confirms the images to analyze the cause of the assembly error. If the assembly heads 154a the components EIf suction is poor or the assembly process is slow due to the mounting heads 154a, the user, for example, retrieves images according to the first search condition and confirms the images to analyze the cause of the problem.

[0061] As in Fig. As shown in section 3, the CPU performs the following actions 21 a control through to manage the multitude of related images 32 together with the selected image 31 to display. If there is a related image 32 in relation to the selected image 31 The CPU shows 21 a related image 32 together with the selected image 31 30 on the screen. If there is no related image 32 in relation to the selected image 31 The CPU shows 21 the selected image 31 on screen 30, without the related image 32 to show. The CPU also shows 21the image recognition results of the selected image together with the selected image 31 The image recognition results include information such as component position, component size, PCB name, SILK name, PCB ID, component number, lead-in device number, time, head number, and nozzle number.

[0062] The CPU 21 shows related images 32 in a size smaller than that of the selected image 31 Furthermore, the CPU shows 21 the multitude of related images 32 side by side. The multitude of related images 32 For example, they are displayed side-by-side in a right-left direction. Furthermore, the multitude of related images are also shown. 32 under the selected image 31 displayed.

[0063] The CPU 21 stores information about a related image 32, which is from the multitude of related images 32 in relation to the selected image 31 in the storage 22 was selected, and reflects the information about the related image 32 , which is in the memory 22 is stored to define the second search condition. For example, it learns to add points to a search condition with a large number of results, and the search condition with a large number of results is preferentially set as the second search condition. That is, the search condition of the related image 32 , which the user frequently selects to view details from the multitude of related images 32 Confirmation is preferably set as the second search condition.

[0064] The CPU 21 shows the multitude of related images 32 side by side in order of priority. For example, the CPU displays 21 the related images 32with a large number of display times and a large number of points next to each other in order from left to right. In addition, the CPU displays 21 for example, the multitude of related images 32 side by side in the order of Japanese syllabification, in alphabetical order, or in numerical order based on the image names of the multitude of related images 32 to.

[0065] The CPU 21 The multitude of related images changes at regular intervals (e.g., five seconds). 32 and displays them one after the other. The CPU 21 shows the multitude of related images one after the other. 32 an, displays a predetermined number of related images 32 and then shows the first related image 32 on. Then the CPU repeats 21 a control to manage the multitude of related images 32 to display one after the other.

[0066] If a related image 32 from the multitude of related images displayed 32 When selected, the CPU displays 21 the selected related image 32 as the selected image 31 in a large format. In this case, the related images can be 32 according to a new second search condition based on information about the selected related image 32 (newly selected image) 31 ) can be retrieved. In this case, the CPU displays 21 the retrieved related images 32 together with the selected related image 32 (newly selected image) 31 ) on.

[0067] The CPU 21 recalls related images 32 according to the second search condition, depending on the type of assembly error, if the image selected by the user... 31 an image that refers to the assembly error of the component EThe type of assembly error is determined, for example, by information from each device (the printer 12, the print inspection machine 13, the component assembly devices). 15 , the visual inspection device 16 and the visual inspection device 18) or determined by a selection made by the user.

[0068] For example, in the event of an assembly error where the assembly position of the component is incorrect E on the circuit board S The second search condition is conditions for retrieving a component identification image of the corresponding component. E from below, a marker recognition image of the corresponding circuit board S (Fixture marks of the entire circuit board or a local fix mark of the circuit board) and / or a positional diagram of the corresponding component Efixed from the side immediately before assembly. In the event of an assembly error, where the component E If the search condition is missing, the second search condition will be conditions for retrieving a position image of the corresponding component. E from the side immediately before assembly and / or an image of the nozzle onto which the corresponding component is mounted E The position was determined from the side immediately after installation. In the event of an installation error by Manhattan, where the component E If the component protrudes upwards, the second search condition is conditions for retrieving a pressure inspection image of the corresponding assembly position, a component recognition image of the corresponding component. E from below and / or a marker recognition image of the corresponding circuit board S (Fix marks of the entire circuit board or a local fix mark of the circuit board) are specified. In the event of an assembly error, where the component EIf the component is incorrectly mounted, a second search condition is used to retrieve a component identification image of the corresponding component. E determined from below.

[0069] The CPU 21 performs a control to OK / NG the test result of the component assembly in the memory 22 to save and images of the same type of another component E with an NG test result than the related images 32 together with the selected image 31 to display when the selected image 31 This is an image with an NG test result. The test result is NG if the component E not correctly on the circuit board S is installed. The test result is OK if the component is E correctly on the circuit board S is mounted.

[0070] As in Fig. As shown in 4, the CPU performs 21a control through to determine the second search condition along with the related images 32 to display. As in Fig. As shown in section 5, the second search condition can be selected via a pull-down menu 33. This means that if a variety of second search conditions are available for the selected image... 31 The CPU can be configured to call 21 the related images 32 according to a second search condition, which is selected based on a user choice or a predefined condition from a variety of configurable second search conditions. In addition, the CPU performs 21 a control to select a variety of secondary search conditions in a selectable manner along with the selected image 31 to display.

[0071] The second search condition for retrieving related images 32 is a condition for retrieving a different recognition image of the component Ein the selected image 31 , a recognition image of the same type of component E like the component E in the selected image 31 and a recognition image of the component E on another circuit board S under the same conditions as, for example, the component E in the selected image 31 Furthermore, the second search condition can be customized by the user.

[0072] The numerous secondary search criteria can be automatically switched at regular intervals. In this case, the search criteria that are frequently displayed are stored in memory. 22 The conditions are saved and preferentially displayed for the elements (a component). E , a circuit board S, a tool and a component feed) are evaluated in the search conditions, and the display order is set so that the display of the condition with a high score takes priority. Advantageous effects of this embodiment

[0073] This embodiment achieves the following advantageous effects.

[0074] According to this embodiment, the CPU 21 , as described above, configured to perform a control to select images from the multitude of images in the database 25 to retrieve the related images according to the first search condition specified by the user. 32 to display results that, according to the second search condition, which differs from the first search condition, are based on information about the selected image 31 together with the image selected by the user from the retrieved images 31 were retrieved. Accordingly, the CPU calls21 the related images 32 according to the second search condition, which differs from the first search condition used to select the image 31 based on the information about the selected image 31 to retrieve, and thus the related images can be viewed 32 They can be extracted without having to pre-assign a large number of images. Consequently, it is not necessary for the user to perform a separate retrieval, and thus it is possible to readily confirm a large number of related images that were captured during the assembly process and were not pre-assigned. Furthermore, the selected image 31 and the related images 32 displayed on the same screen, making it possible to easily understand the assembly status and identify the cause of the error.

[0075] According to this embodiment, the first search condition, as described above, is a condition that is determined on the basis of information which includes component information and / or printed circuit board information and / or information about a component mounting position and / or information about a work device operating on a printed circuit board and / or information about a work unit operating on a printed circuit board and / or information about a component feeding unit feeding components and / or information about a work date and working time.Accordingly, images can be retrieved according to the first search condition defined by the user based on component information, printed circuit board information, information about a component mounting position, information about a work device operating on a printed circuit board, information about a work unit operating on a printed circuit board, information about a component feeding unit feeding components, or information about a work date and time.

[0076] According to this embodiment, the CPU 21 , as described above, configured to perform a control to manage the multitude of related images 32 together with the selected image 31 to display. Accordingly, the multitude of related images can be displayed. 32 together with the selected image 31This can be confirmed, making it easier to understand the assembly status and identify the cause of the error.

[0077] According to this embodiment, as described above, the CPU 21 configured to display information about the related image 32 , which is from the multitude of related images 32 in relation to the selected image 31 was selected in the memory 22 to save and store information about the related image 32 , which are in the storage 22 The stored data is used to reflect the second search condition. Accordingly, the second search condition can be set so that the images selected from the multitude of related images are selected. 32 frequently selected related images 32 readily available and therefore more suitable related images 32 can be extracted.

[0078] According to this embodiment, as described above, the CPU 21 configured to display related images 32 to retrieve the second search condition according to the type of assembly error, if the image selected by the user 31 an image that refers to the assembly error of the component E refers to this. Accordingly, the related images 32 The images are displayed to help identify the cause of the assembly error, allowing the user to efficiently verify the errors. This enables the user to efficiently identify the assembly error. Furthermore, it is possible to prevent the extraction of less relevant images based on the type of assembly error, thus streamlining the search process and reducing search time.

[0079] According to this embodiment, as described above, the CPU 21configured to perform a control to OK / NG the test result of the component assembly in the memory 22 to save and images of the same type of another component E with an NG test result than the related images 32 together with the selected image 31 to display when the selected image 31 This is an image with an NG test result. Therefore, the user does not need to retrieve and display another similar image with an NG test result, thus reducing workload. Furthermore, similar images with an NG test result can be displayed in a list, making it easier to understand the assembly status and identify the cause of the error.

[0080] According to this embodiment, the CPU 21 , as described above, configured to display a control for the second search condition along with the related images 32to perform. In this way, the user can specify the search condition for related images. 32 , which together with the selected image 31 will be displayed, confirm visually.

[0081] According to this embodiment, the CPU 21 , as described above, configured to display the related images 32 to be retrieved according to a second search condition, which is selected from the multitude of adjustable second search conditions based on the user's selection or the predefined condition, if the multitude of second search conditions for the selected image 31 are adjustable. Accordingly, the related images can be adjusted. 32 can be retrieved according to a second search condition, which was selected from the multitude of second search conditions, and thus the related images can be found. 32 can be retrieved according to a more suitable search condition.

[0082] According to this embodiment, as described above, the CPU 21 configured to perform a control to select a variety of secondary search conditions in a selectable manner along with the selected image 31 to display. Accordingly, the user can easily select a desired search condition from the multitude of second search conditions. Modified examples

[0083] The embodiment disclosed here is to be regarded in all respects as illustrative and not as limiting. The scope of the present invention is not defined by the above description of the embodiment, but by the scope of the claims, and all modifications (modified examples) within the meaning and scope corresponding to the scope of the claims are also included.

[0084] While the example in which the image search device is provided as a device for controlling the process of the component assembly line was shown in the aforementioned embodiment, the present invention is not limited thereto. In the present invention, the image search device can be provided separately from a control device configured to control the process of the component assembly line.

[0085] The example in which the components are fed from the conveyor belt feeders to the component assembly devices was shown in the aforementioned embodiment, but the present invention is not limited to this. Within the scope of the present invention, the components can be fed from trays to the component assembly devices.

[0086] While the example in which the printed circuit board is conveyed along a track and the assembly process is carried out on it was shown in the aforementioned embodiment, the present invention is not limited to this. Within the scope of the present invention, the printed circuit boards can be conveyed on two or more tracks on which the assembly process can be carried out.

[0087] While the example in which a so-called in-line head unit comprising a plurality of mounting heads arranged linearly in a row or in a plurality of rows was shown in the aforementioned embodiment, the present invention is not limited thereto. Within the scope of the present invention, a so-called rotary head unit comprising a plurality of circumferentially arranged mounting heads can be provided.

[0088] Although the example in which a head unit is provided was shown in the aforementioned embodiment, the present invention is not limited thereto. Within the scope of the present invention, a plurality of head units can be provided.

[0089] Although the example in which the three component assembly devices are provided in a component assembly line was shown in the aforementioned embodiment, the present invention is not limited thereto. Within the scope of the present invention, two or fewer, or four or more component assembly devices can be provided in a component assembly line. Reference symbol list 15 Component assembly device 20 Image search device 21 CPU (Controller) 22 storage 25 DB (image storage) 31 selected image 32 related images 100 component assembly system E component S circuit board QUOTES INCLUDED IN THE DESCRIPTION

[0000] This list of documents cited by the applicant was automatically generated and is included solely for the reader's convenience. The list is not part of the German patent or utility model application. The DPMA accepts no liability for any errors or omissions. Cited patent literature

[0000] JP 6154120 [0002, 0003, 0004, 0005]

Claims

[1] Image search device comprising: an image memory configured to store a large number of images taken during an assembly process for mounting a component onto a printed circuit board; and a controller configured to retrieve an image from the multitude of images stored in the image memory according to a search condition; wherein The controller is configured to perform a control to retrieve an image from the multitude of images in the image memory according to a first search condition specified by a user, and, together with a selected image chosen by the user from the retrieved image, to display a related image that was retrieved according to a second search condition, which differs from the first search condition, based on information about the selected image. [2] Image search device according to claim 1, wherein the first search condition is a condition that is determined on the basis of information which includes component information and / or printed circuit board information and / or information about a component mounting position and / or information about a working device that works on the printed circuit board and / or information about a working unit that works on the printed circuit board and / or information about a component feeding unit that feeds the component and / or information about a working date and a working time. [3] Image search device according to claim 1 or 2, wherein the controller is configured to perform a control to display a plurality of related images together with the selected image. [4] Image search device according to claim 3, wherein the controller is configured to store information about the related image selected from the plurality of related images with respect to the selected image in a memory and to reflect the information about the related image stored in the memory to establish the second search condition. [5] Image search device according to any one of claims 1 to 4, wherein the controller is configured to retrieve the related image according to the second search condition depending on the type of assembly error, if the selected image chosen by the user is an image relating to an assembly error of the component. [6] Image search device according to any one of claims 1 to 5, wherein the controller is configured to perform a control to store OK / NG of a component assembly test result in a memory and to display an image of the same type of another component with an NG test result as the related image together with the selected image when the selected image is an image with an NG test result. [7] Image search device according to any one of claims 1 to 6, wherein the controller is configured to perform a control to display the second search condition together with the related image. [8] Image search device according to any one of claims 1 to 7, wherein the controller is configured to retrieve, when a plurality of second search conditions are adjustable for the selected image, the related image according to a second search condition selected on the basis of a user selection or a predetermined condition from the plurality of adjustable second search conditions. [9] Image search device according to claim 8, wherein the controller is configured to perform a control to display the plurality of second search conditions in a selectable manner together with the selected image. [10] Component assembly system comprising: a component mounting device configured to mount a component onto a printed circuit board; and an image search device; wherein The image search device includes: an image memory configured to store a large number of images taken during an assembly process to mount the component onto the printed circuit board; and a controller configured to retrieve an image from the multitude of images stored in the image memory according to a search condition; and The controller is configured to perform a control to retrieve an image from the multitude of images in the image memory according to a first search condition specified by a user, and, together with a selected image chosen by the user from the retrieved image, to display a related image that was retrieved according to a second search condition, which differs from the first search condition, based on information about the selected image. [11] Image search methods, comprehensive: Storing a large number of images taken during an assembly process for mounting a component onto a printed circuit board; and Retrieving an image from the multitude of stored images according to a first search condition and displaying a related image retrieved according to a second search condition that differs from the first search condition, based on information about the selected image, along with an image selected from the retrieved image. [12] Image search method according to claim 11, wherein the first search condition is a condition that is determined on the basis of information which includes component information and / or printed circuit board information and / or information about a component mounting position and / or information about a work device that works on the printed circuit board and / or information about a work unit that works on the printed circuit board and / or information about a component feeding unit that feeds the component and / or information about a work date and a work time. [13] Image search method according to claim 11 or 12, wherein a plurality of related images are displayed together with the selected image. [14] Image search method according to one of claims 11 to 13, wherein the related image is retrieved according to the second search condition for a type of assembly defect if the selected image is an image relating to an assembly defect of the component. [15] Image search method according to one of claims 11 to 14, wherein OK / NG of a test result of the component assembly is stored and an image of the same type of another component with an NG test result is displayed as the related image together with the selected image if the selected image is an image with an NG test result. [16] Image search method according to any one of claims 11 to 15, wherein the second search condition is displayed together with the related image.

Images