Image display control device, image display control program, component mounting system, and image display control method

Abstract

Even when a large number of nozzles are used in a component mounting machine, the system allows users to efficiently determine whether or not nozzle maintenance is required. [Solution] The tip surface image Ib (nozzle image) captured by the component mounting machine 2 is stored in the image storage server 4 (image storage unit). The storage unit 53 (information acquisition unit) of the image display control server 5 acquires multiple tip surface images Ib from the image storage server 4, each representing a different set of suction nozzles 3 (nozzles) (step S201). The calculation unit 52 (image display unit) of the image display control server 5 then generates display control data based on the tip surface images Ib (step S403) and transmits it to the viewing PC 6 (step S404).

Claims

1. In a component mounting machine that holds components with a nozzle and mounts them onto a circuit board, an information acquisition unit acquires a nozzle image from an image storage unit that stores a nozzle image acquired by a camera capturing the nozzle, The information acquisition unit controls the display control unit to display multiple nozzle images acquired for each of several different nozzles on a display. An image display control device equipped with the following features.

2. The nozzle has an adsorption hole, and while in contact with the component, it adsorbs the component by negative pressure applied to the adsorption hole facing the component. The camera, facing the adsorption hole, images the nozzle and acquires the nozzle image. The image display control device according to claim 1, wherein the display control unit controls the display of at least the suction holes and the area around the suction holes in the nozzle image on the display.

3. The image display control device according to claim 2, wherein the display control unit performs control to extract a predetermined range from the nozzle image that includes the adsorption holes and display it on the display.

4. The information acquisition unit acquires nozzle position information, which indicates the position of the nozzle shown in the nozzle image on the component mounting machine, in association with the nozzle image. The image display control device according to claim 1, wherein the display control unit performs control to display the nozzle position information corresponding to the nozzle image on the display together with the nozzle image.

5. The information acquisition unit acquires imaging position information, which indicates the position of the nozzle at the time the camera images the nozzle and acquires the nozzle image, as the nozzle position information. The image display control device according to claim 4, wherein the display control unit performs control to display the nozzle image along with the position information at the time of imaging corresponding to the nozzle image on the display.

6. The component mounting machine performs a nozzle scan to confirm the position of the nozzle in the component mounting machine. The information acquisition unit acquires scan position information, which indicates the position of the nozzle confirmed by the nozzle scan, for the nozzle shown in the nozzle image, as the nozzle position information. The image display control device according to claim 4, wherein the display control unit performs control to display the nozzle image along with the scanning position information corresponding to the nozzle image on the display.

7. The system further includes an abnormality detection unit that detects abnormalities contained in the nozzle image, The information acquisition unit acquires the nozzle image abnormality information detected by the abnormality detection unit. The image display control device according to claim 1, wherein the display control unit performs control to display the nozzle image together with the nozzle image and the nozzle image abnormality information acquired for the nozzle image on the display.

8. The image display control device according to claim 7, wherein the anomaly detection unit detects the anomaly using a machine learning model that has performed machine learning on a dataset consisting of the nozzle image and information regarding the anomaly in the nozzle image.

9. The nozzle image anomaly information indicates the location of the anomaly in the nozzle image where an anomaly exists. The image display control device according to claim 8, wherein the display control unit controls the display of an abnormality-enhanced image on the display, which shows an enhanced display that highlights the abnormal area superimposed on the nozzle image.

10. The image display control device according to claim 9, wherein the display control unit performs control for displaying the nozzle image and the abnormal enhancement image side by side on the display.

11. The nozzle image further includes an abnormality detection unit that detects the degree of abnormality of the abnormality contained in the nozzle image, The information acquisition unit acquires the nozzle image abnormality information detected by the abnormality detection unit. The image display control device according to claim 1, wherein the display control unit performs control to arrange and display the plurality of nozzle images on the display in an order determined based on the degree of abnormality of each of the plurality of nozzle images.

12. The image display control device according to claim 11, wherein the display control unit performs control to arrange and display the plurality of nozzle images on the display in the order of the degree of abnormality of each of the plurality of nozzle images.

13. The image display control device according to claim 11, wherein the display control unit classifies each of the plurality of nozzle images into one of the plurality of attributes, calculates an attribute anomaly value indicating the degree of anomaly of the attribute according to the degree of anomaly of the nozzle image belonging to the attribute, and performs control to arrange and display each of the plurality of nozzle images on the display in the order of the attribute anomaly values ​​of the attribute to which the nozzle image belongs.

14. The image display control device according to claim 1, wherein the display control unit controls the display on the display of a plurality of nozzle images selected from among the nozzle images, each showing a different nozzle and stored in the image storage unit, based on predetermined selection conditions.

15. The system further includes an abnormality detection unit that detects abnormalities contained in the nozzle image and obtains the degree of abnormality of the nozzle image. The image display control device according to claim 14, wherein the display control unit selects the plurality of nozzle images based on the selection condition that the degree of abnormality is greater than or equal to a threshold.

16. The component mounting machine acquires nozzle check data that checks the temporal changes in the state of the nozzle, The information acquisition unit acquires the nozzle check data, The image display control device according to claim 1, wherein the display control unit controls each of the plurality of nozzle images to be displayed on the display together with the corresponding nozzle check data.

17. The component mounting machine acquires nozzle-related data concerning the nozzle, The display control unit performs control to display each of the plurality of nozzle images on the display together with the corresponding nozzle-related data. The image display control device according to claim 1, wherein the nozzle-related data includes at least one piece of information: information regarding an adsorption error in which the nozzle failed to adsorb a component; information regarding an recognition error in which the nozzle failed to recognize a component to be adsorbed; information regarding a defect in the nozzle; information regarding a negative pressure generated for the nozzle to adsorb a component; and information regarding an abnormality in the image of the nozzle.

18. An image display control program that causes a computer to function as an image display control device according to any one of claims 1 to 17.

19. A component mounting machine having a mounting head that holds components with a nozzle and mounts them on a substrate, and a camera that acquires nozzle images by imaging the nozzle, An image storage unit for storing the nozzle image, The image display control device according to any one of claims 1 to 17 and A component mounting system equipped with the following features.

20. In a component mounting machine that holds components with a nozzle and mounts them onto a substrate, the process includes acquiring a nozzle image from an image storage unit that stores a nozzle image acquired by a camera capturing an image of the nozzle, A process for controlling the display of multiple nozzle images acquired for each of several different nozzles on a display. An image display control method comprising:

Images