Image processing apparatus, control method for image processing apparatus, and program

Abstract

To display inspection results of a plurality of inspection objects in a display time suitable for a user while maintaining a tact time.SOLUTION: An image processing apparatus includes: acquisition means that acquires a captured image obtained by simultaneously capturing a plurality of inspection objects; inspection means that inspects a defect for each of the plurality of inspection objects using the captured image acquired by the acquisition means; and display control means that controls a user interface screen for displaying inspection results of the plurality of inspection objects obtained from the inspection means. The display control means displays the inspection results of the plurality of inspection objects on the user interface screen according to the order of completion of the inspection, and does not display the inspection results of the plurality of inspection objects for a fixed time after displaying the inspection results of the plurality of inspection objects on the user interface screen.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present disclosure relates to a technique for inspecting the appearance of a product. [Background technology]

[0002] When inspecting the appearance of a product, there is a method of inspecting the product for defects such as scratches on its surface using images captured using multiple light sources. Depending on the type of product, the number of products produced per unit time may be large, and the time available for each inspection may be short. In such cases, it is preferable to photograph and inspect multiple inspection objects at once. In this regard, Patent Document 1 improves inspection efficiency by photographing multiple inspection objects arranged in a regular pattern at once and displaying the inspection results for the multiple inspection objects together. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2012-084000 Summary of the Invention [Problem to be solved by the invention]

[0004] In the above-mentioned Patent Document 1, the inspection results for multiple inspection objects are not displayed until the inspection of all of the multiple inspection objects is completed. Therefore, there is a risk that a display time sufficient for the user to check all the inspection results while maintaining the takt time cannot be ensured. Therefore, there is a demand for a technology that displays the inspection results for multiple inspection objects in a display time appropriate for the user while maintaining the takt time. [Means for solving the problem]

[0005] The image processing device according to the present disclosure comprises an acquisition means for acquiring images of multiple inspection objects simultaneously, an inspection means for inspecting defects for each of the multiple inspection objects using the images acquired by the acquisition means, and a display control means for controlling a user interface screen for displaying the inspection results for the multiple inspection objects obtained from the inspection means, wherein the display control means displays the inspection results for the multiple inspection objects on the user interface screen in the order in which the inspections were completed, and after displaying the inspection results for the multiple inspection objects on the user interface screen, hides the inspection results for the multiple inspection objects for a certain period of time. [Effects of the Invention]

[0006] According to the technology disclosed herein, even when displaying inspection results for multiple inspection objects, it is possible to display the inspection results to the user in a display time that is appropriate for the user while maintaining the takt time. [Brief explanation of the drawings]

[0007] [Figure 1] 1A and 1B are an external view and a hardware configuration diagram of an image processing apparatus. [Figure 2] FIG. 2 is a functional configuration diagram of an image processing device. [Figure 3] 4 is a flowchart of processing performed by the information processing device in the first embodiment. [Figure 4] FIG. 2 is a diagram showing an example of the arrangement of a camera, lighting, and a workpiece in the first embodiment. [Figure 5] 4 is a table for explaining the use and geometric conditions of lighting in the first embodiment. [Figure 6] FIG. 3 is a diagram showing an example of an examination screen user interface in the first embodiment. [Figure 7] 6 is a timing chart showing display results of the conventional technology and the first embodiment. [Figure 8] FIG. 10 is a diagram showing an example of the arrangement of a camera, lighting, and a workpiece in a modified example of the first embodiment. [Figure 9]FIG. 10 is a diagram showing an example of an examination screen user interface in a modified example of the first embodiment. [Figure 10] FIG. 10 is a diagram showing an example of the arrangement of a camera, lighting, and a workpiece in the second embodiment. [Figure 11] 10 is a flowchart of a process performed by an information processing device according to a second embodiment. [Figure 12] FIG. 10 is a diagram showing an example of an examination screen user interface in the second embodiment. [Figure 13] FIG. 10 is a diagram showing an example of a display method for an examination screen in the second embodiment. [Figure 14] 10 is a timing chart showing display results of the conventional technique and the second embodiment. [Figure 15] 10 is a flowchart of processing performed by an information processing device according to a third embodiment. [Figure 16] FIG. 11 is a diagram showing an example of an examination screen user interface in the third embodiment. [Figure 17] FIG. 10 is a diagram showing another example of an examination screen user interface. DETAILED DESCRIPTION OF THE INVENTION

[0008] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. Note that the following embodiments do not limit the present disclosure, and not all combinations of features described in the embodiments are necessarily essential to the solutions of the present disclosure. Note that identical components will be described with the same reference numerals. Furthermore, each process (step) in a flowchart will be indicated with a reference numeral beginning with "S."

[0009] [First embodiment] <Hardware configuration of image processing device> Figure 1 shows an external view and a hardware configuration diagram of an image processing device according to this embodiment. Figure 1(a) is a hardware configuration diagram of the image processing device according to this embodiment, Figure 1(b) is a front view of the entire visual inspection system, and Figure 1(c) is a top view of the entire visual inspection system.

[0010] The image processing device 100 in this embodiment includes an imaging control device 102, an imaging device 103, an information processing device 104, a display 105, a mouse 106, a keyboard 107, and a lighting device 108. The image processing device 100 is connected to a transport control device 111 that controls a transport device 112. The transport control device 111 transports a workpiece 113 to be inspected to the image processing device 100, and sends an inspection start signal to the image processing device 100 via a start signal output interface 101. Note that in this embodiment, the workpieces 113 are transported as a set of two inspection objects (articles), for example, works 113-3 and 113-4, and the imaging device will be described as capturing images of one set of inspection objects (articles) in a single capture.

[0011] The imaging control device 102 includes a control unit 114, which controls the imaging device 103 and the lighting device 108 to capture an image of the workpiece 113 in synchronization with the illumination of the light source. Specifically, upon receiving an inspection start signal from a start signal input interface 115, the control unit 114 sends a capture instruction to the imaging device 103 via a release signal output interface 116. At the same time, the control unit 114 receives a synchronization signal from the imaging device 103 via a synchronization signal input interface 117. The synchronization signal is transmitted from the imaging device 103 to notify the external strobe light source of the timing of light emission in synchronization with the image capture. Furthermore, in response to the received synchronization signal, the control unit 114 turns on the lighting device 108 in a predetermined order and combination. Through the above operations, the workpiece 113 illuminated by the predetermined illumination can be captured. Note that in this embodiment, the image capture is synchronized with the illumination based on the synchronization signal output from the imaging device 103, but the method of synchronized image capture with the illumination is not limited. For example, synchronized image capture can also be achieved by simultaneously outputting an image capture instruction for the imaging device 103 and an instruction to turn on the illumination device 108 using a pulse signal from the control unit 114.

[0012] The imaging device 103 includes a control unit 125 and an imaging optical system 121 including a lens and an imaging element, and generates a captured image by quantizing a captured optical image using an image processing engine 123. The imaging device 103 transfers the captured image to the information processing device 104 via a USB interface 124. In this embodiment, an example will be described in which a still image captured using a digital camera is acquired, but this is not limiting. A form in which a predetermined frame is extracted from a moving image captured using a video camera may also be used. Furthermore, in this embodiment, a USB interface is used to transfer the captured image, but this is not limiting. A wired LAN, a wireless LAN, Bluetooth (registered trademark), or the like may also be used.

[0013] The information processing device 104 includes a RAM 126, a ROM 127, a CPU 128, a GPU 129, and a USB interface 130, and these devices are connected via an internal bus. The processes described in the flowcharts below are stored in the ROM 127 as program code. This program code is loaded into the RAM 126 and executed by the CPU 128 and the GPU 129.

[0014] The lighting device 108 includes one or more luminaires 109. In this embodiment, the luminaires 109 are LEDs, but are not limited to LEDs. They may also be other light sources, such as xenon lamps. Furthermore, the luminaires 109 are installed in a hemispherical pattern above the workpiece 113, dispersed in the zenith and azimuth directions. In image inspection, the illumination method must be changed depending on the appearance inspection item. For example, when inspecting gloss, illumination must be provided from a direction that captures light reflected from the inspection surface, and the captured gloss information is used in the inspection image. Furthermore, when inspecting color or unevenness, illumination must be provided from multiple directions that prevent light reflected from the inspection surface from penetrating. In particular, by synthesizing captured images illuminated from multiple directions using a known photometric stereo method, normal information representing unevenness and color information corresponding to reflectance can be used in the inspection image. Therefore, the luminaires 109 are also positioned in directions with large angles of incidence relative to the installation surface of the workpiece 113, creating a geometric condition that makes it easy to observe diffused light from the imaging device 103. The lighting devices 109 are also arranged in directions with small angles of incidence relative to the workpiece 113 placement surface, creating geometric conditions that make it easy to observe specularly reflected light from the imaging device 103. The lighting devices 109 may also have different light-emitting surfaces or spectral characteristics. For example, spot illumination devices such as lighting devices 109-1 to 109-8 may be provided in directions with large angles of incidence relative to the workpiece 113 placement surface, and ring illumination devices such as lighting device 109-9, in which light-emitting elements are arranged in a circular ring shape, may be provided in directions with small angles of incidence. In response to commands from the control unit 114, the lighting device 108 turns on specific lighting devices among the lighting devices 109 for a preset period of time.

[0015] <Processing performed by the image processing device> 2 is a functional configuration diagram of the image processing device 100 in this embodiment. The control unit 114 of the imaging device 103 includes an imaging control unit 202. Furthermore, the control unit 125 of the imaging device 103 includes an imaging unit 203. Furthermore, the lighting device 108 includes an illumination unit 205. Furthermore, the information processing device 104 includes an information processing unit 204. The information processing unit 204 includes an image conversion unit 215, an inspection object number acquisition unit 216, a divided image acquisition unit 217, a color and shape inspection unit 218, a gloss inspection unit 219, and a display control unit 220.

[0016] The image conversion unit 215 converts the captured images into an image format that can be handled in subsequent processing. The inspection target number acquisition unit 216 acquires the number of inspection targets from the number of inspection targets set in a pull-down menu in the inspection target number setting field or the number of inspection targets input by the user. The inspection target number acquisition unit 216 may also acquire the number of inspection targets from the captured images. The divided image acquisition unit 217 divides all captured images so that the number of inspection targets corresponds to the preset number, and acquires the divided images. The color and shape inspection unit 218 performs inspection processing for color and shape using the divided images. The gloss inspection unit 219 performs inspection processing for gloss using the divided images. The display control unit 220 displays an inspection screen on the display 105 that shows the inspection results of the inspection targets. The inspection results may also be displayed on a touch panel (not shown) other than the display 105.

[0017] 3 is a flowchart of the inspection process executed in the image processing device 100 according to this embodiment. The function and processing content of each component will be described below.

[0018] FIG. 4 is a diagram showing an example of the arrangement of a camera, lighting, and workpiece in this embodiment. In this embodiment, imaging is performed in the positional relationship shown in FIG. 4. FIG. 4(a) is a front view of the camera, inspection object, and lighting. FIG. 4(b) is a top view of the camera, inspection object, and lighting. As shown in FIG. 4(a), the inspection objects are arranged in pairs in the conveying direction (x-axis direction), and each pair of inspection objects moves in the conveying direction. At this time, as shown in FIG. 4(b), imaging is performed so that the two inspection objects are included in the angle of view of the camera. FIG. 4(c) is an example of a captured image. In this embodiment, a case will be described in which two inspection objects are included in one captured image, as shown in FIG. 4(c).

[0019] When the workpiece 113 is transported to a predetermined position by the transport device 112, the start signal output unit 201 of the transport control device 111 transmits an inspection start signal to the imaging control unit 202. When the imaging control unit 202 receives the inspection start signal, the processing of the flowchart shown in Fig. 3 starts.

[0020] In S301, the imaging control device 102 acquires multiple captured images of the inspection surface by turning on a predetermined illumination. First, the release signal output unit 207 sends a release signal to the imaging device 103, and the control unit 212 executes the imaging operation. In this embodiment, high-speed continuous imaging is performed using a known continuous imaging function, but this is not limiting. The continuous imaging function is a function that repeats imaging at a predetermined speed while a release signal is being transmitted, and in this embodiment, imaging is performed at 30 frames per second. During imaging, the control unit 212 synchronizes with the opening of the shutter curtain and outputs a synchronization signal to the synchronization signal input unit 208 via the synchronization signal output unit 213 to notify the external strobe light source of the emission timing.

[0021] When the imaging control unit 202 detects input of a synchronization signal at the synchronization signal input unit 208, the synchronization signal count unit 209 counts the number of synchronization signal inputs, i.e., the number of captured images. The lighting signal output unit 210 switches the lighting that is turned on sequentially according to the number of captured images, and turns on the lighting unit 205.

[0022] FIG. 5 is an example of a table showing the installation angle and lighting order of the lighting unit 205 in this embodiment. The number of lighting units, the arrangement of lighting units, and the lighting order of lighting units are not limited to this. The lighting unit corresponding to lighting unit number 501-1 uses a circular ring light and illuminates the inspection surface from all azimuth angles. In this manner, multiple images are taken with the timing of the photography and lighting units matched. Finally, the image acquisition unit 214 turns on the specified lighting units and transfers multiple captured images of the inspection surface to the information processing device 104 as needed.

[0023] In S302, the image conversion unit 215 converts each of the multiple captured images captured in S301. In this embodiment, the captured images are assumed to be captured in HEIF format (High Efficiency Image File Format). The HEIF images are decoded using a known HEIF format decoding method. Note that the format of the captured images is not limited to HEIF format. For example, JPEG format or other compressed formats may also be used. Next, degamma processing is performed on the decoded RGB data to convert it into RGB data that exhibits a linear relationship with the luminance value. Note that the converted RGB data may also be converted into predetermined RGB data such as sRGB data using a conversion table based on the characteristics of the imaging device 103, but a description thereof will be omitted.

[0024] In S303, the divided image acquisition unit 217 divides all of the images captured in S301 into divided images corresponding to a predetermined number of inspection objects, and acquires the divided images. The number of inspection objects may be acquired from the captured image by the inspection object number acquisition unit 216. In this embodiment, the number of inspection objects is set to two, which is a predetermined number, and the captured image is divided into two divided images at a position halfway along the image width. However, the division method is not limited to this as long as processing can be completed within the takt time. For example, the inspection objects may be extracted, and the image may be divided based on the extraction results.

[0025] In S304, the processes of S305 and S306 are repeated in the order of inspection for all segmented images acquired by the segmented image acquisition unit 217 in S303. In S305, the color and shape inspection unit 218 and the gloss inspection unit 219 use the segmented images to perform inspection processing on the inspection object. In this embodiment, there are three types of appearance inspection items: color, shape, and gloss. However, the appearance inspection items are not limited to these. Anything that represents the appearance and can be imaged and judged may be used, such as material or pattern.

[0026] FIG. 6 is a diagram illustrating an example of an inspection screen user interface in this embodiment. First, one or more types of visual inspection items are set using the inspection screen user interface (hereinafter referred to as the "inspection screen UI") shown in FIG. 6. The user operates the inspection screen UI displayed on the display 105 using the mouse 106 or keyboard 107. To set the visual inspection items, a pre-registered product to be inspected is selected from a drop-down menu in the inspection target product setting section 601 in FIG. 6(a) and then set using the check button in the visual inspection item setting section 602 corresponding to the product. The user can also change the visual inspection items by arbitrarily changing the check boxes in the visual inspection item setting section 602. In the inspection process, the degree of defects is detected by spatial filtering of the inspection image, which is composed of the captured image, normal information synthesized using photometric stereo, and color information. The response value to the spatial filtering process is integrated and quantified as the degree of abnormality, which is then compared with a judgment threshold to determine whether the inspection passed or failed. The judgment threshold corresponds to the threshold setting section 603 in the inspection screen UI, and the user can input a desired value.

[0027] In S306, the display control unit 220 displays the inspection results of the inspection object calculated in S305 on the inspection screen UI displayed on the display 105 (see FIG. 6(b)). In FIG. 6(b), items 604 to 609 are UIs that show the inspection results. Item 604 is an inspection date display field, which displays the date the inspection was performed in the Gregorian calendar. Item 605 is an inspection time display field, which displays the time the inspection was performed. Item 606 is a first inspection result display field, which displays the inspection result of the first inspection object. The first inspection result display field displays "OK" if the abnormality degree calculated in S305 is smaller than the threshold value, and displays "NG" if the abnormality degree is equal to or greater than the threshold value. Item 607 is a first abnormality degree display field, which displays the abnormality degree of the first inspection object. Items 606 and 607 display the results of the first processing of the repeated processing.

[0028] Item 608 is a second inspection result display field, in which the inspection result of the second inspection object is displayed (see FIG. 6(c)). As with the first inspection result display field (item 606), in S305, if the calculated abnormality level is smaller than the threshold, "OK" is displayed, and if the abnormality level is equal to or greater than the threshold, "NG" is displayed. Item 609 is a second abnormality level display field, in which the abnormality level of the second inspection object is displayed. Items 608 and 609 display the results of the second iteration of the repeated processing. Note that in this embodiment, by displaying the inspection results of the inspection process each time the inspection process is performed, the time for displaying the inspection results can be extended. In addition, by displaying the inspection results on the inspection screen UI at a position that corresponds to the positional relationship of the inspection objects at the time of shooting, visibility of which inspection object's inspection results are being displayed is improved.

[0029] In S307, after a first predetermined time has elapsed since all the inspection results were displayed in S306, the display column for the inspection results is hidden for a second predetermined time (see FIG. 6(d)). Taking into account the takt time, the second predetermined time may be equal to or shorter than the first predetermined time. The processing of S307 is performed to explicitly display the inspection results for the next set of inspection objects. By performing the processing described in S307, no inspection results are displayed for the time being, allowing the user to easily understand whether any of the inspection results for the next set of inspection objects are being displayed.

[0030] In S308, the display control unit 220 outputs the inspection results to the transport unit 206, completing the processing flow of the flowchart shown in FIG. 3. For example, if at least one of two inspection objects is found to be NG, the transport unit 206 outputs an NG signal indicating that the inspection has failed. Upon receiving the NG signal, the transport unit 206 changes the corresponding pair of inspection objects to a NG transport route. Alternatively, an identification ID may be assigned to each inspection object, and only the corresponding inspection object may be changed to a NG transport route. Note that the order of the processing of S307 and the processing of S308 is not limited to this. For example, the processing of S307 may be executed after the processing of S308, and the processing flow of the flowchart shown in FIG. 3 may be completed.

[0031] FIG. 7 is a timing chart showing the display results of the conventional technology and the first embodiment, assuming an inspection speed of 50 (items / min). FIG. 7(a) is a timing chart showing the display results in the conventional technology. In the conventional technology, the inspection results are not displayed until all inspections are completed, so the inspection results of all inspection objects are displayed in 900 (msec). In other words, in the example of FIG. 7(a), the time to check the inspection results for each inspection object is 450 (msec).

[0032] 7(b) is a timing chart showing the display results in this embodiment. In this embodiment, when the first inspection is completed, the inspection results of each inspection object are displayed on the display 105. In this embodiment, the inspection results of each inspection object are displayed at intervals of 750 msec. Therefore, it can be seen that the display method of this embodiment ensures a sufficient display time compared to the display method of the prior art.

[0033] As described above, the image processing device according to this embodiment simultaneously captures multiple inspection objects, sequentially executes inspection processing, and displays the inspection results in the order of inspection on an inspection screen UI that reflects the relative positions at the time of image capture. After displaying all inspection results, all displayed inspection results are hidden for a certain period of time, and all inspection result display fields and abnormality level display fields are blanked. This makes it possible to continuously present inspection results to the user for one set of inspection objects while ensuring sufficient display time. Therefore, even when displaying inspection results for multiple inspection objects, it is possible to display the inspection results in a display time appropriate for the user while maintaining takt time. Furthermore, by providing a time period for clearing the inspection results once all inspection results are displayed, user visibility is improved.

[0034] [Modification of the first embodiment] In this embodiment, the arrangement of the inspection objects is described as being aligned in the same direction as the conveying direction. However, the arrangement of the inspection objects is not limited to this. For example, the inspection objects may be installed in the positional relationship shown in FIG. 8. FIG. 8 is a diagram showing an example of the arrangement of a camera, lighting, and workpieces in a modified example. FIG. 8 shows a case where two inspection objects are aligned in a direction perpendicular to the conveying direction. FIG. 8(a) is a front view of the camera, inspection objects, and lighting. FIG. 8(b) is a top view of the camera, inspection objects, and lighting. FIG. 8(c) shows an example of a captured image captured in this positional relationship of the inspection objects. As shown in FIG. 8(b), two inspection objects are aligned in the y-axis direction perpendicular to the conveying direction. In this case, the captured image is acquired as an image of two inspection objects aligned vertically, as shown in FIG. 8(c).

[0035] FIG. 9 shows an example of the inspection screen UI. As shown in FIG. 9, the inspection screen UI can be configured to display inspection results vertically, reflecting the captured image. In this case, the upper inspection object is inspected, and the judgment result is displayed in a first judgment result display field 901, and the abnormality level is displayed in a first abnormality level display field 902 (see FIG. 9(a)). Subsequently, the lower inspection object is inspected, and the judgment result is displayed in a second judgment result display field 903, and the abnormality level is displayed in a second abnormality level display field 904 (see FIG. 9(b)). After the results of all inspection objects are displayed, all displayed inspection results are hidden for a certain period of time (see FIG. 9(c)). As described above, it is also possible to change the display method of the inspection screen UI depending on the positional relationship during imaging.

[0036] [Second embodiment] In the first embodiment, the case where there are two inspection objects has been described. However, the number of inspection objects is not limited to two, and the present disclosure is applicable as long as there are multiple inspection objects. In this embodiment, the case where four inspection objects are detected will be described, focusing on the differences from the first embodiment. Note that the same components as in the first embodiment will be described using the same reference numerals.

[0037] In this embodiment, two inspection objects are arranged in the conveying direction and two inspection objects are arranged in a direction perpendicular to the conveying direction. That is, a case will be described where a total of four inspection objects are photographed at once. FIG. 10 is a diagram showing the relationship between the camera, lighting, and inspection objects in the second embodiment. FIG. 10(a) is a front view of the camera, inspection objects, and lighting. FIG. 10(b) is a top view of the camera, inspection objects, and lighting. As shown in FIG. 10(b), two inspection objects are arranged in each of the x direction and y direction. That is, a total of four inspection objects are arranged. FIG. 10(c) shows an example of a captured image when photographed under the above conditions. As shown in FIG. 10(c), one captured image captured in this embodiment includes four inspection objects.

[0038] <Processing performed by the image processing device> 11 is a flowchart of the inspection process executed in the image processing device 100 in this embodiment. The processes from S1101 to S1102 are the same as the processes from S301 to S302 in the first embodiment, and therefore description thereof will be omitted. In S1103, the inspection object number acquisition unit 216 acquires the number of inspection objects. In S1104, the divided image acquisition unit 217 divides all the captured images captured in S1101 so that the number of divided images corresponds to the number of inspection objects acquired in S1103, and acquires divided images.

[0039] FIG. 12 is a diagram illustrating an example of the inspection screen UI. In the inspection screen UI shown in FIG. 12, the number of inspection objects set by the user from a pull-down menu in an inspection object number setting field 1204 is acquired. Once the number of inspection objects is acquired, the layout of the judgment result display fields 1207, 1209, 1211, and 1213 and the abnormality level display fields 1208, 1210, 1212, and 1214 is determined according to the number of inspection objects. Note that the layout is pre-assigned to the data listed in the pull-down menu. In this embodiment, similar to the positions of the inspection objects, two inspection results are displayed horizontally and two inspection results are displayed vertically on the inspection screen UI. Note that, although the number of inspection objects is acquired from a pull-down menu in this embodiment, the acquisition method is not limited thereto. For example, the user may input the number of inspection objects, or the number of inspection objects may be acquired by reading data from an external device. Alternatively, the inspection object number acquisition unit 216 may acquire the number of inspection objects from a captured image. Alternatively, the vertical and horizontal numbers may be acquired separately. Furthermore, the configuration of the display of the inspection results on the user interface screen is not limited to this as long as it changes based on the number of inspection objects acquired. For example, the display may be automatically divided based on the acquired number of inspection objects in the horizontal direction and the acquired number of inspection objects in the vertical direction.

[0040] The processing from S1105 to S1109 is the same as the processing from S304 to S308, and therefore a description thereof will be omitted. A method for displaying inspection results in this embodiment will be described with reference to FIG. 13. FIG. 13 is a diagram showing an example of a display method for an inspection screen in this embodiment. First, the column for displaying the results of the inspection objects is determined based on the number of inspection objects set by the user. In this embodiment, the inspection results are displayed in two vertical and two horizontal columns. The initial state is blank, as shown in FIG. 13(a). Next, when the first inspection object is inspected, that is, when S1105 is executed for the first time, in S1107, the judgment result of the first inspection object is displayed in the judgment result display column 1207, and the calculated abnormality level is displayed in the abnormality level display column 1208 (see FIG. 13(b)). Subsequently, when S1105 is executed for the second time, in S1107, the judgment result of the second inspection object is displayed in the judgment result display column 1209, and the calculated abnormality level is displayed in the abnormality level display column 1210 (see FIG. 13(c)). Similarly, when S1105 is executed a third time, in S1107, the judgment result of the third inspection object is displayed in judgment result display field 1211, and the calculated degree of abnormality is displayed in abnormality degree display field 1212 (see FIG. 13(d)). Then, when S1105 is executed a fourth time, in S1107, the judgment result of the fourth inspection object is displayed in judgment result display field 1213, and the calculated degree of abnormality is displayed in abnormality degree display field 1214 (see FIG. 13(e)). Finally, in S1108, after all inspection results have been displayed, all displayed inspection results are hidden for a certain period of time, and all inspection result display fields and abnormality degree display fields are made blank (see FIG. 13(f)).

[0041] FIG. 14 is a timing chart showing the display results of the conventional technology and the second embodiment, assuming an inspection speed of 50 (items / min). FIG. 14(a) is a timing chart showing the display results of the conventional technology. In the conventional technology, the inspection results are not displayed until all inspections are completed, so the inspection results of all inspection objects are displayed in 1800 (msec). In other words, in the example of FIG. 14(a), the time to check the inspection results for each inspection object is 450 (msec).

[0042] 14(b) is a timing chart showing the display results in this embodiment. In this embodiment, when the first inspection is completed, the inspection results of each inspection object are displayed on the display 105. In this embodiment, the inspection results of each inspection object are also displayed at intervals of 750 msec. Therefore, it can be seen that the display method of this embodiment ensures a sufficient display time compared to the display method of the prior art.

[0043] In the present embodiment, an example has been shown in which the test results of one test object are displayed on the display 105 in the order of testing, but this is not limiting. Assume that the number of test objects is N (N is an integer equal to or greater than 3). For example, two test objects may be treated as a set, and the test results of the set may be displayed on the display 105 in the order of testing. Note that the above example is merely illustrative, and the number of test objects included in one set may be two or more as long as they are visible to the user.

[0044] As explained above, even when there are more than two inspection objects, displaying the inspection results in inspection order makes it easier for the user to visually recognize which inspection object's inspection result is being displayed. In other words, even when displaying inspection results for multiple inspection objects, it is possible to display the inspection results in a display time that is appropriate for the user while maintaining the takt time.

[0045] [Third embodiment] In the first and second embodiments, examples have been described in which the positions of the inspection result display field and the abnormality degree display field on the inspection screen UI are arranged to correspond to the positions of the captured image, making it easier for the user to visually recognize the results. In this embodiment, in addition to the above, an example will be described in which an actual captured image is displayed on the inspection screen UI. Note that in this embodiment, a case will be described in which two inspection objects are treated as a set.

[0046] <Processing performed by the image processing device> 15 is a flowchart of the inspection process executed in the image processing device 100 of this embodiment. The processes from S1501 to S1504 are the same as the processes from S1101 to S1104 in the second embodiment, and therefore a description thereof will be omitted.

[0047] In S1505, the captured image is displayed on the examination screen UI. Fig. 16 is an example of the examination screen UI in this embodiment. As shown in Fig. 16(a), one captured image from the images captured in S1501 is displayed in an image display area 1610. Note that the image to be displayed may be an image that is highly visible to the user. In this embodiment, an image captured with a ring light indicated by light 109-9 that is highly visible to the user is displayed.

[0048] In S1506, the processes of S1507 to S1509 are repeated for all the divided images divided in S1504. The process of S1507 is the same as the process of S1106, and therefore a description thereof will be omitted. In S1508, a frame is added to the image displayed in S1505 in an area corresponding to the inspection object to be displayed. In this embodiment, when each divided image is generated, the coordinates of each divided image on the captured image are stored. Based on these coordinates, the display control unit 220 adds a frame to the image of the inspection object to be displayed on the inspection screen UI. At this time, the frame may be displayed in an area that is smaller by a predetermined ratio in both length and width. The processes of S1509 to S1511 are the same as the processes of S1107 to S1109, and therefore a description thereof will be omitted.

[0049] 16(b) and 16(c) show examples of the inspection results obtained when the above-described processing is performed. FIG. 16(b) is an example of the display of the first processing result in the repeated processing. As shown in FIG. 16(b), the inspection screen UI displays the inspection results calculated in S1507 in a first judgment result display field 1606 and a first abnormality level display field 1607. Additionally, the processing performed in S1508 causes a frame to be added to a region corresponding to the inspection object in the image displayed in the image display area 1610. FIG. 16(c) is an example of the display of the second processing result in the repeated processing. As shown in FIG. 16(c), the inspection screen UI displays the inspection results calculated in S1507 in a second judgment result display field 1608 and a second abnormality level display field 1609. Additionally, the processing performed in S1508 causes a frame to be added to a region corresponding to the inspection object in the image displayed in the image display area 1610. Finally, in S1510, after all the test results have been displayed, all the displayed test results are hidden for a certain period of time, and all test result display columns and abnormality level display columns are made blank.

[0050] As described above, the image processing device according to this embodiment can simultaneously frame the inspection object and the inspection result, allowing the user to easily recognize which inspection object's inspection result is being displayed.

[0051] [Other embodiments] In the first to third embodiments, examples have been described in which the inspection results of multiple inspection objects are displayed on the inspection screen UI at once. However, as long as the inspection results can be displayed, they do not necessarily have to be displayed on a single screen. For example, it is also possible to switch screens depending on the number of inspection objects.

[0052] FIG. 17 shows another example of the inspection screen UI. FIG. 17(a) shows an example in which the inspection results of the inspection object on the left side of the captured image are displayed. As shown in FIG. 17(a), a frame is displayed on the captured image, and the inspection results of the inspection object on the left side are displayed. FIG. 17(b) shows an example in which the inspection results of the inspection object on the right side of the captured image are displayed. As shown in FIG. 17(b), a frame is displayed on the captured image, and the inspection results of the inspection object on the right side are displayed. Note that it is desirable that the display times of FIGS. 17(a) and 17(b) be long enough to be visible. After the inspection process is executed, the inspection results may not be displayed immediately, but may be displayed for, for example, one second before the next result is displayed. In this case, after the last inspection result is displayed, the inspection results on the inspection screen UI are hidden for, for example, five milliseconds. This allows the user to recognize that the display of the inspection results for one set of inspection objects has been completed.

[0053] In all the above embodiments, the information displayed on the inspection screen is not limited to this. For example, an identification ID may be assigned to the inspection object, and the identification ID may be displayed together with the inspection results.

[0054] The present disclosure can also be realized by providing a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0055] The disclosure of the above-described embodiment includes the following configurations.

[0056] (Configuration 1) An image processing apparatus comprising: an acquisition means for acquiring images of multiple inspection objects simultaneously; an inspection means for inspecting each of the multiple inspection objects for defects using the images acquired by the acquisition means; and a display control means for controlling a user interface screen that displays the inspection results for the multiple inspection objects obtained from the inspection means, wherein the display control means displays the inspection results for the multiple inspection objects on the user interface screen in the order in which the inspections were completed, and after displaying the inspection results for the multiple inspection objects on the user interface screen, hides the inspection results for the multiple inspection objects for a certain period of time.

[0057] (Configuration 2) The image processing device according to Configuration 1, wherein the display control means continues to display the displayed inspection results on the user interface screen until all of the inspection results have been displayed on the user interface screen.

[0058] (Configuration 3) The image processing device described in Configuration 1 or 2, characterized in that the display control means displays the inspection results for the multiple inspection objects at positions on the user interface screen based on the arrangement of the multiple inspection objects in the captured image.

[0059] (Configuration 4) The image processing device described in any one of configurations 1 to 3, characterized in that the acquisition means acquires the number of the plurality of inspection objects based on the captured image, and the display control means changes the configuration of the user interface screen based on the number of the plurality of inspection objects acquired by the acquisition means.

[0060] (Configuration 5) The image processing device according to Configuration 4, characterized in that the display control means determines the display time of the inspection results for each of the plurality of inspection objects based on the takt time of the inspection and the number of the plurality of inspection objects.

[0061] (Configuration 6) The image processing device according to configuration 1, wherein the display control means switches and displays the user interface screen in accordance with each of the plurality of inspection objects to be displayed.

[0062] (Configuration 7) An image processing device according to any one of configurations 1 to 6, further comprising an imaging means for imaging the plurality of inspection objects, wherein the acquisition means acquires the images of the plurality of inspection objects imaged by the imaging means, and the display control means displays the images of the plurality of inspection objects imaged by the imaging means on the user interface screen.

[0063] (Configuration 8) The image processing device described in Configuration 7, characterized in that the display control means surrounds, in the captured image displayed on the user interface screen, areas corresponding to each of the multiple inspection objects for which the inspection results are to be displayed, with a frame.

[0064] (Configuration 9) The image processing device according to Configuration 7, further comprising an illumination means for illuminating the plurality of inspection objects with a ring light, and wherein the photographing means photographs the plurality of inspection objects illuminated by the illumination means.

[0065] (Configuration 10) An image processing device described in any one of configurations 1 to 9, characterized in that each of the plurality of inspection objects has an identification ID, and the display control means displays the identification ID on the user interface screen in the inspection results for each of the plurality of inspection objects.

[0066] (Configuration 11) A control method for an image processing device, comprising: a step of acquiring photographed images of multiple inspection objects simultaneously; a step of inspecting each of the multiple inspection objects for defects using the photographed images acquired in the acquiring step; and a step of controlling a user interface screen that displays the inspection results for the multiple inspection objects obtained in the inspecting step, wherein in the controlling step, the inspection results for the multiple inspection objects are displayed on the user interface screen in the order in which the inspections were completed, and after the inspection results for the multiple inspection objects are displayed on the user interface screen, the inspection results for the multiple inspection objects are hidden for a certain period of time.

[0067] (Configuration 12) A program for causing a computer to function as the image processing device according to any one of configurations 1 to 10.

Claims

1. an acquisition means for acquiring images of a plurality of inspection objects simultaneously; an inspection means for inspecting defects for each of the plurality of inspection objects using the photographed images acquired by the acquisition means; a display control means for controlling a user interface screen that displays inspection results for the plurality of inspection objects obtained from the inspection means; Equipped with The display control means displaying the inspection results for the plurality of inspection objects on the user interface screen in the order in which the inspections were completed; After displaying the inspection results for the plurality of inspection objects on the user interface screen, the inspection results for the plurality of inspection objects are hidden for a certain period of time.

1. An image processing device comprising:

2. 2. The image processing apparatus according to claim 1, wherein the display control means continues to display the displayed inspection results on the user interface screen until all of the inspection results have been displayed on the user interface screen.

3. 2. The image processing apparatus according to claim 1, wherein the display control means displays the inspection results for the plurality of inspection objects at positions on the user interface screen based on an arrangement of the plurality of inspection objects in the captured image.

4. The acquisition means acquires the number of the plurality of inspection objects based on the captured image, 2. The image processing apparatus according to claim 1, wherein the display control means changes the configuration of the user interface screen based on the number of the plurality of inspection objects acquired by the acquisition means.

5. 5. The image processing apparatus according to claim 4, wherein the display control means determines a display time for the inspection results of each of the plurality of inspection objects based on a takt time for the inspection and the number of the plurality of inspection objects.

6. 2. The image processing apparatus according to claim 1, wherein the display control means switches and displays the user interface screen in accordance with each of the plurality of inspection objects to be displayed.

7. further comprising an imaging means for imaging the plurality of inspection objects; the acquiring means acquires the photographed images of the plurality of inspection objects photographed by the photographing means, 2. The image processing apparatus according to claim 1, wherein the display control means displays the images of the plurality of inspection objects photographed by the photographing means on the user interface screen.

8. 8. The image processing device according to claim 7, wherein the display control means surrounds, in the captured image displayed on the user interface screen, areas corresponding to each of the plurality of inspection objects for which the inspection results are to be displayed, with a frame.

9. further comprising an illumination means for illuminating the plurality of inspection objects with a ring illumination; 8. The image processing apparatus according to claim 7, wherein said photographing means photographs said plurality of inspection objects illuminated by said lighting means.

10. Each of the plurality of inspection objects has an identification ID, 2. The image processing apparatus according to claim 1, wherein the display control means displays the identification ID of each of the inspection results of the plurality of inspection objects on the user interface screen.

11. A step of simultaneously capturing images of a plurality of inspection objects; a step of inspecting defects for each of the plurality of inspection objects using the photographed images acquired in the acquiring step; a step of controlling a user interface screen that displays inspection results for the plurality of inspection objects obtained in the inspecting step; Equipped with In the controlling step, displaying the inspection results for the plurality of inspection objects on the user interface screen in the order in which the inspections were completed; After displaying the inspection results for the plurality of inspection objects on the user interface screen, the inspection results for the plurality of inspection objects are hidden for a certain period of time.

2. A method for controlling an image processing apparatus comprising:

12. A program for causing a computer to function as the image processing device according to any one of claims 1 to 10.

Images