Image Processing Verification System

Abstract

This image processing verification system is used for verifying image processing performed on a captured image of a component captured by an imaging device, on the basis of preset processing information. The system comprises: an editing unit for editing the processing information; and a display unit for displaying, side-by-side, a set of image processing results from image processing performed on the captured image before and after editing of the processing information.

Description

[Technical Field]

[0001] This specification discloses an image processing verification system. [Background technology]

[0002] Conventionally, image processing verification systems that reproduce and verify image processing have been known. For example, Patent Document 1 discloses a procedure for reproducing and verifying image processing, in which shape data is created, a database (test sample) is prepared in which desired image processing results are expected, an image processing test is performed using this database, and if an image processing result contrary to expectations is obtained, the shape data is modified and the image processing test is performed again until the expected image processing result is obtained. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2008-197772 Summary of the Invention [Problem to be solved by the invention]

[0004] The more test samples there are, the more comprehensive the image processing test can be, but the results of the image processing test must be visually confirmed by the user. For example, if the user corrects the shape data because the image processing results are contrary to their expectations, they must visually confirm the captured images and the image processing results to ensure that the line between normal and abnormal in the image processing judgment is as intended. Therefore, if the number of test samples is increased to perform a more comprehensive performance check, the number of confirmation steps required will increase accordingly, increasing the burden on the user.

[0005] A primary object of the present disclosure is to provide an image processing verification system that can reduce the burden on a user when performing confirmation work to obtain an intended image processing result. [Means for solving the problem]

[0006] The present disclosure has adopted the following means to achieve the above-mentioned main object.

[0007] A first image processing verification system of the present disclosure includes: An image processing verification system for verifying image processing performed on a captured image of a component captured by an imaging device based on preset processing information, comprising: an editing unit that edits the processing information; a display unit that displays a set of image processing results of the image processing performed on the captured image before and after editing the processing information, side by side; The gist of the project is to provide the following:

[0008] In the first image processing verification system of the present disclosure, a set of image processing results of image processing performed on a captured image before and after editing of processing information is displayed side by side. This allows the user to easily check whether the image processing has been adjusted as intended by editing the processing information by comparing the image processing results before and after editing of the processing information. As a result, the burden on the user when checking to obtain the intended image processing results can be reduced.

[0009] The second image processing verification system of the present disclosure comprises: An image processing verification system for verifying image processing performed on a captured image of a component captured by an imaging device based on preset processing information, comprising: an editing unit that edits the processing information; a display unit that displays a difference between the image processing results of the image processing performed on the captured image before and after editing the processing information; The gist of the project is to provide the following:

[0010] The second image processing verification system of the present disclosure displays the difference between the image processing results of image processing performed on a captured image before and after editing of the processing information. This allows the user to easily confirm whether the image processing has been adjusted as intended by editing the processing information by checking the difference between the image processing results before and after editing of the processing information. As a result, the burden on the user can be reduced when performing confirmation work to obtain the intended image processing results. [Brief explanation of the drawings]

[0011] [Figure 1] 1 is a schematic configuration diagram of an image processing verification system according to an embodiment of the present invention. [Figure 2] FIG. 10 is an explanatory diagram showing an example of a procedure for executing an image processing test. [Figure 3] 10 is a flowchart illustrating an example of an image processing result display process. [Figure 4] FIG. 10 is an explanatory diagram showing an example of display information. [Figure 5] FIG. 10 is an explanatory diagram illustrating an example of a narrowing-down condition selection screen. [Figure 6] FIG. 10 is an explanatory diagram showing an example of a sorting condition selection screen. DETAILED DESCRIPTION OF THE INVENTION

[0012] Next, embodiments of the present disclosure will be described with reference to the drawings.

[0013] 1 is a schematic diagram of an image processing verification system according to this embodiment. The image processing verification system 10 according to this embodiment is a system for verifying whether image processing by an image processing device 20 is performed as expected by a user. In addition to the image processing device 20, the image processing verification system 10 also includes a camera 41, an input device 42 such as a mouse or keyboard, and a display device 43.

[0014] The image processing device 20 includes a processing unit 21, an editing unit 22, and a storage unit 30.

[0015] For example, in a component mounter that picks up components with a suction nozzle and mounts them on a board, processing unit 21 checks for the presence or absence of suction misalignment of the components by processing an image obtained by capturing an image of a component picked up by a suction nozzle with camera 41. Furthermore, processing unit 21 checks for the presence or absence of mounting misalignment of the components by processing an image obtained by capturing an image of a component mounted on a board with camera 41.

[0016] The processing unit 21 also has a function of reproducing and verifying image processing from a plurality of test samples (images of components).

[0017] The storage unit 30 is configured as a storage device such as a hard disk drive or a solid-state drive. The storage unit 30 stores image data 31, processing condition setting data 32, and image processing result data 33. The image data 31 includes images of components captured by the camera 41. In this embodiment, the storage unit 30 stores all images captured during production by the component mounter. The processing condition setting data 32 includes parameters required for image processing by the image processing device 20. For example, the processing condition setting data 32 includes shape data including component outer shape data (part data) and tolerance data indicating the allowable range of component positional and angular misalignment, imaging conditions (light source type), camera resolution, calibration data (camera distortion correction value), etc. The image processing result data 33 includes the position (X coordinate value, Y coordinate value) and angle (θ angle value) of the component identified by image processing, information indicating whether the component positional and angular misalignment is within the allowable range (presence or absence of an image processing error and an error code), etc.

[0018] The editing unit 22 edits the above-mentioned shape data, imaging conditions, and other data based on input operations on the input device 42 by the user.

[0019] Next, a procedure for verifying image processing by the image processing device 20 using the image processing verification system 10 of this embodiment configured as described above will be described. Fig. 2 is an explanatory diagram showing an example of the procedure for executing an image processing test.

[0020] First, shape data is created (S100). The user can create the shape data by operating the input device 42 to input numerical values ​​for the part shape or by extracting part shape data from the part drawing data. The created shape data is stored in the memory unit 30 as processing condition setting data 32.

[0021] Next, a test sample is selected from the image data 31 stored in the storage unit 30 (S110). The test sample may be selected, for example, by the user selecting an arbitrary image from the image data 31 stored in the storage unit 30, or by the user specifying search conditions and the image processing device 20 searching the storage unit 30 for images that match the search conditions. Examples of search conditions include a specified nozzle type, a specified parts lot, a specified camera, or an image processing error with a specified error code.

[0022] Next, the processing unit 21 executes an image processing test (S120). The image processing test is performed by the processing unit 21 performing image processing on the test sample selected in S110 based on the processing condition setting data 32 including the shape data created in S100. For example, the processing unit 21 identifies components captured in the test sample by edge extraction, calculates their positions and angles, and determines whether the component positional and angular misalignments are within the allowable ranges based on the tolerance data. If both the component positional and angular misalignments are within the allowable ranges, the processing unit 21 determines that the image processing results are normal. On the other hand, if either the component positional or angular misalignment is not within the allowable range, the processing unit 21 determines that an image processing error has occurred. The processing unit 21 then stores the image processing results in the storage unit 30 as image processing result data 33.

[0023] Then, the processing unit 21 displays the image processing results on the display device 43 (S130). The image processing results are displayed on the display device 43 by displaying the image of the part after image processing, the position (X coordinate value, Y coordinate value) and angle (θ angle value) of the part, and error information (presence or absence of an image processing error ("OK" or "NG")).

[0024] Next, the test results of the image processing test are evaluated (S140). The test results are evaluated by the user visually checking the image processing results displayed on the display device 43. For example, the user may check whether the image processing results of a test sample that is expected to be normal are normal as expected, or whether the image processing results of a test sample that is expected to be erroneous are erroneous as expected.

[0025] If the evaluation of the test results is as expected ("YES" in S150), production is started and inspection of the parts photographed by the camera 41 by image processing based on the processing condition setting data 32 including the shape data created in S100 is started (S160). Then, if the inspection results are as intended for a certain period of time ("YES" in S170), verification of the image processing is terminated.

[0026] On the other hand, if the evaluation of the test results is not as expected ("NO" in S150) or if the inspection results are not as expected ("NO" in S170), the editing unit 22 edits the shape data, etc. (S180). The shape data is edited by the user operating the input device 42 to change the numerical values ​​of the part data, tolerance data, etc. Note that the editing unit 22 may be configured to be able to edit other data, such as imaging conditions, in addition to the shape data.

[0027] Then, the processing unit 21 re-executes image processing on the test sample using the processing condition setting data 32 including the shape data edited in S180 (S190), and after displaying the image processing results (S200), the process returns to S140. In this way, if the intended evaluation or inspection results are not obtained, editing of the shape data and re-execution of the image processing test are repeated until the intended results are obtained. The image processing results after editing the shape data are displayed by displaying on the display device 43 a set of the results of the image processing executed before and after editing, and information on the difference between them. Figure 3 is a flowchart showing an example of the image processing result display process executed by the processing unit 21 after editing the shape data.

[0028] In this image processing result display device, the processing unit 21 (CPU) first displays a list of display information including image processing results before and after editing and difference information between them on the display device 43 (S210). An example of the display information displayed on the display device 43 is shown in FIG. 4. As shown in the figure, the display information includes an image of the part after image processing, the image processing result before editing the shape data, the image processing result after editing the shape data, and difference information between the two image processing results. A predetermined number (e.g., three) of these display information items are displayed in a list on one screen, and operating the next button advances to the next screen, and operating the previous button returns to the previous screen. The display information also includes a filter button for specifying filter conditions and a sort button for specifying sort conditions. The difference information includes the differences in the position (X coordinate value, Y coordinate value) and angle (θ angle value) of the part before and after editing the shape data, as well as error information (presence or absence of an image processing error ("OK" or "NG")) before and after editing the shape data. This allows the user to check how the image processing results have changed before and after editing the shape data, making it possible to easily determine whether editing the shape data is appropriate.

[0029] Next, the processing unit 21 determines whether the filtering conditions have been changed (S220). Examples of the filtering conditions include a difference of a certain value or more in the positioning results (any of the X coordinate value, Y coordinate value, and θ angle value) and a difference in the error information ("OK" or "NG"), as shown in FIG. 5 . The filtering conditions may also include picking up with a specified nozzle type, capturing images under specified imaging conditions, etc. The user specifies the filtering conditions by operating the input device 42 to select one of multiple conditions. If the processing unit 21 determines that the filtering conditions have been changed, it searches the image processing result data 33 in the storage unit 30 for image processing result data that matches the changed filtering conditions (S230), and displays a list of up to a predetermined number of the retrieved image processing result data and their difference information (S240). On the other hand, if the processing unit 21 determines that the filtering conditions have not been changed, the processing proceeds to S250.

[0030] Next, the processing unit 21 determines whether the sorting conditions have been changed (S250). Here, the sorting conditions include an X difference descending order, which sorts the differences in X coordinate values ​​before and after editing of the shape data in descending order (from the largest difference to the smallest difference), and an X difference descending order, which sorts the differences in X coordinate values ​​before and after editing of the shape data in ascending order (from the smallest difference to the largest difference), as shown in FIG. 6 . Furthermore, the sorting conditions include a Y difference descending order, which sorts the differences in Y coordinate values ​​before and after editing of the shape data in descending order, a Y difference descending order, which sorts the differences in Y coordinate values ​​before and after editing of the shape data in ascending order, a θ difference descending order, which sorts the differences in θ angle values ​​before and after editing of the shape data in descending order, and a θ difference descending order, which sorts the differences in θ angle values ​​before and after editing of the shape data in ascending order. Note that the ascending order sorting may be omitted from the options. The user specifies the sorting conditions by operating the input device 42 to select one of a plurality of conditions. If the processing unit 21 determines that the sorting conditions have been changed, it sorts the display information according to the changed sorting conditions (S260) and displays the sorted display information in order up to a predetermined number of items (S270). On the other hand, if the processing unit 21 determines that the sorting conditions have not been changed, it proceeds to S280.

[0031] Then, the processing unit 21 determines whether or not the end of the display has been selected (S280), and if it determines that the end of the display has not been selected, it returns to S220 and repeats the process, and if it determines that the end of the display has been selected, it ends the image processing result display process.

[0032] Here, the correspondence between the main elements of the embodiment and the main elements of the present disclosure described in the claims will be described. That is, the editing unit 22 of the embodiment corresponds to the editing unit of the present disclosure, and the display device 43 corresponds to the display unit. Also, the storage unit 30 corresponds to the storage unit, the input device 42 and the processing unit 21 that executes S220 of the image processing result display process correspond to the designation unit, and the processing unit 21 that executes S230 of the image processing result display process corresponds to the search unit.

[0033] It goes without saying that the present disclosure is not limited to the above-described embodiments, and can be implemented in various forms as long as they fall within the technical scope of the present disclosure.

[0034] For example, in the above-described embodiment, the processing unit 21 displays the image processing results before and after editing of shape data, etc., and the difference information between the two on the display device 43 at the same time, but it may also be configured to display only one of them.

[0035] In the above-described embodiment, the editing unit 22 is built into the image processing device 20, but may be provided separately from the image processing device 20. In addition, the storage unit 30 is built into the image processing device 20, but may be external to the image processing device 20.

[0036] As described above, the first image processing verification system of the present disclosure displays side-by-side sets of image processing results of image processing performed on a captured image before and after editing of processing information. This allows the user to easily check whether the image processing has been adjusted as intended by editing the processing information by comparing the image processing results before and after editing of the processing information. As a result, the burden on the user when checking to obtain the intended image processing results can be reduced.

[0037] The first image processing verification system of the present disclosure may include a storage unit that stores multiple sets of image processing results, a designation unit that designates predetermined narrowing conditions, and a search unit that searches the storage unit for sets of image processing results that match the designated narrowing conditions, and the display unit may display the sets of image processing results searched by the search unit. This makes it easy to find image processing results that require confirmation, even when performing image processing tests using a large number of test samples. In this case, the predetermined narrowing conditions may include a condition in which there is a difference of a certain value or more in the positions of components identified by the image processing before and after editing of the processing information, or a condition in which there is a difference in the results of the success / failure judgment by the image processing before and after editing of the processing information.

[0038] The first image processing verification system of the present disclosure may further include a storage unit that stores a plurality of sets of image processing results, and the display unit may sort the plurality of sets of image processing results stored in the storage unit according to predetermined sorting conditions and display up to a predetermined number of sets. This makes it possible to easily find image processing results that require confirmation, even when performing image processing tests using a large number of test samples. In this case, the predetermined sorting conditions may include a condition for sorting the differences in the positions of components identified by the image processing before and after editing the processing information in ascending or descending order.

[0039] Furthermore, the second image processing verification system of the present disclosure displays the difference between the image processing results of image processing performed on a captured image before and after editing the processing information. This allows the user to easily confirm whether the image processing has been adjusted as intended by editing the processing information by checking the difference between the image processing results before and after editing the processing information. As a result, the burden on the user can be reduced when performing confirmation work to obtain the intended image processing results. [Industrial Applicability]

[0040] The present disclosure can be used in the manufacturing industries of image processing devices and component mounters. [Explanation of symbols]

[0041] 10 Image processing verification system, 20 Image processing device, 21 Processing unit, 22 Editing unit, 30 Storage unit, 31 Image data, 32 Processing condition setting data, 33 Image processing result data, 41 Camera, 42 Input device, 43 Display device.

Claims

1. An image processing verification system for verifying image processing performed on a captured image of a component captured by an imaging device based on preset processing information, comprising: an editing unit that edits the processing information; a display unit that displays a set of image processing results of the image processing performed on the captured image before and after editing the processing information, side by side; a storage unit that stores a plurality of sets of the image processing results; a designation unit for designating predetermined narrowing conditions; a search unit that searches the storage unit for a set of image processing results that matches the specified narrowing-down conditions; Equipped with the display unit displays the set of image processing results searched by the search unit; The predetermined narrowing-down conditions include a condition that there is a difference of a certain value or more in the position of a component identified by the image processing before and after editing of the processing information, or a condition that there is a difference in the result of the correct / incorrect determination by the image processing before and after editing of the processing information. Image processing verification system.

2. An image processing verification system for verifying image processing performed on an image of a part captured by an imaging device based on preset processing information, comprising: an editing unit that edits the processing information; a display unit that displays a set of image processing results of the image processing performed on the captured image before and after editing the processing information, side by side; a storage unit that stores a plurality of sets of the image processing results; Equipped with the display unit sorts the plurality of sets of image processing results stored in the storage unit according to a predetermined sorting condition and displays up to a predetermined number of sets; the predetermined sorting condition includes a condition for sorting in ascending or descending order based on a difference in the position of a part identified by the image processing before and after editing of the processing information. Image processing verification system.

3. 3. The image processing verification system according to claim 2, a designation unit for designating predetermined narrowing conditions; a search unit that searches the storage unit for a set of image processing results that matches the specified narrowing-down conditions; Equipped with the display unit displays the set of image processing results searched by the search unit. Image processing verification system.

4. 4. The image processing verification system according to claim 3, The predetermined narrowing-down conditions include a condition that there is a difference of a certain value or more in the position of a component identified by the image processing before and after editing of the processing information, or a condition that there is a difference in the result of the correct / incorrect determination by the image processing before and after editing of the processing information. Image processing verification system.

Images