Image management system, image management method, and program

Abstract

To automatically extract image data as a non-deletion object from a workpiece image acquired in product inspection.SOLUTION: An image processing device 11 sequentially stores, in a data storage 12, an image processing result of a workpiece image obtained by photographing a workpiece 2 to be inspected by a camera 112, image data of the workpiece image, setting parameters related to photographing and image processing, together with an inspection log indicating relevance between them. An image management device 13 generates and records evaluation information data, which is information indicating the relevance between designated setting parameters and the inspection log, in accordance with designation by a user, and extracts image data related to the setting parameters selected by the user as image data, which cannot be deleted, from the image data stored in the data storage 12 using the evaluation information data and the inspection log when receiving image deletion processing which includes selection setting of the setting parameters by the user.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to an image management system, an image management method, and a program. [Background technology]

[0002] Image processing systems that use cameras to capture images of products (hereinafter referred to as "workpieces") produced in factories and the like and perform dimensional inspections, appearance inspections, etc. based on the images are becoming widespread. In such image processing systems, it is common to delete the images used in the inspection process after a certain period of time has passed or to store them on an external storage medium such as a cloud service, so that the storage of the images does not overwhelm the storage capacity of the storage device.

[0003] For example, Japanese Patent No. 6979860 (Patent Document 1) describes a technique for reducing the communication load when backing up data from an image processing system to an external server such as a cloud server. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent No. 6979860 Summary of the Invention [Problem to be solved by the invention]

[0005] To prevent the storage space of image processing systems from becoming too large and to prevent cloud service usage fees from becoming too high, it is necessary to manage images so that stored images are eventually deleted.

[0006] On the other hand, maintaining and managing image processing algorithms that address manufacturing variations in workpieces requires continually adjusting the setting parameters of the image processing device using acquired images, which raises concerns that the burden on operators will increase as they must carefully select images that can be deleted. Furthermore, there is also concern that the accuracy of inspections will decline if images necessary for adjustment work or quality assurance are accidentally deleted.

[0007] The present disclosure has been made to solve such problems, and the purpose of the present disclosure is to realize image management that automatically extracts images that are necessary for adjusting the setting parameters of the image processing device and for ensuring processing performance from the work images acquired daily, as images that will not be deleted. [Means for solving the problem]

[0008] According to one aspect of the present disclosure, an image management system is provided. The image management system includes an image processing device having an imaging device for capturing an image of a workpiece to be inspected, a data storage, and an image management device. The image processing device, the data storage, and the image management device are configured to be able to communicate with each other. The image processing device is configured to perform an imaging process for capturing an image of the workpiece using the imaging device, a workpiece image recording process for saving the workpiece image as image data in the data storage, a parameter setting process for setting image processing device setting parameters, an image evaluation process for acquiring a processing result of performing image processing using the image processing device setting parameters set by the parameter setting process and the workpiece image obtained by the imaging process, a parameter recording process for recording the image processing device setting parameters used in the image processing, a processing result recording process for saving the processing result in the data storage, and an inspection log recording process. The inspection log recording process creates an inspection log including information indicating the relationship between the image processing device setting parameters recorded in the parameter recording process, the image data, and the processing result, and saves the inspection log in the data storage. The data storage is configured to execute an image data saving process that accepts a workpiece image recording process by the image processing device and saves the image data, a processing result data saving process that accepts a processing result recording process by the image processing device and saves the processing results, and an inspection log saving process that accepts an inspection log recording process by the image processing device and saves the inspection log. The image management device is configured to execute an evaluation information data recording process and a deletion-prohibited image extraction process. The evaluation information data recording process creates and records evaluation information data that is information indicating the association between the image processing device setting parameters and the inspection log for image processing device setting parameters specified by a user. The deletion-prohibited image extraction process, when accepting an image deletion process involving the selection and setting of image processing device setting parameters by the user, uses the evaluation information data and the inspection log saved in the data storage to extract, from the image data saved in the data storage, image data related to the image processing device setting parameters selected by the user as non-deletable image data.

[0009] According to another aspect of the present disclosure, there is provided an image management method, the image management method including: (1) a step in which an image processing device having an imaging device for a workpiece to be inspected executes an imaging process for capturing a workpiece image using the imaging device; (2) a step in which the image processing device executes a workpiece image recording process for saving the workpiece image as image data in a data storage that can communicate with the image processing device; (3) a step in which the image processing device executes a parameter setting process for setting image processing device setting parameters; (4) a step in which the image processing device executes an image evaluation process for acquiring a processing result obtained by executing image processing using the image processing device setting parameters set by the parameter setting process and the workpiece image obtained by the imaging process; (5) a step in which the image processing device executes a parameter recording process for recording the image processing device setting parameters used in the image processing; (6) a step in which the image processing device executes a processing result recording process for saving the processing result in a data storage; and (7) a step in which the image processing device creates an inspection log including information indicating the association between the image processing device setting parameters recorded in the parameter recording process, the image data, and the processing result, and stores the information in the data storage. (8) a step in which the data storage receives a workpiece image recording process by the image processing device and executes an image data saving process to save the image data; (9) a step in which the data storage receives a processing result recording process by the image processing device and executes a processing result data saving process to save the processing result; (10) a step in which the data storage receives an inspection log recording process by the image processing device and executes an inspection log saving process to save the inspection log; (11) a step in which an image management device capable of mutual communication with the image processing device and the data storage executes an evaluation information data recording process to create and record evaluation information data which is information indicating the association between the image processing device setting parameters and the inspection log, for image processing device setting parameters specified by a user; and (12) when the image management device receives an image deletion process accompanied by the selection and setting of the image processing device setting parameters by the user, the image management device uses the evaluation information data and the inspection log saved in the data storage toand executing a deletion-prohibited image extraction process to extract image data related to the image processing device setting parameters selected by the user as image data that cannot be deleted.

[0010] According to yet another aspect of the present disclosure, there is provided a program. The program causes a computer to operate as an image management device capable of communicating with both an image processing device having an imaging device for a workpiece to be inspected and a data storage. In a state in which the data storage stores image data of a workpiece image captured by the image processing device, processing results of image processing performed by the image processing device using image processing device setting parameters and the workpiece image, and an inspection log including information indicating the correlation between the image processing device setting parameters, image data, and processing results used in the image processing, the image data, and the processing results, the program causes the computer to execute the following steps: (1) creating and recording evaluation information data for image processing device setting parameters specified by a user, the evaluation information data being information indicating the correlation between the image processing device setting parameters and the inspection log; and (2) when an image deletion process involving the user's selection and setting of the image processing device setting parameters is accepted, extracting, from the image data stored in the data storage, image data related to the image processing device setting parameters selected by the user as non-deletable image data, using the evaluation information data and the inspection log. [Effects of the Invention]

[0011] According to the present disclosure, by extracting image data of work images related to the setting parameters of the image processing device selected by the user as image data that cannot be deleted, image management can be realized in which images necessary for adjusting the setting parameters of the image processing device and ensuring processing performance are automatically extracted as non-deletable images from the work images acquired daily. [Brief explanation of the drawings]

[0012] [Figure 1] 1 is a block diagram illustrating a configuration of an image management system according to an embodiment of the present invention. [Figure 2] FIG. 2 is a block diagram illustrating a hardware configuration of the image processing device shown in FIG. [Figure 3] FIG. 2 is a block diagram illustrating the main functional configuration of the image processing apparatus. [Figure 4] FIG. 2 is a block diagram illustrating the hardware configuration of the data storage shown in FIG. [Figure 5] FIG. 2 is a block diagram illustrating the functional configuration of a data storage. [Figure 6] 6 is a table showing an example of the test result data 42 and the test log data 43 shown in FIG. 5. [Figure 7] 2 is a block diagram illustrating a hardware configuration of the image management device shown in FIG. 1. FIG. [Figure 8] FIG. 2 is a block diagram illustrating the functional configuration of the image management device. [Figure 9] 10 is a flowchart illustrating an automatic operation of the image management system. [Figure 10] 10 is a flowchart illustrating a setting operation of an image processing unit in an image management system. [Figure 11] 10 is a flowchart illustrating an operation of registering evaluation information in the image management system. [Figure 12] 10 is a flowchart illustrating an image deletion operation of the image management system. [Figure 13] 1 is a first diagram illustrating an example of the operation of the image management system. [Figure 14] 10 is a second diagram illustrating an example of the operation of the image management system. [Figure 15] 10 is a table illustrating an example of evaluation information data corresponding to selected image processing unit settings. [Figure 16] 16 is a table for explaining the determination result of whether each image data item can be deleted under the selection of the image processing unit setting in FIG. 15. DETAILED DESCRIPTION OF THE INVENTION

[0013] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In the following, identical or corresponding parts in the drawings will be denoted by the same reference numerals, and their description will not be repeated in principle.

[0014] (Overall composition) FIG. 1 is a block diagram illustrating the configuration of an image management system 1 according to this embodiment.

[0015] 1, the image management system 1 includes an image processing device 11, a data storage 12, and an image management device 13. The image processing device 11, the data storage 12, and the image management device 13 are configured to be able to communicate with each other.

[0016] The image processing device 11 has an image processing unit 111, a camera 112, a lighting device 113, an input device 114a, and a display device 115a. The image processing device 11 is a device that acquires images of a workpiece 2, which is a product produced in a factory, measures the dimensions of the product, and inspects the surface of the product for scratches and dents. In the example of FIG. 1, the image processing device 11 captures images of the workpiece 2 as an inspection target, which is transported by a transport device 4. The transport device 4 can be configured, for example, by a belt conveyor or a robot arm controlled by a PLC 3.

[0017] The image processing device 11 is used to improve factory productivity, for example, by measuring product dimensions instead of people. The following explanation will be given using the image processing device 11 that measures product dimensions as an example, but the present invention can also apply to image processing devices that perform any image processing, including those other than dimensional measurement.

[0018] The image processing unit 111 controls the camera 112 to capture an image of the workpiece 2 illuminated by the lighting device 113. The camera 112 is equipped with a camera module having an imaging element that captures an image of the target workpiece 2. For example, a commercially available image sensor such as a CCD (Charge Coupled Device) sensor or a CMOS (Complementary Metal Oxide Semiconductor) sensor can be used as the imaging element.

[0019] The camera 112 captures an image of the workpiece 2 in accordance with an external imaging instruction. The imaging instruction is generated, for example, by manual input using the input device 114a or a control signal input from the PLC 3. The camera 112 corresponds to one embodiment of an "imaging device."

[0020] The camera 112 captures an image of the workpiece 2 that has been transported by the transport device 4 to a predetermined position suitable for imaging during the operating period for which imaging is instructed. For example, the timing of capturing an image (shutter timing) by the camera 112 can be automatically controlled based on the output of a sensor 5 that detects the presence or absence of the workpiece 2 at the predetermined position. The image of the workpiece 2 (workpiece image) captured by the camera 112 is transferred to the image processing unit 111. The sensor 5 can be configured, for example, by a light-shielding sensor.

[0021] The image processing unit 111 performs image processing such as dimensional measurement on the captured workpiece image. Data obtained by the image processing (processing results) is output to a control device such as a PLC (Programmable Logic Controller) 3 externally connected to the image processing unit 111, and to the data storage 12.

[0022] Note that, when it is necessary to switch lighting settings or control lighting timing, the image processing unit 111 may further have a function of controlling the lighting device 113. Furthermore, the image processing unit 111 can be configured by a computer such as a personal computer.

[0023] The lighting device 113 irradiates the workpiece 2 with an amount of light for photographing. As the lighting device 113, for example, a combination of a coaxial epi-illumination, ring illumination, or surface illumination for image processing and an illumination power supply that controls these illuminations can be applied. When it is necessary to switch the settings of the lighting device 113 or control the lighting timing, the lighting device 113 is configured to be able to communicate with the image processing unit 111, and is controlled according to commands from the image processing unit 111.

[0024] The display device 115a visually presents to the user the operating status of the image processing device 11, images captured by the camera 112, settings of the image processing device 11, etc. The user of the image processing device 11 can check the operating status of the image processing device 11 and set the image processing device 11 by checking the display content of the display device 115a. The display device 115a can be configured by, for example, a liquid crystal display.

[0025] The input device 114a is provided for a user of the image processing device 11 to perform input operations for carrying out various operations. By operating the input device 114a, the user of the image processing device 11 can select a menu item displayed on the display device 115a, input an instruction to change settings, etc. The input device 114a can be configured by, for example, a keyboard or a mouse.

[0026] The image processing device 11 has an "operation mode" in which image processing is performed on a workpiece image actually captured by the camera 112 and inspection result data 42 is output to the outside, and a "setting mode" in which settings related to the image processing device 11 are performed using an image captured by the camera 112 or an image stored in the image processing unit 111. For example, the image processing device 11 is configured to operate by switching between the operation mode and the setting mode in response to a user input to the input device 114a.

[0027] If the output of the image processing device 11 is not as desired, for example, if the dimensions cannot be measured correctly, the inspected workpiece 2 may cause problems such as defective assembly of products in subsequent processes or damage to production equipment. Therefore, if it is found that the output of the image processing device 11 operating in the operation mode is not as desired, it is necessary to halt production and use the input device 114a to switch to the setting mode and adjust the image processing device 11.

[0028] In the setting mode, the settings of the image processing device 11 can be changed using the input device 114a while checking the results of the setting change on the display device 115a. For example, when adjusting the exposure time of the camera 112 in the setting mode, the exposure time setting can be adjusted using the input device 114a while checking that no whiteout or blackout occurs with an image captured by the camera 112 displayed on the display device 115a. Furthermore, when setting a reference value (determination value) for determining whether the result of dimension measurement is good or bad (distinguishing between pass / fail) in the setting mode, a sample whose dimensions are within the pass limit can be imaged by the camera 112, and the reference value setting can be adjusted so that the sample is determined to be pass / fail.

[0029] In the setting mode, various adjustments can be made using images pre-stored in the image processing unit 111 or image data pre-recorded in the data storage 12, rather than directly using the images captured by the camera 112.

[0030] If it is confirmed that the desired output can be obtained from the image processing device 11 through adjustments in the setting mode, the image processing device 11 can be switched back to the operation mode and production can be resumed.

[0031] 5, which will be described later, the data storage 12 has a function of storing image data 41, inspection result data 42, inspection log data 43, etc., output from the image processing device 11. The data storage 12 can be configured, for example, by a NAS (Network Attached Storage) or the like.

[0032] 1 and 7, the image management device 13 is configured to be able to communicate with the image processing device 11 and the data storage 12. As shown in Fig. 7, the image management device 13 includes an image management unit 131, an input device 114c, and a display device 115c.

[0033] (Hardware and functional configuration of image processing device) Fig. 2 is a block diagram illustrating the hardware configuration of the image processing device 11 shown in Fig. 1. Fig. 3 is a block diagram illustrating the main functional configuration of the image processing device 11.

[0034] 2, the image processing unit 111 of the image processing device 11 includes a CPU (Central Processing Unit) 1111a, a processing memory 1112a, a main storage device 1113a, an image input unit 1114, a communication unit 1115a, an operation input unit 1116a, and a display control unit 1117a. The components of the image processing device 11 are electrically connected to each other and are capable of communicating with each other.

[0035] The image input unit 1114 is connected to the camera 112, imports workpiece images captured by the camera 112, and transfers them to the processing memory 1112a. The communication unit 1115a is connected to be able to communicate with the data storage 12 and the image management device 13. When controlling the lighting device 113, the communication unit 1115a is also connected to be able to communicate with the lighting device 113. An operation signal from the input device 114a is input to the operation input unit 1116a. The display control unit 1117a outputs a control signal to the display device 115a to control the display content of the display device 115a.

[0036] The CPU 1111a reads the image processing unit settings 21 and the control program 22a from the main storage device 1113a onto the processing memory 1112a, and executes image processing on the image transferred to the processing memory 1112a.

[0037] 3, the image processing unit settings 21 and control program 22a necessary for controlling the image processing device 11 and performing image processing are stored in the processing memory 1112a of the image processing unit 111. Furthermore, as will be described later, image data 41 (FIG. 5) for displaying a workpiece image, inspection result data 42 (FIG. 5), and inspection log data 43 (FIG. 5) are generated and stored in the main memory device 1113a. The image data 41, inspection result data 42, and inspection log data 43 are output to the data storage 12 via the communication unit 1115a.

[0038] 3, the image processing unit settings 21 include at least one of device settings 211, image processing settings 212, and judgment threshold settings 213. The control program 22a may also have a file system function for managing data stored on the main memory device 1113a. The image processing unit settings 21 correspond to one embodiment of the "image processing device setting parameters."

[0039] The device settings 211 include setting parameters necessary for controlling the devices that make up the image processing device 11 and are connected to the image processing unit 111, such as device settings typified by the exposure time of the camera 112 and the brightness of the lighting device 113.

[0040] The image processing settings 212 include setting parameters related to image processing, such as which dimensions of the product to measure, and what level of brightness is required to determine that the product is the product and not the background. The judgment threshold settings 213 also include setting parameters such as the lower and upper limits of the reference length for determining that the result of dimension measurement is a non-defective product.

[0041] The image processing unit settings 21 recorded in the main storage device 1113a and read into the processing memory 1112a are configured to be referable from the image management device 13 via the communication unit 1115a. The referencing method may be, for example, by utilizing a file system function included in the control program 22a.

[0042] As shown in FIG. 3, the CPU 1111a of the image processing unit 111 can operate to perform the functions of the setting reading unit 31, the image reading unit 32, the image processing unit 33, the judgment unit 34, the inspection result creation unit 35, the image saving unit 36, the inspection log creation unit 37, the setting change unit 38, and the setting recording unit 39 by executing the control program 22a read from the processing memory 1112a.

[0043] The setting reading section 31 reads the image processing unit settings 21 into the processing memory 1112a, thereby switching the operations of the image reading section 32, the image processing section 33, and the determination section .

[0044] The image reading unit 32 reads the image 23 corresponding to the workpiece image into the processing memory 1112a through communication with the data storage 12 and control of the image input unit 1114. This enables image processing by the image processing unit 33. The device settings 211 read by the setting reading unit 31 can be used to control the image input unit 1114. Figure 3 shows the state in which the image 23 has been read into the processing memory 1112a by the image reading unit 32.

[0045] The image processing unit 33 executes image processing based on the image 23 in the processing memory 1112a and the image processing settings 212 read by the setting reading unit 31, and calculates a feature quantity 24. For example, when the product inspection is a dimension measurement, the feature quantity 24 is a quantity indicating the length of the measured dimension. Note that when there are multiple target locations for dimension measurement, multiple feature quantities 24 may be calculated.

[0046] The judgment unit 34 performs a pass / fail judgment based on the feature 24 calculated by the image processing unit 33 and the judgment threshold setting 213 read by the setting reading unit 31, and generates a judgment result 25. For example, if the product inspection is dimensional measurement, the judgment result 25 can be generated by treating each workpiece 2 as "good" if the feature 24 is within the range of the lower and upper threshold values, and as "defective" otherwise. Furthermore, when there are multiple target locations for dimensional measurement, multiple judgment thresholds may be defined, or a common judgment threshold may be used for all measurements. Furthermore, if image processing fails, the judgment result 25 may be treated as a "measurement error" rather than a "good" or "defective" classification.

[0047] The inspection result creation unit 35 creates an inspection result 26 using the feature quantity 24 calculated by the image processing unit 33 and the judgment result 25 of the judgment unit 34. The inspection result 26 is output to an externally connected control device such as the PLC 3 and the data storage 12. Note that the inspection result creation unit 35 may output different inspection results 26 for each device. For example, it is possible to output only the judgment result 25 of the judgment unit 34 to the PLC 3, while outputting both the feature quantity 24 calculated by the image processing unit 33 and the judgment result 25 of the judgment unit 34 to the data storage 12. Alternatively, when the image processing unit 33 calculates multiple feature quantities 24, only some of them may be output to the control device (such as the PLC 3) and / or the data storage 12. The inspection result 26 corresponds to one example of a "processing result" obtained by executing image processing.

[0048] As will be described later, the image storage unit 36 ​​stores the image data 41 in the data storage 12. Whether the image storage unit 36 ​​stores the image 23 may be determined based on a condition such as whether a predetermined specific condition is satisfied, based on the determination result 25 of the determination unit 34, etc.

[0049] The inspection log creation unit 37 creates an inspection log 27, which is information on the relationship between the image processing unit settings 21, the image data 41, and the inspection result data 42 indicating the inspection results 26, and outputs the inspection log 27 to the data storage 12. The inspection log 27 does not include the image processing unit settings 21, the image data 41, and the inspection result data 42 themselves, but can be configured by a combination of information that can identify the uniqueness of each. In the data storage 12, a collection of the inspection result data 42 sequentially output from the image processing device 11 is saved as inspection log data 43.

[0050] Note that, as information that uniquely represents the image processing unit setting 21, i.e., information that can identify uniqueness, for example, parameter update time information or a hash value calculated for the parameter based on an algorithm such as MD (Message Digest Algorithm) 5, SHA (Secure Hash Algorithm)-1, or SHA-256 can be used. Similarly, as information that represents the uniqueness of the image data 41 and the test result data 42 (information that can identify uniqueness), storage destination information when storing the image data 41 and the test result data 42 in the data storage 12, update time information, a hash value, or the like can be used.

[0051] The setting change unit 38 accepts an operation by the user of the image processing device 11 and changes the image processing unit settings 21 in the processing memory 1112a. The setting recording unit 39 writes the image processing unit settings 21 changed by the setting change unit 38 to the main storage device 1113a. The user operation for changing the image processing unit settings 21 can be input using the input device 114a.

[0052] (Data storage hardware configuration and function configuration) FIG. 4 is a block diagram illustrating the hardware configuration of the data storage 12 shown in FIG.

[0053] 4, the data storage 12 includes a CPU 1111b, a processing memory 1112b, a main storage device 1113b, and a communication unit 1115b. The components of the data storage 12 are electrically connected to each other and are capable of communicating with each other. The communication unit 1115b is connected to the image processing device 11 and the image management device 13 so as to be able to communicate with each other.

[0054] FIG. 5 shows the functional configuration of the data storage 12.

[0055] The main memory device 1113b stores image data 41, inspection result data 42, inspection log data 43, and control program 22b. Fig. 5 shows the control program 22b read from the main memory device 1113b and stored in the processing memory 1112b. The control program 22b may have a file system function for managing the data stored on the main memory device 1113b. Alternatively, the control program 22b may have a database function that structures and stores data and enables efficient data entry and retrieval.

[0056] The image data 41, the inspection result data 42, and the inspection log data 43 recorded in the main memory device 1113b can be referenced from the image management device 13 via the communication unit 1115b. For example, the reference method can utilize the above-mentioned file system function and / or database function included in the control program 22b.

[0057] As shown in FIG. 5, the CPU 1111b of the data storage 12 can operate to perform the functions of the image recording unit 51, the result recording unit 52, the inspection log recording unit 53, and the image deletion unit 54 by executing the control program 22b loaded into the processing memory 1112b.

[0058] The image recording unit 51 stores the image data 41 in the main memory device 1113b in accordance with a request from the image processing device 11. The result recording unit 52 stores the test result data 42 in the main memory device 1113b in accordance with a request from the image processing device 11.

[0059] The inspection log recording unit 53 stores the inspection log data 43 in the main storage device 1113b in accordance with a request from the image processing device 11. The image deleting unit 54 deletes the image data 41 from the main storage device 1113b in accordance with a request from the image management device 13.

[0060] 6 shows a diagram illustrating examples of the test result data 42 and the test log data 43. In FIG. 6, (a) shows an example of the test result data 42, and (b) shows an example of the test log data 43.

[0061] As shown in Figure 6(a), the test result data 42 is composed of a collection of test results 26, which are a combination of test result Id, which is identification information for each judgment result, a judgment result (OK / NG) based on the feature 24 associated with the test result Id, and information (numbers and / or characters) that indicates the feature 24 itself.

[0062] For example, the test result data 42 can be stored in the form of a database or a text file as tabular data as shown in FIG. 6(a).

[0063] As shown in FIG. 6(b), the inspection log data 43 is composed of a collection of inspection logs 27, which are combinations of data indicating the time the inspection was performed for each inspection, setting name data (the "product type" column) for identifying the image processing unit setting 21, the inspection result ID described in FIG. 6(a), and file name data (the "image name" column) of the image data 41. The inspection log data 43 can also be saved as tabular data as shown in FIG. 6(b) in the form of a database or text file. It can be understood that each inspection log 27 indicates the association (correspondence) between the image processing results indicated by the inspection result ID, the image processing unit setting 21, and the image data 41.

[0064] In the example of FIG. 6(b), the information (setting name data) stored in the "product type" column corresponds to "information indicating uniqueness" of the image processing unit setting 21. The inspection result ID corresponds to "information indicating uniqueness" of the inspection result data 42, and also corresponds to storage destination information of the inspection log data 43 when it is saved in the data storage 12. The image file name data corresponds to the image file name saved in a specified folder, and corresponds to information indicating the correspondence between the inspection of the work 2 and the image data 41.

[0065] (Hardware and functional configuration of image management device) FIG. 7 is a block diagram illustrating the hardware configuration of image management device 13 shown in FIG.

[0066] 7, the image management unit 131 of the image management device 13 includes a CPU 1111c, a processing memory 1112c, a main storage device 1113c, a communication unit 1115b, an operation input unit 1116c, and a display control unit 1117c. The components of the image management unit 131 are electrically connected to each other and can communicate with each other. The communication unit 1115c is connected to the image processing device 11 and the data storage 12 so as to be able to communicate with each other.

[0067] An operation signal is input to the operation input unit 1116c from the input device 114c. The display control unit 1117c outputs a control signal to the display device 115c for controlling the display content of the display device 115c.

[0068] Image management device 13 can use display device 115c to display information about image processing device 11 and data storage 12. Image management device 13 also has the function of accepting user input to input device 114c to check data in image processing device 11 and read / write data on data storage 12. Image management device 13 can be configured, for example, by a computer such as a personal computer.

[0069] FIG. 8 shows the functional configuration of the image manager 13.

[0070] The main storage device 1113c stores the evaluation information data 61 and the control program 22c. In Fig. 5, the control program 22c has been read out from the main storage device 1113c and is stored in the processing memory 1112c.

[0071] The evaluation information data 61 corresponds to information indicating the association between the image processing unit settings 21 and the inspection log data 43. The evaluation information data 61 may be a combination of information capable of identifying the uniqueness of each of the image processing unit settings 21 and the inspection log data 43. The information indicating the uniqueness of the inspection log data 43 may be storage destination information when the data is stored in the data storage 12 (for example, "inspection result ID" in FIG. 6(b)), update time information, or a hash value calculated based on an algorithm such as MD5, SHA-1, or SHA-256.

[0072] By loading the control program 22c into the processing memory 1112c, the CPU 1111c of the image management device 13 can operate to execute the functions of the setting selection unit 71, the related log extraction unit 72, the evaluation information recording unit 73, the evaluation information extraction unit 74, the deletion-prohibited image extraction unit 75, and the image deletion unit 76.

[0073] The setting selection unit 71 can communicate with the image processing device 11 via the communication unit 1115c to acquire a list of image processing unit settings 21 of the image processing device 11. For example, an image processing unit setting 21 is set for each model (with different dimensions) of a product to be assembled using the workpiece 2 to be inspected. In this case, different upper and lower limit values ​​(for example, ±3(%) of the design dimension) must be set in correspondence with the dimensions of each model, resulting in multiple image processing unit settings 21.

[0074] The setting selection unit 71 accepts a user selection using the input device 114c while displaying a list of the acquired image processing unit settings 21 on the display device 115c. Based on this user selection, one or more image processing unit settings 21 can be selected from the list of image processing unit settings 21.

[0075] The related log extraction unit 72 communicates with the data storage 12 via the communication unit 1115c to obtain a list of inspection log data 43, and extracts the inspection log data 43 related to the image processing unit setting 21 selected by the setting selection unit 71. In the example of FIG. 6(b), it can be seen that the inspection log data 43 corresponding to the image processing unit setting 21 selected by the setting selection unit 71 can be easily extracted based on the information (setting name data) stored in the "product type" column.

[0076] The evaluation information recording unit 73 creates evaluation information for the combination of the image processing unit setting 21 selected by the setting selection unit 71 and the inspection log data 43 extracted by the related log extraction unit 72. The created evaluation information is recorded as evaluation information data 61 in the main memory device 1113c.

[0077] The evaluation information extraction unit 74 extracts only the evaluation information data 61 corresponding to the image processing unit setting 21 selected by the setting selection unit 71 from the list of evaluation information data 61 stored in the main storage device 1113c.

[0078] The deletion-prohibited image extraction unit 75 communicates with the data storage 12 to obtain a list of the inspection log data 43, and extracts the inspection log data 43 associated with the evaluation information obtained by the evaluation information extraction unit 74. Then, based on the uniqueness information of the image data 41 included in the inspection log data 43, the deletion-prohibited image extraction unit 75 extracts the image data 41 that must not be deleted. For example, based on the uniqueness information of the image data 41 included in the extracted inspection log data 43, the image data 41 corresponding to the uniqueness information can be extracted as "undeletable image data."

[0079] This non-deletable image data 41 is protected and saved so that it will not be deleted even after the inspection of the products to be shipped is completed, for the purpose of recording data important for quality assurance. For example, when changing the settings of the visual inspection device to inspect the products to be shipped, an evaluation sample (a product not to be shipped) is used to confirm that there are no problems with the settings in advance. At this time, the image data 41 used for confirmation when changing the settings (image processing unit settings 21) used to inspect the products to be shipped is extracted as non-deletable image data 41 and protected so that it will not be accidentally deleted and will be saved.

[0080] The image deletion unit 76 communicates with the data storage 12 to acquire a list of image data 41. Then, it instructs the data storage 12 to delete at least a portion (partial or all) of the remaining image data 41, excluding the image data 41 that must not be deleted and that has been extracted by the deletion-prohibited image extraction unit 75. When deleting only a portion of the image data 41, the image data 41 can be selectively deleted in order from the oldest image until the data volume corresponding to the remaining capacity of the storage medium has been deleted. Alternatively, it is also possible to select the image data 41 to delete according to the number of days that have passed since the image was captured.

[0081] (Explanation of the operation flow of the image processing device) Next, an example of the operation when the image management system according to this embodiment is used will be described. The image management system according to this embodiment is operated by four operations, namely, automatic driving, setting of the image processing unit, registration of evaluation information, and deletion of images, the flowcharts of which are shown in Figures 9 to 12.

[0082] 9 is a flowchart explaining the automatic operation of the image management system. The automatic operation is performed using the image processing device 11 in operation mode and the data storage 12. In the automatic operation, each work 2 conveyed in sequence by the conveying device 4 is photographed, and a quality inspection is automatically performed.

[0083] First, in step (hereinafter simply referred to as "S") 11a, the image processing device 11 in the driving mode uses the setting reading unit 31 to read the image processing unit settings 21 into the image processing unit 111. For example, the settings to be read can be selected using the input device 114a with a list of available settings displayed on the display device 115a. This sets the image processing unit settings 21 to be used in the driving mode (autonomous driving).

[0084] Thereafter, the image processing device 11 repeats the processes from S13 to S17 until the end of the autonomous driving is selected in S12. In S12, the autonomous driving can be ended in response to an input from the input device 114a, for example.

[0085] In S13, the image processing device 11 uses the image reading unit 32 to control the image input unit 1114 to acquire the image 23 from the camera 112. Furthermore, in S14a, an evaluation process of the image 23 is executed. Specifically, in S14a, image processing is performed on the image 23 using the image processing unit 33, thereby acquiring feature quantities 24. Furthermore, the judgment unit 34 judges whether the acquired feature quantities 24 are good or bad, thereby creating a judgment result 25.

[0086] In S15, the image processing device 11 uses the feature quantity 24 and the determination result 25 created in S14a to create the inspection result 26 using the inspection result creation unit 35. Furthermore, the created inspection result is output to the data storage 12, etc. Also, in S15, the image processing unit settings 21 used in the inspection (image processing) in S14a are also recorded.

[0087] In S16, the image processing device 11 uses the image saving unit 36 ​​to output the image 23 acquired in S14a to the data storage 12 as image data 41 for saving. Furthermore, in S17, the image processing device 11 uses the inspection log creating unit 37 to output to the data storage 12 an inspection log 27, which is information indicating the relationship (correspondence) between the settings selected in S11 (image processing unit settings 21), the inspection results 26 created in S15, and the image data 41 saved in S16.

[0088] 9, the process of S11a corresponds to an embodiment of the "parameter setting process," the process of S13 corresponds to an embodiment of the "imaging process," and the process of S14a corresponds to an embodiment of the "image evaluation process." Similarly, the process of S15 corresponds to an embodiment of the "processing result recording process" and the "parameter recording process," the process of S16 corresponds to an embodiment of the "workpiece image recording process," and the process of S17 corresponds to an embodiment of the "inspection log recording process."

[0089] In addition, in the data storage 12, an embodiment of a "processing result data saving process" is executed in response to S15, an embodiment of an "image data saving process" is executed in response to S16, and an embodiment of an "inspection log saving process" is executed in response to S17.

[0090] FIG. 10 is a flowchart illustrating the setting of the image management system, specifically, the parameter adjustment operation. The parameter adjustment operation is performed using the image processing device 11 and data storage 12 in the setting mode, separately from the automatic driving operation of FIG. 9. In the setting of the image management system (parameter adjustment operation), the inspection criteria (e.g., the upper limit of the area of ​​an abnormal part when it is deemed a "good product"), the image processing conditions for the inspection (e.g., which color components to extract from the image), and the imaging conditions (e.g., the camera exposure time and the brightness of the lighting) are set to suit the inspection object and the inspection content. The images to be used in such adjustment operations are selected in advance and stored in the data storage 12 in advance.

[0091] The image processing device 11 loads the image processing unit settings 21 into the image processing unit 111 in S11a, which is similar to S11a in FIG. 9. The processing of S11ba, like S11a, corresponds to one embodiment of the "parameter setting processing." Then, in S21, the image processing device 11 communicates with the data storage 12 using the image reading unit 32 to select and load an image 23 (also referred to as an "evaluation image") to be used for evaluation in the adjustment operation. For example, the selection of the evaluation image in S21 can be performed by selecting it using the input device 114a with a list of available settings displayed on the display device 115a. The image selected in S21a may be one image or multiple images.

[0092] In S22, the image processing device 11 uses the setting change unit 38 to change (edit) the image processing unit settings 21 set in S11b. For example, first, a list of setting items is displayed on the display device 115a, and a selection is accepted by the input device 114a. Then, a list of settings available for the selected setting item is displayed again on the display device 115a, and the input device 114a is operated to select the image processing unit settings 21 after the change in S22. Furthermore, in S22, at least some of the numerical values ​​or settings of the parameters constituting the read image processing unit settings 21 may be adjusted by operating the input device 114a. One embodiment of the "parameter change process" is realized by S22.

[0093] In S23, the image processing device 11 determines NO in S23 and repeats the processes of S24 and S14b until all of the evaluation images selected in S21 have been evaluated, that is, until there are no images that have not been processed in S24 and S14b after performing S22. One embodiment of the "parameter evaluation process" is realized by the processes of S24 and S14b.

[0094] In S24, the image processing device 11 uses the image reading unit 32 to read one evaluation image for which the processing in S14b has not yet been performed from the data storage 12. In S14b, the same evaluation processing as in S14a (FIG. 9) is performed on the evaluation image selected in S24.

[0095] The image processing device 11 evaluates all the evaluation images selected in S21 and the result of S23 is YES. If this is determined, the process proceeds to S25. In S25, it is determined whether or not the end of parameter adjustment has been selected, and if it has been selected (YES in S25), the process proceeds to S26. If not (NO in S25), the process returns to S22, and it becomes possible to change the image processing unit setting 21 again. Here, the end of parameter adjustment in S25 can be selected by input from the input device 114a, for example.

[0096] In S26, the image processing device 11 uses the setting recording section 39 to write the changed image processing unit setting 21 into the main storage device 1113a.

[0097] 11 is a flowchart explaining the operation of registering evaluation information in the image management system. The operation of registering evaluation information is executed using the image processing device 11 in setting mode, the data storage 12, and the image management device 13. In this registration operation, evaluation information data 61 is registered based on the image processing unit settings 21 and inspection log data 43 from past autonomous driving.

[0098] In S31a, the image management device 13 uses the setting selection unit 71 to select an image processing unit setting 21, and in S32 uses the related log extraction unit 72 to communicate with the data storage 12 and obtain a list of inspection log data 43. Furthermore, in S32, the inspection log data 43 related to the image processing unit setting 21 selected in S31a is extracted.

[0099] In S33, the image management device 13 uses the evaluation information recording unit 73 to create evaluation information data 61 using the image processing unit setting 21 selected in S31a and the inspection log data 43 extracted in S32, and records the created evaluation information data 61 in the main memory device 1113c. The evaluation information data 61 is information indicating the association (correspondence) between the image processing unit setting 21 and the inspection log data 43. The processing in S33 corresponds to one embodiment of the "evaluation information data recording processing."

[0100] 12 is a flowchart illustrating the image deletion operation of the image management system. The image deletion operation is performed using the data storage 12 and the image management device 13.

[0101] In S31b, the image management device 13 uses the setting selection section 71 to select an image processing unit setting 21, similar to S31a in Fig. 11. Furthermore, in S41, the image management device 13 uses the evaluation information extraction section 74 to extract evaluation information data 61 related to the image processing unit setting 21 selected in S31b.

[0102] In S42, the image management device 13 communicates with the data storage 12 to obtain a list of inspection log data 43. Furthermore, the image management device 13 extracts the inspection log data 43 included in the evaluation information data 61 extracted in S41, and extracts image data 41 that cannot be deleted based on the uniqueness information of the image data 41 included in the inspection log data 43. In this way, deletion-prohibited images are extracted. The processing in S42 corresponds to one embodiment of the "deletion-prohibited image extraction processing."

[0103] In S43, the image management device 13 communicates with the data storage 12 to acquire a list of image data 41, and then generates an instruction by the image deletion unit 76 to delete at least a portion (partial or all) of the acquired image data 41, excluding the image data 41 corresponding to the deletion-prohibited images extracted in S42. In response to this, in the data storage 12, the image data 41 in accordance with the instruction generated by the image deletion unit 76 is deleted by the image deletion unit 54 (FIG. 5), thereby realizing one embodiment of the "image data deletion process."

[0104] Next, an example of the operation of the image processing unit according to this embodiment will be described with reference to Figures 13 to 16. Here, extraction of deletion-prohibited images when the image processing unit settings 21 are changed from a state in which two image processing unit settings 21 for inspecting two products A and B and evaluation information data 61 are recorded is shown.

[0105] FIG. 13 is a table for explaining the contents of each piece of recording data in the initial state before the image processing unit setting 21 is changed.

[0106] 13(a), in this example of the initial state, two image processing unit settings 21 are set: "ProductA_ver000" for product A and "ProductB_ver000" for product B. As shown in FIG. 13(b), data a to e indicating the inspection log 27 are stored as inspection log data 43 indicating the inspection results of products A and B by the image processing device 11. As shown in FIG. 13(b), data a to c and e are data relating to the inspection results of product A, and data d is data relating to the inspection results of product B.

[0107] As explained in FIG. 6(b), each of the data a to e (inspection log 27) is a combination of time data indicating the timing of the inspection, setting name data (column "product type") for identifying the image processing unit setting 21, inspection result ID, and file name data of the image data 41 recorded in the column "image name", or a combination of each uniqueness information.

[0108] Furthermore, in the initial state, as shown in Figure 13(c), four pieces of data corresponding to the combination of the setting name data ("product type") and the inspection result Id of data a to c, e in Figure 6(b) are recorded as evaluation information data 61 for product A.

[0109] On the other hand, in the initial state, as shown in Figure 13(d), one piece of data corresponding to the combination of the setting name data ("product type") of data d in Figure 6(b) and the inspection result Id is recorded as evaluation information data 61 for product B.

[0110] In this initial state, as shown in Figure 13(e), five pieces of image data "Img_00100" to "Img=00104", which correspond to data a to e in Figure 13(b), respectively, are recorded in data storage 12 as image data 41.

[0111] Here, let us consider a case where the image processing unit settings 21 for product A have been changed from the initial state in Fig. 13 by adding an inspection item, etc. When product inspection is performed after the image processing unit settings 21 have been changed, the contents of each recorded data change from Fig. 13 to Fig. 14.

[0112] FIG. 14 is a table for explaining the contents of the recording data in the state after the image processing unit setting 21 is changed.

[0113] As shown in FIG. 14( a ), by adding the inspection standard for product A, “ProductA_ver001” is added as the image processing unit setting 21 for product A.

[0114] In the example of FIG. 14(b), by performing an inspection using the photographed image data "Img_00100" to "Img=00102" (the same as data a to c) of product A with the changed image processing unit settings 21, data f to h are further created as inspection log data 43 in addition to data a to e in FIG. 13(b). Data f to h include the inspection result Id using "ProductA_ver001" for the image data "Img_00100" to "Img=00102" of product A.

[0115] If there are no problems in the inspection of product A using "ProductA_ver001" as the image processing unit setting 21, evaluation information data 61 for product A is added when image data "Img_00100" to "Img=00102" corresponding to data f to h are inspected using "ProductA_ver001", as shown in Figure 14(c).

[0116] In addition, the evaluation information data 61 for product A may be overwritten and updated so that the data in Figure 13(c) is replaced with the data in Figure 14(c), or may be updated in such a way that the existing data in Figure 13(c) is retained and the data in Figure 14(c) is added.

[0117] On the other hand, as shown in FIG. 14(d), the evaluation information data 61 relating to product B, whose image processing unit settings 21 have not been changed, remains the same as the content shown in FIG. 13(d).

[0118] Next, in the state of Fig. 14, it is assumed that "ProductA_ver001" and "ProductB_ver000" are selected in S31b (Fig. 12) as the image processing unit settings 21 used in the image processing device 11 using the evaluation information extraction unit 74. In this case, the selected evaluation information data 61 has the contents shown in Fig. 15.

[0119] As shown in Figure 15, when "ProductA_ver001" and "ProductB_ver000" are selected, evaluation information data 61 including the inspection result Id when product A shown in Figure 14(c) is inspected with "ProductA_ver001", and evaluation information data 61 including the inspection result Id when product B shown in Figure 14(d) is inspected with "ProductB_ver000" are extracted (S41).

[0120] As shown in Figure 14(b), the image data "Img_00103" corresponds to the test result ID "result_20231220_1050" included in the evaluation information data 61 selected in Figure 14(d), and the image data "Img_00100" to "Img_00102" correspond to the test result IDs "result_20231221_0750," "result_20231221_1102," and "result_20231221_1500" selected in Figure 14(c), respectively.

[0121] At this time, the determination result as to whether or not the image data "Img_00100" to "Img_00104" stored in the data storage 12 can be deleted is as shown in FIG.

[0122] Referring to Figure 16, among the image data "Img_00100" to "Img_00104" recorded in the image management device 13, the image data "Img_00100" to "Img_00102" and "Img_00103" corresponding to the inspection results related to the selected evaluation information data 61 ("ProductA_ver001" and "ProductB_ver000") are determined to be image data that cannot be deleted (S42).

[0123] On the other hand, the image data "Img_00104" that does not correspond to the selected evaluation information data 61 can be determined to be "deletable."

[0124] In this way, the image management system according to this embodiment can realize image management that extracts image data 41 related to the image processing unit settings 21 (image processing device setting parameters) selected by the user as undeletable workpiece images from the data storage 12. As a result, from the image data of workpiece images acquired daily in the operation mode (product inspection), images necessary for adjusting the image processing device setting parameters and for guaranteeing processing performance can be automatically extracted as non-deletion targets, and can be retained without effort or error.

[0125] In this embodiment, an example has been described in which the image processing device 11, data storage 12, and image management device 13 that make up the image management system are each configured as individual hardware (computers, etc.), but it is also possible to integrate some or all of the image processing device 11, data storage 12, and image management device 13 and configure the image management system of this embodiment using one or two pieces of hardware (typically, computers).

[0126] <Additional Notes> The present embodiment as described above includes the following technical idea. [Configuration 1] an image processing device (11) having an imaging device (112) for an inspection target workpiece (2); Data storage (12); an image management device (13); the image processing device, the data storage, and the image management device are configured to be able to communicate with each other; The image processing device includes: An imaging process (S13) of capturing a workpiece image (23) by the imaging device; A workpiece image recording process (S16) for storing the workpiece image as image data (41) in the data storage; a parameter setting process (S11a) for setting image processing device setting parameters (21); An image evaluation process (S14a) for acquiring a processing result (25) (21) obtained by performing image processing using the image processing device setting parameters set by the parameter setting process and the workpiece image obtained by the imaging process; a parameter recording process (S15) for storing the image processing device setting parameters used in the image processing in the data storage; a processing result recording process (S15) for storing the processing result in the data storage; an inspection log recording process (S17) for creating an inspection log (27) including information indicating the correlation between the image processing device setting parameters (21), the image data (41), and the processing results recorded in the parameter recording process, and storing the inspection log in the data storage; The data storage an image data storage process for accepting the workpiece image recording process by the image processing device and storing the image data; a processing result data storage process for accepting the processing result recording process performed by the image processing device and storing the processing result; The image processing device is configured to receive the inspection log recording process and execute an inspection log saving process to save the inspection log, The image management device an evaluation information data recording process (S33) for creating and recording evaluation information data (61) that is information indicating the relationship between the image processing device setting parameters (21) and the inspection log (27) for the image processing device setting parameters designated by a user (S31a); an image management system (1) configured to, when receiving an image deletion process accompanied by a user's selection and setting of the image processing device setting parameters (S31b), execute a deletion-prohibited image extraction process (S42) that uses the evaluation information data and the inspection log stored in the data storage to extract, as non-deletable image data, image data related to the image processing device setting parameters selected by the user from the image data stored in the data storage. [Configuration 2] The image management system according to configuration 1, wherein the deletion-prohibited image extraction process (S42) extracts the inspection log (27) related to the image processing device setting parameters selected by the user based on the evaluation information data (61), and extracts the image data (41) indicated by the extracted inspection log as the non-deletable image data. [Configuration 3] The image management system according to configuration 1 or 2, wherein the data storage (12) is further configured to execute an image data deletion process (S43) for deleting at least a portion of the image data (41) stored therein, other than the non-deletable image data extracted by the deletion-prohibited image extraction process (S42), when the image deletion process is received by the image management device (13). [Configuration 4] The image processing device further comprises: a parameter change process (S22) for changing the image processing device setting parameters (21); a parameter evaluation process (S24, S14b) for evaluating the changed image processing device setting parameters based on the evaluation image stored in advance in the data storage (12) and the processing result of the image processing using the changed image processing device setting parameters; 4. The image management system according to any one of configurations 1 to 3, further comprising: a process (S26) of registering the image processing device setting parameters evaluated by the parameter evaluation process as the changed image processing device setting parameters. [Configuration 5] The image processing device setting parameters (21) are: Parameters (211) indicating the setting conditions of the imaging device (112) when capturing the workpiece image (41); Parameters (212) indicating the setting conditions of the image processing; and The image management system according to any one of configurations 1 to 4, further comprising at least one parameter (213) indicating a judgment value for determining whether the work is good or bad based on the feature (24) obtained by the image processing. [Configuration 6] An image processing device (11) having an imaging device (112) of a workpiece (2) to be inspected performs an imaging process (S13) to capture a workpiece image (23) using the imaging device; A step (S16) in which the image processing device executes a workpiece image recording process to store the workpiece image as image data (41) in a data storage (12) that can communicate with the image processing device; a step (S11a) of executing a parameter setting process by the image processing device to set image processing device setting parameters (21); A step (S14a) in which the image processing device executes an image evaluation process to acquire a processing result (25) obtained by executing image processing using the image processing device setting parameters set by the parameter setting process and the workpiece image obtained by the imaging process; a step (S15) of executing a parameter recording process by the image processing device to record the image processing device setting parameters used in the image processing; a step (S15) in which the image processing device executes a processing result recording process of storing the processing result in the data storage; a step (S17) of executing an inspection log recording process in which the image processing device creates an inspection log (27) including information indicating the correlation between the image processing device setting parameters (21), the image data (41), and the processing result (25) recorded in the parameter recording process, and stores the inspection log in the data storage; a step in which the data storage receives the workpiece image recording process performed by the image processing device and executes an image data storage process for storing the image data; a step in which the data storage receives the processing result recording process performed by the image processing device and executes a processing result data saving process for saving the processing result; a step in which the data storage receives the inspection log recording process performed by the image processing device and executes an inspection log saving process to save the inspection log; an image management device capable of communicating with the image processing device and the data storage executes an evaluation information data recording process (S33) for creating and recording evaluation information data (61) that is information indicating the relationship between the image processing device setting parameters (21) and the inspection log (27) for the image processing device setting parameters designated by a user (S31a); An image management method comprising: when the image management device accepts an image deletion process involving a user's selection and setting of the image processing device setting parameters (S31b), a step (S42) of executing a deletion-prohibited image extraction process using the evaluation information data and the inspection log stored in the data storage to extract image data related to the image processing device setting parameters selected by the user from the image data stored in the data storage as image data that cannot be deleted. [Configuration 7] The image management method according to configuration 6, wherein the deletion-prohibited image extraction process (S42) is executed to extract the inspection log related to the image processing device setting parameters (21) selected by the user based on the evaluation information data (61), and to extract the image data (41) indicated by the extracted inspection log as the non-deletable image data. [Configuration 8] The image management method according to configuration 6 or 7, further comprising a step (S43) of executing an image data deletion process when the data storage (12) receives the image deletion process from the image management device (13), in which at least a portion of the image data (41) stored therein is deleted, other than the image data that cannot be deleted and that has been extracted by the deletion-prohibited image extraction process (S42). [Configuration 9] a step (S22) in which the image processing device (11) executes a parameter change process for changing the image processing device setting parameters (S21); a step (S24, S14b) in which the image processing device executes a parameter evaluation process for evaluating the changed image processing device setting parameters based on a processing result of the image processing using an evaluation image previously stored in the data storage (12) and the changed image processing device setting parameters; The image management method according to any one of configurations 6 to 8, further comprising a step (S26) of registering the image processing device setting parameters evaluated by the parameter evaluation process as the image processing device setting parameters after change. [Configuration 10] The image processing device setting parameters (21) are: Parameters (211) indicating the setting conditions of the imaging device (112) when capturing the workpiece image (41); Parameters (212) indicating the setting conditions of the image processing; and The image management method according to any one of configurations 6 to 9, further comprising at least one parameter (213) indicating a judgment value for determining whether the work is good or bad based on the feature (24) obtained by the image processing. [Configuration 11] A program for operating a computer (1111c) as an image management device (13) capable of communicating with an image processing device (11) having an imaging device (112) for a workpiece (2) to be inspected and a data storage (12), The program The program In a state where the data storage stores image data (41) of a workpiece image (23) captured by the image processing device, image processing device setting parameters in the image processing device and a processing result (25) of image processing using the workpiece image, and an inspection log (27) including information indicating the relationship between the image processing device setting parameters (21), the image data, and the processing result used in the image processing, a step (S33) of creating and recording evaluation information data (61) that is information indicating the relationship between the image processing device setting parameters (21) designated by a user (S31a) and the inspection log (43); A program that causes the computer to function so that, when an image deletion process involving a user's selection and setting of the image processing device setting parameters (S31b) is accepted, the computer executes a step (S42) of extracting, from the work images stored in the data storage, work images associated with the image processing device setting parameters selected by the user as non-deletable work images, using the evaluation information data and the inspection log. [Configuration 12] The program The program of configuration 11 causes the computer to function so that, when the image deletion process is received, the computer further executes a step (S43) of instructing the data storage (12) to delete at least a portion of the data images other than the undeletable work images extracted by the extraction step (S42) from among all the work images (41) stored in the data storage (12).

[0127] The embodiments disclosed herein should be considered to be illustrative in all respects and not restrictive. The scope of the present disclosure is defined by the claims, not by the above description, and is intended to include all modifications within the meaning and scope of the claims. [Explanation of symbols]

[0128] 1 Image management system, 2 Workpiece, 4 Conveying device, 5 Sensor, 11 Image processing device, 12 Data storage, 13 Image management device, 21 Image processing unit setting, 22a, 22b, 22c Control program, 23 Image, 24 Feature, 25 Judgment result, 26, Id Inspection result, 27 Inspection log, 31 Setting reading unit, 32 Image reading unit, 33 Image processing unit, 34 Judgment unit, 35 Inspection result creation unit, 36 Image saving unit, 37 Inspection log creation unit, 38 Setting change unit, 39 Setting recording unit, 41 Image data, 42 Inspection result data, 43 Inspection log data, 51 Image recording unit, 52 Result recording unit, 53 Inspection log recording unit, 54, 76 Image deletion unit, 61 Evaluation information data, 71 Setting selection unit, 72 Related log extraction unit, 73 Evaluation information recording unit, 74 Evaluation information extraction unit, 75 Deletion prohibition image extraction unit, 111 image processing unit, 112 camera, 113 lighting device, 114a, 114c input device, 115a, 115c display device, 131 image management unit, 211 device setting, 212 image processing setting, 213 judgment threshold setting, 1112a, 1112b, 1112c processing memory, 1113a, 1113b, 1113c main memory device, 1114 image input unit, 1115a, 1115b, 1115c communication unit, 1116a, 1116c operation input unit, 1117a, 1117c display control unit.

Claims

1. an image processing device having an imaging device for a workpiece to be inspected; Data storage; an image management device; the image processing device, the data storage, and the image management device are configured to be able to communicate with each other; The image processing device includes: An imaging process of capturing a workpiece image with the imaging device; a workpiece image recording process for storing the workpiece image as image data in the data storage; a parameter setting process for setting image processing device setting parameters; an image evaluation process for acquiring a processing result obtained by performing image processing using the image processing device setting parameters set by the parameter setting process and the workpiece image obtained by the imaging process; a parameter recording process for recording the image processing device setting parameters used in the image processing; a processing result recording process for storing the processing result in the data storage; an inspection log recording process is configured to create an inspection log including information indicating a correlation between the image processing device setting parameters recorded in the parameter recording process, the image data, and the processing result, and store the inspection log in the data storage; The data storage an image data storage process for accepting the workpiece image recording process by the image processing device and storing the image data; a processing result data storage process for accepting the processing result recording process performed by the image processing device and storing the processing result; The image processing device is configured to receive the inspection log recording process and execute an inspection log saving process to save the inspection log, The image management device an evaluation information data recording process for creating and recording evaluation information data, which is information indicating the correlation between the image processing device setting parameters designated by a user and the inspection log; An image management system configured to, when receiving an image deletion process involving a user's selection and setting of the image processing device setting parameters, execute a deletion-prohibited image extraction process that uses the evaluation information data and the inspection log stored in the data storage to extract image data related to the image processing device setting parameters selected by the user from the image data stored in the data storage as image data that cannot be deleted.

2. 2. The image management system of claim 1, wherein the deletion-prohibited image extraction process extracts the inspection log related to the image processing device setting parameters selected by the user based on the evaluation information data, and extracts the image data indicated by the extracted inspection log as the non-deletable image data.

3. 2. The image management system of claim 1, wherein the data storage is further configured to, when receiving the image deletion process from the image management device, execute an image data deletion process to delete at least a portion of the image data stored therein, other than the non-deletable image data extracted by the deletion-prohibited image extraction process.

4. The image processing device further comprises: a parameter change process for changing the image processing device setting parameters; a parameter evaluation process for evaluating the changed setting parameters of the image processing device based on a processing result of the image processing using the evaluation image stored in advance in the data storage and the changed setting parameters of the image processing device; 2. The image management system according to claim 1, further comprising a step of registering the image processing device setting parameters evaluated in the parameter evaluation step as the changed image processing device setting parameters.

5. The image processing device setting parameters are: Parameters indicating setting conditions of the imaging device when capturing the workpiece image; Parameters indicating the setting conditions of the image processing; and The image management system according to any one of claims 1 to 4, further comprising at least one parameter indicating a judgment value for determining whether the work is good or bad based on the feature obtained by the image processing.

6. An image processing device having an imaging device for a workpiece to be inspected performs an imaging process of capturing an image of the workpiece using the imaging device; a step in which the image processing device executes a workpiece image recording process in which the workpiece image is stored as image data in a data storage that can communicate with the image processing device; a step of executing a parameter setting process by the image processing device to set image processing device setting parameters; a step in which the image processing device executes an image evaluation process to acquire a processing result of image processing performed using the image processing device setting parameters set by the parameter setting process and the workpiece image obtained by the imaging process; a step of executing a parameter recording process by the image processing device to record the image processing device setting parameters used in the image processing; a step of executing a processing result recording process by the image processing device to store the processing result in the data storage; a step of executing an inspection log recording process by the image processing device to create an inspection log including information indicating the correlation between the image processing device setting parameters recorded in the parameter recording process, the image data, and the processing result, and storing the inspection log in the data storage; a step in which the data storage receives the workpiece image recording process performed by the image processing device and executes an image data storage process for storing the image data; a step in which the data storage receives the processing result recording process performed by the image processing device and executes a processing result data saving process for saving the processing result; a step in which the data storage receives the inspection log recording process performed by the image processing device and executes an inspection log saving process to save the inspection log; an image management device capable of communicating with the image processing device and the data storage executes an evaluation information data recording process for creating and recording evaluation information data, which is information indicating the correlation between the image processing device setting parameters designated by a user and the inspection log; An image management method comprising: when the image management device accepts an image deletion process involving the user selecting and setting the image processing device setting parameters, using the evaluation information data and the inspection log stored in the data storage, executing a deletion-prohibited image extraction process to extract image data related to the image processing device setting parameters selected by the user from the image data stored in the data storage as image data that cannot be deleted.

7. The image management method of claim 6, wherein the deletion-prohibited image extraction process is executed to extract the inspection log related to the image processing device setting parameters selected by the user based on the evaluation information data, and to extract the image data indicated by the extracted inspection log as the non-deletable image data.

8. 7. The image management method of claim 6, further comprising a step of executing an image data deletion process in which, when the data storage accepts the image deletion process by the image management device, it deletes at least a portion of the image data stored therein, other than the non-deletable image data extracted by the deletion-prohibited image extraction process.

9. a step of executing a parameter change process by the image processing device to change the image processing device setting parameters; a step in which the image processing device executes a parameter evaluation process for evaluating the changed image processing device setting parameters based on a processing result of the image processing using an evaluation image stored in advance in the data storage and the changed image processing device setting parameters; 7. The image management method according to claim 6, further comprising the step of registering the image processing device setting parameters evaluated by the parameter evaluation process as the image processing device setting parameters after change.

10. The image processing device setting parameters are: Parameters indicating setting conditions of the imaging device when capturing the workpiece image; Parameters indicating the setting conditions of the image processing; and The image management method according to any one of claims 6 to 9, further comprising at least one parameter indicating a judgment value for determining whether the work is good or bad based on the feature amount obtained by the image processing.

11. A program for operating a computer as an image management device capable of communicating with each of an image processing device having an imaging device for a workpiece to be inspected and a data storage, The program In a state where the data storage stores image data of a workpiece image taken by the image processing device, image processing device setting parameters in the image processing device and a processing result of image processing using the workpiece image, and an inspection log including information indicating the correlation between the image processing device setting parameters, the image data, and the processing result used in the image processing, creating and recording evaluation information data that indicates a relationship between the image processing device setting parameters designated by a user and the inspection log; When an image deletion process involving selection and setting of the image processing device setting parameters by a user is accepted, extracting, from the image data stored in the data storage, image data related to the image processing device setting parameters selected by the user as undeletable image data, using the evaluation information data and the inspection log; A program that causes the computer to execute the above.

12. The program The program of claim 11, further causing the computer to execute a step of instructing the data storage to delete at least a portion of the image data other than the non-deletable image data extracted by the extraction step from all of the image data stored in the data storage when the image deletion process is accepted.

Images