Information processing device, method for processing information, and program

Abstract

To facilitate selecting a reference image that is suitable for inspection processing.SOLUTION: An information processing device acquires information indicating inspection performance of a reference image that is an inspection standard of a printed matter and displays the reference image and the information indicating the inspection performance thereof together on display means.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to a technique for inspecting a printed matter output by a printing device. [Background technology]

[0002] In the printing industry, prints are inspected for defects to ensure that they are free of defects and of acceptable quality. In recent years, technology to automate inspection work has also been developed. Print inspection involves the use of the difference between two types of images: an image that serves as a quality standard (hereafter referred to as the reference image) and an image of the print to be inspected (hereafter referred to as the inspection image) obtained by scanning the print with a sensor or the like. The data for the reference image is either image data generated by RIP (Raster Image Processor) processing during printing, or image data generated by synthesizing data obtained by scanning multiple prints.

[0003] When inspecting a printed matter, it is necessary to generate reference image data in advance, so it is common to generate multiple reference image data according to print settings and store them in a storage device. Patent Document 1 discloses a technology for storing the frequency of use of a reference image, the date and time of saving, and the date and time of editing in a storage unit together with the reference image. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2020-49899 A Summary of the Invention [Problem to be solved by the invention]

[0005] A user may select a reference image corresponding to an inspection image by referring to information stored together with the reference image. However, in Patent Document 1, even if a reference image containing a defect that is difficult to see visually is used, the frequency of use and date and time information are updated, so that it is difficult to select a reference image suitable for the inspection process.

[0006] Therefore, an object of the present invention is to facilitate the selection of a reference image suitable for inspection processing. [Means for solving the problem]

[0007] In order to solve the above problems, the information processing device of the present invention is characterized by having an acquisition means for acquiring information indicating the inspection performance of a reference image, which is the inspection standard for printed matter, and a display control means for displaying the reference image and the information together on a display means. Effect of the Invention

[0008] According to the present invention, it becomes easier to select a reference image suitable for inspection processing. [Brief description of the drawings]

[0009] [Figure 1] A diagram showing an example of the configuration of a printing system. [Diagram 2] FIG. 1 is a block diagram showing an example of a functional configuration of an information processing device; [Diagram 3] 1 is a flowchart showing a process executed by an information processing device; [Figure 4] A diagram showing an example of a user interface [Diagram 5] A diagram showing an example of a user interface [Figure 6] A flowchart showing a process for updating the rejection rate corresponding to a reference image. [Figure 7] FIG. 1 is a block diagram showing an example of a functional configuration of an information processing device; [Figure 8] 1 is a flowchart showing a process executed by an information processing device; [Figure 9]A flowchart showing a process for calculating information on print position accuracy and image quality defects. [Figure 10] A diagram showing an example of a user interface [Figure 11] A diagram showing an example of a user interface [Figure 12] A diagram showing an example of a user interface DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Each embodiment will be described below with reference to the drawings. Note that the following embodiments do not necessarily limit the present invention. Furthermore, not all of the combinations of features described in each embodiment are necessarily essential to the solution of the present invention.

[0011] [First embodiment] In this embodiment, in an inspection using a reference image that is an inspection standard for printed matter, the reference image and the failure rate corresponding to the reference image are displayed to the user as a set, allowing the user to easily select a reference image suitable for the inspection process while referring to information on past inspection results.

[0012] <Printing system configuration> FIG. 1 is a diagram showing an example of the configuration of a printing system that outputs and inspects a printed matter. The printing system in this embodiment includes an information processing device 100, a printing server 180, and a printing device 190. The printing server 180 generates a print job for a document to be printed, and inputs the print job to the printing device 190. The printing device 190 forms an image on a printing sheet (recording medium) based on the print job input from the printing server 180. The printing device 190 has a paper feed unit 191, and a user sets printing sheets in the paper feed unit 191 in advance. When a print job is input, the printing device 190 forms an image on one or both sides of the printing sheet while conveying the printing sheet set in the paper feed unit 191 along a conveying path 192, and sends the sheet to the information processing device 100.

[0013] The information processing device 100 performs an inspection process to check for defects on a printed material on which an image has been formed and which has been transported along a transport path 192. That is, the information processing device 100 functions as an inspection processing device. The information processing device 100 has a CPU 101, a RAM 102, a ROM 103, a main memory device 104, an image reading device 105, a printing device interface (I / F) 106, a general-purpose I / F 107, a user interface (UI) panel 108, and a main bus 109. Furthermore, the information processing device 100 has a transport path 110 for printed materials connected to the transport path 192 of the printing device 190, an output tray 111 for printed products which have passed the inspection, and an output tray 112 for printed products which have been detected as having defects and have failed the inspection.

[0014] The CPU 101 is a processor that controls each part of the information processing device 100. The RAM 102 is a memory that functions as a work area of ​​the CPU 101. The ROM 103 is a memory that stores a group of programs executed by the CPU 101. The main storage device 104 stores applications executed by the CPU 101 and data used in image processing. The image reading device (scanner) 105 reads one side or both sides of a printed matter sent from the printing device 190 on a conveying path 410 and obtains the read result as image data. The printing device I / F 106 is connected to the printing device 190, and the information processing device 100 and the printing device 190 can synchronize the processing timing of the printed matter and share each other's operating status. The general-purpose I / F 107 is a serial bus interface such as USB or IEEE1394, and allows a user to take out data such as logs. The UI panel 108 is, for example, a liquid crystal display, and functions as a user interface of the information processing device 100 and can display the current status and settings. The UI panel 108 receives instructions from the user via a touch panel or by pressing a button. A main bus 109 connects the various components of the information processing device 100 together.

[0015] The information processing device 100 and each part of the printing system operate in response to instructions from the CPU 101. For example, in response to instructions from the CPU 101, it is possible to synchronously operate a plurality of transport paths, and to switch between sending printed matter to a pass output tray 111 or a fail output tray 112 in response to an inspection result. The information processing device 100 performs an inspection process based on image data of the printed matter read by the image reading device 105 while transporting the printed matter sent from the printing device 190 on the transport path 110. If the printed matter passes the inspection, it is transported to the pass output tray 111, and if not, it is transported to the fail output tray 112. This allows only those whose quality has been confirmed to be collected in the output tray 111 for delivery.

[0016] Although the information processing device 100 in this embodiment includes the image reading device 105 and the UI panel 108, the information processing device 100 is not limited to the above-mentioned configuration. For example, the information processing device 100 is a device having a CPU 101, a RAM 102, a ROM 103, a printing device I / F 106, a general-purpose I / F 107, and a main bus 109, and the image reading device 105, the UI panel 108, etc. may be separate devices.

[0017] <Functional configuration of information processing device> Fig. 2 is a block diagram showing an example of a functional configuration of the information processing device 100. The CPU 101 functions as the functional configuration shown in Fig. 2 by using the RAM 102 as a work memory and reading and executing a program stored in the ROM 103 or the main storage device 104. Note that it is not necessary for all of the processes shown below to be executed by the CPU 101, and the information processing device 100 may be configured so that part or all of the processes are executed by one or more processing circuits other than the CPU 101.

[0018] The information processing device 100 has a print control unit 201, a read control unit 202, an inspection image acquisition unit 203, an inspection result acquisition unit 204, a display control unit 205, an inspection processing unit 206, and a reference image evaluation unit 207. The print control unit 201 inputs document image data in vector format, and converts the document image data into raster data by RIP processing. The print control unit 201 also controls the printing device 190 based on the rasterized document data to form an image on a recording medium. The read control unit 202 controls the image reading device 105 to read one side and both sides of the printed matter on which the image is formed. The inspection image acquisition unit 203 acquires inspection image data representing the image to be inspected based on the result of reading the printed matter.

[0019] The inspection result acquisition unit 204 acquires the inspection results corresponding to each reference image used in the past inspection. The inspection result acquisition unit 204 in this embodiment has a database in which reference image data and inspection results are previously associated with each other, and acquires the inspection results from the database. The inspection result in this embodiment is a failure rate indicating the ratio of failures to the number of inspections using the reference image for each reference image. The database may be owned by another device, and the inspection result acquisition unit 204 may acquire the inspection results from another device via an external interface or a network. The display control unit 205 displays the reference image represented by the reference image data and the failure rate acquired by the inspection result acquisition unit 204 on the UI panel 108 in association with each other. The display control unit 205 also accepts a user instruction to select a reference image via the UI panel 108.

[0020] The inspection processing unit 206 performs an inspection process on the printed matter based on the reference image data and the inspection image data selected by the user. The reference image evaluation unit 207 updates the failure rate corresponding to the reference image used in the inspection process based on the result of the inspection process by the inspection processing unit 206 and the inspection result acquired by the inspection result acquisition unit 204.

[0021] <Processing performed by the information processing device> The flow of processing executed by the information processing device 100 in this embodiment will be described with reference to the flowchart in Fig. 3. The processing shown in the flowchart in Fig. 3 starts when a user inputs an instruction via the UI panel 108 and the CPU 101 accepts the input instruction. Hereinafter, each step (process) will be represented by adding an S before the reference number.

[0022] In S301, the inspection result acquisition unit 204 acquires the failure rate as the inspection result corresponding to each reference image used in the past inspection. Furthermore, the display control unit 205 displays the reference images and the failure rate corresponding to each reference image on the UI panel 108. FIG. 4 is an example of a UI for selecting a reference image. The reference image list 401 is a list that displays the reference images and information assigned to the reference images. Furthermore, in the case where the failure rate corresponding to the reference image has already been calculated, the corresponding failure rate is also displayed in the reference image list 401. The reference image in this embodiment is an image in which the pixel value (RGB value) of each pixel is expressed in 8 bits.

[0023] The reference image list 401 includes an image ID 402, a file name 403, a failure rate 404, a priority button 405, and a setting button 406. The image ID 402 indicates a number for uniquely identifying a combination of a failure rate and a reference image. The file name 403 indicates an image name given to each reference image. The failure rate 404 indicates a failure rate acquired by the inspection result acquisition unit 204. If a failure rate is not registered, N / A is displayed. The priority button 405 is a button for recommending and presenting a reference image with a low failure rate to a user. An example of a display for recommending and presenting a reference image to a user is shown in FIG. 5(a) and FIG. 5(b). FIG. 5(a) is an example in which a reference image with a low failure rate is highlighted, and FIG. 5(b) is an example in which the reference images are sorted based on the failure rate. The highlight display and the sort display may be either one of the two predetermined ones, or may be switched based on a user instruction, or both may be performed. Furthermore, the reference image may be presented by other methods, such as by adding a mark.

[0024] The setting button 406 is a button for setting the reference image selected by the user as the reference image to be used in the inspection process. The image preview 407 is an area for displaying the reference image selected by the user as a preview image. The transition button 408 is a button for transitioning to a setting screen required for acquiring an inspection image. The display control unit 205 receives an instruction regarding the selection of a reference image from the user via the UI panel 108.

[0025] In S302, the print control unit 201 uses the printing device 190 to form an image on a recording medium based on the rasterized original data. The read control unit 202 uses the image reading device 105 to read the printed matter on which the image is formed. The inspection image acquisition unit 203 acquires inspection image data by converting the reading result of the printed matter into digital data. The acquired inspection image data is stored in the main storage device 104. The inspection image in this embodiment is an image in which the pixel value (RGB value) of each pixel is expressed in 8 bits, similar to the reference image. Note that the formats of the reference image and the inspection image are not limited to the above examples, and for example, the pixel value may be a CMYK value or may be expressed in 16 bits.

[0026] In S303, the inspection processing unit 206 generates differential image data representing the difference between the inspection image and the reference image based on the inspection image data and the selected reference image data. The inspection processing unit 206 performs defect detection processing of the inspection image using the generated differential image data. For the defect detection processing, known defect detection processing such as threshold processing and filter processing is used. In S304, the inspection processing unit 206 determines whether the inspection of the printed matter passes or fails based on the presence or absence of defects, and if the inspection passes, the process proceeds to S305, and if the inspection fails, the process proceeds to S306.

[0027] In S305, the inspection processing unit 206 controls the conveying path 110 to discharge the inspected printed matter from the pass output tray 111. In S306, the inspection processing unit 206 controls the conveying path 110 to discharge the inspected printed matter from the fail output tray 112. In S307, it is determined whether or not any printed matter to be inspected remains, and if so, the process returns to S302 to perform a series of processes on new printed matter, and if not, the process proceeds to S308.

[0028] In S308, the reference image evaluation unit 207 refers to the pass / fail information, which is the inspection result output by the inspection processing unit 206, and updates the failure rate corresponding to the reference image used in the inspection. FIG. 6 is a flowchart showing the process of updating the failure rate corresponding to the reference image. For the sake of simplicity, an example will be described in which one reference image is used in the inspection. However, the following process may be performed for each of a plurality of reference images. In S601, the reference image evaluation unit 207 acquires the number of times N that the inspection process was performed using the reference image selected by the user, and the number of times M that the inspection process failed. In S602, the reference image evaluation unit 207 acquires the number of times N1 that the inspection was performed in the past using the reference image selected by the user, and the number of times M1 that the inspection failed in the past, from the database. In S603, the reference image evaluation unit 207 calculates the failure rate A according to formula (1) using the number of times N and the number of times M that the inspection process failed acquired in S601, and the number of times N1 and the number of times M1 that the inspection process failed acquired in S602.

[0029]

number

[0030] In S604, the reference image evaluation unit 207 compares the failure rate A calculated in S603 with the failure rate held in the database, and determines whether the change in the failure rate is equal to or greater than a threshold. If the change in the failure rate is equal to or greater than the threshold, the process proceeds to S605. If the change in the failure rate is less than the threshold, the process proceeds to S606. In S605, the reference image evaluation unit 207 presents the change in the failure rate to the user, and accepts a user instruction via the UI panel 108 as to whether or not to update the failure rate using the current inspection result. If an instruction to update the failure rate is accepted, the process proceeds to S606. If an instruction not to update the failure rate is accepted, the process ends. In S606, the reference image evaluation unit 207 updates the value of the failure rate held in the database with the value of the failure rate A.

[0031] As described above, the information processing device 100 in this embodiment displays a set of reference images and the failure rates corresponding to the reference images to the user, and performs inspection processing of printed matter based on the reference image selected by the user. This allows the user to know the inspection performance of each of the reference images already registered, and to easily identify a reference image with few defects that is suitable for inspection.

[0032] [Second embodiment] In the first embodiment, the failure rate is presented to the user as the inspection result corresponding to the reference image. In this embodiment, the newly registered reference image is evaluated using a read image used to register a new reference image and an image reflecting the printing characteristics of the printing device 190 and the reading characteristics of the image reading device 105 for the manuscript data of the printed matter. Specifically, as the evaluation of the reference image, a value representing the print position accuracy obtained by accumulating the difference in the coordinates of the corresponding points and an accumulated value of the difference representing the image quality defect are calculated. The calculated information on the print position accuracy and the image quality defect are displayed in association with the newly registered reference image, making it easy to select a reference image suitable for the inspection. Hereinafter, an image reflecting the printing characteristics of the printing device 190 and the reading characteristics of the image reading device 105 for the manuscript data of the printed matter is also called a characteristic reflection image.

[0033] In this embodiment, the amount of dirt in the white area of ​​the paper is used as the image quality defect, but the amount of dirt is only one example, and for example, the graininess and sharpness of the image quality evaluation scale, or color reproducibility and gradation, etc. may be used. In this embodiment, the amount of deviation of corresponding characteristic coordinates in the read image and the characteristic reflection image is used as the print position accuracy, but the difference in coordinates calculated using optical flow, etc. may also be used. Since the configuration of the printing system in this embodiment is the same as that in the first embodiment, a description will be omitted. Below, the differences between this embodiment and the first embodiment will be mainly described. The same configurations as those in the first embodiment will be described with the same reference numerals.

[0034] <Functional configuration of information processing device> Fig. 7 is a block diagram showing an example of a functional configuration of the information processing device 100. The CPU 101 functions as the functional configuration shown in Fig. 7 by using the RAM 102 as a work memory and reading and executing a program stored in the ROM 103 or the main storage device 104. Note that it is not necessary for all of the processes shown below to be executed by the CPU 101, and the information processing device 100 may be configured so that part or all of the processes are executed by one or more processing circuits other than the CPU 101.

[0035] The information processing device 100 includes a print control unit 201, a read control unit 202, an inspection image acquisition unit 203, an inspection processing unit 206, a reference image evaluation unit 701, and a display control unit 702. The reference image evaluation unit 701 acquires characteristic reflecting image data representing a characteristic reflecting image and read image data representing a read image. The reference image evaluation unit 701 calculates the amount of misalignment and the amount of dirt in the paper white area by comparing the characteristic reflecting image with the read image. The display control unit 702 displays the reference image generated based on the read image and the amount of dirt and the amount of misalignment calculated by the reference image evaluation unit 701 in association with each other on the UI panel 108.

[0036] <Processing performed by the information processing device> The flow of processing executed by the information processing device 100 in this embodiment will be described with reference to the flowchart in Fig. 8. The processing shown in the flowchart in Fig. 8 starts when a user inputs an instruction via the UI panel 108 and the CPU 101 accepts the input instruction.

[0037] First, a UI displayed in S301 of this embodiment will be described. FIG. 10 is an example of a UI for selecting a reference image. A reference image list 1001 includes a dirt amount 1002, a positional deviation amount 1003, a priority button 1004, and a setting button 1005. The reference image list 1001 displays a reference image and information corresponding to the reference image. Furthermore, when a dirt amount and a positional deviation corresponding to the reference image exist, the reference image list 1001 displays the dirt amount and the positional deviation together. The reference image in this embodiment is an image in which the pixel value (RGB value) of each pixel is expressed in 8 bits. The dirt amount 1002 indicates the dirt amount calculated by the reference image evaluation unit 701. When the dirt amount is not registered, N / A is displayed. The positional deviation amount 1003 indicates the positional deviation amount calculated by the reference image evaluation unit 701. When the positional deviation amount is not registered, N / A is displayed.

[0038] The priority button 1004 is a button for recommending and presenting a reference image with a low amount of dirt or a low amount of positional misalignment to the user. An example of a display for recommending and presenting a reference image to the user is shown in FIG. 11(a) and FIG. 11(b). FIG. 11(a) is an example in which a reference image with a low amount of dirt and a low amount of positional misalignment is highlighted, and FIG. 11(b) is an example in which the reference images are sorted based on the amount of dirt and the amount of positional misalignment. In addition to displaying the amount of dirt and the amount of positional misalignment as numerical values, the amount of dirt and the amount of positional misalignment may be displayed using expressions indicating the degree, such as "normal" and "low" as shown in FIG. 12. The setting button 1005 is a button for setting the reference image selected by the user as the reference image used in the inspection process. The image preview 1006 is an area in which the reference image selected by the user is displayed as a preview image. The transition button 1007 is a button for transitioning to a setting screen required for acquiring an inspection image.

[0039] S302 to S307 are the same processes as in the first embodiment, and therefore the description will be omitted. In S801, the reference image evaluation unit 701 calculates the amount of positional deviation and the amount of dirt in the paper white area by comparing the characteristic reflection image with the read image. Fig. 9 is a flowchart showing the process of calculating information on the print position accuracy and image quality defects.

[0040] In S901, the reference image evaluation unit 701 acquires raster document data generated by the print control unit 201 and read image data obtained by reading an image formed on a recording medium based on the raster document data. The reference image evaluation unit 701 performs a process to reflect the printing characteristics of the printing device 190 and the reading characteristics of the image reading device 105 on the raster document data to generate characteristic reflected image data. The process to reflect the printing characteristics of the printing device 190 and the reading characteristics of the image reading device 105 on the raster document data is color conversion using a look-up table (LUT) generated in advance. In addition to color conversion using the LUT, edge expansion processing and noise addition processing may be performed. The reference image evaluation unit 701 transforms the read image by performing a registration process between the characteristic reflected image and the read image. In addition, a known technique is used for the registration process. In this embodiment, the read image is transformed, but the characteristic reflected image may also be transformed.

[0041] In S902, the reference image evaluation unit 701 calculates the amount of positional deviation P between the read image S and the read image T after deformation according to the formula (2).

[0042]

number

[0043] Here, the scanned image S(x, y) represents the horizontal position x and the vertical position y of the coordinates having a characteristic structure on the scanned image, and the scanned image T(x 1 ,y 1) represents the position of the deformed scanned image T corresponding to the scanned image S. DIST(u,w) represents the process of calculating the distance between two points u and w on the two-dimensional data, and a known formula such as Euclidean distance is used as the specific formula for calculating the distance.

[0044] In S903, the reference image evaluation unit 701 uses equation (3) based on the characteristic reflection image C to generate Mask(x, y) as a mask for classifying areas in the image into print areas and non-print areas. Note that in this embodiment, "1" is assigned to non-print areas and "0" is assigned to print areas, but the value assignment is not limited to this and other values ​​may be used.

[0045]

number

[0046] In S904, the reference image evaluation unit 701 calculates the amount of dirt in the non-printing region using the deformed read image T(x, y) and Mask(x, y) according to formulas (4) and (5), where th represents a preset threshold value.

[0047]

number

[0048] In S905, the reference image evaluation unit 701 registers the deformed scanned image as a new reference image in the database together with the positional deviation amount and the dirt amount calculated in S902 and S904. When registering the deformed scanned image, correction processes such as color conversion, thin line correction, and local distortion correction may be appropriately performed.

[0049] As described above, the information processing device 100 in this embodiment displays a reference image and the amount of dirt and the amount of positional misalignment corresponding to that reference image as a set to the user, and performs inspection processing of the printed matter based on the reference image selected by the user. This allows the user to know the inspection performance of multiple reference images, including the newly registered reference image, and to easily identify a reference image with few defects that is suitable for inspection.

[0050] <Modification> In the first embodiment, the inspection result corresponding to the reference image is displayed together with the reference image, and in the second embodiment, the information on the print position accuracy and image quality defects corresponding to the reference image is displayed together with the reference image, but the two embodiments may be combined. In this case, the inspection result, the print position accuracy, and the information on the image quality defects may be comprehensively evaluated and highlighted or sorted. Even if the inspection result of the reference image exists and the processing of the first embodiment can be performed, if the failure rate is difficult to distinguish overall, the processing of the second embodiment may be performed. Also, the user may be allowed to switch between the processing of the first embodiment and the processing of the second embodiment.

[0051] In the first embodiment, the failure rate is displayed as the inspection result, but the number of failures may be displayed instead, in which case the failure rate calculation process becomes unnecessary.

[0052] Information indicating the inspection performance (rejection rate, amount of dirt, etc.) corresponding to the reference image for each type of defect, such as linear defects or point defects, may be displayed. This makes it easier to select an inspection image suitable for the detection process of the type of defect to be detected.

[0053] [Other embodiments] The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions. [Explanation of symbols]

[0054] 100 Information processing device 204 Test Results Acquisition Department 205 Display control unit 701 Reference Image Evaluation Unit 702 Display control unit

Claims

1. An acquisition means for acquiring information indicating an inspection performance of a reference image which is an inspection standard for a printed matter; a display control means for causing a display means to display the reference image and the information together; 13. An information processing device comprising:

2. 2 . The information processing apparatus according to claim 1 , wherein the display control means causes the display means to display a plurality of the reference images together with the information corresponding to each of the plurality of reference images.

3. The information processing apparatus according to claim 1 , wherein the information indicates a result of an inspection using the reference image.

4. 4. The information processing apparatus according to claim 3, wherein the information is information regarding failure in an inspection using the reference image.

5. The information processing apparatus according to claim 4 , wherein the information indicates a ratio of failures to the number of inspections using the reference image.

6. 2. The information processing apparatus according to claim 1, wherein the acquisition means acquires the information based on a difference between a scanned image of a printed material that is the source of the reference image and an image in which the printing characteristics of a printing device and the reading characteristics of a reading device are reflected in an original image.

7. The information processing apparatus according to claim 1 , wherein the information indicates an image quality defect corresponding to the reference image.

8. The information processing apparatus according to claim 1 , wherein the information indicates a print position accuracy corresponding to the reference image.

9. A program for causing a computer to function as the information processing device according to any one of claims 1 to 8.

10. Obtaining information indicating the inspection performance of a reference image, which is the inspection standard for printed matter; displaying the reference image and the information together on a display means; 23. An information processing method comprising:

Images