Information processing apparatus, information processing method, and program

Abstract

To perform inspection of defects in a printed matter in which a print image is printed on a transparent substrate, where an appearance of the printed matter when being attached to a destination to be attached is taken into consideration.SOLUTION: An information processing apparatus for performing inspection of a printed matter using a transparent substrate as a recording medium comprises: attachment destination setting means for setting attachment destination information representing surface information of a destination object to which the printed matter is attached; and defect detection means for detecting defects in an inspection image obtained by reading a printed image on the recording medium using the attachment destination information.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present invention relates to the inspection of printed matter. [Background technology]

[0002] One method for inspecting defects in printed matter is to use the difference between reference image data and image data obtained by reading the printed matter using a sensor, etc. Patent Document 1 describes a method for inspecting printed matter by taking into consideration the color of the underlying base layer (release paper). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2020-134598 Summary of the Invention [Problem to be solved by the invention]

[0004] A transparent substrate is sometimes used as a recording medium for printed matter. When a printed matter with a printed image on a transparent substrate is attached to a product package or the like, defects may not be noticeable depending on the color of the surface to which it is attached. The method described in Patent Document 1 cannot inspect for defects while taking into account how the printed matter will look when attached to a product package or the like.

[0005] Therefore, an object of the present invention is to take into consideration how the printed matter will look when attached to a target surface when inspecting defects in a printed matter in which an image is printed on a transparent substrate. [Means for solving the problem]

[0006] The present invention is an information processing device for inspecting printed matter using a transparent substrate as a recording medium, characterized by having a destination setting means for setting destination information representing surface information of an object to which the printed matter is to be pasted, and a defect detection means for using the destination information to read the printed image on the recording medium and detect defects in the resulting inspection image. [Effects of the Invention]

[0007] According to the present invention, when inspecting a printed matter in which a print image is printed on a transparent substrate, it is possible to take into consideration how the printed matter will look when attached to a target. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating inspection of a printed matter. [Figure 2] FIG. 1 is a diagram illustrating an example of the overall configuration of a print inspection system. [Figure 3] FIG. 2 is a diagram illustrating an example of a functional configuration of an image processing apparatus. [Figure 4] 10 is a flowchart showing an image inspection process. [Figure 5] FIG. 10 is a diagram showing a display example of an inspection UI. [Figure 6] FIG. 10 is a diagram illustrating an example of a color information file. [Figure 7] FIG. 10 is a diagram showing an example of an inspection result. [Figure 8] 10 is a flowchart showing details of a second inspection process. [Figure 9] FIG. 10 is a diagram illustrating an example of a color conversion table. [Figure 10] FIG. 10 is a diagram showing a display example of an inspection UI. [Figure 11] 10 is a flowchart showing details of a second inspection process. [Figure 12] FIG. 2 is a diagram illustrating an example of a functional configuration of an image processing apparatus. [Figure 13] 10 is a flowchart showing an image inspection process. [Figure 14] FIG. 10 is a diagram showing a display example of an inspection UI. [Figure 15] 10 is a flowchart showing details of the inspection process of the corrected image. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, embodiments of the present invention will be described with reference to the drawings. Note that the following embodiments do not limit the present invention, and not all of the combinations of features described in the embodiments are necessarily essential to the solution of the present invention.

[0010] [Embodiment 1] First, the inspection of printed matter in this embodiment will be described with reference to FIG. FIG. 1(a) shows an example of a printed matter to be inspected in this embodiment. As shown in FIG. 1(a), a picture 102, which is an example of a printed image, is printed on a transparent substrate 101. When the printed matter of FIG. 1(a) is used to attach to an object, the surface of the object to which the printed matter is attached is visible through the transparent area, which is the non-printed region of the printed matter. The object is, for example, a product package. In this embodiment, when the printed matter is used to attach to an object, inspection is performed taking into account color information of the object's surface that is visible through the non-printed region. Note that in this embodiment, attaching to an object is a concept that includes all of superimposing on the object, wrapping, packaging, and covering or installing for protection of the object.

[0011] In the printout of FIG. 1(a), there is a defect 104 in the print area and defects 103 and 105 in the non-print area. Here, defect 103 is a defect caused by a cyan colorant, and defect 105 is a defect caused by a yellow colorant. Also, FIGS. 1(b) and 1(c) show the results of reading pixel values ​​along a horizontal line 106 on the printout of FIG. 1(a). The vertical axis of FIGS. 1(b) and 1(c) represents pixel values ​​(0 to 255), and the horizontal axis represents the position on the horizontal line 106. Pixel value 107 corresponds to image 102, and pixel value 108 corresponds to defect 103.

[0012] FIG. 1(b) shows a case where the background color of the non-print area is a single white color. Pixel value 109 corresponds to the single white color. In FIG. 1(b), there is a large contrast difference between pixel values ​​108 and 109, making defect 103 easy to see. On the other hand, FIG. 1(c) shows a case where the background color of the non-print area is a single blue color. Pixel value 110 corresponds to the single blue color. In FIG. 1(c), there is a small contrast difference between pixel values ​​108 and 110, making defect 103 less noticeable.

[0013] In this embodiment, attention is focused on the characteristic that the appearance of defects in non-printed areas changes depending on the color tone of the non-printed areas, as described above, and defects are detected in the inspection image obtained by reading a printed material using a transparent substrate using color information on the surface to which the printed material is pasted.

[0014] 2 is a diagram showing the overall configuration of a print inspection system that outputs and inspects printed matter, including an image processing device 200 according to embodiment 1. The print inspection system includes the image processing device 200, a printing server 280, and a printing device 290.

[0015] The printing server 280 inputs manuscript data of the print product to the printing device 290. The manuscript data input to the printing device 290 is output to the image processing device 200. The image processing device 200 creates RIP data for printing an image from the manuscript data of the print product and provides this to the printing device 290 as a print job. The printing device 290 forms an image on a recording medium based on the RIP data provided from the image processing device 200. A transparent substrate is used as the recording medium. In this embodiment, roll paper is used as the recording medium, but cut paper may also be used. The printing device 290 can use printing methods such as inkjet printing and electrophotography. In this embodiment, the printing device 290 is an inkjet printing device. The printing device 290 has a paper feed unit 291. The paper feed unit 291 holds roll paper previously set by the user so that it can rotate around a horizontal axis, and unwinds and supplies the roll paper to the printing device 290. When a print job is input, the printing device 290 conveys roll paper set in a paper feed unit 291 , forms an image on one or both sides of the recording medium, and sends it to the image processing device 200 .

[0016] The image processing device 200 inspects a recording medium (printed matter) on which printing has been performed by the printing device 290. The image processing device 200 is an example of an information processing device. The printed matter is obtained by the printing device 290 forming an image on a recording medium, and is transported from the printing device 290 to the image processing device 200 through a transport path 210 inside the image processing device 200.

[0017] The image processing device 200 has a CPU 201, a RAM 202, a ROM 203, an auxiliary storage device 204, an image reading device 205, a printing device I / F (interface) 206, a general-purpose I / F 207, a UI panel 208, and a main bus 209. The image processing device 200 also has a paper discharge unit 211 that winds up printed materials. The paper discharge unit 211 winds up printed materials printed by the printing device 290 around a horizontal axis.

[0018] The CPU 201 comprehensively controls each unit within the image processing device 200. The CPU 201 also comprehensively controls the entire print inspection system including the image processing device 200. The RAM 202 functions as the main memory, work area, etc. of the CPU 201. The ROM 203 stores a group of programs executed by the CPU 201. The auxiliary storage device 204 stores various data used in image inspection processing in addition to the group of programs executed by the CPU 201.

[0019] The image reading device 205 reads one or both sides of the printed material sent from the printing device 290 on the conveying path 210 and acquires the read image data. The acquired read image data may be temporarily saved in a buffer area on the RAM 202, or may be stored in the auxiliary storage device 204. From the read image data acquired by the image reading device 205, an inspection image to be used for defect detection is created. The printing device I / F 206 is connected to the printing device 290, and the image processing device 200 can communicate with the printing device 290 via the printing device I / F 206. For example, by synchronizing the printing device 290 and the image processing device 200 via the printing device I / F 206, the printing device 290 and the image processing device 200 acquire each other's operating status. Furthermore, the image processing device 200 may communicate with the printing server 280 via the printing device 290 via the printing device I / F 206. For example, the image processing device 200 acquires manuscript data of the printed matter from the printing server 280. The image processing device 200 may also acquire color information of the destination to which the printed matter will be pasted, the transmittance of a transparent substrate used as a recording medium, and the like.

[0020] The general-purpose I / F 207 is a serial bus interface such as USB or IEEE1394, and allows the user to retrieve various data such as logs and input various data to the image processing apparatus 200. The UI panel 208 is, for example, a liquid crystal display, and functions as a user interface for the image processing device 200. The UI panel 208 displays information related to the current status and settings of the print inspection system, as well as inspection results. The UI panel 208 also displays a reference image used for comparison with the inspection image, inspection images that have passed inspection because no defects were detected, and inspection images that have failed inspection because defects were detected. Note that the classification of printed matter may be configured to be more detailed than just two types, pass or fail. The UI panel 208 may also be equipped with an input device such as a touch panel, a mouse, or buttons, and may receive instructions from the user. The main bus 209 is a transmission path that connects the modules of the image processing device 200 .

[0021] The CPU 201 performs image inspection processing to determine whether or not there are defects based on an inspection image created from image data read by the image reading device 205 while the recording medium sent from the printing device 290 is being transported along the transport path 210. The results of the image inspection processing may be temporarily stored in the RAM 202 and then stored in the auxiliary storage device 204. The results of the image inspection processing can be used to sort the printed matter based on whether it passed or failed the inspection in subsequent processes such as cutting the roll paper and removing waste from label paper.

[0022] 3 shows a functional configuration diagram of an image processing device 200 according to this embodiment. The image processing device 200 has a print image creation unit 301, an image reading unit 302, a reference image creation unit 303, a first inspection processing unit 304, a paste destination information setting unit 305, a second inspection processing unit 306, and an inspection result output unit 307. The image processing device 200 functions as each unit shown in FIG. 3 by the CPU 201 loading a program stored in the ROM 203 or the like into the RAM 202 and executing the program.

[0023] The print image creation unit 301 creates RIP data from the original data of the print obtained from the printing server 280 via the printing device I / F 206 and the printing device 290, and controls the printing device 290 to print an image based on the RIP data to create the print.

[0024] The image reading unit 302 creates an inspection image from read image data obtained by reading the printout printed by the print image creation unit 301 with the image reading device 205 . The reference image creation unit 303 creates a reference image using RIP data created from the original data of the printed matter. Alternatively, the reference image creation unit 303 may create a reference image from an inspection image obtained by the image reading unit 302. The method for creating the reference image can be arbitrarily specified by the user.

[0025] The first inspection processing unit 304 receives the inspection image created by the image reading unit 302 and the reference image created by the reference image creation unit 303, and detects defects in the inspection image based on the difference between the reference image and the inspection image. It then outputs first inspection result information, which is detection information on defects in the inspection image.

[0026] Paste destination information setting unit 305 sets color information of the paste destination of the printed matter created by print image creation unit 301. In this embodiment, paste destination information setting unit 305 displays a UI for setting paste destination information on UI panel 208, and sets color information of the paste destination based on information specified on the UI in response to a user operation from an input device. Paste destination information setting unit 305 is an example of a paste destination setting means. The second inspection processing unit 306 receives the first inspection result information from the first inspection processing unit 304 and the color information set by the paste destination information setting unit 305, and outputs the inspection result obtained by adding the paste destination information to the defect detection information in the inspection image as second inspection result information. The first inspection processing unit 304 and the second inspection processing unit 306 are examples of defect detection means. The test result output unit 307 outputs the first test result information from the first test processing unit 304 and the second test result information from the second test processing unit 306. The test result output unit 307 may display the test results, which are a combination of the first test result information from the first test processing unit 304 and the second test result information from the second test processing unit 306, on the UI panel 208 or may store them in the auxiliary storage device 204.

[0027] 4 is a flowchart showing image inspection processing executed by the image processing device 200 according to this embodiment. The processing of this flowchart is realized by the CPU 201 loading a program stored in the ROM 203 into the RAM 202 and executing it. In the following description, each process (step) is represented by adding an S to the beginning, and the notation of the process (step) is omitted.

[0028] In S401, the reference image creation unit 303 inputs RIP data created from original data of a printed matter or an inspection image, performs correction processing according to the input data, creates a reference image, and stores it in the auxiliary storage device 204 or the like. In this embodiment, the reference image is in 8-bit RGB format. When RIP data is input, correction processing includes color conversion, fine line correction, and local distortion correction processing. When an inspection image is input, correction processing includes alignment processing and noise removal processing. Various parameters required for correction processing may be set based on user operations on the UI panel 208.

[0029] In S402, paste destination information setting unit 305 sets color information as paste destination information. The paste destination information is set based on information specified by a user operation on the inspection UI. FIG. 5 shows an example of the inspection UI. CPU 201 controls the display of the inspection UI on UI panel 208. As shown in FIG. 5, the inspection UI is provided with an image display area 501 that displays an inspection image, etc., an inspection mode selection area 520, an inspection level setting area 530, and a paste destination information setting area 540.

[0030] The image display area 501 is an area where an inspection image is displayed. Note that a reference image may also be displayed in the image display area 501. In this inspection image, a pattern 502 is printed, and it can be seen that a defect 503 has occurred in an area other than the pattern 502 (non-printed area). The inspection mode selection area 520 is an area for selecting whether or not to perform the second inspection process. By checking the check box 504, it is possible to set to perform both the first inspection process and the second inspection process. By unchecking the check box 504, it is possible to set to perform only the first inspection process without performing the second inspection process.

[0031] The inspection level setting area 530 is an area for setting the detection sensitivity level for each inspection item in the first inspection process. In the inspection level setting area 530, the user can set the inspection level 505 for spot defects, the inspection level 506 for vertical streaks, the inspection level 507 for horizontal streaks, and the inspection level 508 for density changes.

[0032] The paste destination information setting area 540 is an area for specifying paste destination information. When the user presses button 516, it becomes possible to select a color information file to be used for specifying the paste destination color information. A plurality of color information files are pre-stored in the auxiliary storage device 204, and the color information file selected by the user is read out. The file name 509 displays the file name of the color information file selected by the user.

[0033] FIG. 6 shows an example of a color information file. In this embodiment, the case where tristimulus XYZ values ​​are used as color information is described, but spectral radiance or the like may also be used. The label name 601 represents an arbitrary character string assigned to each combination of XYZ values ​​and transmittance. The tristimulus X value 602, the tristimulus Y value 603, and the tristimulus Z value 604 represent the XYZ values ​​as color information of the destination. The transmittance 605 represents the transmittance of the recording medium used for printing.

[0034] The paste destination information setting unit 305 displays information on the combination of XYZ values ​​and transmittance specified in the color information file in the paste destination information setting area 540. Item 510 corresponds to the label name 601. As shown in FIG. 5, item 510 displays a character string (here, "light blue") representing the color information of the paste destination. Item 510 corresponds to the label name 601 specified in the color information file. Item 511 corresponds to the tristimulus value X 602. Item 512 corresponds to the tristimulus value Y 603. Item 513 corresponds to the tristimulus value Z 604. Item 514 corresponds to the transmittance 605. Note that the values ​​of items 511 to 514 may be changed arbitrarily by the user. In this way, the paste destination information setting unit 305 sets the XYZ values ​​and transmittance by specifying the XYZ values ​​and transmittance using the color information file.

[0035] In S403, the image reading unit 302 creates an inspection image from the scanned image data obtained by reading the printout printed by the print image creation unit 301 with the image reading device 205, and stores the image in the auxiliary storage device 204 or the like. In this embodiment, the inspection image is in an RGB 8-bit format. When creating the inspection image from the printout, brightness correction processing, position alignment processing, etc. may be performed to increase the similarity with the reference image.

[0036] In S404, the first inspection processing unit 304 inputs the reference image created in S401 and the inspection image created in S403 and performs defect detection processing on the inspection image. The first inspection processing unit 304 calculates the difference between the reference image and the inspection image, performs defect detection processing on the inspection image based on the detection sensitivity level set in the inspection level setting area 530, and outputs the results of the inspection processing as first inspection result information. Note that in this embodiment, the defect detection processing uses known technology. The first inspection result information includes at least one of information on pixel values ​​of detected defects and coordinate positions of detected defects. The first inspection result information may also include information indicating whether the inspection is passed (OK) or failed (NG) depending on the presence or absence and number of detected defects.

[0037] In S405, the second inspection processing unit 306 receives the XYZ values ​​and transmittance set in S402 and the first inspection result information output in S404, performs a defect detection process on the inspection image, and outputs the result of the inspection process as second inspection result information. Details of the second inspection process executed in this step will be described later with reference to FIG. 8.

[0038] In S406, the CPU 201 determines whether or not there is a defect based on the first inspection result information output in S404 and the second inspection result information output in S405. If the CPU 201 determines that there is a defect, the process proceeds to S407, and if the CPU 201 determines that there is no defect, the process proceeds to S408.

[0039] In S407, the inspection result output unit 307 controls the display of the inspection results on the UI panel 208 based on the first detection result information and the second detection result information. The inspection result output unit 307 also stores the inspection results as a log file in the auxiliary storage device 204, etc. FIG. 7 shows an example of the inspection results. FIG. 7 shows an example of the inspection results for inspection images 1, 2, 3, ..., N. Column 701 shows the file names of the inspection images. Column 702 shows the content corresponding to the first inspection result information. Column 703 shows the content corresponding to the second inspection result information. In S408, the CPU 201 determines whether to end the inspection. If there are any printed materials remaining to be inspected, the CPU 201 decides to continue the inspection, returns to S403, and executes the processes from S403 to S407. If there are no more printed materials remaining to be inspected, the CPU 201 ends the inspection. After that, the series of processes in the flowchart ends.

[0040] FIG. 8 is a flowchart showing the details of the second inspection process executed in S405 of this embodiment. In S801, the second inspection processing unit 306 acquires the first inspection result information output in S404. If the first inspection result information includes a pixel value of a detected defect, the second inspection processing unit 306 acquires the pixel value. If the first inspection result information includes only the coordinate position of the detected defect, the second inspection processing unit 306 acquires the pixel value of the inspection image corresponding to the coordinate position of the detected defect.

[0041] In S802, the second inspection processing unit 306 acquires the XYZ values ​​and transmittance set in S402 and converts them into RGB values ​​by inputting the acquired XYZ values ​​and transmittance into a color conversion table. This makes it possible to reproduce the colors in the non-print area. FIG. 9 shows an example of a color conversion table. In this embodiment, a table such as that shown in FIG. 9 is used to convert four-dimensional data into three-dimensional data. FIG. 9(a) is an example of a table that inputs XYZ values ​​and transmittance and outputs RGB values. FIG. 9(b) is an example of a table that inputs RGB values ​​and transmittance and outputs XYZ values. In this embodiment, an example of converting XYZ values ​​into RGB values ​​will be described.

[0042] In S803, the second inspection processing unit 306 calculates a difference Dn between the representative values ​​(e.g., average, median) (Rn, Gn, Bn) calculated from the pixel values ​​of each defect acquired in S801 and the pixel values ​​(R0, G0, B0) obtained by conversion in S802. When calculating the difference Dn, the second inspection processing unit 306 may consider only defects whose coordinate positions fall within the non-printing area among the defects included in the first inspection result information output in S404, and exclude defects whose coordinate positions fall within the printing area. Whether the coordinate positions of the defects fall within the printing area or the non-printing area can be determined based on the amount of color material ejected at each coordinate position in the RIP data used to create the reference image in S401. For example, a mask image created by the corrected image inspection processing unit 1201 of the second embodiment, described later, may be used. In S804, the second inspection processing unit 306 compares the difference Dn calculated in S803 with a predetermined threshold th and determines whether it is smaller than the threshold th. If the second inspection processing unit 306 determines that it is smaller than the threshold th, the process proceeds to S805, and if it determines that it is equal to or greater than the threshold th, the process proceeds to S806. The threshold th may be a preset value or a value separately specified by the user.

[0043] In S805, the second inspection processing unit 306 outputs the result of the second inspection processing as passed (OK), after which the process proceeds to S406 in FIG. In S806, the second inspection processing unit 306 outputs the result of the second inspection processing as inspection failure (NG), after which the process proceeds to S406 in FIG.

[0044] According to the first embodiment, when inspecting a printed matter in which a printed image is printed on a transparent substrate, defects can be detected taking into consideration the color that will become the background color when the printed matter is attached. This allows defects that become less noticeable when attached, and even printed matter that would have failed inspection when compared with the background color at the time of reading can be made to pass the inspection, thereby suppressing a decrease in yield.

[0045] (Variation 1) In the first embodiment described above, the case where the color information of the paste destination is a single color has been described. In this modified example, a method of acquiring multiple pieces of color information as paste destination information and executing the second inspection process will be described.

[0046] The image inspection process according to this modification can use the same flowchart as in FIG. 4, but the process in S402 is different. In this modification, in S402, paste destination information setting unit 305 sets a plurality of pieces of color information as paste destination information. In this modification, the paste destination information is set based on information specified by a user operation in the inspection UI shown in Fig. 10. The inspection UI shown in Fig. 10 is provided with a paste destination information setting area 1000 that is different from paste destination information setting area 540 of the inspection UI shown in Fig. 5.

[0047] When the user presses button 1001 in paste destination information setting area 1000, the user can specify an image file that holds color information for the paste destination. A plurality of image files are pre-stored in auxiliary storage device 204, and the image file specified by the user is read out. File name 1002 displays the file name of the image file specified by the user. Image display area 1003 displays color image data for the image file specified by the user. Color image data areas 1004, 1005, and 1006 each display different color information. Note that item 1007 displays the transmittance held by the image file specified by the user. In this manner, paste destination information setting unit 305 sets color image data.

[0048] 11 is a flowchart showing details of the second inspection process executed in S405 of this modified example. In the flowchart of FIG. 11, steps S1101 and S1102 are executed instead of steps S802 and S803 of FIG. In S1101, the second inspection processing unit 306 acquires pixel values ​​(R0(x, y), G0(x, y), B0(x, y)) at each coordinate position in the color image data from the color image data set in S402. Here, R0() represents the pixel value of the R channel, G0() represents the pixel value of the G channel, and B0() represents the pixel value of the B channel. Furthermore, (x, y) represent the position in the horizontal direction x and the position in the vertical direction y. In this embodiment, a case will be described in which an image file having RGB values ​​as color information is specified. Furthermore, it is assumed that the acquired pixel values ​​(R0(x, y), G0(x, y), B0(x, y)) have already been converted by transmittance.

[0049] In S1102, the second inspection processing unit 306 acquires the coordinate position of each defect and its pixel value (Rn(x,y), Gn(x,y), Bn(x,y)), and the pixel value (R0(x,y), G0(x,y), B0(x,y)) of each coordinate position of the color image data. The second inspection processing unit 306 then calculates the difference Dn(x,y) between corresponding coordinates, and calculates the average value of the differences for each defect based on the calculated difference Dn(x,y). In the subsequent processing of S804, the average value of the differences calculated in S1102 is compared with a predetermined threshold value th.

[0050] According to the above-described first modification, it is possible to deal with cases where the destination contains multiple color information. As a result, even if the color of the destination product package or the like varies depending on the position, it is possible to detect defects by taking into account the color that will become the background color when the printed matter is pasted.

[0051] [Embodiment 2] In the first embodiment, a method for determining the presence or absence of a defect using first inspection result information and paste destination information was described. In this embodiment, a method for correcting a reference image and an inspection image and determining the presence or absence of a defect using the corrected reference image and corrected inspection image will be described. In the following, a description of the same parts as in the first embodiment will be omitted, and the description will focus on the parts that are different from the first embodiment.

[0052] 12 shows a functional configuration diagram of an image processing device 200 according to this embodiment. The image processing device 200 has a print image creation unit 301, an image reading unit 302, a reference image creation unit 303, a paste destination information setting unit 305, an inspection result output unit 307, and a corrected image inspection processing unit 1201. The print image creation unit 301, the image reading unit 302, the reference image creation unit 303, the paste destination information setting unit 305, and the inspection result output unit 307 are the same as those in the first embodiment, and therefore description thereof will be omitted.

[0053] The corrected image inspection processing unit 1201 receives as input the inspection image created by the image reading unit 302, the reference image created by the reference image creation unit 303, and the paste destination information set by the paste destination information setting unit 305. It then creates a corrected reference image using the reference image and the paste destination information. The corrected image inspection processing unit 1201 also calculates a correction value from the corrected reference image and the reference image, and creates a corrected inspection image using the calculated correction value and the inspection image. Note that the corrected inspection image may be created using the inspection image and the paste destination information in the same manner as the corrected reference image was created. The corrected image inspection processing unit 1201 detects defects in the inspection image based on the difference between the corrected reference image and the corrected inspection image, and outputs an inspection result, which is information on the detection of defects in the inspection image. The corrected image inspection processing unit 1201 is an example of a defect detection means.

[0054] Fig. 13 is a flowchart showing image inspection processing executed by the image processing device 200 according to this embodiment. Compared to the flowchart in Fig. 4, the flowchart in Fig. 13 executes S1301 instead of S404 and S405. Furthermore, the image inspection processing according to this embodiment differs in the processing of S402.

[0055] In this embodiment, in S402, the paste destination information setting unit 305 sets one or more pieces of color information as paste destination information. In this embodiment, the paste destination information is set based on information specified by a user operation on the inspection UI shown in FIG.

[0056] Fig. 14(a) shows an example of the inspection UI when a single color is set as the paste destination information. The inspection UI shown in Fig. 14(a) is provided with image display areas 1401 and 1403, which are different from the image display area 501 of the inspection UI shown in Fig. 5. Image display area 1401 is an area for displaying a reference image. The reference image is a schematic representation of an image in which a pattern 1402 is printed on a recording medium. Image display area 1403 is an area for displaying an inspection image. In this inspection image, a pattern 1404 is printed, and it can be seen that a defect 1405 has occurred in an area other than the pattern 1404 (non-printed area).

[0057] Fig. 14(b) shows an example of the inspection UI when multiple colors are set as paste destination information. The inspection UI shown in Fig. 14(b) is provided with image display areas 1406 and 1408, which are different from image display area 501 of the inspection UI shown in Fig. 10. Image display area 1406 is an area for displaying a reference image. The reference image is a schematic representation of an image in which a pattern 1407 is printed on a recording medium. Image display area 1408 is an area for displaying an inspection image. In this inspection image, a pattern 1409 is printed, and it can be seen that a defect 1410 has occurred in an area other than the pattern 1409 (non-printed area). In this embodiment, the paste destination information setting unit 305 sets the XYZ values ​​and the transmittance using the inspection UI shown in FIG. 14(a) or FIG. 14(b).

[0058] Next, the processing of S1301 will be described. In S1301, the corrected image inspection processing unit 1201 creates a corrected inspection image and a corrected inspection image from the reference image created in S401 and the inspection image created in S403, using the paste destination information set in S402. Then, the difference between the corrected reference image and the corrected inspection image is calculated, and defect detection processing is performed on the inspection image based on the detection sensitivity level set in the inspection level setting area 530, and the results of the inspection processing are output as inspection result information. Details of the inspection processing performed in this step will be described using FIG. 15.

[0059] FIG. 15 is a flowchart showing details of the inspection process executed in S1301 in this embodiment. In S1501, the corrected image inspection processing unit 1201 creates a mask image that classifies the area into a print area and a non-print area using the following formula (1) based on the amount of color material ejected from the RIP data used when creating the reference image in S401. In this embodiment, the mask image is created by treating the correction area as the non-print area and assigning "0" to the non-print area and "1" to the print area, but this is not the only method that can classify the reference image into a print area and a non-print area.

[0060]

number

[0061] In S1502, the corrected image inspection processing unit 1201 creates a corrected reference image using the following formula (2) based on the reference image created in S401 and the XYZ values ​​and transmittance set in S402.

[0062]

number

[0063] Furthermore, the corrected image inspection processing unit 1201 calculates the correction amount Coeff(x, y, c) for correcting the reference image to the corrected reference image using the following formula (3). Note that the following formula (3) is an example of a formula for calculating the correction amount. The corrected image inspection processing unit 1201 may calculate the correction amount using an addition operation or a table.

[0064]

number

[0065] In S1503, the corrected image inspection processing unit 1201 creates a corrected inspection image using equation (4) based on the inspection image acquired in S403 and the correction amount Coeff(x, y, c) calculated in S1502.

[0066]

number

[0067] In S1504, the corrected image inspection processing unit 1201 calculates the difference between the corrected reference image created in S1502 and the corrected inspection image created in S1503, performs defect detection processing on the inspection image based on the detection sensitivity level set in S402, and outputs inspection result information. Note that in this embodiment, the defect detection processing uses known technology. Thereafter, processing proceeds to S406 in FIG. 13.

[0068] The CPU 201 may perform control to display the corrected reference image created in S1502 in the image display area 1401 or 1406 of the inspection UI. The CPU 201 may also perform control to display the corrected inspection image created in S1503 in the image display area 1403 or 1408 of the inspection UI. Then, in S1504, a detection sensitivity level set in the inspection UI on which the corrected reference image and the corrected inspection image are displayed may be used to perform defect detection processing on the inspection image. This allows the user to set the detection sensitivity level according to how the image will look when attached.

[0069] According to the second embodiment, when inspecting a printed matter having a printed image printed on a transparent substrate, defects can be detected using a corrected reference image and a corrected inspection image that are corrected taking into account the color that will become the background color when the printed matter is attached. This allows for defects that become less noticeable when attached, making it possible to pass even printed matter that would have failed inspection when compared with the background color at the time of reading, thereby suppressing a decrease in yield. Furthermore, the detection sensitivity level set for all printed matter other than transparent substrates can be used as is. In other words, there is no need to separately set parameters such as the threshold value th used in the second inspection process in the first embodiment, thereby reducing the burden on the user in setting the detection sensitivity level.

[0070] In the above-described embodiments, color information is used as the paste destination information. However, the paste destination information is not limited to color information as long as it is surface information of the object to which the paste destination is to be applied. For example, specular reflection information and information representing surface roughness of the object surface may be used as the paste destination information. When the intensity of the specular reflection component is high, the diffuse reflection component indicating the surface color becomes difficult to see due to the influence of the specular reflection component. Furthermore, the paste destination information may be set as a combination of color information and information representing specular reflection and surface roughness. Even when specular reflection information and information representing surface roughness are used, defects that become less noticeable when pasted can be considered to be acceptable defects, thereby suppressing a decrease in yield.

[0071] Furthermore, for example, a bump map representing the unevenness of the object surface may be used as the paste destination information. Concave portions are less noticeable than convex portions, and the intensity of the reflected component is reduced, making defects less visible. Furthermore, both color information and map information representing the unevenness may be set as the paste destination information. Even when a bump map representing the unevenness of the paste destination is used, defects that become less noticeable after pasting can be considered as acceptable defects, thereby suppressing a decrease in yield.

[0072] (Other embodiments) The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0073] The disclosure of each of the above-described embodiments includes the following configurations, methods, and programs. (Configuration 1) An information processing device that inspects printed matter using a transparent substrate as a recording medium, a paste destination setting means for setting paste destination information representing surface information of an object to which the printed matter is to be pasted; a defect detection means for detecting defects in an inspection image obtained by reading the printed image on the recording medium using the paste destination information; An information processing device comprising: (Configuration 2) The defect detection means a first detection means for detecting defects in the inspection image based on a difference between the reference image of the printed matter and the inspection image; a second detection means for detecting defects in the inspection image based on the paste destination information and the detection result by the first detection means; 2. The information processing device according to configuration 1, comprising: (Configuration 3) 3. The information processing device according to configuration 1 or 2, wherein the paste destination information is one or more pieces of color information. (Configuration 4) 4. The information processing device according to any one of configurations 1 to 3, wherein the paste destination information is image data. (Configuration 5) The information processing device according to configuration 2, wherein the second detection means determines whether or not there is a defect by using a difference between a pixel value of the defect detected by the first detection means and a pixel value represented by the paste destination information. (Configuration 6) The paste destination information is image data, The information processing device according to configuration 2, wherein the second detection means determines the presence or absence of a defect by using a difference between a pixel value of the defect detected by the first detection means and a pixel value of the image data corresponding to the position of the defect. (Configuration 7) The information processing device according to configuration 5, wherein the second detection means determines the presence or absence of a defect by using a difference between a pixel value of the defect detected by the first detection means and a pixel value calculated from the attachment destination information and the transmittance of the transparent base material. (Configuration 8) The information processing device described in any one of configurations 5 to 7, characterized in that the second detection means targets defects detected in non-printing areas among the defects detected by the first inspection means, and does not target defects detected in printing areas. (Configuration 9) The information processing device described in configuration 1 is characterized in that the defect detection means creates a corrected reference image corrected based on the paste destination information and the reference image, and a corrected inspection image corrected based on the paste destination information and the inspection image, creates the corrected inspection image, and detects defects in the inspection image based on the difference between the corrected reference image and the corrected inspection image. (Configuration 10) 10. The information processing apparatus according to configuration 9, wherein the defect detection means subjects non-printing areas to correction and not printing areas to correction. (Configuration 11) a setting unit for setting a detection sensitivity level used by the defect detection unit through a user operation on a UI screen; 11. The information processing apparatus according to configuration 9 or 10, wherein the setting means displays at least one of the corrected reference image and the corrected inspection image on the UI screen. (Configuration 12) 12. The information processing device according to any one of configurations 1 to 11, wherein the paste destination information includes specular reflection information or information representing surface roughness of the object surface. (Configuration 13) 13. The information processing device according to any one of configurations 1 to 12, wherein the paste destination information includes map information that represents unevenness on the surface of the object. (method) An information processing method for inspecting a printed matter using a transparent substrate as a recording medium, comprising: a paste destination setting step of setting paste destination information representing surface information of an object to which the printed matter is to be pasted; a defect detection step of detecting defects in an inspection image obtained by reading the printed image on the recording medium using the paste destination information; An information processing method comprising: (program) A program for causing a computer to function as each means of the information processing device according to any one of configurations 1 to 13. [Explanation of symbols]

[0074] 200: Image processing device, 290: Printing device, 208: UI panel

Claims

1. An information processing device that inspects printed matter using a transparent substrate as a recording medium, a paste destination setting means for setting paste destination information representing surface information of an object to which the printed matter is to be pasted; a defect detection means for detecting defects in an inspection image obtained by reading the printed image on the recording medium using the paste destination information; An information processing device comprising:

2. The defect detection means a first detection means for detecting defects in the inspection image based on a difference between the reference image of the printed matter and the inspection image; a second detection means for detecting defects in the inspection image based on the paste destination information and the detection result by the first detection means; 2. The information processing apparatus according to claim 1, further comprising:

3. 2. The information processing apparatus according to claim 1, wherein the paste destination information is information about one or more colors.

4. 2. The information processing apparatus according to claim 1, wherein the paste destination information is image data.

5. 3. The information processing apparatus according to claim 2, wherein the second detection means determines whether or not a defect exists by using a difference between a pixel value of the defect detected by the first detection means and a pixel value represented by the paste destination information.

6. The paste destination information is image data, 3. The information processing apparatus according to claim 2, wherein the second detection means determines whether or not a defect exists by using a difference between a pixel value of the defect detected by the first detection means and a pixel value of the image data corresponding to the position of the defect.

7. The information processing device according to claim 5, characterized in that the second detection means determines whether or not there is a defect by using a difference between a pixel value of the defect detected by the first detection means and a pixel value calculated from the attachment destination information and the transmittance of the transparent substrate.

8. 7. The information processing apparatus according to claim 5, wherein the second detection means targets defects detected in non-printing areas among the defects detected by the first inspection means, and does not target defects detected in printing areas.

9. The information processing device according to claim 1, characterized in that the defect detection means creates a corrected reference image corrected based on the paste destination information and the reference image of the printed matter, and a corrected inspection image corrected based on the paste destination information and the inspection image, creates the corrected inspection image, and detects defects in the inspection image based on the difference between the corrected reference image and the corrected inspection image.

10. 10. The information processing apparatus according to claim 9, wherein the defect detection means subjects non-printing areas to correction and does not subject printing areas to correction.

11. The method further includes a setting unit for setting a detection sensitivity level used by the defect detection unit through a user operation on a UI screen, 10. The information processing apparatus according to claim 9, wherein the setting unit displays at least one of the corrected reference image and the corrected inspection image on the UI screen.

12. The information processing apparatus according to claim 1 , wherein the paste destination information includes specular reflection information or information representing surface roughness of the object surface.

13. 2. The information processing apparatus according to claim 1, wherein the paste destination information includes map information representing unevenness of the surface of the object.

14. An information processing method for inspecting a printed matter using a transparent substrate as a recording medium, comprising: a paste destination setting step of setting paste destination information representing surface information of an object to which the printed matter is to be pasted; a defect detection step of detecting defects in an inspection image obtained by reading the printed image on the recording medium using the paste destination information; An information processing method comprising:

15. The computer of the information processing device, An information processing device that inspects printed matter using a transparent substrate as a recording medium, a paste destination setting means for setting paste destination information representing surface information of an object to which the printed matter is to be pasted; a defect detection means for detecting defects in an inspection image obtained by reading the printed image on the recording medium using the paste destination information; A program characterized by functioning as

Images