Image processing device, printing system, image processing method, and program

Abstract

To improve efficiency of an inspection of a printed matter.SOLUTION: An image processing device acquires regulation information regulating the priority of each of a plurality of regions in a print image based on printing data, selects the region to be displayed in the plurality of regions in a read image obtained by reading a printed matter printed on the basis of the printing data on the basis of the inspection result and regulation information with respect to the read image, and displays the selected region in the order according to the priority of the selected region.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an image processing device, a printing system, an image processing method, and a program. [Background technology]

[0002] In the printing industry, inspection work is performed after printing to ensure that printed materials delivered to clients are free of defects and of acceptable quality. Printed materials are inspected manually, but this inspection work is costly. For this reason, technologies for automating the inspection of printed materials have been developed. For example, image data of a non-defective printed material (hereinafter referred to as a reference image) is created in advance. Next, image data of the printed material to be inspected (hereinafter referred to as a read image) is acquired by scanning with a reading device or capturing an image with an imaging device. The printed material is then inspected by comparing the reference image with the read image. If the difference between the reference image and the read image exceeds a threshold, the image processing device determines that the printed material has a printing defect.

[0003] If a defective printing area is detected in the scanned image, the scanned image must be discarded and the printed material must be reprinted. However, even if a defective printing area is detected in the scanned image, it may be possible to determine that the printed material is acceptable depending on the location of the defective printing area on the scanned image and the degree of the printing defect. Furthermore, while automating the inspection of printed materials improves inspection efficiency, it requires processing a large number of scanned images. Therefore, when a defective printing area is detected in the scanned image, it is difficult to immediately determine which page and which part of the defective printing area is detected.

[0004] Therefore, Patent Document 1 proposes generating rectangular data including a region of printing defect that has occurred locally on a scanned image, and notifying the user of the region of printing defect in the form of a report, etc. Furthermore, Patent Document 2 proposes improving the efficiency of inspecting printed materials by sequentially displaying detected regions of printing defect in descending order of the difference between a reference image and a scanned image. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Patent No. 6665671 [Patent Document 2] Patent No. 5994698 Summary of the Invention [Problem to be solved by the invention]

[0006] However, a rectangular image containing a localized area of ​​printing defects is generated from the scanned image and notified to the user. Because the rectangular images are uniformly notified to the user, the user must determine which areas of the notified rectangular image should be prioritized for inspection. Furthermore, in Patent Document 2, an image processing device compares a reference image with a scanned image and sequentially displays the areas of printing defects, starting with the most severe. Depending on the type of printed material, some printed materials cannot tolerate even slight printing defects. On the other hand, printing defects in the scanned image may not be considered a problem based on the location of the printing defect area, the nature of the printing defect, and whether post-printing is possible. In this case, a user who understands the printing workflow must determine the degree of printing defects in the areas of printing defects. In conventional technology, in order to determine the degree of printing defects in the areas of printing defects, it was necessary to check the type of printing workflow processing being performed for each scanned image. This could reduce the efficiency of printed material inspection work.

[0007] Thus, there is a problem in that the efficiency of inspecting printed matter is low.

[0008] Therefore, an object of the present invention is to improve the efficiency of inspecting printed matter. [Means for solving the problem]

[0009] In order to achieve the object of the present invention, an image processing device according to one embodiment of the present invention has the following configuration: The image processing device is characterized by comprising: an acquisition unit that acquires specification information that specifies a priority for each of a plurality of regions in a printed image based on print data, and a display control unit that selects, based on an inspection result for the read image and the specification image, an area to be displayed from a plurality of regions in a read image obtained by reading a printed matter printed based on the print data, and displays the selected areas in an order according to the priority of the selected areas. [Effects of the Invention]

[0010] According to the present invention, it is possible to improve the efficiency of inspecting printed matter. [Brief explanation of the drawings]

[0011] [Figure 1] FIG. 1 is a diagram showing an example of the configuration of a printing system. [Figure 2] FIG. 1 is a block diagram showing an example of the functional configuration of an image processing apparatus according to a first embodiment. [Figure 3] FIG. 2 is a schematic diagram of a reference image according to the first embodiment. [Figure 4] 5 is a flowchart illustrating the flow of image processing according to the first embodiment. [Figure 5] FIG. 3 is a schematic diagram illustrating a process for generating a display reference image according to the first embodiment. [Figure 6] 10 is a flowchart illustrating the flow of a reference image generation process. [Figure 7] 10 is a flowchart illustrating the flow of a reference image generation process based on print settings. [Figure 8] 10 is a flowchart illustrating the flow of a reference image update process based on an inspection setting. [Figure 9] 5 is a flowchart illustrating a display image generation process according to the first embodiment. [Figure 10] 5 is a flowchart illustrating a display process for a display image according to the first embodiment. [Figure 11] FIG. 10 is a block diagram showing an example of the functional configuration of an image processing apparatus according to a second embodiment. [Figure 12] 10 is a flowchart illustrating the flow of image processing according to the second embodiment. [Figure 13] FIG. 11 is a schematic diagram of a reference image update process based on image analysis results according to the second embodiment. [Figure 14] 10 is a flowchart illustrating the flow of a reference image update process based on image analysis information. [Figure 15] FIG. 10 is a diagram showing an example of a setting screen displayed on a user interface. DETAILED DESCRIPTION OF THE INVENTION

[0012] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the scope of the claimed invention. Although multiple features are described in the embodiments, not all of these multiple features are necessarily essential to the invention, and multiple features may be combined arbitrarily. Furthermore, in the accompanying drawings, the same reference numerals are used to designate the same or similar components, and redundant explanations will be omitted.

[0013] (First embodiment) The image processing device acquires specification information that specifies a priority for each of multiple regions in a print image based on print data. The image processing device selects an area to display from multiple areas in a read image obtained by reading a printed matter printed based on the print data, based on an inspection result for the read image and the specification information. The image processing device displays the selected areas in an order according to the priority of the selected areas.

[0014] The priority (rank value) specifies the display priority order and is, for example, a real number value equal to or greater than 0. The lower the real number value equal to or greater than 0, the higher the priority. In this embodiment, an area with a rank value of "0" is an area that is not subject to generation of a display image. Therefore, the priority is used taking into account rank values ​​of "1" or greater. This embodiment can be used as a printing system that combines an image processing device, a server, and a printing device.

[0015] 1 is a diagram showing an example of the configuration of a printing system 10. The printing system 10 includes an image processing device 100, a server 180, and a printing device 190. The printing system 10 outputs printed matter based on print data and inspects the printed matter.

[0016] The image processing device 100 includes a CPU 101, a RAM 102, a ROM 103, a storage unit 104, a reading unit 105, an I / F 106, an I / F 107, a display unit 108, a bus 109, a conveying path 110, a paper discharge tray 111, and a paper discharge tray 112. The image processing device 100 inspects a read image obtained by reading an image (printed material) formed by a printing device 190 to determine whether or not there is an area with a printing defect.

[0017] The CPU 101 is a processor that controls each unit in the image processing device 100 in an integrated manner.

[0018] The RAM 102 functions as the main memory and work area of ​​the CPU 101 .

[0019] The ROM 103 stores a group of programs executed by the CPU 101 .

[0020] The storage unit 104 stores applications executed by the CPU 101, data used in image processing, and the like.

[0021] The reading unit 105 reads one or both sides of the printed matter sent from the printing device 190 on the conveying path 110 and converts it into image data (read image). The reading unit 105 is, for example, a line scanner.

[0022] The I / F 106 is an interface that connects the printing device 190 and the image processing device 100. The I / F 106 can synchronize the timing of processing of printed matter with the printing device 190, and mutually communicates the operating status between the printing device 190 and the image processing device 100.

[0023] The I / F 107 is, for example, a serial bus interface such as a USB (Universal Serial Bus) or IEEE 1394. The I / F 107 enables a user to take out data such as logs stored in the image processing apparatus 100 using the USB.

[0024] The display unit 108 is a device that displays various data and includes, for example, a liquid crystal display (LCD). The display unit 108 displays a user interface (UI) on the LCD. The display unit 108 also displays a screen showing the current printing status and print settings. The display unit 108 receives print setting information, including the size and type of paper set by the user, via, for example, a mouse (not shown) and a keyboard (not shown) connected to the I / F 107.

[0025] Bus 109 is a data bus that connects the various components of image processing device 100. CPU 101 issues instructions to the various components within image processing device 100 and printing system 10 via bus 109. For example, CPU 101 transports the printed matter to paper discharge tray 111 or paper discharge tray 112 via transport path 110 based on the inspection results.

[0026] The transport path 110 is connected to a transport path 192 of a printing device 190 .

[0027] The paper output tray 111 is a tray for outputting printed matter that has passed inspection to the outside of the image processing device 100.

[0028] The paper output tray 112 is a tray for outputting printed matter that has failed the inspection to the outside of the image processing device 100.

[0029] The server 180 generates a print job for the printed material to be printed and transmits the print job to the printing device 190 .

[0030] The printing device 190 forms an image on a recording medium (paper) based on a print job received from the server 180. The printing device 190 includes a paper feed unit 191. A user sets print paper in the paper feed unit 191 in advance. When the printing device 190 receives a print job, it transports the print paper in the paper feed unit 191 along a transport path 192 and forms an image on one or both sides of the print paper. The printing device 190 sends the formed image to the image processing device 100 via the transport path 192.

[0031] 2 is a block diagram showing an example of the functional configuration of an image processing device according to the first embodiment. The image processing device 100 includes an analysis unit 200, a setting unit 201, a generation unit 202, an acquisition unit 203, an acquisition unit 204, an inspection unit 205, a storage unit 206, and an update unit 207.

[0032] The analysis unit 200 analyzes the print job received by the printing device 190. The analysis unit 200 may also obtain the print job directly from the server 180.

[0033] The setting unit 201 sets inspection conditions for the read image based on the inspection conditions set by the user via the display unit 108. The setting unit 201, for example, sets an inspection area on the read image and sets the inspection priority (rank value) for the inspection area.

[0034] When a defective printing area is detected from the read image, the generating unit 202 generates a reference image that specifies which area is to be displayed with priority based on the analysis result (print setting) of the print job and the inspection setting.

[0035] The acquisition unit 203 acquires a reference image that serves as a reference for the inspection from the storage unit 104 or the like.

[0036] The acquisition unit 204 acquires a read image to be inspected from the reading unit 105. The read image is an image obtained by reading a printed material on the conveyance path 110 by the reading unit 105.

[0037] The inspection unit 205 compares the reference image with the read image to inspect whether or not the read image contains any areas with printing defects.

[0038] The storage unit 206 stores the inspection results of the image read by the inspection unit 205 .

[0039] The update unit 207 updates the rank value of the area of ​​the reference image based on the reference image and the inspection result of the read image. Furthermore, the update unit 207 generates an area to be displayed (image for display) from the read image based on the updated reference image, and transmits the image for display to the display unit 108. The update unit 207 corresponds to a display control means.

[0040] 3A to 3C are schematic diagrams of a reference image according to the first embodiment.

[0041] 3A, print settings 301 are settings for printing a printed material using the printing device 190. The print settings 301 include setting information such as the printing method (single-sided printing, double-sided printing), layout settings (1-in-1, 2-in-1), paper size (B5, A3), and paper type (plain paper, glossy paper).

[0042] The generation unit 202 generates a reference image 302 and a reference image 303 based on the print settings 301. The reference image 302 corresponds to a scanned image obtained by scanning the front side of the printed material. The reference image 303 corresponds to a scanned image obtained by scanning the back side of the printed material. Here, if the print settings 301 include setting information for single-sided printing and bordered printing, the scanned image will be an area located a predetermined distance inward from the border of the reference image 302 (shown with hatching). Furthermore, since the print settings 301 include setting information for single-sided printing, the reference image 303 will be a white image.

[0043] 3B, print settings 311 are settings for printing a printed material on the printing device 190. The print settings 311 include the same information as the print settings 301.

[0044] Here, when the print settings 311 include information on paper layout settings (2 in 2, binding margin), the reference images 313 and 314 each include two areas. Furthermore, the reference images 313 and 314 each include an area 312 representing the binding margin between the two areas.

[0045] 3(c), print settings 311 are settings for printing a printed material by the printing device 190. The print settings 311 include setting information similar to that of the print settings 301. Furthermore, the generation unit 202 generates a reference image 323 and a reference image 324 based on the print settings 311 and the inspection settings 321.

[0046] Inspection settings 321 include information on inspection areas and inspection details for the inspection areas in reference image 323 and reference image 324. The inspection areas include, for example, five areas: 1. important area, 2. print area, 3. margin, 4. binding margin, and 5. border. The numbers displayed in reference image 323 and reference image 324 correspond to the areas specified in the inspection areas.

[0047] 4 is a flowchart illustrating the flow of image processing according to the first embodiment. The flowchart in FIG. 4 will be described with reference to FIG.

[0048] In S401, the generation unit 202 acquires print settings 311, which are the analysis results of the print job, from the analysis unit 200, and acquires inspection settings 321 from the setting unit 201. The generation unit 202 generates a reference image 323 and a reference image 324 based on the print settings 311 and the inspection settings 321.

[0049] In S402, the acquisition unit 203 acquires a reference image from the storage unit 104. The reference image is an image of a printed matter of acceptable quality read by the reading unit 105. An acceptable printed matter is, for example, a printed matter that is free of stains, or a printed matter that contains stains that do not pose a quality problem.

[0050] The acquisition unit 204 acquires a read image obtained by reading the printed matter using the reading unit 105 .

[0051] The inspection unit 205 detects pixels where the difference between the reference image and the scanned image is greater than a threshold as pixels with a printing defect. If the inspection unit 205 does not detect any pixels with a printing defect from the scanned image, it determines that the quality of the printed matter is acceptable. If the inspection unit 205 detects pixels with a printing defect from the scanned image, it determines that the quality of the printed matter is unacceptable.

[0052] The storage unit 206 stores the inspection results of the image read by the inspection unit 205 .

[0053] In S403, the update unit 207 generates a display image based on the reference image 323 or 324 and the inspection results for the scanned images. The update unit 207 generates a display image from a scanned image whose quality is unacceptable. However, the update unit 207 may generate a display image from all scanned images that have been inspected if there is no impact on the series of inspection processes.

[0054] In S404, the display unit 108 displays the display images on the screen based on conditions such as the number of images to be displayed on the screen. Here, the conditions such as the number of images to be displayed on the screen are set in advance by the user via the display unit 108.

[0055] 5 is a schematic diagram of a process for generating a reference display image according to the first embodiment. The generating unit 202 generates a reference display image 540 based on a print setting 500 and an inspection setting 510.

[0056] The generation unit 202 acquires print settings 500 from the analysis unit 200. The print settings 500 are the results of analysis of the print job by the analysis unit 200. The generation unit 202 generates a print guide image 501 by dividing the scanned image into grid-like regions based on the print settings 500. The generation unit 202 generates the print guide image 501 including 25 (= 5 × 5) regions, for example, based on the paper size of the print settings 500.

[0057] The generation unit 202 generates a printing guide image 502 in which a rank value is set for each area on a printing guide image 501 based on the print settings 500. The rank value is displayed as 1 or 2 on the printing guide image 502.

[0058] The generation unit 202 generates an inspection specification image 511 based on the inspection setting 510 acquired from the setting unit 201. The inspection setting 510 includes information on the inspection area on the read image and information specifying the inspection conditions for the inspection area. The inspection specification image 511 is an image in which the inspection area of ​​the inspection setting 510 is visualized. Area 512 (shown as an oval), area 513 (shown as an oval), and area 514 (shown as a circle) are displayed on the inspection specification image 511. Areas 512 to 514 are areas where inspection is performed on the read image. A rank value of "1" is set for areas 512 and 513. A rank value of "2" is set for area 514.

[0059] The generation unit 202 divides the reference inspection image 511 into 25 (=5×5) regions, similar to the reference printing image 501, to generate the reference inspection image 515. The generation unit 202 generates the reference inspection image 515 based on the rank values ​​of the regions 512 to 514.

[0060] The generation unit 202 generates a composite image 530 by superimposing the reference inspection image 515 on the reference printing image 502. Areas 512, 513, and 514 on the reference inspection image 511 correspond to areas 531, 532, and 533 on the composite image 530, respectively. Area 531 covers six areas on the composite image 530. Area 532 covers two areas on the composite image 530. Area 533 covers one area on the composite image 530.

[0061] The generation unit 202 generates the display reference image 540 by updating the rank values ​​of the areas of the composite image 530 based on the processing in Fig. 8 described below. Note that although the generation unit 202 determines the number of areas of the print reference image 501 based on the paper size of the print settings 500, the generation unit 202 may determine the number of areas and the shape of the areas based on the inspection settings 510. Furthermore, the generation unit 202 may determine the number of areas of the print reference image 501 taking into consideration the size and resolution of the display area of ​​the screen of the display unit 108.

[0062] 6 is a flowchart illustrating the flow of the reference image generation process, which will be described with reference to FIG.

[0063] In S601, the generation unit 202 acquires the print settings 500 from the analysis unit 200. The generation unit 202 acquires print setting information such as paper size (B5, A3, etc.), layout (1 in 1, etc.), and total number of pages.

[0064] In S602 , the generation unit 202 determines the number of areas on the printing reference image 501 based on the printing paper size in the print settings 500 , and generates the printing reference image 501 .

[0065] In S603, the inspection unit 205 determines whether an inspection mode for inspecting the read image is enabled. If the inspection unit 205 determines that the inspection mode is not enabled (No in S603), the inspection unit 205 ends the process without inspecting the read image. If the inspection unit 205 determines that the inspection mode is enabled (Yes in S603), the process proceeds to S604.

[0066] In step S604 , the generation unit 202 sets rank values ​​for the areas of the printing reference image 501 based on the print settings 500 , and generates the printing reference image 502 .

[0067] In S605, the generation unit 202 determines whether or not there is an inspection setting 510 that can be acquired from the setting unit 201. If the generation unit 202 determines that there is an inspection setting 510 that can be acquired from the setting unit 201 (Yes in S605), the process proceeds to S606. If the generation unit 202 determines that there is no inspection setting 510 that can be acquired from the setting unit 201 (No in S605), the process proceeds to S608.

[0068] In S606 , the generation unit 202 generates the inspection specification image 515 based on the inspection setting 510 acquired from the setting unit 201 .

[0069] In S607, the update unit 207 superimposes the reference inspection image 515 on the reference printing image 502 to generate a composite image 530. The update unit 207 updates the rank value of each region of the composite image 530 to generate a reference display image 540.

[0070] In S608, the update unit 207 stores information that associates the rank value of each area of ​​the display reference image 540 with information about each area (for example, the two-dimensional coordinates (X, Y) of each rectangular area) in the storage unit 104. The update unit 207 stores the information in the storage unit 104 in descending order of rank value.

[0071] FIG. 7 is a flowchart illustrating the flow of processing to generate a reference image based on print settings. FIG. 7 shows detailed processing of S604 in FIG. 6. The area on the reference image where toner or ink is recorded is considered to be the area with the highest display priority. The rank value for the area with the highest display priority is the smallest value (e.g., 1). Furthermore, a margin or blank area that remains even after post-processing (e.g., binding) is considered to be the area with the second highest display priority. The rank value for the area with the second highest display priority is the second smallest rank value (e.g., 2). Note that the rank values ​​may be changed depending on the type of printed matter.

[0072] In S701, the analysis unit 200 acquires information on the total number of pages of the printed material based on the print settings 500.

[0073] In S702, the analysis unit 200 acquires layout information such as 1-in-1 based on the print settings 500. The analysis unit 200 acquires information on the total number of printed sheets based on the information on the total number of pages of the printed material and the layout information. For example, if the total number of pages is 10 and the printing is double-sided 1-in-1, the analysis unit 200 calculates the total number of printed sheets to be 10 pages. Also, if the total number of pages is 10 and the printing is double-sided 2-in-1, the analysis unit 200 calculates the total number of printed sheets to be 5 pages.

[0074] In S703, the generation unit 202 sets a rank value of "1" to all areas of the reference printing image 502 for the total number of prints. Here, the generation unit 202 does not refer to layout information, so it sets the same rank value of "1" to all areas of the reference printing image 502.

[0075] In S704, the generation unit 202 determines whether or not it is 1-in-1 printing based on the print settings 500. If the generation unit 202 determines that it is 1-in-1 printing (Yes in S704), the process proceeds to S711. If the generation unit 202 determines that it is not 1-in-1 printing (No in S704), the process proceeds to S705.

[0076] In S705, the generation unit 202 determines whether or not it is 2-in-2 printing based on the print settings 500. If the generation unit 202 determines that it is 2-in-2 printing (Yes in S705), the process proceeds to S706. If the generation unit 202 determines that it is not 2-in-2 printing (No in S705), the process proceeds to S710.

[0077] In S706, the generation unit 202 determines whether the total number of pages of the printing reference image 502 is an odd number based on the print settings 500. If the generation unit 202 determines that the total number of pages of the printing reference image 502 is an odd number (Yes in S706), the process proceeds to S707. If the generation unit 202 determines that the total number of pages of the printing reference image 502 is not an odd number (No in S706), the process proceeds to S711.

[0078] In S707, the generation unit 202 determines whether to insert a blank image on the page next to the final odd-numbered page based on the print settings 500. If the generation unit 202 determines that a blank image is to be inserted (Yes in S707), the process proceeds to S708. If the generation unit 202 determines that a blank image is not to be inserted (No in S707), the process proceeds to S709.

[0079] In S708, the generation unit 202 sets a rank value of "2" to the blank image area. Note that blank images have the same display priority as margin areas. Furthermore, blank images exist in the same double-page spread layout as other non-blank print reference images 502. Therefore, the generation unit 202 may set the same rank value of "1" to the blank image as the print reference image 502. Furthermore, the generation unit 202 may set a rank value of "3" to the margin areas in order to distinguish between blank images and margin areas.

[0080] In step S709, the generation unit 202 sets a rank value of "2" to the blank area in which no blank image has been inserted. The blank area exists in the same double-page spread layout as the reference printing image 502, and therefore has the same rank value as the area of ​​the reference printing image 502.

[0081] In S710, the generation unit 202 sets a rank value to the margin area between one image and another image in aggregate printing such as N-in-1 printing or poster printing such as 1-in-N printing. The generation unit 202 sets a rank value of "2" to the margin area based on the print settings 500.

[0082] In S711, the generation unit 202 determines whether or not an area 312 representing a binding margin exists based on the print settings 500. If the generation unit 202 determines that an area 312 representing a binding margin does not exist (No in S711), the process proceeds to S713. If the generation unit 202 determines that an area 312 representing a binding margin exists (Yes in S711), the process proceeds to S712.

[0083] In S712, the generation unit 202 sets the maximum rank value in the area representing the binding margin on the printing reference image 502. For example, if the maximum rank value in the printing reference image 502 is "2," the generation unit 202 sets the rank value "3" in the area representing the binding margin on the printing reference image 502.

[0084] In S713, the generation unit 202 determines whether or not a bordered area exists in the print image based on the print settings 500. If the generation unit 202 determines that a bordered area does not exist (No in S713), the processing ends. If the generation unit 202 determines that a bordered area exists (Yes in S713), the processing proceeds to S714.

[0085] In S714, the generation unit 202 sets the bordered area to the maximum rank value on the reference printing image 502, and ends the process. For example, if the maximum rank value on the reference printing image 502 is "3," the generation unit 202 sets the bordered area to a rank value of "4."

[0086] 8 is a flowchart illustrating the flow of the reference image update process based on the inspection settings. The flowchart in FIG. 8 will be described with reference to FIG.

[0087] In S801 , the generation unit 202 generates a composite image 530 by superimposing the reference inspection image 515 on the reference printing image 502 .

[0088] In S802, the update unit 207 sets a rank value of "0" to an area (area without overlap) where the area 531, the area 532, and the area 533 do not exist on the composite image 530. Note that a display image, which will be described later, is not generated from an area with a rank value of "0."

[0089] In S803, the update unit 207 sets rank values ​​defined in the reference inspection image 515 to areas (hereinafter referred to as overlapping areas) on the composite image 530 where the areas 531, 532, and 533 exist. Based on the rank values ​​defined in the reference inspection image 515, the update unit 207 sets rank values ​​of "1" to six areas of the area 531 and two areas of the area 532 on the composite image 530, and sets rank value "2" to one area of ​​the area 533, for example.

[0090] In S804, the update unit 207 calculates the overlapping degree of the overlapping region on the composite image 530. The overlapping degree is used to further set a difference in priority for regions having the same rank value on the composite image 530. The update unit 207 uses the area ratios of the regions 512 to 514 in the reference inspection image 511. Note that the update unit 207 may set the priority in the order of the coordinates of the overlapping regions, for example, instead of calculating the overlapping degree.

[0091] For example, based on the reference inspection image 515, the updating unit 207 sets a rank value of "1" to six regions on the composite image 530 that are covered by the region 531. The updating unit 207 calculates the overlapping degree of the region 532 with respect to each of the two regions on the composite image 530 that are covered by the region 532. The overlapping degree is the ratio of the area of ​​the region 532 to one region on the composite image 530. The updating unit 207 also calculates the overlapping degree of the region 531 with respect to each of the six regions on the composite image 530 that are covered by the region 531.

[0092] In S805, the update unit 207 determines whether the overlapping degree of the areas 531 to 533 is equal to or greater than the threshold. If the update unit 207 determines that the overlapping degree of the areas 531 to 533 is equal to or greater than the threshold (Yes in S805), the process proceeds to S807. If the update unit 207 determines that the overlapping degree of the areas 531 to 533 is not equal to or greater than the threshold (No in S805), the process proceeds to S806.

[0093] The update unit 207 executes the process of S805 on the region 531 and the region 532 that have low rank values ​​(for example, 1) on the composite image 530. By executing the process of S805 on the region 531, the update unit 207 classifies the region 531 into three regions, region 534, whose overlapping degree is equal to or greater than the threshold, and three regions, region 535, whose overlapping degree is less than the threshold.

[0094] In S806, the update unit 207 updates the rank value of the region in the composite image 530 whose overlapping degree is not equal to or greater than the threshold. For example, the update unit 207 changes the rank value of the region 535 in which the overlapping degree is not equal to or greater than the threshold from "1" to "2."

[0095] In S807, the update unit 207 sets a rank value for the area in the reference printing image 502 corresponding to an area in the composite image 530 where the degree of overlap is equal to or greater than the threshold. For example, for area 534 where the degree of overlap is equal to or greater than the threshold, the update unit 207 sets a rank value of "1" for the area in the reference printing image 502 corresponding to area 534.

[0096] It is assumed that the update unit 207 sets a rank value for the area 532 having the same rank value as the area 531 using the method of setting the rank value applied to the area 531 .

[0097] In S808, the update unit 207 determines whether the rank value has been updated for another region having the same rank value. If the update unit 207 determines that the rank value has been updated for another region having the same rank value (Yes in S808), the process proceeds to S809. If the update unit 207 determines that the rank value has not been updated for another region having the same rank value (No in S808), the process proceeds to S809.

[0098] In S809, the update unit 207 updates the rank value of the region on the composite image 530 to perform update processing of the rank value of the region having the rank value "2" which has a higher priority than the rank value "1."

[0099] For example, by completing the update of the rank values ​​of the overlapping regions that overlap with region 531 and region 532 on the composite image 530, the update unit 207 does not need to consider the region with a rank value of "1" defined in the reference inspection image 515. Therefore, the update unit 207 can perform update processing on the region with a rank value of "2" defined in the reference inspection image 515. Here, since the update unit 207 has set the rank value of "2" on the display reference image 540, it updates the rank value in S809. Since the rank value setting of region 533 has not yet been processed, the update unit 207 executes the processes from S805 to S808. As a result, the update unit 207 can set the rank value of "3" to the region corresponding to region 533 on the display reference image 540.

[0100] In S810, the update unit 207 determines whether or not the rank values ​​of all regions on the composite image 530 have been updated. If the update unit 207 determines that the rank values ​​of all regions on the composite image 530 have been updated (Yes in S810), the update unit 207 generates the display reference image 540 and ends the processing. If the update unit 207 determines that the rank values ​​of all regions on the composite image 530 have not been updated (No in S810), the processing returns to S804.

[0101] 9 is a flowchart illustrating the display image generation process according to the first embodiment. Details of the display image generation process in S403 in FIG.

[0102] In S901 , the update unit 207 acquires the inspection result of the scanned image by the inspection unit 205 from the storage unit 206 .

[0103] In S902, the update unit 207 determines whether or not there is a defective printing area in the scanned image based on the inspection result. If the update unit 207 determines that there is no defective printing area in the scanned image (No in S902), the process ends. If the update unit 207 determines that there is a defective printing area in the scanned image (Yes in S902), the process proceeds to S903.

[0104] In S903, the update unit 207 determines whether the cause of the printing defect is something other than misalignment based on the inspection results. If the update unit 207 determines that the cause of the printing defect is something other than misalignment (No in S903), the process ends. If the update unit 207 determines that the cause of the printing defect is something other than misalignment (Yes in S903), the process proceeds to S904.

[0105] In S904, the update unit 207 generates, as a display image, an area of ​​the scanned image corresponding to an area having a rank value of "1" or more in the display reference image 540, and stores the display image in the storage unit 104 or the like.

[0106] 10 is a flowchart illustrating the display processing of the display image according to the first embodiment. Details of the display processing in S404 in FIG.

[0107] In S1001, the update unit 207 determines whether or not to display a display image based on the display settings set via the display unit 108. If the update unit 207 determines not to display a display image (No in S1001), the processing ends. If the update unit 207 determines to display a display image (Yes in S1001), the processing proceeds to S1002.

[0108] In S1002, the update unit 207 acquires the display method of the display image based on the display settings set via the display unit 108. Here, the display method refers to, for example, when an area with a printing defect is detected from the scanned image, specifying whether to display all areas in accordance with the priority order based on the display specification image 540 or to display only areas with a high display priority.

[0109] In S1003, the update unit 207 determines whether the display image generated in S904 exists. If the update unit 207 determines that the display image does not exist (No in S1003), the process ends. If the update unit 207 determines that the display image exists (Yes in S1003), the process proceeds to S1005.

[0110] In S1004, the update unit 207 acquires a display image from the storage unit 104.

[0111] In S1005, the update unit 207 displays the display image on the display unit 108, and the process ends.

[0112] As described above, according to the first embodiment, a display guideline image is generated based on print settings and inspection settings. This allows the image processing device to determine the priority of areas to be displayed when an area with a printing defect is detected, based on the display guideline image. According to the first embodiment, by providing the user with images corresponding to areas that should be checked with priority in consideration of the printing workflow, it is possible to improve the work efficiency related to inspecting printed materials.

[0113] (Second embodiment) There are cases where it is desired to check the areas of printing defects in more detail based on the areas of printing defects detected on the scanned image, or to consolidate the areas of printing defects. Therefore, in the second embodiment, a pre-acquired display guide image is updated based on the image analysis results, including information such as images and characters acquired by analyzing the printed image based on the print data, and the inspection results of the scanned image. This allows the user to be presented with the inspection results based on the image analysis results. The second embodiment will explain the differences from the first embodiment.

[0114] 11 is a block diagram showing an example of the functional configuration of an image processing device according to the second embodiment. The image processing device 100 further includes an image analysis unit 1101. The other configuration of the image processing device 100 is the same as that of the first embodiment, and therefore description thereof will be omitted.

[0115] The image analysis unit 1101 analyzes the print data acquired by the analysis unit 200. The image analysis unit 1101 analyzes the print data (PDF, etc.) to be printed by the printing device 190, and acquires object information such as images, characters, and thin lines within the print page.

[0116] FIG. 12 is a flowchart illustrating the flow of image processing according to the second embodiment.

[0117] In S1201, the image analysis unit 1101 acquires print data from the analysis unit 200 and analyzes the image in the print data.

[0118] In S1202, the generation unit 202 generates a display guide image 540 based on the print settings 311 and the inspection settings 321 in the same manner as in the first embodiment.

[0119] In S1203, the inspection unit 205 detects pixels for which the difference between the reference image and the scanned image is greater than a threshold as defectively printed pixels. If the inspection unit 205 does not detect any defectively printed pixels in the scanned image, it determines that the quality of the printed matter is acceptable. If the inspection unit 205 detects any defectively printed pixels in the scanned image, it determines that the quality of the printed matter is unacceptable.

[0120] In S1204, the generation unit 202 updates the rank value of each area of ​​the display reference image 540 based on the image analysis result by the image analysis unit 1101 and the inspection result by the inspection unit 205.

[0121] FIG. 13 is a schematic diagram of the update process of the display reference image based on the image analysis result according to the second embodiment.

[0122] The image analysis unit 1101 analyzes each page included in the print job and obtains the image analysis results for each page. For example, the image analysis unit 1101 obtains the image analysis results for the input image 1300. Based on the image analysis results, the image analysis unit 1101 determines that the input image 1300 is a page including the objects of image 1301 and text 1302. The image analysis unit 1101 sets an identifiable rank value for each object. For example, the image analysis unit 1101 sets "1" to the area of ​​the image 1301 (the area including the cloud and the star), "2" to the area (P1) of the text 1302, and "0" to the other areas. The image analysis unit 1101 generates the image analysis result 1303 in which a rank value is set for each object.

[0123] If an object with text superimposed on it (for example, a cloud and a star) exists in the input image 1300, the image analysis unit 1101 determines that the object is either an image or a text object. The image analysis unit 1101 assigns a rank value of "1" or "2" to the determined object. Alternatively, the image analysis unit 1101 may classify the determined object as a new region and assign a new rank value to the new region.

[0124] Next, the image analysis unit 1101 obtains the inspection result 1310 from the storage unit 206. Based on the inspection result 1310, the image analysis unit 1101 obtains the inspection result 1311, which records the areas with printing defects. The image analysis unit 1101 generates a composite image 1304 that displays only the rank values ​​of the areas in the image analysis result 1303 that correspond to the areas displayed with an "X" in the inspection result 1311, out of the rank values ​​of the areas in the image analysis result 1303. As a result, the image analysis unit 1101 can classify the composite image 1304 into one area storing a rank value of "1" and two areas storing a rank value of "2".

[0125] The update unit 207 generates a display reference image 1305 based on the display reference image 540 and the composite image 1304. For example, the update unit 207 generates a display reference image 1305 that displays only the rank values ​​of the areas of the display reference image 540 that correspond to the rank values ​​of the areas of the composite image 1304, out of the rank values ​​of the areas of the display reference image 540. This allows the image analysis unit 1101 to classify the display reference image 1305 into one area that stores a rank value of "1", one area that stores a rank value of "2", and one area that stores a rank value of "3".

[0126] Next, the update unit 207 acquires object information from the image analysis result 1303, and acquires the type of defect (printing defect) from the inspection result 1311. Based on the object information (image and character) and the type of printing defect (dot, line), the update unit 207 determines whether or not to divide the area for which a rank value is set on the display guide image 1305.

[0127] Specifically, the update unit 207 divides the area in which the rank value is recorded based on whether the number of printing defects in the area in which the rank value is recorded is equal to or greater than a threshold value (for example, 2). Here, in the area with the rank value "1," three dots (shown by ●) indicating printing defects have been detected according to the inspection result 1310. In the area with the rank value "2," two lines (shown by -) indicating printing defects have been detected according to the inspection result 1310. In the area with the rank value "3," one dot (●) indicating printing defects has been detected according to the inspection result 1310. Note that the update unit 207 counts one dot or line as one printing defect.

[0128] For example, if the updating unit 207 determines that the number of printing defects (3) in an area with a rank value of "1" is equal to or greater than a threshold value (e.g., 2), it divides the area with a rank value of "1" into four. If the updating unit 207 determines that the number of printing defects (2) in an area with a rank value of "2" is equal to or greater than a threshold value (e.g., 2), it divides the area with a rank value of "2" into four. If the updating unit 207 determines that the number of printing defects (1) in an area with a rank value of "3" is not equal to or greater than a threshold value (e.g., 2), it refrains from dividing the area with a rank value of "3".

[0129] As a result, the update unit 207 can divide the area with a rank value of "1" or "2" to generate the display reference image 1306. The update unit 207 updates the rank values ​​of two areas having four divided areas on the display reference image 1306 to generate the display reference image 1307. For example, the update unit 207 can update the rank values ​​for a total of eight areas (=2 areas × 4 divided areas) based on the weight information preset for each of the four divided areas or the above-mentioned overlapping degree.

[0130] FIG. 14 is a flowchart illustrating the flow of the reference image update process based on the image analysis information.

[0131] In S1401, the update unit 207 acquires the inspection result 1311 from the storage unit 206.

[0132] In S1402 , the update unit 207 acquires the image analysis result 1303 of the input image 1300 from the image analysis unit 1101 .

[0133] In S1403, the update unit 207 generates a composite image 1304 based on the inspection result 1310 and the image analysis result 1303. The composite image 1304 includes information on only the area where the printing defect occurred.

[0134] In S1404, the update unit 207 determines whether to refer to the display reference image 540 based on whether a generated display reference image 540 exists. If the update unit 207 determines not to refer to the display reference image 504 (No in S1404), the processing ends. If the update unit 207 determines to refer to the display reference image 504 (Yes in S1404), the processing proceeds to S1405.

[0135] In S1405 , the update unit 207 generates a reference display image 1305 based on the reference display image 540 and the composite image 1304 .

[0136] In S1406, the updating unit 207 determines whether to divide the area in which the rank value is recorded, based on whether the rank value of the area on the display reference image 1305 is equal to or greater than a threshold. If the updating unit 207 determines that the rank value of the area on the display reference image 1305 is equal to or greater than the threshold (Yes in S1406), it divides the area on the display reference image 1305. If the updating unit 207 determines that the rank value of the area on the display reference image 1305 is not equal to or greater than the threshold (No in S1406), the processing proceeds to S1408.

[0137] In S1407, the update unit 207 divides into four areas of the display reference image 1305 whose rank value is equal to or greater than the threshold value. The update unit 207 may determine the number of divisions of the area based on the size assigned to one area on the display reference image 1307. Alternatively, the number of divisions of the area may be any value.

[0138] In S1408, the update unit 207 determines whether or not the division determination for the area in which the rank value is recorded on the display reference image 1305 has been completed. If the update unit 207 determines that the division determination for the area in which the rank value is recorded on the display reference image 1305 has been completed (Yes in S1408), the process ends. If the update unit 207 determines that the division determination for the area in which the rank value is recorded on the display reference image 1305 has not been completed (No in S1408), the process returns to S1406.

[0139] 15 is a diagram showing an example of a setting screen displayed on the user interface. The various screens in FIG. 15 are assumed to be displayed on the screen (user interface) of the display unit 108.

[0140] Screen 1501 is a screen for setting the area size when displaying one area on the display specification image 1307. Screen 1501 is a setting screen that is referenced during the processing in S1205 and S1206. Note that screen 1501 may be set automatically based on the size of the display unit 108, etc. The settings for screen 1501 include setting information for the display area size (width, height), defect-specific display settings, enlarged display settings, and inspection result area division settings. A defect has the same meaning as a printing defect.

[0141] Furthermore, when the user selects the defect-specific display setting on screen 1501, the display unit 108 displays screen 1502. When the user selects the enlarged display setting on screen 1501, the display unit 108 displays screen 1503. When the user selects the inspection result area division setting on screen 1501, the display unit 108 displays screen 1504.

[0142] A screen 1502 is a screen for setting an area to be checked from the display reference image 1307. For example, when a check box for a circular defect is checked on the screen 1502, the display unit 108 displays a display image including only an area including a circular defect such as a dot.

[0143] Screen 1503 is a screen for setting the display order and number of defects to be displayed for the detected defects. The display order includes a defect priority method based on the inspection importance and a coordinate priority method used when checking a specific area. The coordinate priority method is a display method in which a specific area is displayed by setting the coordinates of the specific area. Note that if the number of defects detected from the display specification image 1307 is less than the set number to be displayed (e.g., 10), the display unit 108 displays a display image that includes all defects (areas with printing defects).

[0144] A screen 1504 is a screen for setting a division method for the areas of the display reference image 1307. The division method includes setting information regarding, for example, whether or not to perform area division (e.g., ON), the number of defects (e.g., 5), the area inspection level (e.g., 1), and the data category within the area (e.g., image).

[0145] As described above, according to the second embodiment, a reference display image is generated based on the image analysis results of the input image and the inspection results, and one area on the reference display image is divided into multiple areas. This allows the user to view detailed images of important areas from the reference display image, thereby improving the efficiency of work related to the inspection of printed materials.

[0146] (Variation) In the first and second embodiments, the display guide image is generated based on the print settings and the inspection settings. However, for example, if there are consecutive defects in a specific area, the update unit 207 may acquire the print characteristics of the printing device and update the display guide image based on the print characteristics.

[0147] In the second embodiment, the display reference image is generated based on the inspection results and the image analysis results. However, the update unit 207 may use the image analysis results from the initial stage of the display reference image generation process. Furthermore, for example, if a defective (printing defect) area is located near a boundary area of ​​the display reference image, the update unit 207 may reset the rank value of the area based on the position of the defective area.

[0148] Furthermore, the update unit 207 may generate a plurality of display specification images in advance and store the plurality of display specification images in the storage unit 104, etc. In other words, the user can select the display specification image to be used when inspecting the printed matter from the user interface.

[0149] In the above-described embodiment, an example was described in which an image format was used as a reference image when specifying a priority for each of multiple regions in a print image based on print data. However, the priority does not have to be specified using an image format; for example, the priority can be expressed by a position on the image, or the image can be divided into partial regions and represented by a flag indicating the priority. In these cases, instead of directly processing the position information and flags that are the specification information indicating the priority, the information indicating the priority can be obtained to generate a reference image, and then the processing can be performed as in the above-described embodiment.

[0150] (Other Examples) The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0151] The invention is not limited to the above-described embodiments, and various changes and modifications can be made without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention. [Explanation of symbols]

[0152] 10: Printing system, 100: Information processing device, 101: CPU, 102: RAM, 103: ROM, 104: Storage unit, 105: Reading unit, 106: I / F, 107: I / F, 108: Display unit, 109: Bus, 110: Conveying path

Claims

1. an acquisition means for acquiring definition information that defines a priority for each of a plurality of regions in a print image based on print data; a display control means for selecting an area to be displayed from a plurality of areas in a read image obtained by reading a printed matter printed based on the print data, based on an inspection result for the read image and the stipulated information, and displaying the selected area in an order according to the priority of the selected area; An image processing device comprising:

2. an updating unit that updates the priority of each of the plurality of areas defined in the definition information based on an inspection setting when inspecting the read image; 2. The image processing device according to claim 1, wherein:

3. an analysis means for analyzing an object included in the print image; the updating means updates the priority of each of the plurality of areas defined in the defining information based on the analysis result by the analyzing means and the inspection result of the read image.

3. The image processing device according to claim 2.

4. the display control means identifies an area of ​​a printing defect in the scanned image based on an inspection result of the scanned image, selects an area including the area of ​​the printing defect from the plurality of areas in the scanned image, and displays the selected areas in an order according to the priority of the areas.

4. The image processing device according to claim 1, wherein the image processing device is a computer.

5. the display control means does not select an area in the read image that does not include an area with a printing defect based on an inspection result of the read image; 5. The image processing device according to claim 1, wherein the image processing device is a computer.

6. a detection means for detecting a printing defect area on the read image based on whether or not a difference between a reference image serving as a reference for inspecting the read image and the read image exceeds a threshold value; 6. The image processing device according to claim 1, wherein the image processing device is a computer.

7. The print data includes information on a print method, a layout setting, and a paper size.

7. The image processing device according to claim 1, wherein the image processing device is a computer.

8. The inspection setting includes information on an inspection area on the read image and information on inspection details for the inspection area.

3. The image processing device according to claim 2.

9. a user interface for setting the inspection settings and the display settings of the selected area; 9. The image processing device according to claim 8,

10. the display control means displays the selected areas on the user interface in an order according to the priority of the selected areas.

10. The image processing device according to claim 9,

11. the priority of each of the plurality of regions is a real number value equal to or greater than 0; The lower the real number value is, the higher the priority is.

11. The image processing device according to claim 1,

12. a server that receives a print job; a printing device that prints a printed material based on the print job; An image processing device according to any one of claims 1 to 11; A printing system comprising:

13. An image processing method executed by an image processing device, an acquisition step in which acquisition means of the image processing device acquires definition information that defines a priority for each of a plurality of regions in a print image based on print data; a display control step in which a display control means of the image processing device selects an area to be displayed from a plurality of areas in a read image obtained by reading a printed matter printed based on the print data, based on an inspection result for the read image and the stipulated information, and displays the selected areas in an order according to the priority of the selected areas; An image processing method comprising:

14. A program for causing a computer to function as each of the means of the image processing apparatus according to any one of claims 1 to 11.

Images