Information processing apparatus, information processing method, and program

The information processing apparatus automatically sets inspection regions by grouping regions based on object types, addressing the challenge of manual correction in existing technologies and enhancing inspection accuracy.

JP2025108047APending Publication Date: 2025-07-23CANON KK
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2024001661
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-01-10
Publication Date
2025-07-23

AI Technical Summary

Technical Problem

Existing technologies struggle to group regions corresponding to characters with inter-character distances greater than a predetermined threshold into a single inspection region, requiring manual correction by users.

Method used

An information processing apparatus that extracts regions based on object types and sets inspection regions by grouping regions that meet specific conditions, allowing for automatic and accurate inspection area setting.

Benefits of technology

Enables the appropriate setting of inspection regions for multiple objects, reducing the need for manual intervention and improving the accuracy of inspections.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025108047000001_ABST
    Figure 2025108047000001_ABST
Patent Text Reader

Abstract

To appropriately set an inspection area corresponding to a plurality of applicable objects.SOLUTION: An information processing apparatus is to inspect a print, and the information processing apparatus comprises: extraction means that extracts a corresponding area for each object on the basis of object types indicated by content information for specifying objects included in the print; and setting means that classifies a plurality of areas matching a condition for grouping, of the plurality of areas extracted by the extraction means, into a group, and sets the group to an inspection area for performing the inspection.SELECTED DRAWING: Figure 12
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to a technique for inspecting printed matter.

Background Art

[0002] An inspection apparatus that reads a printed matter printed by a printing apparatus and inspects the printed matter is known.

[0003] Regarding the setting of an inspection area for performing an inspection, Patent Document 1 discloses a technique for detecting a line drawing area and a photo area from a reference image, discriminating the line drawing area as either a character area or a barcode area, and setting each area as an inspection area. Further, in Patent Document 1, an area corresponding to characters adjacent within a predetermined distance is also grouped into one inspection area.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, in the technology of Patent Document 1, in order to group regions corresponding to a plurality of characters whose inter-character distance is within a predetermined distance, it is not possible to group them into one inspection region corresponding to the entire plurality of characters (objects) whose inter-character distance is farther than the predetermined distance. Therefore, manual correction by the user has occurred. For example, assume that the condition for grouping is that the inter-character distance is 2 mm or less, and in the character string indicating the serial number, the inter-character distance is 2.5 mm. In this case, as shown in FIG. 20(a), it is not possible to group them into one inspection region corresponding to the entire character string "001". Also, assume that the grouping condition is only the inter-character distance. In this case, as shown in FIG. 20(b), it is not possible to group them into one inspection region including both the company logo and the barcode. The present disclosure has been made in view of the above problems.

Means for Solving the Problems

[0006] An information processing apparatus according to an aspect of the present disclosure is an information processing apparatus for inspecting a printed matter, and based on an object type indicated by content information for specifying an object included in the printed matter, extraction means for extracting a region corresponding to each object, and among the plurality of regions extracted by the extraction means, setting means for grouping a plurality of the regions that meet the conditions for grouping and setting them as an inspection region for performing the inspection. It is characterized by comprising.

Effects of the Invention

[0007] According to the technology of the present disclosure, it is possible to appropriately set an inspection region corresponding to a plurality of corresponding objects.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Embodiments for Carrying Out the Invention

[0009] Hereinafter, embodiments for implementing the technology of the present disclosure will be described with reference to the drawings. Note that the following embodiments do not limit the scope of the claims, and not all combinations of features described in the embodiments are essential for the solution of the technology of the present disclosure. Note that each step (step) in the flowchart is denoted by prefixing "S".

[0010] <<Embodiment 1>> FIG. 1 is a schematic diagram showing a configuration example of an inspection system including an inspection apparatus according to this embodiment. The inspection system of this embodiment includes an information processing apparatus 109, an inspection apparatus 108, a printing apparatus 101, and a client computer 110. In this embodiment, the case where the printing apparatus 101 is an electrophotographic printing apparatus will be described. However, it may be a printing apparatus using a different image forming method such as an inkjet method or an offset method. Also, in this embodiment, the inspection apparatus 108 is described as a separate apparatus from the printing apparatus 101. However, the inspection apparatus 108 may be incorporated as a part of the printing apparatus 101.

[0011] The printing apparatus 101 is connected to the information processing apparatus 109 via a cable 112. The information processing apparatus 109 is connected to the client computer 110 via a network 113. The printing apparatus 101 includes a UI panel 102, a paper feed deck 103, and a paper feed deck 104. Further, an optional deck 105 composed of a three-stage paper feed deck is connected to the printing apparatus 101. The printing apparatus 101 is, for example, an electrophotographic printing apparatus. In this embodiment, the UI panel 102 is a user interface including, for example, a capacitance type touch panel. However, it is not limited to this as long as it is a user interface including a display unit and an operation unit where a user can input.

[0012] Furthermore, the printing apparatus 101 includes an inspection unit 106 and a high-capacity stacker 107. The inspection unit 106 is connected to an inspection device 108 via a cable 114. The high-capacity stacker 107 includes a main tray 324 (not shown in FIG. 1) and a top tray 320, and the main tray 324 can stack thousands of sheets of paper at a time. Sheets of paper detected to have defects by the inspection device 108 are discharged onto the top tray 320.

[0013] A print job is generated by a client computer 110, transmitted to an information processing apparatus 109 via a network 113, and managed by the information processing apparatus 109. Then, the print job is transmitted from the information processing apparatus 109 to the printing apparatus 101 through a cable 112, and the printing apparatus 101 performs a process of printing on paper based on the print job. Note that the print job may be generated and managed by the information processing apparatus 109, directly transmitted to the printing apparatus 101 via the cable 112, and managed by the printing apparatus 101.

[0014] Note that the client computer 110, the information processing apparatus 109, and the inspection device 108 may each be connected to the cable 112 so as to be able to communicate with the printing apparatus 101. Also, the inspection device 108 may also be connected to the information processing apparatus 109 and the client computer 110 via the network 113. That is, the connection form of the printing apparatus 101, the information processing apparatus 109, and the client computer 110 shown in this embodiment is an example, and there may be various other connection forms in addition to those shown in this embodiment.

[0015] In addition, the printing apparatus 101 may be connected in a form in which a stapling finisher, a folding machine, a bookbinding machine, etc. other than the inspection unit 106 and the high-capacity stacker 107 are connected.

[0016] Also, the setting process for inspection, which will be described later and is executed by the CPU 226 of the inspection device 108, may be executed by an independent external information processing apparatus.

[0017] (Internal Configuration of Inspection System) Figure 2 is a block diagram showing a hardware configuration example of each of the printing apparatus 101, inspection unit 106, large-capacity stacker 107, inspection apparatus 108, information processing apparatus 109, and client computer 110 that constitute the inspection system.

[0018] (Internal Configuration of Printing Apparatus) The printing apparatus 101 includes a CPU 201, a RAM 202, a UI panel 203, a paper feed deck I / F 204, a storage unit 205, a video I / F 206, an NW I / F 207, an accessory I / F 208, an engine I / F 209, and a printer engine 210. Each part of the printing apparatus 101 is connected to each other via a system bus 212.

[0019] The CPU 201 is a Central Processing Unit, which controls and performs calculations in each part within the printing apparatus 101 via the system bus 212. The CPU 201 controls the execution of programs stored in the storage unit 205 and loaded into the RAM 202.

[0020] The RAM 202 is a Random Access Memory, which is a type of general-purpose volatile memory that can be directly accessed by the CPU 201, and is used as a work area for the CPU 201 or other temporary data storage areas. The storage unit 205 functions as a temporary storage area and a work memory during the operation of the printing apparatus 101.

[0021] The engine I / F 209 controls the communication and control between the CPU 201 and the printer engine 210. The paper feed deck I / F 204 controls the communication and control between the CPU 201 and the paper feed deck 211. The paper feed deck 211 is a general term for the hardware configurations of the paper feed decks 103, 104, and option deck 105 in FIG. 1. The UI panel 203 is the hardware configuration of the UI panel 102 in FIG. 1, and is a user interface for performing all operations of the printing apparatus 101. In this embodiment, the UI panel 203 is provided with a capacitive touch panel.

[0022] The NW I / F 207 is a network interface that is connected via a cable 213 to the NW I / F 238 (to be described later) of the information processing apparatus 109 and controls the communication between the information processing apparatus 109 and the printing apparatus 101. In the present embodiment, the NW I / Fs 207 and 238, which are interfaces connected to the system buses 212 and 239, are directly connected. However, for example, they may be connected via a network or the like, and the connection form is not limited. The video I / F 206 is connected via a video cable 241 to the video I / F 233 (to be described later) and controls the communication of image data between the information processing apparatus 109 and the printing apparatus 101.

[0023] Note that the connection interface between the information processing apparatus 109 and the printing apparatus 101 may take a form that integrates the functions of the NW I / F 238 and the video I / F 233. Also, the connection interface between the printing apparatus 101 and the information processing apparatus 109 may take a form that integrates the functions of the NW I / F 207 and the video I / F 206.

[0024] The accessory I / F 208 is connected via a cable 225 to the accessory I / Fs 214 and 220 (to be described later). That is, the printing apparatus 101 communicates with the inspection unit 106 and the large-capacity stacker 107 via the accessory I / Fs 208, 214, and 220.

[0025] (Internal Configuration of Inspection Unit) The inspection unit 106 includes an accessory I / F 214, an inspection apparatus I / F 215, a CPU 216, a RAM 217, a photographing unit 218, and a storage unit 247. Each part of the inspection unit 106 is connected to each other via a system bus 219.

[0026] The CPU 216 is a Central Processing Unit, which controls, calculates, and executes programs stored in the storage unit 247 and loaded into the RAM 217 for each part within the inspection unit 106 via the system bus 219. The RAM 217 is a Random Access Memory, which is a type of general-purpose volatile memory that can be directly accessed from the CPU 216 and is used as the work area of the CPU 216 or other temporary data storage areas. The storage unit 247 functions as a temporary storage area and work memory during the operation of the inspection unit 106.

[0027] The inspection device I / F 215 is connected to the inspection unit I / F 231 described later via the cable 249. That is, the inspection unit 106 communicates with the inspection device 108 via the inspection device I / F 215 and the inspection unit I / F 231.

[0028] The imaging unit 218 is equipped with an imaging function, for example, equipped with a Conductive Image Sensor (hereinafter referred to as CIS), captures the paper passing through the inspection unit 106 to generate a scanned image, and transmits the scanned image to the inspection device 108 via the inspection device I / F 215. In this embodiment, the case where the sensor mounted on the imaging function of the imaging unit 218 is CIS will be described. However, other sensors, for example, other types of sensors such as a CCD image sensor may be used, and the imaging method is not limited. There are two purposes for transmitting the image captured by the imaging unit 218 to the inspection device 108. One is to capture the printed matter of the print job to be inspected regardless of the inspection method and transmit it to the inspection device 108 for inspection of the quality of the printed matter (hereinafter referred to as "inspection of printed matter"). The other is when the inspection method is scan inspection, before executing the print job to be inspected, print and capture one or more parts of the print job to be inspected, and transmit the captured image to the inspection device 108 as a reference image. The image captured by the imaging unit 218 for the latter purpose and transmitted to the inspection device 108 is stored in the storage unit 228 described later as a reference image. That is, the reference image is an image without defects and is used for comparison with the image of the printed matter in the inspection. When the inspection method is RIP inspection, the RIP image (bitmap image data) generated by the information processing device 109 executing RIP processing (Raster Image Processor) by the PDL analysis unit 250 is used as the reference image. The inspection device 108 stores the RIP image in the storage unit 228 as the reference image. That is, as the reference image, there are cases where scanned data obtained by scanning the printed matter is used and cases where RIP data transmitted by the print controller to the printing device is used. Note that whether the inspection is performed by scan inspection or RIP inspection can be specified by the job properties of the print job to be inspected.

[0029] (Internal Configuration of High-Capacity Stacker) The high-capacity stacker 107 has an accessory I / F 220, a CPU 221, a RAM 222, a paper discharge unit 223, and a storage unit 248. Each part of the high-capacity stacker 107 is connected to each other via a system bus 224.

[0030] The CPU 221 is a Central Processing Unit, which controls and performs calculations for each part within the large-capacity stacker 107 via the system bus 224. The CPU 221 is responsible for executing programs stored in the storage unit 248 and loaded into the RAM 222.

[0031] The RAM 222 is a Random Access Memory, which is a type of general volatile memory that can be directly accessed by the CPU 221 and is used as the work area of the CPU 221 or other temporary data storage areas. The storage unit 248 functions as a temporary storage area and work memory during the operation of the large-capacity stacker 107. The paper discharge unit 223 is responsible for the paper discharge operations to the main tray 324 and the top tray 320 described later, as well as monitoring and controlling the loading status of each of the main tray 324 and the top tray 320.

[0032] (Internal Configuration of the Inspection Device) The inspection device 108 can detect image defects such as dirt and printing omissions, character errors, barcode quality, etc. The inspection device 108 includes a CPU 226, a RAM 227, a storage unit 228, a PDL analysis unit 229, an inspection unit I / F 231, and a display unit 245. Each part of the inspection device 108 is connected to each other via the system bus 230.

[0033] The CPU 226 is a Central Processing Unit, which controls and performs calculations for each part within the inspection device 108 via the system bus 230 and is responsible for executing programs stored in the storage unit 228 and loaded into the RAM 227. The RAM 227 is a Central Processing Unit, which is a type of general volatile memory that can be directly accessed by the CPU 226 and is used as the work area of the CPU 226 or other temporary data storage areas. The storage unit 228 functions as a temporary storage area and work memory during the operation of the inspection device 108.

[0034] The PDL analysis unit 229 reads PDL data such as PDF, PostScript, and PCL received from the client computer 110 or the information processing device 109 via the printing device 101 and the inspection unit 106, and executes interpretation processing. The display unit 245 is, for example, a liquid crystal display connected to the inspection device 108, and receives user input to the inspection device 108 and displays the state of the inspection device 108.

[0035] (Internal Configuration of Information Processing Device) The information processing device 109 includes a video I / F 233, a CPU 234, a RAM 235, a storage unit 236, NW I / Fs 237, 238, a PDL analysis unit 250, and a display unit 251. Each unit of the information processing device 109 is connected to each other via a system bus 239.

[0036] The CPU 234 is a Central Processing Unit, and controls and operates each unit within the information processing device 109 via the system bus 239, and executes programs stored in the storage unit 236 and loaded into the RAM 235. The RAM 235 is a Random Access Memory, which is a type of general-purpose volatile storage device that can be directly accessed from the CPU 234, and is used as a work area for the CPU 234 or other temporary data storage areas. The storage unit 236 functions as a temporary storage area and a work memory during the operation of the information processing device 109.

[0037] The NW I / F 237 is a network interface, and is connected to the NW I / F 240 via the network 113. Also, the information processing device 109 communicates with the client computer 110 via the NW I / Fs 237, 240.

[0038] The PDL analysis unit 250 reads PDL data such as print jobs received from the client computer 110, for example, PDF, PostScript, PCL, etc., and executes interpretation processing. The display unit 251 is, for example, a liquid crystal display connected to the information processing apparatus 109, and receives user input to the information processing apparatus 109 and displays the state of the information processing apparatus 109.

[0039] Further, the inspection apparatus 108 may have an NW I / F, and the information processing apparatus 109 may communicate with the inspection apparatus 108 via the NW I / F and the NW I / F237. For example, consider a case where RIP inspection is used as an inspection method and an image before printing by the printing apparatus 101, for example, a RIP image (image before printing), is used as a reference image. In this case, the reference image may be transmitted to the inspection apparatus 108 through the inspection apparatus I / F215, or may be transmitted to the inspection apparatus 108 from the NW I / F provided in the inspection apparatus 108 through the NW I / F207 and 237.

[0040] (Internal Configuration of Client Computer) The client computer 110 includes an NW I / F240, a CPU243, a RAM242, and a storage unit 244. Each unit of the client computer 110 is connected to each other via a system bus 246.

[0041] The CPU243 is a Central Processing Unit, and controls and performs calculations in each unit within the client computer 110 via the system bus 246. Further, the CPU243 is responsible for executing programs stored in the storage unit 244 and loaded into the RAM242. The RAM242 is a Random Access Memory, which is a type of general-purpose volatile storage device that can be directly accessed by the CPU243, and is used as a work area for the CPU243 or other temporary data storage areas. The storage unit 244 functions as a temporary storage area and a work memory when the client computer 110 operates.

[0042] In this embodiment, the display unit 245 is described as being inside the inspection device 108. However, the display unit 245 may exist outside the inspection device 108 as a separate device.

[0043] (Image Forming and Media Transport Mechanism) FIG. 3 is a diagram showing the internal configurations of the printing device 101, the inspection unit 106, and the high-capacity stacker 107, respectively.

[0044] As shown in FIG. 1, the printing device 101 includes a UI panel 102 and paper feed decks 103 and 104. Further, the printing device 101 includes developing stations 301 to 304, paper transport paths 305, 309, 311, 312, an intermediate transfer belt 306, a secondary transfer position 307, a fixing unit 308, a second fixing unit 310, a paper reversing path 313, and a duplex transport path 314.

[0045] The UI panel 102 receives user input and displays the status of the printing device 101. The paper feed decks 103 and 104 are decks capable of accommodating various papers, and can separate only the topmost paper of the accommodated papers and transport it to the paper transport path 305.

[0046] The developing stations 301 to 304 form toner images using colored toners of Y, M, C, and K, respectively, in order to form a color image. The toner images formed here are primarily transferred to the intermediate transfer belt 306. The intermediate transfer belt 306 rotates clockwise in FIG. 3, and the toner images are transferred to the paper transported from the paper transport path 305 at the secondary transfer position 307.

[0047] The fixing unit 308 includes a pressure roller and a heating roller. As the paper passes between the rollers, the toner is melted and pressed to fix the toner image on the paper. The paper that has passed through the fixing unit 308 is conveyed through the paper conveyance path 309 to the paper conveyance path 312. Note that depending on the type of paper, further melting and pressing may be required to fix the toner image. In that case, the paper that has passed through the fixing unit 308 is conveyed to the second fixing unit 310 using the paper conveyance path 311 above the paper conveyance path 309. After additional melting and pressing is performed, it is conveyed to the paper conveyance path 312. Also, when the image formation mode is double-sided, the paper that has passed through the paper conveyance paths 309 and 311 is conveyed to the paper reversal path 313. After being reversed on the paper reversal path 313, it is conveyed to the double-sided conveyance path 314, and the second-sided image transfer is performed at the secondary transfer position 307.

[0048] The inspection unit 106 includes CISs 315 and 316 disposed inside thereof so as to face the paper conveyance path 317. The CIS 315 is a sensor for reading the upper surface of the paper. The CIS 316 is a sensor for reading the lower surface of the paper.

[0049] The inspection unit 106 scans the paper using the CISs 315 and 316 at the timing when the paper conveyed to the paper conveyance path 317 reaches a predetermined position. The scanned image is transmitted to the inspection device 108 via the inspection device I / F 215 and the inspection unit I / F 231. The CPU 226 of the inspection device 108 determines whether there are defects in the image received from the inspection unit 106, and notifies the inspection unit 106 of the determined result via the inspection unit I / F 231 and the inspection device I / F 215. The CPU 216 of the inspection unit 106 notifies the large-capacity stacker 107 of the determination result received from the inspection device 108 via the accessory I / Fs 214 and 220.

[0050] The large-capacity stacker 107 is a stacker capable of loading a large quantity of sheets, and has sheet conveyance paths 318, 319, 321, 322, a top tray 320, a reversing unit 323, and a main tray 324 as a tray for loading sheets.

[0051] The sheets that have passed through the inspection unit 106 enter the large-capacity stacker 107 from the sheet conveyance path 318 through the sheet conveyance path 319. The sheets are loaded onto the main tray 324 via the sheet conveyance path 322 from the sheet conveyance path 319.

[0052] The CPU 221 of the large-capacity stacker 107 discharges the sheets detected as defective by the inspection device 108 to the top tray 320. When discharging the sheets to the top tray 320, the sheets are conveyed from the sheet conveyance path 319 to the top tray 320 via the sheet conveyance path 321. The reversing unit 323 is a conveyance path for reversing the sheets and is used when loading the sheets onto the main tray 324. When loading the sheets onto the main tray 324, the sheets are reversed once by the reversing unit 323 so that the orientation of the sheets entering the large-capacity stacker 107 is the same as the orientation of the sheets when loaded onto the main tray 324. When conveying the sheets to the top tray 320, since the sheets are discharged as they are without flipping during loading, the reversing operation at the reversing unit 323 is not performed.

[0053] (Operation mode setting screen) FIG. 4(a) is a diagram showing an example of an operation mode setting screen in the inspection device. In the setting screen, the operation modes of the inspection device and the inspection unit are specified.

[0054] The operation mode setting screen 410 is displayed on the display unit 245 of the inspection device 108 and is a screen for receiving an operation mode setting from the user. The operation mode setting screen 410 has an input field 411 for the image storage destination, an operation mode setting unit 412, and an inspection method setting unit 413. The input field 411 for the image storage destination is an input unit for inputting the storage destination of the image by user operation.

[0055] The operation mode setting unit 412 is a setting unit for the user to select and set one of the operation modes of "log mode" and "purge mode". When the "log mode" is selected by the user in the operation mode setting unit 412, the printing device 101 discharges the paper after inspection to the discharge destination specified in advance in the properties of the print job regardless of the inspection result by the inspection device 108. On the other hand, when the "purge mode" is selected by the user in the operation mode setting unit 412, the printing device 101 discharges the paper with the inspection result being NG (hereinafter referred to as "paper with NG inspection result") to the top tray 320.

[0056] The inspection method setting unit 413 is a setting unit for the user to select and set one of the inspection methods of "scan inspection" and "RIP inspection". When "scan inspection" is selected by the user in the inspection method setting unit 413, the inspection device 108 sets the scanned image of the printed matter as the reference image. On the other hand, when "RIP inspection" is selected by the user, the inspection device 108 sets the RIP image used by the printing device 101 for printing as the reference image. The generation and storage process of the reference image will be described in the flowchart of the figure described later.

[0057] Figure 4(b) is a diagram showing an example of a recovery setting screen in the purge mode in the inspection device 108. When the "purge mode" is selected in the operation mode setting unit 412, the recovery mode setting set by the user on the recovery mode setting screen 420 is reflected.

[0058] The recovery mode setting screen 420 is a screen that is displayed on the display unit 245 and accepts either the "no recovery mode" or the "recovery mode" as the recovery mode setting from the user. When the "no recovery mode" is selected by the user on the recovery mode setting screen 420, only the sheets with NG inspection results are discharged to the top tray 320. Also, the inspection device 108 continues the same inspection for subsequent sheets, and the printing device 101 discharges only the sheets with NG inspection results to the top tray 320. On the other hand, when the "recovery mode" is selected by the user on the recovery mode setting screen 420, not only the sheets with NG inspection results but also all the sheets in any of the conveyance paths shown in FIG. 3 at the time when the inspection device 108 determines that the inspection result is NG are discharged to the top tray 320. After that, when there are no more sheets in all the conveyance paths shown in FIG. 3, the printing device 101 and the inspection device 108 resume printing and inspection from the image printed on the sheet with the NG inspection result.

[0059] In the inspection device 108 in this embodiment, for the sheet printed by the printing device 101, the CISs 315 and 316 of the inspection unit 106 image the image printed on the sheet and perform inspection. Therefore, when the inspection device 108 determines that the inspection result is NG for a certain sheet, there is a possibility that subsequent sheets have already reached the sheet conveyance paths 309, 311, etc. However, if all the sheets in all the conveyance paths shown in FIG. 3 are not discharged, the image printed on the sheet with the NG inspection result cannot be printed again and stacked in the correct output order at the discharge destination specified in advance in the print job. Therefore, such an operation is executed in the "recovery mode".

[0060] The CPU 226 of the inspection device 108 notifies the inspection unit 106 of the operation mode, recovery mode, and inspection method set on the operation mode setting screen 410 and the recovery mode setting screen 420 via the inspection unit I / F 231 and the inspection device I / F 215. Note that the operation mode, recovery mode, and inspection method set on the operation mode setting screen 410 and the recovery mode setting screen 420 are stored in the RAM 227 by the CPU 226 of the inspection device 108 and in the RAM 217 by the CPU 216 of the inspection unit 106, respectively.

[0061] FIG. 4(c) is a diagram showing an example of a setting screen for inspection criteria in the inspection device. The inspection criteria setting screen 430 is a screen that is displayed on the display unit 245 of the inspection device 108 and accepts inspection criteria settings from the user. The inspection criteria setting screen 430 has an upper limit reference value (first determination reference value) 431, a lower limit reference value (second determination reference value) 432, and check boxes 433, 434.

[0062] The inspection criteria setting screen 430 is displayed for each inspection level described later by selecting an inspection level (not shown) on the inspection application. The inspection criteria are the NG determination criteria for inspection and indicate the difference between the printed result and the reference image as a distance. In the present embodiment, the difference between the printed result and the reference image represents the difference between the misalignment described later and the RIP image and the printed matter due to the characteristics of the printing device. The inspection device 108 determines that the inspection is OK if the difference between the printed result and the reference image is less than the value set by the upper limit reference value 431. The upper limit reference value 431 is commonly used for both scan inspection and RIP inspection. The lower limit reference value 432 is valid when the inspection method setting unit 413 performs RIP inspection.

[0063] Checkbox 433 is used to instruct to display a screen (not shown) on which the user can visually check the difference between the scanned image and the reference image when the difference is within the range from the upper limit reference value 431 to the lower limit reference value 432. In FIG. 4(c), when the difference is greater than 0.3 and less than or equal to 0.5, it is used to instruct to display the scanned image and the reference image and display a screen on which the user can visually check the difference. When checkbox 434 is checked, it instructs to record the inspection result in the log.

[0064] When "RIP inspection" is set in the inspection method setting unit 413, the inspection device 108 determines whether the difference between the scanned image data and the reference image data of the printed product is within the range between the upper limit reference value 431 and the lower limit reference value 432. When it is determined that the difference is within the range between the upper limit reference value 431 and the lower limit reference value 432, the inspection device presents a reference image selection screen (not shown) for receiving a determination by the user.

[0065] In this embodiment, the difference between the scanned image data and the reference image data of the printed result is shown as a distance as the inspection standard, but it is not limited thereto, and different parameters such as color tone may be presented as the inspection standard.

[0066] (Inspection status screen) FIG. 5 is a diagram showing an example of an inspection status screen. The inspection status screen is displayed on the display unit 245 of the inspection device 108 during inspection execution.

[0067] The inspection status screen 500 is displayed on the display unit 245 of the inspection device 108, and accepts the execution / stop of inspections and displays the inspection status. The inspection status screen 500 has a file name display section 501 for the inspection target, an image display area 502 for the inspection target, an "Inspection" button 503, and an inspection status 504. The inspection status screen 500 further has the number of inspected sheets 505, the number of sheets with NG inspection results 506, and the defect rate 507. Regarding the occurrence numbers of each cause which are the details of the number of sheets 506 with NG inspection results, it has the number of sheets with misregistration 5061, the number of sheets with collation mismatch 5062, the number of sheets with dirt (spots) 5063, and the number of sheets with errors 5064. Also, the inspection status screen 500 has an inspection NG list 510. The inspection NG list 510 has a sheet No. 511, front / back 512, misregistration 513, dirt (spots) 514, collation mismatch 515, error 516, inspection time 517, and detailed display 518.

[0068] The "Inspection" button 503 accepts instructions from the user to execute or stop the inspection by the inspection device 108. When the user presses the "Inspection" button 503 which is displayed as "Start Inspection" to instruct the execution of the inspection, the character string on the "Inspection" button 503 changes to "Stop Inspection", while the inspection status 504 changes to "Inspecting".

[0069] After that, when the user presses the "Inspection" button 503 which is displayed as "Stop Inspection" to instruct the stop of the inspection, the character string on the "Inspection" button 503 returns to "Start Inspection", while the inspection status 504 changes to "Stopped".

[0070] Thereafter, the character string on the "Inspection" button 503 and the inspection status 504 change in a toggle manner each time the "Inspection" button 503 is pressed.

[0071] The inspection status screen 500 further displays in real time during the inspection the number of inspected sheets 505, the number of sheets with NG inspection results 506, the defect rate 507, and the occurrence numbers 5061 to 5064 of each cause of the NG inspection results. Note that the occurrence number 5064 of "error" displayed on the inspection status screen 500 is the number of sheets determined to be equivalent to NG inspection results because the inspection device 108 timed out due to the inspection not being completed within a predetermined inspection time.

[0072] For each occurrence of an NG inspection result in the NG inspection list 510, information about the following items is added. That is, information about the sheet No. 511, front / back 512, misalignment 513 (which is the cause of the NG inspection result), stain (spot) 514, collation mismatch 515, error 516, inspection time 517, and detailed display 518 is added to each item. The sheet No. 511 indicates the order in which the sheets with NG inspection results were fed. The front / back 512 indicates whether the surface of the sheet with the NG inspection result is the front or the back. The detailed display 518 indicates a link to an NG details screen (not shown).

[0073] When "Details" in the detailed display 518 in the NG inspection list 510 is pressed, the display unit 245 displays a scanned image of the sheet with the NG inspection result, which is a scanned image of the sheet obtained by imaging with either the CIS 315 or 316. The display unit 245 also displays the position of the defect and the like in the scanned image.

[0074] Also, in the NG inspection list 510, information about each item of misalignment 513, stain (spot) 514, collation mismatch 515, and error 516 is displayed as the cause of the NG inspection result. The misalignment 513 indicates information that determines a defect where all or part of the image is shifted as a whole when comparing the scanned image with the reference image as NG. The stain (spot) 514 indicates information that determines a defect where stains occur in a dot pattern only on the scanned image side as NG. The collation mismatch 515 indicates information that determines a defect where the character data detected by OCR (a process of detecting characters from a read image) does not match the registered character data as NG.

[0075] As described above, the inspection device 108 can identify the type of detected defect based on the characteristics of the defect and display it in the inspection NG list 510. Note that the defects displayed as the causes of the inspection result NG in the inspection NG list 510 are just examples, and the types of defects that the inspection device 108 can detect are not limited to these. For example, when an image is drawn only on the reference image side and all or part of it is not drawn on the scanned image side, the cause of the inspection result NG determined as a missing image may be added to the inspection NG list 510.

[0076] Hereinafter, the characteristic processes of this embodiment will be described with reference to the flowchart. The program of the printing device 101 related to this flowchart is stored in the storage unit 205 of the printing device 101, expanded in the RAM 202, and executed by the CPU 201. Also, the program of the inspection device 108 related to this flowchart is stored in the storage unit 228 of the inspection device 108, expanded in the RAM 227, and executed by the CPU 226. Further, the program of the information processing device 109 related to this flowchart is stored in the storage unit 236 of the information processing device 109, expanded in the RAM 235, and executed by the CPU 234. Also, the program of the client computer 110 related to this flowchart is stored in the storage unit 244 of the client computer 110, expanded in the RAM 242, and executed by the CPU 243.

[0077] (Inspection data) FIG. 6 is a diagram showing an example of inspection data. The inspection data is the reference image and content information (object information) created in this embodiment. The content (object) is a component that constitutes an image, specifically, graphics such as lines and rectangles, images such as photographic images, and characters.

[0078] In this embodiment, the information processing apparatus 109 or the printing apparatus 101 transmits a reference image and content information to the inspection apparatus 108 as inspection data. As described above, if the inspection method is scan inspection, the reference image is a scanned image of a printed matter, and if the inspection method is RIP inspection, the reference image is a RIP image used by the printing apparatus 101 for printing.

[0079] In the case of scan inspection, the reference image is image data obtained by scanning a printed matter with the CISs 315 and 316 of the inspection unit, and each pixel is represented by an 8-bit digital signal. In the case of RIP inspection, the printing apparatus receives character and image data described in a PDL (Page Description Language) from the information processing apparatus 109. Then, the CPU 201 executes RIP processing (Raster Image Process) to create a RIP image (bitmap image). In the case of RIP inspection, the reference image is data created through RIP processing, and each pixel is represented by an 8-bit digital signal. The printing apparatus 101 performs printing using this RIP image.

[0080] In this embodiment, the PDL data received by the printing apparatus 101 includes, for example, as shown in the example of FIG. 6(a), vector graphics 605 such as lines and circles, bitmap images and raster images 606, and characters 607. These are each drawn by different PDL commands, and the printing apparatus 101 has a pixel-by-pixel image area flag to determine what image processing to apply to the RIP image after RIP processing that raster-expands the PDL commands for printing. The image area flag indicates which PDL command was used to generate an image object such as a line or a character. In this embodiment, this image area flag is used as the content type (object type) to determine the inspection area. In this embodiment, the image area flag has three types: Graphics, Image, and Text.

[0081] In this embodiment, the information processing apparatus 109 creates content information 602 from the PDL data. FIG. 6(b) is a diagram showing a part (upper left of the reference image) of the content information. The content information 602 is obtained by assigning numbers 0, 1 (graphic), 2 (image), and 3 (text) to the image area flags generated by the PDL commands for each pixel (content type), and is data of the same size as the RIP image. That is, it can be said that the content information 602 indicates the type of object for each pixel. The content types of the inspection system are not limited to these three types, and new content other than the above three types may be created from various print data including the PDL data and defined as the content type. For example, content such as a human face may be added as the content type.

[0082] The inspection apparatus 108 determines a rectangular area including the image object created by the PDL command as the inspection area for each content type as the inspection range. FIG. 6(c) is an enlarged view of the upper left part of FIG. 6(b). The determination of the rectangular area for each content type is performed according to the following procedure. For example, the CPU 226 of the inspection apparatus 108 extracts an independent area from the content information sent from the information processing apparatus 109 (the white background part in FIG. 6(c)). From the extracted areas having the same content type (1), information on the writing start coordinates and the writing end coordinates of the lines of the image object is obtained from the content information. FIG. 6(c) shows information on the writing start coordinates and the writing end coordinates of the lines of the image object 1 and the image object 2. Similarly, the writing start coordinates and the writing end coordinates of two graphic image objects with the content type "1" are obtained. Next, from the writing start coordinates and the writing end coordinates of these four image objects, the minimum value of the X coordinate, the minimum value of the Y coordinate, the maximum value of the X coordinate, and the maximum value of the Y coordinate are obtained.

[0083] The CPU 226 of the inspection device 108 obtains, by the above-described method, a rectangular area (writing start (1, 1), writing end (12, 12)) that forms the graphics part 608 including an image object having the graphic content type shown in FIG. 6(d). The rectangular area that forms the graphics part 608 is obtained with the writing start coordinates being (the minimum value of the X coordinate, the minimum value of the Y coordinate) and the writing end coordinates being (the maximum value of the X coordinate, the maximum value of the Y coordinate).

[0084] The CPU 226 of the inspection device 108 obtains a rectangular area for each content type from the content information sent from the information processing device 109 and creates rectangular areas from the beginning to the end of the page. FIG. 6(e) is a diagram showing the content information and shows the inspection areas for each content type. In FIG. 6(e), the reference image 601 includes the graphics parts 608, 609, 614, 615 at the four corners, the image parts 610, 612, 613, and the character part 611. In the present embodiment, the inspection device 108 obtains inspection areas for each content type from the reference image and the content information and uses them for inspection.

[0085] (Inspection level setting screen) FIG. 7 is a diagram showing an inspection level setting screen for setting the inspection level of content types when performing an inspection by the inspection apparatus 108. The inspection level setting screen 700 includes a content type 710 and an inspection level 720. In the present embodiment, the content type 710 includes three types: Text (characters) 711, Graphics (graphics) 712, and Image (image) 713. However, the content type 710 is not limited to these three types, and may have content other than the above three types indicating the content of the print data. In the example of FIG. 7, the inspection levels 721, 722, and 723 of Text (characters) 711, Graphics (graphics) 712, and Image (image) 713 are set to 1, 2, and 3, respectively. Note that the inspection level is associated with a threshold used for inspecting circular defects, linear defects, and misalignment. In the inspection level 721, for example, a range of 0.5 mm to 1.0 mm or less for "Level 1", a range of 0.3 mm to 0.5 mm or less for "Level 2", and a range of the threshold of 0.3 mm or less for "Level 3" are associated as the above thresholds. The user can set the inspection level corresponding to each content type by setting the inspection level corresponding to each content type on the inspection level setting screen 700 and pressing the "OK" button 731. The "Cancel" button 732 cancels the setting on the inspection level setting screen 700. The inspection apparatus records a value for the inspection level for each content type used when the display unit of the inspection apparatus performs an inspection according to the user input. The recorded content is used for the inspection level assigned when the inspection apparatus detects an inspection area using the content information.

[0086] (Inspection Area Setting Screen) FIG. 8 is a diagram showing an example of an inspection area setting screen. The inspection area setting screen 800 is a user interface screen (hereinafter referred to as a UI screen) that is displayed by the display unit 245 of the inspection apparatus 108 and shows the inspection area to the user. The inspection area setting screen 800 has an inspection area display unit 810 shown on the left side of the screen and a detailed information display unit 820 shown on the right side of the screen. The detailed information display unit 820 is obtained from the content information 602 by a flowchart described later in FIG. 13. The display unit 245 displays, as inspection areas, the reference image and each rectangular area (with information indicating the area) extracted for each content type included in the content information in the inspection area display unit 810 of the inspection area setting screen 800. At this time, the display unit 245 displays the reference image together with the inspection area in the inspection area display unit 810 of the inspection area setting screen 800. That is, the display unit 245 performs display control so as to display the inspection area superimposed on the reference image.

[0087] The number "3" 812 indicates the page number of the printed data being displayed. When the arrow buttons 813, 814 are pressed, the display unit 245 displays, in the inspection area display unit 810 of the inspection area setting screen 800, the inspection area and the reference image of the previous page or the next page corresponding to the arrow button.

[0088] In addition, the display unit 245 displays, in the detailed information display unit 820, an inspection area setting list 830 in which the inspection levels of the inspection areas displayed in the inspection area display unit 810 are listed for each area. The inspection area setting list 830 has information regarding each item of area 831, content identification 832, and inspection level 833. When the inspection area setting list 830 includes information on, for example, nine or more areas, a scroll bar 834 that can be moved up and down is displayed, and by operating the scroll bar 834, the information on the areas after the ninth area can be displayed.

[0089] The display unit 245 associates the rectangular area of the inspection area with the area for each content type of the inspection area setting so that it can be seen where in the inspection area display unit 810 the area to be displayed in the inspection area setting list 830 is shown, and displays it using line types and colors. For example, the image area 835 of the inspection area setting indicating the same content type and the rectangular area 811 of the image of the inspection area may be displayed using the same line type and the same color. Also, when the rectangular area 811 of the inspection area is selected, the image area 835 of the inspection area setting may be highlighted. That is, the inspection area and the information regarding the inspection area may be displayed in association with each other. The user can automatically set the inspection area as shown in FIG. 8 by setting the inspection level for each content type in advance in the inspection settings as described with reference to FIG. 7.

[0090] If the user determines that the settings of the inspection area display unit 810 are as expected, the user presses the "OK" button 842 to proceed to the execution screen of the inspection application shown in FIG. 5. When the "Cancel" button 841 is pressed, it is saved in a list for saving a reference image (not shown), and the inspection is canceled.

[0091] Incidentally, although the inspection area for each content is automatically detected by the inspection apparatus, there are cases where it is desired to group the inspection areas into specific groups. For example, when checking whether a serial number is correctly printed by character recognition processing (OCR processing), instead of checking each character, a plurality of digits of numerical values must be grouped and recognized as a serial number. At the same time, it is also necessary to be careful not to include unrelated characters in this group. In order to appropriately group the inspection areas in this way, the inspection apparatus must be made to store the grouping conditions in advance.

[0092] (Inspection Area Grouping Setting Screen) FIG. 9 is a diagram showing an example of an inspection area grouping setting screen. The inspection area grouping setting screen 900 includes a grouping setting list 910, an "Add" button 921, a "Delete" button 922, and a "Close" button 923.

[0093] The grouping setting list 910 records four rules. Each rule can have multiple conditions. The grouping setting list 910 has a number 911, a group name 912, a content type 913, a checkbox 914 which is a judgment condition for whether each content is of the same size, a direction 915, and a checkbox 916 which is a judgment condition for whether the content is of the same color. The grouping setting list 910 also has a maximum distance 917 between adjacent contents and a peripheral length 918 which is a condition for how far to include the area around the grouped inspection area as an inspection area. For example, the first grouping rule assumes text characters of serial numbers. The content type is text content, and each character is of the same size, the same color, and aligned horizontally. Also, contents within 2 mm (within a predetermined value) of the adjacent ones are grouped as one inspection area. When the character colors and character sizes are mixed, the checkboxes 914 and 916 are unchecked. Finally, the peripheral margin length of 2.5 mm or less which is a predetermined value is also included in the inspection area. By making such settings, an inspection area for serial numbers suitable for the OCR processing intended by the user can be automatically generated. The second grouping rule is a rule regarding company logos. The logo is specified with the content type being graphic. The other conditions, namely the checkbox 914, the direction 915, the checkbox 916, the maximum distance 917 between adjacent contents, and the peripheral length 918, are the same as those of the first grouping rule. The third grouping rule is a rule for grouping contents drawn with graphic attributes constituting a QR code (registered trademark). The QR code is, for example, a two-dimensional barcode which will be described in detail later. The sizes of the elements constituting the QR code vary. Therefore, the checkbox 914 indicating the size attribute is unchecked. Also, since the elements are arranged in a two-dimensional vertical and horizontal manner, the direction 915 indicating the direction attribute is vertical and horizontal. Also, the color is black and the same color, and since the elements are adjacent at a short distance, the maximum distance 917 between adjacent contents is set to 0.5 mm or less (within a predetermined value). And since 4 cells (dots) are required as a quiet zone which is the margin part around the QR code, the peripheral length 918 is set to 4 mm with a margin.The last, the fourth rule of grouping is the grouping setting rule when the company logo and the QR code are grouped together as the same group. Details will be described with reference to FIG. 11 described later.

[0094] In addition, in FIG. 9, the modes that meet the conditions of content type, content size, direction, content color, and the maximum distance of adjacent content are described, but it is not limited thereto. For example, it may be a mode that meets at least one of the following plurality of conditions. That is, the plurality of conditions include that the types of objects are the same, the sizes of objects are the same, the arrangement directions of objects are the same, the colors of objects are the same, and the distance from adjacent objects is equal to or less than a predetermined value. Further, the plurality of conditions include that the periphery of the object is equal to or less than a predetermined value.

[0095] <Example 1 of grouping process> FIG. 10 is a diagram for explaining the grouping process of the inspection area, and is an enlarged view of a part of the inspection area display unit 810 on the inspection area setting screen 800. FIG. 10(a) shows the state before the grouping process, and FIG. 10(b) shows the state after the grouping process.

[0096] The inspection areas 1011 to 1014 of the content are extracted as corresponding areas for each character (object) based on the object type indicated by the content information 602, and are detected as rectangular areas circumscribing the characters for each character. In this case, if only the stains and streaks on the character part are inspected, the inspection can be executed with only the minimum processing area by executing the inspection in this inspection area.

[0097] However, in order to perform OCR processing on the character "0001" in the inspection area 1014 corresponding to the serial number in FIG. 10(a) and collate it with the customer management number "SCH003" prepared in advance for comparison, it is necessary to integrate four characters as one group. In addition, it is preferable to include an appropriate size of margin around the characters in order to improve the accuracy of the OCR processing.

[0098] The first rule of the inspection area grouping setting shown in FIG. 9 is the rule for this purpose and is input and set. When the content type is "text", the sizes and colors are the same, they are arranged horizontally, and the distance between adjacent contents is within 2 mm, the inspection areas are integrated as the same group. Further, 2.5 mm of margins on the top, bottom, left, and right are added to the inspection area. FIG. 10(b) shows the result of applying the grouping rule. It can be seen that one inspection area 1024 includes the serial number "0001" with margins. Also, it can be seen that the inspection area 1024 after the grouping process is an inspection area without misrecognition in the OCR process of the serial number and without error in number collation. Note that the inspection areas 1011 to 1013, similar to the inspection area 1014, are inspection areas 1021 to 1023 where a plurality of characters are grouped into one area by applying the rule of the inspection area grouping setting (not shown).

[0099] <Example of Grouping Process 2> FIG. 11 is a diagram for explaining the grouping process of inspection areas, and is an enlarged view of the inspection area display section 810 on the inspection area setting screen 800. Specifically, it is a diagram showing a reference image of a business card with a company logo 1101 and a QR code 1102 indicating the URL of the company homepage. In business card printing, multiple such business cards are arranged and printed on a single sheet of paper and then cut. The reference image 1100 of the business card shown in FIG. 11 shows that the company logo 1101 and the QR code 1102 are printed on the left side of the business card. Since it is not good for the impression if there is ink splashing or the like on the company logo 1101, generally, the company logo and its surroundings are inspected more carefully. Also, in order to ensure reliable access to the homepage, the QR code 1102 is subjected to barcode reading verification. When multiple are printed on a single sheet of paper like a business card, the number of logos and QR codes increases, so it is desirable to group the logo and the QR code in the same inspection area to reduce the number of inspection areas in a device with an upper limit on the setting of inspection areas. Rule 4 of the inspection area grouping setting shown in FIG. 9 is the rule input and set for this purpose. It is a condition obtained by combining Rule 2 for the company logo and Rule 3 for the QR code, and logos and QR codes of different sizes and colors are grouped in the same group. Also, the direction expands the range vertically and horizontally, and the distance is made larger than that for the QR code only, which is 2 mm. A margin of 4 mm sufficient for the inspection of the QR code is taken for the surrounding inspection area. FIG. 11 shows the result of applying the grouping rule. One inspection area 1103 after the grouping process includes the company logo 1101 and the QR code 1102, and it can be seen that the company logo 1101 and the QR code 1102 are included in the same group.

[0100] (Processing at the time of registering the reference image) FIG. 12 is a flowchart for explaining the process at the time of reference image registration. The process shown in this flowchart is achieved by the CPU 226 of the inspection apparatus 108 expanding and executing a program stored in the storage unit 228 in the RAM 227. As described above, if the inspection method is scan inspection, the reference image data is scan image data obtained by scanning a printed matter, and if the inspection method is RIP inspection, the reference image data is RIP image data used by the printing apparatus 101 for printing. The flowchart of FIG. 12 is a common flow for both scan inspection and RIP inspection.

[0101] In S1201, when the "Inspection" button 503 on the inspection status screen 500 displayed on the display unit 245 is pressed by a user operation, the CPU 226 receives an instruction to start reading an image from the user. In S1202, the CPU 226 determines whether the reading of the reference image data for all sheets has been completed. If a determination result that the reading of the reference image data for all sheets has been completed is obtained (YES in S1202), the process proceeds to S1207. On the other hand, if a determination result that the reading of the reference image data for all sheets has not been completed is obtained (NO in S1202), the process proceeds to S1203.

[0102] In S1203, when the inspection method is scan inspection, the CPU 226 receives, via the inspection unit I / F 231 and the inspection apparatus I / F 215, the scan image data obtained by scanning with the CISs 315 and 316 of the inspection unit 106 from the inspection unit. That is, the CPU 226 receives the scan image data that is a candidate for the reference image data. On the other hand, when the inspection method is RIP inspection, the CPU 226 receives, via the inspection unit I / F 231 and the inspection apparatus I / F 215, the RIP image data generated by the printing apparatus 101 before printing. That is, the CPU 226 receives the RIP image data that is the reference image data. Further, the CPU 226 receives the content information 602 shown in FIG. 6(e) generated by the information processing apparatus 109 by RIP.

[0103] In S1204, the CPU 226 executes content recognition processing to recognize the content (objects) in the reference image received in S1203. That is, the CPU 226 executes detection processing for the inspection area for each content. The content recognition processing will be described in detail in the flowchart of FIG. 13 described later. In S1205, the CPU 226 executes inspection area grouping processing (grouping processing) to group the inspection areas corresponding to the individual contents detected in S1204 according to the inspection area grouping setting rules shown in FIG. 9. The details of the grouping processing will be described in the flowchart of FIG. 14.

[0104] In S1206, the CPU 226 registers the image data received in S1203 in the RAM 227 as reference image data. Further, the CPU 226 registers the inspection areas grouped in S1205 in the RAM 227. When the processing of S1206 is completed, the processing returns to S1202. That is, the CPU 226 repeatedly executes the processing of S1202 to S1206 until the reference image data of all sheets is stored.

[0105] In S1207, the CPU 226 displays the inspection area setting screen 800 shown in FIG. 8 on the display unit 245. When the CPU 226 detects that the "OK" button 842 or the "Cancel" button 841 on the inspection area setting screen 800 is pressed by a user operation, the CPU 226 recognizes that the user has finished confirming the reference image and the inspection area of the inspection area setting screen, and ends the series of processes shown in FIG. 12.

[0106] Note that the reference image registration process described with reference to FIG. 12 is an example and is not limited thereto. For example, the instruction to start image reading by the user displayed on the display unit 245 of the inspection device 108 may be automatically executed in conjunction with an instruction to start printing in a device external to the inspection device 108, such as the printing device 101, the information processing device 109, or the client computer 110. Further, the instruction to end the image reading by the user in S1207 may be automatically executed in conjunction with the end of printing in the printing device 101.

[0107] When the inspection method is scan inspection, for example, the inspection device 108 may read a plurality of images for the same page and register the synthesis result as reference image data.

[0108] (Detection process of inspection area for each content) FIG. 13 is a flowchart for explaining the details of the detection process (S1204) of the inspection area for each content. The detection process is executed for the content in the reference image. The process shown in this flowchart is achieved by expanding and executing the program stored in the storage unit 228 of the inspection device 108 in the RAM 227.

[0109] In S1301, the CPU 226 reads the content type 710 and the inspection level 720, which are preset correspondence settings between the content type and the inspection level recorded in the storage unit 228 of the inspection device 108. In S1302, the CPU 226 reads the content information received from the information processing device 109. The information processing device 109 and the inspection device 108 communicate with each other, and the content information shall have any one of the content types preset in the inspection settings described in FIG. 7.

[0110] Next, the process proceeds to S1303, and the CPU 226 repeatedly executes the processes from S1303 to S1305 until it finishes reading the content information up to the last page. That is, in S1303 and S1304, until the CPU 226 finishes reading the content information up to the last page, it scans from the beginning to the end in page units and extracts independent regions for each content based on the content type. The details of the extraction method are the methods described in FIG. 6. When the extraction of the region is performed up to the content information of the last page and the region shown in FIG. 6(e) is obtained, in S1306, the CPU 226 associates the inspection level with the extracted region using the content type of the inspection setting. In the present embodiment, when recording in the inspection region setting table, the CPU 226 assigns the names "image region", "graphic region", and "text region" to the region columns in the respective regions of image, graphic, and text. The inspection level of each region in the inspection region setting table stored in the storage unit 228 indicates the inspection level of the region of the content included in the content information.

[0111] Finally, in S1307, the CPU 226 stores the inspection region and the inspection level in the storage unit 228 as an inspection region list.

[0112] In the present embodiment, via the inspection region setting screen 800, the user can also switch the inspection level of the content included in the content information for each content later.

[0113] The following Table 1 is an inspection region list extracted based on the content information of a certain page, taking the example of FIG. 8 as a specific example. The four dragonfly regions of the Graphics content at the corners of the image, the three Image images in the center, and the six characters of Text in the center are extracted as independent inspection regions. Each region has a plurality of attributes. That is, each region has attributes of content type, inspection level, region coordinates, and belonging group. Note that the belonging group is used when grouping regions, which will be described later. In the belonging group, "-1" indicates that it is not set and does not belong to any group.

[0114]

Table 1

[0115] (Grouping process) Figure 14 is a flowchart for explaining the grouping process (S1205). The process shown in this flowchart is achieved by the CPU 226 of the inspection apparatus 108 expanding and executing a program stored in the storage unit 228 in the RAM 227.

[0116] In S1401, the CPU 226 reads out the inspection area grouping setting information described in FIG. 9 from the storage unit 228, and checks whether the grouping conditions are registered. If it is confirmed that there are grouping conditions (YES in S1401), the process proceeds to S1402. If it is confirmed that there are no grouping conditions (NO in S1401), the process shown in FIG. 14 ends.

[0117] In S1402, the CPU 226 determines whether all the grouping conditions have been read out. The processes from S1403 to S1408 are repeatedly executed until all the grouping conditions are read out. That is, if it is determined that all the grouping conditions have been read out (YES in S1402), the process shown in FIG. 14 ends. If it is determined that not all the grouping conditions have been read out (NO in S1402), the process proceeds to S1403.

[0118] In S1403, the CPU 226 reads out one grouping condition. In S1404, the CPU 226 selects inspection areas that match the grouping conditions from the inspection area list created in the process of FIG. 13. For example, in the case of Rule No. 1 shown in FIG. 9, the inspection area information of the following content is selected. That is, the inspection area information of the content whose content (object) type is text, the content size is the same, the content arrangement direction is horizontal, and the distance between adjacent contents is within 2 mm is selected.

[0119] For Rule 2 shown in FIG. 9, the inspection area information of the following content is selected. That is, the inspection area information of the content that meets the conditions that the type of the content (object) is graphic, the sizes of the content are the same, the arrangement direction of the content is horizontal, and the distance between adjacent content is within 2 mm is selected.

[0120] For Rule 3 shown in FIG. 9, the inspection area information of the following content is selected. That is, the inspection area information of the content that meets the conditions that the type of the content (object) is graphic, the arrangement directions of the content are vertical and horizontal, and the distance between adjacent content is within 0.5 mm is selected.

[0121] For Rule 4 shown in FIG. 9, the inspection area information of the following content is selected. That is, the inspection area information of the content that meets the conditions that the type of the content (object) is graphic, the arrangement directions of the content are vertical and horizontal, and the distance between adjacent content is within 2 mm is selected.

[0122] In S1405, the CPU 226 acquires the minimum coordinates and the maximum coordinates at the area coordinates in the inspection area selected in S1404. Based on the acquired minimum coordinates and maximum coordinates, a group of inspection areas is derived.

[0123] In S1406, the CPU 226 adds the peripheral inspection range registered in the grouping condition to the group inspection area. In S1407, the CPU 226 changes the valid / invalid attribute of the content included in the group to invalid. That is, the CPU 226 inputs the area number of the added group to the group attribute to which the inspection area included in the group belongs. In S1408, the CPU 226 executes a process of retrieving the next grouping condition. When the process of S1408 ends, the process returns to S1402.

[0124] The following Table 2 is an example of the inspection area list after grouping. The inspection area with the Text attribute belongs to the group with area number 14. Note that in the belonging group, "-1" indicates that it is not set and does not belong to any group.

[0125] [Table 2]

[0126] (Inspection process) Figure 15 is a flowchart for explaining the inspection process. The process shown in this flowchart is achieved by the CPU 226 of the inspection device 108 expanding and executing the program stored in the storage unit 228 in the RAM 227.

[0127] In S1501, the CPU 226 receives the operation mode setting set in the operation mode setting unit 412 of the operation mode setting screen in Fig. 4(a) and the recovery mode setting set in the recovery mode setting unit 421 of the purge mode recovery setting screen in Fig. 4(b). Also, the CPU 226 acquires the inspection method setting set in the inspection method setting unit 413 in Fig. 4(a). In S1502, the CPU 226 receives an instruction to start reading an image by a user operation via the display unit 245. Next, it proceeds to S1503. If there is a sheet to be inspected, the CPU 226 proceeds to S1504. In S1503 to S1516, these processes are repeated until the processing for the sheet to be inspected is completed.

[0128] In S1504, the CPU 226 receives the scan image data obtained by scanning with the CISs 315 and 316 via the inspection unit I / F 231 and the inspection device I / F 215. This scan image data is the image data obtained by scanning a printed matter, which is the result of executing a print job. The inspection device 108 performs an inspection by comparing this scan image data with the reference image data previously displayed on the inspection status screen of FIG. 5. In S1505, the CPU 226 reads out the reference image data of the corresponding page registered in S1206 from the RAM 227. This reference image data is the reference image data created based on the inspection method set by the inspection method setting unit 413.

[0129] In S1506, the CPU 226 compares the reference image data acquired in S1505 with the scan image data of the inspection target received in S1504. In this comparison operation, first, characteristic points of the image are used as reference points for alignment to align the positions of the reference image data and the scan image data of the inspection target. Next, in the scan image data of the inspection target, the four corners of the paper and the reference points for alignment of the scan image are analyzed to detect whether there is any misalignment of the image with respect to the paper. Next, the density values of each region of the reference image data and the scan image data of the inspection target are compared pixel by pixel. As a result, if no difference equal to or greater than a predetermined value is detected between the scan image data and the reference image data, the inspection result is determined to be OK.

[0130] On the other hand, if a difference equal to or greater than a predetermined value is detected between the scan image data and the reference image data, the inspection result is determined to be NG, and the details of the inspection result NG described in FIG. 5 are recorded according to the type of defect. Here, for the purpose of explaining the basic inspection operation, the process in which the inspection result is always NG when a difference equal to or greater than a predetermined value is detected has been described.

[0131] In S1507, the CPU 226 determines whether the inspection has been completed within the specified time. If a determination result that the inspection has been completed within the specified time is obtained (YES in S1507), the process proceeds to S1508. If a determination result that the inspection has not been completed within the specified time is obtained (NO in S1507), the process proceeds to S1509.

[0132] The determination in S1507 is because if the inspection is not completed within a certain time and the inspection result is not output, the subsequent sheet will be scanned by the CIS 315 and 316 of the inspection unit 106 and the inspection of the subsequent sheet will start, so it will not be in time.

[0133] Also, when the purge mode is selected by the operation mode setting unit 412, it is to enable the CPU 221 of the large-capacity stacker 107 to switch the conveyance destination in time for discharging the sheet determined as NG in inspection by the inspection device 108 to the top tray 320. When the inspection result is NG, the CPU 226 of the inspection device 108 needs to notify the CPU 221 of the large-capacity stacker 107 that the inspection result is NG before the target sheet reaches the point where the conveyance destination cannot be switched in the large-capacity stacker 107. Note that the above notification is made to the CPU 221 of the large-capacity stacker 107 via the inspection unit I / F 231, the inspection device I / F 215, the accessory I / F 214, and the accessory I / F 220.

[0134] Therefore, in S1507, if the CPU 226 cannot complete the inspection within the predetermined time, it cannot determine that the inspection result is OK. Thus, the CPU 226 sets the inspection result as an error and determines that the inspection result of the sheet is equivalent to the result of inspection result NG.

[0135] In S1508, the CPU 226 determines the quality of the printed matter based on the inspection result of the sheet. If a determination result that the inspection result is not NG is obtained (YES in S1508), the process proceeds to S1516. If a determination result that the inspection result is NG is obtained (YES in S1508), the process proceeds to S1509.

[0136] In S1509, the CPU 226 reads the operation mode from the RAM 227 and determines whether the read operation mode is the purge mode. If the determination result is that it is not the purge mode (NO in S1509), the process proceeds to S1515. If the determination result is that it is the purge mode (YES in S1509), the process proceeds to S1510.

[0137] In S1510, the CPU 226 notifies the CPU 216 of the inspection unit 106 that the inspection result is NG via the inspection unit I / F 231 and the inspection device I / F 215. As a result, the paper with an NG inspection result is discharged to the top tray 320 of the high-capacity stacker 107.

[0138] In S1511, it is determined whether the recovery mode read by the CPU 226 from the RAM 227 is the "recovery available mode". If the determination result is that it is not the "recovery available mode" (NO in S1511), the process proceeds to 1515. If the determination result is that it is the "recovery available mode" (YES in S1511), the process proceeds to 1512.

[0139] In S1512, the CPU 226 waits via the inspection unit I / F 231 and the inspection device I / F 215 until it receives print stop information from the CPU 216 of the inspection unit 106. When the CPU 226 receives the print stop information here, the process proceeds to S1513. In this print stop state, the paper with an NG inspection result and all the subsequent papers that have been fed into the printing device 101 and the inspection device 108 at the time when the inspection device 108 determines that the inspection result is NG are all discharged to the top tray 320 of the high-capacity stacker 107.

[0140] In S1513, the CPU 226 reads the reference image data corresponding to the paper with an NG inspection result from the RAM 227 and holds it as the reference image data to be inspected next. In S1514, the CPU 226 notifies the CPU 216 to resume the inspection via the inspection unit I / F 231 and the inspection device I / F 215. In S1515, the CPU 226 adds information about the paper with an NG inspection result to the inspection NG list 510.

[0141] In S1516, the CPU 226 repeats the processes of S1503 to S1516 until the inspection of all papers is completed. When the inspection of all papers is finished, the process proceeds to S1517. In S1517, when the CPU 226 receives an instruction to finish reading the image from the user via the "Inspection" button 503 on the inspection status screen displayed on the display unit 245, this process ends.

[0142] Note that in S1511, if the recovery mode read by the CPU 226 from the RAM 227 is the "No Recovery Mode", the process proceeds to S1515, and thereafter the process can end in the same manner as the above flow. That is, the printing device 101 ejects only the papers with NG inspection results to the top tray 320, and the printing device 101 and the inspection device 108 continue the inspection for the subsequent papers as normal. Also, in S1509, if the operation mode is the log mode, the process proceeds to S1515. Then, since the printing device 101 ejects the papers after inspection to the paper ejection destination specified in advance in the properties of the print job regardless of the inspection results by the inspection device 108, the inspection device 108 continues the inspection as normal. Also in S1508, if the inspection result is OK, the process proceeds to S1516, and thereafter the process can end in the same manner as the above flow.

[0143] Note that the inspection process described with reference to FIG. 15 is merely an example and is not limited thereto. For example, the instruction to start reading the user's image on the display unit 245 may be automatically executed in conjunction with the instruction to start printing on the printing apparatus 101, the information processing apparatus 109, or the client computer 110. Further, the instruction to end reading the user's image on the display unit 245 may be automatically executed in conjunction with the end of printing on the printing apparatus 101.

[0144] As described above, according to the present embodiment, the inspection apparatus can extract independent inspection regions based on content information and automatically set the inspection level based on the content type. Further, a plurality of inspection regions can be grouped according to previously set conditions. That is, it is possible to appropriately set inspection regions corresponding to a plurality of corresponding objects. As a result, the user does not need to manually set the inspection regions that were set in the scan inspection and the RIP inspection. Also, when there are many inspection regions, it is possible to shorten the time required for setting the inspection regions and the inspection level. That is, it is possible to flexibly set the grouping rules and conditions before reading the reference image and reflect them in the grouping of the regions detected according to the rules.

[0145] <<Embodiment 2>> In the present embodiment, a mode of displaying an inspection region frame corresponding to a desired content (object) among a plurality of contents (objects) will be described.

[0146] (Inspection Region Setting Screen) FIG. 16 is a diagram showing an example of an inspection region setting screen. FIG. 16(a) shows a case where all three types of Text, Graphic, and Image are checked, FIG. 16(b) shows a case where only two types of Graphic and Image are checked, and FIG. 16(c) shows a case where only one type of Graphic is checked. Note that FIGS. 16(a) to 16(c) are displayed, for example, on the inspection region display unit 810 of the inspection region setting screen 800.

[0147] When the right button of the mouse is clicked by a user operation within the reference image area displayed in the inspection area display section on the inspection area setting screen, a pop-up menu 1640 is displayed. The pop-up menu 1640 has three types of items 1641, 1642, and 1643, namely Text, Graphic, and Image, each having a check box. An inspection area frame corresponding to the type of content (type of object) that is checked is displayed, and no frame is displayed for the inspection area of an attribute that is not checked.

[0148] When all three types of content items 1641, 1642, and 1643 of Text, Graphic, and Image are checked, as shown in Fig. 16(a), inspection area frames corresponding to all three types of content are displayed. That is, one inspection area frame 1611 corresponding to the text content is displayed. Four inspection area frames 1612, 1613, 1614, and 1615 corresponding to the graphic content are displayed. Further, three inspection area frames 1616, 1617, and 1618 corresponding to the image content are displayed.

[0149] When the two types of content items 1642 and 1643 of Graphic and Image are checked, as shown in Fig. 16(b), inspection area frames corresponding to the two types of content items 1642 and 1643 of Graphic and Image are displayed. That is, four inspection area frames 1622, 1623, 1624, and 1625 corresponding to the graphic content are displayed. Further, three inspection area frames 1626, 1627, and 1628 corresponding to the image content are displayed. Note that the inspection area frame corresponding to the Text content item 1641 is not displayed.

[0150] When only item 1642 of one type of Graphic content is checked, as shown in Fig. 16(c), only the inspection area frame corresponding to Graphic is displayed. That is, four inspection area frames 1632, 1633, 1634, and 1635 corresponding to the graphic content are displayed. Note that the frames corresponding to items 1641 and 1643 of Text content and Image content are not displayed. Thus, it is possible to determine that the butterflies at the four corners of the reference image are graphics. The user can freely change the inspection level at this location. In Fig. 7, the Text content 711 had "Level 1" set as the default inspection level 721, but here, it is possible to select any inspection area and change the inspection level of only the selected inspection area from 1 to another level.

[0151] (Display Processing of Inspection Area Range) Fig. 17 is a flowchart for explaining the display processing of the inspection area range (frame). In this process, the inspection area range (frame) becomes either a display state or a non-display state according to the content type. Note that the process shown in this flowchart is achieved by the CPU 226 of the inspection device 108 expanding and executing the program stored in the storage unit 228 in the RAM 227.

[0152] In S1701, the CPU 226 reads out the content type selected by the user operation. That is, it reads out the content type selected in the pop-up menu 1640. For example, as the selected content type, in the case of Fig. 16(a), text, graphic, and image are read out, in the case of Fig. 16(b), graphic and image are read out, and in the case of Fig. 16(c), graphic is read out.

[0153] In S1702, the CPU 226 determines whether all inspection areas in the inspection area list have been checked. If it is determined that all inspection areas in the inspection area list have been checked (YES in S1702), the flow shown in FIG. 17 ends. If it is determined that not all inspection areas in the inspection area list have been checked (NO in S1702), the process proceeds to S1703. That is, the processes from S1703 to S1706 are executed until all inspection areas in the inspection area list are processed.

[0154] In S1703, the CPU 226 extracts one inspection area from the inspection area list. In S1704, the CPU 226 determines whether the inspection area extracted in S1703 belongs to a group. If it is determined that the inspection area extracted in S1703 belongs to a group (YES in S1704), the process returns to S1702. If it is determined that the inspection area extracted in S1703 does not belong to a group (NO in S1704), the process proceeds to S1705.

[0155] In S1705, the CPU 226 determines whether the content type of the inspection area extracted in S1703 matches the selected content type read in S1701. If it is determined that they do not match (NO in S1705), the process returns to S1702. If it is determined that they match (YES in S1705), the process proceeds to S1706.

[0156] In S1706, the CPU 226 displays the inspection area frame on the screen according to the area coordinates of the inspection area extracted in S1703. After the process of S1706 ends, the process returns to S1702.

[0157] As described above, according to this embodiment, the inspection device 108 can easily confirm on the screen the inspection area frame corresponding to the content type that the user desires to display.

[0158] By the way, the appearance of the reference image and the content type do not necessarily match, and there may be a case where it is necessary to confirm whether the inspection level is appropriate. For example, when the area of the Text (character) content overlaps the area of the Image content, there may be a case where it is desired to determine whether the character part has been converted to an Image or is independent as Text content. In such a case, when the user selects the Text item 1641 in the pop-up menu 1640, a frame is displayed in the inspection area corresponding to the Text content, and it becomes possible to easily confirm the inspection area corresponding to the Text content on the screen.

[0159] <<Embodiment 3>> In this embodiment, in the inspection area setting screen, an aspect of checking the areas of a plurality of contents (objects) that constitute the grouped inspection areas or integrating the inspection areas of each of the selected plurality of groups will be described.

[0160] (Inspection Area Setting Screen) FIG. 18 is a diagram showing an example of an inspection area setting screen. Note that FIG. 18 is displayed, for example, in the inspection area display unit 810 of the inspection area setting screen 800.

[0161] In the reference image area displayed in the inspection area display section on the inspection area setting screen, when the frame of the inspection area is clicked by a user operation, the inspection area of interest is selected. Subsequently, when the right mouse button is clicked in the reference image area, a pop-up menu 1830 is displayed. The pop-up menu 1830 includes in-group content display 1831 and group integration 1832. When the in-group content display 1831 of the pop-up menu 1830 is clicked and selected by a user operation in a state where the inspection area is selected, individual inspection area frames (inspection area ranges) of a plurality of contents included in the group are displayed. That is, it is displayed in units of areas corresponding to the contents (objects) before grouping. Thereby, the user can confirm the inspection areas before and after grouping. FIG. 18(a) is a diagram showing an example of an inspection area setting screen. The inspection areas 1812 before and after grouping of the content "SCH003", which is a specific number of the customer management number, are displayed.

[0162] When the group integration 1832 in the above pop-up menu 1830 is clicked by a user operation, the grouped inspection areas being selected can be integrated into one to form a new inspection area. FIG. 18(b) is a diagram showing an example of an inspection area setting screen. In a state where the inspection areas 1812 and 1814 before grouping shown in FIG. 18(a) are selected, when the group integration 1832 in the pop-up menu 1830 is clicked by a user operation, it shows that they have been integrated into a new group 1821 to form a new inspection area. In this embodiment, the pop-up menu 1830 is used for explanation, but it may also be configured such that the pop-up menu 1830 is displayed as a fixed menu, and its display form is not limited.

[0163] (Display processing of inspection area range) FIG. 19 is a flowchart for explaining the display process of the inspection area range. That is, in the display process, processes such as displaying the inspection areas of the contents included in the group or integrating and displaying a plurality of groups are performed. The process shown in the flowchart is achieved by the CPU 226 of the inspection device 108 expanding and executing the program stored in the storage unit 228 in the RAM 227.

[0164] In S1901, the CPU 226 reads out the item selected by the user operation in the pop-up menu 1830. That is, the display of the contents within the group or the group integration is read out as the selected item. Subsequently, in S1902, the CPU 226 determines the type of the selected item. If it is determined that the selected item is "group integration", the process proceeds to S1903.

[0165] In S1903, the CPU 226 generates the coordinates of the inspection area of the newly created group (new inspection area) that includes all the selected groups from the inspection areas of the currently selected multiple groups. Note that the new inspection area has a size that includes all the selected groups. In S1904, the CPU 226 adds the group integrated in S1903 to the inspection area list. In S1905, the CPU 226 updates the group area number of each inspection area belonging to the selected group to the newly added group number and makes it belong to the new group. In S1906, the CPU 226 deletes the group before integration from the inspection area list.

[0166] Returning to the description of the process of S1902. In S1902, if it is determined that the selected item is "display of the contents within the group", the process proceeds to S1907. In S1907, the CPU 226 acquires the inspection area belonging to the selected group from the inspection area list. In S1908, the CPU 226 displays the inspection area frame on the screen of the display unit 245 according to the area coordinates of the inspection area acquired in S1907. Note that when the process of S1906 or S1908 ends, the flow shown in FIG. 19 ends.

[0167] As described above, according to the present embodiment, the inspection apparatus 108 can easily confirm on the screen the inspection area desired by the user. Also, group integration can be easily executed.

[0168] (Other Embodiments) The present disclosure can also be realized by supplying a program that realizes one or more functions of the above-described embodiment to a system or apparatus via a network or a storage medium, and causing one or more processors in the computer of the system or apparatus to read and execute the program. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

[0169] The disclosure of the present embodiment includes the following configuration examples. (Configuration 1) An information processing apparatus for inspecting a printed matter, extraction means for extracting a corresponding area for each object based on the object type indicated by content information for identifying an object included in the printed matter; setting means for grouping a plurality of the areas that meet the conditions for grouping among the plurality of the areas extracted by the extraction means and setting them as an inspection area for performing the inspection; An information processing apparatus comprising the above and characterized by the above. (Configuration 2) The conditions include at least one of the object types being the same, the object sizes being the same, the object arrangement directions being the same, the object colors being the same, the distance to an adjacent object being equal to or less than a predetermined value, and the periphery of the object being equal to or less than a predetermined value. The information processing apparatus according to Configuration 1, characterized by the above. (Configuration 3) further comprising acquisition means for acquiring the content information The information processing apparatus according to Configuration 1 or 2, characterized by the above. (Configuration 4) The content information indicates the type of the object for each pixel. The information processing apparatus according to any one of Configurations 1 to 3, characterized in that. (Configuration 5) The information processing apparatus according to any one of Configurations 1 to 4, characterized in that an inspection level indicating the accuracy of the inspection is set in association with the type of the object. (Configuration 6) The information processing apparatus according to any one of Configurations 1 to 5, further comprising display control means for displaying the inspection area set by the setting means on a UI screen. (Configuration 7) The display control means superimposes and displays the inspection area on the image of the printed matter and a reference image for comparison in the inspection on the UI screen. The information processing apparatus according to Configuration 6, characterized in that. (Configuration 8) The display control means displays detailed information regarding the inspection area. The information processing apparatus according to Configuration 6 or 7, characterized in that. (Configuration 9) The display control means displays, as the detailed information, the type of the object in the inspection area in association with the inspection level of the inspection area. The information processing apparatus according to Claim 8, characterized in that. (Configuration 10) The display control means displays the inspection area in the image of the printed matter and the inspection area in the reference image for comparison in the inspection in association with the detailed information regarding the inspection area. The information processing apparatus according to Configuration 8 or 9, characterized in that. (Configuration 11) The display control means displays the range of the inspection area corresponding to the specified type of object. The information processing apparatus according to any one of Configurations 6 to 10, characterized in that. (Configuration 12) The display control means displays the selected inspection area in units of areas corresponding to the objects before grouping. The information processing apparatus according to any one of Configurations 6 to 11, characterized by the above. (Configuration 13) The information processing apparatus according to any one of Configurations 1 to 12, characterized in that the setting means integrates a plurality of selected regions into one inspection region according to a user operation. (Configuration 14) The object is any one of characters, graphics, images, and groups. The information processing apparatus according to any one of Configurations 1 to 13, characterized by the above. (Configuration 15) An information processing method for inspecting a printed matter, an extraction step of extracting a corresponding region for each object based on the object type indicated by content information for specifying an object included in the printed matter; a setting step of grouping a plurality of the regions that meet the conditions for grouping among the plurality of regions extracted in the extraction step and setting them as an inspection region for performing the inspection; An information processing method characterized by including the above. (Configuration 16) A program for causing a computer to function as each step of the information processing method according to Configuration 15.

Claims

1. An information processing apparatus for inspecting printed matter, comprising: extraction means for extracting a corresponding area for each object based on an object type indicated by content information for identifying an object included in the printed matter; setting means for grouping a plurality of the areas that meet the conditions for grouping among the plurality of areas extracted by the extraction means and setting them as inspection areas for performing the inspection; An information processing apparatus, characterized by comprising the above.

2. The condition includes at least one of the following: the types of the objects are the same, the sizes of the objects are the same, the arrangement directions of the objects are the same, the colors of the objects are the same, the distance from an adjacent object is equal to or less than a predetermined value, and the periphery of the object is equal to or less than a predetermined value. The information processing apparatus according to claim 1, characterized by the above.

3. The information processing apparatus according to claim 1, further comprising acquisition means for acquiring the content information. The information processing apparatus according to claim 1, characterized by the above.

4. The content information indicates the type of the object for each pixel. The information processing apparatus according to claim 1, characterized by the above.

5. The information processing apparatus according to claim 1, characterized in that an inspection level indicating the accuracy of the inspection is set in association with the type of the object.

6. The information processing apparatus according to claim 1, further comprising display control means for displaying the inspection area set by the setting means on a UI screen.

7. The display control means superimposes and displays the inspection area on an image of the printed matter and a reference image for comparison in the inspection on the UI screen. The information processing apparatus according to claim 6, characterized by the above.

8. The display control means displays detailed information about the inspection area. The information processing apparatus according to claim 6, characterized by the above.

9. The display control means displays, as the detailed information, the type of the object in the inspection area and the inspection level of the inspection area in association with each other. The information processing apparatus according to claim 8, characterized by the above.

10. The display control means displays the inspection area in the image of the printed matter and the reference image for comparison in the inspection and the detailed information about the inspection area in association with each other. The information processing apparatus according to claim 8, characterized by the above.

11. The information processing apparatus according to claim 6, wherein the display control means displays the range of the inspection area corresponding to the specified object type.

12. The information processing apparatus according to claim 6, wherein the display control means displays the selected inspection area in units of areas corresponding to the objects before grouping.

13. The information processing apparatus according to claim 1, wherein the setting means integrates a plurality of selected areas into one inspection area according to a user operation.

14. The object is any one of characters, graphics, images, and groups This is the information processing apparatus according to claim 1.

15. An information processing method for inspecting a printed matter, An extraction step of extracting a corresponding area for each object based on the object type indicated by content information for specifying an object included in the printed matter, A setting step of grouping a plurality of the areas that meet the conditions for grouping among the plurality of areas extracted in the extraction step and setting them as inspection areas for performing the inspection, An information processing method characterized by including:

16. A program for causing a computer to execute each step of the information processing method according to claim 15.

Citation Information

Patent Citations

  • Inspection device, method for controlling inspection device, and program

    JP2023031658A