Inspection Systems

Abstract

To solve such problems that the time and effort increase since designation of an inspection region and an inspection level are received by manual input of a user from an application of an inspection device, and the time required for designation of the inspection region and the inspection level becomes longer every time an inspection spot increases.SOLUTION: An inspection system includes a printer and an inspection device which performs an inspection by comparing an image of a printed matter printed by the printer with a reference image. The inspection device extracts a region corresponding to a content type on the basis of the content information of the reference image, sets an inspection level to the extracted region and presents the extracted region and the set inspection level to a user in association with the reference image.SELECTED DRAWING: Figure 11

Description

Technical Field

[0001] The present invention relates to an inspection system, an inspection apparatus and its control method, and a program.

Background Art

[0002] There is known an inspection apparatus that reads a printed matter printed by a printing apparatus and inspects the quality of an image printed on the printed matter. The inspection apparatus can detect image defects such as dirt and printing omission. It is also common to detect the type of these image defects and set a threshold value for detecting as an image defect for each detected type. For example, in the case of a dot that is a circular image defect, it is common to set a threshold value in the inspection apparatus for what diameter or more is to be regarded as an image defect.

[0003] In these inspections, a method is adopted in which an image without defects, called a reference image, is used as a comparison target, and this reference image is compared with the image of the printed matter. In this case, the reference image is obtained by printing and scanning one or several parts in advance from the print job to be inspected, and after the user confirms that there is no dirt or character error in these printed parts, using the image data obtained by scanning these printed matters as the reference image.

[0004] Also, in inspections, since the print quality required by the user or the print job is different, it is desirable to be able to set the area to be inspected and the threshold value (in the application, this inspection threshold value is called the inspection level, and the higher the level, the smaller the defect that can be detected). For example, when printing a photo album for a sports meet or a trip, the customer desires to be able to inspect whether there is no dirt on the face part because the customer pays attention to people's faces. Also, there may be a case where it is desired to set an inspection area for characters in order to perform an inspection on whether fine lines are printed as expected for fine characters. Patent Document 1 describes a technique for allowing a user to input and specify the area to be inspected and its level with respect to the reference image.

Prior Art Documents

Patent Documents

[0005] [Patent Document 1] Japanese Patent Publication No. 2021-078082 [Overview of the project] [Problems that the invention aims to solve]

[0006] However, with conventional technology, specifying the inspection area and inspection level (quality control level) requires manual input from the user, which is time-consuming for the user. Furthermore, the more inspection points there are, the longer it takes to specify the inspection area and inspection level.

[0007] The object of the present invention is to solve at least one of the problems of the prior art described above.

[0008] The objective of this invention is to provide a technology that automatically sets the inspection area and inspection level based on information contained in a reference image. [Means for solving the problem]

[0009] To achieve the above objective, an inspection system according to one aspect of the present invention has the following configuration. That is, An inspection system comprising a printing device and an inspection device that performs inspection by comparing an image of a printed material printed by the printing device with a reference image, The inspection device, An extraction means for extracting a region corresponding to a content type based on the content information of the aforementioned reference image, A first setting means for setting an inspection level in the region extracted by the extraction means, The presenting means is characterized by having a presentation means that presents to the user, in association with the reference image, the region extracted by the extraction means and the inspection level set by the first setting means. [Effects of the Invention]

[0010] According to the present invention, there is an effect of shortening the inspection time by eliminating the need for the user to set the inspection area and inspection level.

[0011] Other features and advantages of the present invention will become apparent from the following description with reference to the accompanying drawings. In the accompanying drawings, the same or similar components are given the same reference numeral. [Brief explanation of the drawing]

[0012] The attached drawings are included in the specification and constitute part thereof, illustrating embodiments of the present invention and are used together with the description to explain the principles of the present invention. [Figure 1] A diagram showing the configuration of an inspection system according to Embodiment 1 of the present invention. [Figure 2] A block diagram illustrating the configuration of a printing apparatus, inspection apparatus, large-capacity stacker, information processing apparatus, and client computer according to this embodiment 1. [Figure 3] A schematic cross-sectional view illustrating the internal configuration of the printing apparatus, inspection unit, and large-capacity stacker according to Embodiment 1. [Figure 4] This figure shows an example of a screen for setting inspection parameters displayed in the inspection device according to Embodiment 1. [Figure 5] This figure shows an example of an inspection status screen displayed on the display unit during inspection in the inspection device according to Embodiment 1. [Figure 6] A flowchart illustrating the process when the inspection device according to Embodiment 1 registers a reference image. [Figure 7] A flowchart illustrating the inspection process using the inspection device according to Embodiment 1. [Figure 8] This figure shows an example of a screen for setting inspection levels, which is used to set the inspection level for content types when performing inspections with the inspection device according to Embodiment 1. [Figure 9] A diagram showing an example of a table for inspection settings, inspection level, and inspection area settings in Embodiment 1. [Figure 10] A diagram showing an example of the reference image and content information created in Embodiment 1. [Figure 11]A diagram showing an example of a screen for showing a user the inspection area on the inspection device according to Embodiment 1. [Figure 12] A flowchart (A) for explaining the process when setting the inspection area executed by the inspection device according to Embodiment 1, a flowchart (B) for explaining the process that the inspection device according to Embodiment 2 executes instead of S1204, and a flowchart for explaining the process that is executed instead of S1204 in Embodiment 3. [Figure 13] A diagram showing an example of a screen for showing a user a plurality of different inspection areas of the same content type by the inspection device according to Embodiment 2. [Figure 14] A diagram showing an example of a user interface screen displayed on the display unit of the inspection device according to Embodiment 3. [Figure 15] A flowchart for explaining the process when performing an inspection by comparing an image of an inspection target and a reference image by inspection according to Embodiment 1.

Embodiments for Carrying Out the Invention

[0013] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the invention according to the claims. Although a plurality of features are described in the embodiments, not all of these plurality of features are essential for the invention, and the plurality of features may be arbitrarily combined. Further, in the accompanying drawings, the same or similar configurations are denoted by the same reference numerals, and redundant descriptions are omitted.

[0014] Note that, unless otherwise specified, as long as the functions according to the present invention are realized, it may be a single device or an inspection device composed of a plurality of devices. Also, unless otherwise specified, as long as the functions of the present invention are realized, it may be an inspection device that is connected via a network such as a LAN (Local Area Network) or a WAN (Wide Area Network) and processes are performed. That is, the system configuration in which various terminals described in the following embodiments are connected is an example, and it is needless to say that there are various configuration examples according to the use and purpose.

[0015] Figure 1 is a diagram showing the configuration of an inspection system according to Embodiment 1 of the present invention.

[0016] This inspection system includes an information processing device 109, an inspection device 108, a printing device 101, and a client computer 110. In this embodiment 1, the printing device 101 is described using an electrophotographic printing device, but the printing device in embodiment 1 may be a printing device of a different image forming method, such as an inkjet or offset printing device. The printing device 101 is connected to the information processing device 109 via a cable 112. The information processing device 109 is connected to the client computer 110 via a network 113.

[0017] The printing device 101 includes a UI panel 102, a paper feed deck 103, and a paper feed deck 104. Furthermore, an optional deck 105 consisting of three paper feed decks is connected. The printing device 101 is, for example, an electrophotographic printing device. The UI panel 102 is a user interface equipped with, for example, a capacitive touch panel. The printing device 101 also includes an inspection unit 106 and a high-capacity stacker 107. The inspection unit 106 is connected to the inspection device 108 via a cable 114. The high-capacity stacker 107 includes a main tray and a top tray 320, and the main tray can hold several thousand sheets of paper at once.

[0018] Print jobs are generated on the client computer 110, transmitted to the information processing device 109 via the network 113, and managed by the information processing device 109. The print jobs are then transmitted from the information processing device 109 to the printing device 101 via the cable 112, and the printing device 101 performs the printing process on paper. Alternatively, print jobs may be generated and managed in the information processing device 109, transmitted to the printing device 101 via the network 112, and managed by the printing device 101. Furthermore, the client computer 110, the information processing device 109, and the inspection device 108 may be connected to the printing device 101 via the cable 112. The inspection device 108 may also be connected to the information processing device 109 and the client computer 110 via the network 113. In other words, the connection configuration of the printing device 101, the information processing device 109, and the client computer 110 shown in Embodiment 1 is just one example, and it goes without saying that there are various other connection configurations besides those shown in Embodiment 1. In addition to the inspection unit 106 and the large-capacity stacker 107, the printing device 101 may also be connected to a stapler, folding machine, bookbinding machine, and other devices.

[0019] Figure 2 is a block diagram illustrating the hardware configuration of the printing device 101, inspection device 108, large-capacity stacker 107, information processing device 109, and client computer 110 according to this embodiment 1.

[0020] First, let's explain the configuration of the printing device 101.

[0021] The CPU (Central Processing Unit) 201 controls and performs calculations in various parts of the printing device 101 via the system bus 212. The CPU 201 is stored in the memory unit 205 and is responsible for executing programs loaded into the RAM (Ramdom Access Memory) 202. The RAM 202 is a type of general volatile memory that can be directly accessed by the CPU 201 and is used as the CPU 201's work area or other temporary data storage area. The memory unit 205 functions as a temporary storage area and work memory during the operation of the printing device.

[0022] The engine interface 209 is responsible for communication and control with the printer engine 210. The paper feed deck interface 204 is responsible for communication and control with the paper feed deck 211. The paper feed deck 211 is a hardware configuration that collectively refers to the paper feed decks 103, 104 and the optional deck 105 shown in Figure 1. The UI panel 203 is the hardware configuration of the UI panel 102 shown in Figure 1 and is a user interface for performing all operations of the printing device 101. In this embodiment 1, the UI panel 203 is equipped with a capacitive touch panel.

[0023] The network interface (hereinafter referred to as NWI / F) 207 is connected to the NWI / F 238 of the information processing device 109 via cable 213 and is responsible for communication between the information processing device 109 and the printer 101. In this example, the interfaces connected to the system buses 212 and 239 are directly connected, but the information processing device 109 and the printer 101 may be connected by a network, for example, and the connection method is not limited. The video interface 206 is connected to the video interface 233 via video cable 241 and is responsible for the communication of image data between the information processing device 109 and the printer 101.

[0024] Furthermore, the connection interface between the information processing device 109 and the printing device 101 may be a form that integrates the functions of NWI / F238 and video I / F233. Also, the connection interface between the printing device 101 and the information processing device 109 may be a form that integrates the functions of NWI / F207 and video I / F206.

[0025] Accessory I / F 208 connects to accessory I / F 214 and accessory I / F 220 via cable 225. That is, the printing device 101 communicates with the inspection unit 106 and the large-capacity stacker 107 via accessory I / F 208, 214, and 220.

[0026] Next, I will explain the configuration of the inspection unit 106.

[0027] The CPU 216 is stored in the memory unit 247 and executes programs deployed in the RAM 217, controlling and performing calculations in various parts of the inspection unit 106 via the system bus 219. The RAM 217 is a type of general volatile memory that can be directly accessed from the CPU 216 and is used as the CPU 216's work area or other temporary data storage area. The memory unit 247 functions as a temporary storage area and work memory during the operation of the inspection device 108. The inspection device I / F 215 is connected to the inspection device unit I / F 231 via cable 249. That is, the inspection unit 106 communicates with the inspection device 108 via the inspection device I / F 215 and the inspection device unit I / F 231.

[0028] The imaging unit 218 is equipped with an imaging function, for example, a contact image sensor (hereinafter referred to as CIS), and photographs the paper passing through the inspection unit 106, and transmits the captured image to the inspection device 108 via the inspection device I / F 215. Note that the CIS for the imaging unit 218 is just one example of a sensor, and other types of sensors such as CCD image sensors may also be used, and the imaging method is not limited. There are two purposes for transmitting the captured image. One is to photograph the printed material of the print job to be inspected, regardless of the inspection method, and transmit it to the inspection device 108 for inspection. The other is, when the inspection method is scan inspection, to print and photograph one or more copies of the print job to be inspected in advance to create a reference image, and transmit the captured image data as a reference image to the inspection device 108. The inspection device 108 stores the transmitted image data as a reference image in the storage unit 228.

[0029] Next, we will explain the configuration of the large-capacity stacker 107.

[0030] The CPU 221 is stored in the memory unit 248 and executes programs loaded into the RAM 222, controlling and performing calculations on various parts of the large-capacity stacker 107 via the system bus 224. The RAM 222 is a type of general volatile memory that can be directly accessed by the CPU 221 and is used as the CPU 221's work area or other temporary data storage area. The memory unit 248 functions as a temporary storage area and work memory during the operation of the large-capacity stacker 107. The paper output unit 223 is responsible for paper output operations to the main tray and top tray 320, as well as monitoring and controlling the loading status of the main tray and top tray, respectively.

[0031] Next, the configuration of the inspection device 108 will be explained.

[0032] The CPU 226 is stored in the memory unit 228 and executes programs loaded into the RAM 227, controlling and performing calculations on various parts of the inspection device 108 via the system bus 230. The RAM 227 is a type of general volatile memory that can be directly accessed by the CPU 226 and is used as the CPU 226's work area or other temporary data storage area. The memory unit 228 functions as a temporary storage area and work memory during the operation of the inspection device 108. The PDL analysis unit 229 reads PDL data, such as PDF, PostScript, and PCL, received from the client computer 110 or the information processing device 109 and performs interpretation processing. The display unit 245 is a display, such as a liquid crystal, connected to the inspection device 108, and accepts user input to the inspection device 108 and displays the status of the inspection device 108.

[0033] Next, the configuration of the information processing device 109 will be explained.

[0034] The CPU 234 is stored in the memory unit 236 and executes programs loaded into the RAM 235 to control and perform calculations on various parts of the information processing device 109 via the system bus 239. The RAM 235 is a type of general volatile memory that can be directly accessed by the CPU 234 and is used as the CPU 234's work area or other temporary data storage area. The memory unit 236 functions as a temporary storage area and work memory during the operation of the information processing device 109. The network interface (hereinafter referred to as NWI / F) 237 is connected to the NWI / F 240 via the network, and the information processing device 109 communicates with the client computer 110 via the NWI / F 237 and NWI / F 240.

[0035] Alternatively, the inspection device 108 may have an NWI / F, and the information processing device 109 may communicate with the inspection device 108 via the NWI / F and NWI / F237. For example, consider the case where RIP inspection is used as the inspection method, and the RIP image used for printing by the printing device 101 is used as the reference image. In this case, the reference image may be transmitted to the inspection device 108 via the inspection device I / F215. Alternatively, it may be transmitted to the inspection device 108 via the NWI / F provided by the inspection device 108, through the NWI / F207 of the printing device 101 or the NWI / F237 of the information processing device 109.

[0036] Next, the configuration of the client computer 110 according to Embodiment 1 will be described.

[0037] The CPU 243 executes programs stored in the memory unit 245 and loaded into the RAM 242, performing control and calculations of various parts within the client computer 110 via the system bus 246. The RAM 242 is a type of general volatile memory that can be directly accessed by the CPU 243 and is used as the CPU 243's work area or other temporary data storage area. The memory unit 244 functions as a temporary storage area and work memory during the operation of the client computer 110.

[0038] Figure 3 is a schematic cross-sectional view illustrating the internal configuration of the printing apparatus 101, inspection unit 106, and large-capacity stacker 107 according to Embodiment 1.

[0039] The printing device 101 accepts user input via the UI panel 102 and displays the printing and device status. Various types of paper can be stored in the paper feed decks 103 and 104. Each paper feed deck can separate only the top sheet of paper stored and transport it to the paper transport path 305. The developing stations 301 to 304 use colored toners Y, M, C, and K respectively to form a toner image in order to form a color image. The toner image formed here is first transferred to the intermediate transfer belt 306. The intermediate transfer belt 306 rotates clockwise in Figure 3, and at the secondary transfer position 307, the toner image is transferred to the paper transported from the paper transport path 305. The fixing unit 308 is equipped with a pressure roller and a heating roller, and as the paper passes between the rollers, the toner is melted and pressed, fixing the toner image to the paper. The paper that has passed through the fixing unit 308 is transported to the transport path 312 via the paper transport path 309. If further melting and pressing are required for fixing depending on the type of paper, the paper that has passed through the fixing unit 308 is transported to the second fixing unit 310 using the paper transport path above, where additional melting and pressing are performed, and then it is transported to the transport path 312 via the paper transport path 311. Also, if the image forming mode is double-sided, the paper is transported to the paper inversion path 313, inverted, and then transported to the double-sided transport path 314, where the second image transfer is performed at the secondary transfer position 307.

[0040] Inside the inspection unit 106, CIS315 and 316 are arranged facing each other. CIS315 is a sensor for reading the top surface of the paper, and CIS316 is a sensor for reading the bottom surface of the paper. When the paper transported on the paper transport path 317 reaches a predetermined position, the inspection unit 106 scans the paper using CIS315 and 316. The image data obtained by the scan is transmitted to the inspection device 108 via the inspection device I / F215 and inspection unit I / F231. The CPU 226 of the inspection device 108 determines whether there are defects in the scanned image data thus received, and notifies the inspection unit 106 of the result of the determination again via the inspection unit I / F231 and inspection device I / F215. The CPU 216 of the inspection unit 106 notifies the large-capacity stacker 107 of the received determination result via the accessory I / F214 and 220.

[0041] The high-capacity stacker 107 has a main tray 324 as a tray for stacking paper. Paper that has passed through the inspection unit 106 enters the high-capacity stacker 107 via the paper transport path 319. The paper is loaded onto the main tray 324 via the paper transport path 322 from the paper transport path 319. Furthermore, the high-capacity stacker 107 has a top tray 320 as an output tray. The CPU 221 discharges paper that has been detected as defective by the inspection device 108 to the top tray 320. When outputting to the top tray 320, the paper is transported from the paper transport path 319 to the top tray 320 via the paper transport path 321. The inversion unit 323 is used to invert the paper. The inversion unit 323 is used when loading paper onto the main tray 324. When loading paper onto the main tray 324, the paper is inverted once in the inversion unit 323 so that the orientation of the incoming paper and the orientation of the paper when loaded are the same. When transporting to the top tray 320, the paper is ejected without being flipped during loading, so the reversal operation at the reversal unit 323 is not performed.

[0042] Figure 4 shows an example of a screen for setting inspection parameters displayed on the inspection device 108 according to Embodiment 1.

[0043] Figure 4(A) shows an example of a screen for setting the operating mode of the inspection device 108.

[0044] The operation mode setting screen 401 is displayed on the display unit 245 and accepts operation mode settings from the user. When "Log Mode" is selected in the operation mode setting unit 402, the printer 101 ejects the inspected paper to the output destination specified in the print job properties, regardless of the inspection results from the inspection device 108.

[0045] On the other hand, if "Purge Mode" is selected in the operation mode setting unit 402, the printer 101 ejects the paper that fails inspection into the top tray 320 of the large-capacity stacker 107. Also, if "Scan Inspection" is selected in the inspection method setting unit 404, the inspection device 108 uses the image data obtained by scanning the printed material as the reference image for inspection. When "RIP Inspection" is selected, the inspection device 108 uses the RIP (Routine Image Processing) image obtained by analyzing the PDL data used by the printer 101 for printing (Routine Image Processing is obtained by analyzing document data and image data expressed in a page description language, etc., and converting them into a bitmap format that can be printed by the printer) as the reference image. The generation and storage process of this reference image will be described later with reference to the flowchart in Figure 6.

[0046] In Figure 4(A), "Purge Mode" is selected in the operation mode setting unit 402, and "RIP Inspection" is selected in the inspection method setting unit 404.

[0047] Figure 4(B) shows an example of the recovery settings screen for purge mode in the inspection device 108.

[0048] If "Purge Mode" is selected in the operation mode setting unit 402, the recovery mode setting in the recovery mode setting unit 403 is also reflected. The recovery mode setting unit 403 is displayed on the display unit 245 and accepts recovery mode settings from the user. If "No Recovery Mode" is selected in the recovery mode setting unit 403, the printer 101 ejects only the paper with a failed inspection result into the top tray 320. The printer 101 and inspection unit 108 then continue to inspect subsequent paper as usual.

[0049] On the other hand, if "Recovery Mode (Recovery Enabled)" is selected in the recovery mode setting unit 403, the printer 101 ejects all paper that failed inspection and any subsequent paper that was loaded into the machine at the time the inspection device 108 determined that the inspection result was NG into the top tray 320. After that, once there is no more paper in the paper transport path, the printer 101 and inspection device 108 resume printing and inspection from the image printed on the paper that failed inspection.

[0050] In this embodiment 1, the inspection device 108 performs inspection by capturing images with the CIS315 and 316 of the inspection unit 106 while printing is being performed by the printer 101. Therefore, when the inspection device 108 determines that a certain sheet of paper has failed inspection, subsequent sheets of paper may have already reached the paper transport path 309 or 311. However, unless all the paper in the paper transport path is ejected, the image printed on the sheet with the failed inspection result cannot be reprinted and loaded in the correct output order to the output destination specified in the print job. Therefore, this operation is performed in "recovery mode".

[0051] The CPU 226 notifies the inspection unit 106 of the operation mode, recovery mode, and inspection method set in the operation mode setting unit 402, recovery mode setting unit 403, and inspection method setting unit 404 in Figure 4, via the inspection unit I / F 231 and inspection device I / F 215. The operation mode, recovery mode, and inspection method set in the operation mode setting unit 402, recovery mode setting unit 403, and inspection method setting unit 404 are saved by the CPU 226 to RAM 227 and by the CPU 216 to RAM 217, respectively.

[0052] In Figure 4(B), "Recovery Mode" is selected in the recovery mode setting unit 403.

[0053] Figure 4(C) shows an example of the screen for setting inspection criteria in the inspection device 108.

[0054] The inspection criteria setting screen 405 is displayed on the display unit 245 and accepts the user's setting of inspection criteria for the inspection device 108. By selecting an inspection level (not shown) on the inspection application, the inspection criteria setting screen is displayed for each inspection level, as described later. The inspection criteria are the criteria for determining whether an inspection is NG (Not Good), and represent the difference between the print result and the reference image as a distance. In this embodiment 1, the difference between the print result and the reference image represents the difference between the RIP image and the printed material due to positional misalignment and characteristics of the printing device, as described later. The inspection device 108 determines that the inspection is OK if the difference between the print result and the reference image is less than the upper limit reference value 406. The upper limit reference value 406 is used in common for scan inspection and RIP inspection. The lower limit reference value 407 is effective when the inspection method setting 404 is RIP inspection.

[0055] Embodiment 1 proposes a process for selecting a desirable reference image in order to eliminate the discrepancies between the RIP image originating from the printing device and the printed material that occur during RIP inspection. This process will be described later with reference to the flowchart in Figure 6.

[0056] If the inspection method setting 404 is RIP inspection, the inspection device 108 determines whether the difference between the printed output and the reference image falls within the range of the upper limit reference value 406 and the lower limit reference value 407. If it is determined that the difference falls within the range of the upper limit reference value 406 and the lower limit reference value 407, the inspection device 108 presents a reference image selection screen, as described later, with reference to Figure 9, in order to accept a determination from the user.

[0057] In this embodiment 1, the difference between the printed result and the reference image was expressed as a distance as the inspection criterion, but different parameters such as color tone may also be presented as inspection criteria.

[0058] Figure 5 shows an example of the inspection status screen displayed on the display unit 245 when an inspection is performed in the inspection device 108 according to Embodiment 1.

[0059] The inspection status screen 501 is displayed on the display unit 245 and accepts requests to start or stop the inspection, as well as displaying the inspection status. The inspection button 502 accepts requests from the user to start or stop the inspection. When the inspection button 502 is pressed, the text on the button 502 changes to "Stop inspection" and the inspection status 503 changes to "Inspecting". When the inspection button 502 is pressed again, the text on the button changes to "Start inspection" and the inspection status 503 changes to "Stopped". Subsequently, the text on the inspection button 502 and the inspection status 503 toggle each time the inspection button 502 is pressed. Figure 5 shows the "Inspecting" state.

[0060] The inspection status screen 501 displays the number of inspected papers, the number of papers with a failed inspection result, the defect rate, and the number of occurrences of the cause of the failed inspection result in real time during the inspection. Note that the "Error" displayed on the inspection status screen 501 indicates the number of papers for which the inspection device 108 timed out and determined an error because the inspection was not completed within the predetermined inspection time, and which was determined to be equivalent to a failed inspection result.

[0061] In the Inspection NG List 504, each time an inspection result NG occurs, the following information is added: the paper number of the inspection result NG, information on whether the NG occurred on the front or back of the paper, the cause of the inspection result NG, the inspection date and time, and a link to the NG details screen (not shown). When "Details" is pressed in the details display, the display unit 245 displays a screen where the captured image with the inspection result NG, the location of the defect, etc., can be viewed. The causes of the inspection result NG here include misalignment, circular defects (dots), linear defects (streaks), etc. When comparing the scanned image and the reference image, misalignment is a defect where all or part of the image is misaligned overall, circular defects are a condition where dirt occurs in a circular shape only on the scanned image side, and linear defects are a condition where dirt occurs in a streaky or linear shape only on the scanned image side. In this way, the inspection device 108 can identify the type of detected defect from the characteristics of the defect and display it in the Inspection NG List 504. Note that these are just examples, and the types of defects that the inspection device 108 can detect are not limited to these. For example, if an image is drawn only on the reference image, and all or part of it is not drawn on the scanned image, this can be judged as an image defect and added to the inspection results as NG.

[0062] The following describes the processes that are characteristic of this embodiment 1, with reference to the flowchart.

[0063] Furthermore, the program for the printing device 101 related to this flow is stored in the storage unit 205 of the printing device 101, loaded into RAM 202, and executed by CPU 201. Similarly, the program for the inspection device 108 related to this flow is stored in the storage unit 228 of the inspection device 108, loaded into RAM 0227, and executed by CPU 226. The program for the information processing device 109 related to this flow is stored in the storage unit 236 of the information processing device 109, loaded into RAM 0235, and executed by CPU 234. Finally, the program for the client computer 110 related to this flow is stored in the storage unit 245 of the client computer 110, loaded into RAM 242, and executed by CPU 243.

[0064] Figure 10 shows an example of a reference image and content information created in Embodiment 1.

[0065] In Embodiment 1, the information processing device 109 or the printing device 101 transmits the reference image and content information to the inspection device 108 as inspection data. As described above, if the inspection method is scan inspection, the reference image 1001 is a scanned image of the printed material, and if the inspection method is RIP inspection, the reference image 1001 is a RIP image used by the printing device 101 for printing.

[0066] In the case of scan inspection, the reference image is image data obtained by scanning the printed material with the CIS315 and CIS316 of the inspection unit 106, with each pixel represented by an 8-bit digital signal. In the case of RIP inspection, the printing device 101 receives characters and image data described in PDL (Page Description Language) from the information processing device 109, and the CPU 201 performs RIP processing (Raster Image Processor) to create a RIP image (bitmap image). In the case of RIP inspection, the reference image is data created via RIP processing, with each pixel represented by an 8-bit digital signal. The printing device 101 uses this RIP image to perform printing.

[0067] In Embodiment 1, the PDL data received by the printing device 101 includes, for example, vector graphics 1005 such as lines and circles, bitmap images and raster images 1006, and characters 1007, as shown in the example in Figure 10(A). These are each drawn using different PDL commands, and the printing device 101 has an image range flag for each pixel to determine what kind of image processing to apply to the RIP image after the RIP processing that rasterizes the PDL commands before printing. The image range flag indicates which PDL command was used to generate the image object, such as lines or characters. In Embodiment 1, this image range flag is used as the content type to determine the inspection area. In Embodiment 1, there are three types of image range flags: Graphics, Image, and Text.

[0068] In Embodiment 1, the information processing device 109 creates content information from the PDL data.

[0069] Figure 10(B) shows a portion of the content information (upper left of the reference image). The content information is a data set (content type) in which the image range flag generated by the PDL command is assigned a number (0, 1 for graphic, 2 for image, 3 for text) to each pixel, and is the same size as the RIP image. The content types of the inspection system are not limited to these three types; new content other than the three above may be created from various print data, including PDL data, and defined as content types.

[0070] Figure 10(B) shows the image area flags for the upper left corner of the reference image 1001 in Figure 10(A). Pixels in the lined area are "1" indicating graphics, pixels in the other areas are "0", and pixels in the image area are "2" indicating content.

[0071] For example, let's consider the case where "human faces" is added as a content type. When printing photo albums of events such as sports days or trips, it is sometimes necessary to inspect human faces to check whether the skin tone is as expected, whether there are any extraneous circular defects, etc. In such cases, it is conceivable to run a face detection application on the information processing device 109, incorporate the extraction results into the content information, and then operate the inspection device 108. Furthermore, in the case of printed materials such as a group photo of participants in a travel photo album, the area of ​​the face to be extracted will be large, and it is undesirable to switch the inspection level for each individual face. Therefore, in Embodiment 1, the CPU 234 of the information processing device 109 runs a face recognition application to extract human faces. In Embodiment 1, the face detection application of the information processing device 109 interprets the bitmap image of the print data and detects the area of ​​a human face. Furthermore, through cooperation between the information processing device 109 and the inspection device 108, the CPU 226 of the inspection device 108 newly registers "human faces" as a content type according to user input and assigns the number "4". Furthermore, the CPU 234 of the information processing device 109 creates content information based on the image range flag. Next, the CPU 234 of the information processing device 109 replaces the pixels of the human face extracted by the information processing device 109 with the number "4". Then, the information processing device 109 sends this created content information to the inspection device 108.

[0072] The CPU 226 of the inspection device 108 records "human face" as the content type in the inspection settings table 900 shown in Figure 9(A). The CPU 226 also uses the inspection settings table 900 to display the content type "human face" on the interface shown in Figure 8 and determines the inspection level according to the user's input. Figures 8 and 9 will be described in more detail later.

[0073] In photo albums from events like sports days or trips, if a user prioritizes people's faces over other areas during inspection, they will set the inspection level higher than for other content types. For example, they might change the inspection level to "4". By registering a new content type with the information processing device 109 and inspection device 108, and setting its inspection level higher than other content types, the system can automatically inspect the areas of focus according to the user's intentions. Registering a new content type in this way not only allows for automatic inspection of areas of focus, but also satisfies the needs of users who do not wish to inspect certain areas by lowering the inspection level.

[0074] The inspection device 108 determines the inspection area for each content type as a rectangular region containing image objects created by the PDL command. Figure 10(C) is an enlarged view of the upper left portion of Figure 10(A). The determination of the rectangular region for each content type is performed by the following procedure. For example, the CPU 226 of the inspection device 108 extracts an independent region from the content information sent from the information processing device 109 (the white background area in Figure 10(C)). Here, from the extracted regions that have the same content type (1), the start and end coordinates of the lines of the image objects are obtained from the PDL command. In Figure 10(C), the start and end coordinates of the lines of image object 1 and image object 2 are shown. Similarly, the start and end coordinates of two image objects of a graphic whose content type is "1" are obtained. Next, from the start and end coordinates of these four image objects, the minimum X coordinate, the minimum Y coordinate, and the maximum X coordinate and Y coordinate are obtained.

[0075] The CPU 226 of the inspection device 108 uses the method described above to determine the rectangular region 1008 (starting point (1,1), ending point (12,12)) that contains the image object with the graphic content type shown in Figure 10(D). The starting coordinates of this rectangular region 1008 are determined by (minimum X coordinate, minimum Y coordinate), and the ending coordinates are determined by (maximum X coordinate, maximum Y coordinate).

[0076] The CPU 226 of the inspection device 108 determines a rectangular area for each content type from the content information sent from the information processing device 109, and creates a rectangular area from the beginning to the end of the page.

[0077] Figure 10(E) is a diagram showing content information 1002, which shows the inspection area for each content type. In Figure 10(E), the reference image 1001 includes the graphic portions 1008, 1009, 1014, and 1015 at the four corners, the image portions 1010, 1012, and 1013, and the character portion 1011. In this embodiment 1, the inspection device 108 obtains the inspection area for each content type from the reference image and content information and uses it for inspection.

[0078] Figure 6 is a flowchart illustrating the process when the inspection device 108 according to Embodiment 1 registers a reference image. The flowchart in Figure 6 is common to both scan inspection and RIP inspection. The process shown in this flowchart is realized by the CPU 226 executing a program loaded into RAM 227.

[0079] First, in S601, the CPU 226 receives an instruction from the user to start reading images when the inspection button 502 is pressed on the screen shown in Figure 5 on the display unit 245. Next, proceeding to S602, the CPU 226 repeats the process from S602 to S605 until the reference images for all sheets are stored. In S603, if the inspection method is scan inspection, the CPU 226 receives scan image data, which is a candidate for reference image data obtained by scanning with CIS 315 and CIS 316, from the inspection unit 106 via the inspection device I / F 215 and inspection unit I / F 231. On the other hand, if the inspection method is RIP inspection, the CPU 226 receives image data, which is a candidate for reference image data generated by the printing device 101 before printing, via the inspection device I / F 215 and accessory I / F 208. Furthermore, at this time, content information 1002, for example, shown in Figure 10(E), is received from the information processing device 109.

[0080] Next, the process proceeds to S604, where the CPU 226 registers the reference image data received in S603 as a reference image in the RAM 227. The inspection method is the one selected in the inspection method setting unit 404 in Figure 4(A) mentioned above.

[0081] In this embodiment 1, when the inspection method is RIP inspection, we propose a process to register an appropriate reference image using the RIP image and scanned image data based on the information set on the inspection criteria screen 405 in Figure 4(C). This process will be explained later in the flowchart in Figure 7.

[0082] Then, proceeding to S605, the CPU 226 repeats steps S602 to S605 until it has finished reading the images on all the sheets of paper. Once the images on all the sheets of paper have been read, proceed to S606, where the CPU 226 of the inspection device 108 receives an instruction from the user via the display unit 245 that image reading is complete.

[0083] The examples shown here are just examples, and for instance, the user's instruction to start image reading displayed on the display unit 245 of the inspection device 108 may be automatically executed in conjunction with the instruction to start printing on the printing device 101, the information processing device 109, or the client computer 110, and the form is not limited. Similarly, the user's instruction to stop image reading in S606 may be automatically executed in conjunction with the end of printing on the printing device 101, and the form is not limited.

[0084] Furthermore, if the inspection method is scan inspection, the inspection device 108 may, for example, read multiple images for the same page and register the combined result as a reference image.

[0085] Figure 7 is a flowchart illustrating the inspection process performed by the inspection device 108 according to Embodiment 1. The process shown in this flowchart is realized by the CPU 226 executing a program loaded into the RAM 227.

[0086] In S701, the CPU 226 receives the operating mode and recovery mode settings set in the operating mode setting unit 402 and the recovery mode selection unit 403 in Figure 4(A). The CPU 226 also receives the inspection method set in the inspection method setting unit 404. Next, proceeding to S702, the CPU 226 receives an instruction from the user to start reading an image via the display unit 245. Next, proceeding to S703, the CPU 226 proceeds to S704 if there is a paper to be inspected.

[0087] In S704, the CPU 226 receives image data obtained by scanning with CIS315 and CIS316 via the inspection unit I / F 231 and inspection device I / F 215. This image data is a scan of a printed document produced by a print job that generates the deliverable. The inspection device 108 performs inspection by comparing this scanned image data with a reference image determined in advance in the flowchart of Figure 5. In S705, the CPU 226 reads the reference image of the corresponding page, which was registered in S604, from the RAM 227. This reference image is based on the inspection method selected in the inspection method setting unit 404.

[0088] Next, the process proceeds to S706, where CPU226 compares the reference image acquired in S705 with the scanned image data of the object to be inspected, received in S704. In this comparison, first, characteristic points in the image are used as alignment reference points to align the image positions of the reference image and the scanned image data of the object to be inspected. Next, in the scanned image data of the object to be inspected, the four corners of the paper and the alignment reference points of the scanned image data are analyzed to detect any misalignment of the image relative to the paper. Then, the density values ​​of each region of the reference image and the scanned image data of the object to be inspected are compared pixel by pixel. If no difference is detected between the scanned image data and the reference image, the inspection result is considered OK. On the other hand, if a difference is detected, the inspection result is considered NG, and the details of the NG inspection result, as explained in Figure 5, are recorded according to the type of defect. Note that, in order to explain the basic inspection operation, the explanation here assumes that the inspection result is always NG when a difference is detected.

[0089] Next, the process proceeds to S707, where the CPU 226 determines whether the inspection was completed within the specified time. If the inspection is completed, the process proceeds to S708; otherwise, it proceeds to S709. This determination is performed because if the inspection is not completed and the inspection results are not output within a certain time, the subsequent sheets will be scanned by CIS 315 and 316, and there will be no time to acquire the scanned image data via the inspection unit I / F 231 and inspection device I / F 215. Also, if the purge mode is selected in the operation mode setting unit 402, the CPU 221 of the large-capacity stacker 107 switches the transport destination so that sheets deemed NG by the inspection device 108 are ejected to the top tray 320. The CPU 226 of the inspection device 108 needs to notify the CPU 221 of the large-capacity stacker 107 of the inspection result NG via the inspection unit I / F 231, inspection device I / F 215, accessory I / F 214, and accessory I / F 220 before the sheets reach a point where the transport destination cannot be switched.

[0090] Therefore, if the inspection cannot be completed within the specified time, the inspection result cannot be determined to be OK, and the CPU 226 of the inspection device 108 determines the inspection result to be an error, and the inspection result of the paper in question is determined to be equivalent to an inspection result of NG.

[0091] In S708, CPU226 determines whether the test result is NG. If it is NG, it proceeds to S709; otherwise, it proceeds to S716. In S709, CPU226 reads the operating mode stored in RAM227. Then, CPU226 determines whether the operating mode is purge mode. If it is purge mode, it proceeds to S710; otherwise, it proceeds to S715. In S710, CPU226 notifies CPU216 of the test unit 106 that the test result is NG via the test unit I / F231 and the test device I / F215.

[0092] Next, the process proceeds to S711, where the CPU 226 determines whether the recovery mode read from RAM 0227 is a "recovery mode" indicating a mode with recovery. If it is a recovery mode, the process proceeds to S712; otherwise, it proceeds to S715. In S712, the CPU 226 waits until it receives print stop information from the CPU 216 of the inspection unit 106 via the inspection unit I / F 231 and inspection device I / F 215. Once the CPU 226 receives print stop information in S712, the process proceeds to S713.

[0093] In S713, the CPU 226 reads the reference image corresponding to the paper with the inspection result NG from the RAM 227 and holds it as the image to be inspected next. Next, in S714, the CPU 226 notifies the CPU 216 of the inspection unit 106 to resume inspection via the inspection unit I / F 231 and inspection device I / F 215. Then, in S715, the CPU 226 adds information about the paper with the inspection result NG to the inspection NG list 504. Next, in S716, the CPU 226 repeats steps S703 to S716 until all paper has been inspected. Once all paper has been inspected, in S717 the CPU 226 receives a command from the user to stop reading images via the inspection button 502 on the screen shown in Figure 5.

[0094] The examples shown here are just examples, and for example, the user's instruction to start loading an image on the display unit 245 may be automatically performed in conjunction with the instruction to start printing on the printer 101, the information processing device 109, or the client computer 110, and the form is not limited. Similarly, the user's instruction to stop loading an image on the display unit 245 may be automatically performed in conjunction with the end of printing on the printer 101, and the form is not limited.

[0095] Figure 8 shows an example of the inspection level setting screen 800 for setting the inspection level for content types when performing inspection with the inspection device 108 according to Embodiment 1.

[0096] Figure 9 shows an example of the inspection setting table 900, the inspection level table 901, and the inspection area setting tables 902, 903, and 904 stored in the storage unit 228 of the inspection device 108 according to Embodiment 1.

[0097] The inspection level setting screen 800 in Figure 8 includes content type 801 and inspection level 802. In Embodiment 1, the content types include three types: graphics, images, and text. However, the content types are not limited to these three types and may include other types of content that indicate the content of the print data. In the example in Figure 8, the inspection levels for text, graphics, and images are set to 1, 2, and 3, respectively. The user can set the inspection level for each content type on this screen and press the OK button 804 to set the inspection level corresponding to each content type. The Cancel button 803 cancels the settings on this screen.

[0098] Figure 9(A) shows the inspection settings table 900, which records the inspection level for each content type used by the inspection device 108 when performing inspection, according to user input. The inspection settings table 900 stores the inspection levels for each content type set by the user on the screen in Figure 8.

[0099] Figure 9(B) shows the inspection level table 901. The inspection level table 901 includes the inspection level 907 and the defect threshold 908. The inspection threshold 908 set for each inspection level is recorded in the inspection level table 901 by the CPU 226 of the inspection device 108 in response to user input. This table 901 stores the inspection level and the thresholds used for inspecting circular defects, linear defects, and misalignment. In this embodiment 1, the settings for each inspection level are made possible on the inspection criteria setting screen described in Figure 4(C) above.

[0100] Figure 9(C) shows an example of a table 902 for setting inspection areas. The table 902 for setting inspection areas includes areas 909 and content types 910. At S603 in the flowchart of Figure 6, the CPU 226 receives content information 1002 from the information processing device 109 via the printer 101 through the inspection unit I / F 231. Alternatively, the acquisition of content information 1002 may take the form of the inspection device 108 having an NWI / F, and the information processing device 109 communicating with the inspection device 108 via the NWI / F 0237.

[0101] Furthermore, the CPU 226 extracts the areas for each content type contained in the content information 1002 in the flowchart of Figure 12(A), described later, and records the inspection level set by the inspection device 108 in the inspection area setting table 902. The area 909 in Figure 9(C) is a name given to make the areas for each content type easy for the user to understand on the user interface screen of Figure 11, described later. Since the content information exemplified in Embodiment 1 has all three types of content, the inspection area setting table 902 in Figure 9(C) is displayed in three rows. For example, if the content information only contains images and text, it will be recorded in two rows.

[0102] Figure 11 shows an example of a screen 1100 that displays the inspection area to the user in the inspection device 108 according to Embodiment 1.

[0103] The display unit 245 of the inspection device 108 displays this screen 1100 at S1210 when the flowchart in Figure 12(A), described later, is executed. This screen 1100 has an inspection area 1101 shown on the left side of the screen and detailed information 1102 shown on the right side of the screen. The inspection area 1101 is obtained from the content information 1002 by the flowchart described later in Figure 12(A). The display unit 245 displays each rectangular area (with information indicating the area) extracted for each content type included in the content information. At this time, the inspection device 108 displays a reference image together with the inspection area.

[0104] The number "3" 1108 indicates the page number of the displayed print data. When arrow buttons 1107 and 1109 are pressed, the inspection area and reference image of the previous or next page corresponding to the pressed arrow button will be displayed.

[0105] The inspection area setting list 1106 displays the inspection levels for each area of ​​the inspection area 1101 in a list format. At this time, the display unit 245 displays the inspection area setting table 902 stored in the storage unit 228. At this time, to make it clear which part of the inspection area 1101 the area displayed in the inspection area setting list 1106 represents, the rectangular area of ​​the inspection area 1101 is associated with the area for each content type in the inspection area setting and displayed using line types and colors. For example, the image area 1106 of the inspection area setting and the rectangular area 1105 of the inspection area image that indicate the same content type have the same line type and color. When the rectangular area 1105 of the inspection area is selected, the corresponding row of the image area in the inspection area setting list 1106 may be highlighted.

[0106] By pre-configuring the inspection settings, the user can set inspection levels for each content type, enabling the automatic setting of inspection areas as shown in Figure 11. If the settings for inspection area 1101 are as expected, the user presses the OK button 1103 to proceed to the inspection application execution screen shown in Figure 5. Pressing the Cancel button 1104 saves the reference image (not shown) to a list of saved reference images, and the inspection is canceled.

[0107] Figure 12(A) is a flowchart illustrating the process for setting the inspection area to be performed by the inspection device 108 according to Embodiment 1. This flowchart in Figure 12(A) is executed after the registration process of the reference image in Figure 6 is completed and before the inspection process shown in the flowchart in Figure 7 is started. The process shown in this flowchart is achieved by the CPU 226 executing the program loaded into RAM 227.

[0108] First, in S1201, the CPU 226 reads the inspection setting table 900 recorded in the storage unit 228 of the inspection device 108 to obtain the content type and the corresponding inspection level. Next, in S1202, the CPU 226 obtains the content information received after S601. The information processing device 109 and the inspection device 108 communicate with each other, and the content information will contain one of the content types pre-set in the inspection settings. Next, in S1203 and S1204, the CPU 226 scans from the beginning to the end of each page until the content information is read to the end, and extracts independent areas based on the content type. This extraction is performed using the method described in detail with reference to Figure 10. Once the content information is extracted to the end, and content information 1002 as shown in Figure 10(E) is obtained, the process proceeds to S1208. In S1208, the CPU 226 associates the extracted areas with the inspection level using the content type from the inspection settings.

[0109] In Embodiment 1, when the CPU 226 records in the inspection area setting table 902, it assigns the names "image area," "graphic area," and "text area" to the area column for each of the image, graphic, and text areas, respectively. The inspection level of each area in the inspection area setting table 902 of the storage unit 228 indicates the inspection level of the content area included in the content information. In Embodiment 1, the user can switch the content inspection level of the content information for each piece of content via the detailed information 1102 in Figure 11.

[0110] Next, in steps S1209, S1210, and S1211, the CPU 226 repeatedly reads the region information and inspection region settings until they are completely loaded, and displays the region information and inspection region settings as a screen 1100, for example, as shown in Figure 11. This concludes the explanation of Figure 12(A).

[0111] Based on the above explanation, the inspection process performed in S706 in Figure 7 will be explained with reference to the flowchart in Figure 15.

[0112] Figure 15 is a flowchart illustrating the process when performing an inspection by comparing the image of the object to be inspected with a reference image using the inspection procedure 108 according to Embodiment 1. This process corresponds to the process S706 in Figure 7.

[0113] First, in S1501, the CPU 226 acquires region information and inspection region settings for the reference image. Then, in S1502 to S1507, the process is repeatedly executed until the inspection of all region information and inspection region settings for the reference image is completed. In S1503, the CPU 226 compares the region to be inspected in the reference image with the corresponding region in the received image to be inspected. At this time, the inspection level corresponding to this region is read from RAM 227 or storage unit 228, and it is determined whether the difference between the region to be inspected in the reference image and the corresponding region in the received image to be inspected satisfies this inspection level. That is, if the difference satisfies the threshold of the inspection level, the process proceeds to S1505, and the inspection is deemed OK, and the process proceeds to S1507. Then, the process proceeds to S1502, where region information is acquired, and S1503 to S1504 are executed. After performing the inspection up to the last region, if all inspections are OK, the process proceeds to S1508, and the inspection result of the received image to be inspected is OK, and the process ends.

[0114] On the other hand, if the difference in S1504 does not satisfy the corresponding inspection level, the process proceeds to S1506, where the inspection result is determined to be NG, and the information is stored in the NG area. Then the process proceeds to S1508, where the inspection result of the received image to be inspected is recorded as NG, and this process is terminated.

[0115] In this case, if even one area did not meet the inspection level requirements, it was judged as NG. However, depending on the area, instead of immediately judging the inspection result as NG, the inspection of subsequent areas may be continued, and the final inspection result of the received image to be inspected may be determined based on the proportion of areas judged as NG, or the importance of the areas.

[0116] As described above, according to Embodiment 1, the inspection device can extract independent areas based on content information and automatically set the inspection level based on the content type. This eliminates the need for the user to manually set inspection areas, which was previously done in scan inspection and RIP inspection. Furthermore, it is possible to reduce the time required to set inspection areas and inspection levels when there are many inspection areas.

[0117] [Embodiment 2] In the above-described Embodiment 1, a method was explained for automatically setting the inspection area from the content type using the inspection settings 900 pre-set in the inspection device 108. In Embodiment 1, an inspection level was set for each content type included in the content information. However, there is a desire to assign different inspection levels to areas that users want to inspect, even if they are of the same content type, if they are independent and different areas.

[0118] Therefore, in Embodiment 2, when creating the inspection area setting table 902, we propose an inspection device 108 that allows independent areas to be assigned separate inspection levels. The overall system configuration, hardware configuration of each device, and software configuration of Embodiment 2 are the same as those of Embodiment 1 described above, so their explanation is omitted. The overall flow of the software processing is also basically the same as the flow described in Figures 6, 7, and 12(A) of Embodiment 1, so its explanation is omitted.

[0119] The flow for allocating independent areas as separate areas, which is a feature of this second embodiment, will be explained with reference to Figures 9(D), 12(B), and 13.

[0120] Figure 12(B) is a flowchart illustrating the process that the inspection device 108 according to this second embodiment performs in place of S1204.

[0121] Figure 13 shows an example of a screen displayed to the user by the inspection device 108 according to Embodiment 2, which shows multiple different inspection areas of the same content type. In Figure 13, the CPU 226 extracts independent and different areas of the same content type displayed in the detailed information 1102 as separate areas.

[0122] To illustrate using Figure 13(A) as an example, "Area 1" 1304, whose content type is graphics, and "Area 2" 1305, whose content type is graphics, are independent and different areas. Therefore, the CPU 226 determines that these are separate areas and records "Area 1" and "Area 2" as separate areas in the inspection area setting table 903, as shown in Figure 9(D).

[0123] In S1213, CPU226 extracts independent areas for each content type. Then, proceeding to S1205, CPU226 assigns numbers to the independent areas and records the content types in the inspection area setting table 903.

[0124] In this case, at S1210, the CPU 226 displays area information for areas with the same content type but independent areas on screen 1101 in Figure 13(A). Next, at S1211, the CPU 226 displays the values ​​from the inspection area setting table 903 of the storage unit 228 on inspection area setting 1308 in Figure 13(A).

[0125] Furthermore, while Embodiment 2 described an example where different areas can be set individually, when the user presses the batch information tab 1303, the CPU 226 displays the area information and inspection area settings for each content type in a batch, as shown in Figure 13(B).

[0126] As described above, according to Embodiment 2, the inspection device can extract independent and different areas based on content information, even if they are of the same content type, and can automatically set the inspection level based on the content type. Furthermore, depending on the user's selection, the area information and inspection level of the inspection area can be displayed collectively for each content type.

[0127] This allows users to set inspection levels for different areas, even if they are the same content type, in addition to the effects of Embodiment 1.

[0128] [Embodiment 3] In the above-described Embodiment 2, the inspection settings pre-configured in the inspection device 108 were used to extract different areas of the same content type, and the inspection level was automatically set based on the content type. In Embodiment 2, an inspection level was assigned and set for each different area included in the content information. However, when a user has many areas of the same content type, there is a desire to consolidate the areas to be inspected so that the number of areas to be inspected is less than or equal to a predetermined number.

[0129] Therefore, in Embodiment 3, when creating the inspection area setting table, we propose an inspection device that can group independent areas by content type so that the number of independent areas is less than a predetermined number, so as not to make the table complicated. The overall system configuration, hardware configuration of each device, and software configuration of this Embodiment 3 are the same as those of Embodiment 1 described above, so their explanation will be omitted. The overall flow of the software processing is also basically the same as the flow described in Figures 6, 7, and 12(A) of Embodiment 1, so the explanation will be omitted.

[0130] The flow for assigning independent areas as separate areas, which is a characteristic of Embodiment 3, will be explained with reference to Figures 9(E), 12(C), and 14.

[0131] Figure 12(C) is a flowchart illustrating the process performed in place of S1204 in this third embodiment.

[0132] Figure 14 shows an example of a user interface screen displayed on the display unit 245 of the inspection device 108 according to Embodiment 3.

[0133] Figure 14(A) shows an example screen according to Embodiment 3 in which multiple different rectangular areas of the same content type are grouped together and presented to the user in a predetermined number or less. Figure 14(B) shows an example user interface that presents the user with the maximum number of items to group for each content type. The user can change the maximum number of items in each group through this user interface. In Embodiment 3, the number of areas per group corresponding to each content type is set to be less than or equal to this maximum number. In the example in Figure 14(B), the maximum number of areas per group is 5 for text, 5 for graphics, and 5 for images.

[0134] Hereafter, we will explain using the area information 1402 in Figure 14(A) as an example. In S1213 in Figure 12(C), the CPU 226 scans the content information from the top left of the image, from the beginning to the end of the content information on a print page basis, and extracts independent areas corresponding to the content type. Next, in S1205, the CPU 226 assigns area names by assigning numbers to the extracted areas and assigns the content type to each area. Next, in S1206, the CPU 226 creates the area group 915 shown in Figure 9(E) at the timing when the content type changes. At this time, the area group includes the content type name and the area number, and when the content type changes, the CPU 226 creates and records the content type name and the number of the last assigned area number + 1 in the area group 915 of the inspection area setting table 904 in Figure 9(E).

[0135] In Embodiment 3, the CPU 226 retains the last region number assigned to the region group each time the content type is switched. The CPU 226 records the last region number assigned to each content type, for example, the number of image regions, in the same region group until it reaches a predetermined number of images set in Figure 14(B).

[0136] In S1210, the CPU 226 displays region information with independent areas on the user interface screen shown in Figure 14(A). Next, in S1211, the CPU 226 displays the values ​​from the inspection region setting table 904 stored in the storage unit 228 in the inspection region setting 1403 of Figure 14(A).

[0137] As described above, according to Embodiment 3, the inspection device can group multiple different areas of the same content type together in a predetermined number or less, and automatically set the inspection level for that group. This allows the user to group independent areas of the same content type together in a predetermined number or less, in addition to the effects of Embodiments 1 and 2 described above, and switch the inspection level on a group basis.

[0138] (Other embodiments) The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit (e.g., an ASIC) that implements one or more functions.

[0139] The present invention is not limited to the embodiments described above, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, the following claims are attached to make the scope of the invention public. [Explanation of symbols]

[0140] 101…Printing device, 106…Inspection unit, 107…High-capacity stacker, 108…Inspection device, 109…Information processing device, 110…Client computer, 201…(Printing device) CPU, 226…(Inspection device) CPU, 227…(Inspection device) RAM, 228…(Inspection device) Memory unit

Claims

1. An inspection system having a printing device and an inspection device that performs an inspection by comparing an image of a printed matter printed by the printing device with a reference image, a first setting means for automatically setting an inspection area in an area in which the content of the reference image is arranged; a second setting means for setting an inspection level in the inspection area; a display means for displaying to a user the reference image in which the inspection level and the inspection area are associated with each other; An inspection system comprising:

2. A method for detecting a content type and a content inspection level corresponding to each of the content types, comprising:

2. The inspection system according to claim 1, wherein the second setting means sets an inspection level for the inspection area that corresponds to a type of content of the reference image.

3. a third setting means for setting an inspection level in association with each of the plurality of content types; 3. The inspection system according to claim 2, wherein the storage means stores an inspection level in association with each of the plurality of content types set by the third setting means.

4. 4. The inspection system according to claim 2, wherein the display unit displays information indicating a type of content of the inspection area set in the reference image.

5. An inspection system as described in any one of claims 1 to 4, characterized in that the display means displays the inspection level set in the inspection area set in the reference image.

6. The inspection areas are numbered, 5. The inspection system according to claim 1, wherein the display means displays, in association with the number, the type of the content and the inspection level corresponding to the inspection area of ​​the number.

7. 3. The inspection system according to claim 2, wherein the display means displays the inspection areas corresponding to the types of the content together as one group.

8. a fourth setting means for setting a maximum number of the regions included in one group; 8. The inspection system according to claim 7, wherein the display means displays the number of the inspection areas included in one group so that the number is equal to or less than the maximum number.

9. Further comprising an extraction means for extracting an area in which the content is arranged and a type of the content based on content information of the reference image, the first setting means automatically sets the inspection area in an area in which the content extracted by the extraction means is arranged, 9. The inspection system according to claim 1, wherein the second setting means sets an inspection level for the inspection area according to a type of content of the area in which the content is arranged.

10. The inspection system described in Claim 9, characterized in that the content information of the reference image is received from the printing device which rasterizes and prints image data similar to the reference image.

11. Further comprising an information processing device that transmits image data to the printing device, 11. The inspection system according to claim 9, wherein the content information of the reference image is received from the information processing device that has created the image data of the reference image.

12. An inspection device that performs an inspection by comparing an image of a printed matter printed by a printing device with a reference image, a first setting means for automatically setting an inspection area in an area in which the content of the reference image is arranged; a second setting means for setting an inspection level in the inspection area; a display means for displaying to a user the reference image in which the inspection level and the inspection area are associated with each other; An inspection system comprising:

13. The apparatus further includes a storage means for storing a plurality of content types and inspection levels corresponding to each of the plurality of content types, 13. The inspection system according to claim 12, wherein the second setting means sets an inspection level for the inspection area that corresponds to a type of content of the reference image.

14. a third setting means for setting an inspection level in association with each of the plurality of content types; 14. The inspection system according to claim 13, wherein the storage means stores an inspection level in association with each of the plurality of content types set by the third setting means.

15. 15. The inspection system according to claim 13, wherein the display unit displays information indicating a type of content of the inspection area set in the reference image.

16. An inspection system as described in any one of claims 12 to 15, characterized in that the display means displays the inspection level set in the inspection area set in the reference image.

17. The inspection areas are numbered, 17. The inspection system according to claim 12, wherein the display means displays the type of the content and the inspection level corresponding to the inspection area of ​​the number in association with the number.

18. 14. The inspection system according to claim 13, wherein the display means displays the inspection areas corresponding to the plurality of content types together as one group.

19. a fourth setting means for setting a maximum number of the regions included in one group; 20. The inspection system according to claim 18, wherein the display means displays to the user the number of the regions included in one group, the number being equal to or less than the maximum number.

20. An extraction means for extracting an area in which the content is arranged and a type of the content based on content information of the reference image; the first setting means automatically sets the inspection area in an area in which the content extracted by the extraction means is arranged, 20. The inspection system according to claim 12, wherein the second setting means sets an inspection level for the inspection area according to a type of content of the area in which the content is arranged.

21. The inspection system described in Claim 20, characterized in that the content information of the reference image is received from an information processing device that creates image data similar to the reference image.

Images