Inspection system and display device

Abstract

This provides an improved mechanism to assist in selecting the appropriate operating mode in the inspection system. [Solution] In the first operating mode, the control unit of the inspection system for inspecting sheets on which images have been formed discharges normal sheets to a first discharge unit, defective sheets on which defects have been detected to a second discharge unit, discharges at least one subsequent sheet following the defective sheet to the second discharge unit, and reforms the images formed on the defective sheet and at least one subsequent sheet. In the second operating mode, the control unit discharges normal sheets to a first discharge unit, discharges defective sheets to a second discharge unit, discharges at least one subsequent sheet following the defective sheet to the first discharge unit, and reforms the image formed on the defective sheet. Based on settings related to variable data inspection, the control unit displays a message on the display device regarding the selection of the first operating mode or the second operating mode.

Description

Technical Field

[0001] The present disclosure relates to an inspection system and a display device.

Background Art

[0002] Conventionally, there is known an inspection system that inspects a sheet on which an image has been formed by an image forming apparatus during execution of a job by an inspection apparatus disposed downstream of the image forming apparatus. The inspection performed during the execution of the job is also called in-line inspection. In the in-line inspection, the inspection apparatus optically reads the sheet on which the image has been formed to generate read image data, and determines whether the printed image is appropriate by analyzing the read image data. Typically, a defective sheet determined to have a defect is discharged to a discharge destination different from that of normal sheets.

[0003] Patent Document 1 discloses a system capable of performing an offline inspection independently of the execution of a job in addition to the in-line inspection. In the system of Patent Document 1, a so-called purge & recovery mode can be selected in the in-line inspection. In the purge & recovery mode, when a defect is detected during the execution of a job over a plurality of pages, the defective sheet and subsequent sheets being processed are discharged to an escape tray, and images after the page corresponding to the defective sheet are re-formed on new sheets. By such re-formation of images, i.e., the recovery operation, the order of the pages of the printed matter is preserved, so that the user does not have to perform the operation of replacing the sheets of the printed matter regardless of the presence or absence of defects.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, in the purge and recovery mode described in Patent Document 1, not only the defective sheet but also several subsequent sheets are purged, so if there is no need to preserve the order of the pages, the purged subsequent sheets become wasted. This waste can be avoided if the user selects purge mode instead of purge and recovery mode, but recovery operations are not performed in purge mode. Furthermore, users do not always select the appropriate operating mode.

[0006] In light of the circumstances described above, this disclosure aims to provide an improved mechanism to assist in selecting an appropriate operating mode in an inspection system. [Means for solving the problem]

[0007] From one perspective, the system comprises: an image forming unit that forms an image on a sheet; an inspection unit that inspects the sheet on which the image has been formed by the image forming unit; two or more discharge units from which the sheet inspected by the inspection unit is discharged; a setting unit that accepts settings related to the inspection; and a control unit that controls the image formation by the image forming unit and the discharge of the sheet to the two or more discharge units, wherein in a first operating mode, the control unit discharges normal sheets on which no defects were detected by the inspection unit to a first discharge unit, discharges defective sheets on which defects were detected by the inspection unit to a second discharge unit, discharges at least one subsequent sheet following the defective sheet to the second discharge unit, causes the image formed on the defective sheet to be reformed by the image forming unit, and reforms the image formed on the at least one subsequent sheet. An inspection system is provided, which involves: causing an image forming unit to reshape an image; in two operating modes, discharging normal sheets in which no defects were detected by the inspection unit to the first discharge unit; discharging defective sheets in which defects were detected by the inspection unit to the second discharge unit; discharging at least one subsequent sheet following the defective sheet in which no defects were detected by the inspection unit to the first discharge unit; and causing the image forming unit to reshape the image formed on the defective sheet; the settings related to the inspection include settings related to variable data inspection based on comparison with variable data that differs for each page; and the control unit causes a message regarding the selection of the first or second operating mode to be displayed on a display device based on the settings related to the variable data inspection. A corresponding display device is also provided. [Effects of the Invention]

[0008] This disclosure provides an improved mechanism for assisting in the selection of an appropriate operating mode in an inspection system. [Brief explanation of the drawing]

[0009] [Figure 1] A schematic diagram illustrating the outline of an inspection system according to one embodiment. [Figure 2]A schematic diagram of an example of the configuration of an inspection system according to one embodiment. [Figure 3] A block diagram showing an example of a specific configuration of functions related to inspection according to one embodiment. [Figure 4] An explanatory diagram showing an example of the structure of variable data used in variable data testing. [Figure 5] An explanatory diagram showing an example of the screen configuration for selecting a ground truth image dataset. [Figure 6] An explanatory diagram showing an example of the screen configuration for setting the inspection area. [Figure 7] An explanatory diagram showing an example of the screen configuration for detailed settings of the inspection area in variable data inspection. [Figure 8] An explanatory diagram showing an example of the screen configuration for setting the operation of the inspection function. [Figure 9A] An explanatory diagram showing an example of a message regarding a suggestion to change the operating mode to unordered recovery. [Figure 9B] An illustrative diagram showing an example of a message regarding the automatic change in operating mode to unordered recovery. [Figure 10] An explanatory diagram showing an example of the screen configuration for detailed settings of an inspection area related to a particular modification. [Figure 11] A flowchart showing an example of the flow of the inspection setting process according to one embodiment. [Figure 12] A flowchart showing an example of the flow of the inspection preparation process according to one embodiment. [Figure 13] A flowchart showing an example of the flow of an inline inspection process according to one embodiment. [Figure 14] An explanatory diagram showing an example of the screen configuration that may be displayed during inline testing. [Modes for carrying out the invention]

[0010] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the invention according to the claims. Although a plurality of features are described in the embodiments, not all of these plurality of features are essential to the invention, and the plurality of features may be arbitrarily combined. Further, in the accompanying drawings, the same or similar configurations are denoted by the same reference numerals, and redundant descriptions are omitted.

[0011] <1. Overview of the System> In this section, an overview of the system to which the technology according to the present disclosure can be applied will be described. FIG. 1 is a schematic diagram of an overview of an inspection system 100 according to an embodiment. In FIG. 1, in addition to the inspection system 100, an external controller 10 and a client PC (Personal Computer) 50 are shown. In the present embodiment, the inspection system 100 is configured by connecting a device (also referred to as an accessory) that provides an auxiliary function to the image forming apparatus 101. The image forming apparatus 101 may be, for example, a printer or a multifunction peripheral (MFP). In the example of FIG. 1, the inspection system 100 includes an image forming apparatus 101, an inserter 102, an inspection apparatus 103, a stacker 105, and a finisher 107.

[0012] The client PC 50 is communicably connected to the external controller 10 via the network 5. The network 5 may be any type of network such as, for example, a LAN (Local Area Network), the Internet, or a VPN (Virtual Private Network). The external controller 10 is communicably connected to the image forming apparatus 101 of the inspection system 100 via the LAN cable C1 and the video cable C2. Note that the LAN cable C1 and the video cable C2 do not necessarily have to be separate cables and may be integrated into one cable.

[0013] A printer driver is installed on the client PC 50. The printer driver is called from an application operating on the client PC 50, converts data specified as a printing target into data in the form of a predetermined printing description language (e.g., page description language), and transmits it together with a print instruction to the external controller 10.

[0014] The external controller 10 receives a print instruction and input image data from the client PC 50 and issues a print job to the inspection system 100. The external controller 10 may perform image processing such as analysis, rasterization, color conversion, correction, and binarization of the input image data. The external controller 10 may be referred to as an image processing controller, a digital front end (DFE), a print server, or the like. In the present embodiment, the external controller 10 also functions as a display device that performs displays related to inspections in the inspection system 100 and provides a user interface (UI) for receiving settings related to inspections from the user. Details of the functions of the external controller 10 will be further described later.

[0015] Note that the external controller 10 does not necessarily have to exist. That is, the client PC 50 may be configured to be directly communicable with the inspection system 100, and a print job may be directly issued from the client PC 50 to the inspection system 100. In this case, image processing such as analysis and rasterization of the input image data may be executed by the inspection system 100 (e.g., the image forming apparatus 101).

[0016] FIG. 2 shows an example of the configuration of the inspection system 100 in more detail. The image forming apparatus 101 is an apparatus that forms an image on a sheet. The image forming apparatus 101 includes paper feed units 201a and 201b, an image forming unit 210, and a transport mechanism. Each of the paper feed units 201a and 201b picks up a sheet one by one from a stack of sheets stored therein and feeds it to the transport path 202.

[0017] The image forming unit 210 includes image forming units 211a, 211b, 211c, and 211d, an intermediate transfer belt 212, a secondary transfer unit 213, a first fixing unit 214, and a second fixing unit 215. The image forming units 211a, 211b, 211c, and 211d each form toner images with the color components yellow (Y), magenta (M), cyan (C), and black (K), respectively. Since the image forming units 211a, 211b, 211c, and 211d have common configurations, the configuration of the image forming unit 211a will be described here as an example. The image forming unit 211a forms an electrostatic latent image on the surface of the photosensitive drum by exposing the charged photosensitive drum with light (e.g., laser light) modulated according to the input image data. The image forming unit 211a also develops the electrostatic latent image by supplying toner to the electrostatic latent image on the surface of the photosensitive drum, thereby forming a yellow toner image. The toner images of each color component formed by the image-forming units 211a, 211b, 211c, and 211d are sequentially transferred to the intermediate transfer belt 212 (primary transfer), thereby forming a full-color toner image. The intermediate transfer belt 212 transports the full-color toner image to the secondary transfer position of the secondary transfer unit 213 in time with the sheet reaching that position. At the secondary transfer position, the secondary transfer unit 213 transfers the toner image from the intermediate transfer belt 212 to the first surface of the sheet.

[0018] The first fixing unit 214 has rollers (or belts) heated by a heater, and fixes the toner image to the sheet by melting the toner while gripping and transporting the sheet. Depending on the type of sheet, if further fixing is required, the sheet is transported to a path that passes through the second fixing unit 215. The second fixing unit 215 also has rollers (or belts) heated by a heater, and improves the fixation of the toner image to the sheet while gripping and transporting the sheet.

[0019] If double-sided printing is specified, the sheet is guided to the reversal transport path 203, where its direction of travel is reversed and it is transported to the double-sided transport path 204. Then, with the front and back sides reversed, it returns to the transport path 202, and the toner image is transferred to the second side of the sheet, which has reached the secondary transfer position, by the secondary transfer unit 213. After passing through the first fixing unit 214 (and the second fixing unit 215), the sheet with the toner image fixed on one or both sides is output from the image forming apparatus 101 to the inserter 102. The functions of the image forming apparatus 101 will be explained in more detail later.

[0020] The inserter 102 receives a series of sheets sequentially output from the image forming apparatus 101 and inserts additional sheets at designated positions in the print job. The sheets to be inserted are fed from the insert tray 221 located at the top of the inserter 102. The series of sheets and the inserted sheets are output from the inserter 102 to the inspection apparatus 103.

[0021] The inspection device 103 inspects the sheets on which images have been formed by the image forming apparatus 101. In the example shown in Figure 2, the inspection device 103 includes a transport path 231, a first reading unit 232, and a second reading unit 233. Sheets received from the inserter 102 are transported along the transport path 231 and pass through reading positions between the first reading unit 232 and the second reading unit 233. The first reading unit 232 reads the first surface of the sheet and generates a reading image of the first surface. The second reading unit 233 reads the second surface of the sheet and generates a reading image of the second surface. The first reading unit 232 and the second reading unit 233 may be, for example, a CIS (Contact Image Sensor) or a line scan camera. The inspection device 103 determines whether or not there are defects in these reading images, as will be explained in detail later. Sheets on which no defects are detected are treated as normal sheets, and sheets on which defects are detected are treated as defective sheets. Both normal and defective sheets are output from the inspection device 103 to the stacker 105.

[0022] The stacker 105 is a device capable of stacking and storing sheets of printed material. In the example shown in Figure 2, the stacker 105 includes a transport path 251, a stack tray 252, and an escape tray 253. The stack tray 252 is an output section from which normal sheets can be discharged. The escape tray 253 is an output section from which defective sheets can be discharged. Sheets received from the inspection device 103 into the transport path 251 are discharged to either the stack tray 252 or the escape tray 253, depending on the results of the inspection of the sheet. However, if post-processing is set in the print job, normal sheets are output to the finisher 107 instead of being discharged to the stack tray 252. The stacker 105 may also include a sheet reversal mechanism for switching between face-down and face-up output for sheets to be discharged to the stack tray 252.

[0023] The finisher 107 is a device that performs post-processing, such as stapling, punching, or binding. In the example shown in Figure 2, the finisher 107 includes a first post-processing unit 271, a second post-processing unit 272, and output trays 273, 274, and 275. The first post-processing unit 271 provides, for example, stapling and punching functions. The second post-processing unit 272 provides, for example, saddle-stitch binding functions. The bundle of sheets that have undergone post-processing as specified in the print job is discharged to the output trays 273, 274, or 275. Each of the output trays 273, 274, and 275 may have a lifting mechanism.

[0024] <2. Example of configuration of functions related to testing> Figure 3 is a block diagram showing an example of a specific configuration of functions related to inspection according to this embodiment. Figure 3 shows an example of the functional configuration of the external controller 10, image forming apparatus 101, inspection apparatus 103, and stacker 105, which are mainly involved in inline inspection in the inspection system 100.

[0025] <2-1. External Controller> The external controller 10 includes a video interface (I / F) 11, a LAN I / F 12, a LAN I / F 13, an HDD 14, a display 15, an operation unit 16, memory 19, and a CPU 20. These components are interconnected via an internal bus.

[0026] The video interface 11 is a communication means for image communication with the image forming apparatus 101 and inspection apparatus 103 via the video cable C2. The LAN interface 12 is a communication means for control communication with the image forming apparatus 101 via the LAN cable C1. The LAN interface 13 is a communication means for external communication via the network 5. The hard disk drive (HDD) 14 is a storage means including a storage medium capable of storing large amounts of data. The display 15 is a display means for displaying information and images. The operation unit 16 is an operation means that accepts user operations and information input. The operation unit 16 may be, for example, a collection of input devices such as a keyboard, buttons, and switches. The display 15 and the operation unit 16 may be provided integrally as a touch panel. The memory 19 provides a storage area for calculations by the CPU 20. The central processing unit (CPU) 20 provides various functions of the external controller 10 by loading computer programs stored in the HDD 14 into the memory 19 and executing them. The functions provided by the CPU 20 may include, for example, receiving print instructions from external devices, image processing of input image data, issuing print jobs to the inspection system 100, and receiving settings related to inspection. Image processing of input image data may also be provided by a dedicated image processing circuit (not shown).

[0027] In the example shown in Figure 3, the CPU 20 functions as the display control unit 21. The display control unit 21 displays, for example, a screen for the UI of the inspection system 100 on the display 15. The user can input settings related to the inspection by operating the input device of the operation unit 16. The inspection system 100 performs the inspection according to the settings thus accepted. Some examples of the UI provided by the display control unit 21 will be described further later.

[0028] <2-2. Image forming apparatus> The image forming apparatus 101 includes a video interface 111, a LAN interface 112, a communication interface 113, an HDD 114, a display 115, an operation unit 116, a memory 119, a CPU 120, and an image forming unit 210. These components are interconnected via an internal bus. Although not shown in Figures 2 and 3, the image forming apparatus 101 may further include reading means for optically reading a document.

[0029] The video interface 111 is a communication means for image communication with the external controller 10 and the inspection device 103 via the video cable C2. The LAN interface 112 is a communication means for control communication with the external controller 10 via the LAN cable C1. The communication interface 113 is a communication means for control communication with the inspection device 103 and the stacker 105 (and other accessories). The HDD 114 is a storage means including a storage medium capable of storing large amounts of data. The display 115 is a display means for displaying information and images. The operation unit 116 is an operation means for receiving user operations and information input. The display 115 and the operation unit 116 may be provided as an integrated touch panel. The memory 119 provides a storage area for calculations by the CPU 120. The CPU 120 provides various control functions of the image forming apparatus 101 by loading computer programs stored in the HDD 114 into the memory 119 and executing them. The functions provided by the CPU 120 may include controlling the image forming operation in the image forming unit 210, controlling the inspection in the inspection device 103, controlling the discharge operation in the stacker 105, and controlling the operation of other accessories in the inspection system 100. Control of the image forming operation may include, for example, paper feed control, transport control, exposure control, transfer control, and fixing control. The CPU 120 may display settings for print jobs to be executed, the status of print jobs currently running, and reports on completed print jobs on the display 115.

[0030] In the example shown in Figure 3, the CPU 120 functions as a setting unit 121 and a job control unit 122. The setting unit 121 receives settings from the external controller 10 related to the print jobs to be executed in the inspection system 100. If inline inspection is enabled for the print job, the settings related to the print job include settings related to inspection. The job control unit 122 controls the execution of the print jobs in the inspection system 100 according to the settings received by the setting unit 121. For example, the job control unit 122 controls the image forming unit 210 to form an image on a sheet based on the input image data. If inline inspection is enabled for the print job, the job control unit 122 has the inspection device 103 inspect the sheet on which the image has been formed by the image forming unit 210, and controls the discharge of the sheet to two or more discharge units in the stacker 105 based on the inspection results. The control of sheet discharge in inline inspection will be explained further later.

[0031] <2-3. Inspection Equipment> The inspection device 103 includes a video interface 131, a communication interface 132, a display 135, an operation unit 136, a memory 139, a CPU 140, a first reading unit 232, and a second reading unit 233. These components are interconnected via an internal bus.

[0032] The video interface 131 is a communication means for image communication with the external controller 10 and the image forming apparatus 101 via the video cable C2. The communication interface 132 is a communication means for control communication with the image forming apparatus 101 and the stacker 105. The display 135 is a display means for displaying information and images. The operation unit 136 is an operation means for receiving user operations and information input. The display 135 and the operation unit 136 may be provided as an integrated touch panel. The memory 139 provides a storage area for calculations by the CPU 140. The CPU 140 provides the inspection function of the inspection apparatus 103 by loading a computer program stored in some storage medium into the memory 139 and executing it.

[0033] In the example shown in Figure 3, the CPU 140 functions as an inspection unit 141. As an example, inline inspection is performed in a print job where single-sided printing is specified. In this case, the inspection unit 141 acquires read image data of the first side of a sheet on which an image has been formed by the image forming apparatus 101 from the first reading unit 232. The inspection unit 141 then determines whether there is a defect in the read image of the first side based on the acquired read image data. For example, the inspection unit 141 compares the read image with a previously acquired correct image and determines that there is a defect in the read image if the result of the comparison satisfies predetermined conditions. The correct image may be generated from the input image data by an external controller 10. Alternatively, the correct image may be generated by optically reading a sheet on which an image has been formed normally. The correct image data is acquired in advance, for example, via a video I / F 131 and stored in memory 139. In this specification, inspection based on such a comparison between a read image and a correct image is called image inspection.

[0034] Furthermore, in this embodiment, the inspection unit 141 is capable of performing variable data inspection. Variable data inspection is an inspection based on comparison with variable data that differs from page to page. In variable data inspection, for jobs spanning multiple pages, one or more inspection areas are set within each page. Variable data that changes from page to page is associated with each inspection area. The inspection unit 141 then compares the variable data associated with each inspection area with the data detected within that inspection area in the read image, and determines whether or not there is a defect in the read image based on the comparison result. The detection of data within the inspection area may be performed, for example, by optical character recognition (OCR), or by reading information encoded in a visible code (one-dimensional or two-dimensional), such as a barcode.

[0035] If double-sided printing is specified, the inspection unit 141 also performs image inspection and variable data inspection on the read image data of the second side of the sheet acquired from the second reading unit 233, based on the comparison with the correct image described above.

[0036] As described above, sheets in which no defects are detected by the inspection unit 141 are treated as normal sheets, and sheets in which defects are detected for one or more inspection items are treated as defective sheets. The inspection unit 141 sequentially performs inspections on the sheets received from the inserter 102 and notifies the job control unit 122 of the image forming apparatus 101 of the results of the inspection for each sheet via the communication interface 132. The inspection unit 141 may also display the status of the inspection in progress and reports on the completed inspections on the display 135. Settings related to these inspections will be described further later.

[0037] <2-4. Stacker> The stacker 105 includes a communication interface 152, a first discharge unit 153, a second discharge unit 154, a memory 159, and a CPU 160. These components are interconnected via an internal bus.

[0038] The communication I / F 152 is a communication means for control communication with the image forming apparatus 101 and the inspection apparatus 103. The first discharge unit 153 and the second discharge unit 154 may correspond to, for example, the stack tray 252 and the escape tray 253, respectively. Alternatively, any of the discharge trays of the finisher 107 described above may be used as the first discharge unit 153 or the second discharge unit 154. In one modification, the first discharge unit 153 and the second discharge unit 154 may be different discharge positions on the same tray. The memory 159 provides a storage area for calculations by the CPU 160. The CPU 160 provides the discharge control function of the stacker 105 by loading a computer program stored in some storage medium into the memory 159 and executing it.

[0039] In the example shown in Figure 3, the CPU 160 functions as the discharge control unit 161. The discharge control unit 161, for example, in accordance with instructions from the job control unit 122 of the image forming apparatus 101, discharges each sheet on which an image has been formed in the print job to either the first discharge unit 153 or the second discharge unit 154. When inline inspection is performed, the discharge destination of each sheet may be switched depending on the inspection result output from the inspection unit 141 of the inspection apparatus 103. As will be explained in the next section, the discharge destination of each sheet in inline inspection is determined depending on the operating mode selected in the print job.

[0040] Furthermore, the memory and HDD of each device shown in Figure 3 are not limited to the examples described above, and may be any combination of volatile and non-volatile computer-readable storage media (e.g., RAM, ROM, HDD, SSD, and USB memory). Each of these storage media may be built into the device or be external.

[0041] <3. Details of the examination> As described above, the inspection in the inspection system 100 may include variable data inspection in addition to image inspection based on comparison between the read image and the correct image. This section describes the settings that can be accepted via the UI for these inspections, and the details of the inspections performed according to those settings.

[0042] <3-1. Imaging Examination> The correct image to be compared with the read image of each sheet is acquired by the inspection unit 141 prior to the execution of the inspection. If the print job spans N pages (where N is a natural number), typically a set of correct images for N pages is acquired. For inline inspection, the inspection unit 141 may treat the image of each page represented by the input image data of the print job as the correct image. Alternatively, a pre-registered set of correct images (a set selected from one or more sets) may be specified as the set of correct images to be used in the print job (hereinafter referred to as the correct image dataset).

[0043] Imaging tests may include, for example, tests for one or more of the following test items: • Differences in color • Differences in concentration • Positional misalignment • Stripes or faint marks • Printing errors The inspection of these inspection items may be performed, for example, by comparing pixel values ​​for each pixel or group of pixels, and by comparing the positions of objects in the image extracted using edge detection results. Since the specific inspection techniques may be the same as known techniques, a description of those specific techniques will be omitted here.

[0044] <3-2. Variable Data Examination> In variable data inspection, as mentioned above, for jobs spanning multiple pages, one or more inspection areas are set on each page, and variable data that changes from page to page is associated with each inspection area. Below, we will explain the settings related to variable data inspection using the printing of invoices that an insurance company sends to its auto insurance policyholders on a monthly basis as an example.

[0045] Figure 4 shows variable data 300 for inspection in invoice printing as an example of variable data. Variable data may be data written in, for example, CSV (Comma Separated Value) format or any other structured format. Variable data 300 has six columns: "Number (No.)", "Period", "Recipient Name", "Item", "Invoice Amount", and "Payment Due Date". Each row of variable data 300, excluding the header row, corresponds to one of 100 contractors to whom the invoice is sent, and the values ​​of the six columns in each row define the variable strings that should be printed in six fields on a single invoice.

[0046] Variable data inspection settings may be performed on the same inspection settings screen as image inspection settings. Inspection settings typically begin with the user selecting the ground truth image dataset to be used for inspection. Figure 5 is an explanatory diagram showing an example of the screen configuration for selecting a ground truth image dataset. The dataset selection screen 310 shown in Figure 5 includes a dataset list 311, a button 312, and a button 313. The dataset list 311 is a list of identifiers (IDs) and names of ground truth image datasets already registered in the inspection system 100. Button 312 is a button to call up a screen for registering a new ground truth image dataset in the inspection system 100. Button 313 is a button to select one of the ground truth image datasets displayed in the dataset list 311 as the dataset to be used for inspection and to proceed to the subsequent settings screen. For example, if the user selects a dataset identified by ID "R01" and operates button 313, the data file of the selected dataset may be opened, and the screen for setting the inspection area, which will be described next, may be displayed.

[0047] Figure 6 is an explanatory diagram showing an example of the screen configuration for setting the inspection area. Note that, in this example, it is possible to set the area to be inspected not only for variable data inspection but also for image inspection. The inspection area setting screen 320 shown in Figure 6 includes a preview section 321 and buttons 322-327. The preview section 321 is an area that displays a preview of one of the ground truth images included in the ground truth image dataset. In the example in Figure 6, the preview section 321 displays a preview of the ground truth image IM1 on the first page of a total of 100 pages. The pair of buttons 322 are for switching between the pages of ground truth images displayed in the preview section 321.

[0048] Button 323 is used to set the inspection area for image inspection. For example, after operating button 323, the user can specify the desired range in the preview section 321 by dragging, thereby setting the inspection area to be used for image inspection on the currently displayed page. In the example in Figure 6, inspection area A0 is set as the inspection area for image inspection.

[0049] Button 324 is used to set the inspection area for variable data inspection. For example, after operating button 324, the user can specify the desired range in the preview section 321 by dragging, thereby setting the inspection area to be subject to variable data inspection on the currently displayed page. In the example in Figure 6, inspection areas A1 to A6 are set as the inspection area for variable data inspection.

[0050] Button 325 is used to navigate to the detailed settings screen for each inspection area configured in the preview section 321. For example, if the user selects inspection area A3 and operates button 325, the screen for detailed settings of the inspection area for variable data inspection, which will be described next, may be displayed.

[0051] Figure 7 is an explanatory diagram showing an example of the screen configuration for detailed settings of the inspection area for variable data inspection. The detailed settings screen 330 shown in Figure 7 includes a preview section 331, a file selection field 332, a column selection field 333, buttons 334 and 335. The preview section 331 is an area that displays a preview of the correct image for the page selected on the inspection area settings screen 320. The file selection field 332 is a field for selecting a data file that contains variable data to be associated with inspection area A3. The column selection field 333 is a field for selecting a column in the data file selected in the file selection field 332 that contains a string to be compared with the data detected in inspection area A3. In the example in Figure 7, the column "Addressee" in the data file named "BILLING_LIST.csv" (for example, the variable data 300 in Figure 4) is selected. Button 334 is a button to cancel the settings made on the detailed settings screen 330 and return to the inspection area settings screen 320. Button 335 is used to register the settings made on the detailed settings screen 330 to the system and return to the inspection area settings screen 320. Note that the range of each inspection area may also be specified in the preview section 331 of the detailed settings screen 330.

[0052] Referring again to Figure 6, the user registers the variable data to be associated with each of the inspection areas A1 to A6 by calling up the detailed settings screen 330. In the example in Figure 6, the columns "Number," "Period," "Item," "Invoice Amount," and "Payment Due Date" of the variable data 300 are associated with inspection areas A1, A2, A4, A5, and A6, respectively. Then, in the preview section 321, a preview of the corresponding strings from the first page of the correct image (i.e., the strings of the first record excluding the header) is displayed at the location of these inspection areas. Note that detailed settings (e.g., valid inspection items and inspection levels) may also be made for inspection area A0 for image inspection, but the explanation of that is omitted here.

[0053] Button 326 is used to apply the same settings for the inspection area to all pages of the ground truth image dataset. Users can also set the inspection area individually for each page of the ground truth image dataset, in which case they can switch pages using button 322 to set the inspection area for each page. Alternatively, users can set the inspection area commonly for all pages, in which case they set one or more inspection areas on one page and then operate button 326. The setting unit 121 then copies the inspection area settings for that page and applies them to all other pages. This eliminates the need to repeatedly set the inspection area across numerous pages, reducing the burden on the user's setup work.

[0054] After the user has completed all the settings for image inspection and variable data inspection for the selected ground truth image dataset, they operate button 327. The setting unit 121 then registers the received settings in memory, associating them with the ground truth image dataset. Subsequently, when the print job is started, the inspection unit 141 performs inline inspection according to the registered settings.

[0055] <3-3. Multiple operating modes for inline inspection> The invoices printed using the variable data 300 in Figure 4 are sent individually to their respective recipients. Therefore, there are no special constraints on the output order of these invoices, and it does not cause any problems even if the invoices are stacked in a different order on the output tray. This is in contrast to cases where there are constraints on the output order of sheets, such as in print jobs where binding is performed as a post-processing step. In print jobs with constraints on the output order, if a defect is detected during inline inspection, not only the defective sheet but also one or more subsequent sheets already being processed must be purged (e.g., ejected to an escape tray) in order to maintain the correct output order of the sheets. The images corresponding to the purged sheets are reformatted onto new sheets, and these sheets are ejected to their normal destinations if they are free of defects. In this specification, this recovery operation that preserves the output order is called ordered recovery. However, if ordered recovery is performed in a print job without constraints on the output order, subsequent sheets that have been printed well without defects will also be purged and wasted. Alternatively, if only the defective sheet is purged without recovery, the user would have to instruct the system to recreate the image corresponding to the defective sheet on a new sheet after the print job is completed, which is cumbersome. Therefore, in this embodiment, the inspection system 100 allows the user to select non-ordered recovery in addition to the ordered recovery described above as an operating mode with recovery in inline inspection.

[0056] The basic operation of ordered recovery (first operating mode) is as follows: The image forming apparatus 101 sequentially forms images on the sheet. The inspection device 103 sequentially inspects the sheets on which images have been formed. • Normal sheets that were not found to have defects are discharged to the first discharge unit. • If a defect is detected - Defective sheets are discharged to the second discharge section. - Discharge at least one subsequent sheet following the defective sheet to the second discharge unit. (Subsequent sheets already being processed are discharged to the second discharge section without being inspected.) - The image forming apparatus 101 reforms the image formed on the defective sheet. - The image forming apparatus 101 reshapes the image formed on the at least one subsequent sheet.

[0057] The job control unit 122 of the image forming apparatus 101 works in conjunction with the inspection unit 141 of the inspection apparatus 103 and the discharge control unit 161 of the stacker 105 to control the operations described above in sequential recovery. The sheet from which the image has been reformed by the image forming apparatus 101 is inspected again by the inspection unit 141 and discharged to the first discharge unit if it is normal, or to the second discharge unit (along with at least one subsequent sheet at that point) if it is defective.

[0058] The basic operation of unordered recovery (second operating mode) is as follows: The image forming apparatus 101 sequentially forms images on the sheet. The inspection device 103 sequentially inspects the sheets on which images have been formed. • Normal sheets that were not found to have defects are discharged to the first discharge unit. • If a defect is detected - Defective sheets are discharged to the second discharge section. - Discharge at least one subsequent sheet following a defective sheet to the first discharge unit (unless a defect is detected in that sheet). (Subsequent sheets already being processed are inspected, and if defects are detected, they are discharged to the second discharge section.) - The image forming apparatus 101 reforms the image formed on the defective sheet.

[0059] The job control unit 122 of the image forming apparatus 101 works in conjunction with the inspection unit 141 of the inspection apparatus 103 and the discharge control unit 161 of the stacker 105 to control the above-mentioned operations in unordered recovery. The sheet on which the image has been reformed by the image forming apparatus 101 is inspected again by the inspection unit 141, and if it is normal, it is discharged to the first discharge unit; if it is defective, it is discharged to the second discharge unit.

[0060] Naturally, in the inspection system 100, other operating modes may also be selectable in addition to ordered recovery and unordered recovery. Examples of such other operating modes include a mode that only purges defective sheets without performing recovery (reshaping the images corresponding to the purged sheets), and a mode that only records logs and outputs reports about the inspection results without performing either recovery or purging.

[0061] Figure 8 is an explanatory diagram showing an example of the configuration of a screen for setting the operation of the inspection function in the inspection system 100. In the example in Figure 8, the operation setting screen 350 includes radio buttons 351-353, a pull-down menu 354, radio buttons 355 and 356, a cancel button 357, and an OK button 358. Radio buttons 351-353 are buttons for specifying whether or not to perform recovery and whether or not to perform purging when a defect is detected during inspection. Users who wish to perform both purging and recovery select radio button 351. Users who wish to perform only purging without recovery select radio button 352. Users who wish to record logs (and output reports) without performing either recovery or purging select radio button 353. If radio button 351 or 352 is selected and purging is performed, the pull-down menu 354 is enabled. The pull-down menu 354 is an object for specifying the destination (second output unit) of the sheet to be purged from multiple candidates. In the example in Figure 8, the escape tray 253 is specified. When radio button 351 is selected and recovery is performed, radio buttons 355 and 356 are enabled. Radio buttons 355 and 356 are buttons for specifying whether or not to preserve the output order of the sheets during recovery. Users who want to preserve the output order, i.e., perform ordered recovery, select radio button 355. On the other hand, users who want unordered recovery select radio button 356. The cancel button 357 is used to cancel the settings made on the operation setting screen 350 and close the screen. The OK button 338 is used to register the settings made on the operation setting screen 350 to the system and close the screen. Note that the default operation mode when a defect is detected, i.e., the operation mode selected when the user has not set a specific operation mode, may be, for example, ordered recovery.

[0062] For print jobs without constraints on the output order, if the user appropriately selects "unordered recovery" on the operation settings screen 350, the waste of properly printed sheets being purged after a defective sheet can be avoided. However, users do not always select the operation mode correctly. For example, as in the invoice printing and mailing example described above, if the inspection area for variable data inspection is set commonly across multiple pages, there is a high probability that the printed materials of those pages will be handled separately.

[0063] Therefore, in this embodiment, the inspection system 100 determines whether the currently selected operating mode for the recovery operation is appropriate based on settings related to variable data inspection, and proposes or automatically changes the operating mode as necessary. The operating modes that can be selected for the recovery operation may be ordered recovery or unordered recovery. Such proposed changes or automatic changes are notified to the user by a message displayed on the screen. This reduces the risk of inline inspection being performed in an inappropriate operating mode in a print job and reduces the waste of sheets. Naturally, the user may be given the option to accept or reject the proposal, or to revert the automatic change.

[0064] In this embodiment, we will mainly describe an example in which the job control unit 122 of the image forming apparatus 101 displays a message on a display device regarding the selection of ordered recovery or unordered recovery based on settings related to variable data inspection. However, in other embodiments, the display control unit 21 of the external controller 10, or the inspection unit 141 of the inspection apparatus 103, may have the function of displaying a message on a display device regarding the selection of ordered recovery or unordered recovery. The display device here may be part of the inspection system 100 (for example, display 115 or 135), or it may be located outside the system (for example, the display of the client PC 50 or the display 15 of the external controller 10).

[0065] Here, we assume that the input image data for a print job spans multiple pages. The number of copies to be printed may be one or multiple. Also, we assume that ordered recovery is the default mode or selected by the user. Under these circumstances, two embodiments described below are possible. First, in the first embodiment, the setting unit 121 displays the UI screen described with reference to Figures 5 to 7 on the display 15 of the external controller 10 and registers settings related to inspection according to user input received via the operation unit 16. The settings related to inspection may include settings related to variable data inspection, such as one or more inspection areas and the association of each inspection area with variable data. For example, when button 326 on the inspection area setting screen 320 is operated, the setting unit 121 sets the inspection area for variable data inspection to be common to multiple pages. In this case, the job control unit 122 displays a message on the display 15 suggesting to the user to select unordered recovery for the print job.

[0066] Figure 9A shows an example of a message suggesting a change in the operating mode to unordered recovery. In the example in Figure 9A, message 360a includes text explaining to the user that selecting unordered recovery may save sheets if multiple pages do not need to be printed in a specific order. In addition, message 360a includes a YES button 361 and a NO button 362, along with text suggesting a change in the operating mode from ordered recovery to unordered recovery. After message 360a is displayed on the display 15, the setting unit 121 accepts input from the user for selecting the operating mode. For example, a user who wishes to accept the suggestion and change the operating mode to unordered recovery operates the YES button 361. When the YES button 361 is operated, the setting unit 121 changes the operating mode to unordered recovery. On the other hand, a user who wishes to reject the suggestion and keep the operating mode in ordered recovery operates the NO button 362. When the NO button 362 is operated, the setting unit 121 does not change the operating mode to ordered recovery.

[0067] In the second embodiment as well, under the circumstances described above, the setting unit 121 displays the UI screen described with reference to Figures 5 to 7 on the display 15 of the external controller 10, and registers settings related to inspection according to user input received via the operation unit 16. The settings related to inspection may include settings related to variable data inspection. For example, when button 326 on the inspection area setting screen 320 is operated, the setting unit 121 sets the inspection area for variable data inspection to be common to multiple pages. In this case, the job control unit 122 displays a message on the display 15 notifying the user that unordered recovery is automatically selected for the print job.

[0068] Figure 9B shows an example of a message regarding the automatic change of the operating mode to unordered recovery. In the example in Figure 9B, message 360b includes a revert button 363 and an OK button 364, along with text informing the user that the operating mode has been changed from ordered recovery to unordered recovery. After message 360b is displayed on the display 15, the setting unit 121 accepts user input via buttons 363 or 364. For example, a user who has received the notification and wishes to revert the operating mode operates button 363. When button 363 is operated, the setting unit 121 reverts the operating mode to ordered recovery. On the other hand, a user who accepts the change operates OK button 364. When OK button 364 is operated, the change of the operating mode to unordered recovery is confirmed. In the second embodiment, only a message regarding the automatic change of the operating mode is displayed, and further user input does not need to be accepted.

[0069] The opposite situation to the one described above is also conceivable. That is, suppose the input image data for a print job spans multiple pages, but unordered recovery is the default mode or selected by the user. Under these circumstances, in the first embodiment, if the inspection area for variable data inspection is set differently on multiple pages according to user input, the job control unit 122 may suggest to the user that ordered recovery be selected for the print job. Alternatively, in the second embodiment, if the inspection area for variable data inspection is set differently on multiple pages according to user input, the job control unit 122 may notify the user that ordered recovery will be automatically selected for the print job.

[0070] The job control unit 122 may automatically select unordered recovery for print jobs that consist of one page and multiple copies, regardless of the settings related to variable data inspection. When the input image data for a print job consists of only one page, there is usually no need to maintain the output order among multiple copies of that page. Therefore, by having the system automatically select unordered recovery, the effort required for the user to change settings can be reduced while avoiding the possibility of wasting sheets.

[0071] In one modified example, the setting unit 121 may accept a setting related to variable data inspection, specifying whether the page order should be preserved in the printed material for each of one or more inspection areas. If there are no inspection areas in which the page order should be preserved in this setting, the job control unit 122 may suggest to the user, with a message similar to that in Figure 9A, that they select unordered recovery for multi-page jobs. Conversely, if there is at least one inspection area in which the page order should be preserved in the above setting, the job control unit 122 may suggest to the user that they select ordered recovery for multi-page jobs.

[0072] Alternatively, if there are no inspection areas in the above settings where the order of pages should be preserved, the job control unit 122 may automatically select unordered recovery and notify the user with a message similar to that in Figure 9B. Conversely, if there is at least one inspection area in the above settings where the order of pages should be preserved, the job control unit 122 may automatically select ordered recovery for multi-page jobs and notify the user.

[0073] Figure 10 is an explanatory diagram showing an example of the screen configuration for detailed settings of the inspection area related to the modified example described above. The detailed settings screen 370 shown in Figure 10 includes a preview section 331, a file selection field 332, a column selection field 333, buttons 334 and 335, and a checkbox 376. The preview section 331, file selection field 332, column selection field 333, buttons 334 and 335 are the same objects as those described in relation to the detailed settings screen 330 in Figure 7. The checkbox 376 is an object for specifying whether the page order (the order of output of variable data) should be preserved in the printed document for the inspection area being configured. In the example in Figure 7, the column "Addressee" of the data file "BILLING_LIST.csv" is associated with inspection area A3, and checkbox 376 is checked. Therefore, in the printed document, the string specified in the "Addressee" column must be output in the specified order at the location of inspection area A3. In this case, if the selected operating mode is unordered recovery, the job control unit 122 may suggest to the user that they select ordered recovery, or it may automatically select ordered recovery. On the other hand, if checkbox 376 is not checked for any inspection area, the job control unit 122 may suggest to the user that they select unordered recovery, or it may automatically select unordered recovery, if the selected operating mode is ordered recovery.

[0074] <4. Processing Flow> This section describes some examples of processing flows that can be executed in the embodiments described above using flowcharts. In each flowchart, 'S' represents a processing step.

[0075] <4-1. Inspection Setup Process> Figure 11 is a flowchart showing an example of the flow of inspection setting processing according to one embodiment. The inspection setting processing in Figure 11 may be initiated, for example, when a user calls a UI for inspection-related settings from the system's menu screen. The UI for inspection-related settings consists, for example, a screen displayed on the display 15 by the display control unit 21 and user input acquired via the operation unit 16. The setting unit 121 accepts inspection-related settings through a series of user interactions using this UI.

[0076] First, in S11, the setting unit 121 accepts the selection of a ground truth image dataset on the dataset selection screen 310. Next, in S12, the display control unit 21 displays the inspection area setting screen 320 on the display 15. The display control unit 21 displays a preview of one of the ground truth images included in the selected ground truth image dataset in the preview section 321 of the inspection area setting screen 320.

[0077] Next, in S13, the setting unit 121 accepts the setting of an inspection area on the inspection area setting screen 320. For example, an inspection area occupying a certain range in the image is set in response to a drag operation by the user. Then, in S14, the display control unit 21 displays the detailed setting screen 330 or 370 on the display 15, and the setting unit 121 accepts the detailed setting of the inspection area on the detailed setting screen 330. For example, a specified column of variable data specified by the user is associated with the inspection area for variable data inspection. Steps S13 and S14 are repeated until the detailed setting is completed for each of one or more inspection areas (S15-NO).

[0078] Once detailed settings are complete for all inspection areas (S15-YES), in S16, the inspection setting process branches depending on whether the inspection areas for variable data inspection are set commonly across multiple pages. If the inspection areas for variable data inspection are set commonly across multiple pages, in S17, the display control unit 21 determines whether the currently selected operation mode is ordered recovery. If the currently selected operation mode is ordered recovery, in S18, the display control unit 21 displays a message on the display 15 regarding the selection of unordered recovery as the operation mode for recovery operations in inline inspection. This message may be a message suggesting a change in the operation mode to unordered recovery, or a message notifying automatic selection of unordered recovery. If the user accepts the selection of unordered recovery (S19-YES), in S20, the setting unit 121 changes the operation mode from ordered recovery to unordered recovery.

[0079] If the inspection area for variable data inspection is set differently on multiple pages (S16-NO), in S21, the setting unit 121 maintains the currently selected operating mode. Alternatively, if the currently selected operating mode is unordered recovery, the user may be offered the option to change the operating mode of the recovery operation in inline inspection to ordered recovery.

[0080] If the inspection area for variable data inspection is set commonly across multiple pages (S16-YES), and the currently selected operating mode is unordered recovery (S17-NO), then in S21, the setting unit 121 maintains the currently selected operating mode. Also, even if the currently selected operating mode is ordered recovery (S17-YES), if the user rejects the suggestion to change the operating mode or reverts the change (S19-NO), then in S21, the setting unit 121 maintains the currently selected operating mode.

[0081] Then, the inspection setting process shown in Figure 11 is completed. For example, when button 327 is operated on the inspection area setting screen 320 in Figure 6, the inspection system 100 completes the inspection setting process and transitions to a state where it waits for a print job.

[0082] It should be noted that during the inspection setup process, it may not be determined whether the actual print job to be executed will consist of multiple pages. This is because, for example, a ground truth image dataset containing 100 correct images can be applied to both a print job with 100 copies per page and a print job with 100 copies per 100 pages. Therefore, the setup unit 121 may, while maintaining a flag indicating the operation mode of the recovery operation determined in the print setup process shown in Figure 11 (for example, a recommended operation mode flag), select an operation mode different from the pre-set one depending on the number of pages in the print job to be received thereafter. Such overriding of the operation mode may be performed in the inspection preparation process described next.

[0083] <4-2. Preparation for Inspection> Figure 12 is a flowchart showing an example of the flow of the inspection preparation process according to one embodiment. The inspection preparation process in Figure 12 may be started, for example, when the job control unit 122 of the image forming apparatus 101 receives a print job with inline inspection from the external controller 10.

[0084] First, in S31, the job control unit 122 receives a print job with inline inspection from the external controller 10. The job control unit 122 sets up the image forming apparatus 101, as well as the accessories, the inspection device 103 and the stacker 105, according to the various job parameters specified in the print job. Here, it is assumed that the inserter 102 does not insert additional sheets, and the finisher 107 is not used. For example, the job control unit 122 determines the paper feed unit to which the sheets should be fed, selects single-sided or double-sided printing, and determines the discharge unit to which the sheets should be ejected. In the recovery operation, in addition to the first discharge unit to which normal sheets should be ejected, a second discharge unit to which defective sheets should be ejected is determined.

[0085] Next, in S32, the job control unit 122 retrieves the ground truth image dataset and inspection-related settings to be used in inline inspection from memory. Here, the inspection-related settings include settings related to variable data inspection, and the settings related to variable data inspection include variable data associated with each of one or more inspection areas. The job control unit 122 outputs the retrieved ground truth image dataset and inspection-related settings to the inspection unit 141 of the inspection device 103.

[0086] Next, in S33, the job control unit 122 determines whether recovery should be performed when a defect is detected in the inline inspection, based on the acquired inspection-related settings. If recovery should be performed when a defect is detected (ordered recovery or unordered recovery is selected), the job control unit 122 makes a final decision on the operation mode based on the currently selected operation mode and the number of pages in the print job. For example, if the currently selected operation mode is unordered recovery (S34-YES), in S36, the job control unit 122 maintains the operation mode of the print job recovery operation as unordered recovery. Also, if the currently selected operation mode is ordered recovery (S34-NO) and the print job does not span multiple pages (S35-NO), in S36, the job control unit 122 sets the operation mode to unordered recovery. Also, if the currently selected operation mode is ordered recovery (S34-NO) and the print job spans multiple pages (S35-YES), in S37, the job control unit 122 maintains the operation mode of the print job recovery operation as ordered recovery.

[0087] Once the setup of the print job with inline inspection described above is complete, in S40, the job control unit 122 notifies the inspection unit 141 of the final determined operating mode and triggers the execution of the print job.

[0088] <4-3. Inline Inspection Processing> Figure 13 is a flowchart showing an example of the flow of an inline inspection process according to one embodiment. The inline inspection process in Figure 13 can be executed by the inspection device 103 in conjunction with the image forming operation of the image forming apparatus 101, upon completion of the inspection preparation process in Figure 12.

[0089] First, in S41, the inspection device 103 receives a sheet on which an image has been formed by the image forming device 101 into the transport path 231. Next, in S42, the first reading unit 232 reads the first side of the sheet as it passes the reading position and generates a read image of the first side. If both sides of the sheet are to be inspected, the second reading unit 233 also reads the second side of the sheet and generates a read image of the second side. Next, in S43, the inspection unit 141 performs image inspection on the sheet received in S41 based on a comparison between the read image and the correct image, and variable data inspection based on matching with variable data that differs for each page. The inspection unit 141 knows which page the image formed on each sheet is on through communication with the job control unit 122, and uses the correct image and variable data records corresponding to that page for image inspection and variable data inspection, respectively.

[0090] In S44, the inline inspection process branches depending on whether a defect was detected in S43. If no defect is detected in the image inspection or variable data inspection, the process proceeds to S45. On the other hand, if a defect is detected in the image inspection or variable data inspection, the process proceeds to S47.

[0091] In S45, a normal sheet is discharged to the first discharge unit (for example, the stack tray 252 of the stacker 105). Next, in S46, it is determined whether or not the print job has finished executing. If the print job has not finished executing, the process returns to S41, the next sheet is received from the image forming apparatus 101, a read image of the sheet is generated, and image inspection and variable data inspection are performed.

[0092] If a defect is detected, the processing in S47 branches depending on the operation mode for the recovery operation. If the operation mode is unordered recovery (S47-YES), in S48 the defective sheet is discharged to the second discharge unit (for example, the escape tray 253 of the stacker 105). Then, in S49, the inspection unit 141 reports the inspection result to the job control unit 122 so that the image formed on the defective sheet is reformed. The job control unit 122 adds the operation for reforming the image formed on the defective sheet to the running job. The operation for reformation may be added to the end of the running job or in the middle of the job. After that, the process returns to S41, the next sheet is received from the image forming apparatus 101, a read image of the sheet is generated, and image inspection and variable data inspection are performed. The sheet received at this time may be a sheet that follows the defective sheet. If no defect is detected in this subsequent sheet, it may be discharged to the first discharge unit as a normal sheet.

[0093] If a defect is detected and the operating mode is sequential recovery (S47-NO), in S50, the inspection unit 141 reports the inspection result to the job control unit 122 so that the feeding of a new sheet and image formation are temporarily suspended. Meanwhile, in S51, the defective sheet is discharged to the second discharge unit, followed by at least one subsequent sheet being discharged to the second discharge unit in S52. Then, in S53, the job control unit 122 adds an operation to the beginning of the running job to reshape the images formed on the defective sheet and at least one subsequent sheet. After that, the process returns to S41, the next sheet is received from the image forming apparatus 101, a read image of the sheet is generated, and image inspection and variable data inspection are performed. The sheet that is first received at this time may be a sheet on which the image formed on the defective sheet has been reshaped. If no defect is detected on this sheet, it may be discharged to the first discharge unit as a normal sheet.

[0094] Once all pages, including those targeted for recovery, have been successfully ejected as normal sheets, the system determines in S46 that the print job has finished executing. At this point, the inline inspection process shown in Figure 13 terminates.

[0095] <4-4. Displaying the status during inspection> Figure 14 is an explanatory diagram showing an example of the configuration of a screen that may be displayed during the execution of an inline inspection. The status screen 400 shown in Figure 14 includes a preview section 401, a status section 402, and a defect list 403. The preview section 401 is an area that displays a preview of the read image of the sheet currently being inspected. The status section 402 is an area that displays status information, including the inspection results for the inspection that has been performed. The defect list 403 is an area that displays list information related to defects detected in the inspection that has been performed.

[0096] In the example in Figure 14, a preview of the scanned image IM2 on page 11 of a total of 100 pages is displayed in the preview section 401. The status information displayed in the status section 402 includes the name of the print job, the selected operating mode, the number of pages inspected, the number of copies inspected, and the number of sheets in which defects were detected. The list information displayed in the defect list 403 includes the section to which each defective sheet belongs, the corresponding page number, the cause of the detected defect, and the recovery position. The recovery position here indicates where the sheet in which the image formed on each defective sheet was re-formed (a sheet in which no defects were detected during re-inspection) was ejected in the first ejection unit (i.e., within the bundle of normal sheets). In this way, by making the identification information of defective sheets (section and page number, etc.) along with the corresponding recovery position visible to the user on the screen, the user can easily understand where each page is located within the bundle of sheets that were output without maintaining their order.

[0097] Furthermore, if ordered recovery is selected as the operating mode, the output order of the sheets is preserved in the printed document, so the recovery location does not need to be indicated in defect list 403.

[0098] <5. Summary> Up to this point, various embodiments and modifications of the technology relating to this disclosure have been described using Figures 1 to 14. In the embodiments described above, an inspection system that performs image reshaping (i.e., recovery operation) when a defect is detected is provided with a first operation mode (ordered recovery) and a second operation mode (unordered recovery). In the first operation mode, immediately after the defective sheet and at least one subsequent sheet following the defective sheet are purged, a sheet with the image formed on the defective sheet reshaped is output. Therefore, the output order of sheets in the printed material is preserved. For example, the first operation mode is suitable when there are order constraints between pages, such as in printed materials intended for binding (e.g., magazines and books). On the other hand, in the second operation mode, although the output order of sheets is not preserved, subsequent sheets following the defective sheet are not purged. Therefore, waste of sheets is avoided. For example, the second operation mode is suitable when the sheets included in the printed material are handled separately, such as in the example of printing and sending invoices described above. The system then determines the appropriate operating mode for multi-page jobs based on settings related to variable data inspection and displays a message regarding the selection of the operating mode on the display device. Therefore, even if the user has not selected the appropriate operating mode in advance, an opportunity to optimize the operating mode before job execution is provided, allowing for flexible avoidance of wasted sheets.

[0099] For example, in a multi-page job where the first operating mode is the default mode or selected by the user, if the inspection area for variable data checking is set commonly across multiple pages, the user may be prompted to select the second operating mode. Alternatively, in a similar situation, if the inspection area for variable data checking is set commonly across multiple pages, the second operating mode may be automatically selected. With such a configuration, the user does not need to actively change the operating mode from the first to the second operating mode each time a job for which the second operating mode is desirable occurs, thus reducing the burden of user configuration work. This technique is particularly advantageous when there is a large proportion of jobs for which the first operating mode, i.e., ordered recovery, is desirable, because it is easy to maintain the basic operating mode setting in the first operating mode.

[0100] In the embodiment described above, for jobs spanning one page and multiple copies, the probability that the sheets included in the printed material will be handled separately is significantly higher, so the second operating mode may be automatically selected. However, for jobs spanning multiple pages, it is difficult to predict how the sheets included in the printed material will be handled based solely on the number of pages. In contrast, by considering the commonality of settings related to variable data inspection across multiple pages when determining the operating mode, the desired operating mode can be appropriately determined, reducing the burden on the user.

[0101] In one modified version, as a setting related to variable data inspection, a setting is accepted that specifies whether the page order should be preserved in the printed material for each of one or more inspection areas. If there are no inspection areas where the page order should be preserved, the user is suggested to select a second operating mode for multi-page jobs, or the second operating mode is automatically selected. With this configuration, the accuracy of determining the desired operating mode can be further improved.

[0102] <6. Other Embodiments> The above embodiment can also be implemented in the form of a process in which a program that implements one or more functions is supplied to a system or device via a network or storage medium, and one or more processors in the computer of that system or device read and execute the program. It can also be implemented by a circuit (e.g., AS.IC) that implements one or more functions.

[0103] The invention is not limited to the embodiments described above, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, claims are attached to disclose the scope of the invention. [Explanation of Symbols]

[0104] 100: Inspection system, 101: Image forming apparatus, 102: Inserter, 103: Inspection device, 105: Stacker, 107: Finisher, 121: Setting unit, 122: Job control unit, 141: Inspection unit, 153: First discharge unit, 154: Second discharge unit, 210: Image forming unit, 232: First reading unit, 233: Second reading unit, 360a, 360b: Message, 10: External controller (display device), 16: Operation unit, 21: Display control unit, A1~A6: Inspection area

Claims

1. An image forming unit that forms an image on a sheet, An inspection unit for inspecting a sheet on which an image has been formed by the image forming unit, Two or more discharge units from which sheets inspected by the inspection unit are discharged, A setting unit that accepts settings related to the aforementioned inspection, A control unit that controls the formation of an image by the image forming unit and the discharge of sheets to the two or more discharge units, Equipped with, The control unit, In the first operating mode, The inspection unit discharges the normal sheets, in which no defects were detected, to the first discharge unit. The defective sheets in which defects have been detected by the inspection unit are discharged to the second discharge unit. At least one subsequent sheet following the defective sheet is discharged to the second discharge unit. The image formed on the defective sheet is reformed in the image forming unit, and, The image formed on the at least one subsequent sheet is reformed in the image forming unit. In the second operating mode, The inspection unit discharges normal sheets that were not found to have defects to the first discharge unit. The defective sheet in which the inspection unit has detected a defect is discharged to the second discharge unit. At least one subsequent sheet following the defective sheet, in which no defect was detected by the inspection unit, is discharged to the first discharge unit, and The image formed on the defective sheet is reformed in the image forming unit. The settings related to the aforementioned inspection include settings related to variable data inspection based on matching with variable data that differs for each page, The control unit causes the display device to display a message regarding the selection of the first or second operating mode based on the settings related to the variable data inspection. Inspection system.

2. The inspection system according to claim 1, wherein the control unit, in the case of a job spanning multiple pages, displays a message on the display device suggesting to the user to select the second operation mode for the job when the first operation mode is the default mode or selected by the user, and the inspection area for the variable data inspection is set commonly across the multiple pages.

3. The inspection system according to claim 2, wherein the setting unit accepts input from the user for selecting an operating mode after the message suggesting the selection of the second operating mode is displayed on the display device.

4. The inspection system according to claim 1, wherein the control unit, in the case of a job spanning multiple pages, displays a message on the display device notifying the user that the second operation mode is automatically selected for the job when the inspection area for the variable data inspection is set commonly across the multiple pages, while the first operation mode is the default mode or selected by the user.

5. The inspection system according to claim 1, wherein the control unit selects the second operating mode for a job that spans one page and multiple parts.

6. The inspection unit inspects the sheet on which the image has been formed by the image forming unit by determining whether there are any defects in the image read from the sheet. The aforementioned variable data inspection is an inspection based on a comparison between the variable data associated with each of the one or more inspection areas set on the page and the data detected within the inspection area in the read image. The aforementioned variable data changes from page to page. The inspection system according to claim 1.

7. The setting unit accepts a setting related to the variable data inspection, which specifies whether the order of pages should be preserved in the printed material for each of the one or more inspection areas. The control unit, in the settings related to the variable data inspection, if there is no inspection area designated as one in which the order of pages should be preserved, suggests to the user that the second operating mode be selected for a multi-page job, or automatically selects the second operating mode. The inspection system according to claim 6.

8. The inspection system according to claim 7, wherein the control unit, in the settings related to the variable data inspection, if there is at least one inspection area in which the order of pages should be preserved, proposes to the user to select the first operating mode for a multi-page job, or automatically selects the first operating mode.

9. The control unit, In the first operating mode, the at least one subsequent sheet is discharged to the second discharge unit without being inspected by the inspection unit. In the second operating mode, the inspection unit inspects at least one subsequent sheet, and subsequent sheets in which no defects are detected are discharged to the first discharge unit, and subsequent sheets in which defects are detected are discharged to the second discharge unit. The inspection system according to claim 1.

10. The inspection system according to claim 1, wherein when the second operating mode is selected for a job spanning multiple pages, the control unit presents to the user with information indicating the position between sheets in the first discharge unit where the sheet with the reformed image formed on the defective sheet was discharged.

11. A display device that displays information related to inspection in an inspection system including an image forming unit that forms an image on a sheet and an inspection unit that inspects the sheet on which the image has been formed by the image forming unit, The aforementioned inspection system, In the first operating mode, The inspection unit discharges the normal sheets, in which no defects were detected, to the first discharge unit. The defective sheets in which defects have been detected by the inspection unit are discharged to the second discharge unit. At least one subsequent sheet following the defective sheet is discharged to the second discharge unit. The image formed on the defective sheet is reformed in the image forming unit, and, The image formed on the at least one subsequent sheet is reformed in the image forming unit. In the second operating mode, The inspection unit discharges normal sheets that were not found to have defects to the first discharge unit. The defective sheet in which the inspection unit has detected a defect is discharged to the second discharge unit. At least one subsequent sheet following the defective sheet, in which no defect was detected by the inspection unit, is discharged to the first discharge unit, and The image formed on the defective sheet is reformed in the image forming unit. The inspection in the inspection system includes a variable data inspection based on matching with variable data that differs for each page. The aforementioned display device is An operating unit that accepts settings related to the aforementioned variable data inspection, A display control unit that displays a message on the screen regarding the selection of the first or second operation mode based on the settings related to the variable data inspection, A display device equipped with the following features.

12. The display device according to claim 11, wherein the display control unit, with respect to a job spanning multiple pages, displays a message on the screen suggesting to the user to select the second operation mode for the job when the first operation mode is the default mode or selected by the user, and the inspection area for the variable data inspection is set commonly across the multiple pages.

13. The display device according to claim 12, wherein the operation unit accepts input from the user for selecting an operation mode after the message suggesting the selection of the second operation mode is displayed on the display device.

14. The display device according to claim 11, wherein the display control unit displays a message on the screen notifying the user that the second operation mode is automatically selected for a job when the inspection area for the variable data inspection is set commonly across the multiple pages, in a situation where the first operation mode is the default mode or selected by the user for a job spanning multiple pages.

15. The operating unit accepts a setting related to the variable data inspection, which specifies whether the order of pages should be preserved in the printed material for each of one or more inspection areas. The display device according to claim 11, wherein the display control unit displays a message on the screen suggesting to the user to select the second operation mode for a multi-page job, or a message notifying the user that the second operation mode is automatically selected, when there is no inspection area in the settings related to the variable data inspection in which the order of pages should be preserved.

16. The display device according to claim 11, wherein when the second operating mode is selected for a job spanning multiple pages, the display control unit displays on the screen information indicating at what position among the sheets the sheet in which the image formed on the defective sheet has been reformed was discharged in the first discharge unit.

Images