Inspection device and control method for inspection device

Abstract

To solve such a problem that if a scan image is displayed when displaying an inspection result, information that should be concealed is exposed, and if the information is hidden, an occurrence cause of NG becomes hard to be found.SOLUTION: An inspection device comprises: reception means for receiving scan images generated by scanning a printed matter on which an image has been formed by image forming means; inspection means for performing inspection processing for inspecting the printed matter on the basis of the scan image and pre-registered correct answer data; setting means for performing inspection setting related to the inspection processing; and display control means for displaying the inspection processing result and the scan image. The display control means displays the image obtained by applying predetermined image processing to the scan image on a display unit on the basis of the inspection setting.SELECTED DRAWING: Figure 6

Description

Technical Field

[0001] The present invention relates to an inspection apparatus and a control method for the inspection apparatus.

Background Art

[0002] In recent years, a printing system is known in which a printed sheet printed by a printing apparatus is inspected by an inspection apparatus during conveyance. In the inspection of a printed sheet, the inspection apparatus scans an image of the printed sheet conveyed thereto and determines whether the printed sheet is normal by analyzing the read image. The inspection apparatus can detect, for example, barcodes, missing grid lines, printing defects (NG), etc. When the printed sheet is thus determined to be NG, the defective sheet is discharged to a discharge destination different from that of the normal sheet. This prevents defective sheets from being mixed into normal sheets and enables an operator to discard defective sheets.

[0003] Such inspection results are displayed on the screen during inspection together with the scanned image, or output by the operator as an inspection report. The screen during inspection is used for the operator to confirm the printed sheet when an NG occurs. The inspection report is used when calling for support due to a machine defect or reporting to a customer.

[0004] When a scanned image is displayed during an inspection screen or other inspection result display, information that should not be seen by an unspecified number of people, such as personal information or confidential information described on the printed sheet, will be exposed. In Patent Document 1, in order to hide the information of the scanned image, a method is described in which the entire scanned image is not displayed on a highly confidential sheet, and only the portion determined to be a printing defect in the inspection is displayed.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Summary of the Invention

[0006] However, in the above configuration, since the entire scanned image is not displayed and only the portion determined to be a printing defect in the inspection is displayed, the relative positional relationship from the normal portion is unknown, and the portion determined to be a printing defect in the inspection cannot be confirmed instantaneously. [Means for Solving the Problems]

[0007] The inspection apparatus of the present invention includes: a reception unit that receives a scanned image generated by scanning a printed matter on which an image is formed by an image forming unit; an inspection unit that performs an inspection process for inspecting the printed matter based on the scanned image, a registered correct image, and correct data; a setting unit that performs inspection settings related to the inspection process; and a display control unit that displays the result of the inspection process and the scanned image, wherein the display control unit is characterized by displaying, on a display unit, an image obtained by performing predetermined image processing on the scanned image based on the inspection settings. [Effects of the Invention]

[0008] According to the present invention, when displaying the inspection result, by displaying an image obtained by performing image processing on the location where the confidential information of the scanned image is described based on the inspection settings, it is possible to display the inspection result while protecting the confidential information. [Brief Description of the Drawings]

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Mode for Carrying Out the Invention

[0010] Hereinafter, the best mode for carrying out the present invention will be described with reference to the drawings.

[0011] [First Embodiment] FIG. 1 is an overall diagram of the hardware configuration of an image processing system according to the present embodiment. The image processing system includes an image forming apparatus 101 and an external controller 102. The image forming apparatus 101 and the external controller 102 are communicably connected via an internal LAN 105 and a video cable 106. Note that the video cable 106 may not have such a configuration and may be configured such that the internal LAN 105 substitutes for its function. The external controller 102 is communicably connected to a client PC 103 via an external LAN 104, and a print instruction is given from the PC 103 to the external controller 102.

[0012] A printer driver having a function of converting print data into a print description language processable by the external controller 102 is installed in the client PC 103. A user who performs printing can give a print instruction from various applications via the printer driver. The printer driver transmits print data to the external controller 102 based on a print instruction from the user. When the external controller 102 receives a print instruction from the PC 103, it performs data analysis and rasterization processing, inputs the print data to the image forming apparatus 101, and gives a print instruction.

[0013] Next, the image forming apparatus 101 will be described. Devices with a plurality of different functions are connected to the image forming apparatus 101, and it is configured to enable complex printing processes such as bookbinding.

[0014] The printing device 107 forms an image on the paper conveyed from the paper feeding unit 230 at the lower part of the printing device 107 using toner.

[0015] The inserter 108 is an inserter for inserting an insertion sheet. Sheets can be inserted from the inserter 108 at arbitrary positions with respect to the group of papers printed and conveyed by the printing device 107.

[0016] The inspection device 109 is a device for determining whether the printed image is normal by reading the image of the conveyed paper and comparing it with a pre-registered correct image. The sent sheet image is inspected according to preset inspection items. The inspection items include image inspection for inspecting dirt on the printed sheet and data inspection for inspecting whether data such as barcodes and characters are correctly printed on the printed sheet. The image inspection is performed by comparing the preset correct image with the sent sheet image. Methods for comparing images include comparing pixel values for each image position and comparing the positions of objects by edge detection. Also, methods for data inspection include extracting character data by OCR (Optical Character Recognition). The inspection items include misalignment of the printing position, color tone of the image, density of the image, streaks and smudges, and printing omission.

[0017] The high-capacity stacker 110 is a high-capacity stacker capable of stacking a large volume of sheets. The finisher 111 is a finisher that applies a finishing process to the conveyed sheets. It can perform finishing such as stapling, punching, and saddle stitching binding, and discharges the sheets to the discharge tray.

[0018] The printing system described with reference to FIG. 1 has a configuration in which an external controller 102 is connected to an image forming apparatus 101, but the present invention is not limited to a configuration with an external controller 102 connected. That is, the image forming apparatus 101 may be connected to an external LAN 104, and printing data that can be processed by the image forming apparatus 101 may be transmitted from a client PC 103. In this case, in the image forming apparatus 101, data analysis and rasterization processing are performed, and printing processing is executed.

[0019] FIG. 2 is a block diagram showing the system configuration of the image forming apparatus 101, the external controller 102, and the client PC 103.

[0020] First, the configuration of the printing apparatus 107 of the image forming apparatus 101 will be described. The printing apparatus 107 of the image forming apparatus 101 includes a communication I / F 217, a LAN I / F 218, a video I / F 220, an HDD 221, a CPU 222, a memory 223, an operation unit 224, and a display 225. Further, the printing apparatus 107 of the image forming apparatus 101 includes a reading unit 226, a latent image unit 227, an image forming unit 228, a fixing unit 229, and a paper feeding unit 230. Each component is connected via a system bus 231.

[0021] The communication I / F 217 is connected to an inserter 108, an inspection apparatus 109, a large-capacity stacker 110, and a finisher 111 via a communication cable 254, and communication for controlling each apparatus is performed.

[0022] The LAN I / F 218 is connected to the external controller 102 via the internal LAN 105, and communication such as printing data is performed.

[0023] The video I / F 220 is connected to the external controller 102 via a video cable 106, and communication such as image data is performed.

[0024] The HDD 221 is a storage device in which programs and data are stored. The CPU 222 comprehensively controls image processing control and printing based on programs and the like stored in the HDD 221. The memory 223 stores programs required when the CPU 222 performs various processes and image data, and operates as a work area. The operation unit 224 receives inputs of various settings and operation instructions from the user. The display 225 displays setting information of the image processing apparatus, the processing status of print jobs, and the like. The reading unit 226 performs a process of reading a document when using the copy function or the scan function. The document data is read by taking an image with a CMOS image sensor while illuminating an exposure lamp on the paper installed by the user. The latent image unit 227 is a device that forms a latent image for developing a toner image and performs primary charging and laser exposure. The image forming unit 228 is a device for transferring toner to paper, and is composed of a developing unit, a transfer unit, a toner supply unit, etc., and transfers the toner on the photosensitive drum to the paper. The fixing unit 229 is a device for melting and fixing the toner on the paper to the paper with heat and pressure, and is composed of a heating heater, a fixing belt, a pressure belt, etc. The paper feeding unit 230 is a device for feeding paper, and the paper feeding operation and the conveyance operation of the paper are controlled by rollers and various sensors.

[0025] Next, the configuration of the inserter 108 of the image forming apparatus 101 will be described. The inserter 108 of the image forming apparatus 101 is composed of a communication I / F 232, a CPU 233, a memory 234, and a paper feeding control unit 235, and each component is connected via a system bus 236. The communication I / F 232 is connected to the printing apparatus 107 via a communication cable 254, and performs communication necessary for control. The CPU 233 performs various controls necessary for insertion according to the control program stored in the memory 234. The memory 234 is a storage device in which the control program is stored. The paper feeding control unit 235 controls the paper feeding and conveyance of the paper conveyed from the paper feeding unit of the inserter and the printing apparatus 107 while controlling the rollers and sensors based on an instruction from the CPU 233.

[0026] Next, the configuration of the inspection device 109 of the image forming apparatus 101 will be described. The inspection device 109 of the image forming apparatus 101 includes a communication I / F 237, a CPU 238, a memory 239, a photographing unit 240, a display unit 241, an operation unit 242, and an HDD 255, and each component is connected via a system bus 243. The communication I / F 237 is connected to the printing device 107 via a communication cable 254, and communication necessary for control is performed. The CPU 238 performs various controls necessary for inspection according to the control program stored in the memory 239. The memory 239 is a storage device in which the control program is stored. The photographing unit 240 photographs the conveyed paper based on an instruction from the CPU 238. The CPU 238 stores the image photographed by the photographing unit 240 in the memory 239 as a correct image. Further, the CPU 238 compares the image photographed by the photographing unit 240 with the correct image stored in the memory 239, and performs an inspection process to determine whether the printed image is normal. The display unit 241 displays inspection results, setting screens, and the like. The operation unit 242 is operated by the user and receives instructions such as changing the settings of the inspection device 109 and registering a correct image. The HDD 255 stores various setting information and images necessary for inspection. The stored various setting information and images can be reused. In this embodiment, it is described that the inspection device 109 built in the image forming apparatus 101 performs the inspection process, but it is not limited thereto. For example, an inspection PC specialized in performing inspection processes may be connected to a main inspection device that mainly performs photographing via a communication unit, and the inspection PC that has received the image captured by the inspection device may execute an inspection process based on the inspection settings received by the inspection PC.

[0027] Next, the configuration of the high-capacity stacker 110 of the image forming apparatus 101 will be described. The high-capacity stacker 110 of the image forming apparatus 101 is composed of a communication I / F 244, a CPU 245, a memory 246, and a paper discharge control unit 247, and each component is connected via a system bus 248. The communication I / F 244 is connected to the printing apparatus 107 via a communication cable 254, and communication necessary for control is performed. The CPU 245 performs various controls necessary for paper discharge according to the control program stored in the memory 246. The memory 246 is a storage device in which the control program is stored. The paper discharge control unit 247 performs control to convey the conveyed paper to the stack tray, the escape tray, or the subsequent finisher 111 based on an instruction from the CPU 245.

[0028] Next, the configuration of the finisher 111 of the image forming apparatus 101 will be described. The finisher 111 of the image forming apparatus 101 is composed of a communication I / F 249, a CPU 250, a memory 251, a paper discharge control unit 252, and a finishing processing unit 253, and each component is connected via a system bus 256. The communication I / F 249 is connected to the printing apparatus 107 via a communication cable 254, and communication necessary for control is performed. The CPU 250 performs various controls necessary for finishing and paper discharge according to the control program stored in the memory 251. The memory 251 is a storage device in which the control program is stored. The paper discharge control unit 252 controls the conveyance and discharge of paper based on an instruction from the CPU 250. The finishing processing unit 253 controls finishing processes such as stapling, punching, and saddle stitching based on an instruction from the CPU 250.

[0029] Next, the configuration of the external controller 102 will be described. The external controller 102 is composed of a CPU 208, a memory 209, an HDD 210, a keyboard 211, a display 212, LAN I / Fs 213, 214, and a video I / F 215, and is connected through a system bus 216.

[0030] The CPU 208 comprehensively executes operations such as receiving print data from the client PC 103 based on programs and data stored in the HDD 210, performing RIP processing (Raster Image Processer), and transmitting print data to the image forming apparatus 101. It is also possible to perform RIP processing for correct answer image data. Specifically, in the RIP processing for correct answer image data, for example, an image is generated by converting the resolution of 600 dpi to 300 dpi, and in the RIP processing for print data, an image is generated without reducing the resolution.

[0031] The memory 209 stores programs and data necessary for the CPU 208 to perform various processes and operates as a work area. The HDD 210 stores programs and data necessary for operations such as print processing. The keyboard 211 is a device for inputting operation instructions for the external controller 102. Information such as the execution application of the external controller 102 is displayed on the display 212 by a video signal of a still image or a moving image. The LAN I / F 213 is connected to the client PC 103 via the external LAN 104, and communications such as print instructions are performed. The LAN I / F 214 is connected to the image forming apparatus 101 via the internal LAN 105, and communications such as print instructions are performed. The external controller 102 can exchange various data with the printing apparatus 107, the inserter 108, the inspection apparatus 109, the large-capacity stacker 110, and the finisher 111 via the internal LAN 105 and the communication cable 254.

[0032] The video I / F 215 is connected to the image forming apparatus 101 via the video cable 106, and communications such as print data are performed.

[0033] Next, the configuration of the client PC 103 will be described. The client PC 103 is composed of a CPU 201, a memory 202, an HDD 203, a keyboard 204, a display 205, and a LAN I / F 206, and is connected via a system bus 207. The CPU 201 executes the creation of print data and print instructions based on a document processing program or the like stored in the HDD 203. Also, the CPU 201 comprehensively controls each device connected to the system bus. The memory 202 stores programs and data necessary when the CPU 201 performs various processes and operates as a work area. Programs and data necessary for operations such as print processing are stored in the HDD 203. The keyboard 204 is a device for inputting operation instructions for the PC 103. Information such as the execution application of the client PC 103 is displayed on the display 205 by a video signal of a still image or a moving image. The LAN I / F 206 is connected to the external LAN 104, and communication such as print instructions is performed.

[0034] In the above description, the external controller 102 and the image forming apparatus 101 are connected by the internal LAN 105 and the video cable 106, but any configuration that can transmit and receive data necessary for printing may be used. For example, a configuration with only the video cable connected may be used. Also, the memory 202, the memory 209, the memory 223, the memory 234, the memory 239, the memory 246, and the memory 251 may be any storage devices for holding data and programs. For example, a configuration using a volatile RAM, a non-volatile ROM, a built-in HDD, an external HDD, a USB memory, etc. instead may be used. Note that the external controller may also be called an image processing controller, a digital front end, a print server, a DFE, etc.

[0035] Figure 3 is a mechanical cross-sectional view of the image forming apparatus 101. 107 is a printing device that forms an image to be printed on a sheet. 301 and 302 are paper feed decks. Each paper feed deck can accommodate various sheets. In each paper feed deck, only the topmost sheet of the accommodated sheets can be separated and conveyed to the sheet conveyance path 303. 304 to 307 are developing stations, and in order to form a color image, toner images are formed using Y, M, C, and K colored toners respectively. The toner images formed here are primarily transferred to the intermediate transfer belt 308, and the intermediate transfer belt 308 rotates clockwise in the figure, and the toner images are transferred to the sheet conveyed from the sheet conveyance path 303 at the secondary transfer position 309. The display 225 displays information regarding the printing status and settings of the image forming apparatus 101. 311 is a fixing unit for fixing the toner image onto the sheet. The fixing unit 311 includes a pressure roller and a heating roller, and when the sheet passes between the rollers, the toner is melted and pressed to fix the toner image onto the sheet. The sheet that has passed through the fixing unit 311 is conveyed to 315 through the sheet conveyance path 312. If further melting and pressing are required for fixing depending on the type of sheet, after passing through the fixing unit 311, it is conveyed to the second fixing unit 313 using the upper sheet conveyance path, and after additional melting and pressing, it is conveyed to 315 through the sheet conveyance path 314. When the image forming mode is double-sided, the sheet is conveyed to the sheet reversing path 316, reversed at 316, and then the sheet is conveyed to the double-sided conveyance path 317, and the second-sided image transfer is performed at the secondary transfer position 309. 108 is an inserter for inserting an inserted sheet. The inserter 108 includes an inserter tray 321 and merges the sheet fed through the sheet conveyance path 322 into the conveyance path. As a result, it becomes possible to insert a sheet at an arbitrary position into a series of sheet groups conveyed from the printing device 107 and convey it to the subsequent device.

[0036] The sheet that has passed through the inserter 108 is conveyed to the inspection device 109. Inside the inspection device 109, the photographing units 240 are arranged to face each other. The photographing units 240 are sensors for reading the upper surface and the lower surface of the sheet respectively. The inspection device 109 can read the image of the sheet using the photographing units 240 at the timing when the sheet conveyed on the sheet conveyance path 330 reaches a predetermined position, and determine whether the image of the device is normal. The inspection results and the like performed by the inspection device 109 are displayed on the display unit 241.

[0037] 110 is a high-capacity stacker capable of loading a large amount of sheets. The high-capacity stacker 110 has a stack tray 341 as a tray for loading sheets. The sheet that has passed through the inspection device 109 is input into the high-capacity stacker 110 through the sheet conveyance path 344. The sheet is loaded onto the stack tray 341 via the sheet conveyance path 345 from the sheet conveyance path 344. Further, the stacker 340 has an escape tray 346 as a paper discharge tray. The escape tray 346 is a paper discharge tray used to discharge the sheet determined to be a defective sheet by the inspection device 109. When outputting to the escape tray 346, the sheet is conveyed to the escape tray 346 via the sheet conveyance path 347 from the sheet conveyance path 344. When conveying the sheet to a post-processing device after the high-capacity stacker 110, the sheet is conveyed via the sheet conveyance path 348. 247 is a paper discharge control unit for inverting the sheet. This paper discharge control unit 247 is used when loading the sheet onto the stack tray 341. When loading onto the stack tray 341, the paper discharge control unit 247 inverts the sheet once so that the orientation of the input sheet is the same as the orientation of the sheet at the time of output. When conveying to the escape tray 346 or the subsequent post-processing device, since the sheet is discharged as it is without flipping during loading, the inversion operation by the paper discharge control unit 247 is not performed.

[0038] 111 is a finisher that applies finishing processing to the conveyed sheets according to the functions specified by the user. Specifically, the finisher 111 has finishing functions such as stapling (stapling at one or two locations), punching (two-hole or three-hole punching), and center stitching binding. The finisher 111 is provided with two paper output trays, 351 and 352, and is output to the paper output tray 351 via the sheet conveyance path 353. However, finishing processing such as stapling cannot be performed on the sheet conveyance path 353. When performing finishing processing such as stapling, the finishing function specified by the user is executed by the processing unit 355 via the sheet conveyance path 354 and output to the paper output tray 352. The paper output trays 351 and 352 can each be raised and lowered, and it is also possible to operate so as to lower the paper output tray 351 and stack the sheets that have been subjected to finishing processing by the processing unit 355 onto the paper output tray 351. When center stitching binding is specified, after stapling the sheets at the center by the center stitching processing unit 356, the sheets are folded in half and output to the center stitching binding tray 358 via the sheet conveyance path 357. The center stitching binding tray 358 has a belt conveyor configuration, and the center stitching bound bundles stacked on the center stitching binding tray 358 are configured to be conveyed to the left side.

[0039] Note that the image forming apparatus may also be called a multifunction printer, a multifunction peripheral, or an MFP.

[0040] [Flow of the entire inspection process] Next, the overall flow from the work before the start of inspection to the execution of inspection in the inspection apparatus 109 will be described using the flowchart of FIG. 4.

[0041] Each process in FIG. 4 is executed by the inspection apparatus 109 according to an operation from the user.

[0042] First, in step S401, the inspection device 109 performs reference registration and inspection settings. In the inspection settings, detailed information such as the inspection level, inspection type, and inspection area of the printed image inspection is input. Here, the reference refers to the combination of the correct image used for the image comparison inspection and the correct data used for the data collation inspection. At this time, either the correct image or the correct data may not exist. In such a case, the inspection for which the correct answer does not exist is not performed. For example, if only the correct image exists as the correct data, the data collation inspection is not performed. The inspection settings will be described later with reference to FIG. 5.

[0043] In step S402, the inspection device 109 compares the reference that is the correct answer for the inspection with the scanned image of the inspection target and performs the inspection. The inspection flow will be described later with reference to FIG. 8.

[0044] In step S403, the inspection device 109 creates an inspection report using the scanned image saved in S402 in response to the user's input.

[0045] [Inspection Setting Flow] FIG. 5 shows the flow when performing the inspection settings. Here, the inspection settings indicate the combination of the inspection-related content such as the inspection level and inspection content and the mask settings associated with the inspection content to be described later. First, when the inspection device 109 receives an inspection setting start instruction from the user, it accepts the input of the correct image in S501.

[0046] There are two methods for creating the correct image. The first method is to use the image scanned by the imaging unit 240 by executing a print job as the correct image.

[0047] In the imaging of the correct image, the inspection device 109 waits in the reading mode of the correct image and executes a printing job for correct image registration from the client PC 103. When printing is executed, the inspection device 109 detects the conveyance of the paper and scans the paper with the imaging unit 240, and the scanned image is stored in the memory 239 of the inspection device 109 as the correct image. Another method is to use the image data after RIP processing that analyzes the print data to generate image data instead of using the scanned image as the correct image. The scanned image simulated from the image data after RIP processing is treated as the correct image.

[0048] After that, at S502, the inspection settings are saved according to the user operation using the UI (User Interface) shown in FIG. 6.

[0049] The inspection settings by user operation will be described with reference to FIG. 6.

[0050] When the correct image is registered at S501, the inspection settings screen 601 is opened.

[0051] The correct image registered at S501 is displayed in the correct image window 602, and the user can perform settings related to the inspection content and mask by selecting the area within the window.

[0052] The rotation button 603 is a button for rotating the displayed correct image. Depending on the content to be printed, there may be cases where the text is rotated 90 degrees or 180 degrees, so as to facilitate the setting of the inspection area.

[0053] The data inspection button 604, the key area button 605, the standard area button 615, the simple area button 606, and the inspection exclusion area button 607 are buttons for selecting their respective inspection areas. When any of these buttons is selected, the selected inspection area can be written in the correct image window 602.

[0054] In the inspection area setting 608, the inspection level for each selected inspection area is set. The inspection area setting 608 has settings for inspection areas corresponding to the types of each area, and settings such as inspection levels and correct answer data files can be configured for each type of inspection area. For the simple inspection area, standard inspection area, and key inspection area, the inspection level can be set respectively. For the data inspection area, the correct answer CSV with the currently selected data inspection area in the correct answer image window 602 as the correct answer, and the type of data in the selected area (such as OCR, JAN code, QR code (registered trademark), etc.) can be selected.

[0055] Area 609 is an example of an area where an area is selected. This area has the same frame line as the simple area button 606, indicating that this area is a simple inspection area.

[0056] The mask setting 610 allows the selection of the area to be masked when the scanned image is displayed in S402 and S403. The areas of the type selected by the checkbox 611 will be masked when the scanned image is displayed on the display unit 241. In this embodiment, the setting is for masking when the scanned image is displayed both in S402 and S403, but it is not limited to this. For example, it may be configured such that the areas to be masked in the inspection step and the areas to be masked in the inspection report screen can be set respectively.

[0057] The detailed mask setting button 612 can set the details regarding the mask. Pressing this will display the detailed mask window in Fig. 7. In the detailed mask window, it is possible to set how to mask for the OCR area, barcode area, and pattern inspection area respectively.

[0058] In the mask setting for the OCR area, one option is selected by clicking the radio button 701. Here, four options are available: making it blank, applying mosaic, substituting dummy strings, and substituting dummy characters. When "making it blank" is selected, a filling process is performed to fill the mask area with the color of the paper white. Instead of filling with the color of the paper white, a deletion process of cutting and deleting the image of the mask area may be performed. When "applying mosaic" is selected, the readability is reduced by applying mosaic processing to the area to be processed during display. When "substituting dummy strings" is selected, a replacement process is performed to replace all the strings in the target area with the string entered in the character input field 702. When "substituting dummy characters" is selected, all the characters in the target area are replaced with the characters entered in the character input field 703.

[0059] In the mask setting for the barcode area, one option is selected by clicking the checkbox 704. Here, three options are available: making it blank, applying mosaic, and substituting dummy codes. When "making it blank" is selected, a filling process is performed to fill the mask area with the color of the paper white. When "applying mosaic" is selected, the readability is reduced by applying mosaic to the area to be processed during display. When "substituting dummy codes" is selected, a replacement process is performed to replace the barcode in the target area with a pre-generated dummy barcode. The code type for replacement should be the same as the code before replacement.

[0060] In the mask setting for the pattern inspection area, one option is selected by clicking the checkbox 705. Here, three options are available: making it blank, applying mosaic, and substituting dummy patterns. When "making it blank" is selected, a filling process is performed to fill the mask area with the color of the paper white. When "applying mosaic" is selected, the readability is reduced by applying mosaic to the area to be processed during display. When "substituting dummy patterns" is selected, a replacement process is performed to replace the image in the target area with the image entered in the dummy image input field 706. Also, in the current setting, since the setting to mask the pattern inspection area is not selected in Figure 6, the mask setting for the pattern inspection area is grayed out.

[0061] The detailed settings window of the mask closes when the OK button 707 or the Cancel button 708 is clicked. After that, the mask settings are retained in the memory 239 when the OK button 707 is clicked, and discarded when the Cancel button 708 is clicked.

[0062] When the OK button 613 is pressed, these inspection settings are saved to the HDD 255.

[0063] When the Cancel button 614 is pressed, these inspection settings are discarded and the inspection settings are terminated.

[0064] [Inspection Flow] FIG. 8 explains the flow when performing an inspection. When the user gives an inspection instruction after completing the setting in S401, the inspection device 109 starts the inspection at S402 and enters S801.

[0065] At S801, the inspection settings saved in the HDD 255 in S401 are acquired into the memory 239.

[0066] Thereafter, at S802, the inspection device 109 transitions to the scan standby state and accepts an external input at S803. When an image is scanned as an external input at S803, it transitions to S804. When an inspection end instruction is received from the user at S803, it transitions to S813.

[0067] At S804, the CPU 238 performs alignment processing between the scanned image and the correct image, and at S805, the CPU 238 obtains the difference between the two images. At S806, it is determined whether this difference amount has reached a specified value. If at S806 the difference in the images is less than the specified value, the process proceeds to S807 with the pattern inspection result being OK. At S807, a data inspection is executed to compare the correct data with the data read from the scanned image. In this case, the pattern inspection and the data inspection are sequentially executed, but the data inspection and the pattern inspection may be performed in parallel, and if NG occurs in either of the results of both inspections, the process may proceed to S808. If at S806 it is determined that the difference in the images has reached the specified value, the process proceeds to S808 with the pattern inspection result being NG. If the collation inspection result is NG at S807, the process proceeds to S808, and if the collation inspection result is OK, the process proceeds to S811.

[0068] At S808 and S811, the CPU 238 generates a masked scanned image by masking the area selected by the mask setting 610 of the scanned image in the manner specified by the mask detailed setting button 612.

[0069] After that, if the inspection result is NG, at S809, in order to clearly show where the NG is, the CPU 238 generates a display NG image by superimposing an NG map that emphasizes the points equal to or greater than the specified value of the image difference on the masked scanned image.

[0070] At S810 and S812, an inspection result screen as shown in FIG. 9 is displayed on the display unit 241. FIG. 9 shows an inspection result display screen when "Mask OCR area" and "Mask barcode area" are selected in the inspection settings of FIG. 6. Specifically, the characters in the four areas described as "OCR" in FIG. 6 are replaced with "**" and displayed. Also, regarding the four areas described as "barcode", the barcode symbols are replaced with dummy codes specified in advance. For example, if the decoded result strings of the QR codes described in the actual printed matter are "Taro", "Ichiro", "Hanako", "Jiro" which are the destinations of each printed matter, they are replaced with a QR code (registered trademark) showing the character string "SAMPLE" and displayed.

[0071] When the inspection result is OK, the masked scan image is displayed on the scan image display screen 901, and when the inspection result is NG, the display NG image is displayed. In FIG. 9, there are one or more defects in the defect 902 and they are highlighted. This highlighting can be done by methods such as coloring or surrounding with circles or squares. Also, the defects highlighted in this way are displayed in the NG list 903 to show what kind of defects they are. Conventionally, when the data inspection is NG, the read data and the correct data are displayed for easy comparison, but in this case, when masking the data inspection area, considering that it is information to be hidden, neither the scan nor the correct reading result is displayed.

[0072] Also, the inspection end button 904 is a button for sending an inspection end instruction. When this button is pressed, it is recognized that the inspection end instruction is received at S803, and the process transitions to S813. At S813, the inspection result is saved to the HDD 255 together with the inspection settings called at S801. However, regarding the scan image, since the size is large and it is difficult to save it in the memory 239, it may be saved to the HDD 255 for each inspection.

[0073] In the creation of the inspection report at S403, the inspection report screen in FIG. 10 can be opened by referring to the inspection results saved in the HDD 255. By pressing the report output button 1001, an inspection report that allows the scan image and the NG list to be confirmed can be output. The inspection report can be viewed on the inspection report screen even without this inspection device, and there are forms such as viewing on a browser or outputting the NG list as a CSV file and the scan image as a file. By pressing the close button 1002, the inspection report screen can be terminated. As shown in FIG. 10, since the scan image is also displayed on the inspection report screen, the masking using the same inspection settings is effective.

[0074] During the inspection as described above, while selecting the information to be protected by displaying the masked image as the inspection result based on the settings saved in advance at the time of inspection settings regarding the display of the inspection report, the scanned image can be displayed to the user.

[0075] [Second Embodiment] In the first embodiment, the setting method for determining the mask area based on the inspection type was taken up and explained. However, with this setting method, there is a possibility that areas that do not need to be hidden may also be hidden, making the scanned image difficult to understand. For example, if both the ID and name are described, there is a possibility that both will be hidden, making the whole difficult to see. Therefore, in the second embodiment, the method of mask setting for each area will be explained using FIG. 11. In the first embodiment, the inspection setting including the mask setting was referred to as the inspection setting, but in the second embodiment, since the inspection content and the mask setting are not associated with the inspection content, the mask setting is not included in the inspection setting.

[0076] The UI for performing the inspection setting and the mask setting is shown in FIG. 11.

[0077] In this embodiment, the case where area 1101 is replaced with the dummy character "Name", area 1102 is replaced with the dummy character "Company Name", and area 1103 is not masked will be explained.

[0078] In FIG. 11, the mask setting can be performed for each selected area. First, as shown in FIG. 11(a), the user selects the area to be masked by clicking on area 1101 with the mouse.

[0079] Subsequently, when the mask setting button 1104 is pressed, a mask setting window 1105 for the selected area is opened. At this time, the selected area is displayed in an identifiable manner. For example, the selected frame line becomes a thick frame, the displayed color changes, or the inside of the frame is filled so as to be transparent. This mask setting window can hold settings individually for each area. The user can select the desired mask setting by selecting the radio button 1106 in the mask setting window 1105 and setting the dummy string as "Name". Thus, the mask setting for the area 1101 is completed.

[0080] Subsequently, as shown in Fig. 11(b), the user selects the area 1102 by mouse click, presses the mask setting button 1104 to open the mask setting window. Then, the radio button 1106 is selected and the dummy string is input as "Company Name". Thus, the inspection setting for the area 1102 is completed. Since the area 1103 is an area not to be masked, the mask setting button 1104 is not pressed. As described above, the area 1101 can be replaced with the dummy character "Name", the area 1102 can be replaced with the dummy character "Company Name", and the area 1103 can be set not to be masked.

[0081] Also, in the setting of the masked area, the pre-set masked area can be used as a template as it is. The mask setting call button 1107 calls the masked area of the pre-set template. The current setting can be saved by pressing the mask setting save button 1108. For example, in order to prevent work mistakes and worker peeping, the template saving and the setting change of the saved masked area may be locked by a password or the like.

[0082] FIG. 11(c) is an example of a screen during inspection in the inspection settings and mask settings set in FIGS. 11(a) and 11(b). The mask settings set in FIGS. 11(a) and 11(b) are reflected in area 1109. Here, the dummy character string may be displayed in the same color as the printed matter, or may be displayed in a color different from that of the printed matter so that it can be recognized as a dummy character. For example, when "XX Corporation × Mr. Yam" in FIG. 11(a) is printed in black, "Company Name Name Mr." in FIG. 11(c) which is a dummy character may be displayed in black, or may be displayed in red. Also, the display color of the dummy characters may be configured to be selectable from a color chart (not shown).

[0083] As described above, even for the same inspection type, different mask settings can be made for each area.

[0084] [Explanation of methods for reducing readability] A method for reducing readability when mosaic is selected in FIG. 7 will be described. In this case, the mosaic method is adopted, but since the purpose is to reduce readability, other methods such as filtering processing may be adopted. That is, any method may be used as long as it is a process that makes the character string in a visually indiscernible state, a state where data extraction is impossible, or a state where the extracted data does not match the correct data. That is, it is necessary to make it difficult for a person to read in the OCR area. For the barcode area, it should be made impossible to read with a barcode reader or the like.

[0085] When performing mosaic processing, the mask area selected from the scanned image is set as the ROI (Region Of Interest), and a resolution reduction process is performed on the ROI. For example, as shown in FIG. 12, although the scanned image is an image scanned at 300×300 DPI, the readability can be reduced by performing a resolution conversion process so that only the mask area has a resolution of 15×15 DPI.

[0086] Incidentally, the above resolution conversion conditions may be changed according to the character size of the printed matter and the input image fidelity required for the inspection NG display. At that time, since it is an object of the present invention to reduce readability, as a method for confirming the effect, the inspection NG image may be subjected to OCR processing, and the resolution conversion conditions may be determined so as to obtain an OCR analysis result different from the input image.

[0087] As described above, in this case, during the inspection and for the display of the inspection report, masking based on the settings saved in advance at the time of inspection setting has been described. As a result, it is possible to select the information to be protected when the scan image is displayed as the inspection result.

Claims

1. A receiving means for receiving a scanned image generated by scanning a printed matter on which an image has been formed by an image forming means; An inspection means for performing an inspection process for inspecting the printed matter based on the scanned image and pre-registered correct data; A setting means for performing inspection settings regarding the inspection process; A display control means for displaying the result of the inspection process and the scanned image on a display unit; having, The display control means displays, on the display unit, an image obtained by performing predetermined image processing on a region specified by the inspection setting in the scanned image. An inspection apparatus characterized by this.

2. The display control means displays an image obtained by performing image processing for replacing a region specified by the inspection setting in the scanned image with designated information. The inspection apparatus according to claim 1, characterized by this.

3. The image processing for replacement with the designated information is at least one of a filling process, an image replacement process, and an image deletion process. Characterized by this The inspection apparatus according to claim 2, characterized by this.

4. The display control means displays an image obtained by performing image processing for reducing the readability of a region specified by the inspection setting in the scanned image. The inspection apparatus according to claim 1, characterized by this.

5. The image processing for reducing the readability is at least one of a process for making a character in a visually indistinguishable state, a process for making data extraction impossible, and a process for making the extracted data inconsistent with the correct data. The inspection apparatus according to claim 4, characterized by this.

6. The image processing that causes the readability is at least one of filtering processing and mosaic processing. The inspection apparatus according to claim 4 or 5, characterized by this.

7. The inspection means performs a first inspection process for inspecting the printed matter by comparing the scanned image with the correct image included in the correct data. The inspection apparatus according to claim 1, characterized by this.

8. The inspection means performs a second inspection process for inspecting the printed matter by comparing the data extracted from the scanned image with the correct data. The inspection apparatus according to claim 1, characterized by this.

9. The setting means performs at least setting of designation of an area where the inspection process is performed and a method of the inspection process for the area. The inspection apparatus according to claim 1, characterized by this.

10. The display control means displays the image of the printing defect detected in the inspection process by superimposing it on the image subjected to the predetermined image processing. The inspection apparatus according to claim 1, characterized by this.

11. A reception step of receiving a scanned image generated by scanning a printed matter on which an image is formed by an image forming means, An inspection step of performing an inspection process for inspecting the printed matter based on the set inspection settings based on the scanned image and the correct data registered in advance, A display step of displaying the result of the inspection process and the scanned image, having, The display step displays, on a display unit, an image obtained by subjecting the scanned image to predetermined image processing based on the inspection settings. A control method for an inspection apparatus, characterized by this.

12. Receiving means for receiving a scanned image generated by scanning a printed matter on which an image has been formed by an image forming means; Inspection means for performing an inspection process of inspecting the printed matter based on an inspection setting related to the inspection process based on the scanned image and correct data registered in advance; Display control means for displaying the image on a display unit; Setting means for setting a mask area to be masked and displayed as a display method of the inspection process; Having; The display control means displays, on the display unit, an image obtained by performing predetermined image processing on the mask area set by the setting means in the image. An inspection apparatus characterized by the above.

13. The display control means displays an image obtained by performing image processing for replacing the mask area in the scanned image with designated information. The inspection apparatus according to claim 12, characterized by the above.

14. The image processing for replacing with the designated information is at least one of a filling process, an image replacement process, and an image deletion process. The inspection apparatus according to claim 13, characterized by the above.

15. The display control means displays an image obtained by performing image processing for reducing the readability of the mask area in the scanned image. The inspection apparatus according to claim 12, characterized by the above.

16. The image processing for reducing the readability is at least one of a process of making a character in a visually indistinguishable state, a process of making data extraction impossible, and a process of making the extracted data inconsistent with the correct data. The inspection apparatus according to claim 15, characterized by the above.

17. The image processing for reducing the readability is at least one of a filtering process and a mosaic process. The inspection apparatus according to claim 15 or 16, characterized in that.

18. The inspection means performs a first inspection process for inspecting the printed matter by comparing the scanned image with a correct image included in the pre-registered correct data. The inspection apparatus according to claim 12, characterized in that.

19. The inspection means performs a second inspection process for inspecting the printed matter by comparing the data extracted from the scanned image with the correct data. The inspection apparatus according to claim 12, characterized in that.

20. The display control means overlays and displays an image of a printing defect detected in the inspection process on an image subjected to the predetermined image processing. The inspection apparatus according to claim 12, characterized in that.

21. A reception step of receiving a scanned image generated by scanning a printed matter on which an image is formed by an image forming means, An inspection step of performing an inspection process for inspecting the printed matter based on an inspection setting related to the inspection process based on the scanned image and pre-registered correct data, A display step of displaying the result of the inspection process and the scanned image, A setting step of setting a mask area to be masked and displayed when displaying, And having In the display step, an image obtained by subjecting the scanned image to predetermined image processing is displayed on a display unit for the set mask area. A control method for an inspection apparatus, characterized in that.

Images