Printed matter inspection device and method

Abstract

To solve the problem that performing dropout color processing on an image in order to facilitate recognition processing on the image disables an inspection on whether or not a margin area is sufficiently reserved around a code image of a bar code and the like.SOLUTION: An inspection device is controlled to perform first recognition processing after dropout color processing, on a first inspection area that is set to an image generated by reading a printed matter, meanwhile, performs second recognition processing and inspection on whether or not a margin area is sufficiently reserved, on a second inspection area that is set to the image, without performing the dropout color processing.SELECTED DRAWING: Figure 9

Description

[Technical Field]

[0001] The present invention relates to an apparatus and method for inspecting the print quality of printed matter. [Background technology]

[0002] Recently, printing systems have become known in which an inspection device inspects printed sheets while the sheets are being transported by a printing device. In this inspection, the inspection device reads an image of the transported sheet and analyzes the image to determine whether printing on the sheet was performed properly. Such inspection devices can detect missing characters or barcodes printed on the printed material, missing images, printing defects, missing pages, color misalignment, and other issues. If a printed sheet is determined to be defective, the defective sheet is ejected to a different destination from normal sheets. This prevents defective sheets from being mixed in with normal sheets and allows the operator to discard the defective sheets.

[0003] In addition, in order to improve the accuracy of inspections in the above-mentioned systems, a method is also used in which optical character recognition (OCR) or barcode recognition is used to read the character string or barcode to be inspected, and the inspection is carried out by comparing the recognition results with a predetermined correct value.

[0004] In order to improve the accuracy of inspections using such methods, it is necessary to improve the accuracy of character recognition processing (OCR) and barcode recognition. Patent Document 1 discloses a method for improving recognition accuracy by removing predetermined chromatic color components contained in the area to be inspected (dropout color processing) to remove unnecessary lines that overlap printed character strings and barcodes beforehand, thereby performing recognition processing. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Laid-Open No. 2006-165685 Summary of the Invention [Problem to be solved by the invention]

[0006] On the other hand, to ensure that barcodes and 2D codes can be correctly recognized, there are regulations regarding the minimum blank space (quiet zone) that must be provided around the code. Inspection equipment must be able to check whether printing complies with these regulations (whether other characters, figures, or other objects are printed within the blank space).

[0007] When performing an inspection, the barcode included in the inspection area may be surrounded by a ruled line. If the inspection is performed without taking these ruled lines into consideration, it will be impossible to determine whether sufficient margin area has been secured, and the inspection cannot be performed with high accuracy. [Means for solving the problem]

[0008] In order to solve the above problem, the inspection device of the present invention comprises an image forming means for forming an image on paper, a reading means for reading the image formed by the image forming means, and an inspection means for performing an inspection by comparing the read image read by the reading means with a pre-registered reference image, and is characterized in that if an inspection area set as an area to be inspected by the inspection means includes a barcode and a ruled line surrounding the barcode, and includes a margin area of ​​at least a predetermined amount between the barcode and the ruled line, the inspection is performed by the inspection means, and if the inspection area includes the barcode and the ruled line, and does not include a margin area of ​​at least the predetermined amount between the barcode and the ruled line, the inspection is not performed by the inspection means. [Effects of the Invention]

[0009] This makes it possible to improve the inspection accuracy of printed matter. [Brief explanation of the drawings]

[0010] [Figure 1]Schematic diagram showing the configuration of an information processing device, an inspection device, and a printing device [Figure 2] Block diagram showing the configuration of an information processing device, an inspection device, and a printing device [Figure 3] FIG. 1 is a diagram showing the internal configuration of an information processing device, an inspection unit, a printing device, and a large-capacity stacker. [Figure 4] Flowchart of the entire inspection process [Figure 5A] Figure showing the inspection setting screen [Figure 5B] Figure showing the inspection setting screen [Figure 5C] Figure showing the inspection setting screen [Figure 5D] Figure showing the inspection setting screen [Figure 6] Figure showing the inspection area list screen [Figure 7] Inspection settings flowchart [Figure 8] Inspection execution flowchart [Figure 9] Character and barcode recognition flowchart [Figure 10] Figure showing the inspection setting screen [Figure 11] FIG. 10 is a diagram showing an example of an image that serves as input for character and barcode recognition in this embodiment. [Figure 12] Figure showing the inspection setting screen [Figure 13] Character and barcode recognition flowchart [Figure 14] Character and barcode recognition flowchart [Figure 15] Diagram showing the test results screen DETAILED DESCRIPTION OF THE INVENTION

[0011] Below, we will explain the form for implementing the present invention using drawings, but the following form does not limit the invention related to the claims, and not all of the combinations of features described in the form are necessarily essential to the solution of the invention.

[0012] [First embodiment] 1 is a schematic diagram showing the configuration of an information processing device, an inspection device, and an image forming device in this embodiment. Note that, although the image forming device in this embodiment will be described using an electrophotographic image forming device, the image forming device in this embodiment may be an image forming device of a different image forming method, such as an inkjet method or an offset method.

[0013] The image forming apparatus 0101 is connected to an information processing apparatus 0109 via a communication cable 0112. The information processing apparatus 0109 is connected to a client computer 0110 and an inspection apparatus 0108 via a network 0113. The image forming apparatus 0101 includes a UI panel 0102, a paper feed deck 0103, and a paper feed deck 0104. An optional deck 0105 consisting of three paper feed decks is also connected. The image forming apparatus 0101 is, for example, an electrophotographic image forming apparatus. The UI panel 0102 is, for example, a user interface equipped with a capacitive touch panel.

[0014] The image forming apparatus 0101 further includes an inspection unit 0106 and a large-capacity stacker 0107. The inspection unit is connected to an inspection device 0108 via a communication cable 0114. The large-capacity stacker 0107 includes a main tray and a top tray, and the main tray can hold several thousand sheets of paper at a time.

[0015] A print job is generated by the client computer 0110, transmitted to the information processing device 0109 via the network 0113, and managed by the information processing device 0109. The print job is then transmitted from the information processing device 0109 to the image forming device 0101 via the communication cable 0112, and the image forming device 0101 performs processing to print on paper based on the received print job. Note that the print job may also be generated and managed by the information processing device 0109, transmitted to the image forming device 0101 via the network 0112, and managed by the image forming device 0101.

[0016] It should be noted that the client computer 0110, the information processing device 0109, and the inspection device 0108 may all be configured to be able to communicate with the image forming device 0101 via communication cables. That is, the connection configuration of the image forming device 0101, the information processing device 0109, and the client computer 0110 shown in this embodiment is just an example, and it goes without saying that there are various other connection configurations besides that shown in this embodiment.

[0017] FIG. 2 is a block diagram showing the control configuration of the image forming apparatus 0101, the inspection apparatus 0108, the large-capacity stacker 0107, the information processing apparatus 0109, and the client computer 0110 in this embodiment.

[0018] The CPU (Central Processing Unit) 0201 controls and performs calculations for each component within the image forming apparatus 0101 via a system bus 0212. The CPU 0201 functions as a processing unit that executes each process described below by executing programs stored in a computer-readable storage unit 0205 and loaded into a RAM (Random Access Memory) 0202. The RAM 0202 is a type of general volatile storage device directly accessible by the CPU 0201 and is used as a work area for the CPU 0201 or other temporary data storage area. The storage unit 0205 also functions as a temporary storage area and work memory during operation of the image forming apparatus. The engine I / F 0209 communicates with the printer engine 0210. The paper feed deck I / F 0204 communicates with the paper feed deck 0211. The paper feed deck 0211 functions as a processing unit that executes each process described below by collectively referring to the paper feed decks 0103, 0104, and optional deck 0105 as a hardware configuration. The UI panel 0203 is a hardware configuration of the UI panel 0102, and is a user interface for performing overall operations of the image forming apparatus 0101. In this embodiment, the UI panel 0203 is equipped with a capacitive touch panel.

[0019] The network interface (hereinafter, NW I / F) 0207 is connected to the NW I / F 0238 of the information processing device 0109 via a communication cable 0213 and is used for communication between the information processing device 0109 and the image forming device 0101. Note that in this example, the interfaces (0207, 0238) connected to the system bus (0212, 0239) are directly connected to each other, but this is not limited to this. For example, the information processing device 0109 and the image forming device 0101 may be connected via a network such as a LAN, and the connection type is not limited to this. The video I / F 0206 is connected to the video I / F 0233 via a video cable 0241 and is used for communication of image data between the information processing device 0109 and the image forming device 0101. Note that the connection interface between the information processing device 0109 and the image forming device 0101 may be a combination of the functions of the NW I / F 0238 and the video I / F 0233. The connection interface between the image forming apparatus 0101 and the information processing apparatus 0109 may be a combination of the functions of the NW I / F 0207 and the video I / F 0206 .

[0020] The accessory I / F 0208 is connected to the accessory I / F 0214 and the accessory I / F 0220 via a communication cable 0225. That is, the image forming apparatus 0101 can communicate with the inspection unit 0106 and the large-capacity stacker 0107 via the accessory I / Fs 0208, 0214, and 0220.

[0021] The CPU 0216 controls and performs calculations for each component within the inspection unit 0106 via a system bus 0219. The CPU 0216 functions as a processing unit that executes each process described below by executing programs stored in a computer-readable storage unit 0247 and loaded into a RAM 0217. The RAM 0217 is a type of general volatile storage device that can be directly accessed by the CPU 0216 and is used as a work area or other temporary data storage area for the CPU 0216. The storage unit 0247 functions as a temporary storage area and work memory during inspection device operation. The inspection device I / F 0215 is connected to the inspection device unit I / F 0231 via a communication cable 0248. That is, the inspection unit 0106 communicates with the inspection device 0108 via the inspection device I / F 0215 and the inspection device unit I / F 0231. The photographing unit 0218 has a photographing function (scanning function) equipped with, for example, a contact image sensor (hereinafter, CIS), and transmits an image generated by photographing (reading and scanning) a sheet of paper passing through the inspection unit to the inspection device 0108 via the inspection device I / F 0215. Note that the CIS equipped in the photographing unit 0218 is an example of a sensor, and may be another type of sensor such as a CCD image sensor, and the photographing method (scanning method) is not limited thereto.

[0022] The CPU 0220 controls and performs calculations for each unit in the large-capacity stacker 0107 via the system bus 0224. The CPU 0220 functions as a processing unit that executes each process described below by executing programs stored in the computer-readable storage unit 0248 and loaded into the RAM 0222. The RAM 0222 is a type of general volatile storage device that can be directly accessed by the CPU 0221, and is used as a work area for the CPU 0221 or as a temporary data storage area. The paper discharge unit 0223 monitors and controls the paper discharge operation to the main tray and top tray, and the loading status of each of the main tray and top tray.

[0023] The CPU 0226 of the inspection device 0108 controls and performs calculations for each component within the inspection device 0108 via the system bus 0230. The CPU 0226 functions as a processing unit that executes each process described below by executing programs stored in the computer-readable storage unit 0228 and loaded into the RAM 0227. The RAM 0227 is a type of general volatile storage device directly accessible by the CPU 0226 and is used as a work area or other temporary data storage area for the CPU 0226. The storage unit 0228 functions as a temporary storage area and work memory during inspection device operation. The PDL analysis unit 0229 reads PDL data, such as PDF, PostScript, or PCL, received from the client computer 0110 or the information processing device 0109 and performs interpretation processing. The display unit 0245 is, for example, a liquid crystal display connected to the inspection device, and accepts user inputs to the inspection device and displays the status of the inspection device.

[0024] The CPU 0234 of the information processing device 0109 controls and performs calculations for each unit within the information processing device 0109 via a system bus 0239. The CPU 0234 functions as a processing unit that executes each process described below by executing programs stored in a computer-readable storage unit 0236 and loaded into a RAM 0235. The RAM 0235 is a type of general volatile storage device that can be directly accessed by the CPU 0234 and is used as a work area for the CPU 0234 or other temporary data storage area. The storage unit 0236 functions as a temporary storage area and work memory when the information processing device is operating. The network interface (hereinafter referred to as NW I / F) 0237 is connected to the NW I / Fs 0232 and 0240 via a network. The information processing device 0109 communicates with the inspection device 0108 via the NW I / Fs 0237 and 0232. The information processing device 0109 also communicates with the client computer 0110 via the NW I / F 0237 and the NW I / F 0240 .

[0025] The CPU 0243 of the client computer 0110 controls each unit in the client computer 0110 and performs calculations via the system bus 0246. The CPU 0243 functions as a processing unit that executes each process described below by executing programs stored in the computer-readable storage unit 0245 and loaded into the RAM 0242. The RAM 0242 is a type of general volatile storage device that can be directly accessed by the CPU 0243, and is used as a work area for the CPU 0243 or other temporary data storage area. The storage unit 0244 functions as a temporary storage area and work memory when the client computer is operating.

[0026] FIG. 3 shows the internal configuration of the printing device 0101, inspection unit 0106, and large-capacity stacker 0107. The printing device 0101 accepts user input and displays printing and device status via a UI panel 0102. Various types of paper can be stored in the paper feed decks 0103 and 0104. Each paper feed deck can separate only the topmost sheet of paper from the stack and transport it to a paper transport path 0305. Development stations 0301 to 0304 form color images by using Y, M, C, and K color toners, respectively. The toner images formed here are primarily transferred to an intermediate transfer belt 0306. The intermediate transfer belt 0306 rotates clockwise in the figure, and the toner image is transferred to paper transported from the paper transport path 0305 at a secondary transfer position 0307. The fusing unit 0308 is equipped with a pressure roller and a heating roller, and as the paper passes between these rollers, the toner is melted and pressed to fix the toner image to the paper. After passing through the fusing unit 0308, the paper is transported to 0312 via paper transport path 0309. If further fusing and pressing is required for fusing depending on the type of paper, after passing through the fusing unit 0308, the paper is transported to the second fusing unit 0310 via the upper paper transport path, where additional fusing and pressing is performed, and then transported to 0312 via paper transport path 0311. If the image formation mode is double-sided, the paper is transported to the paper reversal path 0313, and after being reversed at 0313, is transported to the double-sided transport path 0314, where the image on the second side is transferred to the secondary transfer position 0307.

[0027] CISs 0315 and 0316 are arranged facing each other within the inspection unit 0106. CIS 0315 is a sensor for reading the top surface of the paper, and CIS 0316 is a sensor for reading the bottom surface of the paper. The inspection unit 0106 scans the paper using CISs 0315 and 0316 when the paper transported on the paper transport path 0317 reaches a predetermined position. The image generated by the scan is sent to the inspection device 0108 via the inspection device I / F 0215 and the inspection unit I / F 0231. The CPU 0226 of the inspection device 0108 determines whether the received image contains defects and notifies the inspection unit 0106 of the determination result via the inspection unit I / F 0231 and the inspection device I / F 0215. The inspection unit CPU 0216 notifies the received determination result to the large-capacity stacker 0107 via the accessory I / Fs 0214 and 0220.

[0028] The large-capacity stacker 0107 can hold a large volume of paper. The large-capacity stacker 0107 has a main tray 0324 as a tray for stacking paper. Paper that has passed through the inspection unit 0106 enters the large-capacity stacker 0107 via a paper transport path 0319. Paper that is determined to be properly printed by the inspection device 0108 is transported from the paper transport path 0319 to a paper transport path 0322 and then stacked on the main tray 0324. The large-capacity stacker 0107 also has a top tray 0320 as a paper output tray. The CPU 0221 controls the ejection of paper that has been detected as defective by the inspection device 0108 to the top tray 0320. When outputting to the top tray 0320, the paper is transported from the paper transport path 0319 to the top tray 0320 via a paper transport path 0321. Reference numeral 0323 denotes an inverting unit for inverting paper. This inverting unit 0323 is used when stacking paper on the main tray 0324. To ensure that the orientation of the incoming paper is the same as the orientation of the paper when it is loaded onto the main tray 0324, the paper is inverted once by the inverting unit 0323. When transporting paper to the top tray 0320, the paper is discharged as is without being flipped when it is loaded, so the inverting unit 0323 does not perform the inverting operation.

[0029] The following describes the processing that characterizes the present invention using flowcharts and screen examples. The image forming apparatus program associated with this flow is stored in the storage unit 0205 of the image forming apparatus 0101, read into the RAM 0202, and executed by the CPU 0201. The inspection apparatus program associated with this flow is stored in the storage unit 0228 of the inspection apparatus 0108, read into the RAM 0227, and executed by the CPU 0226. The information processing apparatus program associated with this flow is stored in the storage unit 0236 of the information processing apparatus 0109, read into the RAM 0235, and executed by the CPU 0234. The client computer program associated with this flow is stored in the storage unit 0245 of the client computer 0110, read into the RAM 0242, and executed by the CPU 0243.

[0030] The overall flow from the registration of a reference image before the start of the inspection to the inspection of the image to be inspected will be explained using the flowchart in Figure 4.

[0031] First, in step S401, the user registers a reference image that will serve as a reference for inspection. First, a print job for registering the reference image is executed on the client computer 0110 to generate the reference image. Then, the inspection device 0108 reads and registers the generated reference image.

[0032] Next, in step S402, the user sets the inspection parameters, inspection area, and inspection level, as will be described in detail later.

[0033] Next, in step S403, the printout printed by the image forming apparatus 0101 is inspected by the inspection device 0108. That is, a print job for generating the printout to be inspected is generated by the client computer 0110 and transmitted to the information processing device 0109 for management. When the image forming apparatus 101 executes this print job and outputs the printout, the inspection unit 0106 detects the conveyance of the printed paper, scans the paper using the CIS 0315 and 0316, and stores the scanned image in the RAM 303 of the inspection device 0108. The inspection device compares the stored scanned image with a reference image to inspect whether the printout is correct and outputs the inspection results. The inspection is performed based on the settings specified by the user in the inspection settings. Based on the inspection results, the large-capacity stacker 0107 ejects printouts determined to have defects to a separate tray.

[0034] Next, the details of the inspection setting in S402 will be explained using the flowcharts of Figures 5A to 5D, Figure 6, and Figure 7. The inspection setting starts by selecting the reference image registered in the reference registration.

[0035] 5A to 5D are examples of inspection setting screens that are displayed on the UI panel 0102 and that accept an operation to execute inspection settings from the user. On the inspection setting screen, the user specifies the position of the inspection area on the preview-displayed reference image, and further performs individual settings for each inspection area.

[0036] Reference numeral 501 denotes a preview display area where a reference image is displayed as a preview. If the reference image is generated based on a multi-page print job, the reference image for each page can be displayed sequentially by switching the reference image displayed as a preview.

[0037] Reference numerals 502 to 504 denote frames showing inspection areas arranged on the preview. The inspection areas are arranged using an inspection area arrangement button 506, and the size and position can be changed by the user dragging the mouse. Reference numeral 502 shows an example of an arranged pattern inspection area. Reference numeral 503 shows an example of an arranged character string inspection area. Reference numeral 504 shows an example of an arranged barcode inspection area. In this embodiment, the barcode inspection area is an area for inspecting at least one of a barcode and a two-dimensional code (such as a QR code (registered trademark)).

[0038] An inspection area selection button 505 is provided. After the user presses the inspection area selection button 505, the user can select an inspection area by clicking one of frames 502 to 504 indicating the inspection area with the mouse.

[0039] An inspection area placement button 506 is referenced. After the user presses the inspection area placement button 506, the user selects the type of inspection area from the displayed pull-down menu, and then selects the area on the preview display that the user wants to specify as the inspection area by dragging the mouse, thereby accepting the placement operation of the inspection area.

[0040] 507 is a setting item for selecting data for verification testing using the file selection method. Verification testing data is a reference CSV file for data testing that is verified when conducting a data test. The reference CSV file is a file that the user must prepare in advance, and it is a file that lists the correct strings for string testing and the correct strings when decoded for barcode testing. In other words, when a data test is performed to verify the contents of a scanned string or the decoded contents of a code image (barcode or 2D code), the OCR results of the string image in the string testing area and the string resulting from decoding the code image are verified against the correct strings listed in the reference CSV file.

[0041] Reference numeral 508 denotes setting items for the selected area, and individual setting values ​​for the inspection area selected after pressing the inspection area selection button 505 are displayed.

[0042] 509 is a setting item for the page range. When the user presses each button, the operation to specify the range of pages on which inspection will be performed by the selected inspection area is accepted. If nothing is selected, the selected inspection area will be placed only on the page currently displayed on the preview display screen. If "Same side as current page" is selected, the selected inspection area will also be placed on other pages on the same side (front or back) depending on whether the selected inspection area is placed on the front or back of the sheet. If "All pages" is selected, the selected inspection area will be placed on all pages, regardless of whether they are on the front or back.

[0043] Note that if you select "Same side as current page" or "All pages" to automatically place an inspection area on a page other than the currently displayed page, the automatically placed inspection area may not match the area you intended to inspect on that page. Figure 5D shows an example in which the automatically placed inspection area does not match the area you intended to inspect because the number of digits in the character string inspection area is different. For example, if the user places inspection area 503 around the character string "100" while displaying page 1, automatically placing the inspection area in the same position on page 2 results in part of the character string "1000" being excluded from inspection. The user can visually confirm the misalignment of the inspection area by displaying page 2 on the preview display screen 501.

[0044] Reference numeral 510 denotes setting items for each type of inspection area, and setting items corresponding to the type of inspection area selected using the inspection area selection button 505 are displayed. Reference numeral 510 in FIG. 5A denotes setting items for pattern inspection that are displayed when the pattern inspection area 502 is selected. The setting items for pattern inspection include the type of defects to be inspected when inspecting printed materials and the level at which minute defects are detected. Examples of inspection items include round defects (hereinafter referred to as "dots") and linear defects (hereinafter referred to as "streaks"). There are five inspection levels, for example, from level 1 to level 5, with level 5 being able to detect thinner and smaller defects than level 1. Furthermore, levels can be set for each inspection item, such as level 5 for dots and level 4 for streaks. Reference numeral 510 in FIG. 5B denotes setting items for string inspection that are displayed when the string inspection area 503 is selected. For each inspection area, settings are made for the angle of the inspection area, the font of the string, whether to perform a verification inspection, and, if so, which column in the reference CSV to verify against. An item for selecting the font for the character string is displayed, and the font selection is accepted from the user. Reference numeral 510 in FIG. 5C denotes barcode inspection setting items that are displayed when the barcode inspection area 504 is selected. For each inspection area, the angle of the inspection area, the type of code image (barcode or 2D code), whether to perform a comparison inspection, and, if a comparison inspection is performed, which column in the reference CSV to compare with are set. Note that in this embodiment, setting items according to the type of inspection area selected are displayed to prevent irrelevant items from being displayed, but a format may be used in which all items are displayed and irrelevant items are disabled, or a format may be used in which irrelevant items are collapsed and hidden.

[0045] Reference numeral 511 denotes an inspection area list display button, which, when pressed by the user, displays the inspection area list shown in FIG.

[0046] Reference numeral 512 denotes a test setting completion button. When the user presses the completion button, the test setting is completed, the settings are saved in the memory unit 0228, and the test setting process ends. If there is an inconsistency in the settings, the test setting completion button 512 may be disabled so that it cannot be pressed. An example of a setting inconsistency is when an inspection area exists for performing a verification test, but the setting item 507 for the verification test data has not been set. Reference numeral 513 denotes a test setting cancellation button. When the user presses the cancellation button, the settings are discarded and the test setting process ends.

[0047] FIG. 6 shows an example of an inspection area list screen displayed on the UI panel 0102. The list displays a list of currently set inspection areas and accepts user operations to change the inspection settings. Each row in the list corresponds to an arranged inspection area 502, with setting values ​​505 and 602, 509 and 603-605, and 510 and 606-612. While the user can select each inspection area individually on the inspection setting screen to check and change the setting values, checking the settings of multiple inspection areas requires a lot of work and is time-consuming. On the other hand, the inspection area list screen allows users to check and change the setting values ​​for multiple inspection areas all at once. The inspection area list screen is displayed on the UI panel 0102 when the user presses the inspection area list display button 511. In this embodiment, it is assumed that the screen is displayed in a floating window separate from the inspection setting screen, but it may also be displayed by transitioning from the inspection setting screen.

[0048] Each line below 601 indicates the setting value for each inspection area. Selection is accepted by the user clicking the mouse. Note that a context menu can be opened by right-clicking, and the selected inspection area can be copied or deleted.

[0049] Column 602 is a display field for the type of inspection area.

[0050] Column 603 is a display field for setting the page range of the inspection area. The inspection area list screen does not have a preview, and if the page range is changed, any misalignment of the inspection area cannot be visually confirmed, so the page range setting operation is not accepted from the inspection area list screen. Column 604 is a display field for the sheet on which the inspection area is arranged. Column 605 is a display field for the surface on which the inspection area is arranged.

[0051] Column 606 is a display field for setting the inspection level for spots. Column 607 is a display field for setting the inspection level for lines.

[0052] Column 608 is a display field for setting the angle of the inspection area. In this embodiment, as with the inspection area, if the angle is set on a screen that does not have a preview, it will be impossible to check if the setting is incorrect, so the angle setting operation is not accepted from the inspection area list screen.

[0053] Column 609 is a display field for setting the font for the inspection area, and accepts a user's operation to change the font. Column 610 is a display field for setting the type of code image (barcode / two-dimensional code) for the inspection area, and accepts a user's operation to change the type of code.

[0054] Column 611 is a display field for setting whether to perform a comparison inspection of the inspection area, and accepts a user change to the setting of whether to perform a comparison inspection. Column 612 is a display field for setting which column in the reference CSV the inspection area will be compared with, and accepts a user change to the column setting. 613 is a button for ending the display of the inspection area list, and when pressed, ends the display of the inspection area list.

[0055] 7 is a diagram showing the processing in the inspection device 0108 when an inspection setting start operation is performed on the inspection device 0108. In response to an operation from the inspection setting screen and inspection area list displayed on the UI panel 0203 of the inspection device 0108, the CPU 0226 of the inspection device 0108 executes various processes for setting up the inspection.

[0056] In S701, the inspection device 0108 accepts a setting operation for the data of the verification inspection from the inspection setting screen. In this embodiment, the setting operation for the data of the verification inspection is an operation of the setting item 507 for the data of the verification inspection by the user.

[0057] In S702, the inspection apparatus 0108 accepts an operation for arranging the inspection area from the inspection setting screen. In this embodiment, the operation for arranging the inspection area is an operation of the inspection area arrangement button 506 by the user.

[0058] In S703, the inspection device 0108 determines whether the user has set individual inspection areas from the inspection setting screen or from the inspection area list screen. If the setting has been made from the inspection setting screen, the process proceeds to S704, where steps S704 to S707 are performed. If the setting has been made from the inspection area list screen, the process proceeds to S708, where steps S708 to S710 are performed. First, the processes of S704 to S707 when the setting has been made from the inspection setting screen will be described.

[0059] In S704, the inspection device 0108 accepts an inspection area selection operation from the inspection setting screen. In this embodiment, the inspection area selection operation is an operation in which the user presses the inspection area selection button 505 displayed on the UI panel 0203 and selects one of the inspection areas arranged in the preview display area.

[0060] In step S705, the inspection device 0108 accepts a page range setting operation from the inspection setting screen. In this embodiment, the page range setting operation is an operation by the user on the page range setting item 509 displayed on the UI panel 0203.

[0061] In S706, the inspection device 0108 accepts a setting operation for each type of inspection area from the inspection setting screen. In this embodiment, the setting operation for each inspection area is an operation by the user of the setting item 510 for each type of inspection area displayed on the UI panel 0203.

[0062] In S707, the inspection apparatus 0108 reflects the results of the setting operation performed by the user on the inspection setting screen on the inspection area list screen, and synchronizes the display contents.

[0063] Next, we will describe the processing of S708 to S710 when settings are made from the inspection area list screen. Note that the inspection area list screen shown in Fig. 6 does not include a preview display area, and if the page range is changed, any deviation in the inspection area cannot be visually confirmed, so the inspection area list screen does not accept setting operations for the page range.

[0064] In S708, the inspection device 0108 accepts an inspection area selection operation from the inspection area list screen. In this embodiment, the inspection area selection operation is an operation by the user to select a row 601 of the setting value for each inspection area displayed on the UI panel 0203.

[0065] In S709, the inspection device 0108 accepts a setting operation for each type of inspection area from the inspection area list screen. In this embodiment, the setting operation for each inspection area is an operation by the user in the display fields 608 to 612 of each setting value displayed on the UI panel 0203.

[0066] In S710, the inspection apparatus 0108 reflects the results of the setting operation performed by the user on the inspection area list screen on the inspection setting screen, and synchronizes the display contents.

[0067] In S711, the inspection device 0108 determines whether the user has completed the inspection settings. If the inspection settings have been completed, the user presses the inspection settings completion button 511 and proceeds to S712. If the inspection settings have not been completed, the user performs the inspection area selection operation in S703 and continues the inspection setting process.

[0068] In S712, the inspection device 0108 stores the settings in the storage unit 0228, and ends the inspection setting process.

[0069] Next, the operation of the inspection device 0108 in relation to the inspection settings will be described. When the user presses an inspection start button (not shown) displayed on the UI panel 0203, the inspection device 0108 performs an inspection using the inspection device 0108. The operation of the inspection device 0108 will be described using the flowchart in FIG. 8.

[0070] First, in step S801, the inspection device 0108 detects circular defects (dots) and linear defects (streaks) contained in the paper as defects during printing according to the inspection settings made by the user. A publicly known method may be used for the detection method, and therefore a description thereof will be omitted.

[0071] Next, in step S802, the inspection device 0108 rotates the inspection area set as shown in 510 during inspection setting.

[0072] Next, in step S803, the inspection device 0108 performs character recognition processing and barcode recognition on the inspection area rotated in step S802. As will be described later, for the barcode inspection area, not only is barcode recognition processing (decoding processing) performed, but also an inspection is performed to determine whether a sufficient quiet zone is secured.

[0073] Next, in step S804, the inspection device 0108 compares the character recognition result and barcode recognition result (decoded code image result) obtained in step S803 with the correct character strings listed in the reference CSV file, and outputs the result of the comparison as the inspection result.

[0074] Next, in step S805, the inspection device 0108 transmits to the inspection unit the results of the printing defect inspection performed in step S801, the inspection results obtained in step S804, and the quiet zone inspection results obtained in S905 (described later). The inspection unit controls the large-capacity stacker so that sheets with detected defects and properly printed sheets are discharged to separate trays. The inspection results may also be transmitted to the UI panel 0203. Upon receiving the inspection results, the UI panel 0203 displays the scanned image of the inspection target and the inspection results to the user. If a defect is found in the printed matter, the UI panel 0203 highlights the detected defect with a dotted frame or a colored frame on the scanned image, and also displays the type of defect (such as a dent or streak) and its location. On the other hand, if no defect is found in the printed matter, a message stating "No defect" is displayed. Note that the method of displaying the inspection results on the UI panel 0203 is not limited to the above, and any method may be used as long as it can display the detection results in an easy-to-understand manner for the user.

[0075] Next, the detailed processing procedure by the inspection device 0108 in the character recognition and barcode recognition processing explained using step S803 will be explained using FIG.

[0076] In step S901, the inspection device 0108 determines whether the inspection area rotated in accordance with the settings in step S802 is a character string area or a barcode area. In this embodiment, this determination is made by reading the inspection settings saved in the memory unit 0228 in S712 and determining whether the inspection area to be determined is a character string inspection area or a barcode inspection area, but other methods may also be used. If the result of the determination in step S901 is that the inspection area is a character string area (if step S901 is "character string"), the process proceeds to step S902, and if the inspection area is a barcode area (if step S901 is "barcode"), the process proceeds to step S904.

[0077] In step S902, the inspection device 0108 performs dropout color processing on the inspection area to generate an image in which pixels of a predetermined chromatic color contained in the inspection area have been removed, and then proceeds to step S903. Note that a known method may be used for the dropout color processing, and therefore a detailed description thereof will be omitted. The dropout color processing can remove only a predetermined color (e.g., red), or can remove all chromatic colors and leave only achromatic colors. The colors to be removed can be determined in advance depending on the content of the document.

[0078] In step S903, the inspection device 0108 performs character recognition processing on the image generated in step S902. Note that a known method may be used for the character recognition processing, and therefore detailed description thereof will be omitted.

[0079] In step S904, the inspection device 0108 performs recognition processing (decoding processing) of a code image such as a barcode on the image of the inspection area rotated in step S802. Note that a known method may be used for the barcode recognition processing (decoding processing), and therefore detailed description thereof will be omitted.

[0080] In step S905, the inspection device 0108 identifies the position of a code image, such as a barcode, in the image of the inspection area rotated in step S802, and inspects whether a sufficient blank space (quiet zone) is secured around the code image. If a sufficient blank space is not secured, an inspection result indicating that the blank space is insufficient (i.e., an inspection result indicating that the blank space is NG) is output. If a sufficient blank space is secured, an inspection result indicating that the blank space is sufficient (i.e., an inspection result indicating that the blank space is OK) is output. Note that the order of the barcode recognition process (decoding process) in step S904 and the blank space (quiet zone) inspection process in step S905 may be reversed.

[0081] In this way, the color dropout process is performed on the inspection area for character strings, but not on the inspection area for code images (barcodes and two-dimensional codes).

[0082] The improvement in inspection accuracy for character string regions and code regions by implementing the present invention according to the processing procedure described above will be described using drawings showing specific examples.

[0083] 10(A) and 10(B) are diagrams showing an example of the inspection setting screen described with reference to FIG. 5, in which an inspection area includes a chromatic border. The character string inspection area 1001 includes a chromatic ruled line 1003, and the barcode inspection area 1002 includes a chromatic ruled line 1004. The character string inspection area 1001 has the inspection setting indicated by 1005, and the barcode inspection area 1002 has the inspection setting indicated by 1006. Furthermore, the ruled line 1004 is located close to the barcode to be inspected, and therefore does not provide a predetermined blank area, commonly known as a quiet zone, necessary for accurate barcode recognition. Therefore, from the perspective of inspecting print quality, the barcode inspection area 1002 is an area that should be determined as unsuccessful, i.e., not passable.

[0084] An example of the operation of the inspection device 0108 when the inspection execution process described with reference to FIGS. 8 and 9 is performed on the character string inspection area 1001 and barcode inspection area 1002 described with reference to FIG. 10 will be described below.

[0085] The information processing device 0109 performs the recognition processing described with reference to FIG. 9 on the character string inspection area 1002 and the barcode inspection area 1003 in step S803 after passing through steps S801 and S802.

[0086] That is, for the character string inspection area 1001, the information processing apparatus 0109 determines it to be a "character string" in step S901, performs color dropout processing in S902, and then performs character recognition processing in S903.

[0087] On the other hand, for the barcode inspection area 1002, the information processing device 0109 determines it to be a "barcode (two-dimensional code)" in step S901, and performs barcode recognition processing in S904.

[0088] 11(A) and 11(B) respectively show a character string image 1101 on which the character recognition process of step S903 is performed and a barcode image 1102 on which the barcode recognition process of step S904 is performed in the specific example described above. The ruled lines 1003 have been removed from the character string region 1101, while the ruled lines 1004 have not been removed from the barcode region 1102. As a result, the character recognition process of S903 for the character string region 1101 is able to recognize the correct character string recorded in advance in the reference CSV, and therefore passes the verification test of the following step S804. On the other hand, the barcode recognition process of S904 for the barcode inspection region 1102 fails to pass the verification test of step S804 because the barcode cannot be detected or cannot be recognized exactly as the correct character string due to an insufficient quiet zone.

[0089] As shown in the above specific example, by inspecting printed matter using the procedure of this embodiment, it is possible to improve the accuracy of character recognition in character string inspection areas, which are important for inspection from the perspective of whether the character string is printed correctly. Furthermore, in barcode inspection areas, which are important for inspection from the perspective of whether the printed barcode is positioned so that it can be correctly recognized later, in addition to the perspective of whether the character string is printed correctly, it is also important for inspection. It is possible to perform inspections that take these perspectives into account. As a result, it is possible to improve the inspection accuracy for character string areas and barcode areas.

[0090] Second Embodiment In this example, it will be explained with reference to the drawings that by appropriately using the present invention, it becomes possible to specify whether or not to perform the dropout color processing described in Example 1 for each inspection area, thereby enabling more flexible inspection to be performed. In explaining this example, explanations of parts that have the same configuration and processing procedures as the first embodiment will be omitted, and only parts that are different will be explained.

[0091] 12 shows an example of an inspection setting screen in this embodiment that is displayed on the UI panel 0102 and that accepts an operation to execute inspection settings from the user. Checkboxes 1201 and 1202 are checkboxes for setting whether or not to perform color dropout processing when inspecting the character string inspection area 503 and the barcode inspection area 504, respectively. The settings made using these checkboxes are reflected by the inspection device 0108 in steps S706 and S709, and are saved as inspection settings in S712.

[0092] FIG. 13 is a flowchart illustrating the detailed processing procedure of the character string / barcode recognition processing in step S803 in this embodiment.

[0093] First, in step S1301, the inspection device 0108 reads the inspection settings saved in step S712 and determines whether or not to perform color dropout processing on the inspection area. The determination in step S712 is made based on whether or not the checkbox 1201 or 1202 in the inspection settings corresponding to the inspection area is checked. If it is checked, it is determined that color dropout processing will be performed (YES in step S1301), and after performing color dropout processing in step S902, the process proceeds to step S901. On the other hand, if it is not checked, it is determined that it will not be performed (NO in step S1301), and the process proceeds to step S901.

[0094] In step S901, the inspection device 0108 determines whether the inspection area is a character string area or a barcode area using the same procedure as described in Example 1. If the result of the determination is that it is a character string area (if step S901 is "character string"), the process proceeds to S903, and if it is a barcode area (if step S901 is "barcode"), the process proceeds to S904.

[0095] As described above, by implementing the present invention, the user can specify whether or not to perform color dropout processing for each inspection area, thereby improving the flexibility of inspection.

[0096] Third Embodiment This example demonstrates that by properly implementing the present invention, it is possible to more directly determine whether or not a sufficient quiet zone exists in the barcode inspection area. Note that in describing this example, explanations of the same configurations and processing procedures as the first and second embodiments will be omitted, and only differences will be explained.

[0097] FIG. 14 is a flowchart illustrating the detailed processing procedure of the character string / barcode recognition processing in step S803 in this embodiment.

[0098] First, in step S1401, the inspection device 0108 stores the input image of the inspection area in the storage unit 0228.

[0099] Next, in step S902, the inspection device 0108 performs dropout color processing on the input inspection area image, and proceeds to step S901. If the inspection area is determined to be a barcode in S901, in this embodiment, the process proceeds to step S1402.

[0100] In step S1402, the inspection device 0108 detects the position of a code image (barcode or two-dimensional code) in the image after the dropout color processing generated in S902. A known technique may be used to detect the position of the barcode. For example, a method may be used in which a binarized image of the image after the dropout color processing is generated and the coordinates of the bounding rectangle of the black pixel group contained in the binarized image are obtained.

[0101] In step S1403, the inspection device 0108 first reads out the input image saved in S1401 from the storage unit 0228, and compares the read image before color dropout processing with the position of the barcode detected in S1402. That is, it determines whether there is a sufficient blank area (quiet zone) around the position of the barcode in the input image that has not undergone color dropout processing.

[0102] In step S1404, the inspection device 0108 determines whether a sufficient quiet zone exists in the input image based on the comparison result of S1403. Any method for determining the quiet zone may be used, and is not limited to one. For example, a method may be used in which the input image is searched for a neighborhood of the minimum required quiet zone from the rectangle indicating the barcode position acquired in S1402, and the determination is made based on whether pixel clusters or ruled lines different from the constituent pixels of the barcode exist. Alternatively, a barcode recognition engine with a barcode grade determination function (a function for determining the print quality of the barcode) may be used to perform a barcode grade inspection on the input image, and the quiet zone evaluation result obtained from the grade inspection may be used. Note that the size of a barcode quiet zone generally depends on the type and size of the target barcode, and therefore the minimum required size of the quiet zone described above varies depending on the barcode inspection area. As a result of step S1404, if it is determined that there is a sufficient quiet zone (if step S1404 is "YES"), proceed to step S1404, and if it is determined that there is not a sufficient quiet zone (if step S1404 is "NO"), proceed to step S1405.

[0103] In step S1405, the inspection device 0108 records in the storage unit 0228 as an inspection result that the target barcode inspection area cannot pass inspection because of an insufficient quiet zone.

[0104] FIG. 15 is a diagram showing an example of a screen displaying the results of the inspection performed in step S803.

[0105] Reference numeral 1501 denotes a test start / stop button that changes the state of the CPU 0226. When the CPU 0226 is in a non-test state, pressing this button by the user causes the state of the CPU 0226 to transition to a test standby state and the test starts. When the CPU 0226 is in a test standby state, pressing this button by the user causes the state of the CPU 0226 to transition to a non-test state and the test stops.

[0106] Reference numeral 1502 denotes an inspection area display that allows a preview of the inspection area of ​​the currently selected inspection setting.

[0107] Reference numeral 1503 denotes an inspection result table showing a list of inspection results for the inspections that have been performed. Information for uniquely identifying the inspection area, such as an "inspection number" indicating which inspection area on the page, a "page number" indicating which page, a "set number" indicating which set, and a "side number" indicating whether it is the front or back, is displayed. Furthermore, the inspection results for the inspection area, and if the inspection result is NG, i.e., if the inspection failed, detailed reasons for this are displayed. Here, the inspection results for inspection areas 1001 and 1002 described in Example 1 using FIG. 10 are displayed as inspection numbers 1 and 2, respectively. According to the processing procedure described using FIG. 14, it was determined in step S1404 that the quiet zone for barcode inspection area 1002 was insufficient, and this fact is clearly indicated in the NG details for inspection number 2 as "insufficient quiet zone."

[0108] Reference numeral 0604 denotes an inspection process completion button. When the user presses this button, the inspection process is completed, the inspection results are stored in the storage unit 0228, and the inspection process ends. When the CPU 0226 is performing an inspection, the inspection process completion button 0604 may be disabled so that it cannot be pressed.

[0109] By implementing the present invention using the above procedure, if the test results for a certain area are due to a lack of a quiet zone, this can be clearly indicated to the user as the test result, thereby improving the convenience for the user when conducting the test.

[0110] Other Examples The present invention can also be realized by executing the following process: software (program) that realizes the functions of the above-described embodiments is supplied to a system or device via a network or a computer-readable storage medium, and the computer (or CPU, MPU, etc.) of the system or device executes the program. [Explanation of symbols]

[0111] 0101 Image forming apparatus 0108 Inspection equipment 0109 Information processing device 0110 Client Computer

Claims

1. an image forming means for forming an image on paper; a reading means for reading the image formed by the image forming means; a first inspection means for performing an inspection based on the image read by the reading means and pre-registered reference data; and a second inspection means for inspecting whether or not a predetermined blank area or more is included between the barcode and the ruled line when the barcode and the ruled line are included in an inspection area set as an area to be inspected by the first inspection means, before the inspection by the first inspection means. The second inspection means outputs as an inspection result a fact that there is a blank area between the barcode and the ruled line when the blank area is equal to or greater than the specified value, and outputs as an inspection result a fact that there is insufficient blank area when the blank area is not equal to or greater than the specified value.

2. a display means for displaying information; The inspection device according to claim 1, characterized in that the display means displays an inspection result indicating that the margin area is insufficient based on the second inspection means outputting an inspection result indicating that the margin area is insufficient.

3. generating means for performing dropout color processing on the read image and generating an image after the dropout color processing; 2. The inspection device according to claim 1, wherein the second inspection means inspects whether the inspection area, to which the dropout color processing has not been performed, includes a blank area of ​​at least the predetermined size.

4. a determination means for determining whether the barcode is included in the inspection area; 2. The inspection device according to claim 1, further comprising: recognition means for executing a recognition process for a code image of the barcode when the determination means determines that the barcode is included in the inspection area.

5. A third inspection means for inspecting the read image read by the reading means based on a reference image registered in advance, 2. The inspection apparatus according to claim 1, wherein the inspection by the third inspection means is carried out before the inspection by the second inspection means and the inspection by the first inspection means are carried out.

6. The inspection device described in Claim 2, characterized in that the display means displays both inspection results on one screen when the first inspection means produces an NG inspection result and the second inspection means produces an inspection result indicating that the margin area is insufficient.

7. An inspection device as described in Claim 1, characterized in that the inspection area is an area set relative to a pre-registered reference image.

8. an image forming step of forming an image on paper; a reading step of reading the image formed by the image forming step; a first inspection step of inspecting the image read by the reading step and pre-registered reference data; a second inspection step of inspecting whether or not a predetermined blank area or more is included between the barcode and a ruled line surrounding the barcode when the inspection area set as the area to be inspected by the first inspection step includes the barcode and the ruled line before the inspection by the first inspection step is performed; The second inspection step outputs as an inspection result a fact that there is a margin area between the barcode and the ruled line that is equal to or greater than the specified value, and outputs as an inspection result a fact that there is an insufficient margin area between the barcode and the ruled line that is not equal to or greater than the specified value.

9. A program for causing a computer to function as each of the means of the inspection apparatus according to any one of claims 1 to 7.

Images