Method and apparatus for inspecting printed materials

Abstract

To provide a printing system capable of notifying a user with high accuracy prior to inspection whether reading inspection to an inspection area of a character string and a barcode preset by a user can be executed within a time limit.SOLUTION: An information processing device for inspecting printed content of a printed sheet includes recognition means for recognizing printed content printed on the sheet, acquisition means for acquiring an attribute value from information recognized by the recognition means, specification means for specifying a time required to inspect the printed content of the sheet by using the attribute value acquired by the acquisition means, and notification means for performing notification to a user according to a result obtained by comparing the time required specified by the specification means with a time limit for inspecting the printed content.SELECTED DRAWING: Figure 8

Description

Technical Field

[0001] The present invention relates to a method and an apparatus for inspecting the print quality of printed matter.

Background Art

[0002] In recent years, a printing system has been known in which a printed sheet printed by a printing device can be inspected by an inspection device during conveyance. In the inspection, the inspection device reads an image of the conveyed printed sheet, and determines whether the printed content of the printed sheet is normal by image analysis of the read image. Specifically, the inspection device can detect missing characters or barcodes printed on the printed matter, missing images, printing defects, missing pages, color misregistration, and printing of incorrect characters or barcodes. When it is determined that the printed sheet is a defective sheet, the defective sheet is discharged to a discharge destination different from that of the normal sheet. This prevents defective sheets from being mixed into normal sheets, and enables an operator to discard defective sheets. Also, in a system as described above, in order to improve the detection accuracy of defective sheets of printed matter, a method of performing optical character recognition processing (OCR) or barcode recognition processing to read the character strings or barcodes to be inspected and performing the inspection by comparison with a previously prepared correct value is also known.

[0003] In a printing system that requires inspection, it is necessary to complete the inspection of the printed sheet while the printed sheet is being conveyed and passing through the inspection device. If it is not completed within the time limit, the inspection of the subsequent printed sheets will not be in time, and inconsistencies in the inspection results will occur, resulting in incorrect inspection results. Therefore, an operator of such a printing system needs to perform inspection settings so that the inspection does not take a long time, which is troublesome.

[0004] Patent Document 1 describes a technique for calculating the priority of an object to be inspected based on its printed object information (object type, color, size) prior to the inspection, and controlling the inspection process to perform only as much inspection as possible within a predetermined time limit according to the priority. By controlling the inspection process in this way, the difficulty of setting up the inspection can be reduced while efficiently inspecting only high-priority objects. [Prior art documents] [Patent Documents]

[0005] [Patent Document 1] Japanese Patent Publication No. 2012-003335 [Overview of the project] [Problems that the invention aims to solve]

[0006] Generally, the time required to complete the inspection of each printed sheet varies depending on various conditions such as the number of strings or barcodes to be inspected, the amount of data, and the size. Therefore, when performing inspections based on the reading results of strings or barcodes, it is normal for the inspection time to differ even among inspection targets with the same object information due to differences in various conditions. Consequently, the technology in Patent Document 1 has problems with the accuracy of calculating the inspection time when performing inspections based on the reading results of strings or barcodes. Furthermore, since the technology in Patent Document 1 controls the inspection to only high-priority inspection targets within the time limit, inspection of all areas is not guaranteed, and there is a problem that it is difficult for the inspection operator to know which inspection areas have actually been inspected.

[0007] This invention has been made in view of these problems, and aims to provide a printing system that can accurately notify the user in advance of the inspection whether or not a read inspection of a pre-set string or barcode inspection area can be performed within a time limit. [Means for solving the problem]

[0008] The present invention Printed paper image An information processing device for inspecting, Registration means for registering a reference image used for inspecting the image on the aforementioned paper; area setting means for setting a data inspection area on the reference image; and an image included in the area where the data inspection area is set. A recognition means for recognizing the printed content, and from the information recognized by the recognition means This affects the inspection time for printed content. An acquisition means for acquiring attribute values, and a means for using the attribute values ​​acquired by the acquisition means to determine the print content of the paper. of inspection Regarding A means for determining the required time, and the required time determined by the means for determining the required time but Time limit for inspecting the aforementioned printed content If it is longer than , Before performing the inspection of the image on the aforementioned paper To the user Warning Having a means of notification It is characterized by the following: [Effects of the Invention]

[0009] This enables the provision of a printing system that can accurately notify the user in advance whether or not a read inspection of a pre-set string or barcode inspection area can be performed within the time limit. [Brief explanation of the drawing]

[0010] [Figure 1] A schematic diagram showing the configuration of an information processing device, an inspection device, and a printing device. [Figure 2] Block diagram showing the configuration of the information processing device, inspection device, and printing device. [Figure 3] Diagram showing the internal configuration of the information processing unit, inspection unit, printing device, and high-capacity stacker. [Figure 4] Flowchart of the entire inspection process [Figure 5A] Diagram showing the inspection settings screen. [Figure 5B] Diagram showing the inspection settings screen. [Figure 5C] Diagram showing the inspection settings screen. [Figure 5D] Diagram showing the inspection settings screen. [Figure 6] Diagram showing the list of inspection areas. [Figure 7] Flowchart for test settings [Figure 8] Flowchart of inspection time test [Figure 9] Figure showing an example of a warning screen when the inspection time exceeds the inspection limit time [Figure 10] Flowchart of inspection time test

Mode for Carrying Out the Invention

[0011] Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings.

[0012] Note that the following embodiments do not limit the invention according to the claims, and not all combinations of features described in the embodiments are essential for the solution means of the invention.

[0013] (First Embodiment) FIG. 1 is a schematic diagram showing the configurations of the information processing apparatus 0109, the inspection apparatus 0108, and the image forming apparatus 0101 in this embodiment. Note that the image forming apparatus 0101 in this embodiment will be described using an electrophotographic image forming apparatus 0101, but the image forming apparatus 0101 in this embodiment may be an image forming apparatus using a different image forming method such as an inkjet method or an offset method.

[0014] The image forming apparatus 0101 is connected to the information processing apparatus 0109 via a cable 0112. The information processing apparatus 0109 is connected to the client computer 0110 and the inspection apparatus 0108 via a network 0113.

[0015] The image forming apparatus 0101 includes a UI panel 0102, a paper feed deck 0103, and a paper feed deck 0104. Further, an optional deck 0105 consisting of a three-stage paper feed deck is connected. The image forming apparatus 0101 is, for example, an electrophotographic image forming apparatus. The UI panel 0102 is, for example, a user interface provided with a capacitive touch panel.

[0016] Furthermore, the image forming apparatus 0101 includes an inspection unit 0106 and a high-capacity stacker 0107. The inspection unit is connected to the inspection apparatus 0108 via a cable 0114. The high-capacity stacker 0107 has a main tray and a top tray, and the main tray can hold several thousand sheets of paper at once.

[0017] A print job is generated on the client computer 0110, transmitted to the information processing device 0109 via the network 0113, and managed by the information processing device 0109. The print job is then transmitted from the information processing device 0109 to the image forming apparatus 0101 via the cable 0112, where the image forming apparatus 0101 performs the printing process on the paper. Alternatively, the print job may be generated and managed in the information processing device 0109, transmitted to the image forming apparatus 0101 via the network 0112, and managed by the image forming apparatus 0101.

[0018] Furthermore, the client computer 0110, the information processing device 0109, and the inspection device 0108 may be connected to cable 0112 and be able to communicate with the image forming apparatus 0101. In other words, the connection configuration of the image forming apparatus 0101, the information processing device 0109, and the client computer 0110 shown in this embodiment is just one example, and it goes without saying that there are various other connection configurations besides those shown in this embodiment.

[0019] Figure 2 is a block diagram showing the control configuration of the image forming apparatus 0101, inspection apparatus 0108, large-capacity stacker 0107, information processing apparatus 0109, and client computer 0110 in this embodiment.

[0020] The CPU (Central Processing Unit) 0201 controls and performs calculations in various parts of the image forming apparatus 0101 via the system bus 0212. The CPU 0201 is responsible for executing programs stored in the memory unit 0205 and loaded into the RAM (Ramdom Access Memory) 0202. RAM 0202 is a type of general volatile memory that can be directly accessed by the CPU 0201 and is used as the CPU 0201's work area or other temporary data storage area. The memory unit 0205 functions as a temporary storage area and work memory during the operation of the image forming apparatus.

[0021] The engine interface 0209 is responsible for communication and control with the printer engine 02010. The paper feed deck interface 0204 is responsible for communication and control with the paper feed deck 0211. The paper feed deck 0211 is a collective term for the hardware configuration of paper feed decks 0103, 0104, and the optional deck 0105. The UI panel 0203 is the hardware configuration of the UI panel 0102 and is a user interface for performing all operations of the image forming apparatus 0101. In this embodiment, the UI panel 0203 is equipped with a capacitive touch panel.

[0022] Network interface (hereinafter referred to as NW I / F) 0207 is connected to NW I / F 0238 of the information processing device 0109 via cable 0213 and is responsible for communication between the information processing device 0109 and the image forming apparatus 0101. In this example, the interfaces connected to system buses 0212 and 0239 are directly connected to each other, but the information processing device 0109 and the image forming apparatus 0101 may be connected by a network, for example, and the connection method is not limited. Video I / F 0206 is connected to video I / F 0233 via video cable 0241 and is responsible for the communication of image data between the information processing device 0109 and the image forming apparatus 0101.

[0023] Furthermore, the connection interface between the information processing device 0109 and the image forming apparatus 0101 may be a form that integrates the functions of NW I / F 0238 and video I / F 0233. Also, the connection interface between the image forming apparatus 0101 and the information processing device 0109 may be a form that integrates the functions of NW I / F 0207 and video I / F 0206.

[0024] Accessory I / F 0208 connects to accessory I / F 0214 and accessory I / F 0220 via cable 0225. That is, the image forming apparatus 0101 communicates with the inspection unit 0106 and the large capacity stacker 0107 via accessory I / F 0208, 0214, and 0220.

[0025] CPU0216 controls and performs calculations in various parts of the inspection unit 0106 via the system bus 0219, and executes programs stored in memory unit 0247 and loaded into RAM0217. RAM0217 is a type of general volatile memory that can be directly accessed from CPU0216 and is used as the CPU0216's work area or other temporary data storage area. Memory unit 0247 functions as a temporary storage area and work memory when the inspection device is operating. Inspection device I / F0215 is connected to inspection device unit I / F0231 via cable 0248. That is, inspection unit 0106 communicates with inspection device 0108 via inspection device I / F0215 and inspection device unit I / F0231.

[0026] The imaging unit 0218 is equipped with an imaging function, for example, a conduct image sensor (hereinafter referred to as CIS), which photographs the paper passing through the inspection unit and transmits the captured image to the inspection device 0108 via the inspection device I / F 0215. Note that the CIS for the imaging unit 0218 is just one example of a sensor, and other types of sensors such as a CCD image sensor may also be used, and the imaging method is not limited.

[0027] CPU02220 controls and performs calculations in various parts of the large-capacity stacker 0107 via the system bus 0224, and executes programs stored in memory unit 0248 and loaded into RAM0222. RAM0222 is a type of general volatile memory that can be directly accessed from CPU0221 and is used as the work area or other temporary data storage area for CPU0221. Memory unit 0248 functions as a temporary storage area and work memory when the inspection device is operating. Paper output unit 0223 controls paper output to the main tray and top tray, and monitors and controls the loading status of the main tray and top tray, respectively.

[0028] The CPU 0226 controls and performs calculations in various parts of the inspection device 0108 via the system bus 0230, and executes programs stored in the memory unit 0228 and loaded into the RAM 0227. RAM 0227 is a type of general volatile memory that can be directly accessed from the CPU 0226 and is used as the CPU 0226's work area or other temporary data storage area. The memory unit 0228 functions as a temporary storage area and work memory during the operation of the inspection device. The PDL analysis unit 0229 reads PDL data such as PDF, PostScript, and PCL received from the client computer 0110 or the information processing device 0109 and performs interpretation processing. The display unit 0245 is, for example, a liquid crystal display connected to the inspection device, and accepts user input to the inspection device and displays the status of the inspection device.

[0029] CPU0234 controls and performs calculations in various parts of the information processing device 0109 via the system bus 0239, and is responsible for executing programs stored in memory unit 0236 and loaded into RAM 0235. RAM0235 is a type of general volatile memory that can be directly accessed by CPU0234 and is used as the CPU0234's work area or other temporary data storage area. Memory unit 0236 functions as a temporary storage area and work memory during the operation of the information processing device. Network interface (hereinafter, NW I / F) 0237 is connected to NW I / F 0232 and 0240 via the network. Information processing device 0109 communicates with inspection device 0108 via NW I / F 0237 and NW I / F 0232. Information processing device 0109 also communicates with client computer 0110 via NW I / F 0237 and NW I / F 0240.

[0030] CPU0243 controls and performs calculations in various parts of the client computer 0110 via the system bus 0246, and executes programs stored in memory unit 0245 and loaded into RAM0242. RAM0242 is a type of general volatile memory that can be directly accessed by CPU0243 and is used as the CPU0243's work area or other temporary data storage area. Memory unit 0244 functions as a temporary storage area and work memory when the client computer is operating.

[0031] Figure 3 shows the internal configuration of the printing device 0101, the inspection unit 0106, and the large-capacity stacker 0107. The printing device 0101 accepts user input via the UI panel 0102 and displays the printing and device status. Various types of paper can be stored in the paper feed decks 0103 and 0104. Each paper feed deck can separate only the top sheet of paper stored and transport it to the paper transport path 0305.

[0032] 0301-0304 are developing stations, where colored toners Y, M, C, and K are used to form toner images to create color images. The toner images formed here are first transferred to the intermediate transfer belt 0306. The intermediate transfer belt 0306 rotates clockwise, and at the secondary transfer position 0307, ​​the toner images are transferred to the paper transported from the paper transport path 0305. The fixing unit 0308 is equipped with pressure rollers and heating rollers, and as the paper passes between each roller, the toner is melted and pressed, fixing the toner image to the paper. After passing through the fixing unit 0308, the paper is transported to 0312 via the paper transport path 0309. Depending on the type of paper, if further melting and pressing are required for fixing, after passing through the fixing unit 0308, the paper is transported to the second fixing unit 0310 using the paper transport path above, where additional melting and pressing are performed, and then the paper is transported to 0312 via the paper transport path 0311. If the image formation mode is double-sided, the paper is transported to the paper inversion path 0313, inverted at 0313, and then transported to the double-sided transport path 0314, where the second image is transferred at the secondary transfer position 0307.

[0033] Inside the inspection unit 0106, CIS0315 and 0316 are arranged facing each other. CIS0315 is a sensor for reading the top surface of the paper, and CIS0316 is a sensor for reading the bottom surface of the paper. When the paper transported on the paper transport path 0317 reaches a predetermined position, the inspection unit 0106 scans the paper using CIS0315 and 0316. The scanned image is transmitted to the inspection device 0108 via the inspection device I / F 0215 and inspection unit I / F 0231. The CPU 0226 determines whether the received image has defects and notifies the inspection unit 0106 of the result of the determination again via the inspection unit I / F 0231 and inspection device I / F 0215. The CPU 0216 notifies the high-capacity stacker 0107 of the received determination result via the accessory I / F 0214 and 0220.

[0034] 0107 is a high-capacity stacker capable of loading large amounts of paper. The high-capacity stacker 0107 has a main tray 0324 as a tray for loading paper. Paper that has passed through the inspection unit 0106 enters the high-capacity stacker 0107 via the paper transport path 0319. The paper is loaded onto the main tray 0324 via the paper transport path 0322 from the paper transport path 0319. Furthermore, the high-capacity stacker 0107 has a top tray 0320 as an output tray. The CPU 0221 discharges paper that has been detected as defective by the inspection device 0108 to the top tray 0320. When outputting to the top tray 0320, the paper is transported from the paper transport path 0319 to the top tray 0321. 0323 is a reversing unit for reversing paper. This reversing unit 0323 is used when loading paper onto the main tray 0324. To ensure that the orientation of the incoming paper matches the orientation of the paper when it is loaded, the paper is flipped once in the flipping unit 0323 when loading it into the main tray 0324. When transporting to the top tray 0320, the paper is ejected without being flipped during loading, so the flipping operation in the flipping unit 0323 is not performed.

[0035] The following flowchart and screen examples illustrate the processing in the system according to the present invention. The program for the image forming apparatus 0101 related to this flow is stored in the memory unit 0205 of the image forming apparatus 0101, read into RAM 0202, and executed by CPU 0201. The program for the inspection apparatus 0108 related to this flow is stored in the memory unit 0228 of the inspection apparatus 0108, read into RAM 0227, and executed by CPU 0226. The program for the information processing device 0109 related to this flow is stored in the memory unit 0236 of the information processing device 0109, read into RAM 0235, and executed by CPU 0234. The program for the client computer related to this flow is stored in the memory unit 0245 of the client computer 0110, read into RAM 0242, and executed by CPU 0243.

[0036] Figure 4 is a flowchart showing the overall processing procedure in the inspection device 0108, from the reference registration process before the start of the inspection to the execution of the inspection. The CPU 0226 of the inspection device 0108 executes each process.

[0037] First, in step S401, the user registers a reference image to be used as the basis for inspection. The inspection device 0108 starts reading the reference image, and the client computer 0110 executes a print job for registering the reference image.

[0038] Next, in step S402, the user configures the inspection settings, including various inspection parameters, inspection areas, and inspection levels. Details will be described later.

[0039] Next, in step S403, the user starts the inspection on the inspection device 0108 and executes a print job for inspection on the client computer 0110. When printing is executed, the inspection unit 0106 detects the paper transport and scans the paper with CIS 0315 and 0316, and the scanned image is saved to the RAM 303 of the inspection device 0108. The saved image is compared with a reference image to produce the inspection result. The inspection is performed based on the settings specified by the user in the inspection settings.

[0040] Next, the details of the inspection settings (S402) will be explained using the flowcharts in Figures 5A-C, 6, and 7. The inspection settings are started by selecting the reference image registered in the reference registration.

[0041] Figures 5A-5C show examples of inspection settings screens displayed on UI panel 0102, which accept user input for executing inspection settings. On the inspection settings screen, the user places inspection areas on a preview of the reference image and sets individual settings for each inspection area.

[0042] Area 501 is a preview display area where reference images are displayed. For reference images in a multi-page print job, it accepts an operation to switch the reference images displayed in the preview, allowing the reference images for each page to be displayed.

[0043] 502-504 are frames that indicate the inspection area placed on the preview. The inspection area is placed using the inspection area placement button 505, and its size and position can be changed by the user dragging with the mouse. 502 shows an example of placing a picture inspection area. 503 shows an example of placing a text inspection area. 504 shows an example of placing a barcode inspection area.

[0044] Button 505 is the inspection area selection button. After the user presses the inspection area selection button 505, the system accepts the selection of the inspection area by clicking on the frames 502-504 that indicate the inspection area with the mouse.

[0045] Button 506 is the inspection area placement button. After the user presses the inspection area placement button 506, they select the type of inspection area from the displayed pull-down menu, and then select the area they want to designate as the inspection area on the preview display by dragging with the mouse, thereby accepting the operation to place the inspection area.

[0046] 507 is a setting item for selecting the data for verification using a file selection method. The data for verification refers to the reference CSV file used for verification during data verification. The reference CSV file is a file that the user must prepare in advance and lists the correct strings for string verification and barcode verification. When data verification is executed, the string verification area and the barcode reading results are compared with the correct strings listed in the reference CSV file.

[0047] 508 is a setting item for the selected area, and the individual setting values ​​for the inspection area selected by the inspection area selection button 505 are displayed.

[0048] 509 is the setting item for the page range. By pressing each button, the user can specify the range of pages on which the inspection will be performed by the selected inspection area. If nothing is selected, the selected inspection area will be placed only on the page currently displayed in the preview display area 501. If "Same side as current page" is selected, the selected inspection area will be placed on the same side of the sheet, depending on whether the selected inspection area is located on the front or back side of the sheet. If "All pages" is selected, the selected inspection area will be placed on all pages.

[0049] 510 is a setting item for each type of inspection area, and the setting items are displayed according to the type of inspection area selected by the inspection area selection button 505. Figure 5A shows the setting items for pattern inspection that are displayed when the pattern inspection area 502 is selected. The setting items for pattern inspection are items such as what kind of defects to inspect when inspecting printed materials, and the level at which minute defects should be detected. Inspection items are, for example, round defects (dots) and linear defects (streaks). There are five levels of inspection, for example, from level 1 to level 5, and level 5 can detect thinner and smaller defects than level 1. Also, a level can be set for each inspection item, such as inspection level 5 for dots and inspection level 4 for streaks.

[0050] Figure 5B shows the string inspection settings displayed when string inspection area 503 is selected. For each inspection area, you can set the angle of the inspection area, the font of the string, whether to perform a matching check, and, if a matching check is performed, which column of the reference CSV to compare against. An item for selecting the font of the string is displayed, and the font selection from the user is accepted.

[0051] Figure 5C shows the barcode inspection settings displayed when barcode inspection area 504 is selected. For each inspection area, you can set the angle of the inspection area, the type of barcode, whether to perform a matching inspection, and, if performing a matching inspection, which column of the reference CSV to compare against. In this embodiment, irrelevant items are not displayed by showing settings according to the type of inspection area selected, but it is also possible to display all items and disable irrelevant items, or to collapse and hide irrelevant items.

[0052] Button 511 is the button to display the list of inspection areas. When the user presses it, the list of inspection areas shown in Figure 6 is displayed.

[0053] Button 512 is the inspection setting completion button. When the user presses it, the inspection settings are completed, the settings are saved to the memory unit 0228, and the inspection setting process ends. If there are inconsistencies in the settings, the inspection setting completion button 512 may be disabled so that it cannot be pressed. An example of a setting inconsistency is that there is an inspection area for performing a matching inspection, but the setting item 507 for the matching inspection data is not set.

[0054] Button 513 is the cancel button for the inspection settings. When the user presses it, the settings are discarded and the inspection settings process is terminated.

[0055] 514 is a test button for the inspection time for the set inspection area. By pressing it, the user can test whether the inspection of the set inspection area can be completed within the time limit. In this embodiment, the processing procedure performed by the inspection device 0108 when pressed by the user will be described later with reference to the drawings.

[0056] Figure 6 shows an example of an inspection area list screen displayed on UI panel 0102, which displays a list of currently configured inspection areas and accepts user operations to change inspection settings. Each row in the list corresponds to an inspection area 502 where it is located, and each setting value corresponds to 505 and 602, and 509 and 605-609. Users can select each inspection area one by one on the inspection settings screen to check and change the setting values, but checking the settings of multiple inspection areas is time-consuming and involves many operations. On the other hand, the inspection area list screen allows users to check and change the setting values ​​of multiple inspection areas at once. The inspection area list screen is displayed on UI panel 0102 when the user presses the display button 511 for the inspection area list. In this embodiment, it is assumed that it will be displayed in a floating window separate from the inspection settings screen, but it may also be displayed by transitioning from the inspection settings screen.

[0057] Row 601 displays the setting values ​​for each inspection area. It accepts selection by mouse clicks from the user. A context menu can be opened via right-click to allow duplication and deletion of the selected inspection area.

[0058] 602 is the display field for the type of inspection area. 603 is the display field for setting the page range of the inspection area. The inspection area list screen does not have a preview, and if the page range is changed, it will not be possible to see if the aforementioned misplacement occurs, so the page range setting operation is not accepted from the inspection area list screen.

[0059] 604 is the display column on the sheet where the inspection area is located.

[0060] 605 is the display area on the side where the inspection area is located.

[0061] 606 is the display field for setting the angle of the inspection area. In this embodiment, since setting the angle on a screen without a preview function would make it impossible to check for incorrect settings, similar to the inspection area, the angle setting operation is not accepted from the inspection area list screen.

[0062] 607 is the display area for font settings in the inspection area, and it accepts user input to change the font.

[0063] 608 is the display field for setting the barcode type in the inspection area, and accepts user operations to change the barcode type. The barcode type varies depending on the barcode cell size, data volume, etc.

[0064] 609 is a display field for the setting of whether or not to perform a matching check in the inspection area, and it accepts user operations to change the setting of whether or not to perform a matching check.

[0065] 610 is a display field for setting which column of the reference CSV to compare against for the inspection area, and it accepts user operations to change the column settings.

[0066] Button 611 is the button to exit the display of the inspection area list; when pressed, it closes the display of the inspection area list. The inspection time test button 612 has the same function as the inspection time test button 514.

[0067] Figure 7 is a flowchart showing the processing procedure in the inspection device 0108 when an inspection setting start operation is performed on the inspection device 0108. The CPU 0226 of the inspection device 0108 receives operations from the inspection setting screen and inspection area list displayed on the UI panel 0203 of the inspection device 0108 and executes various processes for performing inspection settings.

[0068] In S701, the inspection device 0108 accepts the operation to set the data for the matching inspection from the inspection setting screen. In this embodiment, the operation to set the data for the matching inspection refers to the operation of the matching inspection data setting item 507 by the user.

[0069] In S702, the inspection device 0108 accepts an operation to arrange the inspection area from the inspection settings screen. In this embodiment, the operation to arrange the inspection area refers to the user's operation of the inspection area arrangement button 506.

[0070] In S703, the inspection device 0108 determines whether the user configured individual inspection areas from the inspection settings screen (Figure 5) or from the inspection area list screen (Figure 6). If the settings were made from the inspection settings screen, the process proceeds to S704, and S704 to S707 is performed. If the settings were made from the inspection area list screen, the process proceeds to S708, and S708 to S710 is performed.

[0071] In S704, the inspection device 0108 accepts the selection of an inspection area from the inspection setting screen (Figure 5). In this embodiment, the selection of an inspection area refers to the user's operation of the inspection area selection button 505 displayed on the UI panel 0203.

[0072] In S705, the inspection device 0108 accepts a page range setting operation from the inspection settings screen. In this embodiment, the page range setting operation refers to the user's operation of the page range setting item 509 displayed on the UI panel 0203.

[0073] In S706, the inspection device 0108 accepts setting operations for each type of inspection area from the inspection setting screen. In this embodiment, the setting operation for each inspection area refers to the user's operation of the setting items 510 for each type of inspection area displayed on the UI panel 0203.

[0074] In S707, the inspection device 0108 reflects the results of the setting operations performed by the user on the inspection setting screen onto the inspection area list screen (Figure 6) and synchronizes the displayed content.

[0075] Next, we will describe the processing in S708-S710. Note that the inspection area list screen (Figure 6) does not have a preview, and if the page range is changed, it will not be possible to visually confirm if an incorrect placement of the inspection area occurs. Therefore, the page range setting operation is not accepted from the inspection area list screen.

[0076] At S708, the inspection device 0108 accepts an operation to select an inspection area from the inspection area list screen. In this embodiment, the operation to select an inspection area is the user's operation on the display row 601 of the setting value for each inspection area displayed on the UI panel 0203.

[0077] In S709, the inspection device 0108 accepts setting operations for each type of inspection area from the inspection area list screen. In this embodiment, the setting operation for each inspection area refers to the user's operation of the display fields 607 to 610 of each setting value displayed on the UI panel 0203.

[0078] In S710, the inspection device 0108 reflects the results of the setting operations performed by the user on the inspection area list screen onto the inspection settings screen (Figure 5) and synchronizes the displayed content.

[0079] In S711, the inspection device 0108 determines whether the user has completed the inspection settings. Specifically, it determines whether the user has pressed the inspection settings completion button 511, and if so, proceeds to S712. If the completion button 511 has not been pressed, the user performs the inspection area selection operation in S703 and continues the inspection settings process.

[0080] In S712, the inspection device 0108 saves the inspection settings to the storage unit 0228 and terminates the inspection setting process.

[0081] Figure 8 is a flowchart showing the processing procedure in the inspection device 0108 when an instruction to start an inspection time test is given to the inspection device 0108. When the inspection time test button 514 displayed on the UI panel 0203 of the inspection device 0108 is pressed, the CPU 0226 of the inspection device 0108 starts processing.

[0082] In S801, the inspection device 0108 obtains the paper size of the print job being inspected.

[0083] In S802, the inspection device 0108 calculates the inspection time limit per page for the inspection job being set up, based on the paper size information acquired in S801.

[0084] The following is an example of how to calculate the inspection limit time in S802. Table A shows the inspection limit time per page of an inspection job for the paper size of the print job in the inspection device 0108.

[0085] [Table 1]

[0086] The inspection limit time is expressed as the number of character inspection areas that can be inspected per page of the inspection job, with the time required to inspect one character inspection area being set as 1. For example, if the paper size of the print job is A3, the inspection limit time is 30 character inspection areas. If the paper size is B5, the inspection limit time is 27 areas. The inspection device 0108 stores the table information shown in this table in the storage unit 0228. Note that the inspection limit time exemplified using Table A depends on the paper transport speed of the printer 0101. Therefore, it is desirable to have a table that lists different inspection limit times depending on the paper transport speed of the printer 0101, such as when the model of the printer 0101 is different.

[0087] Furthermore, in this embodiment, the time required to inspect one character inspection area was used as the criterion for the inspection time limit. However, the actual time required for inspection may be measured, and the time limit may be expressed based on the measurement results, for example, within 500ms. Alternatively, other criteria may be established and used for expression.

[0088] In S803, the inspection device 0108 determines whether there are any inspection areas for which the required inspection time has not been calculated, among the inspection areas for which the inspection settings described in Figures 5, 6, and 7 have been configured. If such areas exist (if S803 is YES), the process proceeds to S804; otherwise, the process proceeds to S809. The procedure for calculating the required time will be described later.

[0089] In S804, the inspection device 0108 acquires setting information for one of the inspection areas for which the inspection settings described in Figures 5, 6, and 7 have been applied.

[0090] In S805, the inspection device 0108 performs OCR or barcode recognition processing based on the inspection setting information acquired in S804. Here, the determination of whether to perform OCR or barcode recognition processing on the target inspection area is made according to the type 602 of the inspection area. That is, if the type 602 of the inspection area is "string inspection", OCR processing is performed, and if it is "barcode inspection", barcode recognition processing is performed.

[0091] In S806, the inspection device 0108 obtains attribute values ​​related to the calculation of inspection time from the results of the recognition process performed in S805. Examples of attribute values ​​related to the calculation of inspection time include, for string areas, font type, font size, and length of the string contained in the area. For barcodes, these include barcode type, minimum narrow width, cell size, number of cells, error correction level, and length of the decoded string. In this embodiment, an example is shown in which the inspection time is calculated using some of these attribute values, but it is also possible to calculate it using all of these attribute values, or to calculate it using attribute values ​​other than those mentioned above.

[0092] In S807, the inspection device 0108 calculates the inspection time required for the inspection area from the attribute values ​​for the inspection area acquired in S806.

[0093] Tables B and C are table information used to calculate the inspection time for various attribute values ​​acquired by the inspection device 0108 in S807 for the string inspection area and barcode inspection area, respectively. This table information is pre-stored in the storage unit 0228. As an example, consider the case where the pre-configured inspection area acquired in S804 is the barcode inspection area for code 1, and the attribute values ​​obtained in S806 for that area are cell size = 0.7 mm and data amount = 800 bytes. In this case, in S807, the inspection device 0108 calculates the inspection time for this inspection area as equivalent to 10 string inspection areas, according to Table C. In this embodiment, the inspection time for the string inspection area shown in Table B is assumed to be equivalent to 1 area regardless of the attribute value, but it is also possible to set the table information so that the inspection time for the string inspection area differs depending on the attribute value. However, in that case, it is necessary to define a standard combination of attribute values ​​and define the inspection limit time in Table A, and the inspection times in Tables B and C, based on the inspection time for that attribute value.

[0094] [Table 2]

[0095] [Table 3]

[0096] In S808, the inspection device 0108 adds the inspection time obtained in S807 to the total inspection time for one page of inspection jobs, and then proceeds to S803 again. Although this embodiment shows an example where the inspection device 0108 calculates the total inspection time, the total inspection time may also be calculated by a device other than the inspection device 0108, and the inspection device 0108 may determine the total inspection time by obtaining the calculation result from that device.

[0097] The inspection device 0108 calculates the total inspection time per inspection job page by repeating the processes S803 to S808 described above for the number of pre-configured inspection areas.

[0098] If it is determined in S803 that there are no areas for which the required time has not been calculated, then in S809, the inspection device 0108 determines whether the calculated total inspection time is greater than the inspection limit time obtained in S802. If the result of the determination is greater (if S809 is YES), proceed to S810; if it is less (if S809 is NO), terminate this flow.

[0099] In S810, the inspection device 0108 displays a screen prompting the user to reconfigure the inspection settings because the total inspection time per page for the inspection area set in the UI panel 0203 exceeds the time limit for the current inspection job.

[0100] Figure 9A shows an example of a screen displayed in S810. In this example, a screen prompting the user to reconfigure the inspection settings, as described above, is displayed. By displaying such a message, the user can easily find out whether or not they need to modify the inspection settings they have made.

[0101] Figure 9B shows another example of a screen displayed in S810. In this example, along with a prompt to reconfigure the inspection settings as described above, the screen displays hints to reduce the inspection time. By including such information, it is possible to provide a reference for the user when they try reconfiguring the inspection settings.

[0102] Furthermore, the display screen in S810 may also include other information. For example, it may display information on inspection areas in order of the longest inspection time calculated in S807 from among the currently configured inspection areas, and also notify the user of information that will help them determine which inspection areas should have their settings modified in order to stay within the time limit. The present invention is within the scope of the present invention as long as it displays information that is useful for the user to modify the inspection settings based on the information obtained by recognizing the text area and barcode area.

[0103] By implementing the present invention using the processing procedure described above, users can accurately determine whether the inspection time based on their inspection settings will fall within the time limit of the inspection job before executing the inspection job, thereby improving the convenience of the inspection.

[0104] (Second embodiment) In this embodiment, we will explain, with reference to the drawings, how appropriately implementing the present invention makes it possible to more easily and efficiently determine whether the inspection time based on the inspection settings made by the user falls within the time limit of the inspection job. In describing this embodiment, we will omit the explanation of parts that are the same as the configuration and processing procedure of the first embodiment, and only the parts that differ will be explained.

[0105] Figure 10 is a flowchart showing the processing procedure of the inspection device 0108 when it is instructed to start an inspection time test in this embodiment. When the inspection time test button 514 displayed on the UI panel 0203 of the inspection device 0108 is pressed, the CPU 0226 of the inspection device 0108 starts processing.

[0106] In S802, the inspection time limit per inspection job page acquired by the inspection device 0108 is determined based on the time limit table information shown in Table D. As shown in Table D, the inspection time limit per inspection job page in this embodiment is expressed in time format in milliseconds (ms). The time limit table shown in Table D is pre-stored in the storage unit 0228.

[0107] [Table 4]

[0108] In S802, the inspection device 0108 obtains the time limit for the inspection job based on the time limit table information described in Table D, and then proceeds to S1001 after processing in S803 to S805.

[0109] In S1001, the inspection device 0108 measures the time required when it performs recognition processing on the target inspection area in S805. The time required may be measured based on the timestamp information of the operation log of the recognition processing in S805 (not shown), or by other methods. Alternatively, the time required may be calculated by measuring the time required multiple times for the same inspection area and obtaining a statistically significant value from the multiple time required values ​​obtained, such as the maximum value among the measurement results, or by calculating the maximum value considering the variance from the distribution of the obtained measurement times.

[0110] In S808, the inspection device 0108 adds the time measured in S1001, similar to the process in Example 1.

[0111] Steps S803-S805, S1001, and S808 are performed in this order for the number of areas specified in the inspection settings. In S809, the total inspection time per page is compared with the inspection limit time per page obtained in S802, similar to Example 1.

[0112] The processing procedure in this embodiment, as described above using Figure 10, will now be explained using a specific example of the inspection area.

[0113] Let's assume that the inspection settings are currently configured as shown in Figure 5D. Area 503 is set as the text inspection area, area 504 and 515-520 as the barcode inspection areas, and the inspection time test button 514 is pressed, starting the process described in Figure 10. The 2D code refers to a code such as a QR code (registered trademark) or a barcode, as shown in Figure 5D. Also, let's assume the inspection job paper size is A4, and the time limit per page of the inspection job calculated in S802 according to Table D is 500ms. Then, let's assume that the process in S1001 is executed for each of these inspection areas, and the resulting inspection times for each inspection area, and their sum, are as shown in Table E below. The column for inspection area indicates the numbering of each inspection area in Figure 5D.

[0114] [Table 5]

[0115] In this case, the determination by S809 shows that the total inspection time of 515 exceeds the inspection time limit of 500ms, so S810 displays a message on UI panel 0203 indicating that the inspection time limit has been exceeded.

[0116] With the above configuration, it becomes possible to implement the present invention in a simpler way, without the need to calculate the inspection time based on attribute values ​​obtained from the recognition results of strings and barcodes performed in Example 1.

[0117] (Other examples) In Examples 1 and 2, the control described for calculating the inspection time was performed by sequentially executing steps S803-S808 and S1001 for each inspection area, as explained using Figures 8 and 10. If the CPU0226 is configured to enable multithreaded processing and the processing procedure described in Figure 8 can be performed in parallel, it is also possible to calculate the inspection limit time and inspection time by considering parallel processing of steps S803-S808 and S1001 on an inspection area basis. For example, the inspection limit time could be calculated by multiplying the number of threads capable of parallel processing by the inspection limit time listed in Tables A and D, and this value could be compared with the inspection time calculated in Example 1 or Example 2.

[0118] Furthermore, when the image formation mode is double-sided, the CIS0315 and 0316 of inspection unit 0106 scan both the front and back pages simultaneously. In this case, the inspection time limit may be set considering whether the inspection can be processed in parallel. That is, if parallel operation is possible using multithreading, the inspection time limit listed in Table A or Table D may be multiplied by the number of threads capable of parallel processing and considered as the combined inspection time for both sides. This value may then be compared with the sum of the inspection time required for both sides calculated in Example 1 or Example 2. Alternatively, when performing double-sided inspection using single-threading, the inspection time limit listed in Table A or Table D may be divided by 2 and considered as the inspection time limit per page.

[0119] Furthermore, the object of the present invention can also be achieved by performing the following process: supplying a storage medium containing program code for software that realizes the functions of the above-described embodiment to a system or device, and having the computer (or CPU, MPU, etc.) of the system or device read the program code stored in the storage medium. In this case, the program code read from the storage medium itself realizes the functions of the above-described embodiment, and the program code and the storage medium containing the program code constitute the present invention. [Explanation of symbols]

[0120] 0101 Image forming apparatus 0108 Inspection device 0109 Information Processing Equipment 0110 Client Computer

Claims

1. An information processing device for inspecting images on printed paper, A registration means for registering a reference image used for inspecting the image on the aforementioned paper, The aforementioned reference image includes a region setting means for setting a data inspection area, A recognition means for recognizing the printed content of an image included in the area where the data inspection area is set, An acquisition means for acquiring attribute values ​​that affect the inspection time of the printed content from the information recognized by the recognition means, A selection means that uses the attribute values ​​obtained by the acquisition means to determine the time required for inspecting the printed contents of the paper, An information processing apparatus characterized by having a notification means for notifying the user of a warning before performing an inspection of the image on the paper if the required time determined by the identification means is longer than the time limit for inspecting the printed content.

2. The information processing device according to Claim 1, characterized in that the warning includes information indicating that the required time has exceeded the time limit.

3. The aforementioned time limit is The information processing device according to claim 1 or 2, characterized in that the time limit is set in advance according to the size of the paper.

4. The information processing apparatus according to any one of claims 1 to 3, characterized in that the warning includes information about attribute values ​​obtained by the acquisition means to ensure that the required time does not exceed the limit time.

5. The aforementioned attribute values ​​include: The information processing device according to any one of claims 1 to 4, characterized in that it includes a two-dimensional code printed on the aforementioned paper or attribute values ​​related to fonts.

6. The information processing device according to claim 5, characterized in that the two-dimensional code includes a barcode or a QR code.

7. The invention further comprises a display means for displaying a setting screen on which a data inspection area can be set on the reference image, The aforementioned settings screen has an area for setting the parameters of the inspection area selected as the target to be placed on the paper. The information processing apparatus according to any one of claims 1 to 6.

8. The information processing apparatus according to any one of claims 1 to 7, characterized in that the data inspection area is an area designated for inspecting fonts, two-dimensional codes, and images printed on the paper.

9. The information processing apparatus according to any one of claims 1 to 8, characterized in that the inspection of the printed contents of the paper is performed in the inspection of the image of the paper.

10. The information processing apparatus according to any one of claims 1 to 9, characterized in that the inspection of the printed contents of the paper is an inspection that compares the printed contents recognized by the recognition means with data contained in a pre-prepared reference data file.

11. The device further comprises a receiving means for receiving a user's instruction to confirm the inspection time of the data inspection area, By accepting the aforementioned confirmation instruction, The recognition means recognizes the printed content, The acquisition means acquires the attribute value, The aforementioned identification means uses the attribute value to determine the required time, The information processing apparatus according to any one of claims 1 to 10, characterized in that the notification means notifies the user of the warning before performing the inspection of the image of the paper if the required time is longer than the time limit.

12. The region setting means sets a plurality of data inspection regions in the reference image, The recognition means recognizes the printed content of the images contained in each of the plurality of data inspection areas. The acquisition means acquires the attribute values ​​of each of the respective regions, The aforementioned identification means uses the attribute values ​​of each of the respective regions to determine the required time for each of the respective regions. The information processing apparatus according to any one of claims 1 to 11, characterized in that the notification means notifies the user of the warning before performing the inspection of the image on the paper if the sum of the required times for each of the areas is longer than the time limit.

13. A control method for an information processing device that inspects an image on a printed sheet of paper, A registration step for registering a reference image used for inspecting the image on the aforementioned paper, A region setting step in which a data inspection area is set on the aforementioned reference image, A recognition step of recognizing the print content of an image included in the area where the data inspection area is set, An acquisition step is to obtain attribute values ​​that affect the inspection time of the printed content from the information recognized in the recognition step, A selection step involves using the attribute values ​​obtained in the acquisition step to determine the time required for inspecting the printed contents of the paper, If the time required determined by the specified step is longer than the time limit for inspecting the printed content, a notification step is made to notify the user of the warning before performing the inspection. A method for controlling an information processing device.

14. A program to function as an information processing device for inspecting images on printed paper, A registration means for registering a reference image used for inspecting the image on the aforementioned paper, The aforementioned reference image includes a region setting means for setting a data inspection area, A recognition means for recognizing the printed content of an image included in the area where the data inspection area is set, An acquisition means for acquiring attribute values ​​that affect the inspection time of the printed content from the information recognized by the recognition means, A selection means that uses the attribute values ​​obtained by the acquisition means to determine the time required for inspecting the printed contents of the paper, If the required time determined by the specified means is longer than the time limit for inspecting the printed content, a notification means provides a warning to the user before performing the inspection of the image on the paper. A program to cause an information processing device to function as such.

Images