Inspection device, inspection device, inspection method, printing system, inspection system

Abstract

To solve a problem that, when there is an overlapped area between areas for a pattern inspection and a data inspection set by a user, a notification of not performing a print image inspection for the overlapped area has not been performed.SOLUTION: A printing system is capable of executing a first inspection for reading a printed matter to generate a scanned image and inspecting the printed matter based on the scanned image and a correct answer image, and a second inspection for inspecting data acquired from the printed matter based on data acquired from the scanned image and correct answer data. In the correct answer image, when setting at least a first area to be inspected by first inspection means and a second area to be inspected by second inspection means, if there is an overlapped area between the first area and the second area, the printing system performs a notification that the first area and the second area overlap with each other.SELECTED DRAWING: Figure 5

Description

[Technical Field]

[0001] The present invention relates to an inspection device, an inspection device, a printing system, an inspection system, and an inspection method. [Background technology]

[0002] Traditionally, inspections to check whether printed matter has been printed correctly have been performed manually, but in recent years, automated inspection devices have been used as post-processing for printing presses. In such inspection devices, first, correct image (reference image) data is registered. Next, the input image data is printed out on paper by an image forming device, and the printed matter printed out on paper is read by an inspection sensor configured inside the inspection device. Defects in the printed matter are detected by comparing the image data read by the inspection sensor with the correct image data that was initially registered. Inspection to detect defects in the image portion of the printed matter is called print image inspection (image inspection).

[0003] In addition to print image inspection, variable area inspections such as character strings and barcodes are also performed in variable printing. Examples include data readability inspections, which check whether character strings and barcodes are readable, and data verification inspections, which verify the results of reading character strings and barcodes with the correct answers. These data readability inspections and data verification inspections are called data inspections. Variable printing refers to printing in which the content printed on paper can be changed based on data.

[0004] Due to the characteristics of the print image inspection and data inspection methods, print image inspection could not be performed on the variable areas of variable printing. This is because the variable areas of variable printing contain text strings and barcodes that change from page to page, so if a print image inspection of the variable areas were performed using a single correct image, the inspection result would be NG. This is because it is not possible to distinguish between changes due to printing defects (stains, streaks, etc.) and changes in the data such as text strings and barcodes.

[0005] In Patent Document 1, when creating reference image data for variable printing, the user selects an area of ​​an object that is common to all pages on which print image inspection is performed and an area of ​​a unique object whose content changes for each page on which data inspection is performed.Then, the area on which print image inspection is performed and the area on which data inspection is performed are combined to create a reference image, and the created reference image is used to inspect the printed matter. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] Japanese Patent Application Publication No. 2020-67732 Summary of the Invention [Problem to be solved by the invention]

[0007] In the method of Patent Document 1, if the areas set for print image inspection and data inspection overlap, exclusive processing must be performed so that only data inspection is enabled in the overlapping area.If the area for print image inspection and the area for data inspection overlap, it is assumed that only data inspection will be performed in the overlapping area.

[0008] However, in Patent Document 1, when the user sets areas for print image inspection and data inspection overlap, no notification is given that print image inspection will not be performed on the overlapping area.

[0009] Therefore, the present invention aims to propose an inspection system and a printing system that notifies users of the existence of an overlapping area when an area where print image inspection is performed overlaps with an area where data inspection is performed. [Means for solving the problem]

[0010] The present invention includes a printing means for printing an image on a recording sheet, the image including a variable area where a different image is printed on the first page and a fixed area where the same image is printed on the first page and the second page, and a reading device for reading the printed matter printed by the printing means. That A generating means for generating a scanned image, and a display control means for displaying a correct image including at least a fixed region on a display unit; a first inspection means for inspecting the printed matter based on at least a fixed area of ​​the scanned image and the reference image; a second inspection means for inspecting data acquired from the printed matter based on data acquired from an image printed in a variable area of ​​the scanned image and the reference data; a setting means for setting, in the reference image displayed on the display unit, at least a first area to be inspected by the first inspection means and a second area to be inspected by the second inspection means; and a setting means for setting, when there is an overlapping area between the first area and the second area, a first area to be inspected by the first inspection means and a second area to be inspected by the second inspection means. Warning based on duplicates Notification method to notify and when there is an overlapping area between the first area and the second area during the setting by the setting means, the notification means notifies the warning via a UI screen on which the setting is performed by the setting means. A printing system characterized by: [Effects of the Invention]

[0011] According to the present invention, when an area where a print image inspection is performed and an area where a data inspection is performed overlap, it is possible to notify the user that an overlapping area exists. [Brief explanation of the drawings]

[0012] [Figure 1] FIG. 1 is a diagram showing an example of a system configuration including an inspection apparatus according to an embodiment of the present invention. [Figure 2] 1 is an example of an internal configuration diagram of an image forming apparatus 100 according to the present embodiment. [Figure 3] 1 is an example of an internal configuration diagram of an inspection device 110 according to this embodiment. [Figure 4] 1 is an example of a flowchart of the entire inspection process according to this embodiment. [Figure 5] 1 is a flowchart illustrating an example of the test setting in step S403 according to the first embodiment. [Figure 6] 1 is a diagram illustrating an example of overlapping regions according to an embodiment of the present invention; [Figure 7] 1 is an example of a UI screen for test settings according to this embodiment. [Figure 8] 1 is an example of a UI screen for inspection settings when regions overlap in this embodiment. [Figure 9] 10 is an example of a UI screen before examination when regions overlap in this embodiment. [Figure 10] 1 is a flowchart showing an example of the inspection execution in step S404 according to the present embodiment. [Figure 11] 10 is a flowchart illustrating an example of the test setting in step S403 according to the second embodiment. [Figure 12] 10 is an example of a UI screen for setting a reference creation mode in the second embodiment. [Figure 13] 10 is a flowchart illustrating detailed settings of an inspection method according to the second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0013] The following detailed description of the embodiments of the present invention will be given with reference to the accompanying drawings. Note that the following embodiments do not limit the scope of the invention, and not all of the combinations of features described in the embodiments are necessarily essential to the solution of the present invention.

[0014] (Embodiment 1) 1 is a diagram showing a system configuration including an inspection device according to an embodiment of the present invention, in which 100 denotes an image forming device, 110 denotes an inspection device, 120 denotes a finisher, 130 denotes a client PC, 140 denotes a print server, and 150 denotes a network.

[0015] The image forming apparatus 100 performs printing based on various input data, such as print data sent from a client PC 130 or a print server 140 .

[0016] The inspection device 110 receives the printed matter output from the image forming device 100 and inspects the received printed matter for defects. Here, a defect is something that reduces the quality of the printed matter, such as stains caused by color material adhering to unintended locations during printing, or color loss caused by insufficient color material adhering to intended locations.

[0017] Furthermore, the inspection device 110 inspects variable area portions such as character strings and barcodes in variable printing. For example, it performs a data readability inspection to check whether character strings and barcodes are readable, and a data verification inspection to verify the results of reading character strings and barcodes with the correct answer. In other words, the inspection device 110 performs print image inspection and data inspection as described above.

[0018] The finisher 120 receives the output paper inspected by the inspection device 110, switches the paper discharge destination based on the inspection result of the inspection device 110, performs post-processing (bookbinding, etc.) as necessary, and discharges the paper.

[0019] The image forming apparatus 100 is connected to a client PC 130 and a print server 140 via a network 150, and to an inspection apparatus 110 and a finisher 120 via communication cables. The inspection apparatus 110 is connected to the image forming apparatus 100 as well as the finisher 120 via communication cables. This embodiment shows an inline inspection machine that performs image formation, inspection, post-processing, and paper discharge in an integrated manner. In this embodiment, at least the image forming apparatus 100 and the inspection apparatus 110 are collectively referred to as a printing system.

[0020] [Image forming device configuration] FIG. 2 is a diagram showing the internal configuration of the image forming apparatus 100 according to this embodiment.

[0021] Reference numeral 200 denotes a controller that receives images and documents from the network 150 and converts them into print data, 210 denotes a printer unit that prints the print data on a recording sheet (paper, sheet), and 220 denotes a UI unit that allows the user to give instructions such as selecting paper information to the image forming device 100. The image forming device 100 is made up of the above-mentioned controller 200, printer unit 210, and UI unit 220.

[0022] Reference numerals 201 to 208 denote components of the controller 200. Reference numeral 201 denotes a network I / F (interface) unit for transmitting and receiving data to and from the network 150, and 202 denotes a CPU that controls the entire image forming apparatus 100. Reference numeral 203 denotes a RAM that serves as a work area when the CPU 202 executes various commands, and 204 denotes a ROM that stores program data executed by the CPU 202 at startup, setting data for the controller 200, and the like. Reference numeral 205 denotes an image processing unit that performs RIP (Raster Image Processing) processing to convert image and document data received from the network 150 into print data. The image processing unit 205 can also perform RIP processing to convert image data and document data received from the network 150 into data of a correct image. Specifically, in the RIP processing for correct image data, for example, a resolution of 600 dpi is converted to 300 dpi to generate an image, and in the RIP processing for print data, an image is generated without reducing the resolution. Reference numeral 206 denotes an engine I / F (interface) unit that transmits print data to the printer unit 210. Reference numeral 207 denotes a communication I / F unit for communicating with the inspection device 110 and the finisher 120, and 208 denotes an internal bus (system bus).

[0023] Images and documents created on the client PC 130 or print server 140 on the network 150 are transmitted as PDL data to the image forming apparatus 100 via a network (e.g., a local area network). The transmitted PDL data is stored in RAM 203 via the network I / F unit 201. A print instruction from a user on the UI unit 220 is also stored in RAM 203 via the internal bus 208. A print instruction from a user is, for example, a selection of a paper type.

[0024] The image processing unit 205 acquires the PDL data stored in the RAM 203 and performs image processing to convert it into print data. The image processing to convert it into print data involves, for example, rasterizing the PDL data, converting it into multi-value bitmap data, and then performing screen processing or the like to convert it into binary bitmap data. The binary bitmap data obtained by the image processing unit 205 is sent to the printer unit 210 via the engine I / F unit 206.

[0025] The printer unit 210 prints the received binary bitmap data on a recording sheet using color materials. The CPU 202 issues instructions to the printer unit 210 based on a print instruction from the user stored in the RAM 203. For example, if the user instructs the printer unit 210 to print on coated paper, the CPU 202 instructs the printer unit 210 to output paper from a paper cassette (not shown) in the image forming apparatus 100 that stores coated paper. The CPU 202 controls various processes from receiving the PDL data to printing on the paper, thereby forming a full-color toner image on the paper.

[0026] [Internal configuration of inspection device 110] FIG. 3 is a diagram showing the internal configuration of the inspection device 110. As shown in FIG.

[0027] Reference numeral 300 denotes an inspection control unit that controls the entire inspection device 110, inspects the printed matter for defects, and inspects variable area portions such as character strings and barcodes. Here, the variable area refers to an area where a different image is printed on each page, and in particular, an area where an image with content different from the target image is printed. In this embodiment, an area where the same image with common content is printed on each page is called a fixed area, and in particular, an area where an image with content common to the target image is printed is called a fixed area.

[0028] Reference numeral 310 denotes an image reading unit that reads printed matter conveyed from the image forming apparatus 100. Reference numeral 320 denotes a UI unit that allows the user to configure the inspection device 110 and display the inspection results to the user. The user's configuration of the inspection device 110 refers to the type of defects to be inspected when inspecting printed matter. Inspection items include, for example, round defects (dots), linear defects (streaks), and the accuracy of variable area portions such as character strings and barcodes. The inspection device 110 is composed of the inspection control unit 300, image reading unit 310, and UI unit 320 described above. In the present invention, the UI unit 320 is referred to as a display unit.

[0029] Reference numerals 301 to 306 are components of the inspection control unit 300. Reference numeral 301 is a communication I / F (interface) unit for communicating data with the image forming apparatus 100 and the finisher 120, and 302 is a CPU that controls the entire inspection device 110. Reference numeral 303 is a RAM that serves as a work area when the CPU 302 executes various commands, and 304 is a ROM that stores program data executed by the CPU 302 at startup and setting data for the inspection control unit 300. Reference numeral 305 is an inspection processing unit that inspects whether or not there are defects in printed matter, and 306 is an internal bus (system bus).

[0030] Next, an overview of the print image inspection performed by the inspection device 110 will be described.

[0031] The inspection device 110 in this embodiment is capable of performing both print image inspection and data inspection.

[0032] The inspection device 110 uses the image reading unit 310 to read the printed material conveyed from the image forming device 100 and acquire a scanned image of the inspection target. The acquired scanned image of the inspection target is stored in the RAM 303.

[0033] Next, the inspection device 110 causes the inspection processing unit 305 to calculate a difference value between a reference image stored in advance in the RAM 303 as a correct image and the scanned image of the inspection target.

[0034] Next, the inspection device 110 performs an inspection by comparing the calculated difference value with the inspection threshold value (contrast and size) for each inspection item for each pixel. The inspection results are stored in RAM 303, and include, for example, information on whether or not there are defects in the printed matter, the type of detected defect (such as a dent or streak), and information on the position of the defect when displayed on the UI unit 320.

[0035] Next, an overview of the data inspection performed by inspection device 110 will be described.

[0036] The inspection device 110 uses the image reading unit 310 to read the printed material conveyed from the image forming device 100 and acquire a scanned image of the inspection target. The acquired scanned image of the inspection target is stored in the RAM 303.

[0037] Next, the inspection device 110 uses the inspection processing unit 305 to inspect whether the character string or barcode is readable using a pre-set character font for optical character recognition (OCR) and barcode standards. It is also possible to perform a data comparison inspection to check whether the read character string or barcode matches the correct data. The inspection results are stored in RAM 303, and include, for example, the results of the character string or barcode read from the printed material, the comparison results with the correct data, and the positional information of the read character or barcode when displayed on the UI unit 320. The correct data may be stored in RAM 203 of the inspection device 110 in advance, or may be acquired each time via the network 150 and temporarily stored in RAM 203.

[0038] Next, the inspection device 110 instructs the UI unit 320, via the CPU 302, to display the inspection results stored in the RAM 303. The inspection results are displayed on the UI unit 320, allowing the user to recognize the inspection results.

[0039] Furthermore, when a certain number of defective printed materials are found consecutively, the inspection device 110 causes the CPU 302 to transmit the above information to the image forming device 100 via the communication I / F unit 301 .

[0040] The information that defective printed materials have occurred consecutively is received by controller 200 via communication I / F unit 207. When controller 200 receives the information, CPU 202 instructs printer unit 210 to stop printing. When printer unit 210 is instructed to stop printing, image forming apparatus 100 stops the printing operation.

[0041] Furthermore, the inspection device 110 also transmits information to the finisher 120 via the communication I / F unit 301 based on the inspection results stored in the RAM 303 by the CPU 302. The information transmitted to the finisher 120 is information on whether or not there are defects in the printed matter. Using the received information, the finisher 120 discharges printed matter without defects to a normal paper discharge tray, and discharges printed matter with defects to a tray other than the normal paper discharge tray.

[0042] Next, the overall flow from the registration work before the start of the inspection in the inspection processing unit 305 to the execution of the inspection will be described with reference to the flowchart of FIG.

[0043] 4 is executed by the inspection device 110 in accordance with operations performed by the user on the client PC 130. At this time, the processing of the inspection device 110 is executed by loading program code stored in the ROM 304 into the RAM 303 and controlling the inspection control unit 300 by the CPU 302. Note that data created during processing by the inspection device 110 is temporarily stored in the RAM 303 or a storage unit (not shown).

[0044] First, in step S401, the inspection device 110 registers character shapes by creating a character font. The registered character shapes are used during data inspection. The character font is data that associates character image data with character codes, which are required for character recognition (OCR) performed during data inspection.

[0045] The procedure for creating a glyph font begins with the inspection device 110 waiting in a glyph font image reading mode and receiving a print job for creating a glyph font from the client PC 130. The inspection device 110 receives the glyph font job from the client PC and reads the glyph font image. When printing is executed, the inspection device 110 detects paper conveyance, scans the paper with the image reading unit 310, and saves the scanned image in RAM 303 of the inspection device 110. Characters to be OCRed are extracted one by one from the scanned image, and the user inputs the character code for the extracted character image, thereby creating a glyph font. While the method for creating a glyph font in this embodiment has been described, any method may be used as long as it can generate data in which a character code is associated with each character image extracted from a scanned image.

[0046] In some cases, only the print image inspection is performed without performing the data inspection. In this case, step 401 is not performed and the process proceeds to step S402.

[0047] Next, in step S402, the inspection device 110 registers a reference image that will be the correct image for inspection. The inspection device 110 waits in a reference image reading mode, and a print job for registering the reference image is executed from the client PC 130. When printing is executed, the inspection device 110 detects the conveyance of the paper and scans the paper with the image reading unit 310, and the scanned image is saved in the RAM 303 of the inspection device 110 as a reference image.

[0048] Next, in step S403, the inspection device 110 sets various inspection parameters such as the inspection area, inspection level, etc. in accordance with the user's inspection settings. Details of step S403 in this embodiment will be described later.

[0049] Next, in step S404, the inspection device 110 receives an inspection print job from the client PC 130, detects the conveyance of the paper, scans the paper with the image reading unit 310, and stores the scanned image in RAM 303 of the inspection device 110. Then, an inspection is performed using the scanned image of the inspection job and the reference image registered in step S402, using the inspection parameters set in step S403. Details of step S404 in this embodiment will be described later.

[0050] The above is a description of the overall flow from the registration work before the start of the test to the execution of the test in this embodiment.

[0051] Next, a flowchart for setting the inspection in step S403 will be described with reference to Fig. 5. By performing the processing of this flowchart, the inspection device 110 sets various inspection parameters, such as the inspection area and inspection level, for print image inspection and data inspection in accordance with the user's inspection settings. Also, examples of the UI for inspection settings will be described with reference to Figs. 7 and 8.

[0052] The UI screen 700 in FIG. 7 is a UI screen displayed on the UI unit 320 of the inspection device 110 at the timing of setting the inspection in step S403. Button 701 is a reference image change button used when changing the reference image. Button 702 is an inspection area selection button pressed by the user when the user wants to change the setting information for an area that has already been set. Page preview 704 is a display screen that displays the reference image loaded in step S402. Button 703 is a button for rotating the image displayed in page preview 704. Button 716 is a button for completing all inspection settings and executing the inspection. Button 719 is a button for interrupting the inspection settings; when the user presses button 719, the information being set is discarded and the inspection settings are terminated.

[0053] A button 721 is a button that is pressed by the user when setting an area for print image inspection, and a button 722 is a button that is pressed by the user when setting an area for data inspection.

[0054] The UI screen 706 is a group of UIs for setting the level of defects to be detected when performing print image inspection. The UI screen 706 will be described in detail later.

[0055] The UI screen 709 is a group of UIs for setting the data file to be referenced when comparing detected data with the data when performing a data inspection, the type of data inspection, and detailed information about the data inspection. Details of the UI screen 709 will be described later.

[0056] First, in step S501, the inspection device 110 displays a correct image on the UI unit 320. More specifically, the CPU 320 controls the display of the reference image (correct image) registered in S402 on the page preview 704 of the UI screen 700.

[0057] The user can also instruct the display of the reference image at this point. A change is necessary, for example, if there is a defect in the image portion of the reference image registered in step S402. If the reference image contains a flaw that could cause a defect, even if the printed matter is printed correctly, a difference will occur between the reference image and the actual printed matter, preventing accurate inspection. When the user presses button 701, the inspection device 110 waits in reference image reading mode and executes a print job for registering the reference image on the client PC 130. When printing is executed, the inspection device 110 detects paper conveyance and scans the paper with the image reader 310. The scanned image is saved in RAM 303 of the inspection device 110 as a reference image. The inspection device 110 then changes the image displayed in page preview 704 to the scanned image.

[0058] In steps S502 to S511, the inspection device 110 sets detailed information such as the inspection level, inspection type, and inspection area for print image inspection or data inspection in accordance with user operations, as will be described in detail below.

[0059] In S502, the inspection device 110 acquires operation information from the user via the UI screen 700. The operation information in this embodiment refers to information regarding any one of the operation of settings related to print image inspection, the operation of settings related to data inspection, and the operation of the button 716 to end the inspection settings.

[0060] In S503, the inspection device 110 determines whether the operation information acquired in step S502 is an OK input (end of inspection settings) from the button 716. If OK is input (S503; YES), the inspection device 110 ends the setting of detailed information such as the inspection level, inspection type, and inspection area for print image inspection or data inspection, and proceeds to S515.

[0061] If OK is not input (S503; NO), the process proceeds to step S504.

[0062] In step S504, the inspection device 110 determines whether the operation information acquired in step S502 is an operation related to print image inspection. If it is an operation related to print image inspection (S504; YES), the process proceeds to step S506.

[0063] In S506, the inspection device 110 sets the area for print image inspection. The method for setting the area for print image inspection in this embodiment is as follows: First, the user presses the button 721 for setting the area for print image inspection. Next, the user specifies the area for print image inspection in the page preview 704, and the inspection device 110 sets the corresponding specified area as the print image inspection area 705. The print image inspection area is an inspection area for detecting defects in the image portion of the printed matter.

[0064] Next, in step S507, the inspection device 110 sets the detection items and their detection levels for detecting defects in the print image inspection on the UI screen 707. Then, the process proceeds to step S512.

[0065] Detection items for print image inspection are items related to the characteristics of defects that are desired to be detected when inspecting printed matter, such as round defects (dots) and linear defects (streaks). Detection levels are parameters set in stages to determine the size of each detected defect feature before it is deemed a defect. For example, there are five levels, from level 1 to level 5, with level 5 being able to detect thinner and smaller defects than level 1. In addition, levels can be set for each inspection item, such as inspection level 5 for dots and inspection level 4 for streaks. UI screen 707 shows that the user has selected level 4 for the inspection level setting for defects (dots) and level 4 for the inspection level setting for defects (streaks).

[0066] If it is determined in step S504 that the operation is not related to print image inspection, the process proceeds to step S508.

[0067] In S508, a data inspection area is set in inspection device 110. The method for setting a data inspection area in this embodiment is as follows.

[0068] First, the user presses the data inspection area setting button 722 in FIG.

[0069] Next, the user specifies the range in the page preview 704 where data inspection is to be performed, and the inspection device 110 sets the corresponding specified range as a data inspection area 708 for inspecting character strings and a data inspection area 717 for inspecting barcodes. The data inspection area is an inspection area that reads the set type of data (character strings or barcodes) and determines whether it is correct or incorrect.

[0070] Next, in step S509, the inspection device 110 sets, by file selection, a file of the verification inspection data to be used as the correct character information when determining whether the data is correct or not in the data inspection of the UI 710.

[0071] In this embodiment, the data for the verification test is a reference CSV file for data verification that is used for verification when performing a data test. The reference CSV file is a file that the user must prepare in advance, and is a file that lists the correct strings for string and barcode tests. When a data test is performed, the string test area and the barcode reading results are compared with the correct strings listed in the reference CSV file. The UI 710 in Figure 7 shows that data with the file name abc.csv is selected as the data for the verification test.

[0072] Next, in step S510, the inspection device 110 sets the type of character string inspection or barcode inspection selected by the user using a pull-down menu in the data inspection type setting of the UI 720.

[0073] In this embodiment, the type of character string refers to the character font registered in step S401. The UI screen 720 in Fig. 7 shows that the character font selected for character string inspection is OCRB 12pt.

[0074] In this embodiment, the type of barcode refers to the barcode standard supported by the data inspection. For example, one-dimensional barcodes such as CODE39 and JAN, and two-dimensional codes such as QR Code (registered trademark) and DataMatrix code can be selected on the UI screen 720 if they are standards supported by the data inspection. The UI screen 720 in Figure 7 shows that CODE39 is selected as the barcode inspection.

[0075] In this embodiment, the inspection device 110 sets OCRB 12pt as the type of data inspection since the data inspection area 708 is a character string, and sets CODE39 as the type of data inspection since the data inspection area 717 is a barcode inspection.

[0076] Next, in step S511, inspection device 110 sets the direction in which character strings or barcodes are read when inspecting data using one of direction setting buttons 712 to 715 on UI screen 711. Then, the process proceeds to S512.

[0077] The direction setting buttons 712 to 715 correspond to 0°, 90°, 180°, and 270° in 90-degree increments clockwise from the paper transport direction. Since the paper transport direction is leftward when viewed from the page preview 704 in FIG. 7, the angle setting corresponding to the direction setting button 712 is set to 0°. The direction setting buttons 712 to 715 are set so as to correspond to the angle at which the character string or barcode displayed in the page preview 704 is displayed. Note that, although the direction setting buttons 712 to 715 are used to set the direction in which the character string or barcode is read in this embodiment, a UI that can set the direction (for example, radio buttons) may also be used, and is not limited to this embodiment.

[0078] Next, in step S512, the inspection device 110 determines whether there are any overlapping areas using different inspection methods, using the print image inspection area set in step S506 and the data inspection area set in step S508. The method for determining whether there are any overlapping areas will be described later.

[0079] For example, when set as shown in FIG. 7, the print image inspection area 705, the data inspection area 708, and the data inspection area 717 do not have any overlapping areas, and therefore the inspection device 110 determines that there is no overlap.

[0080] Next, in step S513, the inspection device 110 checks the determination result of step S512. If it is determined that there is an overlapping area (S513; YES), the process proceeds to step S514. If it is determined that there is no overlapping area in step S513 (S513; NO), the process proceeds to step S502, where user operation information is acquired to continuously set detailed information such as the inspection level, inspection type, and inspection area of ​​the data inspection.

[0081] In S514, the inspection device 110 notifies the user that there is an overlap by displaying the overlap on the UI unit 320 of the inspection device 110, notifying the user that there is an overlap and that data inspection will take priority in the overlapping area. After notifying, the inspection device 110 proceeds to S502. At this time, the notification made in S514 is used to acquire the next user operation information. For example, if the settings are as shown in FIG. 8, it is determined that there is an overlapping area, and the user is notified as described in text 802. UI screen 800 in FIG. 8 is a UI screen displayed on the UI unit 320 of the inspection device 110 when the print image inspection area and the data inspection area are set to overlap. 701 to 722 in FIG. 8 are the same as those in FIG. 7, and therefore description thereof will be omitted.

[0082] The data inspection area 801 in Figure 8 is an area set for data inspection of character strings inside the print image inspection area 705. When set as shown in Figure 8, the print image inspection area 705 and the data inspection area 801 have an overlapping area, and therefore the inspection device 110 determines that there is an overlap.

[0083] Note that Fig. 8 shows an example in which there is one area where the print image inspection area and the data inspection area overlap, but there may be multiple areas where the print image inspection area and the data inspection area overlap, as shown in Fig. 6(b). Note that Fig. 6 shows a portion of the reference image displayed in the page preview 704 in Figs. 7 and 8.

[0084] 8 is text that is displayed when it is determined in step S512 that an overlapping area exists. The text 802 is a statement that notifies the user that an overlapping area exists using different inspection methods and that data inspection will be enabled for the overlapping area. This is not limited to this embodiment, and any statement that notifies the user that an overlapping area exists using different inspection methods and that data inspection will be enabled for the overlapping area may be used.

[0085] Furthermore, to clearly indicate the overlapping areas to the user, the areas may be displayed in a color different from the frame colors indicating the print image inspection area and the data inspection area, or the relevant areas may be displayed by blinking. For example, in the case of Figure 6(b), the entire overlapping data inspection area 605 and part of the data inspection area 604 are displayed filled in with a conspicuous color. This makes it possible to clearly indicate the overlapping areas to the user.

[0086] If OK is pressed in S503, the process proceeds to S515.

[0087] In S515, the inspection device 110 uses the inspection areas for print image inspection and data inspection set in steps S504 to S511 to determine whether overlapping areas are set by different inspection methods. This is similar to the overlap determination of inspection areas performed in S512. The method for determining whether inspection areas overlap will be described with reference to FIG. 6.

[0088] 6(a) are inspection areas for performing a readability inspection or a data verification inspection as a data inspection, since the data inspection areas 601 and 602 are variable data character strings that change from page to page. The print image inspection area 603 is an inspection area for detecting defects in the image portion of the print.

[0089] Similarly, data inspection areas 604 and 605 in Figure 6(b) are inspection areas for carrying out a readability inspection or a data comparison inspection as a data inspection. Printed image inspection area 606 is an inspection area for detecting defects in the image portion of the printed matter. As shown in 604 and 606 in Figure 6(b), the inspection areas can be set so that only a portion of them overlap.

[0090] To determine whether inspection areas overlap, first check whether there are any common sections in the horizontal and vertical directions between the two inspection areas. If there are common sections in both the horizontal and vertical directions, it is determined that there is an overlap; if there are no common sections in either direction, it is determined that there is no overlap.

[0091] All combinations of different inspection methods are performed, and if the inspection areas overlap in any combination, it is determined that there is overlap in step S515, and if there is no overlap in all combinations, it is determined that there is no overlap in step S515.

[0092] In the case of Figure 6(a), there are combinations of data inspection area 601 and print image inspection area 603, and data inspection area 602 and print image inspection area 603, so a total of two overlapping area determinations are performed. In the case of data inspection area 601 and print image inspection area 603, there is a common section in the horizontal direction, but no common section in the vertical direction, so it is determined that they do not overlap. Similarly, in the case of data inspection area 602 and print image inspection area 603, there are common sections in both the horizontal and vertical directions, so it is determined that they overlap.

[0093] In the case of Figure 6(b), there are combinations of data inspection area 604 and print image inspection area 606, and data inspection area 605 and print image inspection area 606, so a total of two overlapping area determinations are performed. In the case of data inspection area 605 and print image inspection area 606, there are common sections in the horizontal and vertical directions, so they are determined to overlap. Similarly, in the case of data inspection area 605 and print image inspection area 606, there are common sections in the horizontal and vertical directions, so they are determined to overlap. Therefore, in Figure 6(b), it is determined that there are two overlapping areas.

[0094] The overlapping area is determined by the above method, but this is not limited to this embodiment, and any method that can determine the overlapping area may be used.

[0095] Next, in step S516, inspection device 110 checks the result of the overlapping area determined in step S515. If it is determined that there is no overlapping area (S516; NO), the process proceeds to step S517. If it is determined that there is an overlapping area in step S516 (S516; YES), the process proceeds to step S518.

[0096] In step S517, the examination information set in step S502 is saved, and the process ends.

[0097] In S518, the inspection device 110 displays, for example, a pop-up shown in FIG. 9 on the UI unit 320 of the inspection device 110 to notify the user that the button 716 in FIG. 7 has been pressed while the inspection areas are overlapping.

[0098] The display in S518 and the notification in S514 both aim to notify the user that there is an overlapping area, but the display methods are different. In S514, an overlapping area determination is made each time an area is selected, and a notification is made as shown in 802 in Figure 8. On the other hand, in S518, an overlapping area determination is made and a pop-up display is made after all user settings have been completed.

[0099] Depending on the user's settings, the notification (S514) may not be given during the setup process, and only the display (S518) may be given when the setup process is completed. Conversely, the notification (S514) may not be given when the setup process is completed, and only the display (S518) may be given during the setup process.

[0100] 9 is a pop-up UI screen that is displayed on the UI unit 320 of the inspection device 110 when the inspection setting is completed in step S506 with the inspection areas overlapping. When the inspection areas overlap, the UI screen 900 displays the details that data inspection will be enabled in the overlapping areas, and is a UI for confirming whether to perform the inspection as is or return to the inspection setting without performing the inspection.

[0101] Button 901 is a button for executing an inspection with the overlapping area set. Button 902 is a button for displaying the UI screen 700, which is an inspection setting screen, and executing again from step S501 in order to redo the inspection setting. Button 903 is a button for hiding the display of the pop-up screen 900.

[0102] The inspection device 110 continues to display the UI screen 900 until the user selects either the "OK" button 901, the "Proceed with inspection" button 902, or the close button 903 in accordance with the user's operation.

[0103] In this embodiment, Fig. 9 is displayed on the UI unit 320 of the inspection device 110 in the form of a pop-up that overlaps with the screen 700 of Fig. 7, but this is not limiting. For example, the screen may transition from the screen 700 to the screen 900. Alternatively, the notification may be made by displaying a warning mark on an icon. Furthermore, the notification may be made by a warning sound or voice.

[0104] Next, in step S519, the inspection device 110 determines whether the "OK (proceed with the inspection)" button 901 was selected by the user's operation in step S518, and if "OK" was selected, the inspection device 110 executes the process of step S517. If "OK" was not selected in step S518, the inspection device 110 returns to the process of step S502 and redoes the inspection settings.

[0105] The above is a description of the flow of processing for making settings related to an examination in this embodiment.

[0106] Next, the operation of the inspection device 110 after the inspection setting, which is the inspection execution in step S404, will be described using the flowchart in Fig. 10. When the user presses an inspection start button (not shown) displayed on the UI unit 320, the inspection device 110 performs an inspection using the inspection processing unit 305.

[0107] First, in step S1001, the inspection processing unit 305 detects defects (dots) and defects (streaks) contained in the paper as printing defects based on the inspection settings made by the user in step S403. The method for detecting printing defects in this embodiment is a method for extracting the difference between the reference image registered in step S402 and the scanned image of the corresponding print job, and detecting defects (dots) and defects (streaks) from the characteristics of the extracted difference image. This is not limited to this embodiment, and any known method may be used to detect printing defects.

[0108] Next, in step S1002, the inspection processing unit 305 performs OCR or barcode recognition on the data inspection area according to the inspection settings made by the user in step S403. OCR in this embodiment is performed in the following procedure. First, the target area to be OCRed is divided into individual characters. Then, using the character font registered in step S401, the similarity between the character image registered in the character font and the divided characters is calculated, and the character code corresponding to the character image with the highest similarity is determined as the result for one character. The character string obtained by combining the results of all the divided characters is the OCR result. This is not limited to this embodiment, and any known OCR method using a character font may be used.

[0109] Next, in step S1003, the inspection processing unit 305 compares the character recognition result and barcode recognition result obtained in step S1002 with the correct character strings listed in the verification inspection file set in step S509, and outputs the correctness determination result as the inspection result.

[0110] Next, in step S1004, the inspection processing unit 305 transmits the inspection result obtained in step S1003 to the UI unit 320.

[0111] Here, when the UI unit 320 receives the inspection results, it displays the scanned image of the inspection target and the inspection results to the user. If there are defects in the printed matter, the UI unit 320 highlights the detected defects on the scanned image with a dotted frame or a colored frame, and also displays the type of detected defect (such as a dent or streak) and its location information. On the other hand, if there are no defects in the printed matter, the UI unit 320 displays a message saying "No defects." Note that the method of displaying the inspection results by the UI unit 320 is not limited to these, and any method may be used as long as it can display the detection results in an easy-to-understand manner for the user.

[0112] The inspection processing unit 305 also transmits the inspection results obtained in step S1003 to the image forming apparatus 110 and the finisher 120.

[0113] The information sent to the image forming device 100 is information that a certain number of defective printed materials have occurred consecutively, and the information sent to the finisher 120 is information as to whether or not there were any defects in the printed materials.

[0114] As described above, when the image forming apparatus 110 receives the above information, it stops the printing operation. Furthermore, the finisher 120 uses the received information to eject printed materials without defects to a normal paper ejection tray, and eject printed materials with defects to a tray other than the normal paper ejection tray.

[0115] This concludes the description of the operation of the inspection device 110 when performing the inspection in step S404.

[0116] As described above, according to this embodiment, when the user sets overlapping areas for print image inspection and data inspection, the user can be notified in two ways: by displaying a message about the overlap in the UI during setting, and by a pop-up notification after setting. This makes it possible to display in the UI that the print image inspection and data inspection are in an exclusive processing relationship, making the user aware of this exclusive relationship.

[0117] (Embodiment 2) In the first embodiment, a method was described in which a reference image to be used for print image inspection is registered in advance, and the same reference image is used to inspect multiple copies. In this embodiment, an operation is described in which a reference image is created individually for each copy when inspecting multiple copies, and the mode is switched to perform the inspection.

[0118] The following describes the present embodiment, focusing on differences from the above-described embodiment 1. Note that parts not described in detail are the same as embodiment 1.

[0119] This embodiment has two modes for switching between the creation of reference images and the method of performing inspection. The first mode is a page-common mode in which a common reference image is created even when inspecting multiple copies, and print image inspection is performed using the common reference image. For example, if the overall page layout is the same and only the address section differs from page to page, the address section is not printed, and only the section common to each page is printed, and this image is used as the reference image. The page-common mode is the same as in embodiment 1, so a description thereof will be omitted.

[0120] The other mode is page-specific mode, which creates a reference image for each copy when inspecting multiple copies and performs print image inspection using the reference image created for each copy. For example, when printing images in which the layout configuration of the entire page is changed by each user, it is not possible to create a common reference image. Therefore, the image with the layout configuration changed for each user is used as the reference image. There are two methods for creating a reference image in page-specific mode. The first method, as in the first embodiment, is to create a reference image by executing a print job and scanning it with the image reading unit 310. The other method is to use image data after RIP (Raster Image Processor) processing, which analyzes the print job and generates image data, as the reference image, rather than using a scanned image. Because page-specific mode creates a reference image for each copy, it is possible to simultaneously inspect the print image inspection area and the data inspection area even if they overlap. This is because creating a reference image corresponding to the variable area of ​​variable printing allows only image defects to be detected during print image inspection.

[0121] An example of a UI for switching between the page individual mode and the page common mode will be described with reference to FIG.

[0122] 12 is a UI screen displayed on the UI unit 320 of the inspection device 110 when switching between the page individual mode and the page common mode, and is displayed when detailed settings of the main body of the inspection device 110 are made. The user selects either the page individual mode or the page common mode and makes the settings.

[0123] Radio button 1201 is a button for setting either page individual mode or page common mode. In Fig. 12, page individual mode is selected as an example. Button 1202 is a button for completing mode setting and saving the setting of radio button 121 selected by the user. Button 1203 is a button for interrupting mode setting, discarding the selected information, and terminating setting.

[0124] Next, a flowchart for setting the inspection in step S403 in the second embodiment will be described with reference to FIG. 11. By performing the processing of this flowchart, the inspection device 110 sets various inspection parameters, such as the inspection area and inspection level, for print image inspection and data inspection in accordance with the user's inspection settings. An example of a UI for the inspection settings will be described with reference to FIG. 7. Note that step S1101 is similar to step S501 in the first embodiment, and therefore its description will be omitted. Detailed settings of the inspection method in step S1102 are shown in FIG. 13. S1103 is similar to step S515 in the first embodiment, and therefore its description will be omitted.

[0125] Next, in step S1104, the inspection device 110 makes a determination using the setting of the reference image creation mode on the UI screen 1200. If it is determined that the mode is the individual page mode, in step S1108, the inspection device 110 saves the inspection information set in step S1302 and ends the inspection setting.

[0126] If it is determined that the mode is not the individual page mode, the inspection device 110 checks the result of the overlapping area determined in step S1103 in step S1105. If it is determined that there is no overlapping area, the inspection device 110 saves the inspection information set in step S1102 in step S1108 and ends the inspection setting in step S403.

[0127] If it is determined that there is an overlapping area, in step S1106, the inspection device 110 uses the UI unit 320 of the inspection device 110 to display the UI screen 900 in a pop-up format, similar to the first embodiment.

[0128] Next, step S1107 is similar to step S519, and therefore the explanation will be omitted.

[0129] 10 is a description of the processing flow for making settings related to the inspection in step S403 in this embodiment.

[0130] Next, a flowchart for setting detailed information such as the inspection level, inspection type, and inspection area of ​​print image inspection or data inspection in step S1302 will be described with reference to FIG. 13. S1301 is the step following S1101, and if YES in S1302, the process proceeds to S1103. By performing the processing of this flowchart, the inspection device 110 sets various inspection parameters such as the inspection area and inspection level of print image inspection or data inspection. Note that steps S1301 to S1310 are similar to steps S502 to S512 in the first embodiment, and therefore description thereof will be omitted.

[0131] Next, in step S1311, the inspection device 110 checks the setting of the reference image creation mode on the UI screen 1200, and if it determines that the mode is the page individual mode, the process proceeds to step S1301. If it determines that the mode is the page common mode in step S1311, the inspection device 110 checks the result of the overlapping area determination in step S1310 in step S1312. If there is no overlapping area, the process proceeds to step S1301. If there is an overlapping area in step S1312, the inspection device 110 notifies the user of the overlapping and that data inspection of the overlapping area will be prioritized by displaying that information on the UI unit 320 of the inspection device 110 in step S1313. The method of notification via the UI is the same as in the first embodiment, and therefore description thereof will be omitted.

[0132] The above is an explanation of the process relating to detailed settings such as the inspection level, inspection type, and inspection area of ​​the print image inspection or data inspection in step S1302 in this embodiment.

[0133] As described above, according to this embodiment, when the user is in the page common mode, it is possible to notify the user if the areas set for print image inspection and data inspection overlap. When the page individual mode is set, simultaneous inspection is possible even if the print image inspection and data inspection overlap, so there is no need to notify the user. As a result, only when the page common mode is set, it is possible to display on the UI that the print image inspection and data inspection are in an exclusive processing relationship, making the user aware of this exclusive relationship.

[0134] (Other embodiments) While various examples and embodiments of the present invention have been shown and described above, the spirit and scope of the present invention are not limited to the specific descriptions within this specification.

[0135] This embodiment can also be realized by supplying a program that realizes one or more functions of the above-described embodiment to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that realizes one or more functions. [Explanation of symbols]

[0136] 100 Image forming device 310 Image reading unit 303 RAM 305 Inspection Processing Section 302 CPU 320 UI section

Claims

1. a printing means for printing an image on a recording sheet, the image including a variable area for printing different images on the first page and the second page, and a fixed area for printing the same image on the first page and the second page; a generating means for reading the printed matter printed by the printing means and generating a scanned image; a display control means for displaying a correct image including at least a fixed region on a display unit; a first inspection means for inspecting the printed matter based on at least a fixed region of the scanned image and the target image; a second inspection means for inspecting the data acquired from the printed matter based on data acquired from the image printed in the variable area of ​​the scanned image and correct answer data; a setting means for setting, in the correct image displayed on the display unit, at least a first area to be inspected by the first inspection means and a second area to be inspected by the second inspection means; a notification means for issuing a warning based on the overlap between the first area and the second area when there is an overlap between the first area and the second area, The notification means notifies the warning via a UI screen on which the setting is performed by the setting means when there is an overlapping area between the first area and the second area during the setting by the setting means. A printing system characterized by:

2. A printing means for printing an image on a recording sheet, the image including a variable area for printing different images on the first page and the second page and a fixed area for printing the same image on the first page and the second page; a generating means for reading the printed matter printed by the printing means and generating a scanned image; a display control means for displaying a correct image including at least a fixed region on a display unit; a first inspection means for inspecting the printed matter based on at least a fixed region of the scanned image and the target image; a second inspection means for inspecting the data acquired from the printed matter based on data acquired from the image printed in the variable area of ​​the scanned image and correct answer data; a setting means for setting, in the correct image displayed on the display unit, at least a first area to be inspected by the first inspection means and a second area to be inspected by the second inspection means; a notification means for issuing a warning based on the overlap between the first area and the second area when there is an overlap between the first area and the second area, When the setting by the setting means is completed, if there is one or more overlapping areas between the first area and the second area, the notification means notifies the user of the warning by a pop-up. A printing system characterized by:

3. An overlapping area between the first area and the second area is inspected by the second inspection means, but is not inspected by the first inspection means.

3. The printing system according to claim 1, wherein the printing system includes: a printer;

4. The second inspection means performs inspection based on data read from a character string or a barcode printed in a variable area and the correct answer data.

4. The printing system according to claim 1, wherein the first and second printing units are connected to each other.

5. The first inspection means inspects the printed matter by comparing the scanned image generated by the generation means with a correct image corresponding to the scanned image.

5. The printing system according to claim 1, wherein the first and second printing units are connected to each other.

6. The correct image is a scanned image acquired by the generating means.

6. The printing system according to claim 1, wherein the printing system comprises: a printer;

7. The correct image is made up of image data that has been subjected to RIP processing.

6. The printing system according to claim 1, wherein the first and second printing units are connected to each other.

8. The printing system is configured with a printing device including the printing means, and an inspection device including the generating means, the display control means, the setting means, the first inspection means, the second inspection means, and the notification means.

8. The printing system according to claim 1, wherein the printing system is a computer.

9. a printing means for printing an image on a recording sheet, the image including a variable area for printing different images on the first page and the second page, and a fixed area for printing the same image on the first page and the second page; a generating means for reading the printed matter printed by the printing means and generating a scanned image; a selection means for selecting a page common mode in which a correct answer image including at least a fixed area is registered, and a page individual mode in which a correct answer image is registered for each of the first page and the second page; a display control means for displaying the correct image on a display unit; a first inspection means for inspecting the printed matter based on the scanned image and the correct image; a second inspection means for inspecting the data acquired from the printed matter based on the data acquired from the scanned image and the correct answer data; a notification means for notifying a warning based on an overlap between a first area set in the fixed area and a second area set in the variable area; Equipped with The notifying means issues the warning if the page common mode is selected by the selecting means when there is an overlapping area between the first area and the second area. A printing system characterized by:

10. When there is an overlapping area between the first area and the second area, if the page individual mode is selected by the selection means, the notification means does not issue the warning.

10. The printing system according to claim 9.

11. A printing system as described in any one of claims 1 to 10, characterized in that the warning is a warning indicating that the first area and the second area overlap.

12. a generating means for generating a scanned image by reading a printed matter on which an image including a variable area where an image having different contents between the first page and the second page is printed on a recording sheet and a fixed area where an image having the same contents between the first page and the second page is printed; a display control means for displaying a correct image including at least a fixed region on a display unit; a first inspection means for inspecting the printed matter based on at least a fixed area of ​​the scanned image and the target image; a second inspection means for inspecting the data written on the printed matter based on data read from the image printed in the variable area of ​​the scanned image and correct answer data; a setting means for setting, in the correct image displayed on the display unit, at least a first area to be inspected by the first inspection means and a second area to be inspected by the second inspection means; a notification means for issuing a warning based on the overlap between the first area and the second area when there is an overlap between the first area and the second area, The notification means notifies the warning via a UI screen on which the setting is performed by the setting means when there is an overlapping area between the first area and the second area during the setting by the setting means. An inspection device characterized by:

13. a printing step of printing an image on a recording sheet, the image including a variable area where different images are printed on the first page and the second page, and a fixed area where the same image is printed on the first page and the second page; a generating step of reading the printed matter and generating a scanned image; a display step of displaying a correct image including at least the fixed region on a display unit; a first inspection step of inspecting the printed matter based on at least a fixed region of the scanned image and the target image; a second inspection step of inspecting the data acquired from the printed matter based on data acquired from the image printed in the variable area of ​​the scanned image and correct answer data; a setting step of setting at least a first area to be inspected in a first inspection step and a second area to be inspected in a second inspection step in the correct image displayed on the display unit; a notification step of issuing a warning based on the overlap between the first area and the second area when there is an overlap between the first area and the second area, A control method for a printing system, characterized in that in the notification process, if there is an overlapping area between the first area and the second area while the setting is being made in the setting process, the warning is notified via a UI screen on which the setting is made in the setting process.

14. A program for causing a computer to execute the control method according to claim 13.

15. The inspection device described in Claim 12, characterized in that the warning is a warning indicating that the first area and the second area overlap.

16. The method for controlling a printing system according to claim 13, wherein the warning is a warning indicating that the first area and the second area overlap.

17. A conveying means for conveying a printed matter printed by the printing means, 12. The printing system according to claim 1, wherein the generating unit generates a scanned image by reading the printed material conveyed by the conveying unit.

Images