Image inspection device, image inspection method, and image inspection program

Abstract

This reduces the time required for processing, from generating reference images to image inspection. [Solution] The image inspection device 100 includes a reference image generation unit 311 that generates a reference image used for inspecting an image formed on a recording medium, an image inspection unit 312 that inspects the image formed on the recording medium based on the reference image, and a first reception unit 115 that receives an instruction to perform inspection by the image inspection unit before the generation of the reference image by the reference image generation unit is completed.

Description

Technical Field

[0001] The present invention relates to an image inspection apparatus, an image inspection method, and an image inspection program.

Background Art

[0002] Conventionally, the quality of a printed matter has been inspected by comparing a previously registered reference image with an inspection image obtained by reading the printed matter to be inspected. For example, in Patent Document 1, as the reference image, in the case of the proof mode for checking the completion, image data derived from the original image used for printing is used, and in the subsequent mass printing, in the proof mode, when a printed matter confirmed by the user to have no abnormality visually is read, the read image data obtained is used.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the technique of Patent Document 1, the user's processing for generating the reference image used for mass printing is complicated, and it is necessary to execute mass printing after preparing the reference image through the proof mode in advance.

[0005] The present invention has been made in view of the above circumstances, and an object thereof is to provide an image inspection apparatus, an image inspection method, and an image inspection program capable of further shortening the time required for processing from the generation of a reference image to image inspection as compared with the conventional technique.

Means for Solving the Problems

[0006] The above object of the present invention is achieved by the following means.

[0007] (1) A reference image generation unit that generates a reference image used for inspecting an image formed on a recording medium, An image inspection unit that inspects the image formed on the recording medium based on the aforementioned reference image, A first reception unit receives an instruction from the image inspection unit to perform an inspection before the reference image generation unit completes, An image inspection device having the following features.

[0008] (2) The image inspection apparatus according to (1) above, wherein the first receiving unit receives an instruction from the image inspection unit to perform an inspection before or during the generation of the reference image by the reference image generation unit.

[0009] (3) The image inspection apparatus according to (1) or (2) above, further comprising a second receiving unit that receives an instruction to perform an inspection by the image inspection unit based on the reference image after the reference image generation unit has generated the reference image.

[0010] (4) An image forming unit that forms an image on the recording medium based on the original image, A control unit controls the transmission of the original image to the reference image generation unit and the image forming unit based on the receipt of the execution instruction by the first reception unit, The image inspection apparatus according to (1) or (2) above, further comprising the above.

[0011] (5) The image inspection apparatus according to (4) above, wherein the control unit causes the reference image generation unit to generate the reference image and the image formation unit to form the image on the recording medium in parallel.

[0012] (6) The image inspection apparatus according to (4) above, wherein the control unit causes the image forming unit to form the image on the recording medium after the reference image generation unit has generated the reference image.

[0013] (7) An image forming unit that forms an image on the recording medium based on the original image, The system further includes a control unit that controls the transmission of the original image to the image forming unit based on the receipt of the execution instruction by the second reception unit, The image inspection device described in (3) above.

[0014] (8) A reference image generation step that generates a reference image used for inspecting an image formed on a recording medium, An image inspection step of inspecting an image formed on the recording medium based on the aforementioned reference image, A first reception step that receives an instruction to perform the inspection in the image inspection step before the generation of the reference image in the reference image generation step is completed, Image inspection methods, including those mentioned above.

[0015] (9) A reference image generation step that generates a reference image used for inspecting an image formed on a recording medium, An image inspection step of inspecting an image formed on the recording medium based on the aforementioned reference image, A first reception step that receives an instruction to perform the inspection in the image inspection step before the generation of the reference image in the reference image generation step is completed, An image inspection program that causes a computer to perform a process that includes [specific details]. [Effects of the Invention]

[0016] The image inspection apparatus according to the present invention comprises a reference image generation unit that generates a reference image used for inspecting an image formed on a recording medium, an image inspection unit that inspects the image formed on the recording medium based on the reference image, and a first reception unit that receives an instruction to perform inspection by the image inspection unit before the generation of the reference image by the reference image generation unit is completed. In this way, the time required for processing from the generation of the reference image to image inspection can be shortened. [Brief explanation of the drawing]

[0017] [Figure 1] This figure shows a schematic configuration of a printing system including an image inspection device according to the first embodiment. [Figure 2] It is a block diagram showing the hardware configuration of an image inspection device. [Figure 3] It is a schematic diagram for explaining the processing of image inspection. [Figure 4] It is a schematic diagram showing the flow of each data. [Figure 5] It is a schematic diagram showing in time series each process of acquisition of a manuscript image, generation of a reference image, formation of an inspection image, and inspection of the inspection image. [Figure 6A] It is an example of an operation screen for explaining the first reception unit. [Figure 6B] It is an example of an operation screen displayed following FIG. 6A. [Figure 6C] It is an example of an operation screen for explaining the second reception unit. [Figure 6D] It is an example of an operation screen displayed following FIG. 6C. [Figure 6E] It is an example of an operation screen displayed following FIG. 6D. [Figure 6F] It is an example of an operation screen for explaining another second reception unit. [Figure 6G] It is an example of an operation screen displayed following FIG. 6F. [Figure 7] It is a flowchart showing the processing procedure of an image inspection method. [Figure 8] It is a flowchart showing the processing procedure in the first inspection mode performed following FIG. 7. [Figure 9] It is a flowchart showing the processing procedure in the second inspection mode performed following FIG. 7. [Figure 10] It is a subroutine flowchart showing the generation process of a reference image. [Figure 11] It is a subroutine flowchart showing the image inspection process.

MODE FOR CARRYING OUT THE INVENTION

[0018] Embodiments of the present invention will be described below with reference to the attached drawings. However, the scope of the present invention is not limited to the embodiments disclosed. In the description of the drawings, the same elements are denoted by the same reference numerals, and redundant descriptions are omitted. The advantages and features provided by one or more embodiments of the present invention will be fully understood from the detailed description below and the attached drawings. Furthermore, the attached drawings are provided for illustrative purposes only and are not intended to define the scope of the present invention.

[0019] Figure 1 is a diagram showing the schematic configuration of an image inspection device 100 and a printing system 1000 including it according to the first embodiment. Figure 2 is a block diagram showing the hardware configuration of the image inspection device 100. As shown in Figure 1, the printing system 1000 includes a terminal device 80 and one or more image inspection devices 100, which are connected by a network 90.

[0020] The terminal device 80 may be, for example, a personal computer, a tablet, or a smartphone. The terminal device 80 has a printer driver installed for converting document data into a print job. The terminal device 80 is used by a user, such as an operator who operates the image inspection device 100. The printer driver, in response to user instructions, generates a print job in a format compatible with the print controller 13 of the image inspection device 100 (see Figure 2 below) and sends the print job to the image inspection device 100 via the network 90. ​​The terminal device 80 also has a display that can show the inspection results of the printed materials (quality results) (good / defective items), images of defective printed materials, etc.

[0021] A print job includes, for example, print data in PDL (Page Description Language) format (hereinafter also referred to as original image data or original image) and job setting information (hereinafter referred to as job settings). The original image includes, for example, an original image consisting of pages 1 to n. The job settings include, for example, the number of pages, the number of copies, the type of paper (recording medium), size, basis weight, single-sided printing / double-sided printing, and other print settings. The job settings also include inspection conditions. The inspection conditions include whether or not to perform image inspection (inspection setting on / off), and if image inspection is "enabled", the types of the first and second inspection modes are also included. The inspection conditions may also include inspection area specification information (described later). Furthermore, in the second inspection mode, path information (file directory information) specifying the file of the registered reference image to be used is included. The user can instruct the print system 1000 to perform image inspection by enabling inspection (turning on the inspection setting). The inspection conditions can be set using the operation screen displayed by the printer driver (for example, Figure 6A described later).

[0022] (Image inspection device 100) The image inspection apparatus 100 is also called an image forming system. The image inspection apparatus 100 includes an image forming apparatus 10, a paper feeder 20, an inspection unit 30, a purging apparatus 40, and a post-processing apparatus 50, which are mechanically and electrically connected to each other.

[0023] (Overview of inspection unit 30) The details of the inspection unit 30 will be described later, but the inspection unit 30 has a reference image generation unit 311 that generates a reference image used for inspecting the image formed on the recording medium (paper). The reference image generation unit 311 generates a reference image based on the original image. The inspection unit 30 also has an image inspection unit 312 that inspects the image formed on the paper based on the reference image. The image forming apparatus 10 (image forming unit 16) forms an image on the paper based on the original image. The image inspection unit 312 inspects the image on the paper by reading the image on the paper based on the original image and comparing the inspection image obtained with a reference image generated based on the same original image.

[0024] (Image forming apparatus 10) The image forming apparatus 10 performs image formation on paper fed and transported from the upstream paper feeder 20. The image forming apparatus 10 also performs image formation on paper fed from its own paper feed section 14.

[0025] As shown in Figure 2, the image forming apparatus 10 comprises a main unit control unit 11, a storage unit 12, a print controller 13, a paper feeding unit 14, a transport unit 15, an image forming unit 16, an operation panel 17, and a communication unit 19. These components are interconnected via signal lines such as buses for exchanging signals. Note that in Figure 2, some connection lines between components of the image forming apparatus 10, such as the storage unit 12 and the print controller 13, are omitted. Similarly, some connection lines between components of the inspection unit 30 are omitted.

[0026] (Main unit control 11) The main control unit 11 is composed of a CPU, ROM, RAM, etc., and executes various processes by running programs stored in the ROM and the memory unit 12 (described later), and controls each part of the device and performs various calculations according to the program. The main control unit 11 functions as a printer control unit 111, an inspection unit control unit 112, an other device control unit 113, an inspection execution instruction receiving unit 115, a data transmission unit 116, and an inspection area receiving unit 117. Details of each sub-function will be described later. The main control unit 11 works in cooperation with the control unit 31 of the inspection unit 30, etc., to control the entire image inspection device 100.

[0027] (Storage unit 12) The storage unit 12 consists of an auxiliary storage unit such as a hard disk that stores various programs and data in advance. The storage unit 12 also functions as a page memory (the storage unit 32 described later does the same).

[0028] (Print controller 13) The print controller 13 analyzes the print job received from the terminal device 80 via the network 90, performs processing such as color conversion, screening, and rasterization, and generates a bitmap-formatted original image. The generated original image is transmitted to the control unit 31. The print controller 13 functions as an original image acquisition unit.

[0029] The print controller 13 receives print jobs from terminal devices 80, etc., via the communication unit 19. The received print job includes print data (mainly in PDL format) that forms the basis of the original image (also called original image data) and job information that describes print settings such as the type of paper to be used. Based on the print settings, the print controller 13 performs rasterization (RIP) processing to convert the print data into page-level bitmap data. The RIP image after rasterization is temporarily stored in the image memory inside the print controller 13. The RIP image in the image memory is temporarily stored in the compressed memory area of ​​the page memory of the storage unit 12. During normal printing, the RIP image stored in the compressed memory area is decompressed by the compression / decompression IC and sent via the writing processing unit as the original image in image format. The material is sent to section 16 and printing is performed.

[0030] (Paper feeding section 14, transport section 15) The paper feeding unit 14 is equipped with multiple paper trays. The transport unit 15 is equipped with a transport path. This transport path includes multiple pairs of transport rollers provided along the transport path, and a drive motor (not shown) that drives these pairs of transport rollers. The paper feeding unit 14 is equipped with a feed roller that feeds out the top sheet of paper from among the multiple sheets of paper stacked and placed in the paper tray, and feeds the paper in the paper tray one sheet at a time to the transport path downstream.

[0031] (Image forming unit 16) The image forming unit 16 forms images, for example, by an electrophotographic method. The image forming unit 16 includes writing units (laser exposure units) corresponding to each of the basic colors Y (yellow), M (magenta), C (cyan), and K (black), a photosensitive drum, and a developer unit that contains a two-component developer consisting of toner and carrier for each color. The image forming unit 16 also includes an intermediate transfer belt, a secondary transfer unit, and a fixing unit. The toner images formed on the photosensitive drum by the developer units for each color are superimposed on the intermediate transfer belt and transferred to the transported paper in the secondary transfer unit. The toner images on the paper are fixed to the paper by heating and pressurizing in the downstream fixing unit.

[0032] (Control panel 17) The control panel 17 includes a touchscreen, a numeric keypad, a start button, a stop button, and the like. The control panel 17 displays the status of the image forming apparatus 10 or the image inspection apparatus 100 and is used for inputting various settings and instructions from the user. It also displays the inspection results from the inspection unit 30 and accepts input for setting inspection conditions and execution instructions.

[0033] (Communications Section 19) The communication unit 19 is an interface for communicating with various devices on the network, such as PCs, or with other devices 20, 30, etc.

[0034] (Sub-functions 111-117) (Printer control unit 111) When a print job is input, the printer control unit 111 executes the print job based on the print job settings of the input print job. Print jobs are input by instructions sent from the operation panel 17 or from a terminal device 80 such as a network-connected PC operated by the user. The job settings include print settings and inspection conditions. Print settings include double-sided / single-sided printing, paper type, post-processing conditions, etc. Details of the inspection conditions will be described later, but they are set, for example, by the operation screen such as Figure 6A described later.

[0035] The printer control unit 111 controls the paper feeding and transport by controlling the paper feeding unit 14 and the transport unit 15. The printer control unit 111 also controls the image forming unit 16 to form an image on the paper according to the set image forming conditions.

[0036] The inspection unit control unit 112 controls the inspection unit 30 in response to an execution instruction request (inspection instruction) from the printer control unit 111.

[0037] The other device control unit 113 controls the paper feed device 20, the purge device 40, and the post-processing device 50. Specifically, the other device control unit 113 communicates with the paper feed device 20 to send and receive information such as the paper tray to be used and the paper transport timing. The other device control unit 113 also sends information to the purge device 40 regarding the paper transport timing, the main and sub transport paths for the paper to be transported, and post-processing setting information to the post-processing device 50.

[0038] (Inspection execution instruction reception unit 115) The inspection execution instruction receiving unit 115 functions as a first receiving unit and a second receiving unit. Examples of the first and second receiving units will be described later (Figure 4A, etc.).

[0039] The "first reception unit" receives the instruction to execute the inspection in the first inspection mode. That is, the first reception unit receives the execution instruction from the image inspection unit 312 before the reference image generation by the reference image generation unit 311 is completed. In addition, the first reception unit receives the instruction to execute the image inspection by the image inspection unit 312 before the reference image generation is completed, either before (before generation starts) or during the generation of the reference image. Upon receiving the execution instruction, image formation and inspection of the resulting image are performed. In the first inspection mode, it can also be said that the instruction to execute the inspection can be received before the generation of the reference image is completed. In the first inspection mode, in parallel with the image formation process of the image to be inspected on the paper by the image formation unit 16 based on the original image, the reference image generation process by the reference image generation unit 311 is executed based on the same original image. The fact that the first reception unit receives the instruction to execute the image inspection by the image inspection unit 312 while the reference image is being generated means, for example, that the instruction to execute the image inspection for the next job may be received while the reference image for the previous job is being generated.

[0040] The "second reception unit" receives instructions to execute inspection in the second inspection mode. That is, the second reception unit receives instructions to execute image inspection by the image inspection unit 312 after the reference image generation by the reference image generation unit 311 is completed. Upon receiving the execution instructions, image formation and inspection of the resulting image are performed. In the second inspection mode, it can also be said that instructions to execute inspection can be received after the reference image generation process is completed. In the second inspection mode, the reference image generation process by the reference image generation unit 311 is performed based on the original image, and then inspection is performed by receiving instructions to execute inspection using this. Alternatively, in the second inspection mode, inspection is performed using already registered reference images. The latter includes both cases where a new reference image is generated and registered for inspection, and cases where a registered reference image is reused.

[0041] (Data transmission unit 116) The data transmission unit 116 transmits the original document image to the image forming unit 16 and the inspection unit 30 (particularly the reference image generation unit 311). Specifically, the data transmission unit 116 transmits the original document image to the image forming unit 16 and the inspection unit 30 (particularly the reference image generation unit 311) in response to the acceptance of the first reception unit for the execution of the first inspection mode. For example, in response to the acceptance of the first reception unit for the execution of the first inspection mode, the data transmission unit 116 immediately transmits the original document image to both the image forming unit 16 and the reference image generation unit 311 simultaneously. The data transmission unit 116 also transmits the original document image to the image forming unit 16 in response to the acceptance of the first reception unit for the execution of the first inspection mode. Furthermore, the data transmission unit 116 transmits the original document image to the image forming unit 16 in response to the acceptance of the second reception unit for the execution of the second inspection mode.

[0042] (Inspection area reception section 117) The inspection area reception unit 117 receives (a) the designation of areas to be excluded from inspection, and (b) the designation of inspection areas (hereinafter, these are collectively referred to as "inspection area designation information"). The inspection area reception unit 117 also transmits the received inspection area designation information to the reference image generation unit 311. The inspection area designation information is described by the target area range (XY coordinate position along the main scanning direction (X direction) and sub-scanning direction (Y direction)) and its contents. The area range is, for example, a rectangular area. (a) Areas designated as areas to be excluded from inspection are not subject to inspection. (b) Areas designated as inspection areas are subject to inspection. In areas designated as inspection areas, it is possible to perform inspections different from the usual. For example, if the original image contains a photograph of a face, the color inspection level will be set more strictly in areas containing skin tones on the face. Also, when designating an inspection area, barcodes There are specific requirements. The original image may contain barcodes (1D, 2D). In this case, in the inspection area designated for barcodes, the image within the inspection area will be decoded to verify whether the barcode printing is correct.

[0043] (Paper feeder 20) The paper feeder 20 shown in Figures 1 and 2 includes a paper feeding section and a transport section similar to those of the image forming apparatus 10. In addition to the transport section and paper feeding section, the paper feeder 20 also includes a control section, a storage section, and a communication section (none of which are shown), which are interconnected via signal lines such as buses for exchanging signals.

[0044] (Inspection unit 30) Next, the inspection unit 30 will be described. As shown in Figure 2, the inspection unit 30 includes a control unit 31, a storage unit 32, an image reading unit 33, a transport unit 34, a communication unit 39, etc. The control unit 31, storage unit 32, transport unit 34, and communication unit 39 each have the same hardware configuration as the main control unit 11, storage unit 12, transport unit 15, and communication unit 19 of the image forming apparatus 10 described above, so their explanation will be omitted.

[0045] The image reading unit 33 reads the paper (printed material) being transported along the transport path, for example, using a CCD (Charge Coupled Device) image sensor. The control unit 31 controls the scanner to read the image (inspection image) formed on the paper transported from the image forming apparatus 10, according to the reading instructions from the inspection unit control unit 112. The control unit 31 also performs various processes such as analog processing, A / D conversion processing, and shading processing on the analog image signal output from the image reading unit 33 to generate digital image (read image) data.

[0046] (Control Unit 31) The control unit 31 functions as a reference image generation unit 311 and an image inspection unit 312.

[0047] The reference image generation unit 311 generates a reference image by performing the following various processes based on the original image acquired by the image forming apparatus 10 (particularly the print controller 13).

[0048] The reference image generation unit 311 and the image inspection unit 312 may each be configured with independent CPUs so that their respective reference image generation and image inspection processes can be performed in parallel. That is, the control unit 31 is composed of multiple CPUs. Alternatively, a multi-core CPU may be used as the CPU for the control unit 31. In the case of a multi-core CPU, the reference image generation unit 311 can be assigned to a different core from the image inspection unit 312's inspection image formation and inspection processes, allowing the generation of reference images and the formation and inspection of inspection images to be performed in parallel by separate cores.

[0049] (Reference image generation unit 311) The reference image generation unit 311 generates a reference image by performing various processes on the original image regarding its position, resolution, color, etc. For example, the reference image generation unit 311 can extract positional information of the content portion from the original image and add or embed this positional information into the reference image so that the content portions of the reference image and the scanned image (inspection image) can be compared. In other words, the reference image generated by the reference image generation unit 311 has alignment information (also called alignment features) for aligning the reference image and the inspection image when performing image inspection based on the reference image. The alignment information includes image contour information and edge information. Furthermore, the reference image generated by the reference image generation unit 311 has area information regarding the inspection area and the area to be excluded from inspection, based on the inspection area specification information received by the inspection area reception unit 117 mentioned above. In addition, the reference image generation unit 311 can generate a reference image by adjusting the resolution of the original image to match the resolution of the image reading unit 33 (scanner). Furthermore, the reference image generation unit 311 can generate a reference image by converting the color space of the original image data to match the color space (for example, RGB) adopted by the image reading unit 33.

[0050] The reference image generation unit 311 does not use the original image as is for the following reasons. Ideally, the scanned image (inspection image) generated by reading the image formed on the paper is expected to match the original image in terms of content. However, when scanning the inspection image formed on the paper, errors may occur in the inspection image compared to the original image due to various factors such as variations in the paper transport path, deviations in the scanning position, color reproduction, and differences in paper type. Errors may also occur in the inspection image depending on the resolution of the scanner. Therefore, simply comparing the inspection image and the original image is likely to result in errors, and it is not practical to inspect the inspection image by simply comparing it with the original image. In this embodiment, the reference image generation unit 311 is configured to generate a reference image by applying various processing to the original image regarding position, resolution, color, etc., so that it can be compared with the inspection image, and then compare the reference image with the inspection image. This ensures that the comparison with the inspection image is performed appropriately, allowing for accurate inspection of printed materials.

[0051] (Image Inspection Department 312) The image inspection unit 312 performs image inspection based on a reference image. More specifically, the image inspection unit 312 acquires a reference image and a read image, and inspects the inspection image formed on the paper by comparing the reference image and the read image page by page.

[0052] Figure 3 is a schematic diagram illustrating the image inspection process. The image inspection unit 312 calculates, for example, the difference (error) in pixel values ​​between the reference image and the inspection image for each page, and determines whether the inspection image is good or bad according to the size of the difference. The difference calculation can be performed for each page, each object, or each region. For example, when the difference is calculated for each page, if the total difference of pixels within a page is less than a specified value, a "good" inspection result is output, and if the total difference is equal to or greater than the specified value, a "bad" inspection result is output. In addition, when the difference is calculated for each object or region, the system can be configured to output a "good" or "bad" inspection result according to the total difference of pixel values ​​within the selected object or region.

[0053] The control unit 31 determines that the printed material is good if the inspection result of the inspection image is "good," and determines that the printed material is defective if the inspection result of the inspection image is "poor." The determination result is sent to the main control unit 11.

[0054] (Purge device 40) The purging device 40 is provided with a branching section in the transport path, and is equipped with a main transport path leading to the post-processing device 50 and a sub-transport path leading to the purge tray (located on top of the purging device 40 in Figure 1). Paper that has been determined to be of poor quality by the inspection unit 30 is discharged to the purge tray, for example.

[0055] (Post-treatment device 50) The post-processing device 50 performs post-processing on or discharges paper sent from the upstream image forming apparatus 10, according to the settings of the print job. The post-processing device 50 comprises a paper output tray, a post-processing unit, and a transport path. The post-processing device 50 also comprises a control unit, a storage unit, a transport unit, and a communication unit (none of which are shown), which are interconnected via signal lines such as buses for exchanging signals. The post-processing unit performs at least one post-processing operation on the image-formed paper, including stapling, punching, cutting, folding, and binding.

[0056] (Data flow in the image inspection device 100) Figure 4 shows the image formation and image inspection processes in the image inspection apparatus 100 shown in Figure 2. This is a schematic diagram showing the flow of data.

[0057] The main control unit 11 acquires job settings (not shown) and the original image from the print controller 13. The original image is a RIP image obtained by rasterizing the print data. The original image is stored in page memory. The job settings include information such as inspection conditions and print settings. The inspection conditions include whether or not image inspection is performed, and if image inspection is performed, the type of first and second inspection mode is also included. Furthermore, in the second inspection mode, path information (file directory information) specifying the file of the registered reference image to be used is included. In the example in Figure 4, the first inspection mode is mainly selected as the job setting. Also, in the example in Figure 4, the original image is described as consisting of n print data from pages 1 to n.

[0058] In the first inspection mode, the main control unit 11 (data transmission unit 116) simultaneously transmits the original document image stored in the page memory to both the image forming unit 16 and the reference image generation unit 311.

[0059] The reference image generation unit 311 generates reference images 1 to n for pages 1 to n in order from the received original document images (pages 1 to n) and stores them in the storage unit 32.

[0060] As shown in Figure 4, x is a value that starts at 1 and increments up to page n. The image forming unit 16 forms images on the paper sequentially from page 1 to page n. x is the current page value.

[0061] The image reading unit 33 reads the transported paper (x pages) and generates a read image. The read image obtained is sent to the image inspection unit 312 via the page memory as the inspection image for page x. In addition, the reference image x for the corresponding page x is sent from the storage unit 32 via the page memory to the image inspection unit 312.

[0062] The image inspection unit 312 inspects the inspection image by comparing it with the acquired reference image. The control unit 31 (image inspection unit 312) then outputs the inspection result of the inspection image to the main control unit 11. In the example shown in Figure 4, the reference image generated by the reference image generation unit 311 is shown to be stored in the storage unit 32, but it may also be stored in the storage unit 12 of the image forming apparatus 10. Also, in Figures 2, 4, etc., the main control unit 11 and the control unit 31 are described as separate units, but they may be configured as a single unit. That is, the control unit 31 may be integrated into the main control unit 11.

[0063] Here, when the first reception unit accepts the request to execute the first inspection mode, the generation of the reference image by the reference image generation unit 311 and the formation of the image (inspection image) by the image formation unit 16 are executed in parallel. Figure 5 is a schematic diagram showing the processes of acquiring the original image, generating the reference image, forming the inspection image, and inspecting the inspection image in chronological order. Figure 5 shows the following processes from top to bottom. (Process 1) The main unit control unit 11 acquires the original image. (Process 2) Generation of a reference image by the reference image generation unit 311. (Process 3) Formation of an image of the object to be inspected by the image forming apparatus 10 (image forming unit 16). (Process 4) The image inspection unit 312 performs inspection using the inspection image and the reference image. Furthermore, Figure 5 shows the printing and inspection processes for a total of 8 pages of original images, assuming n=8. Note that for processes 3 and 4, the descriptions of the processes from page 3 and 4 onwards are omitted.

[0064] As shown in Figure 5, the reference image is generated by the reference image generation unit 311 and the image forming unit 16 The formation of the inspection images (image formation) is performed in parallel. Specifically, the generation process of reference images for pages 1 to 8 and the image formation by the image formation unit 16 are performed in parallel.

[0065] (Image examination method) The image inspection method according to this embodiment will be described below with reference to Figures 6A to 11.

[0066] First, the setting of inspection conditions for image inspection in this embodiment will be described. Figures 6A to 6G show the operation screens (operation screens s1 to s7) for setting the inspection conditions for image inspection and issuing execution instructions. Print settings other than the inspection conditions for print job job1, and the specification of the original image are performed using other operation screens (not shown). Operation screens s1 to s7 are displayed on the terminal device 80 or the operation panel 17 on which the printer driver is installed. On operation screens s1, s3, etc., the user can select either radio button b1 or b2. If the user selects b2, they can further select either b21 or b22.

[0067] (First Reception Desk) The first reception unit will be explained with reference to Figures 6A and 6B. Buttons b1 (and b3) on the operation screen s1 in Figure 6A correspond to the first reception unit. The user selects button b1 on the operation screen s1 and presses the job start button b3. As a result, the inspection execution instruction reception unit 115 of the image inspection device 100 receives an execution instruction from the image inspection unit 312 before the reference image generation by the reference image generation unit 311 is completed (first inspection mode). Upon receiving the execution instruction, the image inspection device 100 immediately performs image formation and inspection of the resulting image. The operation screen s2 shown in Figure 6B is displayed following the operation screen s1 in Figure 6A. When the user presses the job start button b3, the inspection execution instruction reception unit 115 receives an execution instruction for the first inspection mode. Accordingly, the operation screen s2 indicating that the first inspection mode has been received is displayed.

[0068] (Second reception desk) Referring to Figures 6C to 6E, the second reception unit (second reception unit 1) will be explained. Buttons b2 (and b21, and b5 (operation screen s4)) on the operation screen s3 in Figure 6C correspond to the second reception unit. The user selects button b2, then button b21, and presses the registration start button b4. As a result, the reference image generation unit 311 of the image inspection device 100 generates a new reference image based on the original image and registers the generated reference image in the storage unit 32, etc. After registration, the operation screen s4 in Figure 6D is displayed. The user presses the job start button b5 on the operation screen s4. As a result, the inspection execution instruction reception unit 115 of the image inspection device 100 receives an inspection execution instruction from the image inspection unit 312 after the reference image generation by the reference image generation unit 311 is completed. The operation screen s5 shown in Figure 6E is the screen that is displayed following the operation screen s4 in Figure 6D. When the inspection execution instruction receiving unit 115 receives an instruction to execute an inspection in the second inspection mode, the operation screen s5 is displayed.

[0069] Next, with reference to Figures 6F to 6G, another second reception unit (second reception unit 2) will be described. Buttons b2, b22, and b7 in the operation screen s7 of Figure 6G correspond to the second reception unit. The user selects buttons b2 and b22 on the operation screen s6 and then presses the selection button bb6. This causes a screen to pop up (not shown) where the user can specify the file path, and the user specifies a reference image file that was previously generated and registered. This reference image file is stored, for example, in the storage unit 32 (or storage unit 12). In the operation screen s7 of Figure 6G, the specified reference image (reference image path) is shown in the display field b60. The user presses the job start button b7 on the operation screen s7. This causes the inspection execution instruction reception unit 115 of the image inspection device 100 to receive an inspection execution instruction from the image inspection unit 312 after the reference image generation by the reference image generation unit 311 has completed. When the job start button b7 is pressed, the operation screen s5 is displayed, indicating that the instruction to execute the inspection in the second inspection mode has been received. Next, referring to Figures 7 to 9, the image inspection in accordance with the setting of inspection conditions and execution instructions for the image inspection received through the operation screens from Figures 6A to 6G will be explained.

[0070] (Image examination method) Figures 7 to 9 are flowcharts showing the image inspection method.

[0071] (Step S11) The image inspection device 100 receives a print job. The print job includes the original image (print data), job settings such as inspection conditions, etc. In the following explanation, the original image will be described as including image data for multiple pages, from 1 to n pages, as in the example in Figure 4.

[0072] (Step S12) The control unit 11 of the image inspection device 100 determines whether or not an inspection is set by referring to the inspection conditions described in the job settings. If the control unit 11 decides to perform the inspection (YES), it proceeds to step S13; if it decides not to perform the inspection (NO), it terminates the process (end). In this case, normal image forming is performed on the print job without image inspection, and the explanation is omitted.

[0073] (Step S13) The control unit 11 of the image inspection device 100 makes a determination regarding the received reception unit. If the first reception unit receives an inspection execution instruction, the process proceeds to Figure 8 (indicated by the circled "A" in the figure). On the other hand, if the second reception unit receives an inspection execution instruction, the process proceeds to Figure 9 (indicated by the circled "B" in the figure). The inspection execution instruction received by the first reception unit is the execution instruction received on the operation screen s1 in Figure 6A, as described above, and is the first inspection mode. The inspection execution instruction received by the second reception unit is the execution instruction received on the operation screens s3 and s4 in Figures 6C to 6D, or on the operation screens s6 and s7 in Figures 6F to 6G, as described above, and is the second inspection mode.

[0074] Refer to Figure 8. In Figure 8 (and similarly in Figure 9), the processes enclosed by the dashed line on the left are processes performed on the image forming apparatus 10 side, and the processes enclosed by the dashed line on the right are processes performed on the inspection unit 30 side. The processes on the image forming apparatus 10 side in steps S21 to S23 and the processes on the inspection unit side in steps S24 to S26 may be performed in parallel. That is, image formation by the image forming unit 16 and the generation of the reference image by the reference image generation unit 311 are performed simultaneously. For example, as shown in Figure 5, the generation of the reference images for pages 3 and 4 is performed by the reference image generation unit 311 in parallel with the formation of the inspection image for page 1 by the image forming unit 16. Also, the processes in step S25 and steps S27 and S28 may be performed in parallel. For example, as shown in Figure 5, in step S25, the reference image generation unit 311 generates the reference image for page 5, and at the same time, in step S27, the paper to be inspected is read, and in step S28, the inspection image is inspected by the image inspection unit 312.

[0075] (Step S21) The image forming unit 16 of the image forming apparatus 10 receives original images (1 to n).

[0076] (Step S22) The image forming unit 16 forms an image on the paper based on the original image. x is a value that starts at 1 and increments up to page n. The image forming unit 16 forms images on the paper sequentially from page 1 to page n. x is the current page value. The control unit 11 (or control unit 31) may also configure the image forming unit 16 to perform image formation after generating reference images for all pages (pages 1 to n).

[0077] (Step S23) The image forming apparatus 10 forms an image on a sheet of paper and then transports the image-formed paper to the inspection unit 30.

[0078] (Step S24) The inspection unit 30 receives the document image. The control unit 31 stores the received document image in the page memory or storage unit 32.

[0079] (Step S25) The reference image generation unit 311 generates a reference image based on the original image. Figure 10 is a subroutine flowchart showing the reference image generation process.

[0080] (Step S601) The reference image generation unit 311 reads out the original image stored in the page memory or storage unit 32.

[0081] (Step S602) The reference image generation unit 311 performs resolution conversion and color gamut conversion processing on the original image to obtain converted image data (a temporary reference image). This image data becomes the reference image after processing in steps S603 to S605 below.

[0082] (Step S603) The reference image generation unit 311 proceeds to step S603 if inspection area specification information is available (YES), and skips step S603 if it is not available (NO). Thus, inspection area specification information is not necessarily used in all image inspections and may be omitted. Inspection area specification information is included in the inspection condition information. As mentioned above, inspection area specification information includes the specification of the inspection area and the specification of areas to be excluded from inspection.

[0083] (Step S604) The reference image generation unit 311 sets the inspection area specification information in the reference image.

[0084] (Step S605) The reference image generation unit 311 extracts alignment features from the reference image. These alignment features include image contour information and edge information. This completes the process shown in Figure 10, and the process returns to its original state (return).

[0085] (Step S26) Refer to Figure 8 again. Here, if not all pages have been completed, the control unit 31 increments x and performs the process of step S25 for the next page. On the other hand, if all pages have been completed (YES), that is, if the generation of reference images up to the nth page (x=n) has been completed, the process proceeds to the next step S27. As described above, it is also possible to perform the process of step S25 in parallel with the processes of steps S27 and S28.

[0086] (Step S27) The image reading unit 33 of the inspection unit 30 reads the paper to be inspected (page x) transported from the image forming apparatus 10 and generates a read image. This read image is used as the inspection image.

[0087] (Step S28) The image inspection unit 312 performs an inspection on the x-th page inspection image that was read and generated in step S27. Figure 11 is a subroutine flowchart showing the image inspection process.

[0088] (Step S701) The image inspection unit 312 reads the reference image of page x stored in the storage unit 32 or page memory.

[0089] (Step S702) The image inspection unit 312 aligns the reference image on page x with the inspection image on the same page x generated in step S27. The alignment is performed by associating (matching) the features of the reference image extracted in step S604 with the features of the inspection image. Based on the feature matching, the image inspection unit 312 aligns the two images by coordinate transformation or coordinate shift.

[0090] (Steps S703, S704) The image inspection unit 312 takes the difference between the corresponding pixel values ​​of the reference image after alignment and the inspection image, and determines whether the inspection image is good or bad according to the size of the difference. With this, the process in Figure 11 is completed and the system returns to the original process (return).

[0091] (Step S29) Refer to Figure 8 again. Here, the image inspection device 100 increments x if not all pages have been completed and repeats the process from step S22 onwards. On the other hand, if all pages have been completed (YES), that is, if the inspection up to page n (x=n) has been completed, the process ends (END). This completes the image inspection process in the first inspection mode. Next, refer to Figure 9 and we will explain the second inspection mode.

[0092] (Second inspection mode) Figure 9 is a flowchart showing the second inspection mode, which follows Figure 7. The second inspection mode shown in Figure 9 is described as having received an execution instruction from the second reception unit (second reception unit 1) as explained in Figures 6C to 6E. In other words, in Figure 9, which will be explained below, a new reference image is registered, and then an image inspection is performed using this image.

[0093] (Steps S41, S42) The inspection unit 30 receives the document image. The control unit 31 stores the received document image in the storage unit 32.

[0094] (Steps S43, S44) The reference image generation unit 311 generates a reference image based on the original image. The processing here is the same as in steps S25 and S26, and the reference image is generated according to the subroutine flowchart shown in Figure 10. When the generation of the reference image is complete, the inspection execution instruction reception unit 115 displays an operation screen s4 as shown in Figure 6D. Alternatively, instead of the operation screen s4, the generated reference image may be selected and specified from the button b22 on the operation screen s3 in Figure 6C.

[0095] (Step S45) The inspection execution instruction receiving unit 115 proceeds to step S46 if it receives an instruction to start the image inspection (YES). Here, the instruction to start the execution is when the user presses the job start button b5 on the operation screen s4. This is the execution of the image inspection by the image inspection unit 312 after the reference image generation by the reference image generation unit 311 is completed by the second receiving unit. This corresponds to receiving instructions.

[0096] (Steps S46-S48) The process of transporting the image-formed paper from the image forming apparatus 10 to the inspection unit 30 is the same as steps S21 to S23 in Figure 8, and therefore the explanation is omitted.

[0097] (Steps S49-S51) The image inspection processing performed by the inspection unit 30 here is the same as the processing in steps S27 to S29 of Figure 8, and therefore the explanation is omitted.

[0098] As described above, the image inspection apparatus according to this embodiment includes a reference image generation unit that generates a reference image used for inspecting an image formed on a recording medium, and an image inspection unit that inspects the image formed on the recording medium based on the reference image. The image inspection apparatus also includes a first reception unit that receives an instruction to execute an inspection by the image inspection unit before the reference image generation by the reference image generation unit is completed. This shortens the processing time from reference image generation to image inspection. Furthermore, in the first reception unit, as shown in Figure 6A, for example, simply receiving a job execution start operation (button b3) immediately starts the image inspection, eliminating the need for complicated operations by the user. In addition, the second reception unit can receive an instruction to execute an inspection by the image inspection unit based on the reference image after the reference image generation by the reference image generation unit, thereby enabling inspection using (reusing) registered reference images.

[0099] The configuration of the inspection unit 30 and the image inspection apparatus 100 equipped therewith described above is described as the main configuration in order to explain the features of the above embodiment, and is not limited to the above configuration, and can be modified in various ways within the scope of the claims. Furthermore, it does not exclude the configurations that are generally found in image forming apparatuses. The scope of the present invention should be interpreted in accordance with the attached claims.

[0100] (modified version) As shown in Figure 8, in the image inspection apparatus 100 according to the first embodiment, when the first reception unit receives an instruction to perform an image inspection, the data transmission unit 116 immediately transmits the original image to the image forming unit 16 and the reference image generation unit 311. In response, the image forming unit 16 immediately starts image formation, and the reference image generation unit 311 starts generating a reference image (see Figure 5). However, this is not limited to this. The main control unit 11 may also configure the image forming unit 16 to start image formation after the reference image generation unit 311 has completed generating reference images for all pages (pages 1 to n).

[0101] Furthermore, the image inspection device 100 may include a terminal device 80 equipped with a display unit. This terminal device 80 is provided with an inspection execution instruction receiving unit 115 (first and second receiving units), which receives inspection execution instructions via operation screens s1, s3, etc., displayed on the display unit.

[0102] Furthermore, the means and methods for performing various processing in the inspection unit 30 and image inspection apparatus 100 according to the above-described embodiment can be implemented by either a dedicated hardware circuit or a programmed computer. The program may be provided, for example, on a computer-readable recording medium such as a USB memory or DVD (Digital Versatile Disc)-ROM, or it may be provided online via a network such as the Internet. In this case, the program recorded on the computer-readable recording medium is usually transferred to and stored in a storage unit such as a hard disk. The program may also be provided as a standalone application software, or it may be incorporated into the software of the device as a function of the device. [Explanation of symbols]

[0103] 1000 Printing Systems 100 Image inspection devices 10 Image forming apparatus 11 Main Unit Control 111 Printer Control Unit 112 Inspection Unit Control Unit 113 Other device control unit 115 Inspection Execution Instruction Reception Department 116 Data transmission unit 117 Inspection Area Reception Department 12 Storage section 13 Print Controller 14 Paper feed section 15 Conveying section 16 Image forming unit 17. Control Panel 19 Communications Department 20 Paper feeder 30 Inspection Units 31 Control Unit 311 Reference Image Generation Unit 312 Imaging Inspection Department 32 Storage section 33 Image reading unit 34 Conveying section 39 Communications Department 40. Purge device 50 Post-processing equipment

Claims

1. A reference image generation unit that generates a reference image used for inspecting an image formed on a recording medium, An image inspection unit that inspects the image formed on the recording medium based on the aforementioned reference image, A first reception unit receives an instruction from the image inspection unit to perform an inspection before the reference image generation unit completes, After the reference image generation unit generates a reference image, a second reception unit receives an instruction to perform an inspection by the image inspection unit based on the reference image, The acquisition unit acquires the original image, An image forming unit that forms an image on the recording medium based on the original image, The system includes a control unit that, when the execution instruction is received by the first receiving unit, controls the transmission of the acquired original image to the reference image generation unit and the image forming unit, An image inspection apparatus in which, based on the reception of the original image, the generation of the reference image by the reference image generation unit and the formation of the image on the recording medium by the image forming unit are performed in parallel.

2. The image inspection apparatus according to claim 1, wherein the first receiving unit receives an instruction from the image inspection unit to perform an inspection before or during the generation of the reference image by the reference image generation unit.

3. The image inspection apparatus according to claim 1 or 2, wherein, when the execution instruction is received by the second receiving unit, the image is formed on the recording medium by the image forming unit after the reference image is generated by the reference image generation unit.

4. The control unit, when it receives the execution instruction, controls the transmission of the acquired original image to the image forming unit. The image inspection apparatus according to claim 1 or 2.

5. The acquisition step for obtaining the original image, An image forming step in which an image is formed on a recording medium based on the original image by an image forming unit, A reference image generation step in which a reference image generation unit generates a reference image to be used for inspecting the image formed on the recording medium, An image inspection step of inspecting an image formed on the recording medium based on the aforementioned reference image, A first reception step that receives an instruction to perform the inspection in the image inspection step before the generation of the reference image in the reference image generation step is completed, After the generation of the reference image in the reference image generation step, a second reception step receives an instruction to perform the inspection in the image inspection step based on the reference image, The first transmission step includes transmitting the acquired original image to the reference image generation unit and the image forming unit when the execution instruction is received in the first reception step, An image inspection method comprising the following steps performed in parallel based on the reception of the original image by the first transmission step: generation of the reference image by the reference image generation unit in the reference image generation step and formation of the image on the recording medium by the image forming unit in the image forming step.

6. The second transmission step includes transmitting the acquired original image to the image forming unit when the execution instruction is received in the second reception step, The image according to claim 5, wherein, after the reference image is generated by the reference image generation unit in the reference image generation step, the image is formed on the recording medium by the image forming unit in the image forming step based on the reception of the original image by the second transmission step. Testing method.

7. The acquisition step for obtaining the original image, An image forming step in which an image is formed on a recording medium based on the original image by an image forming unit, A reference image generation step in which a reference image generation unit generates a reference image to be used for inspecting the image formed on the recording medium, An image inspection step of inspecting an image formed on the recording medium based on the aforementioned reference image, A first reception step that receives an instruction to perform the inspection in the image inspection step before the generation of the reference image in the reference image generation step is completed, After the generation of the reference image in the reference image generation step, a second reception step receives an instruction to perform the inspection in the image inspection step based on the reference image, The first transmission step includes transmitting the acquired original image to the reference image generation unit and the image forming unit when the execution instruction is received in the first reception step, An image inspection program for causing a computer to perform processing, wherein, based on the reception of the original image by the first transmission step, the generation of the reference image by the reference image generation unit in the reference image generation step and the formation of the image on the recording medium by the image forming unit in the image forming step are performed in parallel.

8. The second transmission step includes transmitting the acquired original image to the image forming unit when the execution instruction is received in the second reception step, The image inspection program according to claim 7, wherein, after the reference image is generated by the reference image generation unit in the reference image generation step, the image is formed on the recording medium by the image forming unit in the image forming step based on the reception of the original image in the second transmission step.

Images