Image inspection apparatus, image inspection method, and image inspection program

Abstract

To shorten time required for processing from generation of a reference image to image inspection.SOLUTION PART: An image inspection device 100 includes: a reference image generation unit 311 that generates a reference image used for inspection of an image formed on a recording medium; an image inspection unit 312 that inspects the image formed on the recording medium based on the reference image; and a first reception unit 115 that receives an execution instruction of the inspection by the image inspection unit before generation of the reference image by the reference image generation unit is completed.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present invention relates to an image inspection apparatus, an image inspection method, and an image inspection program.

Background Art

[0002] Conventionally, the quality of a printed matter has been inspected by comparing a previously registered reference image with an inspection image obtained by reading the printed matter to be inspected. For example, in Patent Document 1, as the reference image, in the case of the proof mode for confirming the finished product, image data derived from the original image used for printing is used, and in the subsequent actual printing, in the proof mode, when reading a printed matter confirmed by the user to have no abnormality visually, the read image data obtained is used.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the technique of Patent Document 1, the user's process for generating the reference image used for actual printing is complicated, and it is necessary to execute the actual printing after preparing the reference image through the proof mode in advance.

[0005] The present invention has been made in view of the above circumstances, and an object thereof is to provide an image inspection apparatus, an image inspection method, and an image inspection program capable of further shortening the time required for processing from the generation of a reference image to image inspection as compared with the prior art.

Means for Solving the Problems

[0006] The above object of the present invention is achieved by the following means.

[0007] (1) A reference image generation unit that generates a reference image for inspecting an image formed on a recording medium, An image inspection unit that inspects an image formed on the recording medium based on the reference image, A first reception unit that receives an instruction to execute an inspection by the image inspection unit before the generation of the reference image by the reference image generation unit is completed, An image inspection apparatus having the above.

[0008] (2) The first reception unit of the image inspection apparatus according to (1) above, which receives an instruction to execute an inspection by the image inspection unit before or during the generation of the reference image by the reference image generation unit.

[0009] (3) The image inspection apparatus according to (1) or (2) above, further comprising a second reception unit that receives an instruction to execute an inspection by the image inspection unit based on the reference image after the generation of the reference image by the reference image generation unit.

[0010] (4) An image forming unit that forms an image on the recording medium based on a document image, A control unit that controls to transmit the document image to the reference image generation unit and the image forming unit based on receiving the execution instruction by the first reception unit, The image inspection apparatus according to (1) or (2) above, further having the above.

[0011] (5) The control unit of the image inspection apparatus according to (4) above causes the generation of the reference image by the reference image generation unit and the formation of the image on the recording medium by the image forming unit to be performed in parallel.

[0012] (6) The control unit of the image inspection apparatus according to (4) above causes the image forming unit to form the image on the recording medium after the generation of the reference image by the reference image generation unit.

[0013] (7) An image forming unit that forms an image on the recording medium based on a document image, A control unit that controls to transmit the original image to the image forming unit based on receiving the execution instruction by the second reception unit. The image inspection apparatus according to (3) above.

[0014] (8) A reference image generation step of generating a reference image for inspecting an image formed on a recording medium. An image inspection step of inspecting an image formed on the recording medium based on the reference image. A first reception step of receiving an execution instruction for inspection in the image inspection step before the generation of the reference image in the reference image generation step is completed. An image inspection method including the above.

[0015] (9) A reference image generation step of generating a reference image for inspecting an image formed on a recording medium. An image inspection step of inspecting an image formed on the recording medium based on the reference image. A first reception step of receiving an execution instruction for inspection in the image inspection step before the generation of the reference image in the reference image generation step is completed. An image inspection program for causing a computer to execute a process including the above.

Advantages of the Invention

[0016] The image inspection apparatus according to the present invention includes a reference image generation unit that generates a reference image for inspecting an image formed on a recording medium, an image inspection unit that inspects the image formed on the recording medium based on the reference image, and a first reception unit that receives an execution instruction for inspection by the image inspection unit before the generation of the reference image by the reference image generation unit is completed. By doing so, the time required for the process from the generation of the reference image to the image inspection can be shortened.

Brief Description of the Drawings

[0017]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6A

Figure 6B

Figure 6C

Figure 6D

Figure 6E

Figure 6F

Figure 6G

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Mode for Carrying Out the Invention

[0018] Hereinafter, embodiments of the present invention will be described with reference to the attached drawings. However, the scope of the present invention is not limited to the disclosed embodiments. In the description of the drawings, the same reference numerals are assigned to the same elements, and duplicate descriptions are omitted. The advantages and features provided by one or more embodiments of the present invention will be fully understood from the following detailed description and the attached drawings. Also, the attached drawings are provided for illustrative purposes only and are not intended to define the scope of the present invention.

[0019] FIG. 1 is a diagram showing a schematic configuration of an image inspection apparatus 100 according to a first embodiment and a printing system 1000 including the same. FIG. 2 is a block diagram showing a hardware configuration of the image inspection apparatus 100. As shown in FIG. 1, the printing system 1000 includes terminal devices 80 and one or more image inspection apparatuses 100, which are communicatively connected by a network 90.

[0020] The terminal device 80 can be, for example, a personal computer, a tablet terminal, a smartphone, or the like. A printer driver for converting original data into a print job is installed in the terminal device 80. The terminal device 80 is used by a user such as an operator who operates the image inspection apparatus 100. The printer driver generates a print job in a format that can be handled by the print controller 13 (see FIG. 2 described later) of the image inspection apparatus 100 according to a user's instruction, and transmits the print job to the image inspection apparatus 100 through the network 90. Further, the terminal device 80 is provided with a display and can display inspection results (inspection results) (good / defective) of printed matter, images of defective printed matter, and the like.

[0021] A print job includes, for example, print data in the form of PDL (Page Description Language) (hereinafter also referred to as manuscript image data or a manuscript image), and job setting information (hereinafter referred to as a job setting). The manuscript image includes, for example, a manuscript image composed of the first to the nth pages. The job setting includes, for example, print settings such as the number of pages, the number of copies, the type, size, basis weight of the paper (recording medium), single-sided printing / double-sided printing, etc. The job setting also includes inspection conditions. The inspection conditions include the presence or absence of image inspection (inspection setting on / off), and when the image inspection is "present", further include the types of the first and second inspection modes. Further, the inspection conditions may include inspection area designation information (described later). Further, in the second inspection mode, path information (file directory information) for designating a file of a registered reference image to be used is included. By setting the inspection to be "present" (turning on the inspection setting), the user can give an instruction for image inspection to the printing system 1000. The inspection conditions can be set by an operation screen (for example, FIG. 6A described later) displayed by a printer driver.

[0022] (Image inspection device 100) The image inspection device 100 is also referred to as an image forming system. The image inspection device 100 includes an image forming device 10, a paper feeding device 20, an inspection unit 30, a purge device 40, and a post-processing device 50 that are mechanically and electrically connected to each other.

[0023] (Overview of inspection unit 30) Although the details of the inspection unit 30 will be described later, the inspection unit 30 has a reference image generation unit 311 that generates a reference image used for inspecting an image formed on a recording medium (paper). The reference image generation unit 311 generates a reference image based on the manuscript image. Further, the inspection unit 30 has an image inspection unit 312 that inspects an image formed on the paper based on the reference image. The image forming device 10 (image forming unit 16) forms an image on the paper based on the manuscript image. The image inspection unit 312 inspects the image on the paper by comparing an inspection image obtained by reading the image on the paper based on the manuscript image with a reference image generated based on the same manuscript image.

[0024] (Image forming apparatus 10) The image forming apparatus 10 performs image formation on the paper fed from the paper feeding apparatus 20 on the upstream side and conveyed. Also, the image forming apparatus 10 performs image formation on the paper fed from the paper feeding unit 14 of its own apparatus.

[0025] As shown in FIG. 2, the image forming apparatus 10 includes a main body control unit 11, a storage unit 12, a print controller 13, a paper feeding unit 14, a conveyance unit 15, an image forming unit 16, an operation panel 17, and a communication unit 19. These components are interconnected via signal lines such as a bus for signal exchange. In FIG. 2, the connection lines to some components such as the storage unit 12 and the print controller 13 in the image forming apparatus 10 are omitted. Similarly, in the inspection unit 30, the connection lines between some components are omitted.

[0026] (Main body control unit 11) The main body control unit 11 is composed of a CPU, a ROM, a RAM, etc., and executes various processes by executing the programs stored in the ROM and the storage unit 12 described later, and performs control of each part of the apparatus and various arithmetic processes according to the programs. The main body control unit 11 functions as a printer control unit 111, an inspection unit control unit 112, an other apparatus control unit 113, an inspection execution instruction reception unit 115, a data transmission unit 116, and an inspection area reception unit 117. The details of each sub-function will be described later. The main body control unit 11 cooperates with the control unit 31 etc. of the inspection unit 30 to control the entire image inspection apparatus 100.

[0027] (Storage unit 12) The storage unit 12 consists of an auxiliary storage unit such as a hard disk that stores various programs and various data in advance. Also, the storage unit 12 functions as a page memory (the same applies to the storage unit 32 described later).

[0028] (Print controller 13) The print controller 13 analyzes the print job received from the terminal device 80 through the network 90, executes processes such as color conversion, screening, and rasterization, and generates a manuscript image in bitmap format. The generated manuscript image is transmitted to the control unit 31. The print controller 13 functions as a manuscript image acquisition unit.

[0029] The print controller 13 receives a print job from the terminal device 80 etc. via the communication unit 19. The received print job includes print data (mainly in PDL format) that is the source of the manuscript image (also referred to as manuscript image data), and job information describing print settings such as the type of paper to be used. The print controller 13 performs rasterization (RIP) processing to convert the print data into page - unit bitmap data based on the print settings. The RIP image after the rasterization processing is temporarily stored in the image memory inside the print controller 13. The RIP image on the image memory is temporarily stored in the compressed memory area of the page memory of the storage unit 12. During normal printing, the RIP image stored in the compressed memory area is decompressed by the compression - decompression IC and sent to the image forming unit 16 as a manuscript image via the writing processing unit, and printing is executed.

[0030] (Paper feeding unit 14, conveying unit 15) The paper feeding unit 14 includes a plurality of paper feeding trays. The conveying unit 15 includes a conveying path. This conveying path includes a plurality of pairs of conveying rollers provided along the conveying path, and a drive motor (not shown) for driving these pairs of conveying rollers. The paper feeding unit 14 includes a feeding roller that feeds out the uppermost sheet among the plurality of sheets stacked and placed in the paper feeding tray, and feeds out the sheets in the paper feeding tray one by one to the downstream conveying path.

[0031] (Image forming unit 16) The image forming unit 16 forms an image by, for example, an electrophotographic method. The image forming unit 16 includes a writing unit (laser exposure unit) corresponding to each of the basic colors of Y (yellow), M (magenta), C (cyan), and K (black), a photosensitive drum, and a developing device that stores a two-component developer composed of toner and carrier for each color, and the like. Further, the image forming unit 16 further includes an intermediate transfer belt, a secondary transfer unit, and a fixing unit. The toner images formed on the photosensitive drum by the developing devices of the respective colors are superimposed on the intermediate transfer belt and transferred to the paper conveyed in the secondary transfer unit. The toner image on the paper is fixed to the paper by being heated and pressed by the fixing unit on the downstream side.

[0032] (Operation panel 17) The operation panel 17 includes a touch screen, numeric keys, a start button, a stop button, and the like. The operation panel 17 displays the state of the image forming apparatus 10 or the image inspection apparatus 100 and is used for inputting various settings and instructions from the user. Further, the inspection result by the inspection unit 30 is displayed, and the setting of the inspection conditions and the input of the execution instruction are received.

[0033] (Communication unit 19) The communication unit 19 is an interface for communicating with each device such as a PC on the network or other devices 20, 30, etc.

[0034] (Sub-functions 111 to 117) (Printer control unit 111) When a print job is input, the printer control unit 111 executes the print job based on the print job settings of the input print job. The print job is input by an instruction sent from the operation panel 17 or a terminal device 80 such as a network-connected PC operated by the user. Further, the job settings include print settings and inspection conditions. The print settings include double-sided / single-sided, print paper type, post-processing conditions, and the like. Details of the inspection conditions will be described later. For example, they are set by an operation screen such as FIG. 6A described later.

[0035] The printer control unit 111 controls the paper feeding and conveyance of the paper by controlling the paper feeding unit 14 and the conveyance unit 15. Further, the printer control unit 111 controls the image forming unit 16 to form an image on the paper under the set image forming conditions.

[0036] The inspection unit control unit 112 controls the inspection unit 30 in response to an execution instruction request (inspection instruction) from the printer control unit 111.

[0037] The other device control unit 113 controls the paper feeding device 20, the purge device 40, and the post-processing device 50. Specifically, the other device control unit 113 communicates with the paper feeding device 20 to transmit and receive the paper feeding tray to be used, the paper conveyance timing, etc. The other device control unit 113 transmits the paper conveyance timing, the main and sub-conveyance paths of the paper to be conveyed, and the setting information of the post-processing to the post-processing device 50, etc.

[0038] (Inspection execution instruction reception unit 115) The inspection execution instruction reception unit 115 functions as a first reception unit and a second reception unit. Examples of the first and second reception units will be described later (FIG. 4A, etc.).

[0039] The "first reception unit" receives an inspection execution instruction in the first inspection mode. That is, the first reception unit receives an execution instruction from the image inspection unit 312 before the generation of the reference image by the reference image generation unit 311 is completed. Also, the first reception unit, before the generation of the reference image is completed, receives an execution instruction for image inspection from the image inspection unit 312 before the generation of the reference image (before the start of generation) or during the generation. By receiving the execution instruction, image formation and inspection of the image generated thereby are performed. It can also be said that in the first inspection mode, it is possible to receive an execution instruction for inspection before the generation of the reference image is completed. In the first inspection mode, in parallel with the image formation process of the inspection target image on the paper by the image formation unit 16 based on the manuscript image, the reference image generation process by the reference image generation unit 311 based on the same manuscript image is executed. The fact that the first reception unit receives an execution instruction for image inspection from the image inspection unit 312 "during the generation" of the reference image means, for example, that an execution instruction for image inspection of the next job may be received during the generation of the reference image of the previous job.

[0040] The "second reception unit" receives an inspection execution instruction in the second inspection mode. That is, the second reception unit receives an execution instruction for image inspection from the image inspection unit 312 after the generation of the reference image by the reference image generation unit 311 is completed. By receiving the execution instruction, image formation and inspection of the image generated thereby are performed. It can also be said that in the second inspection mode, it is possible to receive an execution instruction for inspection after the reference image generation process is completed. In the second inspection mode, the reference image generation process by the reference image generation unit 311 is executed based on the manuscript image, and then the inspection is performed by receiving an execution instruction using this. Or, in the second inspection mode, an inspection using a previously registered reference image is executed. The latter includes both the case of newly generating and registering a reference image for inspection and the case of reusing a previously registered reference image.

[0041] (Data transmission unit 116) The data transmission unit 116 transmits the original image to the image forming unit 16 and the inspection unit 30 (particularly the reference image generation unit 311). In particular, the data transmission unit 116 transmits the original image to the image forming unit 16 and the inspection unit 30 (particularly the reference image generation unit 311) in response to receiving the execution of the first inspection mode by the first reception unit. For example, in response to receiving the execution of the first inspection mode by the first reception unit, the data transmission unit 116 immediately transmits the original image to both the image forming unit 16 and the reference image generation unit 311 simultaneously. Also, the data transmission unit 116 transmits the original image to the image forming unit 16 in response to receiving the execution of the first inspection mode by the first reception unit. Further, the data transmission unit 116 transmits the original image to the image forming unit 16 in response to receiving the execution of the second inspection mode by the second reception unit.

[0042] (Inspection area reception unit 117) The inspection area reception unit 117 receives (a) the designation of an inspection exclusion area and (b) the designation of an inspection area (hereinafter, these are collectively referred to as "inspection area designation information"). Also, the inspection area reception unit 117 transmits the received inspection area designation information to the reference image generation unit 311. The inspection area designation information is described by the target area range (XY coordinate positions along the main scanning direction (X direction) and the sub-scanning direction (Y direction)) and its content. The area range is, for example, a rectangular area. The area designated as (a) the inspection exclusion area is excluded from the inspection target. The area designated as (b) the inspection area is the inspection target. In the area designated as the inspection area, it is also possible to perform an inspection different from normal. For example, if the original image includes an image of a face photo, in the area including the human skin of the face, the color inspection level is set strictly. Also, in the designation of the inspection area, there is a barcode designation. The original image may include a barcode (1-dimensional, 2-dimensional). In this case, in the inspection area where the barcode is designated, by decoding the image within the inspection area, it is inspected whether the barcode is printed correctly.

[0043] (Paper feeding device 20) The paper feeding device 20 shown in FIGS. 1 and 2 includes a paper feeding unit and a conveying unit similar to those of the image forming apparatus 10. Further, the paper feeding device 20 includes, in addition to the conveying unit and the paper feeding unit, a control unit, a storage unit, and a communication unit (none of which are shown), and these are interconnected via signal lines such as a bus for signal exchange.

[0044] (Inspection unit 30) Next, the inspection unit 30 will be described. As shown in FIG. 2, the inspection unit 30 includes a control unit 31, a storage unit 32, an image reading unit 33, a conveying unit 34, a communication unit 39, etc. Each of the control unit 31, the storage unit 32, the conveying unit 34, and the communication unit 39 has the same hardware configuration as the main body control unit 11, the storage unit 12, the conveying unit 15, and the communication unit 19 of the above-described image forming apparatus 10, and the description thereof will be omitted.

[0045] The image reading unit 33 reads a sheet (printed matter) conveyed on the conveyance path, for example, by a CCD (Charge Coupled Device) image sensor. The control unit 31 controls the scanner to read an image (inspection image) formed on the sheet conveyed from the image forming apparatus 10 in accordance with a reading instruction from the inspection unit control unit 112. Further, the control unit 31 performs various processes such as analog processing, A / D conversion processing, and shading processing on the analog image signal output from the image reading unit 33 to generate digital image (read image) data.

[0046] (Control unit 31) The control unit 31 functions as a reference image generation unit 311 and an image inspection unit 312.

[0047] The reference image generation unit 311 generates a reference image by performing the following various processes based on the original image acquired by the image forming apparatus 10 (particularly the print controller 13).

[0048] The reference image generation unit 311 and the image inspection unit 312 may each be configured with an independent CPU so that their respective reference image generation processes and image inspection processes can be performed in parallel. That is, the control unit 31 is composed of a plurality of CPUs. Alternatively, a multi-core CPU is applied as the CPU of the control unit 31. In the case of a multi-core CPU, the reference image generation unit 311 is allocated to a core different from the process of forming and inspecting the inspection image of the image inspection unit 312, and the generation of the reference image and the formation and inspection of the inspection image can be executed in parallel by different cores.

[0049] (Reference image generation unit 311) The reference image generation unit 311 performs various processes on the manuscript image regarding position, resolution, color, etc. to generate a reference image. For example, the reference image generation unit 311 can extract the position information of the content part from the manuscript image and add or embed the position information into the reference image so that the content parts (contents) of the reference image and the read image (inspection image) can be compared with each other. That is, the reference image generated by the reference image generation unit 311 has alignment information (also referred to as alignment feature amounts) for aligning the reference image and the inspection image when performing image inspection based on the reference image. Note that the alignment information includes contour information and edge information of the image. In addition, the reference image generated by the reference image generation unit 311 has region information regarding the inspection region and the inspection exclusion region based on the inspection region designation information received by the above-described inspection region reception unit 117. Furthermore, the reference image generation unit 311 can generate a reference image by adjusting the resolution of the manuscript image to match the resolution of the image reading unit 33 (scanner). Also, the reference image generation unit 311 can generate a reference image by converting the color space of the manuscript image data to match the color space (e.g., RGB) adopted by the image reading unit 33.

[0050] The reason why the reference image generation unit 311 does not use the original image as it is is as follows. Ideally, the read image (inspection image) generated by reading the image formed on the paper is considered to match the original image in terms of content. However, when reading the inspection image formed on the paper by a scanner, errors may occur in the inspection image with respect to the original image due to various factors such as variations in the paper conveyance path, misalignment of the reading position by the scanner, color reproducibility, and differences in paper types. Also, errors may occur in the original image depending on the resolution of the scanner reading. Therefore, there is a high possibility of errors if the inspection image and the original image are simply compared, and it is not practical to inspect the inspection image by simply comparing it with the original image. Thus, in this embodiment, the reference image generation unit 311 is configured to generate a reference image by performing various processes on the original image with respect to position, resolution, color, etc. so that it can be compared with the inspection image, and to compare the reference image with the inspection image. Thereby, since the comparison with the inspection image is appropriately performed, the inspection of the printed matter can be carried out with high accuracy.

[0051] (Image inspection unit 312) The image inspection unit 312 performs image inspection based on the reference image. More specifically, the image inspection unit 312 acquires the reference image and the read image, and inspects the inspection image formed on the paper by comparing the reference image and the read image page by page.

[0052] FIG. 3 is a schematic diagram for explaining the process of image inspection. The image inspection unit 312, for example, calculates the difference (error) in pixel values between the reference image and the inspection image page by page, and determines the quality of the inspection image according to the magnitude of the difference. The calculation of the difference can be performed page by page, object by object, or region by region. For example, when calculating the difference page by page, if the total value of the differences of the pixels within one page is less than a specified value, a "good" inspection result is output, and if the total value of the differences is greater than or equal to the specified value, a "bad" inspection result is output. Also, when calculating the difference object by object or region by region, it can be configured to output a "good" or "bad" inspection result according to the total value of the differences of the pixel values within the selected object or region.

[0053] When the inspection result of the inspection image is "good", the control unit 31 determines that the printed matter is a good product. When the inspection result of the inspection image is "bad", the control unit 31 determines that the printed matter is a defective product. The determination result is sent to the main control unit 11.

[0054] (Purge device 40) The purge device 40 is provided with a branch portion of the conveyance path, and a main conveyance path leading to the post-processing device 50 and a sub-conveyance path leading to a purge tray (disposed above the purge device 40 in FIG. 1) are provided. For example, sheets determined to be of poor quality in the inspection by the inspection unit 30 are discharged to the purge tray.

[0055] (Post-processing device 50) The post-processing device 50 performs post-processing on or discharges the sheets sent from the upstream image forming device 10 according to the settings of the print job. The post-processing device 50 includes a paper discharge tray, a post-processing unit, and a conveyance path. The post-processing device 50 also includes a control unit, a storage unit, a conveyance unit, and a communication unit (none of which are shown), and these are interconnected via signal lines such as a bus for signal exchange. The post-processing unit performs at least one post-processing of staple processing, punching processing, cutting processing, folding processing, and bookbinding processing on the image-formed sheets.

[0056] (Flow of each data in the image inspection device 100) FIG. 4 is a schematic diagram showing the flow of data in the processes of image formation and image inspection in the image inspection device 100 shown in FIG. 2.

[0057] The main control unit 11 acquires job settings (not shown) and a manuscript image from the print controller 13. The manuscript image is a RIP image obtained by rasterizing print data. The manuscript image is stored in the page memory. The job settings include information such as inspection conditions and printing settings. The inspection conditions include whether image inspection is performed, and when image inspection is "yes", the types of the first and second inspection modes are further included. Further, in the second inspection mode, path information (file directory information) for designating a file of a registered reference image to be used is included. In the example of FIG. 4, it will be described that mainly the first inspection mode is selected as the job setting. Also, in the example of FIG. 4, it will be described that the manuscript image is composed of n print data from pages 1 to n.

[0058] In the case of the first inspection mode, the main control unit 11 (data transmission unit 116) simultaneously transmits the manuscript image stored in the page memory to both the image forming unit 16 and the reference image generation unit 311.

[0059] The reference image generation unit 311 sequentially generates reference images 1 to n for pages 1 to n from the received manuscript image (pages 1 to n), and stores them in the storage unit 32.

[0060] In FIG. 4, x has an initial value of 1 and is a value that increments up to the nth page. The image forming unit 16 forms an image on the paper in order from pages 1 to n. x is the current page value.

[0061] The image reading unit 33 reads the conveyed paper (page x) and generates a read image. The read image obtained by reading is sent to the image inspection unit 312 as the inspection image for page x via the page memory. Also, the corresponding reference image x for page x is sent to the image inspection unit 312 from the storage unit 32 via the page memory.

[0062] The image inspection unit 312 inspects the inspection image by comparing the acquired reference image and the inspection image. Then, the control unit 31 (image inspection unit 312) outputs the inspection result of the inspection image to the main control unit 11. In the example shown in FIG. 4, the reference image generated by the reference image generation unit 311 is an example stored in the storage unit 32, but it may be stored in the storage unit 12 of the image forming apparatus 10. Also, in FIGS. 2, 4, etc., the main control unit 11 and the control unit 31 have been described as separate entities, but they may be integrally configured. That is, the control unit 31 may be integrated into the main control unit 11.

[0063] Here, when the first reception unit receives the execution of the inspection in the first inspection mode, the generation of the reference image by the reference image generation unit 311 and the formation of the image (inspection image) by the image forming unit 16 are executed in parallel. FIG. 5 is a schematic diagram showing each process of acquisition of the document image, generation of the reference image, formation of the inspection image, and inspection of the inspection image in time series. In FIG. 5, the following processes are shown in order from the top. (Process 1) Acquisition of the document image by the main control unit 11. (Process 2) Generation of the reference image by the reference image generation unit 311. (Process 3) Formation of the image of the inspection target by the image forming apparatus 10 (image forming unit 16). (Process 4) Inspection using the inspection image and the reference image by the image inspection unit 312. Also, in FIG. 5, with n = 8, the printing and inspection processes of a total of 8 pages of document images are shown. Regarding processes 3 and 4, the description of the processes after 3 and 4P (pages) is omitted.

[0064] As shown in FIG. 5, the generation of the reference image by the reference image generation unit 311 and the formation of the inspection image (image formation) by the image forming unit 16 are executed in parallel. Specifically, the generation process of the reference image up to pages 1 to 8 and the image formation by the image forming unit 16 are executed in parallel.

[0065] (Image inspection method) Hereinafter, with reference to FIGS. 6A to 11, the image inspection method according to the present embodiment will be described.

[0066] First, the setting of inspection conditions for image inspection in this embodiment will be described. FIGS. 6A to 6G are operation screens (operation screens s1 to s7) for setting inspection conditions for image inspection and giving execution instructions. Regarding printing settings other than the inspection conditions for the print job job1 and the designation of the original image, they are performed on other operation screens (not shown). The operation screens s1 to s7 are displayed on the terminal device 80 or the operation panel 17 on which the printer driver is installed. On the operation screens s1, s3, etc., the user can select either of the radio buttons b1, b2. Also, when the user selects b2, the user can further select either of b21, b22.

[0067] (First reception unit) Referring to FIGS. 6A to 6B, the first reception unit will be described. The buttons b1 (and b3) on the operation screen s1 in FIG. 6A correspond to the first reception unit. The user selects the button b1 on the operation screen s1 and presses the job start button b3. Thereby, the inspection execution instruction reception unit 115 of the image inspection apparatus 100 receives an execution instruction from the image inspection unit 312 before the generation of the reference image by the reference image generation unit 311 is completed (first inspection mode). By receiving the execution instruction, the image inspection apparatus 100 immediately executes image formation and inspection of the image generated thereby. The operation screen s2 shown in FIG. 6B is a screen displayed following the operation screen s1 in FIG. 6A. When the user presses the job start button b3, the inspection execution instruction reception unit 115 receives an execution instruction for the inspection in the first inspection mode. In response thereto, an operation screen s2 indicating that the first inspection mode has been received is displayed.

[0068] (Second reception unit) Referring to FIGS. 6C to 6E, the second reception unit (one of the second reception units) will be described. Buttons b2 (as well as b21 and b5 (operation screen s4)) on the operation screen s3 in FIG. 6C correspond to the second reception unit. The user selects button b2, further selects button b21, and presses the registration start button b4. As a result, the reference image generation unit 311 of the image inspection apparatus 100 newly generates a reference image based on the original image and registers the generated reference image in the storage unit 32 and the like. By registering, the operation screen s4 in FIG. 6D is displayed. The user presses the job start button b5 on the operation screen s4. As a result, after the generation of the reference image by the reference image generation unit 311 is completed, the inspection execution instruction reception unit 115 of the image inspection apparatus 100 receives an instruction to execute an inspection by the image inspection unit 312. The operation screen s5 shown in FIG. 6E is a screen that is displayed following the operation screen s4 in FIG. 6D. When the inspection execution instruction reception unit 115 receives an instruction to execute an inspection in the second inspection mode, the operation screen s5 is displayed.

[0069] Next, referring to FIGS. 6F to 6G, another second reception unit (second reception unit 2) will be described. Buttons b2, b22, and b7 on the operation screen s7 in FIG. 6G correspond to the second reception unit. The user selects buttons b2 and b22 on the operation screen s6 and further presses the selection button bb6. As a result, a screen for specifying the file path of the file pops up (not shown), and the user specifies the file of the reference image generated and registered in the past. This file of the reference image is stored in, for example, the storage unit 32 (or the storage unit 12). On the operation screen s7 in FIG. 6G, the specified reference image (the path of the reference image) is shown in the display field b60. The user presses the job start button b7 on the operation screen s7. Thereby, after the generation of the reference image by the reference image generation unit 311 is completed, the inspection execution instruction reception unit 115 of the image inspection apparatus 100 receives an instruction to execute an inspection by the image inspection unit 312. Even when the job start button b7 on the operation screen s7 is pressed, an operation screen s5 indicating that an instruction to execute an inspection in the second inspection mode has been received is displayed. Next, referring to FIGS. 7 to 9, an image inspection corresponding to the setting of the inspection conditions and the execution instruction of the image inspection received by the operation screens from FIGS. 6A to 6G will be described.

[0070] (Image inspection method) FIGS. 7 to 9 are flowcharts showing an image inspection method.

[0071] (Step S11) The image inspection apparatus 100 receives a print job. The print job includes a document image (print data) and job settings such as inspection conditions. In the following, it will be described as an example that the document image includes image data of a plurality of pages from page 1 to page n, similar to the example in FIG. 4.

[0072] (Step S12) The control unit 11 of the image inspection apparatus 100 determines the presence or absence of inspection settings by referring to the inspection conditions described in the job settings. When the control unit 11 executes the inspection (YES), the process proceeds to step S13. When the inspection is not executed (NO), the process ends (end). In this case, normal image formation is performed without performing an image inspection on the print job, and the description is omitted.

[0073] (Step S13) The control unit 11 of the image inspection apparatus 100 determines the received reception unit. If it is an execution instruction for the inspection received by the first reception unit, the process proceeds to FIG. 8 (indicated by the circled "A" in the figure). On the other hand, if it is an execution instruction for the inspection received by the second reception unit, the process proceeds to FIG. 9 (indicated by the circled "B" in the figure). The execution instruction for the inspection received by the first reception unit is the execution instruction received on the operation screen s1 in FIG. 6A as described above, and is the first inspection mode. The execution instruction for the inspection received by the second reception unit is the execution instruction received on the operation screens s3, s4 in FIGS. 6C to 6D, or the operation screens s6, s7 in FIGS. 6F to 6G as described above, and is the second inspection mode.

[0074] Refer to FIG. 8. In FIG. 8 (similarly in FIG. 9), the process surrounded by the one-dot chain line on the left side is the process performed on the image forming apparatus 10 side, and the process surrounded by the broken line on the right side is the process performed on the inspection unit 30 side. The processes on the image forming apparatus 10 side in steps S21 to S23 and the processes on the inspection unit side in steps S24 to S26 may be performed in parallel. That is, image formation by the image forming unit 16 and generation of a reference image by the reference image generation unit 311 are performed simultaneously. For example, as shown in FIG. 5, generation of the reference image for pages 3 to 4 by the reference image generation unit 311 is performed in parallel with the formation of the inspection image for the first page by the image forming unit 16. Also, the process in step S25 and the processes in steps S27 and S28 may be performed in parallel. For example, as shown in FIG. 5, in step S25, generation of the reference image for the fifth page is performed by the reference image generation unit 311, and at the same time, in step S27, the paper to be inspected is read, and in step S28, the inspection image is inspected by the image inspection unit 312.

[0075] (Step S21) The image forming unit 16 of the image forming apparatus 10 receives the document images (1 to n).

[0076] (Step S22) Based on the document image, the image forming unit 16 forms an image on the paper. x has an initial value of 1 and is a value that increments up to the nth page. The image forming unit 16 forms an image on the paper in order from pages 1 to n. x is the current page value. Note that the control unit 11 (or the control unit 31) may cause the image forming unit 16 to perform image formation after generating the reference images for all pages (pages 1 to n).

[0077] (Step S23) The image forming apparatus 10 forms an image on the paper and conveys the paper on which the image is formed to the inspection unit 30.

[0078] (Step S24) The inspection unit 30 receives the document image. The control unit 31 stores the received document image in the page memory or the storage unit 32.

[0079] (Step S25) The reference image generation unit 311 generates a reference image based on the document image. FIG. 10 is a subroutine flowchart showing the reference image generation process.

[0080] (Step S601) The reference image generation unit 311 reads out the document image stored in the page memory or the storage unit 32.

[0081] (Step S602) The reference image generation unit 311 performs resolution conversion and color gamut conversion processing on the document image to obtain the converted image data (temporary reference image). This image data becomes the reference image by performing the processing from the following steps S603 to S605.

[0082] (Step S603) If there is inspection area designation information (YES), the reference image generation unit 311 proceeds with the process to step S603; if not (NO), it skips step S603. Thus, inspection area designation information is not necessarily used in all image inspections and may be omitted. The inspection area designation information is included in the inspection condition information. As the inspection area designation information, there are the designation of the inspection area and the designation of the inspection exclusion area as described above.

[0083] (Step S604) The reference image generation unit 311 sets the inspection area designation information in the reference image.

[0084] (Step S605) The reference image generation unit 311 extracts the feature amount for alignment from the reference image. As the feature amount for alignment, there is the contour information or edge information of the image. Thus, the process of FIG. 10 ends and returns to the original process.

[0085] (Step S26) Referring to FIG. 8 again. Here, if the control unit 31 has not finished all pages, it increments x and performs the process of step S25 for the next page. On the other hand, if all pages have been finished (YES), that is, if the generation of the reference images up to the nth page (x = n) has been completed, the process proceeds to the next step S27. As described above, it is also possible to perform the process of step S25 in parallel with the processes of step S27 and step S28.

[0086] (Step S27) The image reading unit 33 of the inspection unit 30 reads the paper to be inspected (xth page) conveyed from the image forming apparatus 10 and generates a read image. This read image is used as the inspection image.

[0087] (Step S28) The image inspection unit 312 executes an inspection on the inspection image of the xth page read and generated in step S27. FIG. 11 is a subroutine flowchart showing the image inspection process.

[0088] (Step S701) The image inspection unit 312 reads out the reference image of the x-th page stored in the storage unit 32 or the page memory.

[0089] (Step S702) The image inspection unit 312 aligns the reference image of the x-th page with the inspection image of the same x-th page generated in step S27. The alignment is performed by associating the feature amount of the reference image extracted in step S604 with the feature amount of the inspection image (matching). The image inspection unit 312 aligns the two images by coordinate transformation or coordinate shift according to the association of the feature amounts.

[0090] (Steps S703, S704) The image inspection unit 312 takes the difference between the corresponding pixel values of the aligned reference image and inspection image, and determines the quality of the inspection image according to the magnitude of the difference. Thus, the process of FIG. 11 is terminated and the process returns to the original process.

[0091] (Step S29) Referring to FIG. 8 again. Here, if the image inspection apparatus 100 has not completed all pages, it increments x and repeats the processes below step S22. On the other hand, if all pages have been completed (YES), that is, if the inspection up to the n-th page (x = n) has been completed, the process ends (ends). The above is the image inspection process in the first inspection mode. Next, referring to FIG. 9, the second inspection mode will be described.

[0092] (Second Inspection Mode) FIG. 9 is a flowchart showing the second inspection mode performed following FIG. 7. The second inspection mode shown in FIG. 9 will be described on the assumption that an execution instruction is received by the second reception unit (one of the second reception units) described in FIGS. 6C to 6E. That is, in FIG. 9 described below, a reference image is newly registered, and then image inspection using this is performed.

[0093] (Steps S41, S42) The inspection unit 30 receives the document image. The control unit 31 stores the received document image in the storage unit 32.

[0094] (Steps S43, S44) The reference image generation unit 311 generates a reference image based on the document image. The processing here is the same as that in steps S25 and S26, and the reference image is generated by the subroutine flowchart shown in FIG. 10. When the generation of the reference image is completed, the inspection execution instruction reception unit 115 displays an operation screen s4 as shown in FIG. 6D. Instead of the operation screen s4, the generated reference image may be selected and specified from the button b22 on the operation screen s3 in FIG. 6C.

[0095] (Step S45) If there is an instruction to start the execution of the image inspection (YES), the inspection execution instruction reception unit 115 advances the process to step S46. Here, the instruction to start the execution means that the job start button b5 is pressed by the user on the operation screen s4. This corresponds to the reception of the execution instruction for the image inspection by the image inspection unit 312 after the generation of the reference image by the reference image generation unit 311 by the second reception unit.

[0096] (Steps S46 - S51) The process of transporting the paper on which the image is formed by the image forming apparatus 10 to the inspection unit 30 here is the same as the process in steps S21 - S23 in FIG. 8, and the description is omitted.

[0097] (Steps S49 - S50) The image inspection process and the like by the inspection unit 30 here are the same as the process in steps S27 - S29 in FIG. 8, and the description is omitted.

[0098] As described above, the image inspection apparatus according to the present embodiment includes a reference image generation unit that generates a reference image for inspecting an image formed on a recording medium, and an image inspection unit that inspects the image formed on the recording medium based on the reference image. Further, the image inspection apparatus includes a first reception unit that receives an instruction to execute the inspection by the image inspection unit before the generation of the reference image by the reference image generation unit is completed. Thereby, the time required for the process from the generation of the reference image to the image inspection can be shortened. Further, in the first reception unit, for example, as shown in FIG. 6A, by only receiving an operation (button b3) to start job execution, the image inspection is immediately started, so that complicated operations by the user are unnecessary. Further, by the second reception unit, after the generation of the reference image by the reference image generation unit, by receiving an instruction to execute the inspection by the image inspection unit based on the reference image, an inspection using (reusing) the registered reference image can also be executed.

[0099] The configuration of the inspection unit 30 described above and the image inspection apparatus 100 including the same has described the main configuration in explaining the features of the above embodiment, and is not limited to the above configuration, and various modifications can be made within the scope of the claims. Further, it does not exclude the configuration provided in a general image forming apparatus. The scope of the present invention should be construed by the appended claims.

[0100] (Modification example) As shown in FIG. 8, in the image inspection apparatus 100 according to the first embodiment, when the first reception unit receives an instruction to execute the image inspection, immediately, the data transmission unit 116 transmits the original image to the image forming unit 16 and the reference image generation unit 311. Further, in response to this, the image forming unit 16 immediately starts image formation, and the reference image generation unit 311 starts generating a reference image (see FIG. 5). However, it is not limited to this. The main control unit 11 may cause the image forming unit 16 to start image formation after the generation of the reference images of all pages (pages 1 to n) by the reference image generation unit 311 is completed.

[0101] Further, the image inspection apparatus 100 may include a terminal device 80 having a display unit. The terminal device 80 is provided with an inspection execution instruction reception unit 115 (first and second reception units), and receives an inspection execution instruction via operation screens s1, s3, etc. displayed on the display unit.

[0102] Also, the inspection unit 30 according to the above-described embodiment, and the means and methods for performing various processes in the image inspection apparatus 100 can be realized by either a dedicated hardware circuit or a programmed computer. The above program may be provided by a computer-readable recording medium such as a USB memory or a DVD (Digital Versatile Disc)-ROM, or may be provided online via a network such as the Internet. In this case, the program recorded on the computer-readable recording medium is usually transferred and stored in a storage unit such as a hard disk. Further, the above program may be provided as a single application software, or may be incorporated into the software of the apparatus as one function of the apparatus.

Explanation of Reference Numerals

[0103] 1000 Printing system 100 Image inspection apparatus 10 Image forming apparatus 11 Main body control unit 111 Printer control unit 112 Inspection unit control unit 113 Other device control unit 115 Inspection execution instruction reception unit 116 Data transmission unit 117 Inspection area reception unit 12 Storage unit 13 Print controller 14 Paper feeding unit 15 Conveying unit 16 Image forming unit 17 Operation panel 19 Communication unit 20 Paper feeding device 30 Inspection unit 31 Control Unit 311 Reference Image Generation Unit 312 Image Inspection Unit 32 Memory Unit 33 Image Reading Unit 34 Conveyor Unit 39 Communication Unit 40 Purge Device 50 Post-Processing Device

Claims

1. A reference image generation unit that generates a reference image for inspecting an image formed on a recording medium, An image inspection unit that inspects an image formed on the recording medium based on the reference image, A first reception unit that receives an instruction to execute an inspection by the image inspection unit before the generation of the reference image by the reference image generation unit is completed, An image inspection apparatus having the above.

2. The first reception unit according to claim 1, wherein the first reception unit receives an instruction to execute an inspection by the image inspection unit before or during the generation of the reference image by the reference image generation unit.

3. The image inspection apparatus according to claim 1 or 2, further comprising a second reception unit that receives an instruction to execute an inspection by the image inspection unit based on the reference image after the generation of the reference image by the reference image generation unit.

4. An image forming unit that forms an image on the recording medium based on a document image, A control unit that controls to transmit the document image to the reference image generation unit and the image forming unit based on the reception of the execution instruction by the first reception unit. The image inspection apparatus according to claim 1 or 2, further comprising the above.

5. The control unit according to claim 4, wherein the control unit causes the generation of the reference image by the reference image generation unit and the formation of the image on the recording medium by the image forming unit to be performed in parallel.

6. The control unit according to claim 4, wherein the control unit causes the image forming unit to form the image on the recording medium after the generation of the reference image by the reference image generation unit.

7. An image forming unit that forms an image on the recording medium based on a document image, A control unit that controls to transmit the document image to the image forming unit based on the reception of the execution instruction by the second reception unit. The image inspection apparatus according to claim 3.

8. A reference image generation step of generating a reference image for inspecting an image formed on a recording medium, An image inspection step of inspecting an image formed on the recording medium based on the reference image, A first reception step of receiving an instruction to execute an inspection in the image inspection step before the generation of the reference image in the reference image generation step is completed. An image inspection method including the above.

9. A reference image generation step of generating a reference image for inspecting an image formed on a recording medium, An image inspection step of inspecting an image formed on the recording medium based on the reference image, A first reception step of receiving an instruction to execute the inspection in the image inspection step before the generation of the reference image in the reference image generation step is completed; An image inspection program for causing a computer to execute a process including this.

Images