Inspection system and inspection device

Abstract

When users set the font for inspection, it is difficult to select the font and the setting process is time-consuming. [Solution] An information processing device displays a setting screen including a preview display of a reference image on a display unit, and registers font data to be candidates for reference font data that serves as a basis for character recognition when inspecting a printed material, in a candidate list associated with an inspection area of ​​the reference image set on the setting screen, and sets the reference font data on the setting screen in accordance with a user's selection from the candidate list. When registering font data in the candidate list, font data that has a similarity to the character string in the inspection area of ​​the reference image that exceeds a threshold is registered in the candidate list from among pre-registered registered font data.

Description

[Technical Field]

[0001] The present invention relates to an information processing device, a setting method, an inspection system, and a program for inspecting the print quality of printed matter. [Background technology]

[0002] In recent years, printing systems have become known that allow an inspection device to inspect sheets printed by a printing device while they are being transported. In inspecting printed sheets, the inspection device reads an image of the transported printed sheet and determines whether the printed sheet is normal or not by analyzing the read image. The inspection device can detect defective sheets, including, for example, missing barcodes or ruled lines, missing images, poor printing, missing pages, and color misalignment. If a printed sheet is determined to be defective, the defective sheet is ejected to a different destination from normal sheets. This prevents defective sheets from being mixed in with normal sheets and allows the operator to discard the defective sheets.

[0003] When inspecting a character string, character recognition processing is performed on the area where the character string is printed using the font dictionary for that character string, and the recognition results are compared with the correct data to perform the inspection. At this time, if the user does not know the font of the character string to be inspected, there is a problem that they do not know which font dictionary to set. Patent Document 1 describes an embodiment in which character recognition processing is performed on the area where the character string is printed, and if it is determined that the output character recognition rate is below a predetermined recognition rate threshold, a warning display screen is output, and an approximate font is presented if the recognized font type is incorrect. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2016-009223 Summary of the Invention [Problem to be solved by the invention]

[0005] However, in Patent Document 1, it is necessary to set the correct font in advance, and the approximate font is presented after the inspection, which is not the timing when the user wants it to be presented, which is a problem.

[0006] Therefore, the present invention aims to set a font with high accuracy and in a short time without causing the user any trouble by presenting highly accurate correct font candidates to the user before the test settings are finalized. [Means for solving the problem]

[0007] In order to achieve the above object, the present invention has the following configuration: That is, according to one aspect of the present invention, a preview unit displays a setting screen including a preview display of a reference image on a display unit; a registration means for registering font data, which is a candidate for reference font data that serves as a basis for character recognition when inspecting a printed matter, in a candidate list in association with the inspection area of ​​the reference image set on the setting screen; a setting means for setting the reference font data on the setting screen in accordance with a user's selection from the candidate list, The registration means registers, in the candidate list, font data among pre-registered registered font data, whose similarity to the character string in the inspection area of ​​the reference image exceeds a threshold value. An information processing device characterized by the above features is provided. [Effects of the Invention]

[0008] According to the present invention, by presenting highly accurate font candidates to the user before the inspection settings are finalized, it becomes possible for the user to set the font with high accuracy and in a short time without causing any trouble to the user. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a schematic diagram showing the configuration of an information processing device, an inspection device, and a printing device. [Figure 2] FIG. 1 is a block diagram showing the configurations of an information processing device, an inspection device, and a printing device. [Figure 3] FIG. 2 is a diagram showing the internal configuration of an information processing device, an inspection unit, a printing device, and a large-capacity stacker. [Figure 4] Flowchart of the entire test. [Figure 5] FIG. 10 is a diagram showing a font registration screen. [Figure 6] FIG. 10 is a diagram showing a character segmentation screen. [Figure 7] 10 is a flowchart for font registration. [Figure 8A] FIG. [Figure 8B] FIG. 10 is a diagram showing a setting item screen for character string inspection. [Figure 9] 1 is a flowchart of the test setup. [Figure 10] 10 is a flowchart for storing registered font data in a candidate list. [Figure 11] Inspection flowchart. [Figure 12] A diagram showing the dialog that appears when no font suggestions are available. [Figure 13] 10 is a flowchart for storing registered font data in a candidate list according to the second embodiment. [Figure 14] FIG. 10 is a diagram showing how registered font data is displayed on the setting item screen for character string inspection. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the scope of the invention claimed. Although multiple features are described in the embodiments, not all of these multiple features are necessarily essential to the invention, and multiple features may be combined arbitrarily. Furthermore, in the accompanying drawings, the same reference numerals are used to designate the same or similar components, and redundant explanations will be omitted.

[0011] (First embodiment) ● Image formation system configuration 1 is a schematic diagram showing the configuration of an image forming system (or inspection system) having an information processing device, an inspection device, and an image forming device in this embodiment. Note that, although the image forming device in this embodiment will be described using an electrophotographic image forming device, the image forming device in this embodiment may be an image forming device of a different image forming method, such as an inkjet method or an offset method. An image forming device may also be called a printing device.

[0012] The image forming apparatus 0101 is connected to an information processing apparatus 0109 via a cable 0112. The information processing apparatus 0109 is connected to a client computer 0110 and an inspection apparatus 0108 via a network 0113. The image forming apparatus 0101 includes a UI panel 0102, a paper feed deck 0103, and a paper feed deck 0104. An optional deck 0105 consisting of three paper feed decks is also connected. The image forming apparatus 0101 is, for example, an electrophotographic image forming apparatus. The UI panel 0102 is, for example, a user interface equipped with a capacitive touch panel.

[0013] The image forming apparatus 0101 further includes an inspection unit 0106 and a large-capacity stacker 0107. The inspection unit is connected to an inspection device 0108 via a cable 0114. The large-capacity stacker 0107 includes a main tray and a top tray, and the main tray can hold several thousand sheets of paper at a time.

[0014] A print job is generated by the client computer 0110, transmitted to the information processing device 0109 via the network 0113, and managed by the information processing device 0109. The print job is then transmitted from the information processing device 0109 to the image forming device 0101 via the cable 0112, and the image forming device 0101 performs processing to print on paper. Note that the print job may also be generated and managed by the information processing device 0109, transmitted to the image forming device 0101 via the network 0112, and managed by the image forming device 0101.

[0015] The client computer 0110, the information processing device 0109, and the inspection device 0108 may be connected to a cable 0112 to communicate with the image forming device 0101. That is, the connection configuration of the image forming device 0101, the information processing device 0109, and the client computer 0110 shown in this embodiment is just an example, and it goes without saying that there are various other connection configurations besides that shown in this embodiment.

[0016] FIG. 2 is a block diagram showing the control configuration of the image forming apparatus 0101, the inspection apparatus 0108, the large-capacity stacker 0107, the information processing apparatus 0109, and the client computer 0110 in this embodiment.

[0017] ●Hardware configuration of image forming device 0101 The CPU (Central Processing Unit) 0201 controls and performs calculations in each section of the image forming apparatus 0101 via a system bus 0212. The CPU 0201 executes programs stored in a storage unit 0205 and loaded into a RAM (Random Access Memory) 0202. The RAM 0202 is a type of general volatile storage device that can be directly accessed by the CPU 0201, and is used as a work area for the CPU 0201 or as other temporary data storage areas. The storage unit 0205 functions as a temporary storage area and work memory when the image forming apparatus is operating.

[0018] The engine I / F 0209 controls communication with and control of the printer engine 02010. The paper feed deck I / F 0204 controls communication with and control of the paper feed deck 0211. The paper feed deck 0211 is a collective term for the paper feed decks 0103 and 0104 and the option deck 0105 as a hardware configuration. The UI panel 0203 is a hardware configuration of the UI panel 0102, and is a user interface for performing overall operations of the image forming apparatus 0101. In this embodiment, the UI panel 0203 is equipped with a capacitive touch panel.

[0019] The network interface (hereinafter referred to as NW I / F) 0207 is connected to the NW I / F 0238 of the information processing device 0109 via a cable 0213, and controls communication between the information processing device 0109 and the image forming device 0101. In this example, the interfaces connected to the system buses 0212 and 0239 are directly connected to each other, but the information processing device 0109 and the image forming device 0101 may also be connected via a network or the like, and the connection method is not limited thereto. The video I / F 0206 is connected to the video I / F 0233 via a video cable 0241, and controls communication of image data between the information processing device 0109 and the image forming device 0101.

[0020] The connection interface between the information processing device 0109 and the image forming device 0101 may be a combination of the functions of the NW I / F 0238 and the video I / F 0233. The connection interface between the image forming device 0101 and the information processing device 0109 may be a combination of the functions of the NW I / F 0207 and the video I / F 0206.

[0021] The accessory I / F 0208 is connected to the accessory I / F 0214 and the accessory I / F 0220 via a cable 0225. That is, the image forming apparatus 0101 communicates with the inspection unit 0106 and the large-capacity stacker 0107 via the accessory I / Fs 0208, 0214, and 0220.

[0022] ●Hardware configuration of inspection unit 0106 The CPU 0216 controls and calculates each part of the inspection unit 0106 via the system bus 0219, and executes programs stored in the memory unit 0247 and loaded into the RAM 0217. The RAM 0217 is a type of general volatile storage device that can be directly accessed by the CPU 0216 and is used as a work area for the CPU 0216 or other temporary data storage area. The memory unit 0247 functions as a temporary storage area and work memory when the inspection device is operating. The inspection device I / F 0215 is connected to the inspection device unit I / F 0231 via a cable 0248. That is, the inspection unit 0106 communicates with the inspection device 0108 via the inspection device I / F 0215 and the inspection device unit I / F 0231.

[0023] The photographing unit 0218 has a photographing function equipped with, for example, a contact image sensor (hereinafter, CIS), photographs the paper passing through the inspection unit, and transmits the photographed image to the inspection device 0108 via the inspection device I / F 0215. Note that the CIS for the photographing unit 0218 is an example of a sensor, and may be another type of sensor such as a CCD image sensor, and the photographing method is not limited.

[0024] ●Hardware configuration of the large-capacity stacker 0107 The CPU 02220 controls and calculates each part of the large-capacity stacker 0107 via the system bus 0224, and executes programs stored in the memory unit 0248 and loaded into the RAM 0222. The RAM 0222 is a type of general volatile storage device that can be directly accessed by the CPU 0221, and is used as a work area for the CPU 0221 or other temporary data storage area. The memory unit 0248 functions as a temporary storage area and work memory when the inspection device is operating. The paper discharge unit 0223 controls the paper discharge operation to the main tray and top tray, and monitors and controls the loading status of each of the main tray and top tray.

[0025] ●Hardware configuration of inspection device 0108 The CPU 0226 controls and performs calculations for each component of the inspection device 0108 via the system bus 0230, and executes programs stored in the memory unit 0228 and loaded into the RAM 0227. The RAM 0227 is a type of general volatile storage device that can be directly accessed by the CPU 0226 and is used as a work area for the CPU 0226 or other temporary data storage area. The memory unit 0228 functions as a temporary storage area and work memory when the inspection device is operating. The PDL analysis unit 0229 reads PDL data, such as PDF, PostScript, and PCL, received from the client computer 0110 or the information processing device 0109 and performs interpretation processing. The display unit 0245 is, for example, a liquid crystal display connected to the inspection device, and accepts user inputs to the inspection device and displays the status of the inspection device.

[0026] ●Hardware configuration of information processing device 0109 The CPU 0234 controls and performs calculations for each component within the information processing device 0109 via a system bus 0239, and executes programs stored in the memory unit 0236 and loaded into the RAM 0235. The RAM 0235 is a type of general volatile storage device that can be directly accessed by the CPU 0234 and is used as a work area for the CPU 0234 or other temporary data storage area. The memory unit 0236 functions as a temporary storage area and work memory when the information processing device is operating. The network interface (hereinafter referred to as NW I / F) 0237 is connected to the NW I / Fs 0232 and 0240 via a network. The information processing device 0109 communicates with the inspection device 0108 via the NW I / F 0237 and NW I / F 0232. The information processing device 0109 also communicates with the client computer 0110 via the NW I / F 0237 and NW I / F 0240.

[0027] ●Hardware configuration of client computer 0110 The CPU 0243 controls and performs calculations in each section of the client computer 0110 via the system bus 0246, and executes programs stored in the memory unit 0245 and loaded into the RAM 0242. The RAM 0242 is a type of general volatile storage device that can be directly accessed by the CPU 0243, and is used as a work area for the CPU 0243 or other temporary data storage areas. The memory unit 0244 functions as a temporary storage area and work memory when the client computer is operating.

[0028] Image formation and media transport mechanism FIG. 3 shows the internal configuration of the image forming apparatus 0101, inspection unit 0106, and large-capacity stacker 0107. The image forming apparatus 0101 accepts user input and displays printing and device status via a UI panel 0102. Various types of paper can be stored in the paper feed decks 0103 and 0104. Each paper feed deck can separate only the topmost sheet of paper from the stack and transport it to a paper transport path 0305. Development stations 0301 to 0304 form color images by using Y, M, C, and K color toners, respectively. The toner images formed here are primarily transferred to an intermediate transfer belt 0306. The intermediate transfer belt 0306 rotates clockwise in the figure, and the toner image is transferred to a paper transported from the paper transport path 0305 at a secondary transfer position 0307. The fusing unit 0308 is equipped with a pressure roller and a heating roller. As the paper passes between these rollers, the toner is melted and pressed to fix the toner image to the paper. After passing through the fusing unit 0308, the paper is transported to the paper discharge hole 0312 via the paper transport path 0309. Depending on the type of paper, further fusing and pressing may be required for fusing. In this case, after passing through the fusing unit 0308, the paper is transported to the second fusing unit 0310 via the upper paper transport path, where additional fusing and pressing is performed, and then transported to the paper discharge hole 0312 via the paper transport path 0311. When the image formation mode is double-sided, the paper is transported to the paper inversion path 0313, where it is inverted, and then transported to the double-sided transport path 0314, where the image on the second side is transferred to the secondary transfer position 0307.

[0029] The inspection unit 0106 has CISs 0315 and 0316 arranged facing each other. CIS 0315 is a contact image sensor for reading the top surface of the paper, and CIS 0316 is a contact image sensor for reading the bottom surface of the paper. The inspection unit 0106 scans the paper using the CISs 0315 and 0316 when the paper transported along the paper transport path 0317 reaches a predetermined position. The scanned image is sent to the inspection device 0108 via the inspection device I / F 0215 and inspection unit I / F 0231. The CPU 0226 of the inspection device 0108 determines whether the received image contains defects and notifies the inspection unit 0106 of the determination result via the inspection unit I / F 0231 and inspection device I / F 0215. The CPU 0216 of the inspection unit 0106 notifies the received determination result to the large-capacity stacker 0107 via the accessory I / Fs 0214 and 0220.

[0030] The large-capacity stacker 0107 is a stacker capable of stacking a large amount of paper. The large-capacity stacker 0107 has a main tray 0324 as a tray for stacking paper. Paper that has passed through the inspection unit 0106 enters the large-capacity stacker 0107 via a paper transport path 0319. The paper travels from the paper transport path 0319 to a paper transport path 0322 and is then stacked on the main tray 0324. The large-capacity stacker 0107 also has a top tray 0320 as a paper output tray. The CPU 0221 of the large-capacity stacker 0107 ejects paper that has been detected as defective by the inspection device 0108 to the top tray 0320. When outputting to the top tray 0320, the paper is transported from the paper transport path 0319 to the top tray 0320 via a paper transport path 0321. A reversing unit 0323 for reversing paper is used when stacking paper on the main tray 0324. To ensure that the orientation of the incoming paper is the same as the orientation of the paper when it is loaded onto the main tray 0324, the paper is inverted once by the inverting unit 0323. When transporting paper to the top tray 0320, the paper is discharged as is without being flipped when it is loaded, so the inverting unit 0323 does not perform the inverting operation.

[0031] The following describes the processing that characterizes the present invention using flowcharts and screen examples. The image forming apparatus program associated with this flow is stored in the storage unit 0205 of the image forming apparatus 0101, read into the RAM 0202, and executed by the CPU 0201. The inspection apparatus program associated with this flow is stored in the storage unit 0228 of the inspection apparatus 0108, read into the RAM 0227, and executed by the CPU 0226. The information processing apparatus program associated with this flow is stored in the storage unit 0236 of the information processing apparatus 0109, read into the RAM 0235, and executed by the CPU 0234. The client computer program associated with this flow is stored in the storage unit 0245 of the client computer 0110, read into the RAM 0242, and executed by the CPU 0243.

[0032] The overall flow from font registration before the start of the test to the execution of the test will be explained using the flowchart in Figure 4.

[0033] ●Inspection procedure First, in font registration in step S401, the user creates registration font data. The registration font data is data that associates character shape images with character codes, which are required for character recognition (OCR) performed during data inspection. The registration font data is data that serves as a reference for evaluating the quality of character images. The inspection device 0108 begins reading the font registration image, and the client computer 0110 executes a print job for font registration. In this embodiment, the print job for font registration is a print job for printing a font with the same character shape and size as used in the printed material to be inspected, and the same paper as the printed material to be inspected is used. The print job for font registration may also be a print job for printing the same content as the print job for actual printing. Note that font registration may be performed using a test print to be inspected, or a reference image may be used for registration.

[0034] Next, in step S402, the user registers a reference image that will serve as the standard for inspection. The inspection device 0108 starts reading the reference image, and the client computer 0110 executes a print job for registering the reference image. The reference image is an image that serves as the standard for evaluating the printed image. Note that the reference image may also be registered using a test print of the object to be inspected.

[0035] Next, in step S403, the user sets the inspection parameters, inspection area, and inspection level, as will be described in detail later.

[0036] Next, in step S404, the user starts the inspection using the inspection device 0108 and executes a print job for inspection using the client computer 0110. When printing is executed, the inspection unit 0106 detects the transport of the paper and scans the paper using the CIS 0315, 0316, and the scanned image is sent to the inspection device 0108 and stored in its RAM 0227. The stored image is compared with a reference image and the inspection result is output. The inspection is performed based on the setting values ​​specified by the user in the inspection settings.

[0037] ● Font registration UI Next, details of font registration will be explained using the UI diagrams of Fig. 5 and Fig. 6, and the flowchart of Fig. 7. Fig. 5 shows an example of a font registration screen that is displayed on the UI panel 0102 and that accepts font registration execution operations from the user.

[0038] In the initial state, the font registration screen does not display a preview image 504 because the image to be registered has not been loaded yet. Instead, it displays a scanned image loading start button 501 and a character area selection button 502. When the loading start button 501 is touched to print an image for font registration, the scanned image is read by the inspection unit 106 and displayed on the preview display screen 504 of the UI panel 0102.

[0039] In this state, the user presses character area selection button 502, and then accepts a character area selection operation by selecting a frame indicating the character area with a mouse click or the like. After the user presses character area placement button 503, the user accepts placement operations such as moving or resizing the character area by manipulating selected character area 505 on the preview display with a mouse drag or the like. The user selects a character area so that it contains a character string containing the characters for which font registration is desired. Setting field 506 is a field for setting the direction of the character string in the selected character area. The direction of the character string is set by the angle of the character relative to a predetermined reference direction. 507 is a button for starting character extraction; pressing button 507 transitions to the character extraction screen of Figure 6. Touching complete button 508 completes the font registration process.

[0040] 6 shows a character segmentation screen displayed on the UI panel 0102. A preview screen 601 is a screen that displays a preview of an image in which a character region has been segmented. A preview of the character region 505 set by the user on the font registration screen is displayed, and a frame indicating the coordinates of the character segmentation processing result is displayed on the preview.

[0041] The font name input field 602 is an input field for the font name of the registered font. The font size input field 603 is an input field for the font size of the registered font. The text box 604 is a field for inputting a character segmentation image of the character area and the characters (text) to be associated with the character segmentation image. A character segmentation image is an image obtained by segmenting each character of the character string included in the character area 505. Pressing the registration button 605 completes input of the registered font information, closes the screen, and transitions to the font registration screen of Figure 5.

[0042] ●Font registration process 7 is a diagram showing the processing in the inspection device 0108 when a font registration operation is performed on the inspection device 0108. In response to user operations via the font registration screen and character extraction screen displayed on the UI panel 0102, the CPU 0226 executes various processes for making inspection settings.

[0043] In S701, the CPU 0226 accepts an operation to start reading a scanned image from the font registration screen. In this embodiment, the operation to start reading a scanned image is the user pressing the scan image reading start button 501. When the CPU 0226 accepts the pressing of the scan image reading start button 501, it transitions to a state waiting to receive a scanned image of a printed matter. Thereafter, when a print job is executed, the scanned image is read.

[0044] In S702, the user executes a print job for font registration on the client computer 0110. The CPU 0226 receives an image of the printed matter scanned by the inspection unit 0106 from the inspection unit 0106 via the inspection device I / F 0215 and the inspection unit I / F 0231. The CPU 0226 then displays the scanned image on the preview display screen 504 of the font registration screen.

[0045] In step S703, the CPU 0226 ends the waiting state for receiving the scanned image of the printed matter.

[0046] In step S704, the CPU 0226 accepts a character area setting operation from the font registration screen. The user sets the character area on the preview of the loaded image using the character area selection button 502, the character area placement button 503, and the character string direction setting field 506. The character area is set on the scanned image in accordance with the operation.

[0047] In S705, the CPU 0226 accepts a character segmentation operation from the font registration screen. In this embodiment, the character segmentation operation is the pressing of button 507, which starts character segmentation. After accepting the pressing of button 507, which starts character segmentation, the CPU 0226 executes a process of segmenting characters included in the character region and transitions to the character segmentation screen. The character segmentation process is, for example, a process of calculating a pixel value histogram for an image of the character region and segmenting an area where this pixel value histogram stands out as a character segmented image. This character segmentation method is just one example, and there are various other forms besides the one shown in this embodiment. The segmented characters are displayed one by one on the left side of the text box 604 shown in FIG. 6, but this display may also display the segmented characters sequentially, or the segmented characters may be displayed in response to a user operation.

[0048] In S706, the CPU 0226 accepts an input operation of a character code to be associated with a character segmentation image from the character segmentation screen. In this embodiment, the user inputs characters in the text box 604. The text is input as the corresponding character code.

[0049] In step S707, the CPU 0226 accepts an input operation for the font name and font size from the character extraction screen. The input operation for the font name and font size is an input operation by the user in the input field 602 for the font name of the registered font and the input field 603 for the font size.

[0050] In step S708, the CPU 0226 accepts a registration operation from the character segmentation screen. In this embodiment, the registration operation is the user pressing the registration button 605. The CPU 0226 then stores the input font name, font size, character segmentation image, corresponding character, character recognition process to be used, and pre-processing parameters as registered font data in the storage unit 0228. The character recognition process and pre-processing parameters to be used may be stored as predetermined values ​​or separately specified values.

[0051] Font settings are set for each font and size used in the printed material to be inspected. For example, if multiple character areas are set in one scanned image, font settings are set for each area. Conversely, a single continuous area containing characters to which a common font setting is applied can be selected as a character area.

[0052] ●Setting inspection details Next, the details of the inspection settings will be explained using the UI diagrams of Figures 8A, 8B, and 12, and the flowchart of Figure 9. The inspection settings start by selecting the reference image registered in the reference registration.

[0053] 8A is an example of an inspection setting screen that is displayed on the UI panel 0102 and that accepts an operation to execute inspection settings from the user. On the inspection setting screen, the user arranges inspection areas (also called inspection target areas) on a preview of a reference image and performs individual settings for each inspection area. The inspection setting screen is displayed in response to an operation to execute inspection settings.

[0054] The registered reference image is displayed on the preview display screen 801. The reference image is an image that serves as a standard for evaluating the printed material, and is saved on a page-by-page basis. In the case of a reference image for a multi-page print job, an operation to switch the page displayed in preview can be accepted, and the reference image for each page can be displayed.

[0055] Inspection frames 802 and 803 are frames showing examples of inspection areas to be inspected that are arranged on the preview display screen 801. The inspection areas can be arranged on the preview display screen 801 by touching an inspection area arrangement button 805, and the size and position can be changed by the user operating the mouse drag or the like. Inspection frame 802 shows an example in which a picture is arranged as the inspection area. Inspection frame 803 shows an example in which a character string is arranged as the inspection area.

[0056] The inspection area selection button 804 is a button for selecting an inspection area. After the user presses the inspection area selection button 804, the user accepts an inspection area selection operation by, for example, clicking the inspection frames 802 and 803 indicating the inspection areas with the mouse, and the clicked inspection area is placed in a selected state.

[0057] The inspection area placement button 805 is a button for setting an inspection area. After the user presses the inspection area placement button 805, they select the type of inspection area from the displayed pull-down menu, and then select the area they want to specify as the inspection area on the preview display by dragging the mouse or other operation, thereby accepting the placement operation of the inspection area. This sets the inspection area. Inspection area types include character strings, barcodes, patterns (images), etc., and a type of inspection may be determined for each type of inspection area. Note that the inspection may involve evaluating the quality of the image formed in the inspection area according to the set type, and determining whether the evaluation result reaches a predetermined level. The inspection includes a data inspection when a barcode or character string is set as the inspection area type, and an image quality inspection when an image is set.

[0058] Setting item 806 is a setting item for selecting data for a comparison test using a file selection method. The comparison test data is a reference CSV file for data testing that is compared with the data in the test area when performing a data test. The reference CSV file is a file that the user must prepare in advance and is a file that lists the correct strings for string tests and barcode tests. When performing a data test, if the type of the selected test area is a string, the string recognized from the image of that test area is compared with the correct strings listed in the reference CSV file. If the type of the selected test area is a barcode, the string decoded from the image of that test area is compared with the correct strings listed in the reference CSV file.

[0059] The setting field 807 for the selected area displays individual (or unique) setting values ​​for each inspection area selected by the inspection area selection button 804. Fig. 8A shows the case where the type of the selected inspection area is a character string.

[0060] In the page range setting field 808, the user can press each button there to specify the page range for which inspection will be performed using the selected inspection area as the inspection target. If no page range is selected, the selected inspection area will be placed only on the pages currently displayed on the preview display screen. If "Same side as current page" is selected, the selected inspection area will be placed on pages on the same side depending on whether the selected inspection area is placed on the front or back side of the sheet. If "All pages" is selected, the selected inspection area will be placed on all pages. Note that the inspection area is set on pages registered as reference image data, and pages may be numbered according to the order in which they were printed or registered.

[0061] The string inspection setting field 809 is a setting item for string inspection that is displayed when the string inspection area 803 is selected. For each inspection area, the angle of the inspection area, the font of the string, whether to perform a comparison inspection, and if a comparison inspection is to be performed, which column of the reference CSV selected in the setting item 806 to compare with are set.

[0062] The font setting field 810 is a font setting item that is displayed when the character string inspection area 803 is selected. An item for selecting the character string font is displayed and font selection by the user is accepted. The font setting may be saved in association with the inspection area.

[0063] The font presentation checkbox 811 is a setting item for selecting whether or not to present a font when the character string inspection area 803 is placed. The user selects either "present" or "do not present" by pressing the checkbox 811. If "present" is selected, the registered font data is narrowed down during the process of storing the registered font data in the candidate list (this process will be described later). If "do not present", the registered font data is not narrowed down during the process of storing the registered font data in the candidate list. In other words, all registered font data is stored in the candidate list.

[0064] The Complete button 812 is a button for completing the test settings. When the user presses the Complete button 812, the test settings are completed, the settings are saved in the storage unit 0228, and the test setting process ends. If there is an inconsistency in the settings, the Complete button 812 for test settings may be disabled so that it cannot be pressed. An example of an inconsistency in the settings is when an inspection area for performing a verification test exists, but the setting item 806 for the data for the verification test has not been set.

[0065] The cancel button 813 is a button for canceling the test settings. When the user presses the cancel button 813, the settings are discarded and the test setting process ends.

[0066] 8B shows an example of a candidate list displayed when selecting a font for a character string, which is displayed in the character string check setting field 809. The candidate list is displayed when accepting a font selection from the user.

[0067] A pull-down menu 814 is displayed when accepting a font selection from the user. In one example, a font candidate list generated in a process for storing registered font data in a candidate list (this process will be described later) is displayed in the pull-down menu 814. By selecting registered font data from the candidate list displayed in the pull-down menu, the font to be used for inspection is set in the font setting field 810.

[0068] 12 shows an example of a dialog 1201 displayed on the UI panel 0102. The dialog 1201 is displayed when there are no font candidates in the process of determining whether registered font data exists in the candidate list (this process will be described later).

[0069] ●Inspection setting process FIG. 9 is a diagram showing the processing in the information processing device 0109 when an inspection setting start operation is performed on the inspection device 0108. In response to user operations on the inspection setting screen and inspection area list displayed on the UI panel 0102, the CPU 0234 executes various processes for setting the inspection. Note that FIG. 9 explains the setting of a character string type inspection area, and omits other types. At the start of FIG. 9, reference image (standard image) data has already been received from the inspection device 0108. The inspection setting screen is also displayed. Note that the information processing device 0109 is sometimes called an inspection setting device or an inspection setting system because it sets the inspection settings, such as the area and range of the inspection target. In this example, the inspection settings (inspection setting information) entered on the information processing device 0109 are transmitted to the inspection device 0108, and the inspection is performed using the settings.

[0070] In step S901, the CPU 0234 accepts a setting operation for the data of the verification test from the test setting screen. In this embodiment, the setting operation for the data of the verification test is an operation of the setting item 807 for the data of the verification test by the user.

[0071] In step S902, the CPU 0234 accepts an operation for arranging the inspection area from the inspection setting screen. In this embodiment, the operation for arranging the inspection area is an operation by the user of the inspection area arrangement button 805 and an operation for setting the arrangement and type of the inspection area accordingly.

[0072] In step S903, the CPU 0234 performs a process of determining and storing a font candidate from among registered fonts for the inspection area accepted in step S902. This process will be described later with reference to the flowchart in FIG.

[0073] In step S904, the CPU 0234 accepts an inspection area selection operation from the inspection setting screen. In this embodiment, the inspection area selection operation is the user's selection of an inspection area and operation of the inspection area selection button 804.

[0074] In S905, the CPU 0234 accepts setting operations for each inspection area from the inspection setting screen. In this embodiment, the setting operations for each inspection area are operations by the user on the setting items 808 for each inspection area. That is, in S905, operations for setting the page range and the character string inspection are accepted. However, the settings in S905 do not include font settings.

[0075] In S906, the CPU 0234 accepts a font selection operation from the string inspection setting item screen. In this embodiment, the font selection operation is an operation of the string inspection setting item 809 by the user. In addition, the user can select a font from the font candidates determined in S903, thereby reducing the effort required for selection. Note that in FIG. 9, the font setting (S906) is performed after the setting of items other than the font (S905), but this is for the convenience of explaining the font setting, and there are no particular restrictions on the order in which the inspection area is set.

[0076] In step S907, the CPU 0234 displays the candidate list acquired in step S903 on the pull-down menu 814 (FIG. 8B) in response to an operation in the font setting field 810. The candidate list may be displayed by displaying only the registered font data included in the candidate list, or by displaying all registered font data and highlighting the registered font data included in the candidate list. The registered font data may also be displayed in descending order of likelihood.

[0077] The display of registered font data will be explained using Figures 14(a), (b), (c), and (d). Figure 14(a) shows an example of all registered font data 1401. Figure 14(b) shows an example of a candidate list 1402. Figure 14(c) displays only the registered font data included in the candidate list 1402 on the pull-down menu 814. Figure 14(d) displays all registered font data, highlighting the registered font data included in the candidate list.

[0078] In S908, the CPU 0234 accepts a registered font data selection operation from the pull-down menu 814. In this embodiment, the registered font data selection operation is an operation in which the user selects a font from the pull-down menu 814.

[0079] In S909, the CPU 0234 determines whether the user has completed the inspection settings. If the inspection settings are complete, the user presses the inspection settings completion button 812 and proceeds to S910. If the inspection settings are not complete, the user continues the inspection settings. In S910, the CPU 0234 transmits the set information (setting information) to the inspection device 0108. The inspection device 0108 stores the setting information in the storage unit 0228 and ends the inspection setting process. Note that the process of FIG. 8 may be performed by the inspection device 0108 instead of the information processing device 0109. In that case, the setting information may be stored as is without being transmitted in step S910. Note that the set registered font data is referred to as a reference font or reference font data because it is used as a reference for character recognition.

[0080] The inspection settings are made according to the above procedure. Font data selected from registered font data that are candidates for setting is set for the inspection area of ​​the character string. During inspection, a character string image is extracted from the document image read from the printed sheet at a position and range that corresponds to the inspection area of ​​the character string, and becomes the subject of character recognition based on the set font data (set font). The results of the character recognition are evaluated, for example, in the same manner as in step S1003 of FIG. 10, which will be described later, to determine whether or not the result matches the set font.

[0081] 10 is a flowchart showing the details of the process (S903) for storing registered font data in the candidate list. The CPU 0234 of the client computer 0109 executes various processes for calculating font candidates.

[0082] In step S1001, the CPU 0234 acquires all registered font data from the storage unit 0236 to the RAM 0233. The registered font data is data registered using the UI and the procedure described with reference to FIGS.

[0083] In S1002, the CPU 0234 determines whether the font presentation function 811 is set to "present." If it is set to "present," the process proceeds to S1003; if not, the process proceeds to S1009.

[0084] In S1003, the CPU 0234 performs character recognition processing on the inspection area using registered font data to measure likelihood. If there are multiple sets of registered font data, this processing is performed by sequentially focusing on each of them and using the registered font data. Likelihood refers to the likelihood that the character string in the inspection area is identical to the character image in the registered font data. In this embodiment, the character recognition processing compares an image in the registered font data of interest with a character image included in the inspection area of ​​the image to be read, and the character string data of the registered font image with the highest similarity is determined as the recognition result. This similarity is referred to as likelihood. For example, when character recognition is performed using a statistical discriminant function such as Bayesian discrimination, likelihood is obtained from the feature values ​​of the input character and the feature values ​​of the reference character, and this value may be used. Furthermore, as described above, likelihood in this embodiment refers to similarity. Therefore, if similarity is expressed as the distance between feature values ​​(feature vectors), the distance can be referred to as similarity or likelihood.

[0085] In S1004, the CPU 0234 determines whether the likelihood measured in S1003 is equal to or greater than a threshold. If the likelihood is equal to or greater than the threshold, the process proceeds to S1005; if it is less than the threshold, the process proceeds to S1006. For example, in step S1003, character recognition of the image within the inspection area may be performed in the same manner as character recognition performed in actual inspection, using the registered font data of interest as a reference. As a result, in step S1004, it may be determined whether the likelihood of the recognized character is equal to or greater than a threshold.

[0086] If the inspection area contains multiple characters, the likelihood of each character may be calculated for each registered font, and in step S1004 it may be determined whether the likelihood of all of those characters is equal to or greater than the threshold value. Alternatively, the likelihood may be calculated for each character, and in step S1004 it may be determined whether the average likelihood of those characters is equal to or greater than the threshold value.

[0087] In step S1005, the CPU 0234 stores the registered font data whose likelihood is determined to be equal to or greater than the threshold in a candidate list.

[0088] In S1006, the CPU 0234 determines whether character recognition processing has been completed for all registered font data. If not, the process proceeds to S1003, where the process is repeated for a new set of registered font data. If completed, the process proceeds to S1007.

[0089] In S1007, the CPU 0234 determines whether registered font data exists in the candidate list. If not, the process proceeds to S1008, and if present, the process of storing the registered font data in the candidate list is terminated.

[0090] In step S1008, the CPU 0234 displays a warning on the UI panel 0203, saying, "There are no font candidates. Please register the font." The warning is, for example, the dialog box 1201 shown in FIG. 12. Note that the warning message is an example and is not limited to this.

[0091] In step S1009, the CPU 0234 stores all registered font data in the candidate list, and then ends the process of storing registered font data in the candidate list.

[0092] In step S1003 of FIG. 10, likelihoods may be calculated for all inspection areas within a page (called a page of interest) that includes the current inspection area, and steps S1004 and S1005 may be executed for each inspection area. In this case, a candidate list is created for each page. Alternatively, steps S1001 to S1009 may be executed for each inspection area, and a candidate list may be created and linked to each inspection area. In this case, in step S907 of FIG. 9, the registered fonts in the candidate list linked to the selected inspection area are displayed. Furthermore, a candidate list may be associated with all pages to be inspected, including multiple pages (i.e., all pages included in the reference image).

[0093] If there is registered font data containing characters corresponding to the characters in the inspection area of ​​the reference image through the above process, the registered font data is registered in the candidate list as a candidate for font setting in that inspection area. On the other hand, if there is no corresponding registered font, all registered fonts are registered in the candidate list.

[0094] ●Inspection processing Next, the details of the inspection will be described using the flowchart in Fig. 11. In response to an instruction to execute the inspection process via the input device of the inspection device or the UI panel 0102 of the image forming device 0101, the CPU 0226 of the inspection device 0108 executes various processes for the inspection.

[0095] In step S1101, the CPU 0226 loads the inspection settings from the storage unit 0228 into the RAM 0227 and starts loading the scanned image. The CPU 0226 transitions to a state in which it waits for reception of the scanned image of the printed matter, and thereafter, when a print job is executed, the scanned image is loaded.

[0096] In S1102, the user executes a print job to be inspected on the client computer 0110. The CPU 0226 receives the image of the printout scanned by the inspection unit 0106 from the inspection unit 0106 via the inspection device I / F 0215 and the inspection unit I / F 0231.

[0097] In S1103, the CPU 0226 acquires an image (referred to as an inspection area image) corresponding to the inspection area specified in the inspection settings from the scanned image received from the inspection unit 0106.

[0098] In step S1104, the CPU 0226 executes character recognition processing on the inspection area image using registered font data. This character recognition processing may be performed in the same manner as step S1003 in FIG.

[0099] In S1105, the CPU 0226 compares the character recognition results with the reference CSV file (correct CSV). If the comparison results in a mismatch, the inspection result for that inspection area is deemed NG; if the comparison results in a match, the inspection result is deemed OK. In step S1105, for inspection areas of character string type, character recognition is performed using the font data associated with the inspection area as a reference, and the result is compared with the reference CSV data. In other words, it is determined whether the character image in the inspection area matches the set font data in terms of font type, size, and direction.

[0100] In step S1106, the CPU 0226 determines whether the inspection of the inspection area specified in the inspection setting has been completed. If completed, the process proceeds to step S1107, and if not completed, the process proceeds to step S1103.

[0101] In step S1107, the CPU 0226 determines the result of the inspection. If the inspection of all inspection areas in the scanned image is successful, the process proceeds to step S1108, and if the inspection is unsuccessful, the process proceeds to step S1109.

[0102] In step S1108, the CPU 0226 instructs the large-capacity stacker 0107 to output the printouts that passed inspection onto the main tray of the paper discharge unit 0223 of the large-capacity stacker 0107.

[0103] In step S1109, the CPU 0226 instructs the large-capacity stacker 0107 to output the printouts that have failed the inspection onto the top tray of the paper discharge unit 0223 of the large-capacity stacker 0107.

[0104] In step S1110, the CPU 0226 determines whether or not the inspection of the print to be inspected has been completed. If the inspection has not been completed, the process proceeds to step S1102, and if the inspection has been completed, the process proceeds to step S1111.

[0105] In step S1111, the CPU 0226 ends the waiting state for receiving the scanned image of the printed matter, and then ends the inspection process.

[0106] According to the above-described procedure, this embodiment allows the user to set a font without any effort by presenting font candidates to the user before finalizing the font setting for the inspection area.Furthermore, by selecting and setting a font from among similar fonts, the font can be set accurately.

[0107] (Second embodiment) When an inspection area (hereinafter referred to as the "placed inspection area") is enclosed, there are cases where this placed inspection area and an inspection area enclosed on another page (hereinafter referred to as the "inspection area on another page") are located close to each other. In this case, there is a high possibility that the placed inspection area and the inspection area on the other page are the same font. Therefore, by narrowing down the registered font data for which candidates are sought, the number of processes for calculating likelihood can be reduced, thereby increasing the processing speed. In the second embodiment, when the placed inspection area and the inspection area on the other page are located close to each other, the candidate list presented in the inspection area on the other page is used to further narrow down the registered font data candidates. Note that the explanation will omit parts common to the previous embodiment.

[0108] 13 is a flowchart showing the process of calculating font candidates in the second embodiment. The CPU 0234 of the client computer 0109 executes various processes for calculating font candidates.

[0109] The processing in S1001 and S1002 is the same as the processing steps with the same reference numerals in the flowchart of FIG.

[0110] In S1301, the CPU 0234 determines whether an inspection area exists on another page. If it exists, the process proceeds to S1302, and if it does not exist, the process proceeds to S1003.

[0111] In S1302, the CPU 0234 calculates the similarity between the placed inspection area and the inspection area of ​​another page. As an example, when a page including the placed inspection area and another page are overlapped, the similarity is calculated by dividing the overlapping area of ​​the inspection areas of the two pages by the area of ​​the placed inspection area. The overlapping of these pages is performed on the data. Note that the method of calculating the similarity is not limited to this. Here, the other page may be a page before the page including the inspection area currently being processed, i.e., a page for which a candidate list has already been created.

[0112] In S1303, the CPU 0234 determines whether the similarities of all the inspection areas of different pages have been calculated. If all the calculations have been completed, the process proceeds to S1304, and if the calculations have not been completed, the process proceeds to S1302.

[0113] In S1304, the CPU 0234 determines whether the highest similarity is greater than a threshold value. If it is greater than the threshold value, the process proceeds to S1304, and if it is equal to or less than the threshold value, the process proceeds to S1003.

[0114] In S1305, the CPU 0234 acquires a candidate list for the inspection area of ​​another page with the highest similarity and overwrites the registered font data acquired in S1001. In this case, a candidate list is created for each inspection area. The inspection area of ​​another page with the highest similarity is called the corresponding inspection area in relation to the original inspection area.

[0115] The processes in S1003 to S1009 are the same as the process steps with the same reference numerals in the flowchart of FIG.

[0116] According to the above procedure, in this embodiment, when the inspection area placed and the inspection area of ​​another page are located close to each other, the candidate list presented in the inspection area of ​​the other page is used to further narrow down the registered font data candidates. This reduces the registered font data for which likelihood is calculated, thereby increasing the processing speed.

[0117] The procedure of FIG. 13 may also be performed by the inspection device 0108.

[0118] [Other Examples] The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program.The present invention can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0119] The invention is not limited to the above-described embodiments, and various changes and modifications can be made without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention. [Explanation of symbols]

[0120] 0101 Image forming apparatus, 0106 Inspection unit, 0108 Inspection device, 0107 Large capacity stacker, 0109 Information processing device, 0110 Client computer

Claims

1. a preview means for displaying a setting screen including a preview display of a reference image by a display means; a registration means for registering in a candidate list font data that is a candidate for reference font data that serves as a basis for character recognition when inspecting a printed matter, in association with the inspection area of ​​the reference image set on the setting screen; a setting means for setting the reference font data on the setting screen in accordance with a user's selection from the candidate list, The registration means registers, in the candidate list, font data corresponding to the character string in the inspection area of ​​the reference image from among pre-registered registered font data.

1. An information processing device comprising:

Images