Information processing apparatus, setting method, inspection system, and program

Abstract

To solve the problem that it is difficult for a user to select a font for inspection and it takes time and effort to set the font.SOLUTION: An information processing apparatus is configured to: cause a display unit to display a setting screen including a preview display of a reference image; register, in a candidate list, in association with an inspection region of the reference image set on the setting screen, font data as a candidate of reference font data which is the basis for character recognition at the time of inspection of a printed matter; and set the reference font data on the setting screen in accordance with a user selection from the candidate list. In registering the font data in the candidate list, among preregistered registration font data, font data whose similarity with a character string of the inspection region of the reference image exceeds a threshold is registered in the candidate list.SELECTED DRAWING: Figure 10

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, a setting method, an inspection system, and a program for inspecting the print quality of printed matter.

Background Art

[0002] In recent years, a printing system has been known in which a sheet printed by a printing apparatus can be inspected by an inspection apparatus during conveyance. In the inspection of a printed sheet, the inspection apparatus reads an image of the conveyed printed sheet, and determines whether the printed sheet is normal by image analysis of the read image. The inspection apparatus can detect defective sheets including, for example, missing barcodes or ruled lines, missing images, printing defects, missing pages, color misregistration, and the like. When it is thus determined that the printed sheet is a defective sheet, the defective sheet is discharged to a different discharge destination from the normal sheets. This prevents defective sheets from being mixed into normal sheets and enables an operator to discard the defective sheets.

[0003] In the inspection of a character string, character recognition processing is performed on the area where the character string is printed using the font dictionary of the character string, and the inspection is performed by collating the recognition result with the correct data. At this time, if the user does not know the font of the character string to be inspected, there is a problem that it is not known which font dictionary should be set. In Patent Document 1, a character recognition process is performed on the area where the character string is printed, and when it is determined that the output character recognition rate is lower than the threshold of the predetermined recognition rate, a warning display screen is output, and an approximate font is presented when the recognized font type is incorrect.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, Patent Document 1 requires setting the correct font in advance, and since the approximate font is presented only after the inspection has been performed, there is a problem in that it is not presented at a time when the user would want it.

[0006] Therefore, the present invention aims to enable users to set fonts with high accuracy and in a short amount of time without requiring them to spend time on the process, by presenting them with a list of highly accurate correct font candidates before the inspection settings are finalized. [Means for solving the problem]

[0007] To achieve the above objective, the present invention has the following configuration. That is, according to one aspect of the present invention, a preview means that displays a settings screen including a preview of a reference image using a display means, A registration means for registering font data to be used as candidate reference font data for character recognition during inspection of printed materials, in association with the inspection area of ​​the reference image set in the settings screen, The settings screen includes a setting means for setting the reference font data according to the user's selection from the candidate list, The registration means registers font data from among the pre-registered registered font data whose similarity to the string in the inspection area of ​​the reference image exceeds a threshold into the candidate list. An information processing device characterized by the above is provided. [Effects of the Invention]

[0008] According to the present invention, by presenting the user with high-precision font candidates before confirming the inspection settings, it becomes possible to set fonts with high precision and in a short time without requiring the user to spend time on the process. [Brief explanation of the drawing]

[0009] [Figure 1] A schematic diagram showing the configuration of an information processing device, an inspection device, and a printing device. [Figure 2] A block diagram showing the configuration of an information processing device, an inspection device, and a printing device. [Figure 3] A diagram showing the internal configuration of the information processing unit, inspection unit, printing device, and high-capacity stacker. [Figure 4] Flowchart of the entire inspection process. [Figure 5] A diagram showing the font registration screen. [Figure 6] A diagram showing the text extraction screen. [Figure 7] Font registration flowchart. [Figure 8A] A diagram showing the inspection settings screen. [Figure 8B] A diagram showing the settings screen for string validation. [Figure 9] Flowchart for setting up the inspection. [Figure 10] A flowchart for storing registered font data in a candidate list. [Figure 11] Inspection flowchart. [Figure 12] This diagram shows the dialog box that appears when no font options are found. [Figure 13] A flowchart for storing registered font data in a candidate list in the second embodiment. [Figure 14] This diagram shows how registered font data is displayed on the string inspection settings screen. [Modes for carrying out the invention]

[0010] The embodiments will be described in detail below with reference to the attached drawings. Note that the following embodiments do not limit the invention as defined in the claims. While the embodiments describe multiple features, not all of these features are essential to the invention, and the features may be combined in any way. Furthermore, in the attached drawings, identical or similar configurations are given the same reference numerals, and redundant descriptions are omitted.

[0011] (First Embodiment) ● Configuration of the image forming system FIG. 1 is a schematic diagram showing the configuration of an image forming system (or inspection system) having an information processing apparatus, an inspection apparatus, and an image forming apparatus in the present embodiment. Although the image forming apparatus in the present embodiment will be described using an electrophotographic image forming apparatus, the image forming apparatus in the present embodiment may be an image forming apparatus using a different image forming method such as an inkjet method or an offset method. The image forming apparatus may sometimes be referred to as a printing apparatus.

[0012] The image forming apparatus 0101 is connected to the information processing apparatus 0109 via a cable 0112. The information processing apparatus 0109 is connected to the client computer 0110 and the inspection apparatus 0108 via a network 0113. The image forming apparatus 0101 includes a UI panel 0102, a paper feed deck 0103, and a paper feed deck 0104. Further, an optional deck 0105 composed of a three-stage paper feed deck is connected. The image forming apparatus 0101 is, for example, an electrophotographic image forming apparatus. The UI panel 0102 is, for example, a user interface provided with a capacitance type touch panel.

[0013] Furthermore, the image forming apparatus 0101 includes an inspection unit 0106 and a large-capacity stacker 0107. The inspection unit is connected to the inspection apparatus 0108 via a cable 0114. The large-capacity stacker 0107 includes a main tray and a top tray, and thousands of sheets of paper can be stacked in the main tray at a time.

[0014] A print job is generated by the client computer 0110, transmitted to the information processing apparatus 0109 via the network 0113, and managed by the information processing apparatus 0109. Then, the print job is transmitted from the information processing apparatus 0109 to the image forming apparatus 0101 through the cable 0112, and the image forming apparatus 0101 performs a process of printing on paper. Note that the print job may be generated and managed in the information processing apparatus 0109, transmitted to the image forming apparatus 0101 via the network 0112, and managed by the image forming apparatus 0101.

[0015] Furthermore, the client computer 0110, the information processing device 0109, and the inspection device 0108 may be connected to cable 0112 and be able to communicate with the image forming apparatus 0101. In other words, the connection configuration of the image forming apparatus 0101, the information processing device 0109, and the client computer 0110 shown in this embodiment is just one example, and it goes without saying that there are various other connection configurations besides those shown in this embodiment.

[0016] Figure 2 is a block diagram showing the control configuration of the image forming apparatus 0101, inspection apparatus 0108, large-capacity stacker 0107, information processing apparatus 0109, and client computer 0110 in this embodiment.

[0017] ● Hardware configuration of the image forming apparatus 0101 The CPU (Central Processing Unit) 0201 controls and performs calculations in various parts of the image forming apparatus 0101 via the system bus 0212. The CPU 0201 is responsible for executing programs stored in the memory unit 0205 and loaded into the RAM (Ramdom Access Memory) 0202. RAM 0202 is a type of general volatile memory that can be directly accessed by the CPU 0201 and is used as the CPU 0201's work area or other temporary data storage area. The memory unit 0205 functions as a temporary storage area and work memory during the operation of the image forming apparatus.

[0018] The engine interface 0209 is responsible for communication and control with the printer engine 02010. The paper feed deck interface 0204 is responsible for communication and control with the paper feed deck 0211. The paper feed deck 0211 is a collective term for the hardware configuration of paper feed decks 0103, 0104, and the optional deck 0105. The UI panel 0203 is the hardware configuration of the UI panel 0102 and is a user interface for performing all operations of the image forming apparatus 0101. In this embodiment, the UI panel 0203 is equipped with a capacitive touch panel.

[0019] Network interface (hereinafter referred to as NW I / F) 0207 is connected to NW I / F 0238 of the information processing device 0109 via cable 0213 and is responsible for communication between the information processing device 0109 and the image forming apparatus 0101. In this example, the interfaces connected to system buses 0212 and 0239 are directly connected to each other, but the information processing device 0109 and the image forming apparatus 0101 may be connected by a network, for example, and the connection method is not limited. Video I / F 0206 is connected to video I / F 0233 via video cable 0241 and is responsible for the communication of image data between the information processing device 0109 and the image forming apparatus 0101.

[0020] Furthermore, the connection interface between the information processing device 0109 and the image forming apparatus 0101 may be a form that integrates the functions of NW I / F 0238 and video I / F 0233. Also, the connection interface between the image forming apparatus 0101 and the information processing device 0109 may be a form that integrates the functions of NW I / F 0207 and video I / F 0206.

[0021] Accessory I / F 0208 connects to accessory I / F 0214 and accessory I / F 0220 via cable 0225. That is, the image forming apparatus 0101 communicates with the inspection unit 0106 and the large capacity stacker 0107 via accessory I / F 0208, 0214, and 0220.

[0022] ● Hardware configuration of inspection unit 0106 CPU0216 controls and performs calculations in various parts of the inspection unit 0106 via the system bus 0219, and executes programs stored in memory unit 0247 and loaded into RAM0217. RAM0217 is a type of general volatile memory that can be directly accessed from CPU0216 and is used as the CPU0216's work area or other temporary data storage area. Memory unit 0247 functions as a temporary storage area and work memory when the inspection device is operating. Inspection device I / F0215 is connected to inspection device unit I / F0231 via cable 0248. That is, inspection unit 0106 communicates with inspection device 0108 via inspection device I / F0215 and inspection device unit I / F0231.

[0023] The imaging unit 0218 is equipped with an imaging function, for example, a contact image sensor (hereinafter referred to as CIS), which photographs the paper passing through the inspection unit and transmits the captured image to the inspection device 0108 via the inspection device I / F 0215. Note that the CIS for the imaging unit 0218 is just one example of a sensor, and other types of sensors such as a CCD image sensor may also be used, and the imaging method is not limited.

[0024] ● Hardware configuration of the high-capacity stacker 0107 CPU02220 controls and performs calculations in various parts of the large-capacity stacker 0107 via the system bus 0224, and executes programs stored in memory unit 0248 and loaded into RAM0222. RAM0222 is a type of general volatile memory that can be directly accessed from CPU0221 and is used as the work area or other temporary data storage area for CPU0221. Memory unit 0248 functions as a temporary storage area and work memory when the inspection device is operating. Paper output unit 0223 controls paper output to the main tray and top tray, and monitors and controls the loading status of the main tray and top tray, respectively.

[0025] ● Hardware configuration of inspection device 0108 The CPU 0226 controls and performs calculations in various parts of the inspection device 0108 via the system bus 0230, and executes programs stored in the memory unit 0228 and loaded into the RAM 0227. RAM 0227 is a type of general volatile memory that can be directly accessed from the CPU 0226 and is used as the CPU 0226's work area or other temporary data storage area. The memory unit 0228 functions as a temporary storage area and work memory during the operation of the inspection device. The PDL analysis unit 0229 reads PDL data such as PDF, PostScript, and PCL received from the client computer 0110 or the information processing device 0109 and performs interpretation processing. The display unit 0245 is, for example, a liquid crystal display connected to the inspection device, and accepts user input to the inspection device and displays the status of the inspection device.

[0026] ● Hardware configuration of the information processing device 0109 CPU0234 controls and performs calculations in various parts of the information processing device 0109 via the system bus 0239, and is responsible for executing programs stored in memory unit 0236 and loaded into RAM 0235. RAM0235 is a type of general volatile memory that can be directly accessed by CPU0234 and is used as the CPU0234's work area or other temporary data storage area. Memory unit 0236 functions as a temporary storage area and work memory during the operation of the information processing device. Network interface (hereinafter, NW I / F) 0237 is connected to NW I / F 0232 and 0240 via the network. Information processing device 0109 communicates with inspection device 0108 via NW I / F 0237 and NW I / F 0232. Information processing device 0109 also communicates with client computer 0110 via NW I / F 0237 and NW I / F 0240.

[0027] ● Hardware configuration of client computer 0110 CPU0243 controls and performs calculations in various parts of the client computer 0110 via the system bus 0246, and executes programs stored in memory unit 0245 and loaded into RAM0242. RAM0242 is a type of general volatile memory that can be directly accessed by CPU0243 and is used as the CPU0243's work area or other temporary data storage area. Memory unit 0244 functions as a temporary storage area and work memory when the client computer is operating.

[0028] ●Image forming and media transport mechanism Figure 3 shows the internal configuration of the image forming apparatus 0101, the inspection unit 0106, and the large-capacity stacker 0107. The image forming apparatus 0101 accepts user input via the UI panel 0102 and displays the printing and equipment status. Various types of paper can be stored in the paper feed decks 0103 and 0104. Each paper feed deck can separate only the top sheet of paper stored and transport it to the paper transport path 0305. 0301 to 0304 are developing stations, where colored toners Y, M, C, and K are used to form toner images in order to form color images. The toner images formed here are first transferred to the intermediate transfer belt 0306. The intermediate transfer belt 0306 rotates clockwise, and at the secondary transfer position 0307, ​​the toner images are transferred to the paper transported from the paper transport path 0305. The fuser unit 0308 is equipped with a pressure roller and a heating roller. As the paper passes between these rollers, the toner is melted and pressed, fixing the toner image to the paper. After passing through the fuser unit 0308, the paper is transported through the paper transport path 0309 to the paper output hole 0312. Depending on the type of paper, further melting and pressing may be required for fixing. In that case, after passing through the fuser unit 0308, the paper is transported to the second fuser unit 0310 using the paper transport path above, where additional melting and pressing is performed, and then the paper is transported through the paper transport path 0311 to the paper output hole 0312. If the image formation mode is double-sided, the paper is transported to the paper inversion path 0313, where it is inverted, and then transported to the double-sided transport path 0314, where the second image is transferred at the secondary transfer position 0307.

[0029] Inside the inspection unit 0106, CIS0315 and 0316 are arranged facing each other. CIS0315 is a contact image sensor for reading the top surface of the paper, and CIS0316 is for reading the bottom surface of the paper. When the paper transported on the paper transport path 0317 reaches a predetermined position, the inspection unit 0106 scans the paper using CIS0315 and 0316. The scanned image is transmitted to the inspection device 0108 via the inspection device I / F 0215 and inspection unit I / F 0231. The CPU 0226 of the inspection device 0108 determines whether the received image has defects and notifies the inspection unit 0106 of the result of the determination again via the inspection unit I / F 0231 and inspection device I / F 0215. The CPU 0216 of the inspection unit 0106 notifies the high-capacity stacker 0107 of the received determination result via the accessory I / F 0214 and 0220.

[0030] The high-capacity stacker 0107 is a stacker capable of loading a large amount of paper. The high-capacity stacker 0107 has a main tray 0324 as a tray for loading paper. Paper that has passed through the inspection unit 0106 enters the high-capacity stacker 0107 via the paper transport path 0319. The paper is loaded onto the main tray 0324 via the paper transport path 0322 from the paper transport path 0319. Furthermore, the high-capacity stacker 0107 has a top tray 0320 as an output tray. The CPU 0221 of the high-capacity stacker 0107 discharges paper that has been detected as defective by the inspection device 0108 to the top tray 0320. When outputting to the top tray 0320, the paper is transported from the paper transport path 0319 to the top tray 0321. The inversion unit 0323 for inverting paper is used when loading paper onto the main tray 0324. To ensure that the orientation of the incoming paper matches the orientation of the paper when it is loaded, the paper is flipped once in the flipping unit 0323 when loading it into the main tray 0324. When transporting to the top tray 0320, the paper is ejected without being flipped during loading, so the flipping operation in the flipping unit 0323 is not performed.

[0031] The following flowchart and screen examples will be used to explain the processes that are characteristic of the present invention. The program for the image forming apparatus related to this flow is stored in the memory unit 0205 of the image forming apparatus 0101, read into RAM 0202, and executed by CPU 0201. The program for the inspection apparatus related to this flow is stored in the memory unit 0228 of the inspection apparatus 0108, read into RAM 0227, and executed by CPU 0226. The program for the information processing apparatus related to this flow is stored in the memory unit 0236 of the information processing apparatus 0109, read into RAM 0235, and executed by CPU 0234. The program for the client computer related to this flow is stored in the memory unit 0245 of the client computer 0110, read into RAM 0242, and executed by CPU 0243.

[0032] The entire process, from font registration before the start of the inspection to the execution of the inspection, is explained using the flowchart in Figure 4.

[0033] ●Inspection Procedure First, in step S401, the user creates registered font data during font registration. The registered font data is data that associates character shape images with character codes, which are necessary for optical character recognition (OCR) performed during data inspection. The registered font data is data that serves as the standard for evaluating the quality of character images. The inspection device 0108 starts reading the font registration images, and the client computer 0110 executes a print job for font registration. In this embodiment, the print job for font registration is a print job that prints a font with the same character shape and size as the one used in the printed material under inspection, and the same paper as the printed material under inspection is used. The print job for font registration may also be a print job that prints the same content as the print job for the main print. In addition, font registration may be performed using a test print of the material under inspection, or it may be performed using a reference image.

[0034] Next, in step S402, the user registers a reference image to be used as the basis for inspection. The inspection device 0108 starts reading the reference image, and the client computer 0110 executes a print job for reference image registration. The reference image is the image used as a basis for evaluating the printed image. Alternatively, a test print of the item to be inspected may be used to register the reference image.

[0035] Next, in step S403, the user configures the inspection settings, including various inspection parameters, inspection areas, and inspection levels. Details will be described later.

[0036] Next, in step S404, the user starts the inspection on the inspection device 0108 and executes a print job for inspection on the client computer 0110. When printing is executed, the inspection unit 0106 detects the paper feed and scans the paper with CIS 0315 and 0316. The scanned image is sent to the inspection device 0108 and stored in its RAM 0227. The stored image is compared with a reference image to obtain the inspection result. The inspection is performed based on the settings specified by the user in the inspection settings.

[0037] ● Font PUUI Next, the details of font registration will be explained using the UI diagrams in Figures 5 and 6, and the flowchart in Figure 7. Figure 5 is an example of a font registration screen that is displayed on UI panel 0102 and accepts font registration operations from the user.

[0038] In the initial state of the font registration screen, the preview image 504 is not displayed because the image to be registered has not yet been loaded. Instead, the scan image loading start button 501 and the character area selection button 502 are displayed. When the loading start button 501 is touched, the image for font registration is printed, and that scanned image is loaded by the inspection unit 106 and displayed on the preview display screen 504 of the UI panel 0102.

[0039] In this state, after the user presses the text area selection button 502, the selection operation for the text area is accepted by selecting the frame indicating the text area with a mouse click or the like. After the user presses the text area placement button 503, the placement operation such as moving or resizing the text area is accepted by manipulating the selected text area 505 on the preview display with a mouse drag or the like. The user selects a text area that includes the string containing the characters to be registered as a font. The setting field 506 is for setting the direction of the string in the selected text area. The direction of the string is set by the angle of the characters relative to a predetermined reference direction. 507 is a button to start character extraction, and pressing button 507 transitions to the character extraction screen in Figure 6. Touching the complete button 508 completes the font registration process.

[0040] Figure 6 shows the character extraction screen displayed in UI panel 0102. Preview screen 601 is a screen that displays a preview of the image extracted from the character area. A preview of the character area 505 set by the user in the font registration screen is displayed, and a frame indicating the coordinates of the character extraction result is displayed on the preview.

[0041] The font name input field 602 is for entering the font name of the registered font. The font size input field 603 is for entering the font size of the registered font. The text box 604 is for entering the character cropping image of the character area and the characters (text) to be associated with the character cropping image. The character cropping image is an image created by cropping each character of the string contained in the character area 505. Pressing the register button 605 completes the input of the registered font information, closes the screen, and transitions to the font registration screen shown in Figure 5.

[0042] ●Font registration process Figure 7 shows the processing performed by the inspection device 0108 when a font registration operation is performed on the inspection device 0108. The CPU 0226 receives operations from the user via the font registration screen and character extraction screen displayed on the UI panel 0102 and executes various processes to set up the inspection.

[0043] In S701, CPU0226 receives a command to start reading scanned images from the font registration screen. In this embodiment, the command to start reading scanned images is the user pressing the scan image reading start button 501. When CPU0226 receives the press of the scan image reading start button 501, it enters a state of waiting to receive scanned images of the print job. Thereafter, when a print job is executed, the scanned image is read.

[0044] In S702, the user executes a print job for font registration on client computer 0110. CPU 0226 receives the scanned image of the printout from inspection unit 0106 via inspection device I / F 0215 and inspection unit I / F 0231. Subsequently, CPU 0226 displays the scanned image on the font registration screen preview display screen 504.

[0045] In S703, CPU0226 terminates the waiting state for receiving scanned images of the printed document.

[0046] In S704, CPU0226 accepts character area setting operations from the font registration screen. The user sets the character area on the preview of the loaded image using the character area selection button 502, the character area placement button 503, and the text direction setting field 506. The character area is set on the scanned image according to these operations.

[0047] In S705, CPU0226 accepts a character extraction operation from the font registration screen. In this embodiment, the character extraction operation is the pressing of button 507 to start character extraction. After receiving the press of button 507 to start character extraction, CPU0226 executes the character extraction process for the characters contained in the character area and transitions to the character extraction screen. The character extraction process is, for example, a process that calculates a histogram of pixel values ​​for the image of the character area and extracts the area where this pixel value histogram protrudes as a character extraction image. This character extraction method is just one example, and there are various other forms besides those shown in this embodiment. The extracted characters are displayed one by one to the left of the text box 604 shown in Figure 6, but this display may show the extracted characters sequentially, or it may show the extracted characters according to the user's operation.

[0048] In S706, CPU0226 accepts input from the character extraction screen for the character code to be associated with the extracted image. In this embodiment, the user enters text in text box 604. The text is entered as the corresponding character code.

[0049] In S707, CPU0226 accepts input operations for font name and font size from the character extraction screen. Input operations for font name and font size refer to inputting the font name in input field 602 and the font size in input field 603 for registered fonts by the user.

[0050] In S708, CPU0226 accepts a registration operation from the character extraction screen. In this embodiment, the registration operation is the user pressing the registration button 605. Subsequently, CPU0226 saves the entered font name, font size, character extraction image, corresponding character, character recognition process to be used, and preprocessing parameters as registered font data in storage unit 0228. The character recognition process and preprocessing parameters to be used may be predetermined values ​​or separately specified values.

[0051] Font settings are configured for each font and size used in the printed material being inspected. For example, if multiple text areas are defined in a single scanned image, font settings will be applied to each area. Conversely, a single continuous area containing characters to which a common font setting applies can be selected as a text area.

[0052] ●Setting the details of the examination Next, the details of the inspection settings will be explained using the UI diagrams in Figures 8A, 8B, and 12, and the flowchart in Figure 9. The inspection settings are started by selecting the reference image registered in the reference registration.

[0053] Figure 8A shows an example of the inspection settings screen displayed on UI panel 0102, which accepts user input for performing inspection settings. On the inspection settings screen, the user places the inspection area (also called the area to be inspected) on the preview of the reference image and sets individual settings for each inspection area. The inspection settings screen is displayed accordingly when an operation to perform inspection settings is performed.

[0054] The preview screen 801 displays the registered reference images. Reference images are images used as a standard for evaluating printed materials and are saved on a page-by-page basis. For reference images in multi-page print jobs, the system accepts the operation to switch between pages in the preview display, allowing the reference images for each page to be shown.

[0055] Inspection frames 802 and 803 are frames that show examples of inspection areas to be placed on the preview display screen 801. Inspection areas can be placed on the preview display screen 801 in response to touching the inspection area placement button 805, and their size and position can be changed by the user through operations such as mouse dragging. Inspection frame 802 shows an example where an image is placed as the inspection area. Inspection frame 803 shows an example where a string of characters is placed as the inspection area.

[0056] The inspection area selection button 804 is a button used to select an inspection area. When a user presses the inspection area selection button 804 and then clicks, for example, the inspection frames 802 and 803 that indicate the inspection areas with the mouse, the system accepts the operation to select an inspection area, and the clicked inspection area becomes selected.

[0057] The inspection area placement button 805 is used to set the inspection area. After the user presses the inspection area placement button 805, they select the type of inspection area from the displayed pull-down menu, and then select the area they want to specify as the inspection area on the preview display by dragging the mouse or performing other operations. This sets the inspection area. The types of inspection areas include text, barcodes, patterns (images), etc., and the type of inspection may be determined for each type of inspection area. The inspection may involve evaluating the quality of the image formed within the inspection area according to the set type, and determining whether the evaluation result has reached a predetermined level. The inspection includes data inspection when barcodes or text are set as the type of inspection area, and image quality inspection when images are set.

[0058] Setting item 806 is a setting item for selecting the data for the matching inspection using a file selection method. The data for the matching inspection is a reference CSV file used for data inspection, which is used to compare the data in the inspection area when performing data inspection. The reference CSV file is a file that the user must prepare in advance and lists the correct strings for string inspection and barcode inspection. When performing data inspection, if the type of the selected inspection area is string, the string recognized from the image of that inspection area is compared with the correct strings listed in the reference CSV file. If the type of the selected inspection area is barcode, the string decoded from the image of that inspection area is compared with the correct strings listed in the reference CSV file.

[0059] The settings field 807 for the selected area displays individual (or unique) settings for each inspection area selected by the inspection area selection button 804. Figure 8A shows the case where the type of the selected inspection area is a string.

[0060] In the page range setting section 808, users can specify the range of pages on which the inspection targeting the selected inspection area will be performed by clicking the buttons located there. If no page range is selected, the selected inspection area will be placed only on the page currently displayed in the preview screen. If "Same side as current page" is selected, the selected inspection area will be placed on the same side of the sheet, depending on whether the selected inspection area is located on the front or back of the sheet. If "All pages" is selected, the selected inspection area will be placed on all pages. Note that the inspection area is set on the page registered as the reference image data, and pages may be numbered according to the printing order or registration order.

[0061] The string inspection settings field 809 is a string inspection setting item that appears when the string inspection area 803 is selected. For each inspection area, you can set the angle of the inspection area, the font of the string, whether to perform a matching check, and, if a matching check is performed, which column of the reference CSV selected in setting item 806 to compare against.

[0062] The font settings field 810 is a font setting item that appears when the text inspection area 803 is selected. It displays an item for selecting the text font and accepts the font selection from the user. The font setting may be saved in association with the inspection area.

[0063] The font suggestion checkbox 811 is a setting item that allows you to choose whether or not to suggest fonts when the string inspection area 803 is placed. By clicking checkbox 811, the user can choose either "Suggest" or "Do not suggest". If "Suggest" is selected, the process of storing registered font data in the candidate list will be filtered (the process is described below). If "Do not suggest" is selected, the process of storing registered font data in the candidate list will not be filtered. In other words, all registered font data will be stored in the candidate list.

[0064] The Complete button 812 is used to complete the inspection settings. When the user presses the Complete button 812, the inspection settings are completed, saved to the storage unit 0228, and the inspection settings process ends. If there are inconsistencies in the settings, the Complete button 812 for the inspection settings may be disabled so that it cannot be pressed. An example of a setting inconsistency is that there is an inspection area for performing a matching inspection, but the setting item 806 for the matching inspection data is not set.

[0065] The Cancel button 813 is used to cancel the inspection settings. When the user presses the Cancel button 813, the settings are discarded and the inspection setting process is terminated.

[0066] Figure 8B shows an example of the candidate list displayed when selecting a font for a string, as shown in the string inspection settings section 809. The candidate list is displayed when accepting a font selection from the user.

[0067] Dropdown 814 is a dropdown menu that appears when accepting font selection from the user. In one example, the font candidate list generated by the process of storing registered font data in a candidate list (details of which will be described later) is displayed in dropdown 814. By selecting registered font data from the candidate list displayed in the dropdown, the font to be used for inspection is set in the font setting field 810.

[0068] Figure 12 shows an example of dialog 1201 displayed in UI panel 0102. Dialog 1201 is displayed when no font candidates are found during the process of determining whether registered font data exists in the candidate list (details of which will be described later).

[0069] ● Inspection setting process Figure 9 shows the processing in the information processing device 0109 when an inspection setting start operation is performed on the inspection device 0108. The CPU 0234 executes various processes for setting the inspection area based on user operations on the inspection setting screen and inspection area list displayed on the UI panel 0102. Note that Figure 9 explains the setting of a string-type inspection area; other types are omitted. At the start of Figure 9, reference image data has been received from the inspection device 0108. The inspection setting screen is also displayed. The information processing device 0109 is sometimes called an inspection setting device or inspection setting system because it performs inspection settings such as the area and range to be inspected. In this example, the inspection settings (inspection setting information) entered in the information processing device 0109 are transmitted to the inspection device 0108, and the inspection is performed using this information.

[0070] In S901, CPU0234 accepts the operation to set the data for the matching inspection from the inspection settings screen. In this embodiment, the operation to set the data for the matching inspection refers to the operation of the matching inspection data setting item 807 by the user.

[0071] In S902, CPU0234 accepts inspection area placement operations from the inspection settings screen. In this embodiment, inspection area placement operations refer to the user's operation of the inspection area placement button 805 and the corresponding settings for the placement and type of the inspection areas.

[0072] In S903, CPU0234 processes the process of selecting and storing font candidates from the registered fonts for the inspection area received in S902. This process will be described later using the flowchart in Figure 10.

[0073] In S904, CPU0234 accepts the selection of the inspection area from the inspection settings screen. In this embodiment, the selection of the inspection area refers to the user selecting an inspection area and operating the inspection area selection button 804.

[0074] In S905, CPU0234 accepts setting operations for each inspection area from the inspection settings screen. In this embodiment, setting operations for each inspection area refer to the user's operation of setting item 808 for each inspection area. In other words, S905 accepts operations for setting the page range and setting the string inspection. However, the settings in S905 do not include font settings.

[0075] In S906, CPU0234 accepts a font selection operation from the string inspection settings screen. In this embodiment, the font selection operation is the user's operation on the string inspection settings item 809. The user can also select a font from the font candidates determined in S903, reducing the effort required for selection. In Figure 9, the settings other than font (S905) are performed before the font settings (S906), but this is for the convenience of explaining the font settings, and there are no particular restrictions on the order of setting the inspection area.

[0076] In S907, CPU0234 displays the candidate list obtained in S903 on the pull-down menu 814 (Figure 8B) according to the operation in the font setting field 810. The candidate list may be displayed in any way; it may display only the registered font data included in the candidate list, or it may display all registered font data while highlighting the registered font data included in the candidate list. Alternatively, the registered font data may be displayed in order of highest likelihood.

[0077] The display of registered font data is explained using Figures 14(a), (b), (c), and (d). Figure 14(a) shows an example of all registered font data 1401. Figure 14(b) shows an example of candidate list 1402. Figure 14(c) displays only the registered font data included in candidate list 1402 on the pull-down menu 814. Figure 14(d) displays all registered font data while highlighting the registered font data included in the candidate list.

[0078] In S908, CPU0234 accepts a registered font data selection operation from pull-down 814. In this embodiment, the registered font data selection operation is the operation by the user to select a font from pull-down 814.

[0079] In step S909, CPU0234 determines whether the user has completed the inspection settings. If the inspection settings are complete, the user presses the inspection settings completion button 812 and proceeds to S910. If the inspection settings are not complete, the user continues the inspection settings. In S910, CPU0234 transmits the configured information (setting information) to the inspection device 0108. The inspection device 0108 saves the setting information to the storage unit 0228 and terminates the inspection setting process. Note that the process in Figure 8 may be executed by the inspection device 0108 instead of the information processing device 0109. In that case, the setting information may be saved as is without being transmitted in step S910. Note that the configured registered font data is used as a reference for character recognition and is therefore called the reference font or reference font data.

[0080] The inspection settings are configured according to the procedure described above. For the text inspection area, the font data selected from the registered font data that are candidates for setting is set. During inspection, the text image corresponding to the position and range of the text inspection area is extracted from the document image read from the printed sheet and becomes the subject of character recognition based on the set font data (set font). The result of character recognition is evaluated in the same manner as step S1003 in Figure 10, which will be described later, and it is determined whether it matches or does not match the set font.

[0081] Figure 10 is a flowchart detailing the process (S903) for storing registered font data in a candidate list. CPU 0234 of client computer 0109 performs various processes to calculate font candidates.

[0082] In S1001, CPU0234 retrieves all registered font data from memory unit0236 to RAM0233. The registered font data is the data registered using the UI and procedure described in Figures 6 and 7.

[0083] In S1002, CPU0234 determines whether the font presentation function 811 is set to "present". If it is set to "present", proceed to S1003; otherwise, proceed to S1009.

[0084] In S1003, CPU0234 performs character recognition processing on the inspection area using registered font data and measures the likelihood. If there are multiple sets of registered font data, this process is performed by sequentially focusing on one of them and using the selected registered font data. Likelihood is the probability that the string in the inspection area is identical to the character image in the registered font data. In this embodiment, the character recognition processing compares the image in the selected registered font data with the character image included in the inspection area of ​​the image to be read, and recognizes the string data of the registered font image with the highest similarity as the recognition result. This similarity is also referred to as the likelihood. For example, when performing character recognition using a statistical discriminant function such as Bayesian discrimination, the likelihood can be obtained from the feature quantities of the input characters and the feature quantities of the reference characters, and that value may be used. Also, as mentioned above, the likelihood in this embodiment indicates similarity, so if similarity is expressed as the distance between feature quantities (feature vectors), then that distance can be called the similarity or likelihood.

[0085] In step S1004, CPU0234 determines whether the likelihood measured in S1003 is above a threshold. If the likelihood is above the threshold, the process proceeds to S1005; otherwise, it proceeds to S1006. For example, in step S1003, character recognition of the image within the inspection area may be performed using the registered font data of interest as a reference, in the same manner as character recognition performed in the actual inspection. As a result, it may be determined in step S1004 whether the likelihood of the recognized character is above a threshold.

[0086] If the inspection area contains multiple characters, the likelihood can be calculated for each character for each registered font, and in step S1004, it can be determined whether the likelihood for all of those characters is above the threshold. Alternatively, the likelihood can be calculated for each character, and in step S1004, it can be determined whether the average likelihood of those characters is above the threshold.

[0087] In S1005, CPU0234 stores registered font data whose likelihood is determined to be above the threshold into the candidate list.

[0088] In S1006, CPU0234 determines whether character recognition processing has been completed for all registered font data. If not, it proceeds to S1003 and repeats the process, focusing on a new set of registered font data. If completed, it proceeds to S1007.

[0089] In S1007, CPU0234 determines whether registered font data exists in the candidate list. If it does not exist, the process proceeds to S1008; if it does exist, the process of storing the registered font data in the candidate list is terminated.

[0090] In S1008, CPU0234 displays a warning on UI panel 0203, stating, "No font candidates found. Please register a font." The warning is, for example, the dialog box 1201 shown in Figure 12. Note that the warning message is just an example and is not limited to this.

[0091] At S1009, CPU0234 stores all registered font data in the candidate list. After that, CPU0234 terminates the process of storing registered font data in the candidate list.

[0092] In step S1003 of Figure 10, the likelihood may be calculated for all test areas within the page containing the current test area (referred to as the page of interest), and steps S1004 and S1005 may be performed for each test area. In this case, a candidate list is created on a page-by-page basis. Alternatively, steps S1001 to S1009 may be performed for each test area to create a candidate list associated with each test area. In this case, in step S907 of Figure 9, the registered fonts of the candidate list associated with the selected test area will be displayed. Furthermore, the candidate list may be associated with all pages to be tested, including multiple pages (i.e., all pages included in the reference image).

[0093] Through the above process, if there is registered font data containing characters corresponding to the characters in the inspection area of ​​the reference image, that registered font data is registered in the candidate list as a candidate for the font setting of that inspection area. On the other hand, if there is no matching registered font, all registered fonts are registered in the candidate list.

[0094] ● Inspection process Next, the details of the inspection will be explained using the flowchart in Figure 11. In response to an instruction to execute the inspection process via the input device of the inspection apparatus or the UI panel 0102 of the image forming apparatus 0101, the CPU 0226 of the inspection apparatus 0108 executes various processes for performing the inspection.

[0095] In S1101, CPU0226 reads the inspection settings from memory unit 0228 to RAM0227 and starts reading the scanned image. CPU0226 then enters a state of waiting to receive the scanned image of the printout, and thereafter, when a print job is executed, the scanned image is read.

[0096] In S1102, the user executes the print job to be inspected on client computer 0110. CPU 0226 receives the image of the printed material scanned by inspection unit 0106 from inspection unit 0106 via inspection device I / F 0215 and inspection unit I / F 0231.

[0097] In S1103, CPU0226 acquires an image (referred to as the inspection area image) corresponding to the inspection area specified in the inspection settings from the scan image received from inspection unit 0106.

[0098] In S1104, CPU0226 performs character recognition processing on the inspection area image using registered font data. This character recognition processing can be performed in the same manner as in step S1003 in Figure 10.

[0099] In step S1105, CPU0226 compares the character recognition results with the reference CSV file (correct CSV). If the comparison is found to be inconsistent, the inspection result for that inspection area is set to NG; if they match, it is set to OK. In step S1105, for string-type inspection areas, character recognition is performed based on the font data associated with that inspection area and compared with the reference CSV data. In other words, it is determined whether the character image in the inspection area matches the set font data in terms of font type, size, and orientation.

[0100] In S1106, CPU0226 determines whether the inspection of the inspection area specified in the inspection settings has been completed. If it has been completed, it proceeds to S1107; otherwise, it proceeds to S1103.

[0101] In S1107, CPU0226 determines the inspection result. If the inspection of all inspection areas in the scanned image is OK, proceed to S1108; otherwise, proceed to S1109.

[0102] In S1108, CPU0226 instructs the high-capacity stacker 0107 to output the printouts that have passed inspection to the main tray of the output section 0223 of the high-capacity stacker 0107.

[0103] In S1109, CPU0226 instructs the high-capacity stacker 0107 to output the printouts that fail inspection to the top tray of the output section 0223 of the high-capacity stacker 0107.

[0104] In S1110, CPU0226 determines whether the inspection of the printed material to be inspected is complete. If it is not complete, proceed to S1102; if it is complete, proceed to S1111.

[0105] At S1111, CPU0226 terminates the waiting state for the scanned image of the printed document. After that, CPU0226 terminates the inspection process.

[0106] According to the above procedure, this embodiment allows users to set fonts without extra effort by presenting them with font options before confirming the font setting for the inspection area. Furthermore, by selecting from similar fonts, the font can be set accurately.

[0107] (Second embodiment) When an inspection area (hereinafter referred to as the "placed inspection area") is enclosed, there are cases where this placed inspection area and an inspection area enclosed on another page (hereinafter referred to as the "inspection area on another page") are located close together. In this case, there is a high probability that the placed inspection area and the inspection area on the other page use the same font. Therefore, by narrowing down the registered font data for which candidates are sought, the number of processes required to calculate the likelihood can be reduced, and the processing speed can be increased. In the second embodiment, when the placed inspection area and the inspection area on the other page are located close together, the candidate list presented in the inspection area on the other page is used to further narrow down the registered font data candidates. Note that the parts common to the above embodiment will be omitted from the explanation.

[0108] Figure 13 is a flowchart showing the process for calculating font candidates in the second embodiment. CPU 0234 of client computer 0109 performs various processes for calculating font candidates.

[0109] The processes in S1001 to S1002 are the same as the corresponding processing steps in the flowchart in Figure 10.

[0110] In S1301, CPU0234 determines whether a test area exists on another page. If it does, it proceeds to S1302; otherwise, it proceeds to S1003.

[0111] In S1302, CPU0234 calculates the similarity between the placed inspection area and the inspection area on another page. For example, when the page containing the placed inspection area is placed on top of another page, the similarity is calculated by dividing the overlapping area of ​​the inspection areas on the two pages by the area of ​​the placed inspection area. This page overlay is done in the data. Note that this is not the only way to calculate the similarity. Here, the other page may be a page prior to the page containing the inspection area currently being processed, i.e., a page for which a candidate list has already been created.

[0112] In S1303, CPU0234 determines whether it has calculated the similarity of all the inspection areas on different pages. If it has calculated all of them, it proceeds to S1304; otherwise, it proceeds to S1302.

[0113] In S1304, CPU0234 determines whether the highest similarity score is greater than the threshold. If it is greater than the threshold, proceed to S1304; otherwise, proceed to S1003.

[0114] In S1305, CPU0234 obtains a candidate list for the inspection area on another page with the highest similarity and overwrites the registered font data obtained in S1001. In this case, a candidate list is created for each inspection area. The inspection area on another page with the highest similarity is called the corresponding inspection area in relation to the original inspection area.

[0115] The processes in S1003 to S1009 are the same as the corresponding processing steps in the flowchart in Figure 10.

[0116] According to this embodiment, if the inspection area on one page is close to the inspection area on another page, the candidate list presented in the inspection area on the other page is used to further narrow down the list of registered font data candidates. This reduces the number of registered font data for which likelihood is calculated, thereby increasing processing speed.

[0117] The procedure shown in Figure 13 may also be performed using the inspection device 0108.

[0118] [Other examples] The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit (e.g., an ASIC) that implements one or more functions.

[0119] The invention is not limited to the embodiments described above, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, claims are attached to disclose the scope of the invention. [Explanation of Symbols]

[0120] 0101 Image forming apparatus, 0106 Inspection unit, 0108 Inspection device, 0107 High-capacity stacker, 0109 Information processing device, 0110 Client computer

Claims

1. a preview means for displaying a setting screen including a preview display of a reference image by a display means; a registration means for registering in a candidate list font data which is a candidate for reference font data serving as a standard for character recognition when inspecting a printed matter, in association with the inspection area of ​​the reference image set on the setting screen; a setting means for setting the reference font data on the setting screen in accordance with a user's selection from the candidate list, The registration means registers, in the candidate list, font data corresponding to the character string in the inspection area of ​​the reference image, among pre-registered registered font data.

23. An information processing apparatus comprising:

2. 2. The information processing device according to claim 1, 2. An information processing apparatus comprising: font data corresponding to the character string in the inspection area, the font data having a similarity to the character string in the inspection area exceeding a threshold value.

3. 3. The information processing device according to claim 2, When there is no font data whose similarity exceeds the threshold, the registration means registers all of the registered font data in the candidate list.

23. An information processing apparatus comprising:

4. 4. The information processing device according to claim 3, When there is no font data having the degree of similarity exceeding the threshold value, the registration means further notifies a user that there is no font data to be registered in the candidate list.

23. An information processing apparatus comprising:

5. 5. The information processing device according to claim 2, The registration means performs character recognition on the inspection area using the registered font data as a reference, and registers font data whose similarity exceeds the threshold in the candidate list.

23. An information processing apparatus comprising:

6. 6. The information processing device according to claim 1, a second setting unit for setting whether or not the candidate list is to be displayed when the reference font data is set by the setting unit, If the second setting means has not set the display of the candidate list, the registration means registers all of the registered font data in the candidate list.

23. An information processing apparatus comprising:

7. 6. The information processing device according to claim 2, When there is another page including a corresponding inspection area corresponding to the inspection area, the registration means registers, in the candidate list associated with the corresponding inspection area, font data whose similarity with the character string in the inspection area exceeds the threshold.

23. An information processing apparatus comprising:

8. 8. The information processing device according to claim 1, The display means displays a character image on the display screen, and the character image is selected from the character image displayed on the display means. The display means displays a character image on the display screen.

23. An information processing apparatus comprising:

9. 9. The information processing device according to claim 1, The setting means displays the names of the font data included in the candidate list as a list, and sets the font data selected from the list as the reference font data.

23. An information processing apparatus comprising:

10. An information processing device according to any one of claims 1 to 9; An image forming apparatus; an inspection device that inspects a character image formed by the image forming device using the reference font data set by the setting means.

1. An inspection system comprising:

11. A program for causing a computer to function as the information processing device according to any one of claims 1 to 9.

12. A setting method for inspecting an image by an information processing device having a preview means, a registration means, and a setting means, comprising: the preview means displays a setting screen including a preview display of a reference image on a display means; the registration means registers, in a candidate list, font data to be candidates for reference font data that serves as a standard for character recognition when inspecting a printed matter, in association with the inspection area of ​​the reference image set on the setting screen; the setting means sets the reference font data on the setting screen in response to a user's selection from the candidate list; When the font data is registered in the candidate list, font data having a similarity to the character string in the inspection area of ​​the reference image that exceeds a threshold value among pre-registered registered font data is registered in the candidate list. A setting method comprising:

Images