Information processor, control method for information processor, and program

Abstract

To provide a screen in which character strings corresponding to each attribute to be masked in image data as an edition target are displayed, and an indication is also performed to indicate that character strings have not been acquired for the attribute from which the corresponding character strings have not been acquired.SOLUTION: An information processor MFP manages a plurality of attributes related to character strings as targets of masking while associating the attributes with one item, acquires character strings corresponding to each of the plurality of attributes to be managed while being associated with the one item from the plurality of character strings obtained by performing character recognition processing on image data of an edition target, on the basis of selection of the one item, provides a screen in which the acquired character strings corresponding to each of the plurality of attributes are displayed while being associated with each of the plurality of attributes, and indicates that character strings have not been acquired for the attribute from which corresponding character strings have not been acquired among the plurality of attributes, on the provided screen.SELECTED DRAWING: Figure 4

Description

Technical Field

[0001] The present invention relates to a technique for masking scanned images.

Background Art

[0002] When sharing documents containing personal information or secrets, such as identification documents, application forms, and drawings, with others, it may be necessary to mask (also referred to as "blacking out" or "masking") a part of the document. Patent Document 1 discloses a technique for masking confidential information corresponding to attributes such as "name", "date of birth", and "address" registered in advance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] When masking confidential information corresponding to attributes registered in advance as in Patent Document 1, depending on the image data, it is conceivable that the character string corresponding to the registered attribute cannot be obtained from the image data. For example, it is conceivable that the character string corresponding to the attribute is not properly recognized from the image data, or that the character string corresponding to the attribute is not included in the image data at all. At this time, the user may want to check the character strings corresponding to each attribute to be masked in the image data to be edited, and also check the attributes for which the corresponding character strings have not been obtained.

[0005] Therefore, an object of the present invention is to provide a screen on which the character strings corresponding to each attribute to be masked in the image data to be edited are displayed, and for the attributes for which the corresponding character strings have not been obtained, a display indicating that the character strings have not been obtained is made.

Means for Solving the Problems

[0006] In order to achieve the above object, an information processing apparatus according to the present invention includes: a management means for managing a plurality of attributes related to a character string to be masked by associating them with one item; an acquisition means for acquiring, from a plurality of character strings obtained by character recognition processing on image data to be edited, a character string corresponding to each of the plurality of attributes managed in association with the one item based on the selection of the one item; and a provision means for providing a screen on which the character strings corresponding to each of the plurality of acquired attributes are displayed in association with each of the plurality of attributes. In the provided screen, for an attribute for which a corresponding character string has not been acquired among the plurality of attributes, a display indicating that the character string has not been acquired is made.

Advantages of the Invention

[0007] According to the information processing apparatus of the present invention, it is possible to provide a screen on which character strings corresponding to respective attributes masked in image data to be edited are displayed, and for an attribute for which a corresponding character string has not been acquired, a display indicating that the character string has not been acquired is made.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Embodiments for Carrying Out the Invention

[0009] Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings. Note that the following embodiments do not limit the invention according to the claims, and not all combinations of the features described in the embodiments are essential for the solution means of the invention.

[0010] <The First Embodiment> <Overall Configuration> FIG. 1 is a diagram showing the overall configuration of the present system. The image processing system of FIG. 1 includes an MFP (Multifunction Peripheral) 110 and an external storage 120. The MFP 110 is communicably connected to a server that provides various services on the Internet via a LAN (Local Area Network).

[0011] The MFP 110 is a multifunction device having a plurality of functions such as a scanner and a printer, and is an example of the information processing apparatus of the present invention. The MFP 110 also has a function of transferring a scanned image file to a service capable of file storage such as an external storage service. Note that the information processing apparatus of the present invention is not limited to a multifunction device having a scanner and a printer, and may be a PC. Further, it may be a server that performs the processing of the attribute classification unit 428 described later and provides a screen displayed based on the data obtained by the processing to the communicably connected MFP 110 or the like.

[0012] The external storage (service) 120 is a service capable of storing a file received via the Internet or acquiring a file from an external device via a web browser. The external storage 120 is, for example, a cloud service. There may be a plurality of external storages, not limited to just 120.

[0013] The image processing system of the present embodiment is configured to include the MFP 110, the external storage 120, and the external storage 130, but is not limited thereto. For example, part of the functions and processing of the MFP 110 may be implemented on another server arranged on the Internet or the LAN. Further, the external storage 120 may be arranged on the LAN instead of on the Internet. Furthermore, the external storage 120 may be replaced with a mail server or the like, and the scanned image may be attached to and sent by mail. The MFP 110 may also have the storage function of the external storage 120.

[0014] <Hardware Configuration of MFP> Figure 2 is a hardware configuration diagram of the MFP 110. The MFP 110 is composed of a control unit 210, an operation unit 220, a printer unit 221, a scanner unit 222, and a modem 223. The control unit 210 is composed of the following units 211 to 219 and controls the operation of the entire MFP 110. The CPU 211 reads out control programs stored in the ROM 212 and the HDD 214 and executes and controls various functions of the MFP 110 such as reading / printing / communication. The RAM 213 is used as a temporary storage area such as the main memory and work area of the CPU 211. In this embodiment, it is assumed that one CPU 211 executes each process shown in the flowchart below using one memory (RAM 213 or HDD 214), but it is not limited to this. For example, a plurality of CPUs, a plurality of RAMs, or HDDs may cooperate to execute each process. The HDD 214 is a large-capacity storage unit that stores image data and various programs.

[0015] The operation unit I / F 215 is an interface that connects the operation unit 220 and the control unit 210. The operation unit 220 is equipped with a touch panel, a keyboard, etc., and receives operations / inputs / instructions from the user. The printer I / F 216 is an interface that connects the printer unit 221 and the control unit 210. Image data for printing is transferred from the control unit 210 to the printer unit 221 via the printer I / F 216 and printed on a recording medium. The scanner I / F 217 is an interface that connects the scanner unit 222 and the control unit 210. The scanner unit 222 reads a document set on a document table or an ADF (Auto Document Feeder) (not shown) to generate image data and inputs it to the control unit 210 via the scanner I / F 217. The MFP 110 can print out (copy) the image data generated by the scanner unit 222 from the printer unit 221, and can also send files or send emails. The modem I / F 218 is an interface that connects the modem 223 and the control unit 210. The modem 223 performs facsimile communication of image data with a facsimile device on the PSTN. The network I / F 219 is an interface that connects the control unit 210 (MFP 110) to a LAN. The MFP 110 uses the network I / F 219 to send image data and information to various services on the Internet and receive various information.

[0016] <Hardware Configuration of External Storage> FIG. 3 is a hardware configuration diagram of the external storage 120. The external storage 120 is composed of a CPU 311, a ROM 312, a RAM 313, an HDD 314, and a network I / F 315. The CPU 311 controls the overall operation by reading out the control program stored in the ROM 312 and executing various processes. The RAM 313 is used as a temporary storage area such as the main memory and work area of the CPU 311. The HDD 314 is a large-capacity storage unit that stores image data and various programs. The network I / F 315 is an interface that connects the external storage 120 to the Internet. The external storage 120 receives a processing request from another device (such as the MFP 110) via the network I / F 315 and transmits and receives various information.

[0017] <Software Configuration of MFP> FIG. 4 is a software configuration diagram of the image processing system according to the present embodiment. The MFP 110 is roughly divided into two major parts: a native function unit 410 and an additional function unit 420. Each function unit is realized by the CPU 211 reading out the program stored in the ROM 212 or HDD 214 of the MFP 110 into the RAM 213 and executing it. Each part included in the native function unit 410 is standardly provided in the MFP 110, while the additional function unit 420 is an application additionally installed in the MFP 110. The additional function unit 420 is an application based on Java (registered trademark), and can easily realize the addition of functions to the MFP 110. Note that other additional applications (not shown) may be installed in the MFP 110.

[0018] The native function unit 410 has a scan execution unit 411, an image data storage unit 412, and a print execution unit 413. The additional function unit 420 has a display control unit 421, a scan instruction unit 422, an image processing unit 423, a data management unit 424, a print instruction unit 425, a data conversion unit 426, and an external storage access unit 427.

[0019] The display control unit 421 displays a UI (user interface) screen for receiving operations by the user on the liquid crystal display unit having the touch panel function of the operation unit 220 of the MFP 110. For example, it displays an operation screen for receiving operations such as scan settings, scan start operations, previews of scanned images, designation operations of mask areas described later, previews of mask composite images, output settings, and output start operations.

[0020] The scan instruction unit 422 requests a scan process according to the scan settings input via the UI screen to the scan execution unit 411. The scan execution unit 411 receives a scan request including the scan settings from the scan instruction unit 422. The scan execution unit 411 generates scan image data by reading a document placed on the document table glass with the scanner 222 via the scanner I / F 217 according to the scan request. The generated scan image data is sent to the image data storage unit 412. The scan execution unit 411 sends an image identifier uniquely indicating the stored scan image data to the scan instruction unit 422. The image identifier is a number, symbol, alphabet, etc. for uniquely identifying an image scanned by the MFP 110 (not shown). The image data storage unit 412 stores the scan image data received from the scan execution unit 411 in the HDD 214.

[0021] The image processing unit 423 performs analysis processing and processing on the scanned image. The image processing unit 423 receives an image identifier from the scan instruction unit 422 and acquires the scanned image data corresponding to the image identifier from the image data storage unit 412. The image processing unit 423 performs recognition processing on the image, such as character area analysis, OCR (Optical Character Recognition), barcode area analysis, and rotation and inclination correction of the image, within the acquired image data. Further, the image processing unit 423 has learning data in advance for determining whether the scanned document is a standard document or a non-standard document, and determines that the scanned image is a standard document if it is similar to the learned standard document from the analysis result of the scanned image. In addition, the image processing unit 423 synthesizes a mask image according to the area designation process (described in FIG. 6 below) corresponding to the mask area and the like input via the UI screen, and instructs the image data storage unit 412 to store the generated mask composite image data. The image processing unit 423 sends the image identifier to the print instruction unit 425, the data conversion unit 426, and the external storage access unit 427 according to the output settings set for the image after mask synthesis.

[0022] The data management unit 424 associates and holds information such as the coordinates specified in the area designation process, the character string, the attribute, the file name, and the storage destination with the image identifier. Further, the coordinates, the character string, the attribute, the file name, and the storage destination specified in the area designation process are stored in the HDD 214 as presets. In the present embodiment, the preset is a template in which information indicating the coordinates, the character string, the attribute, the file name of the file including the scanned image, and the storage destination of the area to be masked of the scanned image is stored in association with the document type. By selecting an item indicating the document type displayed as a preset button on the screen 800 described later, processing can be performed using the settings stored in the template without making individual settings again. Note that the attribute will be described later.

[0023] The printing instruction unit 425 sends a request for printing processing according to the printing settings input via the UI screen to the printing execution unit 413 and the image identifier received from the image processing unit 423. The printing execution unit 413 receives the printing request including the printing settings from the printing instruction unit 425 and the image identifier. The printing execution unit 413 acquires from the image data storage unit 412 corresponding to the image identifier and generates image data for printing according to the printing request. The printing execution unit 413 prints the mask composite image on the recording medium by the printer 221 via the printer I / F 216 according to the generated image data for printing.

[0024] The data conversion unit 426 acquires the image corresponding to the image identifier received from the image processing unit 423 from the image data storage unit 412 and converts it into a file format according to the output settings input via the UI screen. The data conversion unit 426 acquires the file name corresponding to the image identifier received from the image processing unit 423 from the data management unit and sets it as the file name of the converted file. The data conversion unit 426 sends the converted file and the corresponding image identifier to the data management unit 424, and the data management unit 424 holds the received file in association with the image identifier.

[0025] The external storage access unit 427 sends a processing request to a cloud service or the like that provides a storage function (storage service). Cloud services generally expose various interfaces for storing files in cloud storage or retrieving stored files from external devices using protocols such as REST and SOAP. The external storage access unit 426 uses the exposed interface of the cloud service to operate the cloud service. The external storage access unit 427 acquires the file corresponding to the image identifier received from the image processing unit 423 and the transmission information from the data management unit 424. The external storage access unit 426 uses the transmission information acquired from the data management unit 424 to send the file acquired from the data management unit 424 to the external storage 120 via the network I / F.

[0026] The attribute classification unit 428 classifies the character string extracted from the result of the OCR process in the image processing unit 423 into attributes by means of natural language processing that enables semantic understanding of the OCR character string, or character recognition processing such as key-value extraction. An attribute is an item indicating the type of character string. Examples of attributes include "date", "personal name", "email address", "phone number", "company name", "product name", "document number", and the like. The attribute classification unit 428 stores teacher data associating the character string with the attribute, and determines and classifies to which attribute the character string of the OCR result corresponds by learning using the teacher data. Alternatively, the attribute classification unit 428 stores and manages the character string (the "key") that becomes the item name. Then, the attribute classification unit 428 cooperates with the image processing unit 423 to extract the key from the character strings obtained by OCR of the image data. For example, if the character string "date: ○○ month ○○ day" is included in the image data, "date" is extracted as the key. Then, the attribute classification unit 428 detects the character string (the "value") corresponding to the key from the positional relationship with the character string of the key, and classifies the value in correspondence with the attribute of the item name of the key. Alternatively, the attribute classification unit 428 preliminarily manages the regular expressions of the attributes and the character strings corresponding to each attribute. The regular expression may be set by the user. Then, the attribute classification unit 428 may cooperate with the image processing unit 423 to classify the character strings that match the set regular expression from the character strings obtained by OCR of the image data into the attributes. In this case, on the attribute selection screen 1700 described later, it may be configured to accept from the user the specification of the regular expression of the character string corresponding to each attribute. The OCR character string classified by attributes is stored in the RAM 213 with the attribute name and the OCR character string associated as shown in FIG. 16.

[0027] <Overall processing flow> For the processes described hereinafter, the CPU 211 of the MFP 110 reads out the control programs stored in the ROM 212 and the HDD 214, and executes and controls various functions and additional application functions of the MFP 110.

[0028] FIG. 5 is a flowchart showing the processing flow when a mask image is synthesized with an image scanned by the MFP 110, the image is filed, and then transmitted to cloud storage (external storage 120). In the present embodiment, an example in which the display control unit 421 displays a screen on the touch panel of the operation unit 220 will be described. However, the display control unit 421 may provide each screen in the present embodiment to another device, and the operation unit of the other device may be configured to display each of the screens.

[0029] The display control unit 421 displays a main screen (not shown) with buttons for executing applications provided by the MFP 110 on the touch panel of the operation unit 220.

[0030] An additional application (hereinafter referred to as a masking app) that masks a partial area of the scanned image of the present invention and transmits it to a cloud service can be used by installing it on the MFP 110. When the masking app is installed on the MFP 110, a button for using the function of the application is displayed on the main screen of the MFP 110.

[0031] When it is detected that the masking app button is pressed, the flow of FIG. 5 starts, and in S501, the MFP 110 starts the masking app (reads and executes a program). When the masking app is started, in S502, the display control unit 421 of the MFP 110 displays the mask setting method selection screen 700 of FIG. 7 as the initial screen of the masking app. 701 is a button for instructing the MFP 110 to display a screen 800 described later. Preset is a function of saving setting values such as scan settings, mask areas, and file storage information that have been set once in the HDD 214 of the MFP 110 and reusing them. 702 is a button for instructing a process of manually setting various initial values of the masking app. When the user selects any button on the mask setting method selection screen 700, the display control unit 421 determines in S503 which of "preset" of 701 and "manual" of 702 is selected.

[0032] When the selection of "Manual" in 702 is detected, the determination in S503 becomes "No", and in S505, the display control unit 421 displays the scan screen 900 in FIG. 9. 901 is an item for specifying the output method of the masked scan image. As the output method, it is possible to select only printing, only saving, or both printing and saving. 902 is an item for specifying the file format at the time of saving, which is valid when the setting of 901 is set to "Print and Save" or "Save Only". 903 is an item for specifying scan settings, and accepts changes in settings such as "Original Size", "Color", "Duplex", and "Detailed Settings". In "Detailed Settings", changes in settings such as resolution, image quality, mixed original sizes, and density are accepted. 904 is a button for executing a scan using the scan settings set in 903. 905 is an area for displaying the number of scanned pages. 906 is a button for returning to the previous screen. When the determination in S503 is "No", the scan screen 900 is displayed with the output settings and scan settings that the MFP 110 holds as the initial values of the masking application set in 901 to 903.

[0033] On the other hand, when the selection of "Preset" in 701 is detected, S503 becomes "Yes", and in S504, the display control unit 421 displays the preset list screen 800 in FIG. 8. 801 is an example of a registered preset button. The preset button is a button corresponding to the template stored in the data management unit 424. When it is detected that any preset button has been selected, the set values of the template associated with the button ID of the preset button are used in subsequent processing. The button ID is an ID generated by the data management unit 424 at the time of registering the preset button, and is a number, symbol, alphabet, etc. for uniquely identifying the registered set of values (not shown). 802 is a button for returning to the mask setting method selection screen 700 in FIG. 7. For example, when it is detected that "Investigation Report" in 801 has been selected, the display control unit 421 reads the settings related to the button ID of "Investigation Report" and displays the scan screen 900. At this time, the settings related to the button ID are reflected in the output settings and scan settings of 901 to 903.

[0034] When the operation unit 220 detects that the user has placed the document to be scanned on the platen glass or ADF and pressed the "Scan" button at 904, at S506, the MFP 110 executes scanning to generate an image identifier that uniquely indicates the image data obtained by digitizing the document. The generated scan image and the image identifier are saved in association with each other in the HDD 214. Each time the MFP 110 completes generating a scan image for one page, the number of scanned pages at 905 increases.

[0035] When it is detected that the scanning of the document to be scanned is completed and "Next" at 907 is pressed, at S507, the image processing unit 423 executes an analysis process of the scan image. In the scan image analysis process, the image processing unit 423 detects a character area existing in the image and acquires the coordinates of the detected character area. Also, the image processing unit 423 executes an optical character recognition process on the scan image and extracts the character string within the detected character area. Note that the image processing unit 423 may execute the optical character recognition process only on the image data included in the detected character area. Then, the coordinates of the acquired character area and the information of the extracted character string are saved in the HDD 214 in association with the image identifier as the analysis result. Further, the attribute classification unit 428 classifies the character string obtained by the optical character recognition process by the image processing unit 423 into attributes by the method described above.

[0036] When the processing of the scan image analysis in S507 is completed, in S508, the MFP 110 executes an area designation process. The area designation process is a process of accepting the designation of an area to be masked on the scan image and generating a composite image obtained by masking the designated area. In the present embodiment, the designation of the area to be masked is accepted by selecting a character string to be masked from among the character strings extracted in the scan image or by selecting the attribute of the character string to be masked. FIG. 6 is a flowchart of the process executed in the area designation process of S508. In the area designation process of S508, the process changes depending on whether "Preset" is selected on the mask setting method selection screen 700. First, in S601, the display control unit 421 determines whether "Preset" is selected on the mask setting method selection screen 700. If "Preset" is selected in S601, in S602, the display control unit 421 acquires preset information from the data management unit 424. If "Manual" is selected in S601, the process proceeds to the process of S604 without acquiring the preset information.

[0037] If it is determined in S601 that "Preset" is not selected, the process proceeds to S603, and the display control unit 421 displays the attribute selection screen 1700 of FIG. 17. On the attribute selection screen 1700, the attribute names when the character strings extracted in S507 are classified into attributes are displayed. 1701 is an area for displaying a list of attribute names, and each area where an attribute name is displayed is a button for accepting input from the user. When the pressing of each attribute name button is accepted, the color of the background of the button changes so that it can be understood that the button is in a selected state. 1702 is a button for returning to the mask setting method selection screen 700. 1703 is a button for transitioning to a preview screen 1000 (described later) for mask area designation of FIG. 10. The attribute name selected by pressing the button in 1701 is held in the RAM 213.

[0038] At S604, the display control unit 421 displays the preview screen 1000 of FIG. 10. FIG. 10(a) is an example of the preview screen 1000 first displayed at S604. If "preset" is not selected at S601, the display control unit 421 acquires the information of the attributes selected via the attribute selection screen 1700 of S603 and reflects it on the preview screen 1000. Specifically, the display control unit 421 acquires the information of attributes such as "date" and "phone number" selected on the attribute selection screen 1700. Further, in cooperation with the attribute classification unit 428, it acquires the character strings of the OCR results classified into the acquired attributes. The process of classifying the character strings of the OCR results for each attribute is performed by the attribute classification unit 428 in the method described above. The display control unit 421 masks the OCR character strings belonging to the attribute based on the acquired attribute information and the character strings of the OCR results and displays them on the preview screen 1000. Masking is to fill and display a rectangular area surrounding the target character string. Further, the display control unit 421 displays, in the attribute list display area 1012, the information of all the attributes managed by the attribute classification unit 428 including the attributes not selected on the attribute selection screen 1700, and the character strings of the OCR results classified into each attribute. 1012 is an attribute list display area for displaying the OCR character strings in association with each attribute. At this time, the display control unit 421 displays in 1012 with the character strings of the OCR results corresponding to the attributes selected on the attribute selection screen 1700, that is, the character strings masked on the preview screen 1000, being selected.

[0039] When "Preset" is selected in S601, the display control unit 421 obtains, in S602, information on the attributes registered in the template corresponding to the selected preset button. Further, in cooperation with the attribute classification unit 428, it obtains the character strings of the OCR results classified into the obtained attributes. The process of classifying the character strings of the OCR results for each attribute is performed by the attribute classification unit 428 in the method described above. The display control unit 421 masks and displays the OCR character strings belonging to the attribute based on the obtained attribute information and the character strings of the OCR results. Further, the display control unit 421 displays, in the attribute list display area 1012, information on all the attributes managed by the attribute classification unit 428 including the attributes not registered in the template, and the character strings of the OCR results classified into each attribute. At this time, the display control unit 421 displays, in 1012, in a state where the character string of the OCR result corresponding to the attribute selected on the attribute selection screen 1700, that is, the character string masked on the preview screen 1000, is selected.

[0040] The display control unit 421 displays the attributes and the OCR character strings in a tree structure in the attribute list display area 1012. The parent is the attribute name and the child is the OCR character string. That is, for each of the plurality of attributes, one or more OCR character strings classified into each attribute are displayed in association. The display control unit 421 displays check boxes in the attribute list display area 1012 for receiving, by a tap operation, a designation as to whether or not to select each of the attributes and each of the OCR character strings as a masking target. The display control unit 421 receives, via the check box, a designation from the user for selecting or deselecting each OCR character string.

[0041] Specifically, when the user performs an operation of checking the check box of the OCR character string, the operation is received as a designation for selecting the OCR character string. Then, based on the designation, an instruction to mask the OCR character string is received. Then, the OCR character string is masked on the preview screen 1000.

[0042] When the user unchecks the check box of the OCR string, the operation is accepted as a designation to deselect the OCR string. Then, based on the designation, an instruction to unmask the OCR string is accepted. Then, the OCR string is displayed without masking on the preview screen 1000.

[0043] Furthermore, when the user checks the check box of an attribute, the operation is accepted as a designation to select all the OCR strings associated with the attribute. Then, based on the designation, an instruction to mask all the OCR strings associated with the attribute is accepted. Then, all the OCR strings are masked on the preview screen 1000.

[0044] When the user unchecks the check box of an attribute, the operation is accepted as a designation to deselect all the OCR strings associated with the attribute. Then, based on the designation, an instruction to unmask all the OCR strings associated with the attribute is accepted. Then, all the OCR strings are displayed without masking on the preview screen 1000.

[0045] Also, when the displayed OCR string does not fit within the attribute list display area, the display control unit 421 displays a scroll bar. In this embodiment, the association between the attribute and the OCR string is represented in a tree structure, but other representation methods such as a list structure may be used as long as the association between the attribute and the OCR string is made. With this attribute list display area 1012, it becomes convenient to add or delete the attributes and strings to be masked.

[0046] In addition, when an attribute lock described later is applied to an attribute registered in a preset, the display control unit 421 controls the attribute list display area 1012 so that the attribute targeted by the attribute lock cannot be released. For example, the attribute targeted by the attribute lock, its checkbox, and all OCR character strings associated with the attribute and their checkboxes are grayed out and displayed so that they cannot be deselected. The attribute lock has the effect of preventing an operator of this application from touching confidential information such as personal information. Therefore, the function of the attribute lock may be controlled to be used in the case of specific user authorities. For example, it may be applied when the user who calls and operates a preset is a user with a predetermined authority. Specifically, when the user information management unit (not shown) of the MFP 110 determines that the setting of the attribute lock described later is effective for at least one attribute in the called preset, it checks the information of the user logged in to the MFP 110. When the information indicates a general user, it notifies the display control unit 421 to that effect. When the display control unit 421 receives information indicating that it is information indicating a general user, it performs display control so that the OCR character string cannot be deselected for the attribute set to enable the attribute lock in the preset.

[0047] 1001 is an area where a preview of the image scanned in S506 is displayed. 1002 is a preview image of the image scanned in S506. When the preview image does not fit on the screen, a scroll bar is automatically displayed.

[0048] 1003 is a button for releasing the masked area selected on the preview image 1002. When the display control unit 421 detects that the OCR string selected as the masking target has been touched with a finger on the image data of the preview image, it recognizes the touched OCR string as being selected for the next operation. Then, when the display control unit 421 detects the pressing of the deselection button 1003 following the selection, it releases the OCR string from the masking target. Specifically, first, the display of masking on the preview image 1002 is released. Further, the selection is also released from the attribute list display area 1012 described later. That is, the selection of the checkbox corresponding to the OCR string is released. Also, if all of the strings included in the attribute to which the deselected string belongs are in a deselected state due to the deselection, the selection of the attribute is also released.

[0049] 1004 is a button for reducing the display magnification of the preview image 1002 by a certain amount and displaying it in a reduced size. 1005 is a button for changing to the maximum magnification at which the entire preview image 1002 fits within the preview area 1001. 1006 is a button for increasing the display magnification of the preview image 1002 by a certain amount and displaying it in an enlarged size. 1007 is a button for displaying the scan image of the previous page when there are multiple pages of scan images. 1008 displays the page of the currently displayed scan image and the total number of pages. 1009 is a button for displaying the scan image of the next page when there are multiple pages of scan images.

[0050] 1010 is a mask color specification button for specifying the color of the masked area described later. The color for filling the masked area may include not only a single color but also filling effects such as mosaic and stamp. That is, in the present embodiment, the button 1010 is described as a mask color specification button, but it is not limited to this. It may also be a button for selecting the type of mask image. For example, it may be configured to be able to select the color and pattern of the mask image.

[0051] 1011 is a toggle button that semi-transparently displays the mask area on the preview. When receiving a selection to enable the setting for transparent display via 1011, the display control unit 421 masks and displays the selected string as the mask target in a transparent manner so that the string can be seen. Also, when receiving a selection to disable the setting for transparent display via 1011, the display control unit 421 masks and displays the selected string as the mask target without transparency so that the string cannot be seen.

[0052] 1018 is a button to return to the previous process. When "Preset" is selected in S601, when the display control unit 421 detects the pressing of button 1018, it displays the scan screen 900. When "Preset" is not selected in S601, when the display control unit 421 detects the pressing of button 1018, it displays the attribute selection screen 1700. 1019 is a button to proceed to the next process. When the display control unit 421 detects the pressing of button 1019, it displays the execution confirmation screen 1200 (described later in FIG. 12).

[0053] In this embodiment, a method of specifying the mask area by attributes is described. However, subsequently, other methods such as string specification and coordinate specification may be used to specify the mask area. String specification is a method in which the user specifies the string to be masked. The display control unit 421 searches for the specified string among the strings extracted in the scan image and selects it as the mask target. Coordinate specification is a method in which the user specifies the area to be masked on the scan image. The display control unit 421 detects the touch operation by the user and sets the corresponding area as the area to be masked. Also, multiple area specification methods may be used on the same screen.

[0054] 1020 to 1030 show the state where the display control unit 421 masks and displays the OCR character strings included in the preset or the attributes selected on the attribute selection screen 1700. Before accepting a designation for the user to select or deselect a character string, the display control unit 421 displays the screen 1000 with 1020 to 1030 masked. Also, the display control unit 421 displays the masked OCR character strings in a state selected by a check mark in the attribute list display area 1012. Further, among the attributes displayed in the attribute list display area 1012, for the attributes for which all of the associated OCR character strings are selected, they are displayed in a state selected by a check mark.

[0055] FIG. 10(b) is an example of the preview screen 1000 after the user edits the mask area, and shows the state where, after the preview screen 1000 in FIG. 10(a) is displayed, the user designates addition or deletion of a masking target. When the display control unit 421 receives an instruction to deselect the attribute name "Date" in the attribute list display area 1012, it cancels the mask image displayed at 1022 and displays the character string of the attribute "Date" without masking. When the display control unit 421 receives an instruction to deselect the OCR character strings "XXX" and "AAA" in the attribute list display area 1012, it cancels the mask images that have hidden "XXX" and "AAA" among the mask images displayed at 1027 to 1029. Then, it displays the character strings of "XXX" and "AAA" without masking. Also, when the display control unit 421 detects that the attribute name "Personal Name" in the attribute list display area 1012 is newly selected, it displays the mask image at 1030 and masks the character string "△△△" associated with "Personal Name".

[0056] FIG. 13(a) shows area information 1300 such as coordinates held in the RAM 213 related to the area specified on the preview screen of FIG. 10(a). When the display control unit 421 detects that a mask area has been specified on the preview screen, the area information 1300 is saved by the data management unit 424. 1301 is an ID uniquely indicating each area information. 1302 is the type of area designating means. The types of 1302 include, in addition to "attribute", "coordinates", "text", etc. "Attribute" indicates the type of the mask area specified by specifying an attribute on the preview screen of FIG. 10(a). "Coordinates" indicates the type of the mask area specified by specifying coordinates. "Text" indicates the type of the mask area specified by specifying a character string. 1303 is the starting point of the area. The horizontal (horizontal direction) and vertical (vertical direction) coordinates with the upper left corner of the scanned image as the origin are shown in the form of (X, Y). 1304 is the end point of the area. That is, a rectangle with the coordinates of 1303 as the upper left point and the coordinates of 1304 as the lower right point is the target area. The coordinate information of the character string is obtained by image analysis processing such as OCR by the image processing unit 423. 1305 is the RGB value of the color. 1306 is the OCR character string of the mask target. It can be seen that in the area information 1300, 10 mask areas (MSK1 to 10) corresponding to the area information of the preview area 1001 of FIG. 10(a) are stored.

[0057] FIG. 13(b) shows area information 1301 such as coordinates held in the RAM 213 related to the area specified on the preview screen of FIG. 10(b). In FIG. 10(b), as mask targets, 1022 (2022 / 12 / 22), 1027 (XXX), 1028 (AAA), 1029 (AAA) are deleted from the area information, and 1030 (△△△) is newly added. Therefore, it can be seen that in the area information 1301, 8 mask areas (MSK1 to 7) corresponding to the area information of the preview area 1001 of FIG. 10(b) are stored.

[0058] In S607, the image processing unit 423 synthesizes an image of a specified color with the area designated as the mask area in the process of S604 for the scanned image, and stores it in the HDD 214. That is, a mask image is synthesized with the area corresponding to the character string selected in the attribute list display area 1012 to generate a mask composite image. In S608, the mask area information used in the mask composition of S607 is associated with the image identifier of the scanned image data and stored in the HDD 214. The mask area information to be stored is the information shown in FIG. 13. The above is the detailed process executed in the area designation process of S508.

[0059] When the area designation process of S508 is completed, in S509, the display control unit 421 displays the execution confirmation screen 1200 in FIG. 12. 1201 is a print setting display area that is displayed when an item including printing is selected in the output method 901 in FIG. 9. In the print setting display area 1201, the number of copies is set and buttons for "other print settings" are arranged. Also, when the "other print settings" button is pressed, a screen (not shown) where settings such as double-sided, paper size, and page orientation can be changed is displayed. 1202 is a confirmation display area for save settings that is displayed when an item including saving is selected in the output method 901 in FIG. 9. The save setting confirmation display area 1202 displays the set values of the save destination and file name set in FIGS. 12(b) and 12(c).

[0060] 1206 is a button for displaying an edit screen for setting the external storage or folder path of the save destination. When it detects the pressing of the save destination edit button 1206, the display control unit 421 displays the save destination setting screen 1210 in FIG. 12(b) on the execution confirmation screen 1200.

[0061] 1211 is an item for setting an external storage for transmitting scanned images. In this example, "Cloud A" is selected. When it is detected that a storage has been selected by an operation at 1211, the MFP 110 starts connecting to the external storage set at 1211. If authentication is required for accessing the external storage set at 1211, a screen (not shown) required for authentication is displayed. When the authentication is completed, a list 1213 (described later) of folders available under the external storage of 1211 is displayed, and the user can select a desired folder and change the folder path.

[0062] 1212 is an area for displaying the currently selected folder path under the external storage set at 1211. In the example of Fig. 12(b), it can be seen that "Investigation Report" is set in the folder path.

[0063] 1213 is a list of folders available under the external storage. The user can select a desired folder and change the folder path. When a folder is selected, the folder path is displayed in the folder path display area 1212.

[0064] 1214 is a button for discarding the contents changed on the save destination setting screen 1210 and returning to the execution confirmation screen 1200.

[0065] 1215 is a button for finalizing and saving the contents changed on the save destination setting screen 1210 and returning to the execution confirmation screen 1200. When it is detected that the decision button 1215 has been pressed, the MFP 110 saves the settings and displays the set information in the save setting confirmation display area 1202. At this time, the storage name and the folder path are connected together so that the user can understand the path of the save destination. In the save setting confirmation display area 1202 of Fig. 12(b), it can be seen that "Cloud A" is set as the external storage and "Investigation Report" is set as the folder path of the save destination.

[0066] 1207 is a button for displaying an editing screen for changing the setting of the file name. When detecting the pressing of the file name edit button 1207, the MFP 110 displays the name input screen 1220 in Fig. 12(c) on the execution confirmation screen 1200.

[0067] 1221 is an area for displaying the set file name. 1222 to 1223 are areas where buttons used for inputting the file name are displayed. 1222 is an area where a button for inputting fixed text is displayed. Any text or predefined delimiter characters (such as hyphens, underscores, blanks, etc.) can be input into the file name. When "Text" is selected, a keyboard for text input (not shown) is displayed on the touch panel, and the user can input any text. 1223 is an area where a button for inputting the date and time information at the time of scanning into the file name is displayed. By using the button in this date and time area 1223 to input into the file name, the date and time information can be easily input into the file name. 1224 is a name rule display area for displaying which button in the areas of 1222 to 1223 was used for input. When input is made from the button in the fixed value area 1222, the corresponding text is directly displayed in the name rule display area 1224, but when input is made from other areas, it is displayed in the form of [variable name]. Information related to the name of the button in each area is entered into [variable name]. From the name rule display area 1224 in Fig. 12(c), it can be seen that buttons for "Year", "Month", and "Day" in the date and time area 1223 were used as information other than fixed values.

[0068] 1225 is a button for deleting the string entered in the file name. The delete button 1225 deletes the string from the end of the file name. However, if the deletion target is other than a fixed value, the string corresponding to [variable name] in the name rule display area will be deleted collectively in one deletion. That is, when it is detected that the user has pressed the delete button 1225 on the screen of Fig. 10(c), the string "05" will be deleted collectively. At that time, the [date] corresponding to the deleted string will also be deleted from the name rule display area 1224. 1226 is a button for canceling the editing of the name input screen 1220 and returning to the execution confirmation screen 1200. 1227 is a button for finalizing the editing of the name input screen 1220, saving it, and returning to the execution confirmation screen 1200. The finalized file name is displayed in the save setting confirmation display area 1202. The setting content of the name rule display area 1224 is stored as the setting value of the preset button when registering the preset button described later. Therefore, the value entered using variable values other than fixed values can be changed according to the actual scan date and time or the information obtained from the scan image.

[0069] 1203 is an option for registering various areas and various setting information of this time as presets. In S503 and S504, the process of accepting the selection of a template that stores scan setting and masking setting information was explained. In this embodiment, the settings newly set or changed from the template in S505, S508, and S509 can be saved in the data management unit 424. A new template can be registered with a preset name described later. It is also possible to update an existing template by attaching an existing preset name. For example, if a preset is selected in S503 and S504, the template can be updated by attaching the same preset name.

[0070] 1204 is a button for returning to the preview screen 1100 in FIG. 10 or FIG. 11. 1205 is a button for performing printing, saving, and preset registration. When it is detected that the execution button 1205 has been pressed, the display control unit 421 determines in S510 whether the preset registration option 1203 is set. If the preset registration option 1203 is ON, the determination in S510 is "Yes", and in S511, the display control unit 421 displays the preset name setting screen 1500. The user can register any preset name from the preset name input area 1501 on the preset name setting screen 1500. In the attribute lock designation area 1502, it is possible to make settings for designating that when information is called for in the preset, specific attributes cannot be released from the masking target. The setting of the attribute lock does not necessarily have to be configured in this embodiment. The attribute lock designation area 1502 shown in FIG. 15 is displayed based on the attribute list display area 1012 in FIG. 10(b). In FIG. 15, three items, the telephone number, email address, and personal name, which are personal information, are selected as the lock targets, and the company name and product name, which are not personal information, are excluded from the lock targets. The information designated in the attribute lock designation area 1502 is stored in the attribute lock 1415 of the area information 1405 described later. When it is detected that the return button 1503 has been pressed, the screen transitions to the execution confirmation screen 1200.

[0071] When it is detected that the decision button 1504 has been pressed, in S512, the data management unit 424 associates each type of area, setting information, and preset name set this time with the button ID and stores them in the HDD 214.

[0072] Fig. 14 shows an example of the preset information 1400 stored in the data management unit 424. 1401 is the preset button ID. 1402 is the preset name input by the user in S511. 1403 and 1404 are the output method and scan settings set on the scan screen 900 of Fig. 9. 1405 is the area information set on the preview screen 1000 of Fig. 10(a). As can be seen from the area information 1405, the attribute name 1415 used as the method for specifying the mask area is stored. When specifying the mask target by attribute, since the coordinate position of the OCR character string that becomes the mask target may change depending on the input scan image, the coordinate information does not necessarily have to be stored as preset information. Similarly, although the OCR character strings included in each attribute may also change depending on the scan image, they are not included in 1405, but the coordinate information and the OCR character strings may also be included in the area information 1405. Also, information such as specifying or excluding a specific OCR character string may be included.

[0073] 1411 is, similar to 1301, an ID that uniquely indicates each area information. 1412 is, similar to 1302, the type of area designating means, and in addition to "attribute", there are types such as "coordinate" and "text". 1413 is, similar to 1305, the RGB value of the color. 1414 is the attribute name set via the attribute list display area 1012.

[0074] 1415 is an attribute lock setting for specifying whether the attribute stored in the preset can be released from the mask target. In the case of YES, when calling the preset and specifying the mask target, the attributes with the YES setting in the preset cannot be released from the mask target. In the case of NO, it can be released. The attribute lock setting 1515 accepts from the user the attributes to be locked in S517.

[0075] 1406 is the save setting configured on the execution confirmation screen 1200 in FIG. 12. The save setting 1406 stores the name rule of the save destination and the folder path rule. The print setting 1407 is the print setting configured on the execution confirmation screen 1200 in FIG. 12. As described above, by registering various areas and various settings once configured as presets, the same settings can be easily reused next time. The registered preset information can be called via the preset list screen 800 in FIG. 8 in S504.

[0076] When the saving in S512 is completed, in S513 the print instruction unit 425 determines whether the print setting is configured. If the print setting is configured, S513 becomes "Yes", and in S514 the print instruction unit 425 instructs the print execution unit 413 to execute the print process of the image with the mask synthesized, and the print execution unit 413 executes the printing.

[0077] Next, in S515, the external storage access unit 427 determines whether the save setting is configured. If the save setting is configured, S515 becomes "Yes", and in S516 the external storage access unit 427 executes the save process of the image with the mask synthesized. At this time, the data conversion unit 426 converts the image with the mask synthesized into the file format specified on the scan screen 900 in FIG. 9. Then, the external storage access unit 427 transmits it with the specified file name to the save destination specified on the preview screen 1000 in FIG. 10. Then, on the external storage 120, the transmitted file is saved.

[0078] When the save execution in S516, that is, the transmission execution is completed, all the processes of the masking application are completed. That is, screen transitions such as returning to the main screen of the MFP 110 or returning to the mask setting method selection screen in FIG. 7 for the next scan are executed.

[0079] As described above, by displaying the string corresponding to the attribute in the image data to be edited and receiving from the user the designation of whether to select the displayed string as the masking target, the convenience is improved.

[0080] <Second Embodiment> In this embodiment, a method for further improving the convenience of setting a mask area by switching the display order according to the type of attribute classification means will be described with reference to FIGS. 11 and 18. Descriptions of the same processes as in the first embodiment will be omitted.

[0081] The attribute classification unit 428 classifies the character string extracted from the result of the OCR process in the image processing unit 423 into attributes by means of natural language processing that enables semantic understanding of the OCR character string or character recognition processing such as key-value extraction. In the classification by semantic understanding and the attribute classification by key-value extraction, the characteristics of the attribute names are different. In the classification by semantic understanding, the attribute names are predefined, while in the classification by key-value extraction, the attribute names are the character strings actually present in the input image data. Therefore, by actually using the character string present in the image data as the attribute name, it becomes easier to search by associating the character string on the preview screen with the attribute name.

[0082] FIG. 11 is a diagram showing the attribute names classified by key-value extraction displayed at the top of the list. In the attribute list display area 1012 of the preview screen 1000 in FIG. 11, an area labeled "List by Item" is displayed, and character strings associated with keys and values are displayed from the content of the document displayed on the preview screen. Here, as the parts corresponding to the keys, four attribute names, "Creation Date", "Person in Charge", "TEL", and "E-mail", are displayed. These four key character strings are character strings that actually exist within the preview screen. As the parts corresponding to the values respectively, the OCR character strings "2022 / 12 / 22", "△△△", "xxx-xxxx-xxxx", and "xxx@example.com" are displayed in association. The OCR character string "△△△" of the attribute name "Person in Charge" is not selected as a masking target here and is therefore not displayed here.

[0083] FIG. 18 shows information obtained by adding item names to the information associating the attribute names shown in FIG. 16 with the OCR character strings. The item names are attribute names classified by key-value extraction. For each OCR character string, it is possible to associate both the attribute name classified by semantic understanding and the item name classified by key-value extraction, and the OCR character string with the item name is displayed at the top of the list on the attribute list display area 1012.

[0084] As described above, by switching the display order according to the type of attribute classification means, the convenience of mask area setting by attribute specification is further improved.

[0085] <The Third Embodiment> In this embodiment, a method for presenting to the user that there is a detection omission when the attribute classification unit 428 cannot obtain the character string corresponding to the specified attribute will be described with reference to FIG. 19. In the description of this embodiment, the description of the parts having the same configuration and processing procedure as those of the first embodiment will be omitted, and only the different parts will be described.

[0086] By displaying the specified attribute and the character string corresponding to the attribute on the preview screen, it is possible to perform the masking process for the specified attribute without omission, even if it is not displayed in the attribute list display area.

[0087] FIG. 19 is an example of the preview screen that the display control unit 421 displays in S604 in this embodiment. The preview screen 1000 includes a specified attribute display area 1101. The specified attribute display area 1101 is an area for displaying a list of character strings corresponding to the specified attributes.

[0088] The specified attribute is an attribute included in the preset acquired by the display control unit 421 in S602 or an attribute selected on the attribute selection screen 1700 in S603. The character string corresponding to the specified attribute is the OCR character string corresponding to the attribute name detected by the attribute classification unit 428.

[0089] In the example of the preview screen in FIG. 19, the attribute names specified in S602 or S603 are "personal name", "e-mail address", and "document number".

[0090] The designated attribute display area 1101 displays a character string corresponding to the designated attribute by the display control unit 421. Specifically, it displays the character string "△△△" corresponding to the attribute "personal name", the character string "xxx@example.com" corresponding to the attribute "e-mail address", and the character string "" (no character string) corresponding to the attribute "document number". "": indicates that, as a result of the processing by the attribute classification unit 428, no character string corresponding to the attribute could be obtained.

[0091] For example, when the attribute classification unit 428 determines which attribute the character string of the OCR result corresponds to using a learning model with teacher data, it is conceivable that the accuracy of the learning model is low and the character string corresponding to the document number attribute cannot be determined. Also, when the attribute classification unit 428 classifies the character string of the OCR result for each attribute using the key-value extraction method, a case where the key corresponding to the document number attribute is not included in the image data is conceivable. The case shown in FIG. 19 is this case. The character string 1900 included in the preview image 1002 is the document number that the user wants to mask, but since the corresponding key does not exist in the image data, it is not extracted by the key-value extraction process. Also, when the attribute classification unit 428 detects the character string of the regular expression set in advance for each attribute and classifies it for each attribute, a case where there is an error in the set regular expression is conceivable. Or, a case where the character string corresponding to the document number attribute is not included in the image data in the first place is conceivable.

[0092] In S604, the display control unit 421 acquires the attribute name and the OCR character string, which are the processing results of the attribute classification unit 428, and the attribute specified in S602 or S603 from the RAM 213. Then, it creates a designated attribute character string correspondence list using the attribute name as a key, saves it in the RAM 213, and displays it on the operation unit 220.

[0093]

Table 1

[0094] The attribute name and the OCR string are the same as the processing result of the attribute classification unit 428. Whether an attribute is specified is set to "Yes" if the attribute is specified in S602 or S603, and "No" if it is not specified.

[0095] The specified attribute display area 1101 displays all the attribute names and OCR strings for which the presence of attribute specification is "Yes" by the display control unit 421. When the OCR string cannot be obtained as "“”(no string)", it is displayed as a blank.

[0096] Furthermore, for the attributes and OCR strings for which the presence of attribute specification is "Yes", they are displayed in the attribute list display area 1012 in a state of being selected in advance as mask targets.

[0097] When the presence of attribute specification is "Yes" but the OCR string cannot be obtained, a string for prompting the user is displayed in the string display part of the attribute list display area. For example, since the OCR string for which "document number" is an attribute cannot be obtained, "Could not be detected" is displayed.

[0098] The editing button 1102 is a button for accepting a mask area corresponding to a string that could not be detected. When the display control unit 421 detects that the editing button 1102 has been pressed, it accepts the designation of the mask area using methods such as the string designation and coordinate designation described in the first embodiment. Specifically, when the display control unit 421 detects that the editing button 1102 has been pressed and detects a touch operation by the user on the preview image 1002, it specifies the coordinates of the area to be masked based on the operated position. For example, the image processing unit 423 detected in the above-described scanned image analysis process corresponding to the position touched by the user specifies the coordinates of the character area existing in the image as the coordinates of the area to be masked. Alternatively, the coordinates corresponding to the start point and the end point of the drag operation by the user are specified as the lower right coordinates of the upper left coordinates of the area to be masked. Or, when the display control unit 421 detects that the editing button 1102 has been pressed, it displays an input field and a soft keyboard for inputting a string. Then, it searches for the string input in the input field from the image data, and specifies the coordinates corresponding to the string found by the search as the coordinates of the area to be masked. Also, in the case of an embodiment in which an attribute is specified by a method of setting a regular expression in a preset, a screen for editing the regular expression set in the preset may be displayed. On the screen, when the user edits the regular expression for the attribute of the document number and makes a user operation to return to the screen 1000, the display control unit 421 cooperates with the attribute classification unit 428 to specify the string corresponding to the attribute of the document number with the edited regular expression. Then, it masks the specified string and displays the screen 1000.

[0099] The editing button 1102 is displayed together with a string for prompting the user's attention in the OCR string display portion within the attribute list display area 1012 when the presence or absence of attribute designation in the designated attribute string correspondence list is "present" and there is no OCR string. Also, an editing button may be displayed for all OCR strings.

[0100] When the corresponding character string is edited by the edit button 1102, the display control unit 421 creates an edited designated attribute character string correspondence list, adds "AA01-20-0001" (not shown) to the edited OCR character string, and stores it in the RAM 213.

[0101] The edited designated attribute character string correspondence list is obtained by adding the edited OCR character string as an item to the designated attribute character string correspondence list. In this embodiment, the edited OCR character string is text, but may also include information such as an area.

[0102] The character string to be displayed in the attribute list display area 1102 displays the edited OCR character string if it exists, and the OCR character string if it does not exist.

[0103] After the edit button 1102 sets the character string corresponding to the attribute "document number", the edited OCR character string is retained even after the masking target is deselected. Therefore, even when the selection and deselection of the character string as the masking target are repeated, it is not necessary to specify the masking target again by the edit button.

[0104] In addition, since the designated attribute display area 1101 performs display based on the designated attribute character string correspondence list, it can clearly display that the OCR character string could not be detected.

[0105]

Table 2

[0106] Also, when the user selects the edit button 1102 and edits the regular expression corresponding to the attribute or sets the coordinates of the area corresponding to the attribute, a check box may be displayed to receive from the user a selection as to whether to update the preset based on the edited information. The display control unit 421 stores whether or not a selection to update the preset is made in the check box. In S510, if it is stored that a selection to update the preset is made in the check box, the process proceeds to S511, and the updated preset is registered in S512. Thereby, when there is a problem with the recognition of the character string corresponding to the attribute, the setting for the recognition can be corrected and reflected in the preset.

[0107] By implementing the present invention according to the above processing procedure, in the designated attribute display area 1101, by displaying the designated attribute and the processing result of the attribute classification unit 428, it is possible to confirm the character string for performing the masking process on the designated attribute. Further, even when there is no character string corresponding to the designated attribute, it is possible to confirm it with good visibility, and there is an effect that the masking process can be performed without omission.

[0108] <Other Embodiments> The present invention can also be realized by supplying a program that realizes one or more functions of each of the above-described embodiments to a system or apparatus via a network or a storage medium, and causing one or more processors in a computer of the system or apparatus to read and execute the program. Further, it can also be realized by a circuit (for example, ASIC or FPGA) that realizes one or more functions.

Description of Reference Numerals

[0109] 110 MFP 421 Display control unit 423 Image processing unit

Claims

1. Management means for associating and managing a plurality of attributes related to a string to be masked with one item; Acquisition means for acquiring, from among a plurality of strings obtained by character recognition processing on image data to be edited, strings corresponding to each of the plurality of attributes associated and managed with the one item based on the selection of the one item; Providing means for providing a screen on which the strings corresponding to each of the plurality of acquired attributes are displayed in association with each of the plurality of attributes; having; In the provided screen, for an attribute for which a corresponding string has not been acquired, a display indicating that the string has not been acquired is made An information processing apparatus characterized by this.

2. The screen includes the image data to be edited, On the image data, the strings corresponding to each of the plurality of acquired attributes are masked and displayed The information processing apparatus according to claim 1, characterized by this.

3. The information processing apparatus according to claim 2, further comprising first reception means for receiving, from a user, a designation of a region corresponding to the attribute for which the corresponding string has not been acquired on the image data. The information processing apparatus according to claim 2, characterized by this.

4. The information processing apparatus according to claim 2, further comprising second reception means for receiving, from a user, an input of a string corresponding to the attribute for which the corresponding string has not been acquired. The information processing apparatus according to claim 2, characterized by this.

5. The management means manages a plurality of items, A plurality of attributes related to strings to be masked with different combinations are associated and managed with each of the plurality of items The information processing apparatus according to claim 1, characterized by this.

6. Equipped with a scanner, The information processing apparatus according to claim 1, characterized in that the image data to be edited is obtained by scanning a document with the scanner.

7. The information processing apparatus is communicable with an image processing apparatus equipped with a scanner, The image data to be edited is image data obtained by scanning a document with the scanner, The screen is provided from the information processing apparatus to the image processing apparatus The information processing apparatus according to claim 1, characterized by this.

8. A control method for an information processing apparatus, comprising: A management step of associating and managing a plurality of attributes related to a string to be masked with one item; An acquisition step of acquiring, from among a plurality of character strings obtained by performing character recognition processing on image data to be edited, a character string corresponding to each of the plurality of attributes managed in association with the one item, based on the selection of the one item; A provision step of providing a screen in which the character strings corresponding to each of the plurality of acquired attributes are displayed in association with each of the plurality of attributes; comprising: In the provided screen, for an attribute for which a corresponding character string has not been acquired among the plurality of attributes, a display indicating that the character string has not been acquired is made. A control method characterized by the above. **Claim 9** Management means for managing a plurality of attributes related to a character string to be masked in association with one item; Acquisition means for acquiring, from among a plurality of character strings obtained by performing character recognition processing on image data to be edited, a character string corresponding to each of the plurality of attributes managed in association with the one item, based on the selection of the one item; Provision means for providing a screen in which the character strings corresponding to each of the plurality of acquired attributes are displayed in association with each of the plurality of attributes; A program for causing a computer to function as: In the provided screen, for an attribute for which a corresponding character string has not been acquired among the plurality of attributes, a display indicating that the character string has not been acquired is made. A program characterized by the above.

Images