Image processing device, control method for image processing device, and program

Abstract

To make available masking processing that matches a user's use case.SOLUTION: An image processing device with a scanner includes display control means that displays a UI screen on display means for specifying a selected method from among a plurality of different methods for specifying an area to be masked in a document image obtained by scanning with a scanner, acceptance means for accepting user input on the UI screen, and image processing means for masking specified parts of the document image on the basis of the user input accepted through the acceptance means. The plurality of different methods include a first method for specifying a type of information that indicates a type of character string included in the area to be masked, and a second method for specifying a position of the area to be masked on the UI screen where the document image is displayed.SELECTED DRAWING: Figure 7

Description

[Technical field]

[0001] The present disclosure relates to techniques for masking images. [Background technology]

[0002] In order to protect personal information or confidential information, when documents such as identification documents, application documents, or drawings are shared with others, some parts of the documents may be masked by filling them in (hereinafter, also referred to as "erasing" or "masking"). For example, Patent Document 1 discloses a technique for masking areas in an image that correspond to areas registered in advance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-033790 Summary of the Invention [Problem to be solved by the invention]

[0004] In the technique disclosed in Patent Document 1, the user can only specify the position of the area to be masked. For example, the user cannot specify the area to be masked by specifying the attribute of the character string to be concealed in addition to the position of the area. The present disclosure has been made in consideration of the above problems, and aims to make it possible to use a masking process that matches the user's use case. [Means for solving the problem]

[0005] The image processing device according to the present disclosure is an image processing device including a scanner, and is configured to: identification Several different ways to do this Display A display control means for displaying a UI screen on a display means; About the method selected by the user viaA receiving means for receiving a user input, and based on the user input received by the receiving means, Using the method selected by the user of the document identification and an image processing means for masking the designated area, wherein the plurality of different methods include a first method for specifying an information type representing a type of character string included in the area to be masked, and a second method for specifying a position of the area to be masked on the UI screen on which the document image is displayed. Effect of the Invention

[0006] According to the technology disclosed herein, it becomes possible to utilize masking processing that matches the user's use case. [Brief description of the drawings]

[0007] [Figure 1] FIG. 1 is a diagram showing an example of the configuration of an information processing system. [Diagram 2] FIG. 2 is a diagram showing an example of the hardware configuration of an information processing device that constitutes the present system. [Diagram 3] FIG. 2 is a diagram showing an example of the hardware configuration of an information processing device that constitutes the present system. [Figure 4] FIG. 2 is a diagram showing an example of the software configuration of an information processing device that constitutes the present system. [Diagram 5] 3 is a flowchart illustrating the overall processing executed by the present system. [Figure 6] 4 is a flowchart illustrating a function designation process executed by the present system. [Figure 7] FIG. 2 is a diagram showing an example of a screen configuration of the present system. [Figure 8] 11 is a flowchart illustrating a masking region specifying process. [Figure 9] 11 is a flowchart illustrating a masking editing process. [Figure 10] FIG. 2 is a diagram showing an example of a screen configuration of the present system. [Figure 11] 11 is a flowchart illustrating a preset registration process. [Figure 12] FIG. 2 is a diagram showing an example of a screen configuration of the present system. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. Note that the following embodiments do not limit the present disclosure, and not all of the combinations of features described in the embodiments are necessarily essential to the solutions of the present disclosure. Note that the same configurations will be described with the same reference numerals. Also, each process (step) in the flow chart will be indicated with a reference numeral beginning with "S".

[0009] [First embodiment] <Overall composition> Fig. 1 is a diagram showing the overall configuration of an information processing system according to the present embodiment. The information processing system 100 in Fig. 1 includes an MFP (Multifunction Peripheral) 110 and an external storage 120. The MFP 110 is communicably connected to a server that provides various services on the Internet via a LAN (Local Area Network).

[0010] The MFP 110 is a multifunction device having multiple functions such as a scanner and a printer, and is an example of an information processing device or an image processing device of the present disclosure. The MFP 110 also has a function of transferring a scanned image file to a service that allows file storage, such as an external storage service. Note that the information processing device according to the present disclosure is not limited to a multifunction device having a scanner and a printer, and may be a PC (personal computer), a tablet terminal, a smartphone, or the like.

[0011] The external storage (service) 120 is a service that allows a user to store files received via the Internet and to obtain files from an external device via a web browser. The external storage 120 is, for example, a cloud service. The external storage is not limited to the external storage 120, and multiple external storages may exist.

[0012] The information processing system according to this embodiment is configured to include the MFP 110 and the external storage 120, but is not limited thereto. For example, part of the functions and processes of the MFP 110 may be performed by another server arranged on the Internet or on the LAN. Also, the external storage 120 may be arranged on the LAN instead of on the Internet. Further, the external storage 120 may be replaced with a mail server or the like, and the scanned image may be attached to and sent by mail. The MFP 110 may also have the storage function of the external storage 120.

[0013] <Hardware Configuration of MFP 110> FIG. 2 is a hardware configuration diagram of the MFP 110. The MFP 110 includes a control unit 210, an operation unit 220, a printer 221, a scanner 222, and a modem 223. The control unit 210 includes the following units 211 to 219 and controls the overall operation of the MFP 110. The CPU 211 reads out by expanding the control programs stored in the ROM 212 and the HDD 214 into the RAM 213, and executes and controls various functions such as reading, printing, and communication. The RAM 213 is used as a temporary storage area such as the main memory and the work area of the CPU 211. In this embodiment, it is assumed that one CPU 211 uses one memory (RAM 213 or HDD 214) to execute each process shown in the flowchart described later, but it is not limited thereto. For example, a plurality of CPUs may cooperate with a plurality of RAMs or HDDs to execute each process. The HDD 214 is a large-capacity storage unit that stores document image data or image data, and various programs. In the following description, the term "image" is used for explanation, but the "image" also includes the "document image". Therefore, masking within the image also includes masking within the document image.

[0014] The operation unit I / F 215 is an interface that connects the operation unit 220 and the control unit 210. The operation unit 220 is provided with a touch panel, a keyboard, and the like, and accepts operations, inputs, or instructions from a user. The printer I / F 216 is an interface that connects the printer 221 and the control unit 210. Image data for printing is transferred from the control unit 210 to the printer 221 via the printer I / F 216 and printed on a recording medium. The scanner I / F 217 is an interface that connects the scanner 222 and the control unit 210. The scanner 222 reads an original placed on a platen (not shown) or an ADF (Auto Document Feeder) (not shown) to generate image data, and inputs the image data to the control unit 210 via the scanner I / F 217. The MFP 110 prints (copies) the image data generated by the scanner 222 from the printer 221, and also transmits the image data as a file or by email. The modem I / F 218 is an interface that connects the modem 223 and the control unit 210. The modem 223 communicates image data by facsimile between the MFP 110 and a facsimile device on the PSTN. The network I / F 219 is an interface that connects the control unit 210 (MFP 110) to a LAN. The MFP 110 uses the network I / F 219 to transmit image data and information to each service on the Internet and receive various information.

[0015] <Hardware configuration of the external storage 120> Figure 3 is a hardware configuration diagram of the external storage 120. The external storage 120 includes a CPU 311, a ROM 312, a RAM 313, an HDD 314, and a network I / F 315. The CPU 311 controls the operation of the entire external storage 120 by expanding the control program stored in the ROM 312 into the RAM 313 and executing various processes. The RAM 313 is used as a temporary storage area such as the main memory and work area of the CPU 311. The HDD 314 is a large-capacity storage unit that stores image data and various programs. The network I / F 315 is an interface that connects the external storage 120 to the Internet. The external storage 120 receives a processing request from another device such as the MFP 110 via the network I / F 315 and transmits and receives various information.

[0016] <Software Configuration of MFP 110> Figure 4 is a software configuration diagram of the MFP 110 according to the present embodiment. The software configuration of the MFP 110 includes a native function unit 410 and an additional function unit 420. The CPU 211 expands the programs stored in the ROM 212 and HDD 214 of the MFP 110 into the RAM 213 and executes them, whereby each function unit is realized. Each unit included in the native function unit 410 is a function standardly provided in the MFP 110. The additional function unit 420 is an application additionally installed in the MFP 110. The additional function unit 420 is an application based on Java (registered trademark), and the addition of functions to the MFP 110 can be easily realized. Note that other additional applications (not shown) may be installed in the MFP 110.

[0017] The native function unit 410 includes a scan execution unit 411, an internal data storage unit 412, a print execution unit 413, and a UI (User Interface) display unit 414. The additional function unit 420 includes a main processing unit 421, a scan instruction unit 422, an image processing unit 423, a data management unit 424, a print instruction unit 425, an Internet access unit 426, a display control unit 427, an information detection unit 428, and an input reception unit 429.

[0018] The scan execution unit 411 receives a scan request including scan settings from a scan instruction unit 422, which will be described later. In accordance with the scan request, the scan execution unit 411 generates scan image data by reading a document placed on a document table (not shown) with the scanner 222 via the scanner I / F 217. The internal data storage unit 412 stores information requested by a data management unit 424, which will be described later, in the HDD 214 or acquires information requested by the data management unit 424 from the HDD 214. The print execution unit 413 receives a print request including print settings and an image identifier from a print instruction unit 425, which will be described later. The print execution unit 413 acquires data corresponding to the image identifier from the internal data storage unit 412 and generates image data for printing in accordance with the print request. The print execution unit 413 prints a mask composite image on a recording medium with the printer 221 via the printer I / F 216 in accordance with the generated image data for printing. The UI display unit 414 displays a UI screen for accepting operations by a user on a liquid crystal display unit having a touch panel function of the operation unit 220 of the MFP 110. For example, an operation screen for accepting operations for scan setting, scan start operation, a preview of a scanned image, a mask area designation operation described later, a preview of a mask composite image, output setting, and output start operation is displayed.

[0019] The main processing unit 421 has a general function of processing the additional function unit 420. Specifically, the main processing unit 421 controls the overall processing of the additional function unit 420, and requests each unit included in the additional function unit 420 to perform processing. The scan instruction unit 422 requests the scan execution unit 411 to perform scanning processing according to the scan settings input via the UI screen. The image processing unit 423 performs analysis processing and processing processing on the image data. The image processing unit 423 performs image recognition processing such as character area analysis in the image data, OCR (Optical Character Recognition), and image rotation and tilt correction. In addition, the image processing unit 423 generates a masking image in which a designated portion designated as a masking area on the image is masked. The masking area is information representing the coordinates of the start point and end point of a rectangular area to be masked in the image. The coordinate format is expressed by (x coordinate, y coordinate). For example, the masking area is information that represents the coordinates of the start point and the end point of a rectangular area such as "(441,957), (1369,1057)". In this embodiment, the masking area is a rectangular area, but may be an ellipse, a triangle, or other shape. The masking image is an image in which the masking area is masked on the image data. The masking may be done by filling in the area with black, hiding it with a background color, or by other methods. The image processing unit 423 also determines whether the extracted character string matches a specified character string, and determines whether or not to mask the extracted character string. The image processing unit 423 also determines whether or not the information type detected by the information detection unit 428 matches the specified information type, and determines whether or not to mask the character string corresponding to the specified information type.

[0020] The data management unit 424 saves and acquires image data and presets. It may also save and acquire other necessary information. A preset is information saved so that a user's designation for masking can be reused, and by using a preset, masking can be performed without making individual settings again. A preset includes a preset name, an image size, a masking area, a masking character string, and a masking type. A preset may also include other information.

[0021] The masking area is the coordinates of a rectangular area on an image to be masked. The masking character string is a character string to be masked. The masking type is a type of the masking target. For example, it includes information types detectable by the information detection unit 428 described later. It also includes types that indicate area information, such as "rectangular area". It also includes types that indicate a character string specified by the user, such as "specified character string". The masking type may also include other types.

[0022] The data management unit 424 requests the internal data storage unit 412 to store information inside the MFP 110 or to acquire information from inside the MFP 110. The data management unit 424 may also request the Internet access unit 426 to store information in the external storage 120 or to acquire information from the external storage 120. The print instruction unit 425 transmits to the print execution unit 413 a request for print processing according to the print settings input via the UI screen and an image identifier received from the image processing unit 423.

[0023] The internet access unit 426 transmits a processing request to a cloud service or the like that provides a storage function (storage service). Cloud services generally use protocols such as REST and SOAP to store files in cloud storage and to publish various interfaces for retrieving the stored files from an external device. The internet access unit 426 operates the cloud service using the published interface of the cloud service. The internet access unit 426 retrieves a file and transmission information corresponding to the image identifier received from the image processing unit 423 from the data management unit 424. The internet access unit 426 uses the transmission information acquired from the data management unit 424 to transmit the file acquired from the data management unit 424 to the external storage 120 via the network I / F.

[0024] The display control unit 427 controls the display of a UI screen for accepting operations by a user on a liquid crystal display unit having a touch panel function of the operation unit 220 of the MFP 110. The information detection unit 428 determines whether a character string corresponds to a predetermined detectable information type, and generates an information detection result that stores the character string, the character string area, and the corresponding information type. The detectable information type is a type of concept expressed by the character string, and is used to specify the character string to be masked. In this embodiment, the detectable information type represents a type of personal information or confidential information such as "name", "credit card number", and "email address", but is not limited to this. The information detection unit 428 also determines whether the character string corresponds to a predetermined detectable information type. For example, the information detection unit 428 determines that the character string "Taro Yamada" corresponds to the information type "name". The information detection unit 428 determines that a character string that does not correspond to any information type is the information type "- (none)". In this embodiment, the information detection unit 428 also holds a list of predetermined detectable information types. The storage location is not limited to the information detection unit 428, and may be, for example, the external storage 120. The input reception unit 429 receives user input on the UI screen displayed by the display control unit 427.

[0025] <Overall process flow> The CPU 211 of the MFP 110 loads control programs stored in the ROM 212 and HDD 214 into the RAM 213 and executes the programs to execute and control various functions of the MFP 110 and functions of additional applications.

[0026] 5 is a flowchart for generating and printing a masking image from an image scanned by the MFP 110. In addition to printing, the image may be converted into a file and sent to cloud storage (external storage 120). Note that, in this embodiment, an example will be described in which the display control unit 427 displays a screen on the touch panel of the operation unit 220, but the display control unit 427 may provide each screen in this embodiment to another device, and the operation unit of the other device may display each screen.

[0027] In the present disclosure, an additional application that masks a part of a scanned image and transmits the image to a cloud service (hereinafter referred to as a "masking application") can be used by installing it on the MFP 110. When the masking application is installed on the MFP 110, a button for using the function of the application is displayed on the main screen of the MFP 110.

[0028] In S501, the CPU 211 displays a main screen on the touch panel of the operation unit 220, on which buttons for executing applications provided by the MFP 110 are arranged, via the display control unit 427. Furthermore, the CPU 211 creates job information based on a designation received from a user via the input receiving unit 429. The job information includes a masking mode, a masking character string, a masking type, and a masking area designated by the user. Other information may also be included in the job information. Details will be described with reference to FIG. 6.

[0029] In S502, the CPU 211 requests scanning via the scan instruction unit 422 and the scan execution unit 411, acquires the scanned image data, and stores it in the RAM 213. In this embodiment, the CPU 211 acquires the image data by scanning, but may also acquire the image data from the HDD 214 via the data management unit 424 and the internal data storage unit 412. The CPU 211 may also acquire the image data from the external storage 120 via the data management unit 424 and the Internet access unit 426. The CPU 211 may also acquire the image data using other means.

[0030] In S503, CPU 211 generates masking information from the job information acquired in S501 and the image data acquired in S502 via image processing unit 423. CPU 211 performs skew rotation correction on the image data acquired in S502 via image processing unit 423 to generate corrected image data. Furthermore, CPU 211 analyzes the corrected image data via image processing unit 423 and generates masking information in light of the job information acquired in S501. Details will be described with reference to FIG.

[0031] In S504, the CPU 211 creates a masking image from the corrected image data and masking information created in S503 via the image processing unit 423. Next, the CPU 211 creates and displays a preview screen via the main processing unit 421 and the display control unit 427, on which the created masking image can be viewed and modified as necessary. The CPU 211 creates the preview screen via the display control unit 427, displays it on the touch panel of the operation unit 220, and modifies the masking image based on a designation received from the user. This will be described in detail later with reference to FIG. 9.

[0032] In S505, the CPU 211 prints the masking image created in S504 via the main processing unit 421, the print instruction unit 425, and the print execution unit 413. In this embodiment, the CPU 211 generates a printout of the masking image by printing via the main processing unit 421, but is not limited to this. The CPU 211 may store the image in the HDD 214 via the data management unit 424 and the internal data storage unit 412. The CPU 211 may also store the image in the external storage 120 via the data management unit 424 and the Internet access unit 426, or may send the image by email to an arbitrary destination. The CPU 211 may store the image using other means.

[0033] In S506, the CPU 211 generates a preset registration screen via the display control unit 427, displays it on the touch panel of the operation unit 220, and registers the preset based on the designation received from the user. Details will be described later with reference to FIG.

[0034] <Function selection flow> 6A is a flowchart for explaining the main screen display process of S501 in this embodiment. In S601, the CPU 211 generates a main screen for accepting designation of a masking mode executed in this embodiment via the display control unit 427, and displays the main screen on the touch panel of the operation unit 220 via the UI display unit 414. Here, the masking mode is the type of masking process executed in this embodiment. The masking modes include character string designation (character string masking process), information type designation (information type masking process), area designation (area masking process), and preset designation (preset masking process).

[0035] The character string specification is a mode for masking a character string that corresponds to a specified character string. The information type specification is a mode for masking a character string that corresponds to a specified information type. The area specification is a mode for masking a rectangular area specified on a preview screen. The preset specification is a mode for specifying masking information when a character string specification, an information type specification, or an area specification that is saved in advance as a preset, and for masking according to the contents of the preset.

[0036] 7(a) shows an example of a main screen in this embodiment. The main screen 700 includes a masking mode list 701. In this embodiment, the masking mode list 701 includes a character string designation button 702, an information type designation button 703, an area designation button 704, and a preset designation button 705, but may also include other buttons.

[0037] When the CPU 211 detects a user pressing the character string designation button 702 via the input receiving unit 429, the CPU 211 determines the masking mode as "character string designation" and transitions the screen to a character string designation screen 710 shown in Fig. 7(b) . When the masking mode is character string designation, the character string area of ​​the corresponding character string is automatically masked in the flowchart of Fig. 8 described later.

[0038] When the CPU 211 detects a user pressing the information type designation button 703 via the input receiving unit 429, the CPU 211 confirms the masking mode as "information type designation" and transitions the screen to an information type designation screen 720 shown in Fig. 7(c) . When the masking mode is information type designation, information detection is performed in the flowchart of Fig. 8 described later, and the character string area corresponding to the relevant information type is automatically masked.

[0039] When the CPU 211 detects the user pressing the area designation button 704 via the input reception unit 429, the CPU 211 confirms the masking mode as "area designation" and transitions the screen to a scan message screen 730 shown in Fig. 7(d) . When the masking mode is area designation, the coordinates of a rectangular area in the flowchart of Fig. 8 described later are acquired, and the rectangular area designated by the user's press is masked. Therefore, "area designation" is a masking process that can be used regardless of whether or not character recognition processing described later is performed.

[0040] When the CPU 211 detects a user pressing the preset designation button 705 via the input receiving unit 429, the CPU 211 determines the masking mode as "preset designation" and transitions the screen to a preset designation screen 740 shown in Fig. 7(e). When the masking mode is preset designation, a masking area is determined according to the contents of the designated preset in the flowchart of Fig. 8 described later. The determined masking area is masked.

[0041] When the user presses any button included in the masking mode list 701, the main screen 700 confirms the masking mode and transitions to a screen corresponding to the masking mode. When the main screen 700 is displayed, the process proceeds to S602.

[0042] In S602, the CPU 211 determines the masking mode confirmed in S601 via the display control unit 427 and the input receiving unit 429. If the masking mode is character string designation (character string designation in S602), the process proceeds to S603. If the masking mode is information type designation (information type designation in S602), the process proceeds to S604. If the masking mode is area designation (area designation in S602), the process proceeds to S605. If the masking mode is preset designation (preset designation in S602), the process proceeds to S606.

[0043] In S603, the CPU 211 generates a character string designation screen 710 via the display control unit 427, and displays the character string designation screen 710 on the touch panel of the operation unit 220 via the UI display unit 414. The character string designation screen 710 is a screen that accepts a character string to be masked. When a scan button 712 is pressed on the character string designation screen 710, the CPU 211 generates job information, and the process of the flowchart shown in FIG. 6(a) ends.

[0044] FIG. 7B shows an example of a character string designation screen 710 in this embodiment. The character string designation screen 710 includes a character string input form 711 and a scan button 712. Other forms, buttons, and the like may also be included. The character string input form 711 is a form for inputting a character string to be masked. For example, when masking the character string "product code can0n", the CPU 211 accepts the user's input of the character string to the character string input form 711 via the input acceptance unit 429. When the scan button 712 is pressed on the character string designation screen 710, the CPU 211 generates job information via the display control unit 427 and adds the masking mode confirmed in S601 to the job information. Furthermore, the CPU 211 adds the character string input to the character string input form 711 via the display control unit 427 and the input acceptance unit 429 to the job information. For example, when "product code can0n" is input in the character string input form 711, the CPU 211 adds "product code can0n" as a masking character string and "designated character string" as a masking type to the job information via the display control unit 427. Next, the CPU 211 stores the job information in the RAM 213 via the display control unit 427, and ends the processing flow of the flowchart shown in Fig. 6(a). Note that a configuration may be made in which an information type designation screen, which will be described later, is subsequently displayed before ending the processing flow of the flowchart shown in Fig. 6(a).

[0045] In S604, the CPU 211 acquires a list of predetermined detectable information types via the display control unit 427 and the information detection unit 428, and generates an information type designation screen 720. Next, the CPU 211 displays the information type designation screen 720 on the touch panel of the operation unit 220 via the UI display unit 414. The information type designation screen 720 is a screen for accepting a detectable information type to be masked. When the scan button 712 is pressed on the information type designation screen 720, the CPU 211 generates job information, and the process of the flowchart shown in FIG. 6(a) ends.

[0046] FIG. 7(c) shows an example of an information type designation screen 720 in this embodiment. The information type designation screen 720 includes an information type list 721 and a scan button 712. It may also include other buttons. The information type list 721 is an area that lists and displays information type items 722 equal to the number of detectable information types. For example, if the detectable information types are "company name, name, telephone number, address", the information type list 721 displays information type items 722 of "company name, name, telephone number, address". The detectable information types may include "fax number, e-mail address, URL, credit card number, one-dimensional or two-dimensional code image", etc. If the information type items 722 do not fit within the display area, the information type list 721 may display a scroll bar to enable scrolling.

[0047] The information type item 722 includes an information type name 723 and a toggle button 724. The information type name 723 is an area that displays the information type name. The toggle button 724 is a button that is set to on when the information type displayed in the information type name 723 is to be masked, and is set to off when the information type is not to be masked. For example, when the information type "company name" is to be masked, the CPU 211 receives a press from the user via the input receiving unit 429, and sets the toggle button corresponding to the information type "company name" to on.

[0048] When the scan button 712 is pressed on the information type designation screen 720, the CPU 211 generates job information via the display control unit 427, and adds the masking mode confirmed in S601 to the job information. Furthermore, the CPU 211 adds all information types in the information type list 721 for which the toggle button 724 is turned on to the job information via the display control unit 427. For example, when the toggle button for the information type "company name" is turned on in the information type list 721, the CPU 211 adds the information type "company name" to the job information as a masking type via the display control unit 427. The CPU 211 then holds the job information in the RAM 213 via the display control unit 427, and the process flow of the flowchart shown in FIG. 6(a) ends. Note that a configuration may be made such that a character string designation screen is subsequently displayed before the process flow of the flowchart shown in FIG. 6(a) ends. By adopting such a configuration, it is possible to perform a masking process that combines "information type designation" and "character string designation".

[0049] In S605, the CPU 211 generates a scan message screen 730 via the display control unit 427, and displays it on the touch panel of the operation unit 220 via the UI display unit 414. The scan message screen is a screen that displays a message to prompt the user to scan. When the scan button is pressed on the scan message screen 730, the CPU 211 generates job information, and the process of the flowchart shown in FIG. 6A ends.

[0050] FIG. 7(d) shows an example of a scan message screen 730 in this embodiment. The scan message screen 730 includes a message 731 and a scan button 712. It may also include other buttons. The message 731 is an area that displays a message encouraging the user to scan. When the scan button 712 is pressed on the scan message screen 730, the CPU 211 generates job information via the display control unit 427, and adds the masking mode confirmed in S601 to the job information. Furthermore, the CPU 211 adds the masking type to the job information as blank via the display control unit 427. Next, the CPU 211 holds the job information in the RAM 213 via the display control unit 427, and the process flow of the flowchart shown in FIG. 6(a) ends.

[0051] Thereafter, when the user reads the document on the MFP 110, the CPU 211 displays the read image on the touch panel via the display control unit 427 and the UI display unit 414. When a PC or the like is used instead of the MFP 110, an image of the selected file is displayed on the touch panel. The details will be described later, but the user specifies a masking area with a finger, a touch pen, or the like.

[0052] In S606, the CPU 211 acquires a list of registered presets via the display control unit 427 and the data management unit 424. Specifically, the CPU 211 acquires the list of registered presets from the HDD 214 via the data management unit 424, the internal data storage unit 412, and the display control unit 427. The CPU 211 may also acquire the list of presets from the external storage 120 via the data management unit 424 and the Internet access unit 426. The CPU 211 may acquire the list of presets using other means. The CPU 211 extracts each preset name from the list of presets acquired via the display control unit 427, generates a preset designation screen 740, and displays it on the touch panel of the operation unit 220 via the UI display unit 414. The preset designation screen 740 is a screen that displays a list of presets and accepts the designation of any preset. When the scan button 712 is pressed on the preset designation screen 740, the CPU 211 generates job information, and the process of the flowchart shown in FIG. 6(a) ends.

[0053] FIG. 7(e) shows an example of a preset designation screen in this embodiment. The preset designation screen 740 includes a preset list 741. The preset list 741 is an area that displays a list of preset buttons 742 in the number of presets in the preset list. For example, if the preset list is a preset of "Proposal, Contract, Driver's License, Public Release", the preset list 741 displays the preset buttons of "Proposal, Contract, Driver's License, Public Release". If the preset buttons 742 do not fit within the display area of ​​the preset list 741, a scroll bar may be displayed so that the preset buttons 742 can be scrolled. The preset buttons 742 are buttons for designating presets. The CPU 211 receives a user's press on any of the preset buttons 742 displayed in the preset list 741 via the display control unit 427 and the input receiving unit 429. When the user's press is received, the CPU 211 generates a preset details screen from the contents of the preset via the display control unit 427, and displays the preset details screen on the touch panel of the operation unit 220 via the UI display unit 414. The preset details screen is a screen that displays the masking settings of a specified preset. For example, when a "contract" preset is specified, a preset details screen that displays the masking settings of the "contract" preset is generated.

[0054] When the content of the preset is a masking character string, the CPU 211 generates a preset details screen for character string designation via the display control unit 427. When the content of the preset is a masking type, the CPU 211 generates a preset details screen for information type designation via the display control unit 427. When the content of the preset is a masking area, the CPU 211 generates a preset details screen for area designation via the display control unit 427. Furthermore, when the content of the preset is a composite content including a masking character string, a masking type, and a masking area, the CPU 211 may display each preset details screen in a switching manner via the display control unit 427.

[0055] 7(f) shows an example of a preset details screen for specifying a character string in this embodiment. The preset details screen 750 includes a preset name 751, a character string input form 711, and a scan button 712. The preset name 751 displays the name of the preset. The masking character string of the preset is input by default in the character string input form 711. Furthermore, in the character string input form 711, the masking character string may be freely edited by receiving an input from the user.

[0056] When the scan button 712 is pressed on the preset details screen 750, the CPU 211 generates job information via the display control unit 427, and adds the masking mode confirmed in S601 to the job information. Furthermore, the CPU 211 adds the character string input to the character string input form 711 via the display control unit 427 and the input receiving unit 429 as a masking character string to the job information. Next, the CPU 211 holds the job information in the RAM 213 via the display control unit 427, and ends the processing flow of the flowchart shown in FIG. 6(a).

[0057] 7(g) shows an example of a preset details screen for specifying an information type in this embodiment. The preset details screen 760 includes a preset name 751, a character string input form 711, an information type list 721, and a scan button 712. In the information type list 721, an information type item 722 that corresponds to the masking type of the preset is switched on as a default. If the information type does not correspond to the masking type of the preset, the toggle button is switched off as a default. The toggle button may also be freely edited by the user when pressed.

[0058] When the scan button 712 is pressed on the preset details screen 760, the CPU 211 generates job information via the display control unit 427, and adds the masking mode confirmed in S601 to the job information. Furthermore, the CPU 211 adds all information types in the information type list 721 for which the toggle button 724 is turned on, as masking types to the job information via the display control unit 427. Next, the CPU 211 holds the job information in the RAM 213 via the display control unit 427, and ends the processing flow of the flowchart shown in FIG. 6(a).

[0059] FIG. 7(h) shows an example of a preset detail screen for area designation in this embodiment. The preset detail screen 770 includes a preset name 751, a preset preview 771, and a scan button 712. The preset preview 771 includes an image outer shape preview 772 and a masking 773. The image outer shape preview 772 displays the outer shape of the image using the image size included in the preset. The masking 773 displays the masking area included in the preset within the same coordinate position on the image outer shape preview 772. Here, the masking 773 is a masking area specified by the CPU 211 via the input receiving unit 429. The preset preview 771 displays the area to be masked in the image by displaying the image outer shape preview 772 and the masking 773.

[0060] When the scan button 712 is pressed on the preset details screen 770, the CPU 211 generates job information via the display control unit 427, and adds the masking mode confirmed in S601 to the job information. Furthermore, the CPU 211 adds the masking area of ​​the preset to the job information via the display control unit 427. For example, if the masking area of ​​the preset is "(441, 957), (1369, 1057)", the CPU 211 adds the masking type as "rectangle area" and the masking area as "(441, 957), (1369, 1057)" to the job information. Next, the CPU 211 holds the job information in the RAM 213 via the display control unit 427, and ends the processing flow of the flowchart shown in FIG. 6(a).

[0061] When the preset details screen is switched and displayed and the scan button 712 is pressed, the CPU 211 generates job information via the display control unit 427 and adds the masking mode confirmed in S601 to the job information. The CPU 211 then adds the contents set in all of the preset details screens to the job information via the display control unit 427. The CPU 211 then stores the job information in the RAM 213 via the display control unit 427 and ends the processing flow of the flowchart shown in FIG. 6(a). When the preset contents are complex, masking can be specified by combining "character string specification", "information type specification", and "area specification".

[0062] Also, unlike the process of the flowchart shown in Fig. 6(a), it may be configured so that all of the character string designation, information type designation, and area designation can be designated. Fig. 6(b) is a flowchart in the case where the character string designation, information type designation, and area designation can be designated in combination in the main screen display process of S501 in this embodiment.

[0063] In S601, the CPU 211 generates a main screen via the display control unit 427, and displays it on the touch panel of the operation unit 220 via the UI display unit 414. An example of the main screen in this embodiment is shown in Fig. 7(i). The main screen 780 is made up of a masking mode list 781. In this embodiment, the masking mode list 781 includes a manual designation button 782 and a preset designation button 705, but may also include other buttons. When the main screen is displayed, the process proceeds to S602.

[0064] In S602, the CPU 211 determines the masking mode selected by the user via the display control unit 427 and the input receiving unit 429. If manual designation is selected, the process proceeds to S603. If preset designation is selected, the process proceeds to S606.

[0065] In S603, S604, and S605, the CPU 211 performs the same process as in the flowchart shown in FIG. 6(a) via the display control unit 427. If there is an unused process in the character string designation, information type designation, and area designation, the process is not executed and the process proceeds to the next process. The CPU 211 stores the user's designation information in the composite process in the job information, holds the job information in the RAM 213, and ends the process flow of the flowchart shown in FIG. 6(b). In S606, the CPU 211 performs the same process as in the flowchart shown in FIG. 6(a) via the display control unit 427. The CPU 211 generates job information, holds it in the RAM 213, and ends the process flow of the flowchart shown in FIG. 6(b). By executing the process flow shown in FIG. 6(b), it is also possible to perform masking designation that combines "character string designation" or "information type designation" that uses the result of character recognition processing with "area designation" that is executed regardless of whether character recognition processing is executed or not.

[0066] In the process flow shown in Fig. 6(a), basically, the image processing unit 423 operates in a mode in which one masking process is performed. In the process flow shown in Fig. 6(b), the image processing unit 423 operates in a mode in which a plurality of different masking processes are performed. That is, as shown in Fig. 6(a) and Fig. 6(b), the image processing unit 423 may have a mode in which one masking process is performed and a mode in which a plurality of different masking processes are performed.

[0067] <Masking area specification flow> FIG. 8 is a flowchart for explaining the masking region specification process of S503 in this embodiment. Note that, if the masking type included in the job information is empty, the processes of S802, S803, and S804 may be skipped. Also, if the masking type included in the job information is only a rectangular region, the processes of S802 and S803 may be skipped. In S801, the CPU 211 acquires image data from the RAM 213 via the image processing unit 423, performs skew correction and rotation correction, and stores the corrected image data in the RAM 213. When the corrected image data is stored in the RAM 213, the process proceeds to S802. In S802, the CPU 211 converts the corrected image data into a one-channel image via the image processing unit 423 to improve OCR accuracy, performs OCR, and stores the extracted character string and the character string area corresponding to the character string in the RAM 213. That is, the CPU 211 selects an area (character string area) in which a character string exists by performing block selection (BS), and extracts the character string by performing OCR processing (character recognition processing) on ​​the character string area. When the extracted character strings and character string areas are stored in the RAM 213, the process proceeds to S803. An OCR result table showing an example of character strings and character string areas extracted in this embodiment is shown in Table 1. However, for areas where the result of block selection is an image or the like, no character strings exist, so OCR processing (character recognition processing) is not performed on the area.

[0068] [Table 1] In S803, the CPU 211 performs information detection processing from the character string extracted in S802 via the information detection unit 428, adds the information type corresponding to the character string and the character string area, and stores the information detection result in the RAM 213. Here, the information detection processing is processing in which the CPU 211 determines whether the character string corresponds to any of the predetermined detectable information types, and stores the corresponding information type in the information detection result. Table 2 shows an example of adding the information detection result generated in this embodiment. For example, if the character string is "Iroha Co., Ltd.", the CPU 211 determines that it corresponds to the information type "company name," and stores the information type, character string, and character string area in the information detection result. If it does not correspond to any of the information types, the CPU 211 stores it in the RAM 213 as the information type "- (none)." The information detection processing may be determined based on a predetermined rule, or may be determined using machine learning. In addition, the information detection processing may be determined by calling an external service via the Internet access unit 426. When the information type is added, the processing proceeds to S804.

[0069] [Table 2] In S804, the CPU 211 generates masking information from the job information acquired in S501 via the image processing unit 423 and the information detection result acquired in S803, and stores the masking information in the RAM 213. The masking information includes a masking type, a character string, whether masking is required, and a masking area. Whether masking is required is information indicating whether the item is to be masked. The masking area is information indicating the coordinates of the start point and the end point of a rectangular area to be masked in the image. Table 3 shows a table to which the masking information has been added.

[0070] [Table 3] First, CPU 211 generates blank masking information via image processing unit 423. Next, if a masking character string is included in the job information via image processing unit 423, CPU 211 determines whether the character string matches a character string in the information detection result. If the two match, CPU 211 stores in the masking information the masking type as "specified character string", the character string as the character string, whether masking is required as "required", and the masking area as the character string area.

[0071] Furthermore, if the job information includes a masking type, CPU 211 determines whether the masking type matches the information type of the information detection result. If the two match, CPU 211 stores the masking type as the information type, the character string as the character string, the masking necessity as "necessary", and the masking area as the character string area in the masking information. If the two do not match, CPU 211 stores the masking necessity as "not required" in the masking information as well. Next, CPU 211 stores the masking type as "rectangular area", the character string as "- (none)", the masking necessity as "necessary", and the masking area as the masking area for the item of the masking type included in the job information that is a rectangular area. When the process of S804 is completed, the process of the flowchart shown in FIG. 8 ends.

[0072] <Masking editing flow> 9 is a flowchart for explaining the masking editing process of S504 in this embodiment. In S901, the CPU 211 acquires the corrected image data created in S801 and the masking information created in S804 or S905 from the RAM 213 via the image processing unit 423. The CPU 211 acquires a masking area (start point coordinates / end point coordinates) to be masked from the masking information acquired via the image processing unit 423. The CPU 211 performs masking on a rectangular area generated at the same coordinate position on the corrected image data to generate a masked image. The CPU 211 stores the masked image generated via the image processing unit 423 in the RAM 213. When the masking image is stored in the RAM 213, the process proceeds to S902.

[0073] In S902, the CPU 211 acquires the masking image generated in S901 from the RAM 213 via the display control unit 427, generates the preview screen 1000 of Fig. 10(a) or 10(b), and displays it on the touch panel via the UI display unit 414. When the preview screen 1000 is displayed, the process proceeds to S903.

[0074] 10(a) and 10(b) show an example of a preview screen 1000 for displaying a preview of a masking image according to this embodiment. The preview screen 1000 includes the following components. A masking image preview display area 1001 displays the masking image created in S901. When the masking image does not fit on the screen, a scroll bar is automatically displayed in the masking image preview display area 1001. A preview display area enlargement button 1002 is a button for increasing the display magnification of the masking image preview display area 1001 by a certain amount and enlarging the display. A preview display area fit button 1003 is a button for changing the magnification to the maximum magnification at which the masking image fits within the masking image preview display area 1001. A preview area reduction button 1004 is a button for decreasing the display magnification of the masking image preview display area by a certain amount and reducing the display.

[0075] The previous page button 1007 is a button for displaying the previous page of the scanned image when there are multiple pages of scanned images. The page number display 1008 displays the page of the scanned image currently displayed and the total number of pages. The next page button 1009 is a button for displaying the next page of the scanned image when there are multiple pages of scanned images. The masking deletion button 1011 is a button for canceling the masking specified in the masking image preview display area 1001. Specifically, when the masking selection button 1013 is selected via the display control unit 427 and the input reception unit 429, the CPU 211 executes the following operation. When the CPU 211 detects that the masking "necessary" masking has been pressed on the image data of the masking image, the CPU 211 recognizes that the masking has been specified for the next operation. Then, when the CPU 211 detects that the masking deletion button 1011 has been pressed following the specification via the display control unit 427 and the input reception unit 429, the CPU 211 sets the masking necessity of the masking information to "no." The CPU 211 creates a masking image based on the masking information updated via the image processing unit 423 , and updates the masking image preview display area 1001 .

[0076] When the masking instruction button 1012 is selected via the display control unit 427 and the input reception unit 429, the CPU 211 performs the following operation. The CPU 211 detects, as a starting point, a location touched by a finger, a touch pen, or the like in an image in which a masking region is displayed on a touch panel via the display control unit 427 and the input reception unit 429. When the CPU 211 subsequently detects, via the display control unit 427 and the input reception unit 429, an end point at which the finger or the touch pen, or the like, is removed after dragging, the CPU 211 recognizes a rectangular region specified by the start point and end point as a masking 1006. The masking 1006 in FIG. 11(a) is a display during dragging with a finger or a touch pen, or the like, and the masking 1006 in FIG. 11(b) is an example showing the masking 1006 in which the finger or the touch pen, or the like, is removed from the touch panel during dragging and the rectangular region is confirmed. The masking 1005 is a region that has already been masked in the masking region. A print button 1014 is a button for designating masking printing using the masking image being previewed.

[0077] The character string designation input form 1021 is a form for inputting a character string to be masked. The character string designation input form 1021 has the same function as the character string input form 711 described above. The information type designation input form 1022 is a form for inputting an information type to be masked. The information type designation input form 1022 has the same function as the information type list 721.

[0078] In S903, CPU 211 determines whether or not print button 1014 has been pressed via display control unit 427 and input acceptance unit 429. If CPU 211 determines via display control unit 427 and input acceptance unit 429 that print button 1014 has been pressed (YES in S903), the process flow of the flowchart shown in Fig. 9 ends. If CPU 211 determines via display control unit 427 and input acceptance unit 429 that print button 1014 has not been pressed (NO in S903), the process proceeds to S904.

[0079] In S904, the CPU 211 determines whether designation of masking 1006, input to character string designation input form 1021, or input to information type designation input form 1022 has been detected via the display control unit 427, the input reception unit 429, and the UI display unit 414. If the CPU 211 determines via the display control unit 427 and the input reception unit 429 that masking designation or the like has been performed in S904 (YES in S904), the process proceeds to S905. If the CPU 211 determines via the display control unit 427 and the input reception unit 429 that masking designation or the like has not been performed in S904, the process returns to S902.

[0080] In S905, the CPU 211 acquires the masking 1006 designated on the touch panel via the display control unit 427, the input receiving unit 429, and the UI display unit 414, and converts it into a rectangular area on the masking image displayed as a preview image. The CPU 211 acquires the masking information created in S804 or S905 via the display control unit 427. The CPU 211 adds to the masking information "rectangular area" as the masking type, "- (none)" as the character string, "necessary" as the masking necessity, and the converted rectangular area as the masking area (coordinates of the start point and end point), and stores the masking information in the RAM 213. Table 3 shows an example in which a rectangular area has been added, and Table 4 shows an example in which a rectangular area has been added.

[0081] [Table 4] The CPU 211 determines whether the character string input to the character string designation input form 1021 via the display control unit 427 and the input acceptance unit 429 corresponds to a character string in the masking information. If the character string corresponds to a character string in the masking information, the CPU 211 changes the masking necessity of the item to "Needed". The CPU 211 changes the masking type item of the masking information corresponding to the information type item whose toggle button has been changed in the information type designation input form 1022 via the display control unit 427 and the input acceptance unit 429. If the toggle button is changed to on, the CPU 211 changes the masking necessity to "Needed". If the toggle button is changed to off, the CPU 211 changes the masking necessity to "No". When the CPU 211 completes the above process in S905, the process returns to S901.

[0082] <Preset registration flow> 11 is a flowchart for explaining the preset registration process of S506 in this embodiment. In S1101, the CPU 211 determines whether or not the masking mode included in the job information is preset-specified via the display control unit 427. If the masking mode is preset-specified, the process proceeds to S1102. If the masking mode is not preset-specified, the process proceeds to S1103.

[0083] In S1102, the CPU 211 determines whether or not the preset specified in S606 has been edited in response to a user input via the display control unit 427 and the input receiving unit 429. If the preset has been edited, the process proceeds to S903, and if the preset has not been edited, the process flow of the flowchart shown in Fig. 11 ends. In S1103, the CPU 211 displays on the operation unit 220, via the display control unit 427 and the UI display unit 414, a screen (not shown) for confirming with the user whether or not to register a preset.

[0084] In S1104, the CPU 211 determines whether or not a user operation has been received via the display control unit 427 and the input receiving unit 429 to select registration as a preset. If registration has been selected, the process proceeds to S1105. If registration has not been selected, the process flow of the flowchart shown in FIG. 11 ends. In S1105, the CPU 211 displays a preset registration screen on the operation unit 220 via the display control unit 427 and the UI display unit 414. The preset registration screen is a screen on which the masking information implemented in this embodiment can be registered as a preset. When the CPU 211 executes the process of S1105, the process proceeds to S1106.

[0085] In S1105, the CPU 211 generates a preset registration screen according to the masking type of the masking information. For an item whose masking type is a specified character string, a preset registration screen for specifying a character string is generated. For an item whose masking type is a predetermined detectable information type, a preset registration screen for specifying an information type is generated. For an item whose masking type is a rectangular area, a preset registration screen for specifying an area is generated. When the masking type of the masking information includes multiple masking types, namely, a specified character string, a predetermined detectable information type, and a rectangular area, the CPU 211 displays the corresponding preset registration screens so that they can be switched.

[0086] FIG. 12(a) shows an example of a preset registration screen for specifying a character string in this embodiment. The preset registration screen 1200 includes a preset name 751, a character string input form 711, a register button 1203, and a cancel button 1204. The preset name 751 and the character string input form 711 have the same functions as the items in the preset details screen 750. The preset name 751 can freely edit a character string upon receiving an input from the user. In the character string input form 711, a character string is determined according to the masking information. For example, when the masking information includes an item in which the masking necessity is "required", the information type is "specified character string", and the character string is "product code can0n", "product code can0n" is displayed in the character string input form 711. In addition, the CPU 211 may receive an input from the user via the display control unit 427 and the input receiving unit 429 and edit the masking character string in the character string input form 711.

[0087] The register button 1203 is a button for confirming the registration of information displayed on the preset registration screen as a preset. When the register button 1203 is pressed on the preset registration screen 1200, the CPU 211 registers the information displayed in the preset name 751 and the character string input form 711 as a preset via the display control unit 427. For example, if "Proposal 2" is input in the preset name 751, a preset with the preset name "Proposal 2" is created and registered. Furthermore, if "Product Code can0n" is input in the character string input form 711 on the preset registration screen 1200, the masking character string "Product Code can0n" is stored in the preset with the preset name "Proposal 2" and registered. The cancel button 1204 is a button for ending this embodiment without performing the preset registration process.

[0088] FIG. 12B shows an example of a preset registration screen for specifying an information type in this embodiment. The preset registration screen 1210 includes a preset name 751, an information type list 721, a registration button 1203, and a cancel button 1204. The preset name 751 and the information type list 721 have the same functions as the items in the preset details screen 760. The CPU 211 can edit the character string of the preset name 751 by receiving an input from the user via the display control unit 427 and the input receiving unit 429. In the information type list 721, the toggle button 724 is turned on or off depending on the masking information. For example, when the masking information includes an item in which the masking necessity is "necessary" and the information type is "company name", the toggle button 724 of the company name item in the information type list 721 is turned on. The CPU 211 may also edit the toggle button 724 in the information type list 721 by receiving an input from the user via the display control unit 427 and the input receiving unit 429.

[0089] When the register button 1203 is pressed on the preset registration screen 1210, the CPU 211 registers the information displayed in the preset name 751 as a preset via the display control unit 427. Furthermore, the CPU 211 stores and registers the information type of the item in the information type list 721 for which the toggle button 724 is turned on in a preset via the display control unit 427. For example, if "contract 2" is input in the preset name 751, a preset with the preset name "contract 2" is created and registered. Furthermore, suppose that the toggle button 724 of the item "company name" in the information type list 721 of the preset registration screen 1210 is turned on. The masking type with the type "company name" is stored and registered in the preset with the preset name "contract 2".

[0090] FIG. 12C shows an example of a preset registration screen for area designation in this embodiment. The preset registration screen 1220 includes a preset name 751, a preset preview 771, a registration button 1203, and a cancel button 1204. The preset name 751 and the preset preview 771 have functions equivalent to those of the items in the preset details screen 770. In the preset preview 771, the CPU 211 acquires the corrected image data from the RAM 213 via the display control unit 427, acquires the image size from the corrected image data, and displays the outer shape of the image in the image outer shape preview 772. In addition, the CPU 211 displays a rectangular area as a masking 773 in the same coordinate position on the image outer shape preview 772 from the masking area of ​​the masking information via the display control unit 427 and the UI display unit 414. When the registration button 1203 is pressed on the preset registration screen 1220, the CPU 211 registers the preset name 751, the image size of the corrected image data, and the masking area as presets via the display control unit 427.

[0091] In any of the preset registration screens, when the registration button 1203 is pressed, a preset may be registered using the contents of the individual preset registration screen, or the contents of all the preset registration screens may be integrated and registered as one preset.

[0092] In S1106, the CPU 211 saves the preset confirmed in S1105 via the display control unit 427 and the data management unit 424. The CPU 211 may save the preset in the external storage 120 via the data management unit 424 and the Internet access unit 426, or may save the preset in the HDD 214 via the data management unit 424 and the internal data storage unit 412. Here, if a preset with the same name has already been saved in the HDD 214 or the external storage 120 via the display control unit 427, the CPU 211 may display a warning display on the operation unit 220 inquiring of the user whether or not to overwrite the preset. In addition, when the preset registration is normally completed, the CPU 211 may display a display indicating that the preset registration is completed on the operation unit 220 via the display control unit 427.

[0093] As described above, by providing the user with the masking process of character string specification, information type specification, area specification, or preset specification, the user can use the masking process that matches the use case. Also, the user can perform the desired masking, such as masking by specifying an arbitrary area, masking arbitrary character strings collectively, or masking by combining two or more processing methods. This allows the user to use the masking process that matches the use case.

[0094] [Second embodiment] In this embodiment, the convenience of specifying a preset is improved by saving the number of times the preset is used. In the description of this embodiment, the description of the same configuration and processing procedure as in the first embodiment will be omitted, and only the differences will be described.

[0095] When the CPU 211 saves or acquires a preset via the data management unit 424, the CPU 211 adds the number of times the preset has been used to the preset as the number of times the preset has been used and saves it. The CPU 211 may also add the date and time when the preset was last used to the preset as the date and time of the last preset use and save it via the data management unit 424. In S606, when the CPU 211 generates a preset designation screen from the preset list acquired via the display control unit 427, the CPU 211 generates the preset list 741 so that the number of times the preset has been used is in descending order. The CPU 211 may also generate the preset list 741 so that the date and time of the last preset use is in descending order via the display control unit 427.

[0096] As described above, by sorting the preset list using the number of times the preset has been used or the date and time when the preset was last used, the user can easily find a frequently used preset or a preset that was used last, improving usability. As described above, the user can specify and mask an arbitrary area, mask an arbitrary character string all at once, or mask using a combination of two or more masking methods. This makes it possible to perform masking processing that matches the use case.

[0097] [Third embodiment] In this embodiment, a specific description will be given of how the misalignment of the document when scanning is performed in the MFP is corrected, so that the area is correctly masked even when the area is specified. In describing this embodiment, descriptions of the same configuration and processing procedure as in the first embodiment will be omitted, and only the differences will be described.

[0098] 8, the CPU 211 acquires image data from the RAM 213 via the image processing unit 423, performs position correction, and stores the corrected image data in the RAM 213. Position correction is a process for correcting an image scanned while being significantly displaced from the origin of the platen or an image scanned while being placed at an angle to the platen so that the same origin becomes the base point.

[0099] First, CPU 211 detects via image processing unit 423 that the document was scanned without being placed on the document platen as the origin in the image data. For example, this corresponds to the case where CPU 211 detects that the upper left vertex of the rectangular area of ​​the document in the image is a predetermined value away from the origin of the image, or that the four sides of the rectangular area of ​​the document are not perpendicular to the coordinate system of the image. Misalignment of the document may be detected by other methods.

[0100] When it is detected that the document is misaligned, CPU 211 performs skew rotation correction via image processing unit 423 so that the four sides of the rectangular area of ​​the document included in the image data are upright, and then translates the image data so that the origin of the document becomes the origin of the image data, thereby generating corrected image data. Alternatively, CPU 211 may cut out the document portion via image processing unit 423, and perform rotation correction and translation on the cut-out image data to generate corrected image data. Next, CPU 211 stores the corrected image data in RAM 213 via image processing unit 423.

[0101] As described above, by performing position correction, masking can be performed by directly using the coordinates of the rectangular area specified in the area specification, regardless of how the document is placed on the document platen, improving usability. As described above, the user can specify and mask any area, mask any character string collectively, or mask using a combination of two or more masking processing methods. This makes it possible to perform masking processing that matches the use case.

[0102] [Other embodiments] The present disclosure can also be realized by a process in which a program for implementing one or more functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that implements one or more functions.

[0103] The disclosure of the above-described embodiment includes the following configurations.

[0104] (Configuration 1) An image processing device equipped with a scanner, comprising: a display control means for displaying on a display means a UI screen for designating an area to be masked in a document image obtained by scanning with the scanner using a method selected from a plurality of different methods; a reception means for receiving user input on the UI screen; and an image processing means for masking a designated portion of the document image based on the user input received by the reception means, wherein the plurality of different methods include a first method for designating an information type representing a type of character string included in the area to be masked, and a second method for designating a position of the area to be masked on the UI screen on which the document image is displayed.

[0105] (Configuration 2) The image processing device according to configuration 1, wherein the plurality of different methods further includes a third method for specifying a character string to be included in the area to be masked.

[0106] (Configuration 3) The image processing device according to configuration 2, further comprising a storage means for storing information of an area specified by the first method or information of an area specified by the second method executed by the image processing means as a preset designation.

[0107] (Configuration 4) The image processing device according to configuration 2, characterized in that, when the selected method for specifying the area to be masked is the third method, the receiving means receives user input specifying the character string on a UI screen of the third method, and the image processing means masks a character string area including the character string.

[0108] (Configuration 5) The image processing device according to configuration 1, characterized in that, when the selected method for specifying the area to be masked is the first method, the receiving means receives user input specifying the information type on a UI screen of the first method, and the image processing means masks a character string area including a character string corresponding to the specified information type.

[0109] (Configuration 6) The image processing device according to configuration 5, wherein the specified information type includes company name, name, telephone number, address, fax number, email address, URL, credit card number, and one-dimensional or two-dimensional code image.

[0110] (Configuration 7) The image processing device described in configuration 1, characterized in that, when the selected method for specifying the area to be masked is the second method, the receiving means receives user input specifying the position of the area to be masked on a UI screen of the second method, and the image processing means masks the area at the specified position.

[0111] (Configuration 8) The image processing device described in Configuration 3, wherein the plurality of different methods further includes a fourth method of specifying an area to be masked using the preset designation stored in the storage means, and when the selected method of specifying the area to be masked is the fourth method, the receiving means receives a preset designation selected from the preset designations displayed on a UI screen of the fourth method, and the image processing means performs masking based on the selected preset designation.

[0112] (Configuration 9) The image processing device according to configuration 8, wherein the display control means displays the preset designation on the display means based on the number of times the user has used the UI screen of the fourth method.

[0113] (Configuration 10) The image processing device according to configuration 8, wherein the display control means displays the preset designation on the display means based on the last use date and time on the UI screen of the fourth method.

[0114] (Configuration 11) The image processing device according to configuration 1, wherein the display control means displays a preview screen on the display means before the image processing means executes masking.

[0115] (Configuration 12) The image processing device according to configuration 2, wherein the display control means displays a preview screen on the display means before the image processing means executes masking.

[0116] (Configuration 13) The image processing device according to configuration 12, wherein the preview screen includes a screen for inputting a character string specified in the third method, a screen for specifying an information type specified in the first method, and a screen for specifying an area to be masked in the second method.

[0117] (Configuration 14) The image processing device according to configuration 3, wherein the display control means displays a preview screen on the display means before the image processing means executes masking.

[0118] (Configuration 15) The image processing device according to configuration 14, wherein the preview screen includes a screen for inputting a character string specified in the third method, a screen for specifying an information type specified in the first method, and a screen for specifying an area to be masked in the second method.

[0119] (Configuration 16) The image processing device according to any one of configurations 1 to 15, wherein a designated portion in the document image is masked in black.

[0120] (Configuration 17) The image processing device according to any one of configurations 1 to 15, wherein a designated portion in the document image is masked with a background color.

[0121] (Configuration 18) The image processing device according to configuration 1, characterized in that when the image processing means detects a misalignment between the newly acquired document image and the already acquired document image, it obliquely rotates the newly acquired document image so that all four sides of the document image are upright, and corrects the origin of the obliquely rotated document image so that it coincides with the origin of the already acquired document image.

[0122] (Configuration 19) A control method for an image processing device equipped with a scanner, comprising the steps of: displaying on a display means a UI screen for designating an area to be masked in a document image obtained by scanning with the scanner using a method selected from a plurality of different methods; accepting user input on the UI screen; and masking a designated portion of the document image based on the user input accepted in the accepting step, wherein the plurality of different methods include a first method for designating an information type representing a type of character string included in the area to be masked, and a second method for designating a position of the area to be masked on the UI screen displaying the document image.

[0123] (Configuration 20) A program for causing a computer to function as the image processing device according to any one of configurations 1 to 18.

Claims

1. An image processing device including a scanner, a display control means for displaying on a display means a UI screen showing a plurality of different methods for identifying an area to be masked within a document image obtained by scanning with the scanner; a receiving means for receiving a user input regarding a method selected by a user via the UI screen; an image processing means for masking the identified portion of the document image using a method selected by the user based on the user input received by the receiving means; Equipped with The plurality of different methods include a first method of specifying an information type that indicates a type of character string included in the area to be masked, and a second method of specifying a position of the area to be masked on the UI screen on which the document image is displayed.

13. An image processing device comprising:

2. 2. The image processing apparatus according to claim 1, wherein the plurality of different methods further includes a third method for specifying a character string to be included in the area to be masked.

3. 3. The image processing device according to claim 2, further comprising a storage means for storing information on an area identified by at least one of the first method, the second method, and the third method executed by the image processing means as a preset designation.

4. When the selected method for identifying the region to be masked is the third method, the accepting means accepts a user input specifying the character string on a UI screen of the third method; 3. The image processing apparatus according to claim 2, wherein the image processing means masks a character string area including the character string.

5. When the method for identifying the selected region to be masked is the first method, the accepting means accepts a user input specifying the information type on a UI screen of the first method, 2. The image processing apparatus according to claim 1, wherein said image processing means masks a character string area including a character string corresponding to the specified information type.

6. 6. The image processing apparatus according to claim 5, wherein the specified information type includes a company name, a name, a telephone number, an address, a FAX number, an email address, a URL, a credit card number, and a one-dimensional or two-dimensional code image.

7. When the selected method for identifying the region to be masked is the second method, the receiving means receives a user input specifying a position of an area to be masked on a UI screen of the second method; 2. The image processing apparatus according to claim 1, wherein said image processing means masks the area of ​​said designated position.

8. The plurality of different methods further includes a fourth method of specifying an area to be masked using the preset designation stored in the storage means; When the method for identifying the selected region to be masked is the fourth method, the receiving means receives a preset designation selected from the preset designations displayed on the UI screen of the fourth method, 4. The image processing apparatus according to claim 3, wherein the image processing means executes masking based on the selected preset designation.

9. 9. The image processing apparatus according to claim 8, wherein the display control means displays the preset designation on the display means based on the number of times the user has used the UI screen of the fourth method.

10. 9. The image processing apparatus according to claim 8, wherein the display control means displays the preset designation on the display means on the UI screen of the fourth method based on a last use date and time.

11. 2. The image processing apparatus according to claim 1, wherein said display control means displays a preview screen on said display means before said image processing means executes masking.

12. 3. The image processing apparatus according to claim 2, wherein the display control means displays a preview screen on the display means before the image processing means executes masking.

13. 13. The image processing device according to claim 12, wherein the preview screen includes a screen for inputting a character string to be specified in the third method, a screen for specifying an information type to be specified in the first method, and a screen for specifying a position of an area to be masked in the second method.

14. 4. The image processing apparatus according to claim 3, wherein said display control means displays a preview screen on said display means before said image processing means executes masking.

15. 15. The image processing device according to claim 14, wherein the preview screen includes a screen for inputting a character string to be specified in the third method, a screen for specifying an information type to be specified in the first method, and a screen for specifying a position of an area to be masked in the second method.

16. The image processing apparatus according to claim 1 , wherein the specified portion in the document image is masked in black.

17. The image processing apparatus according to claim 1 , wherein the specified portion in the document image is masked with a background color.

18. 2. The image processing device according to claim 1, wherein, when the image processing means detects that the newly acquired document image is misaligned with the already acquired document image, the image processing means obliquely rotates the newly acquired document image so that all four sides of the newly acquired document image are upright, and corrects the origin of the obliquely rotated document image so that it coincides with the origin of the already acquired document image.

19. A method for controlling an image processing device including a scanner, comprising: displaying, on a display means, a UI screen that displays a plurality of different methods for specifying an area to be masked within a document image obtained by scanning with the scanner; receiving a user input regarding a method selected by the user via the UI screen; masking the identified portion of the document image using a method selected by the user based on the user input received in the receiving step; Equipped with The plurality of different methods include a first method of specifying an information type that indicates a type of character string included in the area to be masked, and a second method of specifying a position of the area to be masked on the UI screen on which the document image is displayed.

23. A method for controlling an image processing apparatus comprising the steps of:

20. A program for causing a computer to function as the image processing device according to any one of claims 1 to 18.

Images