Information processing device and program
Patent Information
- Application Number
- JP2022191705
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2022-11-30
- Publication Date
- 2026-02-17
- Estimated Expiration
- 2042-11-30
AI Technical Summary
Existing image processing systems fail to appropriately handle masked areas in scanned documents, leading to inconsistencies in using information from these areas for file and folder names, which can compromise privacy when sharing documents.
An image processing apparatus that displays a preview of a scanned image, allowing users to designate areas to be masked and areas for character information, with overlapping areas highlighted for user recognition and selection of appropriate processing options to manage overlapping information.
Ensures that only appropriate information is used for file and folder names, reducing the risk of inadvertently disclosing sensitive data and enhancing privacy in document sharing.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to an image processing apparatus, an image processing method, and a program, and in particular to a technique for masking a scanned image and printing it or transmitting it to a cloud service or the like for storage. [Background technology]
[0002] When a document is scanned with a scanner and the resulting scanned image is electronically stored, the scanned image may be shared with others. In such cases, if the scanned image contains personal information or confidential information, such as an identification document, application form, contract, or design drawing, masking (so-called blackout) may be performed to make parts of the scanned image (such as confidential information) invisible by painting them black.
[0003] Methods for masking a part of a scanned image generated by reading an original with a scanner include a method of masking at a preset position, a method of manually specifying the masking position, etc. For example, Patent Document 1 discloses an information processing device that performs masking processing on electronic data of N copies (N≧2) of a document based on mask position designation information that designates the mask position on a page-by-page basis, and generates N copies of electronic files divided for each page number designated by the mask position designation information. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] JP 2020-205493 A Summary of the Invention [Problem to be solved by the invention]
[0005] MFPs (multi-function peripherals) are known that have a function of linking with cloud services as a storage destination when a scanned image generated by a scanner is saved as an electronic file, and a user can send an electronic file created by the MFP to a cloud service specified by the user. Here, one of the purposes of sending an electronic file of a scanned image to a cloud service is to change the storage and sharing of documents from conventional printed matter to electronic files. For this reason, it is desirable to be able to easily obtain a desired electronic file from a large number of saved electronic files, and one method for this is to use document information possessed by an electronic file as the file name of the electronic file. Then, for example, character strings or barcode information in a scanned image can be used as a file name or folder name that utilizes the document information in the electronic file.
[0006] In this case, whether or not it is acceptable to use the information under the masked area in the file name of the electronic file of the scanned image that includes the masked portion (hereinafter referred to as the "masked area") depends on the purpose of the electronic file. In other words, if the electronic file is shared with a person to whom the information under the masked area should not be disclosed, or if the storage destination of the electronic file is made public to said person, the information under the masked area cannot be used in the file name or folder name. On the other hand, if the purpose is personal storage, etc., convenience can be increased by using the information under the masked area in the file name. The same situation applies to folder names when storing electronic files in folders.
[0007] The present invention has been made in consideration of the above circumstances, and has an object to provide an image processing device that makes it possible to save an electronic file including a masked area with an appropriate name. [Means for solving the problem]
[0008] The image processing device of the present invention comprises a control means for displaying a preview of a scanned image on a display device, a first designation means for designating a first area to be masked in the scanned image, and a second designation means for designating a second area including text information to be used for saving the scanned image, and is characterized in that, when there is an overlapping area where the first area and the second area overlap, the control means displays the preview so that the user can recognize the overlapping area. Effect of the Invention
[0009] According to the present invention, it is possible to save an electronic file including a mask area with an appropriate name. [Brief description of the drawings]
[0010] [Figure 1] 1 is a diagram showing a schematic configuration of an image processing system according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a block diagram showing the hardware configuration of the MFP. [Diagram 3] FIG. 2 is a block diagram showing the hardware configuration of an external storage device. [Figure 4] FIG. 2 is a block diagram showing the functional blocks (software configuration) of the MFP. [Diagram 5] 11 is a flowchart of a process executed by the MFP. [Figure 6] FIG. 13 is a diagram showing an example of a masking method selection screen. [Figure 7] FIG. 13 is a diagram illustrating an example of a preset selection screen. [Figure 8] FIG. 13 is a diagram illustrating an example of a scan screen. [Figure 9] 13 is a flowchart of an area designation process. [Figure 10] FIG. 13 illustrates an example of a preview screen. [Figure 11] 11 is a diagram showing an example of area information stored in the MFP. [Figure 12] 13A and 13B are diagrams illustrating an example of a name input screen and a save destination setting screen. [Figure 13]FIG. 13 is a diagram illustrating an example of a processing selection screen. [Figure 14] FIG. 13 illustrates an example of an execution confirmation screen. [Figure 15] FIG. 4 is a diagram illustrating an example of preset information stored in the MFP. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0011] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.
[0012] Fig. 1 is a diagram showing a schematic configuration of an image processing system including an image processing device according to this embodiment. The image processing system is configured by connecting an MFP 110 and an external storage 120 so that they can communicate with each other over the Internet. The MFP 110 is connected to the external storage 120, which is a cloud service that provides various services over the Internet, via a LAN (not shown) (see Fig. 2). The number of external storages 120 is not limited to one, but multiple external storages are present.
[0013] The MFP 110 is a multifunction device having multiple functions such as a scanner and a printer, and is an example of an image forming device, and has a function of scanning an original to generate an image file and transferring the generated image file to an external storage service or the like capable of storing the file. The external storage 120 stores various data such as image files received via the Internet, and also executes a service of acquiring various data from an external device via a web browser.
[0014] 2 is a block diagram showing the hardware configuration of the MFP 110. The MFP 110 has a control unit 210, an operation unit 220, a printer unit 221, a scanner unit 222, and a modem 223. The control unit 210 has a CPU 211, a ROM 212, a RAM 213, a HDD 214, an operation unit I / F 215, a printer I / F 216, a scanner I / F 217, a modem I / F 218, and a network I / F 219.
[0015] The CPU 211 reads out a control program stored in the ROM 212 or the HDD 214 into the RAM 213 and executes it, thereby controlling the overall operation of the MFP 110 and executing various functions of the MFP 110 such as reading, printing, and communication. The ROM 212 stores programs such as an OS executed by the CPU 211 to control the operation of the MFP 110, and parameters required for executing the programs. The RAM 213 is used as a temporary storage means such as the main memory and work area of the CPU 211. Note that in this embodiment, one CPU 211 executes each process shown in a flowchart described later using one storage means (RAM 213 or HDD 214). However, the present invention is not limited to such a processing form, and each process may be executed by, for example, a plurality of CPUs and a plurality of RAMs or HDDs working together.
[0016] The HDD 214 is a large-capacity storage unit that stores image data and various programs. The operation unit I / F 215 is an interface that connects the operation unit 220 and the control unit 210. The operation unit 220 has a display device such as a liquid crystal monitor equipped with a touch panel, a keyboard, etc., accepts operations by a user, and notifies the CPU 211 of instructions according to the operation input.
[0017] The printer I / F 216 is an interface that connects the printer unit 221 and the control unit 210. Print data is transferred from the control unit 210 to the printer unit 221 via the printer I / F 216, and is printed by the printer unit 221 on a recording medium such as paper of a predetermined size. The scanner I / F 217 is an interface that connects the scanner unit 222 and the control unit 210. The scanner unit 222 reads an original placed on an original platen or an automatic document reader (ADF) (not shown), generates image data, and inputs the image data to the control unit 210 via the scanner I / F 217. The MFP 110 can perform copying by outputting image data generated by the scanner unit 222 as a printed matter from the printer unit 221, and can also perform file transmission and email transmission to the outside.
[0018] The modem I / F 218 is an interface that connects the modem 223 and the control unit 210. The modem 223 transmits and receives image data by facsimile communication with a facsimile machine (not shown) on the PSTN (Public Switched Telephone Network). The network I / F 219 is an interface that connects the control unit 210 (MFP 110) to a LAN. Using the network I / F 219, the MFP 110 can transmit image data and information to various services on the Internet and can also receive various information.
[0019] 3 is a block diagram showing a hardware configuration of the external storage 120. The external storage 120 includes a control unit 310. The control unit 310 includes a CPU 311, a ROM 312, a RAM 313, an HDD 314, and a network I / F 315.
[0020] The CPU 311 controls the overall operation of the external storage 120 by loading a control program stored in the ROM 312 into the RAM 313 and executing it. The ROM 312 stores programs executable by the CPU 311, parameters required for executing the programs, and the like. The RAM 313 is used as a temporary storage means such as the main memory and work area of the CPU 311. The HDD 314 is a large-capacity storage device that stores image data and various programs. The network I / F 315 is an interface that connects the external storage 120 to the Internet. The external storage 120 performs processes such as sending, receiving, and storing various types of information in response to requests notified from external devices such as the MFP 110 via the network I / F 315.
[0021] 4 is a diagram showing the functional blocks (software configuration) of the MFP 110. The functional blocks of the MFP 110 can be roughly divided into two parts: a native functional unit 410 and an additional functional unit 420. Each functional unit is realized by the CPU 211 reading a program stored in the ROM 212 or HDD 214 into the RAM 213 and executing it.
[0022] The native function unit 410 includes a scan execution unit 411, an image data storage unit 412, and a print execution unit 413, which are provided as standard in the MFP 110. The additional function unit 420 includes a display control unit 421, a scan instruction unit 422, an image processing unit 423, a data management unit 424, a print instruction unit 425, a data conversion unit 426, and an external storage access unit 427. Each unit included in the additional function unit 420 is an application additionally installed in the MFP 110. The additional function unit 420 is an application based on Java (registered trademark), and therefore, functions can be easily added to the MFP 110. Note that other additional applications (not shown) may be installed in the MFP 110.
[0023] Here, the functions of each functional block of the MFP 110 will be described, mainly taking as examples the generation, image processing, storage, and printing of scanned images.
[0024] The display control unit 421 displays a UI screen for accepting operations by a user on a display device that is one element of the operation unit 220. For example, a UI screen for accepting operations such as scan setting and scan start operations, a preview of a scanned image, specification of a mask area (area to be masked) described later, output setting, and output start operations is displayed on the display device of the operation unit 220.
[0025] The scan instruction unit 422 requests the scan execution unit 411 to execute a scan process according to the scan settings input from the UI screen. When the scan execution unit 411 receives a scan request including the scan settings from the scan instruction unit 422, it drives the scanner unit 222 in accordance with the scan request to optically read an original document and generate a scan image (image data). The generated scan image is transmitted to the image data storage unit 412, and the image data storage unit 412 stores the scan image received from the scan execution unit 411 in the HDD 214. At that time, the scan execution unit 411 transmits an image identifier that uniquely identifies the stored scan image to the scan instruction unit 422. The image identifier is composed of a number, symbol, alphabet, or the like for uniquely identifying the scan image in the MFP 110.
[0026] The image processing unit 423 performs, for example, analysis and processing on the scanned image. Specifically, the image processing unit 423 receives an image identifier from the scan instruction unit 422, and acquires a scanned image corresponding to the image identifier from the image data storage unit 412. The image processing unit 423 performs recognition processing on the acquired scanned image, such as character area analysis, optical character recognition (OCR), barcode area analysis, and image rotation and tilt correction. The image processing unit 423 also generates a mask composite image (data) generated by combining a mask image with the scanned image according to an area designation process corresponding to a mask area input from the UI screen, and instructs the image data storage unit 412 to store the image. The area designation process will be described later with reference to the flowchart of FIG. 9 and the accompanying drawings related thereto. The image processing unit 423 then transmits the image identifier to the print instruction unit 425, the data conversion unit 426, and the external storage access unit 427 according to the output setting set for the mask composite image.
[0027] The data management unit 424 holds information such as coordinates, file name, and storage destination specified in the area designation process in association with the image identifier. The data management unit 424 also stores the coordinates, file name, and storage destination specified in the area designation process in the HDD 214 as preset information.
[0028] The print instruction unit 425 transmits a print processing request corresponding to the print settings input from the UI screen and the image identifier received from the image processing unit 423 to the print execution unit 413. The print execution unit 413 receives the print processing request and the image identifier transmitted from the print instruction unit 425, acquires image data (scanned image or mask composite image) corresponding to the image identifier from the image data storage unit 412, and generates print data according to the print processing request. The print execution unit 413 transmits the generated print data to the printer unit 221 via the printer I / F 216, and the printer unit 221 prints the scanned image or mask composite image on a recording medium.
[0029] The data conversion unit 426 acquires image data (scanned image or mask composite image) corresponding to the image identifier received from the image processing unit 423 from the image data storage unit 412, and converts it into a file format according to the output setting input from the UI screen. The data conversion unit 426 also acquires a file name corresponding to the image identifier received from the image processing unit 423 from the data management unit 424, sets it as the file name of the converted file, and transmits the converted file and its corresponding image identifier to the data management unit 424. The data management unit 424 holds the file received from the data conversion unit 426 in association with the image identifier.
[0030] The external storage access unit 427 transmits a processing request to a cloud service or the like that provides a storage function (storage service). Note that a cloud service generally stores files in cloud storage using protocols such as REST and SOAP, and also publishes various interfaces for acquiring the stored files from an external device. The external storage access unit 427 operates the cloud service using the published interface of the cloud service. In addition, the external storage access unit 427 acquires a file and transmission information corresponding to the image identifier received from the image processing unit 423 from the data management unit 424. Then, the external storage access unit 427 transmits the file acquired from the data management unit 424 to the external storage 120 via the network I / F, using the transmission information acquired from the data management unit 424.
[0031] Next, the process executed by the MFP 110 will be described. Fig. 5 is a flowchart showing the flow of the process in which the MFP 110 combines a mask image with a scanned image, files the image, and transmits the file to the external storage 120 (cloud storage). Each process (step) indicated by an S number in this flowchart is realized by the CPU 211 reading out a control program stored in the ROM 212 or HDD 214 into the RAM 213 and comprehensively controlling the operation of each unit of the MFP 110. Note that, since the CPU 211 acts as each functional unit shown in Fig. 4 in each process of this flowchart, the process will be described assuming that the CPU 211 is the executing entity.
[0032] Before starting S501, CPU 211 displays a main screen (not shown) on the display device of operation unit 220, on which buttons for executing applications provided by MFP 110 are arranged. An additional application (hereinafter referred to as a "masking application") that masks a partial area of a scanned image and transmits the image to a cloud service can be made available by additionally installing the application in MFP 110. When the masking application is installed in MFP 110, a button for instructing CPU 211 of the specifications of the masking application is displayed on the main screen, and CPU 211 starts the processing of S501 when it detects pressing of the button.
[0033] In S501, the CPU 211 starts (reads and executes) the masking application. In S502, the CPU 211 displays a masking method selection screen, which is an initial screen of the masking application, on the display device of the operation unit 220. FIG. 6 is a diagram showing an example of the masking method selection screen. The masking method selection screen 600 in FIG. 6 has a preset selection button 601 and a manual selection button 602. The preset selection button 601 is a button for displaying a list of settings that have been registered as presets on the display device of the operation unit 220. The preset here is a function for saving setting values such as scan settings, mask areas, and file storage information that have been set once in the HDD 214 and reusing them. The manual selection button 602 is a button for setting the initial values of the masking application manually.
[0034] In S503, the CPU 211 determines whether or not the preset selection button 601 has been pressed (selected) on the mask method selection screen 600. If the CPU 211 determines that the preset selection button 601 has been pressed (Yes in S503), it executes the process of S504. On the other hand, if the CPU 211 determines that the preset selection button 601 has not been pressed, that is, that the manual selection button 602 has been pressed (No in S503), it executes the process of S505.
[0035] In S504, the CPU 211 displays a preset list screen on the display device of the operation unit 220. FIG. 7 is a diagram showing an example of the preset list screen. The preset list screen 700 shown in FIG. 7 includes at least one preset button 701 and a back button 702. The preset button 701 is represented by a registered document name or the like. The CPU 211 uses the setting value stored in association with the button ID of the pressed preset button 701 in subsequent processing. The button ID is an ID generated by the data management unit 424 when the preset button 701 is registered, and is composed of numbers, symbols, alphabets, etc. for uniquely identifying a group of registered setting values. The back button 702 is a button for returning from the preset list screen 700 to the masking method selection screen 600.
[0036] In S505, the CPU 211 displays a scan screen. Fig. 8 is a diagram showing an example of the scan screen. The scan screen 800 in Fig. 8 includes an output setting field 801, a file format designation field 802, a scan setting field 803, a scan button 804, a page number display area 805, a back button 806, and a next button 807.
[0037] The output setting field 801 is a button for specifying the output method of the masked scanned image, and it is possible to select either printing or saving, or both. The file format specification field 802 is effective when an output including "saving" (i.e. "print and save" or "save only") is set in the output setting field 801, and is a button for specifying the file format when saving the masked composite image. The scan setting field 803 is a group of buttons for setting the scanning conditions of the document, and accepts changes to the settings of "document size," "color," "double-sided," and "detailed settings." In addition, in the "detailed settings," it is possible to change and set the resolution, image quality, mixed document sizes, density, etc.
[0038] The scan button 804 is a button for executing scanning of the document under the conditions set in the scan setting field 803. The number of scanned document pages is displayed in a page count display area 805. The back button 806 is a button for returning to the previous screen. When the back button 806 is pressed, the display switches to the masking method selection screen 600 in FIG. 6 or the preset list screen 700 in FIG. 7, depending on the route taken up to S505. The next button 807 is a button for transitioning to a UI screen for analyzing the scanned image, and becomes enabled when scanning of the document is completed.
[0039] For example, if the determination in S503 is 'No', the CPU 211 displays the scan screen 800 with the output settings and scan settings held as the initial values of the masking application set in the output setting field 801, file format designation field 802, and scan setting field 803. On the other hand, for example, if "Insurance Card" of the preset buttons 701 is selected, the CPU 211 reads out the settings associated with the button ID of "Insurance Card". Then, the CPU 211 displays the scan screen 800 in which the read out settings are reflected in the output setting field 801, file format designation field 802, and scan setting field 803.
[0040] When the user places a document to be scanned on the document platen or ADF and presses the scan button 804, the CPU 211 starts the process of S506. In S506, the CPU 211 executes a scan to generate a scanned image which is image data that has been digitized from the document, generates an image identifier that uniquely identifies the generated scanned image, and associates the generated scanned image with the image identifier and stores them in the HDD 214. Note that each time generation of a scanned image for one page is completed, the number of scanned pages displayed in the page number display area 805 is incremented.
[0041] When the user presses the next button 807 after the scanning of the document to be scanned is completed, the CPU 211 starts the process of S507. In S507, the CPU 211 executes an analysis process of the scanned image. The analysis process of the scanned image is executed by the CPU 211 functioning as the image processing unit 423. The image processing unit 423 analyzes a character area present in the image, and stores the analysis result, which acquires the coordinates of the character area and the characters in the character area, in the HDD 214 in association with the image identifier. Note that, if an area determined to be a two-dimensional barcode or a three-dimensional barcode is detected in the analysis process of the scanned image, the CPU 211 acquires the coordinates of the barcode and information corresponding to the barcode, includes it in the analysis result, and stores it in the HDD 214 in association with the image identifier.
[0042] In S508, CPU 211 executes area designation processing. Here, the area designation processing will be described in detail. Fig. 9 is a flowchart of the area designation processing. The content of the area designation processing varies depending on whether "preset" is selected on mask method selection screen 600, and whether an output including "save" is selected on output setting field 801 on scan screen 800, so the following description will be made by dividing the cases appropriately.
[0043] In S901, the CPU 211 determines whether or not an output including "save" has been selected in the output setting field 801 of the scan screen 800 (i.e., whether or not "print and save" or "save only" has been selected). If the CPU 211 determines that an output including "save" has been selected (Yes in S901), it executes the process of S902. The following describes the subsequent process in the case where "print and save" has been selected in S901.
[0044] In S902, the CPU 211 determines whether or not "Preset" has been pressed (selected) on the masking method selection screen 600. If the CPU 211 determines that "Manual" has been pressed (No in S902), it executes the process of S904. Next, the processes of S905 to S911 will be explained on the assumption that the process has proceeded from S902 to S904, and the case where the determination in S902 is 'Yes' and the process of S903 is performed will be described later.
[0045] In S904, the CPU 211 displays a preview screen on the display device of the operation unit 220. Fig. 10A is a diagram showing an example of a preview screen displayed with the initial settings of the masking application. The scanned image obtained in S506 is displayed as a preview image 1002 in a preview area 1001 of a preview screen 1000 in Fig. 10A.
[0046] The preview screen 1000 has a delete button 1003 , a reduce button 1004 , a full display button 1005 , a zoom in button 1006 , a previous page button 1007 , a page display area 1008 , a next page button 1009 , a color designation button 1010 , and a transparent display button 1011 .
[0047] The delete button 1003 is a button for deleting a mask region or an OCR region selected on the preview image 1002. The reduce button 1004 is a button for reducing the display magnification of the preview image 1002. The full display button 1005 is a button for changing the preview image 1002 to the maximum magnification that fits within the preview area 1001 and displaying it. The enlarge button 1006 is a button for increasing the display magnification of the preview image 1002 and displaying it in an enlarged manner. Note that when the display magnification is changed to a larger magnification than that by the full display button 1005 by operating the enlarge button 1006, a part of the preview image 1002 is no longer displayed in the preview area 1001. At this time, although not shown, a scroll bar for moving the display area of the preview image 1002 in the preview area 1001 is displayed in the preview area 1001.
[0048] Previous page button 1007 is a button for displaying the scanned image of the previous page as preview image 1002 when there are scanned images of multiple pages. Page display area 1008 displays the page number and total number of pages of the scanned image currently being displayed. Next page button 1009 is a button for displaying the scanned image of the next page as preview image 1002 when there are scanned images of multiple pages.
[0049] A color specification button 1010 is a button for specifying a color (masking color) to be applied to the mask area. A transparent display button 1011 is a button for semi-transparently displaying the mask area on the preview image 1002. By enabling the semi-transparent display, the preview image 1002 is displayed in such a manner that the user can visually recognize character strings and the like under the mask area.
[0050] The preview screen 1000 has first to fifth mode switching buttons 1012 to 1016. The first to fifth mode switching buttons 1012 to 1016 are buttons for adding or selecting various areas within the preview screen 1000, and these are switched exclusively between, making it possible to select only one of them.
[0051] The first mode switching button 1012 is a button for switching to a mode for selecting a mask area already added (set) to the preview image 1002. The second mode switching button 1013 is a button for switching to a mode for adding a new mask area to the preview image 1002. The third mode switching button 1014 is a button for switching to a mode for specifying a character area of a character string used for a file name or a folder name among character strings on the preview image 1002. The fourth mode switching button 1015 is a button for switching to a mode for specifying a barcode area of a barcode used for a file name or a folder name among barcodes on the preview image 1002. The fifth mode switching button 1016 is a button for switching to a mode for inserting an image registered in advance in the MFP 110 as a mask.
[0052] When any of the second to fourth mode switching buttons 1013 to 1015 is selected, the user can add or specify various areas by touching preview area 100 with a finger or the like. For example, when CPU 211 detects a touch operation in preview area 1001, it starts drawing a rectangle with the touch position as the start point. When CPU 211 detects that the user has moved his / her finger while touching the screen (touch panel) of the display device of operation unit 220 and then removed the finger from the screen, it displays a rectangle with that point as the end point. The rectangular area becomes a newly added mask area, a newly specified character volume area, or a barcode area.
[0053] In the mode for adding a mask area, the color set by the color designation button 1010 is reflected in the inserted rectangle, and the coordinates and color of the start point and end point of the rectangle are stored in the HDD 214. In the mode for designating a character area, the CPU 211 acquires and stores a character string and its coordinates included in the coordinates of the inserted rectangle from the analysis result of the scanned image executed in S507. At this time, the selected character string may be displayed so that the user can easily understand it, for example, by surrounding the corresponding character string on the preview image 1002 with a line. In the mode for designating a barcode area, the CPU 211 acquires and stores the coordinates of a barcode included in the coordinates of the inserted rectangle and a value (number, character string, etc.) read from the barcode from the analysis result of the scanned image executed in S507. At this time, the selected barcode may be displayed so that the user can easily understand it, for example, by surrounding the corresponding barcode on the preview image with a line.
[0054] When CPU 211 detects that fifth mode switching button 1016 has been pressed, it displays a screen (not shown) displaying a list of images registered as masks on the display device of operation unit 220. When CPU 211 detects that the user has selected one of the images, it inserts the selected image into preview area 1001. Once the image insertion is complete, first mode switching button 1012 is automatically switched to an enabled state, making it possible to move the image or adjust its size.
[0055] The preview screen 1000 is provided with a destination display area 1017 that displays the external storage 120 and folder path set as the destination for saving scanned images and the like in the MFP 110. The folder name of the destination folder path can be a character string or a barcode value obtained from the scanned image, as will be described in detail later. The destination display area 1017 is provided with an edit button 1018 for displaying an edit screen on the display device of the operation unit 220 for setting or changing the destination external storage and folder path.
[0056] The preview screen 1000 is provided with a file name display area 1019 that displays the file name set for the scanned image (mask composite image). As with the folder name, the character string or barcode value in the scanned image can be used for the file name. The file name display area 1019 is provided with an edit button 1020 for displaying an edit screen on the display device of the operation unit 220 for setting or changing the file name.
[0057] The preview screen 1000 has a back button 1021 for returning to the previous scan screen 800, and a next button 1022 for completing the operation on the preview screen 1000 and proceeding to the next process.
[0058] FIG. 10(b) is an example of a screen showing a state in which a mask region and a character region are specified for the preview image 1002, and shows a state in which mask regions 1023 to 1026 are specified for the preview image 1002 by the user. The mask regions 1023 to 1026 are displayed as rectangles filled with an arbitrary color specified as the mask color. In addition, labels "Mask 1" to "Mask 4" (balloon illustrations and text explanations) are displayed adjacent to each of the mask regions 1023 to 1026 to distinguish each region. In addition, the label "OCR1" indicating that it is a character region is displayed in the character region 1027 overlapping with the mask region of mask 4.
[0059] The mask area 1023 is a mask area selected in a mode in which the first mode switching button 1012 is selected. The mask area 1023 is highlighted, for example, with a thick frame, so that the user can easily recognize the selected state. The color of the frame indicating the selected mask area can be changed using the color designation button 1010. The mask area 1023 also displays square icons on its four sides and four corners to let the user know that the mask area can be re-edited. When the user drags and moves one square icon, the point or line on the diagonal where the square is displayed becomes the starting point, and the mask area can be expanded / reduced in the direction from there. Thus, the user can adjust the shape and size of the mask area by dragging the square icon. When a mask area other than the selected mask area (a mask area not highlighted) is dragged, the mask area moves according to the drag operation while maintaining its current size.
[0060] When the delete button 1003 is pressed when there is a selected masked area, the masking of the selected masked area is released. The display mode of the delete button 1003 may be controlled so that it is enabled only when there is a selected masked area. For example, when the CPU 211 detects the pressing of the delete button 1003 in the state of Fig. 10(b), it erases the mask color and highlighting applied to the masked area 1023, and deletes the coordinate information stored corresponding to the masked area.
[0061] In the mask areas 1023 to 1026, it is possible to visually recognize information such as character strings in each area. This is because the transparent display button 1011 is enabled (selected). When the transparent display button 1011 is deselected, the state changes to one in which the user cannot visually recognize the character strings, etc. in the mask areas 1023 to 1026.
[0062] A text area 1027 in the preview image 1002 includes a character string in a mask area 1026 specified in the mode in which the third mode switching button 1014 is selected. Unlike a mask area, a text area is displayed with a frame that is not filled with a color. At this time, a label such as "OCR1" is displayed separately from "Mask 4" etc. so that the text area and the mask area can be distinguished. The color of the frame showing the text area can be changed using the color specification button 1010.
[0063] Fig. 11A is a diagram showing area information such as coordinates held for each area that has been specified on the preview screen 1000 in Fig. 10B. Area information 1100A in Fig. 11A is made up of an ID 1101, a type 1102, a start point 1103, an end point 1104, and a value 1105.
[0064] The ID 1101 is a value that uniquely indicates each piece of area information. The type 1102 indicates the type of area, and can be mask, character, barcode, image, etc. The start point 1103 is a value that indicates the start point of the area, and is expressed as coordinates (X, Y) that indicate the horizontal and vertical positions with the upper left corner of the preview image 1002 as the origin. The end point 1104 is a value that indicates the end point of the area, and is expressed by the coordinates of the lower right point of the area. Thus, each area is expressed as a rectangle with the coordinates of the start point 1103 as the upper left point and the coordinates of the end point 1104 as the lower right point.
[0065] The value 1105 is information related to each area, and in the case of a mask area, it is the mask color (color code), in the case of a text area, it is the character string obtained by OCR, in the case of a barcode area, it is the character string obtained from the barcode, and in the case of an image inserted from elsewhere, it is the path of the image used. In Fig. 11(a), it can be seen that four mask areas (MSK1-4) and one text area (OCR1) corresponding to the area information of the preview area 1001 in Fig. 10(b) are stored. Note that Fig. 11(b) will be described later.
[0066] Next, a method for setting a file name for a scan composite image will be described. When CPU 211 detects pressing of file name edit button 1020, it transitions preview screen 1000 to a name input screen. Fig. 12(a) is a diagram showing an example of the name input screen. Name input screen 1230 in Fig. 12(a) has a display area 1231 that displays the set file name. Note that name input screen 1230 corresponds to preview screen 1000 in Fig. 10(b).
[0067] The name input screen 1230 displays first to fourth auxiliary input areas 1232 to 1235 used for inputting a file name. The first auxiliary input area 1232 is provided with a group of buttons for inputting fixed text, and allows the user to input any text or a prepared delimiter (such as a hyphen, underscore, or blank) into the file name. For example, when "Text" is selected, a text input keyboard (not shown) is displayed on the display device of the operation unit 220, allowing the user to input any text.
[0068] The second to fourth auxiliary input areas 1233 to 1235 are provided with a group of buttons for inputting variable values into the file name, whose values change depending on the scan date and time and information obtained from the scanned image. The second auxiliary input area 1233 is provided with a button for inputting the scan date and time information into the file name, and date and time information can be easily input into the file name by inputting using each of the "year / month / day / hour / minute / second" buttons.
[0069] The third auxiliary input area 1234 has buttons for inputting text information obtained from the text area specified in the preview area 1001 into the file name. Here, the text in the text area 1027 in FIG. 10(b) is displayed as one button, and a number corresponding to the label of the text area is displayed on the button as identification information. When the button displayed in the third auxiliary input area is pressed, the text inside the button (987654321 in this case) is added to the file name. If there are multiple text areas in the third auxiliary input area 1234, the same number of buttons are displayed as there are text areas, and if there are no text areas, "no area specified" is displayed.
[0070] The fourth auxiliary input area 1235 is provided with a button for inputting character information acquired from the barcode area designated in the preview area 1001 into the file name. In FIG. 12(a), "No area designated" is displayed, indicating that no area is designated, and no button is displayed. This is because the barcode area is the mask area 1025 of "Mask 3" in the preview screen 1000 in FIG. 10(b), but is not a barcode area designated for the purpose of acquiring character information, as shown in FIG. 11(b) described later. When a button is displayed in the fourth auxiliary input area 1235, a button including a number corresponding to the label of the barcode area and a character string acquired from the barcode is displayed, similarly to the third auxiliary input area 1234.
[0071] The name input screen 1230 has a name route display area 1236 that displays which button was used to input from among the first to fourth auxiliary input areas 1232 to 1235. In the name route display area 1236, the text input from the first auxiliary input area 1232 is displayed as is, but the input from the buttons displayed in the second to fourth auxiliary input areas 1233 to 1235 is displayed in the format of [variable name]. Information related to the name of each button is entered in the "variable name". In the example of FIG. 12(a), it can be seen that the "year", "month", and "day" in the second auxiliary input area 1233 and "[1]" in the third auxiliary input area 1234 were used as information other than the fixed values (here, "Scan" and "_").
[0072] The name input screen 1230 is provided with a delete button 1237 for deleting a character string entered in the file name. The delete button 1237 deletes one character at a time from the end of the character string in the file name, but if the object to be deleted is not a fixed value, the character string corresponding to the [variable name] in the name route display area 1236 is deleted all at once in one deletion. For example, in the example of FIG. 12(a), when the delete button 1237 is pressed, the character string "987654321" corresponding to [OCR1] is deleted all at once. At that time, [OCR1] corresponding to the deleted character string is also deleted from the name route display area 1236.
[0073] The name input screen 1230 is provided with a cancel button 1238 and a confirm button 1239. The cancel button 1238 is a button for canceling the editing on the name input screen 1230, closing the name input screen 1230, and redisplaying the preview screen 1000. The confirm button 1239 is a button for confirming the editing on the name input screen 1230, saving the input contents, and then closing the name input screen 1230 and redisplaying the preview screen 1000. The confirmed file name is displayed in the file name display area 1019 of the preview screen 1000. The information in the name route display area 1236 is stored as the setting value of the preset button 701 when the information is registered in the preset button 701. Therefore, when a preset is selected when using a masking application for a scanned image of a different document, the setting value corresponding to the variable value changes depending on the scan date and time of the different document and information acquired from the scanned image. Therefore, by using the preset information, a file name that makes use of the information of the scanned document can be easily set.
[0074] Next, a method for setting a file save destination will be described. When the CPU 211 detects a press of the edit button 1018 on the preview screen 1000, it transitions the preview screen 1000 displayed on the display device of the operation unit 220 to a save destination setting screen. Fig. 12(b) is a diagram showing an example of the save destination setting screen. The save destination setting screen 1240 in Fig. 12(b) has a save destination setting field 1241, a root folder setting area 1242, first to third sorting folder areas 1243 to 1245, a cancel button 1246, and a confirm button 1247.
[0075] In the save destination setting field 1241, an external storage to which the scanned image is to be sent can be set, and in this example, "Cloud A" is set.
[0076] In the root folder setting area 1242, a root folder can be set under the external storage set in the save destination setting field 1241, and the path of the currently set root folder and a reference button for selecting the root folder are displayed. When the CPU 211 detects the pressing of the reference button in the root folder setting area 1242, it starts a connection to the external storage set in the save destination setting field 1241. If authentication is required to access the external storage set in the save destination setting field 1241, a screen (not shown) required for authentication is displayed when the authentication is completed. A list of folders that can be used under the external storage that can be set in the save destination setting field 1241 is displayed, and the user can change the root folder by selecting a desired folder. In the example of FIG. 12(b), it can be seen from the root folder setting area 1242 that the "Application Documents" folder directly under the "Cloud A" service is set as the root folder.
[0077] The first to third sorting folder areas 1243 to 1245 are areas for setting sorting routes for folders. Each of the first to third sorting folder areas 1243 to 1245 displays an area for displaying the set folder name and an edit button.
[0078] In "sortment folder 1" of the first sorting folder area 1243, the name of the folder immediately below the root folder set in the root folder setting area 1242 is set. In "sortment folder 2" of the second sorting folder area 1244, the name of the folder immediately below "sortment folder 1" is set. In "sortment folder 3" of the third sorting folder area 1245, the name of the folder immediately below "sortment folder 2" is set. Therefore, starting from the root folder in the root folder setting area 1242, a three-level folder sorting route can be set in the first to third sorting folder areas 1243 to 1245.
[0079] The setting of each folder in the first to third sorting folder areas 1243 to 1245 can be done by the edit button provided in each area. When the CPU 211 detects the pressing of any of the edit buttons in the first to third sorting folder areas 1243 to 1245, it displays a name input screen equivalent to the name input screen 1230 in FIG. 12(b) on the display device of the operation unit 220. Note that the description of the name input screen displayed here is similar to the description of the name input screen 1230, so it will be omitted. The folder names of the folders in the first to third sorting folder areas 1243 to 1245 can be easily set by combining the variable values input from the second to fourth auxiliary input areas 1233 to 1235, making use of the information of the scanned document. In the example of FIG. 12(b), a state in which [Year] is set in "sorting folder 1" is shown.
[0080] The cancel button 1246 is a button for canceling (discarding) the contents on the save destination setting screen 1240, closing the save destination setting screen 1240, and redisplaying the preview screen 1000 on the display device of the operation unit 220. The enter button 1247 is a button for finalizing and saving the contents on the save destination setting screen 1240, and then closing the save destination setting screen 1240 and redisplaying the preview screen 1000. When the CPU 211 detects pressing of the enter button 1247, it saves the settings on the save destination setting screen 1240 and displays the set information in the save destination display area 1017. At this time, the CPU 211 displays the storage name, root folder path, and sorting folder name in a concatenated manner so that the save destination path is easily recognizable to the user.
[0081] Returning to the explanation of the flowchart in Fig. 9, when the setting of the preview screen 1000 in S904 is completed and the Next button 1022 is pressed, the CPU 211 checks the positional relationship between the character area and the barcode area and the mask area in S905. Specifically, the CPU 211 determines whether or not there is an area where the character area and the barcode area overlaps with the mask area (hereinafter referred to as an "overlapping area"). For example, in the case of the area information in Fig. 11(a), since "OCR1" is a character area, it is checked whether or not there is an overlapping area between the "OCR1" area and the other mask area, "MSK1-4".
[0082] The presence or absence of an overlapping area can be determined by comparing the coordinates of the start and end points. Specifically, when the start coordinates of one of the two areas are (Xa1, Ya1) and the end coordinates are (Xa2, Ya2), and the start coordinates of the other are (Xb1, Yb1) and the end coordinates are (Xb2, Yb2), the following formulas 1 to 4 are compared. As a result, when one or more of the X coordinate values and one or more of the Y coordinate values are satisfied in the following formulas 1 to 4, it is determined that there is an overlapping area. In other words, when there is an overlapping area, it means that the entire character area is included in the mask area, when a part of the character area overlaps with the mask area, when the entire barcode area is included in the mask area, or when a part of the barcode area overlaps with the mask area. The reverse comparison is also performed using the following formulas 5 to 8. When one or more of the X coordinate values and one or more of the Y coordinate values are satisfied in the following formulas 5 to 8, it is determined that there is an overlapping area.
[0083]
number
[0084] In the example of Fig. 11(a) (Fig. 13(a)), the coordinates of the start and end points of "OCR1" are within the range of the coordinates of "MSK4", so it can be seen that MSK4 overlaps to cover the entire OCR1. Note that the above method of determining whether or not there is an overlapping area is only one example, and is not limited thereto, and other methods may be used to determine whether or not there is an overlapping area.
[0085] In S906, the CPU 211 determines whether or not one or more overlapping areas have been found based on the confirmation result of S905. If the CPU 211 determines that an overlapping area has been found (Yes in S906), it executes the process of S907, and if it determines that no overlapping area has been found (No in S906), it executes the process of S909. In the example of Fig. 11(a), since OCR1 and MSK4 overlap, the determination result in S906 is 'Yes' and the process of S907 is executed.
[0086] In S907, the CPU 211 displays a process selection screen on the display device of the operation unit 220. Fig. 13(a) is a diagram showing an example of a process selection screen corresponding to the area information of Fig. 11(a). Process selection screen 1300A of Fig. 13(a) has a preview area 1301 showing character areas and barcode areas having overlapping areas. To make it easier for the user to recognize the overlapping areas, labels are displayed only in the character areas and barcode areas having overlapping areas and in the mask area. At this time, it is desirable to make it easier for the user to notice the overlapping areas by displaying the mask area in which the labels are displayed in a transparent color, for example.
[0087] The process selection screen 1300A has an area number display area 1302 that shows the number of overlapping areas found, and a display area for first to third options 1303 to 1305 for selecting the process to be performed on the overlapping areas. The first option 1303 is an option that indicates that there is no problem with the current state of the overlapping areas, and that the masked areas and character areas are maintained without performing any process. The second option 1304 is an option that instructs a process to cancel the designation of the masked areas of the overlapping areas. Note that the file name does not change when the first option 1303 is selected and when the second option 1304 is selected.
[0088] The third option 1305 is an option for instructing a process to cancel the use of the character area (or barcode area) under the mask area. When the process of the third option 1305 is executed, the use of character information in the folder name or file name is canceled, so the file name or folder name after the execution of the third option 1305 is also displayed in the display area of the third option 1305. This allows the user to determine whether or not to execute the process by the third option 1305. Note that in the case of the process selection screen 1300A, when the process of the third option 1305 is executed, the designation of the entire area of "OCR1" is canceled.
[0089] In this embodiment, the first to third options 1303 to 1305 are used to select the process to be performed on the overlapping area, but the contents of the options displayed may be changed depending on the settings of the masking application. For example, if it is desired to prohibit the use of the character string under the mask area in the file name, a separate setting may be made to make the first option 1303 invisible.
[0090] The process selection screen 1300A is provided with a cancel button 1306 and a confirm button 1307. The cancel button 1306 is a button for canceling (discarding) the contents displayed on the process selection screen 1300A, closing the process selection screen 1300A, and redisplaying the preview screen 1000 of Fig. 10(b). The confirm button 1307 is a button for executing the process selected from the first to third options 1303 to 1305.
[0091] Note that the process selection screen 1300A shows an example in which one overlapping area has been found. If multiple overlapping areas have been found, for example, if two overlapping areas have been found and the first of them is displayed in the preview area 1301, the area number display area 1302 displays "Process Selection (1 / 2)". Then, by changing the Confirm button 1307 to buttons such as "Next" and "Previous", it becomes possible to select processes for the overlapping areas in order. At that time, on the screen for selecting the process for the last overlapping area, the Confirm button is displayed or the Next button cannot be selected. This makes it possible to know that the selected process has been performed for all overlapping areas.
[0092] When the CPU 211 detects that any one of the processes from the first to third options 1303 to 1305 has been selected and the Confirm button 1307 has been pressed, the CPU 211 executes the process of S908. In S908, the CPU 211 executes the selected process and updates the area information, the save destination, and the file name information.
[0093] In S909, the CPU 211 stores information such as coordinates and values of the character area, barcode area, and mask area in the HDD 214 as a final result. In addition to the case where the entire character area is included in the mask area as shown in the process selection screen 1300A in Fig. 13(a), an example in which the character area and the mask area partially overlap will also be described. Fig. 13(b) is a diagram showing another example of the process selection screen. Fig. 11(b) is a diagram showing the process selection screen in Fig. 13(b) and corresponding area information.
[0094] The region information 1100B in FIG. 11(b) indicates that the "OCR1" region and the "MSK4" region partially overlap, as shown in the preview area 1301 of the processing selection screen 1300B in FIG. 13(b). In this case, the process of canceling the use of character information under the mask region of the third option 1305 is executed only for the overlapping region. Therefore, even if the third option 1305 is executed, the information use of "321", which does not overlap with the mask region of "MSK4" in the character string "987654321" of the character region of "OCR1", is not canceled. Specifically, the X coordinate of the start point of "OCR1" becomes the X coordinate value of the end point of "MSK4". 11B, when the process of the third option 1305 is executed, the X coordinate of the starting point of the "OCR1" area information changes from "330" to "471", and the value also changes from "987654321" to "321". In addition, as displayed together with the third option 1305, the character information "321" remains in the file name.
[0095] The process selection screen 1300B provides an option 1308 for expanding the mask area of the partial overlap area to the entire overlap area, that is, for expanding the mask area to the entire text area (and barcode area). The option 1308 is displayed only when the partial overlap area is the processing target, and therefore is displayed on the process selection screen 1300B in Fig. 13(b) but not on the process selection screen 1300A in Fig. 13(a).
[0096] Although not shown, when an option is selected on the processing selection screen 1300B in FIG. 13(b) (when the checkbox for option selection 1308 is checked), the area of "Mask 4" is expanded to the entire area of "OCR1". In this case, in FIG. 11(b), the X coordinate of the end point of "MSK4" becomes the same as the X coordinate of the end point of "OCR1". Specifically, the X coordinate of the end point of MSK4 changes from "471" to "509", and accordingly, when the third selection 1305 is executed, the file name display changes to one where "321" has been deleted.
[0097] The above-mentioned processes of S905 to S909 provide the following effects. That is, by displaying process selection screens 1300A and 1300B when there is an overlapping area, the user can be made aware of an error in setting the mask area or an error in setting the use of information under the mask area. Also, the user can select and execute an appropriate process while looking at preview area 1301 on process selection screens 1300A and 1300B. Note that if it is determined in S906 that there is no overlapping area (No in S906), the processes of S907 and S908 are not executed, and the current area information is saved in HDD 214 as the final result in S909.
[0098] When the area information is finalized in S909, the CPU 211 generates a folder path from the set information in S910. The CPU 211 generates a file name in S911. In S912, the CPU 211 composites (overpaints) the mask area designated for the scanned image with an image of a designated color, stores the composite image in the HDD 214, and then ends this process, thereby ending the process of S508. The processes of S913 to S916 will be described later.
[0099] Returning to the explanation of the flowchart in Fig. 5. When the area designation process in S508 is completed, in S509 the CPU 211 displays an execution confirmation screen on the display device of the operation unit 220. Fig. 14 is a diagram showing an example of the execution confirmation screen. The execution confirmation screen 1400 in Fig. 14 has a print setting display area 1401, a confirmation display area 1402, option options 1403, a back button 1404, and an execute button 1405.
[0100] The print setting display area 1401 is displayed when an item including "Print" is selected in the output setting column 801. In the print setting display area 1401, the number of copies to be printed can be set, and by pressing the "Other print settings" button, settings such as double-sided printing, paper size, imposition, etc. can be changed.
[0101] The confirmation display area 1402 is displayed when an item including "Save" is selected in the output setting column 801. The setting values of the save destination and file name set on the preview screen 1000 are displayed in the confirmation display area 1402. The option selection options 1403 have check boxes, and by checking the check boxes, the current various areas and various setting information can be registered as presets. The back button 1404 is a button for returning to the preview screen 1000. The execute button 1405 is a button for executing printing, saving, and preset registration.
[0102] When execute button 1405 is pressed, in S510 CPU 211 determines whether or not to perform preset registration. In the determination in S510, it is determined that preset registration is to be performed if the check box of option choice 1403 is checked. If it is determined that preset registration is to be performed (Yes in S510), CPU 211 executes the process of S511, and if it is determined that preset registration is not to be performed (No in S510), it executes the process of S513.
[0103] In S511, the CPU 211 displays a preset name setting screen (not shown) on the display device of the operation unit 220 and accepts input of a preset name from the user. At this time, the user can register the contents to be preset registered with an arbitrary preset name. When the preset name is input, in S512, the CPU 211 associates various setting contents such as the current various areas, setting information, and preset name with the button ID of the preset button 701 and saves them in the HDD 214.
[0104] Fig. 15 is a diagram showing an example of preset information saved in the HDD 214 in S511. Preset information 1500 in Fig. 15 has a button ID 1501 of the preset button 701, a preset name 1502 input by the user in S511, and an output method 1503 and scan settings 1504 set on the scan screen 800.
[0105] The preset information 1500 has area information 1505 and save settings 1506 set on the preview screen 1000, and print settings 1507. The area information 1505 stores coordinate information of a mask area, a character area, etc. However, since character information acquired from a character area, etc. varies depending on the manuscript, no information is registered in the "value" of the area information 1505. The save settings 1506 store a name route and a folder path route, but since character information acquired from a character area, etc. varies depending on the manuscript, no specific value (character string) is registered. The print settings 1507 register the contents of the print settings on the execution confirmation screen 1400. In this way, by registering various areas and various settings that have been set once as presets, the processing of a manuscript of the same format in the masking app from the next time onwards can be easily performed by using the presets.
[0106] In S513, CPU 211 determines whether or not a setting to perform printing has been made. If CPU 211 determines that a setting to perform printing has been made (Yes in S513), it executes processing of S514, and if CPU 211 determines that a setting not to perform printing has been made (No in S513), it executes processing of S515. In S514, CPU 211 executes printing processing of the mask composite image.
[0107] In S515, CPU 211 determines whether or not a setting for saving has been made. If CPU 211 determines that a setting for saving has been made (Yes in S515), it executes the process of S516, and if CPU 211 determines that a setting for saving has not been made (No in S515), it ends this process.
[0108] In S516, the CPU 211 executes a process of saving the mask composite image, and then ends this process. At this time, the mask composite image is converted into a file format specified on the scan screen 800. The mask composite image is also sent to a destination (e.g., external storage 120) specified on the preview screen 1000 with a specified file name, and saving at the destination is completed. When the masking application process is thus completed, the CPU 211 executes a screen switching process on the display device of the operation unit 220. The new screen at that time may be the masking method selection screen 600 for the next scan, or may be the main screen (not shown).
[0109] Next, a case will be described where it is determined in S902 of the area designation process in S508 that "preset" has been pressed on the masking method selection screen 600. If it is determined in S902 that "preset" has been pressed (Yes in S902), the CPU 211 executes the process of S903. Below, the process of S903 to S912 will be described, focusing on the difference from the case where it is determined that "manual" has been pressed on the masking method selection screen 600.
[0110] In S903, the CPU 211 acquires area information and setting information of the button ID selected on the preset list screen 700. In S904, the CPU 211 displays the preview screen in a state where the settings acquired in S903 are reflected. For example, when the preset information shown in FIG. 15 is used, the preview screen is displayed in a state where the various selection areas and setting information are reflected as shown in FIG. 10(b). Therefore, unlike when "Manual" is selected in S902, it is possible to save the effort of area designation and save settings.
[0111] 10B, for example, the CPU 211 executes the process from S905 onwards. The processes from S905 to S912 in this case are similar to the processes when "Manual" is selected in S902 described above, and therefore the description thereof will be omitted.
[0112] 9 is completed, that is, when the area designation process of S508 is completed, the CPU 211 displays the execution confirmation screen 1400 on the display device of the operation unit 220 in a state where the print settings related to the button ID are reflected in S509. At this time, the option choice 1403 for whether or not to register the setting contents of the execution confirmation screen 1400 as a preset may be hidden if there is no change in the area designation process of S508. When the CPU 211 detects that the execution button 1405 is pressed on the execution confirmation screen 1400, it determines whether or not to register a preset in S510. If there is no change in the contents to be preset, the determination result of S510 is "No", and thereafter, the printing and saving processes (S513 to S516) are executed in the same manner as described above.
[0113] Next, a description will be given of a case where it is determined in S901 of the area designation process in S508 that "Print only" has been selected in the output setting field 801 of the scan screen 800. If it is determined in S901 that an item including "Save" has not been pressed, that is, "Print only" has been pressed (No in S901), the CPU 211 executes the process of S913.
[0114] In S913, the CPU 211 determines whether or not "Preset" has been pressed (selected) on the mask method selection screen 600. If the CPU 211 determines that "Preset" has been pressed (Yes in S913), it executes the process of S914, and if the CPU 211 determines that "Manual" has been pressed (No in S913), it executes the process of S915.
[0115] In S914, the CPU 211 acquires area information and the like related to the button ID selected on the preset list screen 700, similarly to S903.
[0116] In S915, CPU 211 displays preview screen 1000. At this time, although not shown, third mode switching button 1014, fourth mode switching button 1015, save destination display area 1017, edit button 1018, file name display area 1019, and edit button 1020, which are items used for saving, are hidden (not shown). Therefore, unlike when an item including "save" is selected, the process of determining whether or not there is an overlapping area (S906 to S908) is not performed.
[0117] When the Next button 1022 on the preview screen 1000 is pressed, in S916 the CPU 211 stores information about the mask area, similar to S909. Thereafter, in S912 the CPU 211 composites the mask area designated for the scan image with an image of the designated color, and saves the composite image in the HDD 214. When the area designation process of S508 is thus completed, in S509 the CPU 211 displays an execution confirmation screen 1400 on the display device of the operation unit 220. At this time, although not shown, a confirmation display area 1402 related to the save process is not displayed because it is unnecessary. When the CPU 211 detects pressing of the Execute button 1405 on the execution confirmation screen 1400, it executes the processes of S510 to S515.
[0118] The above describes an embodiment of the present invention. When using character information obtained from a scanned image that requires masking to save data suitable for the scanned image, care must be taken to ensure that the character information in the masked area in the scanned image is not used in the file name or folder name. In contrast, in this embodiment, the masked area and the character and barcode areas used in the file name or folder name are simultaneously displayed on the preview screen of the scanned image. This makes it possible to reduce the risk of erroneously using information under the masked area in the scanned image.
[0119] Furthermore, according to this embodiment, even if the user does not realize that the mask area overlaps with the character area or barcode area (there is an overlapping area), the processing selection screen is displayed to make the user aware of the existence of the overlapping area. As a result, when the scanned image is masked and saved as a file, only information that can be shared with others can be used in the file name and saved.
[0120] The disclosure of this embodiment includes the following configurations and methods. (Configuration 1) An image processing device comprising a control means for displaying a preview of a scanned image on a display device, a first designation means for designating a first area to be masked on the scanned image, and a second designation means for designating a second area including text information to be used for saving the scanned image, wherein the control means displays the preview when there is an overlapping area where the first area and the second area overlap so that a user can recognize the overlapping area. (Configuration 2) The image processing device described in Configuration 1, characterized in that when the overlapping area is displayed on the display device, the control means displays options on the display device together with the overlapping area, allowing the user to select the processing to be performed on the overlapping area. (Configuration 3) The image processing device according to configuration 2, wherein the options include at least one of a first process of maintaining the first area and the second area, a second process of canceling the designation of the first area, and a third process of canceling the use of character information in the overlapping area. (Configuration 4) The image processing device described in Configuration 3, characterized in that when the third process is selected, the control means displays text information to be used for saving the scanned image alongside the options for the third process. (Configuration 5) The image processing device described in configuration 3 or 4, characterized in that when the overlapping area is an overlap of a part of the second area and the entire first area, the control means includes in the options a fourth process of expanding the first area to the entire second area. (Configuration 6) The image processing device according to any one of configurations 1 to 5, wherein the control means displays the first area so that a user can visually recognize text information in the overlapping area. (Configuration 7) The image processing device described in any one of configurations 1 to 6, characterized in that the control means displays labels for distinguishing the first area and the second area in the preview adjacent to each of the first area and the second area. (Configuration 8) The image processing device according to any one of configurations 1 to 7, characterized in that the control means displays the first area and the second area in the preview by changing at least one of the masking color, the frame indicating the area specified by the first specification means or the second specification means, and the color of the frame. (Configuration 9) The image processing device according to any one of configurations 1 to 8, wherein the character information is used as a folder name or file name for the scanned image. (Configuration 10) An image processing device described in any one of configurations 1 to 9, characterized in that the first designation means and the second designation means are provided on a screen of the display device, and the control means makes the second designation means invisible on the screen when the scanned image is not saved. (Configuration 11) A program for causing a computer to function as each of the means of the image processing device according to any one of configurations 1 to 10. (Method 1) A control method for an image processing device comprising the steps of: displaying a preview of a scanned image on a display device; specifying a first area to be masked on the scanned image; specifying a second area containing text information to be used for saving the scanned image; and, if there is an overlapping area where the first area and the second area overlap, displaying the preview so that a user can recognize the overlapping area.
[0121] Although the present invention has been described in detail above based on the preferred embodiments, the present invention is not limited to these specific embodiments, and various forms within the scope of the gist of the present invention are also included in the present invention. Furthermore, each of the above-mentioned embodiments merely shows one embodiment of the present invention, and each embodiment can be appropriately combined.
[0122] For example, the image processing system in Fig. 1 is configured to include an MFP 110 and an external storage 120, but the image processing system according to the present invention is not limited to this configuration. For example, some of the functions and processing of the MFP may be performed by another server located on the Internet or a LAN. Also, the external storage may be located on the LAN rather than on the Internet. Furthermore, the external storage may be replaced with a mail server or the like, and a scanned image may be attached to an email and sent. The MFP may also be configured to have a storage function of the external storage.
[0123] The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions. [Explanation of symbols]
[0124] 110 MFP 120 External Storage 210 Control section 211 CPU 220 Operation section 222 Scanner section 411 Scan execution unit 421 Display control unit 422 Scan instruction section 423 Image Processing Unit 424 Data Management Department 600 Mask method selection screen 700 Preset list screen 800 Scan Screen 1000 Preview Screens
Claims
1. a display control means for displaying the scanned image on a display means; a mask area setting means for setting a mask area for filling in a partial area of the scanned image; a character recognition area setting means for setting a character recognition area for acquiring character information in the scanned image by character recognition processing; a setting means for setting the character recognition area set by the character recognition area setting means to be filled in, the setting means sets an area to be filled using information on the position of the character recognition area set by the character recognition area setting means; An information processing apparatus characterized in that the area to be filled, which is set using information on the position of the character recognition area, and the mask area set by the mask area setting means are displayed on the display means in different colors.
2. A display control means for displaying the scanned image on a display means; a mask area setting means for setting a mask area for filling in a partial area of the scanned image; a character recognition area setting means for setting a character recognition area for acquiring character information in the scanned image by character recognition processing; a setting means for setting the character recognition area set by the character recognition area setting means to be filled in, the setting means sets an area to be filled using information on the position of the character recognition area set by the character recognition area setting means; An information processing device characterized in that the area to be filled is displayed on the display means in different colors when it is set using information on the position of the character recognition area and when it is set by the mask area setting means.
3. A display control means for displaying the scanned image on a display means; a mask area setting means for setting a mask area for filling in a partial area of the scanned image; a character recognition area setting means for setting a character recognition area for acquiring character information to be used in a file name to be used in a file generated based on the scanned image from the scanned image by character recognition processing; a setting means for setting the character recognition area set by the character recognition area setting means to be filled in, the setting means sets an area to be filled using information on the position of the character recognition area set by the character recognition area setting means; An information processing apparatus characterized in that the area to be filled, which is set using information on the position of the character recognition area, and the mask area set by the mask area setting means are displayed on the display means in different colors.
4. An information processing device as described in Claim 1, characterized in that the character information is character information to be used in a file name used for a file generated based on the scanned image.
5. An information processing device as described in Claim 2, characterized in that the character information is character information to be used in a file name used for a file generated based on the scanned image.
6. The information processing device character recognition area storage means for storing information on the position of the character recognition area set by the character recognition area setting means; The information processing device according to any one of claims 1 to 5, further comprising a storage means for, after the character recognition area position information is saved by the character recognition area saving means, saving a file generated based on another scanned image different from the scanned image by assigning a file name including character information obtained from the character recognition area indicated by the saved position information of the other scanned image.
7. An information processing device as described in any one of claims 1 to 5, characterized in that the setting means sets the character recognition area set by the character recognition area setting means to be filled in based on a user's selection operation on an option for selecting whether or not to fill in the character recognition area.
8. The display control means displaying the mask area set by the mask area setting means on the display means so that the image within the mask area in the scanned image cannot be visually recognized by the user; An information processing device according to any one of claims 1 to 5, characterized in that the area to be filled, which is set using information on the position of the character recognition area, is displayed on the display means so that the user can visually recognize the image within the area to be filled in the scanned image.
9. The information processing device described in Claim 8, characterized in that the display control means displays the area to be filled, which is set using information about the position of the character recognition area, on the display means so that the user can see the character information of the image within the area to be filled in the scanned image.
10. An information processing device as described in any one of claims 1 to 5, characterized in that the position of the character recognition area set to be filled can be changed by the user by performing a drag-and-drop operation on the character recognition area.
11. An information processing device as described in any one of claims 1 to 5, characterized in that the frame of the area to be filled, which is set using information on the position of the character recognition area, and the frame of the mask area are displayed on the display means in different colors.
12. The information processing device described in any one of claims 1 to 5, characterized in that it further has a masking processing means for performing a masking process to fill in a set area to be filled using information on the position of the mask area and the character recognition area set in the scanned image.
13. The information processing device described in Claim 12, characterized in that the masking processing means fills in the image in the scanned image that is included in the area to be filled, which is set using information on the positions of the mask area and the character recognition area, so that it becomes invisible.
14. The information processing device according to Claim 13, further comprising a storage control means for storing in a storage means a file generated based on a scanned image that has been masked by the masking processing means.
15. The information processing device described in Claim 14, characterized in that the saving control means saves the file by assigning a file name including information about the characters obtained from the character recognition area.
16. The information processing device according to claim 13, further comprising a printing means for printing the scanned image on which the masking process has been performed.
17. The information processing device according to claim 12, wherein the masking processing means is capable of filling in a color specified by the user.
18. An information processing device as described in any one of claims 1 to 5, characterized in that the area to be filled in, set using information on the position of the character recognition area, and the mask area set by the mask area setting means are shown in different colors on the scanned image displayed by the display control means.
19. An information processing device as described in Claim 18, characterized in that the area to be filled in, set using information on the position of the character recognition area shown in different colors on the scanned image displayed by the display control means, and the mask area set by the mask area setting means, are shown in the same color in at least one of a file generated based on the scanned image or a document printed based on the scanned image.
20. A display control means for displaying the scanned image on a display means; a mask area setting means for setting a mask area to be filled on the scanned image; a character recognition area setting means for setting a character recognition area on the scanned image for acquiring character information by character recognition processing; and a change means for changing the color of the mask area on the scanned image displayed on the display means.
21. A computer comprising: a display control procedure for displaying the scanned image on a display means; a mask area setting step of setting a mask area for filling in a part of the scanned image; a character recognition area setting step for setting a character recognition area for acquiring character information in the scanned image by character recognition processing; a setting procedure for setting to fill in the character recognition area set in the character recognition area setting procedure, In the setting step, an area to be filled is set using information on the position of the character recognition area set in the character recognition area setting step; The program is characterized in that the area to be filled, which is set using the information on the position of the character recognition area, and the mask area set in the mask area setting procedure are displayed on the display means in different colors.
22. A computer comprising: a display control procedure for displaying the scanned image on a display means; a mask area setting step of setting a mask area for filling in a part of the scanned image; a character recognition area setting step for setting a character recognition area for acquiring character information in the scanned image by character recognition processing; a setting procedure for setting to fill in the character recognition area set in the character recognition area setting procedure, In the setting step, an area to be filled is set using information on the position of the character recognition area set in the character recognition area setting step; The program is characterized in that the area to be filled is displayed on the display means in different colors depending on whether it is set using information on the position of the character recognition area or set by the mask area setting procedure.
23. A computer comprising: a display control procedure for displaying the scanned image on a display means; a mask area setting step of setting a mask area for filling in a part of the scanned image; a character recognition area setting step for setting a character recognition area for acquiring character information to be used in a file name to be used in a file generated based on the scanned image by character recognition processing from the scanned image; a setting procedure for setting to fill in the character recognition area set in the character recognition area setting procedure, In the setting step, an area to be filled is set using information on the position of the character recognition area set in the character recognition area setting step; The program is characterized in that the area to be filled, which is set using the information on the position of the character recognition area, and the mask area set in the mask area setting procedure are displayed on the display means in different colors.
24. The program described in Claim 21, characterized in that the character information is character information to be used in a file name used for a file generated based on the scanned image.
25. The program described in Claim 22, characterized in that the character information is character information to be used in a file name used for a file generated based on the scanned image.
26. A character recognition area saving step for saving information about the position of the character recognition area set in the character recognition area setting step; The program according to any one of claims 21 to 25, further comprising a saving procedure for, after the information on the position of the character recognition area is saved by the character recognition area saving procedure, saving a file generated based on another scanned image different from the scanned image by assigning a file name including information on characters obtained from the character recognition area indicated by the saved position information of the other scanned image.
27. A program described in any one of claims 21 to 25, characterized in that in the setting procedure, the character recognition area set in the character recognition area setting procedure is set to be filled in based on a user's selection operation on an option for selecting whether or not to fill in the character recognition area.
28. In the display control procedure, displaying the mask area set in the mask area setting procedure on the display means so that the image within the mask area in the scanned image cannot be visually recognized by the user; A program according to any one of claims 21 to 25, characterized in that the area to be filled, which is set using information on the position of the character recognition area, is displayed on the display means so that the user can visually recognize the image within the area to be filled in the scanned image.
29. The program described in Claim 28, characterized in that in the display control procedure, the area to be filled, which is set using information on the position of the character recognition area, is displayed on the display means so that the user can see the character information of the image within the area to be filled in the scanned image.
30. A program described in any one of claims 21 to 25, characterized in that the position of the character recognition area set to be filled can be changed by the user by performing a drag-and-drop operation on the character recognition area.
31. A program described in any one of claims 21 to 25, characterized in that the frame of the area to be filled, which is set using information on the position of the character recognition area, and the frame of the mask area are displayed on the display means in different colors.
32. A program described in any one of claims 21 to 25, characterized in that it further comprises a masking processing procedure that performs a masking process to fill in a set area to be filled using information on the position of the mask area and the character recognition area set in the scanned image.
33. The program described in Claim 32, characterized in that in the masking processing procedure, images in the scanned image that were included in an area to be filled in, which was set using information on the positions of the mask area and the character recognition area, are filled in so as to become invisible.
34. The program described in Claim 33, further comprising a storage control procedure for storing in a storage means a file generated based on a scanned image that has been masked in the masking processing procedure.
35. The program described in Claim 34, characterized in that in the save control procedure, the file is saved by being given a file name containing information about the character obtained from the character recognition area.
36. The program described in Claim 33, further comprising a printing procedure for printing the scanned image on which the masking process has been performed.
37. The program according to claim 32, characterized in that the masking process procedure is capable of filling in a color specified by the user.
38. A program described in any one of claims 21 to 25, characterized in that the area to be filled in set using information on the position of the character recognition area and the mask area set in the mask area setting procedure are shown in different colors on the scanned image displayed in the display control procedure.
39. The program described in Claim 38, characterized in that the fill area set using information on the position of the character recognition area shown in different colors on the scanned image displayed in the display control procedure and the mask area set in the mask area setting procedure are shown in the same color in at least one of a file generated based on the scanned image or a document printed based on the scanned image.
40. A computer comprising: a display control procedure for displaying the scanned image on a display means; a mask area setting step of setting a mask area to be filled on the scanned image; a character recognition area setting step for setting a character recognition area on the scanned image for acquiring character information by character recognition processing; a change procedure for changing the color of the mask area on the scanned image displayed on the display means;