Image processing device, image processing method, and program

Abstract

Improved usability. [Solution] The image processing device includes an operation object for receiving a request to perform a process to edit a set of items to be edited at once, a display control means for controlling the display of a preview screen including a preview image, and an execution means that, when an operation is received on the operation object, performs a process to edit a set of items to be edited at once, from among a plurality of source images corresponding to the source of the preview image, the source image which includes the set items to be edited. When the processing by the execution means is performed, the display control means changes the display of the preview image corresponding to the target image to reflect the processing result by the execution means.

Description

Technical Field

[0001] The present disclosure relates to an image processing apparatus, an image processing method, and a program.

Background Art

[0002] Some image processing apparatuses have a function of performing rotation of pages of a document obtained by scanning and deletion of pages on a preview screen. In this case, a user can rotate a selected page by selecting the page on the preview screen and pressing a rotation button. Further, the user can select a plurality of pages and collectively rotate the selected plurality of pages. It is also possible to delete pages by a similar method.

[0003] Patent Document 1 discloses an image processing apparatus that displays a preview screen. On this preview screen, a page selected by the user from among a plurality of pages obtained by scanning is displayed as an editing target, and further, substitute images corresponding to pages before and after the selected page are displayed.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problem to be Solved by the Invention

[0005] For a user who frequently performs similar operations on the preview screen, performing searches, selections, and the like for the corresponding page each time is cumbersome. Therefore, there is a demand for improved usability.

Means for Solving the Problem

[0006] An image processing apparatus according to one aspect of the present disclosure comprises an operation object for receiving the execution of a process for editing a target to be edited in a batch, a display control means for controlling the display of a preview screen including a preview image, and an execution means that, when an operation is received on the operation object, executes a process for editing a target image, which is a source image containing the target to be edited, from among a plurality of source images corresponding to the source of the preview image, and the display control means is characterized in that, when the process by the execution means is executed, the display of the preview image corresponding to the target image changes to a state that reflects the processing result by the execution means. [Effects of the Invention]

[0007] According to one aspect of this disclosure, usability can be improved. [Brief explanation of the drawing]

[0008] [Figure 1] This is a block diagram showing the hardware configuration of an image processing device. [Figure 2] This figure shows an example of the software configuration, which is a function of an image processing device. [Figure 3] This flowchart shows an example of a pre-configuration process. [Figure 4] This figure shows an example of a pre-configuration screen. [Figure 5] This diagram explains how to specify what should be blacked out. [Figure 6] This flowchart shows an example of batch editing processing in the first embodiment. [Figure 7] This figure shows an example of a preview screen. [Figure 8] This flowchart shows an example of batch editing processing in the second embodiment. [Figure 9] This figure shows an example of a pop-up screen. [Figure 10] This flowchart shows an example of batch editing processing in the third embodiment. [Figure 11]This figure shows an example of a confirmation screen. [Figure 12] This diagram shows an example of another preview screen. [Modes for carrying out the invention]

[0009] Preferred embodiments of this disclosure will be described in more specific and detail below with reference to the attached drawings. Note that the following embodiments do not limit the invention as defined in the claims. While the embodiments describe multiple features, not all of these features are essential to the invention, and the features may be combined in any way. Furthermore, in the attached drawings, identical or similar configurations are given the same reference numerals, and redundant descriptions are omitted.

[0010] [First Embodiment] This embodiment describes an example of performing preview editing in a short number of steps by pre-configuring settings for one-button preview editing of scanned documents and executing the pre-configured editing process with a single button.

[0011] <Hardware configuration of the image processing device> Figure 1 is a block diagram showing the hardware configuration of the image processing device 10. The image processing device 10 comprises a controller unit 11, a scanner 12, a printer 13, and a sensor group 14. The controller unit 11 controls the image processing device 10. The scanner 12 is both a reading device and an image input device. The scanner 12 reads a document as an image and inputs the scanned image data to the controller unit 11. The printer 13 is both a printing device and an image output device. The printer 13 prints data such as images onto a recording medium such as paper. The sensor group 14 includes various sensors.

[0012] In the present embodiment, the scanner 12 and the printer 13 are provided in the image processing apparatus 10, but may be provided outside the image processing apparatus 10. In this case, the image processing apparatus 10 inputs and outputs various types of information to and from the scanner 12 and the printer 13 via a network.

[0013] The controller unit 11 includes a system bus 101 and an image bus 102. The system bus 101 is a main path for transmitting data between components. The image bus 102 is a dedicated path for transferring image data at high speed. Examples of the image bus 102 include a PCI bus and IEEE1394.

[0014] A CPU 110, a ROM 111, a RAM 112, an SRAM 113, an HDD 114, an RTC 115, an operation unit I / F 116, a modem 117, a network I / F 118, and an image bus I / F 119 are connected to the system bus 101.

[0015] The CPU 110 performs control for realizing various functions of the image processing apparatus 10. The CPU 110 includes one or more processors. The CPU 110 performs various processes by executing a program or activating hardware. The program is executed by loading the program into the RAM 112. The processing by the CPU 110 may be performed in cooperation with a GPU (not shown).

[0016] The ROM 111 stores various types of data. For example, the ROM 111 stores programs. These programs include a boot program, a device driver for operating a device, and the like. The RAM 112 is used as a work memory for the CPU 110. That is, the RAM 112 stores data necessary for execution of processing by the CPU 110.

[0017] SRAM113 is a high-speed, non-volatile storage medium. HDD114 is a high-capacity storage medium. Various types of data, such as system software, applications, and image data, are stored in either SRAM113 or HDD114.

[0018] The RTC115 is a real-time clock. The RTC115 counts the time even when the controller unit 11 is not powered on. The operation unit I / F116 exchanges data between the controller unit 11 and the operation unit 120. The operation unit 120 can display various user interfaces in its display area and can also accept input such as instructions in response to user operations on the operation unit 120. The operation unit 120 may be a touch panel having a liquid crystal layer and a touch sensor layer.

[0019] The modem 117 connects to a public telephone line and performs information input and output via the connected public telephone line. The network interface 118 connects to a network and performs information input and output via the connected network. The image bus interface 119 is a bus bridge that connects the system bus 101 and the image bus 102 and converts the data structure.

[0020] The image bus 102 is connected to the RIP 121, device I / F 122, scanner image processing unit 123, and printer image processing unit 124.

[0021] RIP121 is a raster image processor. RIP121 converts PDL code into a bitmap image. The device I / F unit 122 exchanges data between the controller unit 11 and various devices. These devices include the scanner 12, printer 13, and sensor group 14. The device I / F unit 122 performs image data conversion between synchronous and asynchronous systems. The scanner image processing unit 123 performs various image processing such as correction, processing, and editing on the image data input from the scanner 12 to the controller unit 11. The printer image processing unit 124 performs various image processing such as printer correction and resolution conversion on the image data to be output from the controller unit 11 to the printer 13.

[0022] <Software configuration of the image processing device> Figure 2 shows an example of the software configuration of the image processing device 10. In the image processing device 10, the CPU 110 expands programs installed on the HDD 114 or the like into RAM 112 and executes the expanded programs to function as each functional unit. Each functional unit includes a scan preview display unit 201, a batch edit button display unit 202, a pre-setting screen display unit 203, an operation reception unit 204, a batch edit setting reception unit 205, a batch edit setting storage unit 206, a batch edit identification unit 207, and a batch edit execution unit 208.

[0023] The scan preview display unit 201 performs the process of displaying a preview screen of the document scanned by the scanner 12. The batch editing button display unit 202 displays a button for accepting the execution of a process to edit the target of editing in a batch. A button is one of the operation objects that can be operated in the display area. Operation objects other than buttons may also be displayed. The pre-setting screen display unit 203 displays a pre-setting screen, which is a screen for making prior settings regarding the process of editing the target of editing in a batch. The operation reception unit 204 accepts input such as instructions corresponding to user operations. The batch editing setting reception unit 205 accepts settings related to the process of editing the target of editing in a batch. The batch editing setting storage unit 206 stores setting information, which is information indicating the content of the settings related to the process of editing the target of editing in a batch. The batch editing identification unit 207 identifies the target page (target image), which is the page (source image) containing the set editing target, from among the multiple pages (multiple source images) scanned by the scanner 12, based on the setting information. The batch editing execution unit 208 executes a process to edit the target pages in bulk based on the configuration information.

[0024] <Pre-configuration process> Next, the pre-configuration process will be explained. The pre-configuration process is a setup process for performing preview editing with a single button. Figure 3 is a flowchart of an example of the pre-configuration process. The series of processes shown in the flowchart of Figure 3 constitute the pre-configuration process. The pre-configuration process starts, for example, when power is turned on to the image processing device 10. Each step shown in the flowchart of Figure 3 is processed by the CPU 110 of the image processing device 10 executing a program stored in the ROM 111 or the like. That is, the processing of each step is executed by one of the functional units shown in Figure 2. Note that some or all of the processing of each step may be implemented by hardware such as an ASIC or electronic circuit. Also, the symbol "S" in the following flowchart explanation represents a step.

[0025] In S301, the operation reception unit 204 detects the receipt of a command to display the pre-configuration screen. For example, if a command to display the pre-configuration screen is received in response to a user operation on a pre-configuration item in a settings menu (not shown), the process proceeds to S302.

[0026] In S302, the pre-configuration screen display unit 203 displays the pre-configuration screen in the display area of ​​the operation unit 120. The process then proceeds to S303. In S303, the pre-configuration screen display unit 203 determines the user's operation on the pre-configuration screen. This operation includes item operation, setting confirmation operation, and setting cancellation operation.

[0027] An item operation is either a selection operation or a deselection operation on an item displayed on the pre-configuration screen. If the pre-configuration screen display unit 203 determines that it is either a selection operation or a deselection operation, it proceeds to S304. In S304, the pre-configuration screen display unit 203 switches the display of the items. For example, the pre-configuration screen display unit 203 switches the display of a selected item to a selected state. Alternatively, the pre-configuration screen display unit 203 switches the display of a deselected item to a non-selected state. Once the display of an item is switched, the process returns to S303.

[0028] The setting confirmation operation is the operation to confirm the settings of the batch edit. If the pre-setting screen display unit 203 determines that it is a setting confirmation operation, it proceeds to S305. In S305, the batch edit setting storage unit 206 generates setting information and stores it in the HDD 114 or the like. The setting information includes information about the items that have been switched to display as selected. Note that if previously generated setting information is stored in the HDD 114 or the like, the batch edit setting storage unit 206 may discard the previously generated setting information. Once the setting information is stored, the process proceeds to S306. In S306, the pre-setting screen display unit 203 closes the pre-setting screen. After that, the pre-setting process ends.

[0029] The setting cancellation operation cancels the settings for batch editing. If the pre-setting screen display unit 203 determines that it is a setting cancellation operation, it proceeds to S307. In S307, the pre-setting screen display unit 203 closes the pre-setting screen. After that, the pre-setting process ends.

[0030] Figure 4 shows an example of a pre-configuration screen. Specifically, Figure 4(a) shows an example where each item is not selected, and Figure 4(b) shows an example where some items are selected.

[0031] The items are used to set the editing content, which is the process for editing multiple items at once. The editing content for each item is different. In the example in Figure 4, the following items are displayed on the pre-setting screen: Blank Delete Item 401, Invert / Rotate Item 402, First Blackout Item 403, and Second Blackout Item 404. In the example in Figure 4, a Cancel button 405 for canceling the settings and an OK button 406 for confirming the settings are also displayed on the pre-setting screen. In the example in Figure 4, checkboxes corresponding to each item are also displayed. When the user selects an item, a check mark appears in the checkbox. When the user deselects an item, the check mark displayed in the checkbox disappears.

[0032] The blank page deletion item 401 is an item for deleting blank pages, which are pages without printed content, from among multiple pages scanned by the scanner 12, as editing targets. Blank pages are detected by the scanner image processing unit 123. Information indicating the detected blank pages is supplied to the CPU 110. The CPU 110 stores the information indicating blank pages in the HDD 114 or the like and sets it. Each functional unit shown in Figure 2 can determine whether there are pages containing blank pages among the multiple pages scanned by the scanner 12, based on the information indicating blank pages. One method for detecting blank pages is to compare the brightness value of each pixel on the page with a threshold and detect blank pages based on the percentage of pixels above the threshold. Alternatively, blank pages can be detected by detecting the reflectance using an optical sensor.

[0033] The inversion / rotation item 402 is an item for rotating inverted pages, which are pages whose orientation is reversed among multiple pages read by the scanner 12, to their normal state as editing targets. Inverted pages are detected by the scanner image processing unit 123. For example, the scanner image processing unit 123 performs optical character recognition (OCR) and detects inverted pages based on the orientation of the characters. Information indicating the detected inverted pages is supplied to the CPU 110. The CPU 110 stores and sets the information indicating the inverted pages in the HDD 114 or the like. Each functional unit shown in Figure 2 can determine whether there are pages containing inverted pages among the multiple pages read by the scanner 12, based on the information indicating the inverted pages.

[0034] The first blacked-out item 403 is for blacking out parts of multiple pages scanned by the scanner 12 that the user has specified as the target of editing. Blacking out is a process that replaces the pixel values ​​of the areas to be blacked out with values ​​corresponding to black.

[0035] Figure 5 is a diagram illustrating the process of specifying the area to be blacked out. Specifically, Figure 5(a) shows the first screen for specifying the area to be blacked out, and Figure 5(b) shows the second screen that appears after the first screen. Figure 5(c) shows the second screen with the area to be blacked out specified.

[0036] For example, if a selection operation is performed for the first blacked-out item 403 shown in Figure 4(a), and then the setting confirmation operation is performed by pressing the OK button 406, the CPU 110 displays the first screen in the display area of ​​the operation unit 120. The first screen displays a message prompting the user to place the document to be blacked out into the scanner 12. The first screen also displays the cancel button 501 and the start button 502. When the user presses the start button 502, the CPU 110 requests the scanner 12 to scan the document.

[0037] Once the document scanning is complete, the CPU 110 displays the second screen in the display area of ​​the control unit 120, replacing the first screen. The second screen displays a preview image 511 of the document scanned by the scanner 12 and a message prompting the user to specify areas to be blacked out. The second screen also displays a cancel button 512, an OK button 513, and an icon 514 for specifying areas to be blacked out. The user presses the icon 514 and then specifies the areas to be blacked out in the preview image 511.

[0038] When the CPU 110 receives a request to black out certain areas, it blacks out those areas in the preview image 511, as shown in Figure 5(c). If the user presses the cancel button 512, the CPU 110 discards the request to black out certain areas and closes the second screen. On the other hand, if the user presses the OK button 513, the CPU 110 stores information indicating the format of the document and the specified location (location of the blacked-out area) within that document in the HDD 114 or similar device, sets it, and closes the second screen. The format of the document may include, for example, the number of lines on a page, borders, or text strings generated by optical character recognition (OCR). Each functional unit shown in Figure 2 can determine, based on the information indicating the format of the document and the specified location within that document, whether there is a page containing the document portion specified by the user among the multiple pages scanned by the scanner 12.

[0039] The second blacked-out item 404 is an item among the multiple pages read by the scanner 12 that is to be blacked out for editing purposes, specifically for items containing signatures and seals. A signature and seal is at least one of a signature and a seal. One method for automatically detecting signatures and seals is, for example, an AI-OCR detection method using AI technology called deep learning. When this detection method is used, the scanner image processing unit 123 uses a trained machine learning model, the AI-OCR model, to automatically detect signatures and seals on multiple pages. Information indicating the automatic detection result is supplied to the CPU 110. The CPU 110 stores and configures the information indicating the automatic detection result in the HDD 114 or the like. Each functional unit shown in Figure 2 can determine, based on the information indicating the automatic detection result, whether there is a page containing a signature and seal among the multiple pages read by the scanner 12. In this embodiment, the target of automatic detection is a signature and seal, but it is not limited to this. For example, the target of automatic detection may be personal information such as address, date of birth, telephone number, email address, or facial photograph.

[0040] Furthermore, if the result of blacking out the document using the trained AI-OCR model is not as expected by the user, the CPU 110 may create training data based on the page of the document and store it in the HDD 114 or the like. The training data includes information indicating the coordinates (area) of the correct signature and seal, information indicating the signature and seal, information indicating the color of the signature and seal, and information indicating whether or not there is an underline. In addition, the CPU 110 may retrain the AI-OCR model in the scanner image processing unit 123 using the training data stored in the HDD 114 or the like.

[0041] <Batch editing process> Next, the batch editing process will be described. The batch editing process is a process that performs preview editing in a batch with a single button. Figure 6 is a flowchart of an example of the batch editing process in the first embodiment. The series of processes shown in the flowchart in Figure 6 constitute the batch editing process. The batch editing process starts when a scan job instruction is received. Each step shown in the flowchart in Figure 6 is processed by the CPU 110 of the image processing device 10 executing a program stored in the ROM 111 or the like. That is, the processing of each step is performed by one of the functional units shown in Figure 2. Note that some or all of the processing of each step may be implemented by hardware such as an ASIC or electronic circuit.

[0042] In S601, the CPU 110 displays a preview screen of the document scanned by the scanner 12 in the display area of ​​the operation unit 120. That is, the CPU 110 requests the scanner 12 to scan the document and obtains multiple pages scanned by the scanner 12. The CPU 110 generates a preview screen based on the obtained multiple pages and displays the generated preview screen in the display area of ​​the operation unit 120. This preview screen includes an operation object for accepting the execution of a process to edit the target of editing all at once, and a preview image. Note that the preview screen may display preview images corresponding to each page in thumbnail format, or it may display larger preview images than thumbnail format for each page. Once the CPU 110 displays the preview screen, it proceeds to S602.

[0043] In S602, the CPU 110 waits for user input on the operation object. In response to user input on the operation object displayed on the preview screen, the CPU 110 receives an instruction to execute a process to edit all editing targets at once. In this case, the CPU 110 proceeds to S603.

[0044] In S603, the CPU 110 determines whether there is a target page among the multiple pages scanned by the scanner 12 that contains the page to be edited. This determination is made based on the setting information stored in S305 through the setting confirmation operation on the pre-setting screen. For example, as shown in Figure 4(b), if the OK button 406 is pressed with the blank deletion item 401, the inversion / rotation item 402, and the second blackout item 404 selected, it is determined whether there is a target page that is a blank page, an inverted page, or a page with a signature and seal. Alternatively, although not shown, if the OK button 406 is pressed with only the blank deletion item 401 selected, it is determined whether there is a target page that is a blank page. If there is no target page among the pages, the CPU 110 terminates the batch editing process. On the other hand, if there is a target page among the pages, the CPU 110 proceeds to S604.

[0045] In S604, CPU110 executes a batch editing process for the target pages, then proceeds to S605 to change the display of the preview screen. Specifically, CPU110 changes the display of the preview image representing the target pages to reflect the results of the editing process. After that, CPU110 terminates the batch editing process.

[0046] Figure 7 shows examples of preview screens. Specifically, Figure 7(a) is an example of a preview screen before batch editing, and Figure 7(b) is an example of a preview screen after batch editing. The preview screen before batch editing shown in Figure 7(a) is an example of a preview screen displayed in S601 shown in the flowchart of Figure 6. The preview screen after batch editing shown in Figure 7(b) is an example of a preview screen displayed in S605 shown in the flowchart of Figure 6.

[0047] In the example shown in Figure 7(a), preview images corresponding to each of the multiple pages scanned by the scanner 12 are displayed on the preview screen in thumbnail format. Specifically, a signed and sealed image 701, a blank page image 702, and an inverted image 703 are displayed. The signed and sealed image 701 is the preview image corresponding to the page with a signature and seal. The blank page image 702 is the preview image corresponding to the blank page. The inverted image 703 is the preview image corresponding to the inverted page.

[0048] In addition, in the example shown in Figure 7(a), an automatic button 704 is displayed on the preview screen as an operation object for accepting the execution of a process to edit all items at once. Also in the example shown in Figure 7(a), an operation menu 705 is displayed on the preview screen for accepting the execution of a manual editing process. The operation menu 705 displays a rotate button, a move button, a delete button, and an edit button.

[0049] If the user wishes to manually edit a page scanned by scanner 12, they operate the operation menu 705. For example, the user presses the move button to select the preview image they wish to edit, and then presses the rotate, delete, or edit button. In response to this operation, CPU 110 edits the page corresponding to the selected preview image.

[0050] If the user wishes to perform batch editing of pages scanned by scanner 12, they press the automatic button 704. This press triggers the process to proceed from S602 to S603 in the flowchart shown in Figure 6. When batch editing is set as shown in the pre-configuration screen in Figure 4(b), the pages corresponding to the signature and seal image 701, the blank image 702, and the inverted image 703 become the target pages in the example in Figure 7(a). Therefore, the display reflecting the batch editing of the target pages in S605 of the flowchart shown in Figure 6 will be as shown in Figure 7(b). Specifically, the part of the signature and seal image 701 corresponding to the signature and seal is blacked out. The blank image 702 is deleted from the preview screen. The inverted image 703 is rotated to its normal orientation.

[0051] In the example shown in Figure 7(a), a cancel button 706 and a send button 707 are displayed. When the user presses the cancel button 706, the CPU 110 closes the preview screen. On the other hand, when the user presses the send button 707, the CPU 110 closes the preview screen and sends the multiple pages scanned by the scanner 12 to the printer 13. Note that if at least one of manual editing or batch editing is performed, the pages sent to the printer 13 will be the edited pages.

[0052] As described above, this embodiment makes it possible to improve usability. For example, the CPU 110, acting as a display control means, controls the display of a preview screen that includes a preview image and an auto button 704. Furthermore, when the auto button 704 is pressed, the CPU 110, acting as an execution means, executes a process to collectively edit the target page containing the page to be edited among multiple pages corresponding to the source of the preview image. When this process is executed, the CPU 110 changes the display of the preview image corresponding to the target page to reflect the results of the editing process.

[0053] In other words, when the automatic button 704 is pressed once, the pages to be edited in bulk are automatically edited, and the edited results are reflected in the preview screen. Therefore, the user can check whether the bulk editing results are as desired and then decide whether or not to print the images of each page scanned by the scanner 12. As a result, the entire process up to sending the documents can be completed in a short number of steps.

[0054] Furthermore, CPU 110 changes the display of the preview image to reflect the editing process results and hides the auto button 704 from the preview screen (see Figure 7(b)). This prevents the batch editing process from being executed more than twice. As a result, the operation becomes simpler for the user, reducing the user's burden. In addition, restoration becomes easier compared to when the batch editing process for the target pages is executed more than twice.

[0055] Furthermore, the CPU 110, acting as a setting means, performs a pre-configuration process to set at least one of several items with different editing content. The CPU 110, acting as an execution means, executes a process to edit the target pages corresponding to the configured editing content all at once. This makes it possible for the user to edit pages corresponding to one or more items of their choice all at once, leading to improved usability.

[0056] In this embodiment, the process of editing the target page included deleting blank pages, rotating inverted pages, and blacking out parts of the original document or signatures and seals, but it is not limited to these.

[0057] [Second Embodiment] In the first embodiment, an example was described in which the batch editing process is terminated if the target page is not found among the multiple pages scanned by the scanner 12. In this embodiment, an example is described in which, if the target page is not found, the user is notified that the editing process will not be executed before the batch editing process is terminated. In the following, explanations of content common to the first embodiment will be omitted as appropriate, and the differences will be explained mainly.

[0058] <Batch editing process> Figure 8 is a flowchart showing an example of batch editing processing in the second embodiment. In the flowchart shown in Figure 8, the processing in S801 is added to the flowchart shown in Figure 6. If the target page is not among the multiple pages read by the scanner 12 in S603, the CPU 110 proceeds to S801.

[0059] In S801, the CPU 110 notifies that the target page does not exist. For example, the CPU 110 displays a pop-up screen in the display area of ​​the operation unit 120 to notify that the target page does not exist. Figure 9 shows an example of a pop-up screen. In the example in Figure 9, the pop-up screen displays a message indicating that the target page (target operation) does not exist, and an OK button 901. When the user presses the OK button 901, the CPU 110 closes the pop-up screen and terminates the batch editing process.

[0060] As described above, in this embodiment, if the target page does not exist, the CPU 110 notifies the user that the target page does not exist. This makes it possible to inform the user that the batch editing effect cannot be obtained because the target page does not exist. As a result, the user can be given an opportunity to review the pre-configuration settings for batch editing or to review the document scanned by the scanner 12.

[0061] In this embodiment, the notification was a display on the display area, but it may also be an audio signal, a warning light turning on or flashing, or a vibration from the vibrating part. Alternatively, the notification may be a combination of at least two of the following: a display on the display area, an audio signal, a warning light turning on or flashing, or a vibration from the vibrating part.

[0062] [Third Embodiment] In the first embodiment, an example was described in which the batch editing results were immediately reflected in the preview screen display. In this embodiment, an example is described in which the batch editing results are reflected in the preview screen display after the user has been allowed to confirm them. In the following, explanations of content common to the first embodiment will be omitted as appropriate, and the differences will be explained mainly.

[0063] <Batch editing process> Figure 10 is a flowchart showing an example of batch editing processing in the third embodiment. In the flowchart shown in Figure 10, processes S1001 to S1005 are added between processes S604 and S605 in the flowchart shown in Figure 6.

[0064] In S1001, the CPU 110 determines whether the settings for the batch editing process include blacking out. This determination is made based on the setting information stored in S305 through the setting confirmation operation on the pre-setting screen. If the CPU 110 determines that the settings for the batch editing process do not include blacking out, it proceeds to S605. On the other hand, if the CPU 110 determines that the settings for the batch editing process include blacking out, it proceeds to S1002.

[0065] In S1002, the CPU 110 displays a confirmation screen showing the page containing the blacked-out area in the display area of ​​the operation unit 120. Figure 11 shows an example of the confirmation screen. In the example in Figure 11, the confirmation screen displays the page containing the blacked-out area and a message asking whether to apply the blacked-out area. The confirmation screen also displays a cancel button 1101 to undo the blacked-out area on the displayed page containing the blacked-out area, and an OK button 1102 to allow the blacked-out area on the displayed page containing the blacked-out area. Once the confirmation screen is displayed, the process proceeds to S1003.

[0066] In S1003, the CPU 110 waits for user input regarding either the Cancel button 1101 or the OK button 1102. When the CPU 110 receives an input indicating that either the Cancel button 1101 or the OK button 1102 has been pressed, it proceeds to S1004. The CPU 110 may also display a message prompting the user to perform an edit, such as "You can edit using the operation menu on the preview screen." if it receives an input indicating that the Cancel button 1101 has been pressed.

[0067] In S1004, the CPU 110 determines whether there are any other pages in the document scanned by the scanner 12 that contain blacked-out areas, in addition to the page that contained the blacked-out area displayed on the confirmation screen in S1002. If there are other pages containing blacked-out areas, the CPU 110 returns to S1002; otherwise, it proceeds to S605.

[0068] In S605, the CPU 110 switches the display of the preview screen to a display that reflects the results of the batch editing process for the target pages. In this embodiment, if the batch editing process for the target pages results in blacking out parts of the pages, the blacking out results for target pages permitted by the user are reflected, but the blacking out results for target pages that have been canceled by the user are not reflected.

[0069] As described above, in this embodiment, the CPU 110, acting as a result display control means, controls the display of images of the target pages for which a batch editing process has been performed. If there are multiple images for the target pages, the CPU 110 controls the display of each image for each target page individually. This makes it possible to cancel the editing process if the editing result is not as expected by the user, leading to improved usability.

[0070] Furthermore, CPU110 changes the display of the preview image corresponding to the approved editing result when the user approves it. This leads to improved user satisfaction.

[0071] In this embodiment, the image of the target page displayed on a page-by-page basis was an image containing black fills, but it may also be an image of a blank page, an inverted page, or an image of a page on which other editing processes have been performed.

[0072] <About this disclosure> This disclosure is not limited to the embodiments described above.

[0073] For example, in the above embodiment, the CPU 110 changes the display of the preview image to reflect the editing processing results and hides the auto button 704 from the preview screen, but the auto button 704 may remain on the preview screen. Alternatively, the CPU 110 may change the display of the preview image to reflect the editing processing results and change the display of the auto button 704 to an operation disabled state. For example, an operation disabled state could be a grayed-out state or a state with reduced transparency. The same effect as in the above embodiment can be obtained by doing this as well.

[0074] Furthermore, the CPU 110 may change the display of the preview image to reflect the editing process results and may also display an operation object different from the auto button 704. For example, it may display a restore operation unit, which is an operation object for accepting an operation to revert to the state before the batch editing process was performed on the target pages. Figure 12 shows an example of another preview screen. Specifically, Figure 12(a) is an example of a preview screen after batch editing, and Figure 12(b) is a preview screen when reverted to before batch editing. In Figures 12(a) and 12(b), the same elements as in Figure 7(a) are denoted by the same symbols.

[0075] In the example shown in Figure 12(a), the undo button 1201 is displayed as the restore operation unit instead of the auto button 704. The undo button 1201 is displayed by the CPU 110 when the display of the preview image changes to reflect the editing process results. In response to the user pressing the undo button 1201, the CPU 110 receives a display restore instruction. Upon receiving the display restore instruction, the CPU 110 restores the display of the preview screen to the state before the processing to edit the target page all at once was performed. This makes it possible to cancel the editing process if the editing process results are not as the user expected, leading to improved usability.

[0076] The CPU 110 may revert the preview screen display to the state it was in before the batch editing process for the target pages was performed, and may also display the restored target page's preview image in a way that allows it to be distinguished from the preview images of other pages. In the example in Figure 12(b), a frame is added around the restored target page's preview image. On the other hand, the preview images of other pages remain in their original state without a frame. Even with a large number of preview images displayed, the user can easily identify the target page at a glance.

[0077] In the above embodiment, the source image, which is the source of the preview image, was a page (image) read by the scanner 12, but is not limited to this. For example, the source image may be an image stored on a storage medium such as a memory card. Various images can be used as the source image.

[0078] This disclosure can also be realized by performing the following process: supplying software (programs) that realize the functions of the embodiments described above to a system or device via a network or storage medium, and having the computer of that system or device read and execute the program code. In this case, the program and the storage medium storing the program constitute this disclosure.

[0079] Furthermore, the various processes described above as being performed by the CPU 110 may be performed by a single piece of hardware, or the processing may be shared among multiple pieces of hardware (for example, multiple processors or circuits). For example, at least a part of the CPU 110 that functions as the display control means, execution means, setting means, result display control means, notification means, etc., may be configured by hardware.

[0080] Furthermore, the various processes described above may be implemented by supplying software (programs) to a system or device via a network or storage medium, and by the computer of that system or device reading and executing the program code. In this case, the program and the storage medium storing the program constitute the present disclosure.

[0081] The disclosure of this embodiment includes configurations represented by the following example image processing apparatus, example image processing method, and example program.

[0082] (Composition 1) An operation object for accepting the execution of a process to edit multiple items at once, and a display control means for controlling the display of a preview screen including a preview image, An execution means that, upon receiving an operation on the aforementioned operation object, performs a process to collectively edit the target image, which is a source image containing the specified editing target, among a plurality of source images corresponding to the source of the preview image. Equipped with, The image processing apparatus is characterized in that, when processing by the execution means is performed, the display control means changes the display of the preview image corresponding to the target image to a state that reflects the processing result by the execution means.

[0083] (Configuration 2) The image processing apparatus according to Configuration 1, comprising setting means for setting at least one of several items with different editing content, wherein the execution means performs a process of batch editing the target images corresponding to the set editing content.

[0084] (Composition 3) One of the aforementioned items is a blackout item for blacking out a specified portion of the document as the subject of editing. When a setting confirmation operation for the blacked-out item is received, the setting means sets information indicating the format of the document read by the reader and the specified position within the document. The execution means is an image processing apparatus according to configuration 2, which blacks out a specified position in the target image based on the information.

[0085] (Composition 4) One of the aforementioned items is a redacted item for redacting personal information as the subject of editing. When a setting confirmation operation for the blacked-out item is received, the setting means sets information indicating the automatic detection result of the personal information for the multiple source images using the trained machine learning model. The execution means is an image processing apparatus according to configuration 2, which blacks out the personal information in the target image based on the information.

[0086] (Composition 5) The aforementioned items include blacked-out items for blacking out the items to be edited. The image processing apparatus according to configuration 2, further comprising result display control means for controlling the display of the source image including the blacked-out area, which is the result of processing by the execution means.

[0087] (Composition 6) The image processing apparatus according to configuration 5, wherein, if there are multiple source images including the blacked-out areas which are the result of processing by the execution means, the result display control means controls the display of each source image including the blacked-out areas individually.

[0088] (Composition 7) The image processing apparatus according to any one of configurations 2 to 6, wherein the plurality of items include a blank deletion item for deleting a blank image as the editing target and a reverse rotation item for rotating a reversed image as the editing target.

[0089] (Composition 8) The image processing apparatus according to any one of configurations 1 to 7, wherein the display control means changes the display of the preview image to the state and changes the display of the operation object to an operation disabled state.

[0090] (Composition 9) The image processing apparatus according to any one of configurations 1 to 7, wherein the display control means changes the display of the preview image to the state and hides the operation object from the preview screen.

[0091] (Composition 10) The image processing apparatus according to any one of configurations 1 to 9, wherein the display control means changes the display of the preview image to the state and displays an operation object on the preview screen for accepting the execution of a process to return to the state before the processing by the execution means was performed.

[0092] (Composition 11) An image processing apparatus according to any one of configurations 1 to 10, further comprising a notification means for notifying that the target image does not exist if the target image does not exist.

[0093] (Composition 12) The image processing apparatus according to any one of configurations 1 to 11, wherein the display control means changes the display of the preview image corresponding to the permitted processing result when the processing result by the execution means is permitted by the user.

[0094] (Composition 13) An image processing apparatus according to any one of configurations 1 to 12, further comprising result display control means for controlling the display of the target images processed by the execution means individually.

[0095] (Composition 14) An operation object for accepting the execution of a process to edit multiple items at once, and a display control means for controlling the display of a preview screen including a preview image, When an operation is received on the aforementioned operation object, the execution step includes executing a process to collectively edit the target image, which is one of several source images corresponding to the source of the preview image and which is the source image containing the set editing target, A modification step that changes the display of the preview image corresponding to the target image to a state that reflects the processing result in the execution step, An image processing method characterized by including

[0096] (Composition 15) A program for causing a computer to function as one of the means of an image processing apparatus described in any one of items 1 to 13 of the configuration. [Explanation of Symbols]

[0097] 110 CPU 120 Operation section 201 Scan Preview Display Section 202 Batch Edit Button Display Section 203 Pre-configuration screen display section 204 Operation Reception Section 205 Batch Editing Settings Reception Department 206 Batch Editing Settings Storage Unit 207 Batch Editing Special Section 208 Batch Editing Execution Unit

Claims

1. An operation object for accepting the execution of a process to edit multiple items at once, and a display control means for controlling the display of a preview screen including a preview image, An execution means that, upon receiving an operation on the aforementioned operation object, performs a process to collectively edit the target image, which is a source image containing the set editing target, among a plurality of source images corresponding to the source of the preview image. Equipped with, The image processing apparatus is characterized in that, when processing by the execution means is performed, the display control means changes the display of the preview image corresponding to the target image to a state that reflects the processing result by the execution means.

2. The image processing apparatus according to claim 1, comprising setting means for setting at least one of a plurality of items with different editing contents, wherein the execution means performs a process of editing the target images corresponding to the set editing contents all at once.

3. One of the aforementioned items is a blackout item for blacking out a specified portion of the document as the subject of editing. When a setting confirmation operation for the blacked-out item is received, the setting means sets information indicating the format of the document read by the reader and the specified position within the document. The image processing apparatus according to claim 2, wherein the execution means blacks out a specified position in the target image based on the information.

4. One of the aforementioned items is a redacted item for redacting personal information as the subject of editing. When a setting confirmation operation is received for the blacked-out item, the setting means sets information indicating the result of automatic detection of the personal information for the multiple source images using the trained machine learning model. The image processing apparatus according to claim 2, wherein the execution means blacks out the personal information in the target image based on the information.

5. The aforementioned items include blacked-out items for blacking out the items to be edited. The image processing apparatus according to claim 2, further comprising result display control means for controlling the display of the source image including the blacked-out area, which is the result of processing by the execution means.

6. The image processing apparatus according to claim 5, wherein, if there are multiple source images including the blacked-out areas which are the result of processing by the execution means, the result display control means controls the display of each source image including the blacked-out areas individually.

7. The image processing apparatus according to claim 2, wherein the plurality of items include a blank deletion item for deleting a blank image as the editing target, and a reverse rotation item for rotating a reversed image as the editing target.

8. The image processing apparatus according to claim 1, wherein the display control means changes the display of the preview image to the state and changes the display of the operation object to an operation disabled state.

9. The image processing apparatus according to claim 1, wherein the display control means changes the display of the preview image to the state and hides the operation object from the preview screen.

10. The image processing apparatus according to claim 1, wherein the display control means changes the display of the preview image to the state and displays an operation object on the preview screen for accepting the execution of a process to return to the state before the processing by the execution means was performed.

11. The image processing apparatus according to claim 1, further comprising a notification means for notifying that the target image does not exist if the target image does not exist.

12. The image processing apparatus according to claim 1, wherein the display control means changes the display of the preview image corresponding to the permitted processing result when the processing result by the execution means is permitted by the user.

13. The image processing apparatus according to claim 1, further comprising a result display control means for controlling the display of the target images processed by the execution means individually.

14. An operation object for accepting the execution of a process to edit multiple items at once, and a display control means for controlling the display of a preview screen including a preview image, When an operation is received on the aforementioned operation object, the execution step includes executing a process to collectively edit the target image, which is one of several source images corresponding to the source of the preview image and which is the source image containing the set editing target, A modification step that changes the display of the preview image corresponding to the target image to a state that reflects the processing result in the execution step, An image processing method characterized by including

15. A program for causing a computer to function as one of the means of an image processing apparatus described in any one of claims 1 to 13.

Images