IMAGE PROCESSING APPARATUS, CONTROL METHOD FOR IMAGE PROCESSING APPARATUS, AND PROGRAM

Abstract

To execute a transfer process by reading a manuscript and specifying transfer destination information regarding the transfer destination and a transfer amount of money according to a result obtained by the character recognition process.SOLUTION: An image processing device includes: reading means for reading a manuscript; processing means for executing a character recognition process to characters contained in an image of the manuscript read by the reading means; specifying means for specifying transfer destination information and transfer amount of money regarding the transfer destination from the result obtained by the character recognition process executed by the processing means; and transmitting means for transmitting the transfer destination information and transfer amount of money regarding the transfer destination specified by the specifying means.SELECTED DRAWING: Figure 6

Description

[Technical field]

[0001] The present invention relates to an image processing apparatus, a control method for an image processing apparatus, and a program. [Background technology]

[0002] Conventionally, technology is known that reduces the effort required for users to input information regarding a transfer by capturing an image of a document on which a transfer destination is written, performing character recognition on the captured image, and extracting information regarding the transfer destination for use in the transfer process.

[0003] Patent document 1 describes a method of performing character recognition on a captured image to extract the financial institution name, branch name, subject matter, and account number, and if this information matches information stored in a pre-stored financial institution information database, this information is used to carry out the transfer process. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2013-109726 A Summary of the Invention [Problem to be solved by the invention]

[0005] In Patent Document 1, when performing a transfer process using the results obtained by character recognition processing, the transfer destination information regarding the transfer destination can be used, but the transfer amount must be manually input by the user, digit by digit.

[0006] The present invention has been made in consideration of the above problems. The present invention is a method for reading an original document, identifying transfer destination information and a transfer amount from the results obtained by character recognition processing, and performing a transfer process, and Show locationWhen an object for storing position information and calling up transfer destination information relating to a transfer destination is selected, a new document is read, and if transfer destination information relating to a new transfer destination obtained by character recognition processing from a position indicated by the position information of the image of the read document coincides with the stored transfer destination information, a transfer destination based on the new document is called. New transfer Amount When an object for calling up transfer destination information regarding a transfer destination is selected, a new document is read, and if the transfer destination information regarding the new transfer destination obtained by character recognition processing from the position indicated by the position information of the image of the read document does not match the transfer destination information regarding the stored transfer destination, At least a part of the image of the new document that has been read is displayed in a state in which the user can identify the area that has been subjected to character recognition processing. The purpose of this document is to provide a mechanism for this. [Means for solving the problem]

[0007] The present invention includes a reading means for reading an original document, a processing means for executing character recognition processing included in an image of the original document read by the reading means, a specifying means for specifying transfer destination information and a transfer amount from the results obtained by the character recognition processing executed by the processing means, a transmitting means for transmitting the transfer destination information and the transfer amount specified by the specifying means, the transfer destination information and the transfer amount transmitted by the transmitting means, and Show location A storage means for storing location information, and an object for calling up the transfer destination information related to the transfer destination stored in the storage means are displayed. table and a display means for displaying the selected object, the display means reads a new document and, when the object displayed by the display means is selected, the reading means reads a new document and, when transfer destination information relating to a new transfer destination obtained by the character recognition process from a position indicated by the position information of the image of the read document coincides with transfer destination information relating to the transfer destination stored in the storage means, displays a transfer destination based on the new document on the display means. New transfer Amountwhen the object displayed by the display means is selected, a new document is read by the reading means, and when transfer destination information regarding a new transfer destination obtained by the character recognition process from the position indicated by the position information of the image of the read document does not match the transfer destination information regarding the transfer destination stored in the storage means, At least a part of the image of the new document read by the reading means is displayed on the display means in a state in which the area subjected to the character recognition process can be identified by a user. It is characterized by the above. Effect of the Invention

[0008] According to the present invention, a document is read, and from the results obtained by character recognition processing, transfer destination information regarding the transfer destination and the transfer amount are specified, and a transfer process is performed. Show location When an object for storing position information and calling up transfer destination information relating to a transfer destination is selected, a new document is read, and if transfer destination information relating to a new transfer destination obtained by character recognition processing from a position indicated by the position information of the image of the read document coincides with the stored transfer destination information, a transfer destination based on the new document is called. New transfer Amount When an object for calling up transfer destination information regarding a transfer destination is selected, a new document is read, and if the transfer destination information regarding the new transfer destination obtained by character recognition processing from the position indicated by the position information of the image of the read document does not match the transfer destination information regarding the stored transfer destination, At least a part of the image of the new document that has been read is displayed in a state in which the user can identify the area that has been subjected to character recognition processing. It is possible. [Brief description of the drawings]

[0009] [Figure 1] Network configuration diagram [Diagram 2] 1 is a diagram showing a configuration of an image forming apparatus. [Diagram 3] FIG. 2 is a diagram showing an operation unit of the image forming apparatus. [Figure 4] Illustration showing the login screen for banking service authentication [Diagram 5] Figure showing the screen when login to banking services fails [Figure 6] Diagram showing the banking service authentication screen via browser [Figure 7] Flowchart explaining the flow of logging in to bank services [Figure 8] A diagram showing the screen to confirm the execution of an app that registers a transfer destination as a shortcut [Figure 9] Flowchart explaining the flow of new transfer registration processing [Figure 10] FIG. 1 shows an invoice according to an embodiment. [Figure 11] Figure showing the bank transfer processing selection screen [Figure 12] Figure showing the bank transfer processing selection screen [Figure 13] Figure showing the interruption screen for interrupting bank transfer processing [Figure 14] A diagram showing a pre-transfer confirmation screen for bank transfer processing [Figure 15] Chart explaining the bank transfer process flow [Figure 16] Figure showing the confirmation screen for registering a bank transfer destination [Figure 17] A diagram showing that a shortcut has been registered on the operation unit of the image forming apparatus. [Figure 18] Figure showing the screen displayed when authentication for bank transfer processing fails [Figure 19] FIG. 1 shows an invoice according to an embodiment. [Figure 20] Flow chart for registering transfers [Figure 21] A diagram showing the confirmation screen before transfer for the registered destination transfer process. [Figure 22] Chart explaining the process flow for reselecting bank account information [Figure 23] Figure showing the confirmation screen for the detected bank name in the bank account information reselection process DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, the embodiments of the present invention will be described in detail with reference to the drawings. Note that the following embodiments do not limit the invention according to the claims, and all of the combinations of features described in the embodiments are not necessarily essential to the solution of the invention.

[0011] (First embodiment) A first embodiment of the present invention will be described.

[0012] FIG. 1 is a block diagram showing a network configuration according to the present invention.

[0013] The image forming apparatus 101 is an example of an image processing apparatus. In this embodiment, the image forming apparatus 101 is an MFP (Multi Function Peripheral).

[0014] An image forming apparatus 101 is capable of communicating with a PC (Personal Computer) 102 via a network 100. The network 100 is connected to the Internet 103.

[0015] The PC 102 is used to obtain and display the status of the image forming apparatus 101, to configure the image forming apparatus 101, and to transmit print data to the image forming apparatus.

[0016] A bank service API authorization server 104, a bank service resource server 105, an online storage 106, and a mail server 107 are connected to the Internet 103.

[0017] The bank service API authorization server 104 authorizes the use of the bank service API.

[0018] The bank service resource server 105 is used to provide services such as bank transfers and issuing deposit and withdrawal statements.

[0019] The online storage 106 stores images and setting information.

[0020] A mail server 107 sends and receives e-mails.

[0021] The image forming device 101, the PC 102, the bank service API authorization server 104, the bank service resource server 105, the online storage 106, and the mail server 107 are capable of communicating with each other.

[0022] The image forming apparatus 101 reads an original document and transmits the image data obtained by reading the original document to a PC 102 or an online storage 106. The image forming apparatus 101 also reads an original document and attaches the image data obtained by reading the original document to an email and transmits the email to a mail server 107.

[0023] The PC 102 can set or update the setting values ​​of the image forming apparatus 101 using the HTTP protocol.

[0024] Network 100 may be configured to be connected wirelessly to an access point (not shown) as long as the network configuration allows image data to be transmitted. Image data in this embodiment is electronic data. Specifically, image data is not limited to electronic data obtained by converting an image into RAW data, but may be electronic data in an image format such as TIFF or JPEG, or electronic data in a PDF format. Image forming apparatus 101 also has a character recognition unit and has a function of recognizing characters from image data obtained by reading an original document and outputting the character data.

[0025] FIG. 2 is a block diagram showing the configuration of the image forming apparatus 101. As shown in FIG.

[0026] The image forming apparatus 101 has a control unit 110, an operation unit 116, a reading unit 118, and a printing unit 120. The control unit 110 has a CPU 111, a ROM 112, a RAM 113, a storage 114, an operation unit I / F (interface) 115, a reading unit I / F 117, a printing unit I / F 119, an external storage I / F 121, and a communication unit I / F 123. CPU is an abbreviation for Central Processing Unit. ROM is an abbreviation for Read Only Memory. RAM is an abbreviation for Random Access Memory.

[0027] The CPU 111 controls the operation of the image forming apparatus 101 .

[0028] The CPU 111 reads out a program stored in the ROM 112 or the storage 114 into the RAM 113 and executes it. The program is, for example, a control program, and the CPU 111 executes the control program to perform various types of control such as reading control and printing control.

[0029] The ROM 112 stores the programs executed by the CPU 111. The ROM 112 also stores a boot program, font data, and the like.

[0030] The RAM 113 is a main storage memory for the CPU 111. The RAM 113 is used as a work area for the CPU 111 and a temporary storage area for loading programs stored in the ROM 112 and the storage 114. The RAM 113 is also used to temporarily store image data.

[0031] The storage 114 stores image data, print data, an address book, shortcuts, various programs, and various setting information. In this embodiment, the storage 114 is assumed to be a flash memory, but an auxiliary storage device such as an SSD, HDD, or eMMC may also be used. SSD is an abbreviation for Solid State Drive. HDD is an abbreviation for Hard Disk Drive. eMMC is an abbreviation for Embedded Multi Media Card.

[0032] The operation unit I / F 115 connects the operation unit 116 and the control unit 110. The operation unit 116 has hard keys and a touch panel. The touch panel is configured by attaching a touch panel sheet to a display. The operation unit 116 accepts operations from a user via the hard keys and displays a screen via the touch panel.

[0033] The reading unit I / F 117 connects the reading unit 118 and the control unit 110. The reading unit 118 reads an image of a document and generates image data. The image data generated by the reading unit 118 is subjected to character recognition processing, transmitted to an external device, or printed on a printing sheet.

[0034] The printing unit I / F 119 connects the printing unit 120 and the control unit 110. The CPU 111 transfers image data to be printed (image data to be printed) to the printing unit 120 via the printing unit I / F 119. The printing unit 120 prints an image on a sheet fed from a paper feed cassette. The method for printing an image may be an electrophotographic method that uses toner to print an image, or an inkjet method that uses ink to print an image.

[0035] The external storage I / F 121 connects the external storage device 122 and the control unit 110. The CPU 111 stores image data in the external storage device 122 via the external storage I / F 121. In this embodiment, it is assumed that the external storage I / F 121 is a USB interface, and the external storage device 122 is a USB memory. However, the external storage device 122 may be an SD card or the like.

[0036] The control unit 110 is connected to the network 100 via a communication unit I / F 123. The network 100 is, for example, a LAN. LAN is an abbreviation for Local Area Network.

[0037] The communication unit I / F 123 controls transmission and reception of data via the network 100. For example, the image forming apparatus 101 transmits various setting information within the apparatus to the PC 102, transmits e-mail to the mail server 107, and transmits image data to the online storage 106 via the communication unit I / F 123.

[0038] Furthermore, image forming apparatus 101 connects to bank service API authorization server 104 via communication unit I / F 123 and acquires an authorization code for the bank service API provided by bank service resource server 105. Image forming apparatus 101 also connects to bank service resource server 105 via communication unit I / F 123 and presents the authorization code for the bank service API to execute a bank service from the bank service API. Registration and modification of various setting information for acquiring the authorization code for the bank service API are performed by PC 102 accessing image forming apparatus 101 via HTTP.

[0039] Although not shown, the PC 102 has a CPU, RAM, ROM, storage, a communication I / F, and an operation unit. The bank service API authorization server 104, the bank service resource server 105, the online storage 106, and the mail server 107 also have the same hardware as the PC 102.

[0040] 3 is a diagram showing the operation unit 116. The operation unit 116 is composed of a touch panel 300, a Data LED 306, and an Error LED 307.

[0041] A home screen displayed immediately after the start of the image forming apparatus 101 is displayed on the touch panel 300 shown in FIG. 3. The home screen is a screen for instructing the execution of each function of the image forming apparatus 101. For example, the home screen displays a copy button for using a copy function that prints an image based on image data generated by reading an original with the reading unit 118 with the printing unit 120. The home screen also displays a fax button for using a fax function that transmits image data generated by reading an original with the reading unit 118 using a modem (not shown). The home screen also displays a scan button for using a transmission function that transmits image data generated by reading an original with the reading unit 118 via the communication unit I / F 123. The transmission function includes an email function that transmits image data attached to an email, and a folder transmission function that transmits image data to store it in a specified folder. The home screen also displays a memory media print button that prints an image based on image data stored in an external storage device 122 such as a USB memory with the printing unit 120. In addition, the home screen displays a menu button 301, an address book button 302 for calling and displaying an address book, and a bank transfer icon registration button 303 for setting the transfer destination for bank transfers.

[0042] The home key 305 is a hard key, and is a button for switching the currently displayed screen to the home screen.

[0043] The Data LED 306 lights up during data transmission, thereby notifying the user that the image forming apparatus 101 is transmitting data.

[0044] An Error LED 307 is turned on when an error occurs in the image forming apparatus 101 .

[0045] FIG. 4 illustrates a setting screen for registering in the image forming apparatus 102 user information of the remittance source used when making a bank transfer via the operation unit 116. In FIG.

[0046] FIG. 4(A) is displayed by selecting menu 301 in FIG.

[0047] In Fig. 4(A), the user inputs a user ID 401 and a password 402 (an example of authentication information) that are registered to use the bank service. After input is complete, the user ID remains displayed, but the password 402 is obscured. For the registered name 403, the registered name of the bank service is input.

[0048] When the login button 404 is selected, the image forming apparatus 101 performs authentication processing in the sequence of Fig. 7. In this authentication processing, the image forming apparatus 101 performs authentication on the bank service API authorization server 104.

[0049] If the authentication is successful, the screen shown in FIG. 4B appears, where the user ID 405 and password 406 are obscured and only the registered name is displayed.

[0050] When the logout button 408 is selected, FIG. 4(A) is displayed, and the user ID 401, password 402, and registered name 403 are cleared.

[0051] If the authentication fails, the screen in Fig. 5 is displayed on the operation unit 116. When the "Yes" button 501 in Fig. 5 is selected, the screen in Fig. 4(A) is displayed on the operation unit 116.

[0052] The information to be entered on the screen of FIG. 4A and registered to use bank services is set in advance by connecting to the image forming apparatus 101 using a browser on the PC 102 .

[0053] Fig. 6(A) is an example of a setting screen for performing the same operation as in Fig. 4(A) using the PC 102. The user inputs a user ID, password, and registration name in advance via such a screen, and selects the login button.

[0054] When the login button is selected, the user ID, password, and registered name entered by the user are transmitted to the image forming apparatus 101 via the network 100 to the destination, and are stored in the storage 114 of the image forming apparatus 101. Then, when the image forming apparatus 101 receives and stores the user ID, password, and registered name, it performs an authentication process in the sequence of Fig. 7. In this authentication process, the image forming apparatus 101 performs authentication with the bank service API authorization server 104.

[0055] If the authentication is successful, the screen in Fig. 6(B) is displayed on the display device of the PC 102. On this screen, the user ID and password are obscured and only the registered name is displayed.

[0056] If the authentication fails, the screen in FIG. 6(C) is displayed on the display device of the PC 102.

[0057] Fig. 7 shows a sequence when the image forming apparatus 101 performs authentication with the bank service API authorization server 104. Here, a process for performing authentication based on information input via Fig. 4(A) will be described.

[0058] When a request is made to perform login settings for accessing bank services in S801, the image forming apparatus 101 displays an input screen for a user ID and a password on the operation unit 116 in S802.

[0059] In S803, when the user ID 401 and password 402 are entered and the login button 404 is selected, in S804, the image forming apparatus 101 notifies the bank service API authorization server 104 of a token request including the user ID and password set by the user.

[0060] In S805, if the bank service API authorization server 104 confirms that the user ID and password in the token request are legitimate, it transmits a token request response to the image forming apparatus 101.

[0061] In S806, the image forming apparatus 101 displays the result of authentication based on the received token request response. When the bank service API authorization server 104 confirms that the token request response is legitimate, the image forming apparatus 101 displays the screen of Fig. 8 on the operation unit 116. Then, when a start button 901 is selected, the image forming apparatus 101 stores the access token in the token request response in the storage 114 of the image forming apparatus 101, linking it to user information. After the storage is complete, Fig. 4(B) is displayed on the operation unit 116 and Fig. 6(B) is displayed on the PC 102, the password is cleared, and the process ends.

[0062] On the other hand, if the token request response cannot be confirmed as being authentic, the image forming apparatus 101 displays FIG. 5 on the operation unit 116 and ends the process.

[0063] Fig. 9 is a flow chart showing the flow of the initial transfer process. Each process in the flow chart shown in Fig. 9 is realized by CPU 111 reading a program stored in ROM 112 into RAM 113 and executing it.

[0064] Figure 10 is an example of an invoice.

[0065] In S1001, when the bank transfer icon registration button 303 in FIG. 3 is selected, the CPU 111 determines whether authentication by the bank service API authorization server 104 has been completed.

[0066] In S1001, if the CPU 111 determines that authentication by the bank service API authorization server 104 has been completed, the CPU 111 advances the process to S1002. On the other hand, if the CPU 111 determines that authentication by the bank service API authorization server 104 has not been completed, the CPU 111 advances the process to S1009.

[0067] When the process proceeds to S1009, the CPU 111 causes the operation unit 116 to display the bank service authentication setting screen of FIG.

[0068] The process in S1009 for displaying the bank service authentication screen follows the flow in Fig. 7. After the usage authentication process is completed, in S1001, the CPU 111 again checks whether authentication for using the bank service has been completed, and then the process proceeds to S1002.

[0069] In S1002, the CPU 111 selects a transfer source registered by the user, and when the selection is complete, the process proceeds to S1003.

[0070] In S1003, the CPU 111 executes an invoice image reading process. Specifically, the CPU 111 causes the reading unit 116 to read an image of the document, stores the generated image data in the RAM 113, and advances the process to S1004.

[0071] In S1004, CPU 111 executes OCR (character recognition processing) and text object extraction processing on the image data stored in RAM 113. Specifically, CPU 111 performs OCR on the invoice image data stored in RAM 113, searches for the left and right vicinity of each extracted character, and treats characters within a predetermined distance as one piece of character information (one text object). CPU 11 then proceeds to S1005. Note that, although the present embodiment will be described mainly with reference to characters, the character information extracted by OCR may also include numbers and symbols.

[0072] In S1005, CPU 111 causes operation unit 116 to sequentially display the screens in FIGS. 11(A) and 11(B) and the screens in FIGS. 12(A) to 12(C) in order to obtain information necessary for bank transfer.

[0073] In the screens of Figs. 11(A) and 11(B) and the screens of Figs. 12(A) and 12(C), the extracted pieces of character information are displayed in a list. In addition, in the list, a part of the extracted pieces of character information may be displayed, and the remaining pieces of character information may be displayed when a scroll key or a key for displaying the next list is selected. The user selects character information on each screen. The CPU 111 stores the character information selected on the screens of Figs. 11(A) and 11(B) and the screens of Figs. 12(A) and 12(C) in the storage 114 as transfer information. In addition, specifically, the CPU 111 stores the characters selected on the screen of Fig. 11(A) in the storage 114 as the bank name. In addition, the CPU 111 stores the characters selected on the screen of Fig. 11(B) in the storage 114 as the branch name. In addition, the CPU 111 stores the characters selected on the screen of Fig. 12(A) in the storage 114 as the account type. Furthermore, CPU 111 stores the characters selected on the screen of Fig. 12(B) as an account number in storage 114. CPU 111 stores the characters selected on the screen of Fig. 12(C) as a transfer amount in storage 114. The back buttons on the screens of Figs. 11(A) to (B) and Figs. 12(A) to (C) are buttons for returning the display to the previous screen.

[0074] To cancel the transfer process, press and hold "Back" until the transfer process interruption confirmation screen in Fig. 13 is displayed, and in S1006, if "Yes" is selected on the screen in Fig. 13, the transfer process is canceled and the process ends. If "No" is selected on the screen in Fig. 13, the screen in Fig. 11(A) is displayed.

[0075] In S1008, the CPU 111 determines whether or not the selection of items is complete. If the Confirm button in Fig. 11(A) to Fig. 11(B) and Fig. 12(C) is selected, the CPU 111 determines that the selection of items is not complete and advances the process to S1005. On the other hand, if the Confirm button in Fig. 12(C) is selected, the CPU 111 determines that the selection of items is complete and advances the process to S1010.

[0076] In S1010, the CPU 111 causes the operation unit 116 to display the confirmation screen of FIG.

[0077] In S1011, CPU 111 judges whether the transfer process has been permitted or canceled. If the Confirm button is selected on the confirmation screen of Fig. 14, CPU 111 judges that the transfer process has been permitted, and proceeds to S1012. On the other hand, if the Cancel button is pressed on the screen of Fig. 14, CPU 111 judges that the transfer process has been canceled, and ends the process without carrying out the transfer process.

[0078] In S1012, the CPU 111 executes the transfer process shown in Fig. 15. The details of the transfer process will be described later with reference to Fig. 15.

[0079] In S1013, CPU 111 determines whether or not the transfer process has been completed normally. If it is determined that the transfer process has been completed normally, CPU 111 advances the process to S1014. On the other hand, if it is determined that the transfer process has not been completed normally, CPU 111 ends the process. If the transfer process has not been completed normally, CPU 111 may cause operation unit 116 to display an error screen notifying that effect. For example, if the authentication process has failed, CPU 111 may cause operation unit 116 to display an authentication process failure screen (FIG. 18(A)) shown in FIG. 18(A), and if there is no corresponding transfer destination, CPU 111 may cause operation unit 116 to display an incomplete transfer destination information screen shown in FIG. 18(B).

[0080] In S1014, CPU 111 causes operation unit 116 to display the transfer information registration screen shown in FIG.

[0081] In S1015, CPU 111 determines whether or not the user has instructed to register transfer information. If the "Yes" button is selected on the transfer information registration screen, CPU 111 determines that the user has instructed to register transfer information, and proceeds to S1016. On the other hand, if the "No" button is selected on the transfer information registration screen, CPU 111 determines that the user has not instructed to register transfer information, and CPU 111 ends the process.

[0082] In S1016, CPU 111 executes a transfer destination registration process. Specifically, CPU 111 displays a screen shown in FIG. 16(B) on operation unit 116. The user inputs a registration name via the screen of FIG. 16(B) using a software keyboard (not shown). Then, when the "Yes" button in FIG. 16(B) is selected, CPU 111 stores the registration name, bank name, branch name, account type, account number and the position of each character string, and the position of the character string of the transfer amount in storage 114 as transfer information. Thereby, when the home screen is displayed next time, CPU 111 displays shortcut button 1701 on operation unit 116 based on the information stored in storage 114 (displays an object). On the other hand, when the "No" button is selected on the screen of FIG. 16(A), the transfer information is not registered and the process ends as it is.

[0083] Figure 15 shows the flow of the transfer process.

[0084] When the user selects the Confirm button on the transfer confirmation screen of Fig. 14 in S1501, the image forming apparatus 101 notifies the bank service resource server 105 of a transfer instruction including an access token and transfer information in S1502. Note that this access token is the access token stored in advance in the processing of Fig. 7. Also, the transfer information is the text information selected in each of Figs. 11(A) to 11(B) and Figs. 12(A) to 12(C).

[0085] In S1503, the bank service resource server 105 extracts the access token from the transfer instruction, and queries the bank service API authorization server 104 for information about the access token.

[0086] In S1504, the bank service API authorization server 104 returns information about the received access token to the bank service resource server 105.

[0087] In S1505, the bank service resource server 105 checks the validity of the received access token based on the information. If the access token is valid, the bank service resource server 105 performs the transfer process. On the other hand, if the access token is invalid, the bank service resource server 105 does not perform the transfer process.

[0088] In S1506, the bank service resource server 105 notifies the image forming apparatus 101 of the result of the transfer process.

[0089] In S1507, the CPU 111 of the image forming apparatus 101 causes the operation unit 116 to display the result of the transfer process notified by the bank service resource server 105.

[0090] Fig. 20 shows the process when shortcut icon 1701 of the registered transfer process in Fig. 17 is selected. The process shown in Fig. 20 is realized by CPU 111 reading a program stored in ROM 112 into RAM 113 and executing it.

[0091] An example of a bill set in the reading unit 118 is shown in FIG.

[0092] When the registered shortcut icon 1701 for the transfer process is selected, in S2001, the CPU 111 causes the reading unit 116 to read the invoice.

[0093] After the invoice image data generated by reading the invoice is stored in the RAM 113, in S2002 the CPU 111 executes OCR and text object extraction processing on the invoice image data. The details of the OCR and text object extraction processing are the same as those described in S1003 of FIG. 9.

[0094] In S2003, the CPU 111 acquires the bank account information linked to the shortcut icon 1701 stored in the storage 114 and character position information of the bank account information.

[0095] In S2004, the CPU 111 compares character information generated by reading characters at positions indicated in the character position information of the bank account information with character information of the bank account registered in the shortcut.

[0096] In S2005, CPU 111 determines whether or not the character information generated by reading the characters at the positions indicated in the character position information of the bank account information is the same as the character information of the bank account registered in the shortcut, as a result of the comparison of the character information.

[0097] If it is determined that they are the same, the CPU 111 advances the process to S2007. On the other hand, if it is determined that they are not the same, the CPU 111 advances the process to S2006.

[0098] In S2007, the CPU 111 causes the operation unit 116 to display the transfer amount.

[0099] In S2006, the CPU 111 accepts corrections to the bank account information by the user in a bank account information user verification process.

[0100] In S2007, CPU 111 causes the transfer information amount display screen shown in Fig. 21 to be displayed on operation unit 116, and asks the user to confirm whether or not to carry out the transfer. In S2008, if the user presses "Confirm" on the transfer information amount display screen, CPU 111 carries out the transfer process of Fig. 15. On the other hand, if the user presses "Cancel" on the transfer information amount display screen, CPU 111 interrupts and ends the process.

[0101] FIG. 22 shows the bank account information user verification process in S2006 of the transfer process shown in FIG.

[0102] In S2201, the CPU 111 extracts a portion where an inconsistency occurs between the registered information and the extracted text object.

[0103] In S2202, the CPU 111 causes the operation unit 116 to display an inconsistency part display screen (FIG. 23) regarding the part where the inconsistency has occurred.

[0104] In FIG. 23, the bank name is displayed as an example, but if there are differences in other branch names or bank account numbers, the screen will be displayed in the same way.

[0105] In S2203, the CPU 111 determines whether or not the cancel button has been pressed on the inconsistency part display screen in Fig. 23. If the cancel button has been pressed, the CPU 111 ends the bank account information reselection process and the transfer process.

[0106] On the other hand, if the confirm button is pressed on the mismatch part display screen, the CPU 111 advances the process to step S2204.

[0107] If CPU 111 determines in S2204 that checking of all inconsistencies has been completed, it ends the process and returns to the transfer process. If there are any unchecked inconsistencies, CPU 111 advances the process to S2202 and causes operation unit 116 to display an inconsistency display screen showing other inconsistencies.

[0108] According to this embodiment, a document is read, and from the results obtained by character recognition processing, transfer destination information regarding the transfer destination and the transfer amount can be identified, and the transfer process can be carried out.

[0109] In addition, text information and the location of the text information are also obtained from the image data of the invoice. The obtained text information can then be used to transfer funds using the WebAPI and registered in shortcuts, allowing the transfer information to be reused.

[0110] In addition, by comparing the information registered in the shortcut with the text information in the scanned image data, it is possible to determine whether there are any differences from the format at the time the invoice was registered, thereby preventing transfer errors.

[0111] In particular, in recent years, services that use the Internet to transfer funds have been available, but by using a Web API, transfer and transfer processing can be performed without going through a web browser. Unlike transfers via ATM networks or a web browser, with the Web API, the name of the account holder of the transfer destination cannot be obtained even if the financial institution name, branch name, and account number are notified. In addition, the name of the account holder of the transfer destination linked to the financial institution name and account number stored in the host computer of the financial institution cannot be obtained. Therefore, if the financial institution name, branch name, subject, and account number are incorrect, the transfer destination will be transferred to the wrong destination. In addition, the positions of the financial institution name, branch name, subject, and account number written on a general invoice, etc., are not constant, unlike in an account transfer request form, because they depend on the format of the invoice issuer. Therefore, every time an invoice is received, it is necessary to check and enter the financial institution name, branch name, subject, account number, and amount billed before transferring. However, according to this embodiment, character information such as the transfer destination and position information of the character information are also obtained from the image data of the original document such as the invoice. Then, by performing a transfer using the obtained character information as the transfer destination with the WebAPI and registering it in a shortcut, the transfer destination information can be reused. In addition, by comparing the information registered in the shortcut with the text information in the scanned image data, it is possible to determine whether there are any differences from the format at the time the invoice was registered, thereby preventing transfer errors.

[0112] (Other embodiments) In this embodiment, the image forming apparatus 101 executes each process shown in the flowcharts described later using one CPU 111 and one memory (RAM 113), but other configurations are also possible. For example, each process shown in the flowcharts described later can be executed by using multiple CPUs, RAMs, ROMs, and storages in cooperation with each other. Also, some of the processes can be executed using hardware circuits such as ASICs and FPGAs.

[0113] The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions. [Explanation of symbols]

[0114] 111 CPU 112 ROM 113 RAM 114 Storage 116 Operation section 118 Reading unit 123 Communication I / F

Claims

1. A reading means for reading a document; a processing means for executing a character recognition process for the image of the document read by the reading means; A determination means for determining transfer destination information and a transfer amount from the results obtained by the character recognition process executed by the processing means; a transmission means for transmitting the transfer destination information regarding the transfer destination specified by the specification means and the transfer amount; a storage means for storing the transfer destination information on the transfer destination transmitted by the transmission means and position information indicating the position where the transfer destination information is obtained by character recognition processing; a display means for displaying an object for calling up the transfer destination information relating to the transfer destination stored in the storage means, when the object displayed by the display means is selected, a new document is read by the reading means, and when transfer destination information regarding a new transfer destination obtained by the character recognition process from the position indicated by the position information of the image of the read document coincides with transfer destination information regarding the transfer destination stored in the storage means, a new transfer amount based on the new document is displayed on the display means; An image processing device characterized in that, when the object displayed by the display means is selected, a new original document is read by the reading means, and if the transfer destination information regarding a new transfer destination obtained by the character recognition processing from the position indicated by the position information of the image of the read original document does not match the transfer destination information regarding the transfer destination stored in the storage means, at least a portion of the image of the new original document read by the reading means is displayed on the display means in a state in which the area subjected to the character recognition processing can be identified by the user.

2. The display means further displays a result obtained by the character recognition process executed by the processing means, 2. The image processing device according to claim 1, wherein after displaying the result by the display means, the transmission means transmits the transfer destination information regarding the transfer destination specified by the specification means and the transfer amount.

3. The system further comprises a reception means for receiving from a user a selection of transfer destination information regarding the transfer destination and the transfer amount from the results displayed by the display means, 3. The image processing apparatus according to claim 2, wherein the specifying means specifies transfer destination information relating to the transfer destination and the transfer amount based on the selection accepted by the accepting means.

4. 4. The image processing apparatus according to claim 1, further comprising a registration unit for registering transfer destination information relating to the transfer destination and authentication information of a server of the transfer destination to which the transmission unit transmits the transfer amount.

5. 5. The image processing device according to claim 1, wherein the transfer destination information on the transfer destination includes a bank name.

6. 6. The image processing device according to claim 1, wherein the transfer destination information on the transfer destination includes an account type.

7. 6. The image processing device according to claim 1, wherein the transfer destination information on the transfer destination includes an account number.

8. a reading step of reading a manuscript; a processing step of executing a character recognition process for the image of the document read in the reading step; a step of identifying information on the transfer destination and the amount to be transferred from the results of the character recognition process executed in the processing step; a transmission step of transmitting the transfer destination information regarding the transfer destination identified in the identification step and the transfer amount; a storage step of storing the transfer destination information regarding the transfer destination transmitted in the transmission step and position information indicating the position where the transfer destination information was obtained by character recognition processing; a display step of displaying an object for calling up the transfer destination information related to the transfer destination stored in the storage step, when the object displayed in the display step is selected, a new document is read in the reading step, and when transfer destination information relating to a new transfer destination obtained by the character recognition process from the position indicated by the position information of the image of the read document coincides with transfer destination information relating to the transfer destination stored in the storage step, a new transfer amount based on the new document is displayed; A control method for an image processing device, characterized in that when the object displayed in the display process is selected, a new document is read in the reading process, and if transfer destination information regarding a new transfer destination obtained by the character recognition process from the position indicated by the position information of the image of the read document does not match the transfer destination information regarding the transfer destination stored in the storage process, at least a portion of the image of the new document read in the reading process is displayed in a state in which the area subjected to the character recognition process can be identified by a user.

9. 9. A program for causing a computer to execute the control method for an image processing apparatus according to claim 8.

Images