Information processing device and information processing program

Abstract

To provide an information processing device capable of correcting setting information, when there is a defect in an extract or output processing result of the character string that is the operation step of the target image, without displaying a screen in a setting step on a screen separate from the operation step, and an information processing program.SOLUTION: An information processing device in a first embodiment has a processor. The processor acquires an extract result in which a character string is extracted from a target image of a document read from a target image or an output result based on the extract result to be output to the outside by using setting information that is a piece of information that is set to extract a string from an image. A first screen for displaying the extract result or output result and for receiving instructions to correct the setting information is displayed, and when receiving the instructions, a second screen is displayed for allowing a correction of the setting information related to the target image.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to an information processing device and an information processing program. [Background technology]

[0002] Patent Document 1 discloses a reading position information correction system that outputs reading position information required for character reading to an optical character reading device that reads and recognizes characters written on the surface of a document and corrects the reading position information based on the character reading and recognition results in the device, the system including a display means that displays image data of the document, a correction means that corrects the reading position information in response to external input, and a display control means that displays the character reading and recognition results performed by the optical character reading device in accordance with the corrected reading position information on a display screen of the display means. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 10-334182 Summary of the Invention [Problem to be solved by the invention]

[0004] In the case of using character recognition processing (OCR: Optical Character Recognition) to extract a character string from an image and output it to the outside, a service is provided in which information previously set for each document (hereinafter referred to as "setting information") is used to extract the character string from an image obtained by scanning the document and output it to the outside. In this service, in a setting process for setting, a process is performed to set setting information for extracting a character string from an image for each document and outputting it to the outside. Also, in an operation process for extracting a character string from a target image, which is an image of a filled-out form, and outputting it to the outside, a process is performed to extract the character string from the target image and output it to the outside using the setting information.

[0005] In the operation process, if a character string could not be properly extracted or output from a target image due to an error in the setting information, the operation process was interrupted, and the screen for the setting process was displayed on a screen separate from the operation process, and the setting information was corrected.

[0006] The present invention aims to provide an information processing device and an information processing program that can correct setting information when there is an error in the results of the string extraction or output process, which is the operation process of the target image, without displaying a screen for the setting process on a screen separate from the screen for the operation process. [Means for solving the problem]

[0007] The information processing device of the first aspect has a processor, and the processor uses setting information, which is information set for extracting character strings from an image, to obtain an extraction result of extracting character strings from a target image obtained by reading a document, or an output result based on the extraction result to be output to the outside, and displays the extraction result or the output result, as well as a first screen that accepts instructions to modify the setting information, and when an instruction is accepted, displays a second screen that allows the setting information related to the target image to be modified.

[0008] In a second aspect of the information processing device, in the information processing device relating to the first aspect, when a processor receives a modification of the setting information on the second screen, the processor uses the modified setting information to display the extracted results or the output results on the first screen.

[0009] In a third aspect of the information processing device, in an information processing device relating to the first or second aspect, a processor displays setting information relating to a target image on a second screen, and also displays the target image and accepts modifications to the setting information.

[0010] An information processing device of a fourth aspect is an information processing device relating to any one of the first to third aspects, in which the processor displays a second screen when an image element that indicates correction and is displayed on the first screen is specified.

[0011] An information processing device of a fifth aspect is an information processing device of the fourth aspect, wherein the first screen is a plurality of screens according to operation, the second screen is a plurality of screens according to settings, the plurality of screens related to the first screen are respectively associated with the plurality of screens related to the second screen, and when an image element displayed on the first screen is specified, the processor displays the corresponding second screen.

[0012] An information processing device of a sixth aspect is an information processing device relating to any one of the first to fifth aspects, in which the setting information includes information relating to the range from which a character string is extracted, and when the range of the character string included in the target image is wider than the range from which the character string is extracted in the setting information, the processor displays on the first screen a message prompting the user to modify the setting information.

[0013] An information processing device of a seventh aspect is the information processing device according to any one of the first to sixth aspects, in which the processor displays a suggestion regarding modification of the setting information.

[0014] An information processing device of an eighth aspect is an information processing device according to the seventh aspect, in which when the processor corrects the range from which to extract a character string in the setting information, the processor displays on the second screen the range in which the character string included in the target image fits.

[0015] An information processing device of a ninth aspect is an information processing device according to the seventh aspect, wherein the target image includes a plurality of related character strings, the setting information includes information relating to a dictionary for identifying the character strings, and when the processor is unable to identify one of the plurality of related character strings, it uses the results of extracting other character strings to estimate a dictionary for identifying the one character string and displays the dictionary on the second screen.

[0016] The information processing program of the tenth aspect causes a computer to obtain an extraction result of extracting a character string from a target image obtained by reading a document using setting information, which is information set for extracting a character string from an image, or an output result based on the extraction result to be output to the outside, and to display the extraction result or the output result, as well as displaying a first screen that accepts instructions to modify the setting information, and when the instruction is accepted, displaying a second screen that allows the setting information related to the target image to be modified. Effect of the Invention

[0017] According to the information processing device of the first aspect and the information processing program of the tenth aspect, if there is an error in the result of the string extraction or output process, which is the operation process of the target image, the setting information can be corrected without displaying the screen for the setting process on a screen separate from the screen for the operation process.

[0018] According to the information processing device of the second aspect, it is possible to confirm the extraction result that reflects the corrected setting information.

[0019] According to the information processing device of the third aspect, it is possible to correct the setting information by referring to the target image that has already been subjected to the extraction process.

[0020] According to the information processing device of the fourth aspect, the setting information can be corrected at a time desired by the user.

[0021] According to the information processing device of the fifth aspect, the user can modify the setting information to a desired setting.

[0022] According to the information processing device of the sixth aspect, it is possible to recognize that there is an inadequacy in the setting of the range from which a character string is extracted in the setting information.

[0023] According to the information processing device of the seventh aspect, it is possible to recognize that there is a defect in the setting information.

[0024] According to the information processing device of the eighth aspect, it is possible to recognize the range in the target image from which a character string can be extracted.

[0025] According to the information processing device of the ninth aspect, it is possible to recognize that there is a defect in the settings of a dictionary for extracting a character string in the setting information. [Brief description of the drawings]

[0026] [Figure 1] 1 is a block diagram showing an example of a schematic configuration of a form system according to an embodiment of the present invention; [Diagram 2] 1 is a block diagram showing an example of a hardware configuration of an information processing device according to an embodiment of the present invention. [Diagram 3] 2 is a block diagram showing an example of a functional configuration of the information processing device according to the present embodiment. FIG. [Figure 4] 5A to 5C are screen transition diagrams showing an example of transition to each screen according to the present embodiment. [Diagram 5] FIG. 13 is a front view showing an example of a document discrimination screen according to the embodiment. [Figure 6] FIG. 13 is a front view showing an example of a confirmation and correction screen according to the embodiment. [Figure 7] FIG. 13 is a front view showing an example of an output confirmation screen according to the embodiment. [Figure 8] 13 is a front view showing an example of a setting verification screen according to the embodiment. FIG. [Figure 9] FIG. 13 is a front view showing an example of a reading setting screen according to the embodiment. [Figure 10] FIG. 4 is a front view showing an example of an output setting screen according to the embodiment. [Figure 11] 10 is a flowchart showing an example of a process flow for controlling a screen transition according to the embodiment. [Figure 12] 10 is a flowchart showing an example of a process flow for displaying a screen related to an operational function according to the present embodiment. [Figure 13] 10 is a flowchart showing an example of a process flow for displaying a screen relating to a setting function according to the present embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0027] Hereinafter, with reference to the drawings, an embodiment for carrying out the present invention will be described in detail. In this embodiment, a form in which a screen transition is made from an arbitrary screen to another screen while continuing a series of processes of the same application will be described. However, the present invention is not limited to this. For example, by pressing a tab displayed on a screen, a screen with switched display contents may be displayed to continue the process, or a small screen may be displayed together with the displayed screen to continue the process. In other words, the arbitrary screen and the other screen are screens having a dependency relationship in a series of processes of the same application. In other words, the other screen does not include a screen that can be displayed independently without dependency on the screen related to the series of processes, such as a screen related to a different application or a screen that can be displayed at an arbitrary opportunity independent of the series of processes. On the other hand, the other screen refers to a screen that can be displayed independently without dependency on the screen related to the series of processes, such as a screen related to a different application or a screen that can be displayed at an arbitrary opportunity independent of the series of processes.

[0028] Fig. 1 is a diagram showing a schematic configuration of a form system 10 according to the present embodiment. As shown in Fig. 1, the form system 10 includes an information processing device 20, a client terminal 40, and an input device 60. These devices are connected to a network (not shown) and can communicate with each other via the network. As an example of this network, the Internet, a LAN (Local Area Network), a WAN (Wide Area Network), etc. are applied.

[0029] The information processing device 20 performs OCR (Optical Character Recognition) processing on image data of multiple documents including forms input through the input device 60, and manages a series of processing flows for outputting the results of the OCR processing to a predetermined output destination. Here, the image data according to this embodiment may be any image data as long as it is an image related to a document including character strings such as an invoice, application form, receipt, etc. The specific configuration and operation of the information processing device 20 will be described later.

[0030] The client terminal 40 transmits various instructions related to the OCR process to the information processing device 20. The various instructions include, for example, an instruction to start reading information of image data, an instruction to display the result of reading information of image data, and the like. The client terminal 40 also displays various information such as the result of the OCR process performed by the information processing device 20 in response to the various received instructions, and notifications related to the OCR process. For example, the client terminal 40 is a general-purpose computer device such as a server computer or a personal computer (PC). Although only one client terminal 40 is illustrated in FIG. 1, this is not limiting, and multiple client terminals 40 may be prepared and, for example, each client terminal 40 may be used for different processes.

[0031] The input device 60 inputs image data to be subjected to OCR processing to the information processing device 20. Examples of the input device 60 include a general-purpose computer device such as a server computer or a PC, and an image forming device having a scanning function, a printer function, a FAX function, etc. In addition to the input device 60, image data may also be input to the information processing device 20 from the client terminal 40.

[0032] Next, an overview of the form system 10 will be described. The form system 10 is a system in which an information processing device 20 performs OCR processing on image data input via an input device 60, and outputs the result of the OCR processing to a predetermined output destination.

[0033] In the OCR process, the information processing device 20 manages various processes, including (1) business design and operation verification, (2) data input, (3) data reading, (4) form discrimination, confirmation and correction, (5) reading result confirmation and correction, (6) business check, (7) data output, and (8) return. In this embodiment, the OCR process refers not only to the process of simply reading characters and symbols from image data, but also to post-processing such as character correction.

[0034] As an example of the management of various processes, (1) business design and operation verification, (2) data input, (3) data reading, (6) business check, and (7) data output processes are each automatically executed by the information processing device 20. Also, as an example of the management of various processes, (4) document discrimination, confirmation, and correction, and (5) reading result confirmation and correction processes are each accepted by input by the user via the client terminal 40. Also, as an example of the management of various processes, (8) return process may be automatically executed by the information processing device 20 or may be accepted by input by the user via the client terminal 40.

[0035] In the (1) business design and operation verification process, a job rule including a read definition setting, an output setting, and a business check setting is created. In the read definition setting, as an example, a read range is set, which is the range in which image data information is read in the process of "(3) data reading". More specifically, as an example, a definition may be set such that an item value, which is a value, is read from the right vicinity of an item extracted as a key. In the output setting, as an example, a file format and an output destination of the output data output in the process of "(7) data output". In the business check setting, as an example, a format such as a required input item in a form to be detected in the process of "(6) business check" and the number of characters that can be input is set. Here, the read range according to this embodiment is an example of an "extraction range".

[0036] In the process of (2) data input, image data is accepted as input from the input device 60. The accepted input image data is registered as a job, which is an execution unit of the process of "(3) data reading."

[0037] (3) In the data reading process, the information of the image data in the job is read using a job rule for the job to be executed, selected by the user from the job rules created in the process of "(1) Business Design and Operation Verification." As an example, in this process, the form included in the image data in the job is identified (hereinafter referred to as "form identification") and characters and symbols within the reading range are read.

[0038] In the (4) form identification, confirmation, and correction process, the image data in the job is divided into records that indicate the forms included in the job based on the results of the form identification performed in the "(3) Data Reading" process. After that, in this process, the divided records are displayed, and the user can confirm and correct the form identification.

[0039] In the process of (5) checking and correcting the read result, the read result of the characters and symbols within the read range performed in the process of "(3) reading data" is displayed, and the user can check and correct the read result.

[0040] In the (6) task check process, errors in each preceding process are detected by the task check setting included in the job rule for the job selected by the user from among the job rules created in the process of "(1) Task design and operation verification." The detection results may be presented to the user.

[0041] (7) In the data output process, output data is created using the output settings included in the job rules for the job selected by the user from the job rules created in the process of "(1) Business design and operational verification," and the created output data is output to a predetermined output destination.

[0042] In the (8) return process, the process executed in the OCR process is returned to the process one or more steps before. As an example, the return is instructed by the user from the client terminal 40 during the execution of various processes such as "(4) Document discrimination, confirmation, and correction" and "(5) Read result confirmation and correction." Also, as an example, the return is instructed from the client terminal 40 of the administrator depending on the result of the check by the administrator performed between the processes of "(6) Business check" and "(7) Data output."

[0043] In the above OCR processing, the process of "(1) business design and operation verification" is executed before the processes after "(3) data reading" are performed, i.e., before the form system 10 is put into operation. Furthermore, the process of "(1) business design and operation verification" may be executed during the operation of the form system 10, when the processes after "(3) data reading" are being performed. As an example, the job rules created in the process of "(1) business design and operation verification" before the form system 10 is put into operation can be appropriately modified according to the results of the process of "(5) checking and correcting the reading results" of the form system 10 in operation.

[0044] Next, the configuration of the information processing device 20 will be described with reference to Fig. 2. Fig. 2 is a block diagram showing an example of a hardware configuration of the information processing device 20 according to the present embodiment. As an example, the information processing device 20 according to the present embodiment will be described as a terminal such as a personal computer, or a server. However, the present embodiment is not limited to this. The information processing device 20 may be mounted on an image forming device such as a multifunction peripheral.

[0045] 2, the information processing device 20 according to this embodiment includes a CPU (Central Processing Unit) 21, a ROM (Read Only Memory) 22, a RAM (Random Access Memory) 23, a storage 24, an input unit 25, a monitor 26, and a communication interface (communication I / F) 27. The CPU 21, the ROM 22, the RAM 23, the storage 24, the input unit 25, the monitor 26, and the communication I / F 27 are each connected to one another by a bus 28. Here, the CPU 21 is an example of a processor.

[0046] The CPU 21 supervises and controls the entire information processing device 20. The ROM 22 stores various programs including the information processing program used in this embodiment, data, and the like. The RAM 23 is a memory used as a work area when various programs are executed. The CPU 21 performs processing to display each image and character string by expanding the program stored in the ROM 22 into the RAM 23 and executing it. The storage 24 is, for example, a hard disk drive (HDD), a solid state drive (SSD), or a flash memory. The storage 24 may store the information processing program, and the like. The input unit 25 is a mouse and a keyboard that accepts character input, and the like. The monitor 26 displays each screen. The communication I / F 27 transmits and receives data.

[0047] Next, the functional configuration of the information processing device 20 will be described with reference to Fig. 3. Fig. 3 is a block diagram showing an example of the functional configuration of the information processing device 20 according to this embodiment.

[0048] 3, the information processing device 20 has, as functional components, an acquisition unit 81, a reading unit 82, a display unit 83, a reception unit 84, a storage unit 85, and an estimation unit 86. The CPU 21 executes an information processing program to function as the acquisition unit 81, the reading unit 82, the display unit 83, the reception unit 84, the storage unit 85, and the estimation unit 86.

[0049] The acquisition unit 81 acquires image data obtained by reading a document.

[0050] The reading unit 82 obtains a reading result, which is a result of reading a character string included in the acquired image data using OCR processing. Here, the reading result according to this embodiment is a result of reading a character string included in the image data and extracting the read character string as a character code, and the reading result according to this embodiment is an example of an "extraction result". The reading unit 82 according to this embodiment obtains a reading result by reading a character string from the image data using information on settings for reading a character string from the image data (hereinafter referred to as "setting information") stored in the storage unit 85 described later. Note that the setting information according to this embodiment is a reading setting including a form layout that sets items related to the document and the arrangement of the character string, a reading range that sets a range for reading the character string from the image data, and a dictionary that sets candidates for identifying the character string read from the image data as a character code, and an output setting that sets a format for outputting the reading result, etc., will be described.

[0051] The display unit 83 displays the image data and the read results (hereinafter referred to as "read data") on a screen. The display unit 83 also displays a screen for correcting setting information. Note that the read data according to this embodiment has been described as being image data and the read results. However, this is not limited to this. The read data may include a job name indicating the name of the read data, the operation date and time when corrections and modifications were made, and the registration date and time registered in the information processing device 20.

[0052] The reception unit 84 receives an instruction to display each screen, and corrected read data and setting information. As shown in FIG. 4 as an example, the screens according to this embodiment include a form discrimination screen 100, a confirmation and correction screen 120, and an output confirmation screen 140 as operation functions, and a setting verification screen 160, a read setting screen 180, and an output setting screen 200 as setting functions. The operation functions are functions for confirming and outputting read data read from image data. The operation functions correspond to "(4) Form discrimination confirmation and correction", "(5) Read result confirmation and correction", and checks by an administrator performed between the processes of "(6) Business check" and "(7) Data output" in FIG. 1. The setting function is a function for accepting corrections to setting information. The setting function corresponds to the read definition setting and output setting of "(1) Business design and operation verification" in FIG. 1.

[0053] As an example, as shown in Fig. 4, each screen related to the operation function and the setting function has a button for transitioning to another screen, and accepts an instruction to transition to another screen, confirmation and correction of read data, and modification of setting information. Here, the button for transitioning to another screen is an example of an "image element."

[0054] 4 has a setting information correction button, and pressing the setting information correction button transitions to a setting verification screen 160. For example, pressing the setting information correction button on the document discrimination screen 100 transitions to the setting verification screen 160, which displays the read data currently being read and the setting information related to the read data, and accepts corrections to the setting information.

[0055] Furthermore, since the confirmation and correction screen 120 has a read setting correction button, and the output confirmation screen 140 has an output setting correction button, it is possible to transition to a screen that accepts correction of each setting in the setting function according to the contents displayed on each screen of the operation function. Note that in this embodiment, a form has been described in which the screens related to the operation function have buttons respectively corresponding to the screens related to the setting function. However, this is not limited to this. When the setting information correction button is pressed, it is also possible to transition to each screen related to the setting function that corresponds to the screen related to the operation function.

[0056] In addition, when the screen for each operation function is displayed after accepting the modification of each setting on each screen for the setting function shown in Fig. 4, the read data reflecting the modified setting information is displayed. Each screen will be described in detail later with reference to Figs. 5 to 10.

[0057] The storage unit 85 shown in Fig. 3 stores the read data and the setting information in association with each other. The storage unit 85 according to this embodiment stores information related to items related to image data as setting information. Information related to items is, for example, information that belongs to the same subject, such as the item "billing source name" and the item "billing source address". Furthermore, a character string according to this embodiment is the content written for an item such as "XX ward, Tokyo".

[0058] When the estimation unit 86 cannot read a character string from the image data, it estimates a dictionary for identifying the character string as a character code by using the item to which the character string belongs and information related between the items. When the estimated dictionary differs from the dictionary related to the item set in the setting information, the estimation unit 86 prompts the user to change the dictionary and presents the estimated dictionary as a candidate. For example, when the estimation unit 86 cannot read the character string "XX ward, Tokyo", it estimates a dictionary by using setting information set in "billing address" indicating the item of the character string and "billing name" related to the item.

[0059] In addition, the estimation unit 86 uses the character strings related to the read data to estimate the range in which each character string related to the image data falls, and if the range of the estimated character strings is wider than the read range set in the configuration information, presents the estimated range of the character strings as a candidate for the range of the character strings to be corrected.

[0060] Here, the estimation unit 86 may be a learning device that has performed machine learning to estimate a dictionary and a range of a character string. For example, the estimation unit 86 may be a learning device that has learned a dictionary for identifying a character string from an input item and information related to the item, and may input an item in which a character string could not be read and information related to the item to estimate a dictionary for identifying a character string related to the item. The estimation unit 86 may also be a learning device that has learned a range of a character string from an input character string, and may input a character string read from image data to estimate the range of the character string.

[0061] Next, before describing the operation of the information processing device 20, each screen displayed according to this embodiment will be described with reference to Fig. 5 to Fig. 10. First, each screen related to the operation function will be described with reference to Fig. 5 to Fig. 7. Fig. 5 is a front view showing an example of a form discrimination screen according to this embodiment.

[0062] 5, the form discrimination screen 100 has a discrimination image display area 101, a confirm / correct button 102, and a setting information correction button 103. The discrimination image display area 101 classifies image data read using the form layout settings set in the setting information by document and displays it in the discrimination image display area 101. The confirm / correct button 102 is a button for sending an instruction to transition to a confirmation / correction screen 120, and the setting information correction button 103 is a button for sending an instruction to transition to a setting verification screen 160.

[0063] For example, the form discrimination screen 100 transitions to a confirmation and correction screen 120 when the user checks the classification status of the documents displayed in the discrimination image display area 101 and presses a confirmation and correction button 102. Also, if the user checks the classification status of the documents and wishes to change the form layout, the user can press a setting information correction button 103 to transition to a setting verification screen 160 where the settings in the form layout can be corrected.

[0064] Next, the confirmation and correction screen 120 will be described with reference to Fig. 6. Fig. 6 is a front view showing an example of the confirmation and correction screen according to the present embodiment.

[0065] 6, the confirmation and correction screen 120 has an image display area 121, a read result display area 122, a form discrimination button 123, an output confirmation button 124, a setting information correction button 125, and a read setting correction button 126. The image display area 121 displays image data related to the read data, and the read result display area 122 displays the read result related to the read data. The form discrimination button 123 is a button for transmitting an instruction to transition to the form discrimination screen 100, and the output confirmation button 124 is a button for transmitting an instruction to transition to the output confirmation screen 140. The setting information correction button 125 is a button for transmitting an instruction to transition to the setting verification screen 160, and the read setting correction button 126 is a button for transmitting an instruction to transition to the read setting screen 180.

[0066] For example, the confirmation / correction screen 120 transitions to an output confirmation screen 140 when an output confirmation button 124 is pressed, and transitions to a form discrimination screen 100 when a form discrimination button 123 is pressed. If the user wishes to change the settings in the form layout, the setting information correction button 125 is pressed to transition to a setting verification screen 160. If the user wishes to change the settings for reading character strings from image data, the read setting correction button 126 is pressed to transition to a read setting screen 180.

[0067] Furthermore, the confirmation and correction screen 120 estimates the range of a character string from a character string read from the image data, and if the estimated range of the character string exceeds the reading range set in the setting information, displays a message 127 urging the user to correct the setting information. In other words, if the confirmation and correction screen 120 detects that there is an error in the range of a character string set in the setting information, it notifies the user to correct the setting information.

[0068] Next, the output confirmation screen 140 will be described with reference to Fig. 7. Fig. 7 is a front view showing an example of the output confirmation screen 140 according to the present embodiment.

[0069] 7, the output confirmation screen 140 has an output item display area 141, a confirm and correct button 142, a setting information correction button 143, an output setting correction button 144, and an output button 145. The output item display area 141 displays the read result for each item related to the read data, and the confirm and correct button 142 is a button for transmitting an instruction to transition to the confirmation and correction screen 120. The setting information correction button 143 is a button for transmitting an instruction to transition to the setting verification screen 160, and the output setting correction button 144 is a button for transmitting an instruction to transition to the output setting screen 200. The output button 145 is a button for outputting the read result and transmitting an instruction to end the screen display process.

[0070] For example, the output confirmation screen 140 outputs the reading results displayed on the output confirmation screen 140 when the user checks the output item display area 141 and presses the output button 145. Also, when the user checks the output item display area 141 and desires to change the settings of the items to be output and the output order of the items, the output confirmation screen 140 transitions to the output setting screen 200 by pressing the output setting correction button 144.

[0071] Next, each screen relating to the setting function will be described with reference to Fig. 8 to Fig. 10. Fig. 8 is a front view showing an example of a setting verification screen 160 according to this embodiment.

[0072] As shown in FIG. 8, the setting verification screen 160 has an image display area 161, a read data display area 162, a form layout change button 163, and a read setting correction button 164. The setting verification screen 160 also has an OCR execution button 165, a form discrimination button 166, a check and correction button 167, and an output confirmation button 168. The image display area 161 displays image data related to the read data, and the read data display area 162 displays the job name and registration date and time related to the read data. The form layout change button 163 is a button for accepting a change of the form layout set to read the image data related to the read data, and the read setting correction button 164 is a button for transmitting an instruction to transition to the read setting screen 180. The OCR execution button 165 is a button for re-executing the OCR process and transmitting an instruction to transition to the form discrimination screen 100, and the form discrimination button 166 is a button for transmitting an instruction to transition to the form discrimination screen 100. The confirmation and correction button 167 is a button for transmitting an instruction to transition to the confirmation and correction screen 120 , and the output confirmation button 168 is a button for transmitting an instruction to transition to the output confirmation screen 140 .

[0073] For example, if the document classification cannot be performed normally on the document discrimination screen 100, the screen transitions to a setting verification screen 160 shown in Fig. 8, and the setting verification screen 160 accepts corrections to the settings of the document layout for classifying the document related to the image data. Specifically, the form layout change button 163 shown in Fig. 8 is pressed to select the document layout related to the image data, whereby the corrections are accepted.

[0074] Furthermore, when the OCR execution button 165, the form discrimination button 166, the confirmation and correction button 167, or the output confirmation button 168 is pressed, the setting verification screen 160 acquires read data reflecting the correction of the setting information and transitions to each screen related to the operational function. For example, when the form layout is corrected, the setting verification screen 160 executes OCR processing reflecting the correction of the form layout by pressing the OCR execution button 165, and transitions to the form discrimination screen 100. This makes it possible to correct the setting information while checking the read data read from the image data, and to resume checking the read data reflecting the corrected setting information.

[0075] In addition, if a setting is modified that does not require re-execution of OCR processing, such as modifying the reading range described below, the read data reflecting the modified settings can be displayed on each screen by pressing the document discrimination button 166, the confirmation and correction button 167, or the output confirmation button 168.

[0076] Next, the reading setting screen 180 will be described with reference to Fig. 9. Fig. 9 is a front view showing an example of the reading setting screen 180 according to the present embodiment.

[0077] 9, the reading setting screen 180 has an image display area 181, a reading result display area 182, and a setting verification button 183. The image display area 181 displays image data related to the read data, and the reading result display area 182 displays the reading results related to the read data for each item. The setting verification button 183 is a button for storing the corrected settings and transmitting an instruction to transition to the setting verification screen 160.

[0078] For example, the reading setting screen 180 allows the user to confirm the reading range 184 before correction displayed in the image display area 181 and the reading results for each item displayed in the result display area 182, and accepts correction of the reading range. Specifically, the user can correct the reading range by using the mouse to drag the reading range 184 before correction and drop it at a desired location.

[0079] The reading setting screen 180 estimates the range of the character string using the character string related to the reading result, and if the estimated range of the character string is wider than the reading range set in the setting information, it displays the estimated reading range in the image display area 181 as a candidate reading range 185.

[0080] When the read range is modified, the read setting screen 180 uses the modified read range to obtain a character string from the read result and displays it in the read result display area 182. By using the image data that has actually been read and the read result, it is possible to modify the read range while checking whether the modified read range corresponds to the image data that has actually been read.

[0081] Furthermore, if a character string related to the acquired read result cannot be identified as a character code and cannot be read, the read setting screen 180 displays a message that the character string could not be read. Furthermore, the read setting screen 180 estimates a dictionary for reading the character string using information on other items related to the item of the character string that could not be read, and displays the estimated dictionary as a candidate when the estimated dictionary differs from the dictionary related to the item set in the setting information. As an example, the read setting screen 180 displays a message 186 notifying that the character string could not be read and notifying the dictionary candidates. Here, the read range candidates 185 and the message 186 notifying the dictionary candidates are an example of a "suggestion for correcting the setting information".

[0082] When the setting dictionary displayed in the reading result display area 182 of the reading setting screen 180 is modified, the information processing device 20 obtains a character string from the reading result using the modified dictionary and displays it in the reading result display area 182.

[0083] When the user has completed modifying the settings, the read setting screen 180 transitions to the setting verification screen 160 by pressing the setting verification button 183, and by pressing a button to transition to each screen of the operational function, the read data reflecting the modified settings is displayed.

[0084] The reading setting screen 180 according to the present embodiment has been described as accepting modifications to the reading range and dictionary. However, this is not limiting. Modifications to other settings may also be accepted. For example, modifications to the display format of the read character string may be accepted, or modifications to the positional relationship between the item (key) that is the reference for reading and the corresponding reading result (value) may be accepted.

[0085] Next, the output setting screen 200 will be described with reference to Fig. 10. Fig. 10 is a front view showing an example of the output setting screen 200 according to the present embodiment.

[0086] 10, the output setting screen 200 has an output setting display area 201, an output item display area 202, and an output confirmation button 203. The output setting display area 201 displays output settings related to the read data, the output item display area 202 displays items to be output and the read results for each item, and the output confirmation button 203 is a button for transmitting an instruction to transition to the output confirmation screen 140.

[0087] The output setting screen 200 accepts modifications to the file name, character code, presence or absence of a header, and output format settings displayed in an output setting display area 201. The output setting screen 200 also accepts modifications to the output order of items when an item movement icon 204 displayed in an output item display area 202 is pressed, and accepts addition of items to be output when an item addition icon 205 is pressed.

[0088] Here, when the user changes the output settings, the output setting screen 200 displays the reading results related to the read data in the output item display area 202, allowing the user to confirm the correspondence between the items and the character strings related to the reading results, and accepts modifications to the output settings.

[0089] When the user has completed modifying the settings, pressing the output confirmation button 203 transitions to the output confirmation screen 140, where it is possible to confirm that the modified settings have been reflected and to output the reading results.

[0090] In the present embodiment, the configuration has been described in which the settings are modified and reflected before output. However, the present invention is not limited to this. After output, each setting may be modified by referring to the output result. In this case, after the output button 145 of the output confirmation screen 140 in FIG. 7 is pressed, the information processing device 20 displays the output result and a message asking whether or not to modify the settings, and requests the user to modify the settings.

[0091] Next, the operation of the information processing device 20 according to this embodiment will be described with reference to Fig. 11 to Fig. 13. Fig. 11 is a flowchart showing an example of a process flow for controlling screen transition according to this embodiment. The information processing program shown in Fig. 11 is executed by the CPU 21 reading and executing an information processing program from the ROM 22 or the storage 24. The information processing program shown in Fig. 11 is executed when an instruction to display read data is input.

[0092] In step S101, the CPU 21 acquires the selected read data.

[0093] In step S102, the CPU 21 displays the document discrimination screen 100.

[0094] In step S103, the CPU 21 determines whether or not the button is pressed. If the button is pressed (step S103: YES), the CPU 21 proceeds to step S104. On the other hand, if the button is not pressed (step S103: NO), the CPU 21 waits until the button is pressed.

[0095] In step S104, the CPU 21 determines whether or not a button for transmitting an instruction to transition to a screen related to the operational function (document discrimination screen 100, confirmation / correction screen 120, and output confirmation screen 140) is pressed and whether or not to display a screen related to the operational function. If a screen related to the operational function is to be displayed (step S104: YES), the CPU 21 proceeds to step S105. On the other hand, if a screen related to the operational function is not to be displayed (step S104: NO), the CPU 21 proceeds to step S106.

[0096] In step S105, the CPU 21 executes a process for displaying a screen relating to the operational function. Note that the process for displaying a screen relating to the operational function will be described in detail later with reference to FIG.

[0097] In step S106, the CPU 21 determines whether or not a button for transmitting an instruction to transition to a screen related to the setting function (setting verification screen 160, reading setting screen 180, and output setting screen 200) is pressed and whether or not to display a screen related to the setting function. If a screen related to the setting function is to be displayed (step S106: YES), the CPU 21 proceeds to step S107. On the other hand, if a screen related to the setting function is not to be displayed (step S106: NO), the CPU 21 proceeds to step S108.

[0098] In step S107, the CPU 21 executes a process for displaying a screen relating to the setting function. Note that the process for displaying a screen relating to the setting function will be described in detail later with reference to FIG.

[0099] In step S108, the CPU 21 determines whether the output button is pressed and the process of controlling the screen transition is to be ended. If the process of controlling the screen transition is to be ended (step S108: YES), the CPU 21 ends the process of controlling the screen transition. On the other hand, if the process of controlling the screen transition is not to be ended (step S108: NO), the CPU 21 proceeds to step S103.

[0100] Next, a process for displaying a screen related to the operation function will be described with reference to Fig. 12. Fig. 12 is a flow chart showing an example of the process flow for displaying a screen related to the operation function according to this embodiment. The CPU 21 reads out a screen display program related to the operation function from the ROM 22 or the storage 24 and executes it, thereby executing the screen display processing program related to the operation function shown in Fig. 12. The screen display processing program related to the operation function shown in Fig. 12 is executed when the form discrimination button, the confirmation and correction button, the output confirmation button, or the OCR execution button is pressed.

[0101] In step S201, the CPU 21 acquires setting information related to the selected read data.

[0102] In step S202, the CPU 21 determines whether or not the form discrimination button has been pressed. If the form discrimination button has been pressed (step S202: YES), the CPU 21 proceeds to step S203. On the other hand, if the form discrimination button has not been pressed (step S202: NO), the CPU 21 proceeds to step S204.

[0103] In step S203, the CPU 21 displays the document discrimination screen 100 using the acquired setting information.

[0104] In step S204, the CPU 21 determines whether the OCR execution button is pressed. If the OCR execution button is pressed (step S204: YES), the CPU 21 proceeds to step S205. On the other hand, if the OCR execution button is not pressed (step S204: NO), the CPU 21 proceeds to step S206.

[0105] In step S205, the CPU 21 executes the OCR process again to obtain the read data.

[0106] In step S206, the CPU 21 determines whether the confirm / correct button has been pressed. If the confirm / correct button has been pressed (step S206: YES), the CPU 21 proceeds to step S207. On the other hand, if the confirm / correct button has not been pressed (step S206: NO), the CPU 21 proceeds to step S211.

[0107] In step S207, the CPU 21 displays the confirmation / correction screen 120 using the acquired setting information.

[0108] In step S208, the CPU 21 estimates the range of the character string related to the read data.

[0109] In step S209, the CPU 21 determines whether the range of the estimated character string exceeds the read range of the character string set in the setting information. If the range of the estimated character string exceeds the read range of the character string set in the setting information (step S209: YES), the CPU 21 proceeds to step S210. On the other hand, if the range of the estimated character string does not exceed the read range of the character string set in the setting information (step S209: NO), the CPU 21 ends the screen display process related to the operational function.

[0110] In step S210, CPU 21 displays a notice that the range of the estimated character string exceeds the read range of the character string set in the setting information.

[0111] In step S211, the CPU 21 displays the output confirmation screen 140 using the acquired setting information.

[0112] Next, a process for displaying a screen related to the setting function will be described with reference to Fig. 13. Fig. 13 is a flow chart showing an example of a process flow for displaying a screen related to the setting function according to this embodiment. The CPU 21 reads out a screen display program related to the setting function from the ROM 22 or the storage 24 and executes it, thereby executing the screen display processing program related to the setting function shown in Fig. 13. The screen display processing program related to the setting function shown in Fig. 13 is executed when the setting information correction button, the read setting correction button, the output setting correction button, or the setting verification button is pressed.

[0113] In step S301, the CPU 21 acquires setting information related to the selected read data.

[0114] In step S302, the CPU 21 determines whether or not the setting information correction button has been pressed. If the setting information correction button has been pressed (step S302: YES), the CPU 21 proceeds to step S303. On the other hand, if the setting information correction button has not been pressed (step S302: NO), the CPU 21 proceeds to step S304.

[0115] In step S303, the CPU 21 displays the setting verification screen 160 using the setting information and the read data.

[0116] In step S304, the CPU 21 determines whether or not the Verify Settings button has been pressed. If the Verify Settings button has been pressed (step S304: YES), the CPU 21 proceeds to step S303. On the other hand, if the Verify Settings button has not been pressed (step S304: NO), the CPU 21 proceeds to step S305.

[0117] In step S305, the CPU 21 determines whether the read setting correction button is pressed. If the read setting correction button is pressed (step S305: YES), the CPU 21 proceeds to step S306. On the other hand, if the read setting correction button is not pressed (step S305: NO), the CPU 21 proceeds to step S314.

[0118] In step S306, the CPU 21 displays the read setting screen 180 using the setting information and the read data.

[0119] In step S307, the CPU 21 estimates the range of the read character string related to the read data.

[0120] In step S308, CPU 21 determines whether the range of the estimated character string exceeds the read range of the character string set in the setting information. If the range of the estimated character string exceeds the read range of the character string set in the setting information (step S308: YES), CPU 21 proceeds to step S309. On the other hand, if the range of the estimated character string does not exceed the read range of the character string set in the setting information (step S308: NO), CPU 21 proceeds to step S310.

[0121] In step S309, CPU 21 displays the estimated range of the character string as a candidate for the reading range.

[0122] In step S310, the CPU 21 determines whether or not there is an item for which a character string could not be read from the image data. If there is an item for which a character string could not be read from the image data (step S310: YES), the CPU 21 proceeds to step S311. On the other hand, if there is no item for which a character string could not be read from the image data (character strings were read for all items) (step S310: NO), the CPU 21 proceeds to step S315.

[0123] In step S311, the CPU 21 estimates a dictionary for identifying a character string from image data, using information related to the item in which the character string could not be read.

[0124] In step S312, the CPU 21 determines whether the estimated dictionary is different from the dictionary set in the setting information. If the estimated dictionary is different from the dictionary set in the setting information (step S312: YES), the CPU 21 proceeds to step S313. On the other hand, if the estimated dictionary is not different from the dictionary set in the setting information (the estimated dictionary is the same as the dictionary set in the setting information) (step S312: NO), the CPU 21 proceeds to step S315.

[0125] In step S313, the CPU 21 displays the estimated dictionary as a candidate for the dictionary to be corrected.

[0126] In step S314, the CPU 21 displays the output setting screen 200 using the setting information and the read data.

[0127] In step S315, the CPU 21 stores the setting information inputted into each screen relating to the setting function.

[0128] As described above, according to this embodiment, it is possible to modify the setting information without displaying a screen for the setting process on a screen separate from the screen for the operation process.

[0129] In the present embodiment, a button for transitioning to another screen is displayed, and when each button is pressed, a transition to the corresponding other screen is performed. However, the present invention is not limited to this. A transition to another screen may be performed by pressing a predetermined key on a keyboard, or a transition to another screen may be performed by a predetermined operation. For example, on a screen related to an operation function, a screen related to the operation function may be moved back and forth by pressing the "→" and "←" keys on the keyboard, and a screen related to the operation function and a screen related to the setting function may be moved back and forth by pressing the "↑" and "↓" keys on the keyboard. In addition, for example, when a touch panel is used, a transition to another screen may be performed by a predetermined gesture operation such as tapping with three fingers or sliding from top to bottom with four fingers, and a correction of the setting information may be accepted. Therefore, an instruction to correct the setting information and an instruction to transition to another screen may be accepted by any operation.

[0130] In the present embodiment, the embodiment has been described in which the reading setting screen 180 relating to the setting function is displayed to indicate that the dictionary is to be corrected. However, the embodiment is not limited to this. The embodiment may be displayed on each screen relating to the operation function. For example, the embodiment may be displayed on the confirmation / correction screen 120 or the output confirmation screen 140.

[0131] Although the present invention has been described above using each embodiment, the present invention is not limited to the scope described in each embodiment. Various modifications or improvements can be made to each embodiment without departing from the gist of the present invention, and the modifications or improvements are also included in the technical scope of the present invention.

[0132] In the above embodiment, the term "processor" refers to a processor in a broad sense, including, for example, a general-purpose processor (e.g., a CPU: Central Processing Unit) and a dedicated processor (e.g., a GPU: Graphics Processing Unit, an ASIC: Application Specific Integrated Circuit, an FPGA: Field Programmable Gate Array, a programmable logic device, etc.).

[0133] In addition, the operations of the processor in each of the above embodiments may be performed not only by one processor, but also by multiple processors located at physically separate locations working together. Furthermore, the order of the operations of the processor is not limited to the order described in each of the above embodiments, and may be changed as appropriate.

[0134] In the present embodiment, the information processing program is installed in the storage, but the present invention is not limited to this. The information processing program according to the present embodiment may be provided in a form recorded in a computer-readable storage medium. For example, the information processing program according to the present invention may be provided in a form recorded in an optical disc such as a CD (Compact Disc)-ROM and a DVD (Digital Versatile Disc)-ROM. The information processing program according to the present invention may be provided in a form recorded in a semiconductor memory such as a USB (Universal Serial Bus) memory and a memory card. The information processing program according to the present embodiment may be obtained from an external device via a communication line connected to the communication I / F. [Explanation of symbols]

[0135] 10 Reporting System 20 Information processing device 21 CPU 22 ROM 23 RAM 24 Storage 25 Input section 26 Monitor 27 Communication I / F 28 Bus 40 Client terminals 60 Input Devices 81 Acquisition Department 82 Reading unit 83 Display section 84 Reception 85 Memory section 86 Estimation part 100 Document discrimination screen 101 Discrimination image display area 102, 142, 167 Confirmation and correction button 103, 125, 143 Setting information correction button 120 Confirmation and correction screen 121 Image display area 122 Reading result display area 123, 166 Form discrimination button 124, 203 Output check button 126, 164 Read setting correction button 127 Messages 140 Output confirmation screen 141 Output item display area 144 Output setting modification button 145 Output button 160 Setting verification screen 161 Image display area 162 Read data display area 163 Change form layout button 165 OCR execution button 168 Output check button 180 Scan setting screen 181 Image display area 182 Reading result display area 183 Validate Settings Button 184 Reading Range 185 Read Range Candidates 186 Messages 200 Output setting screen 201 Output setting display area 202 Output item display area 204 Item Move Icon 205 Add Item Icon

Claims

1. a processor, the processor comprising: Using setting information that is information set for extracting a character string from an image, an extraction result is obtained by extracting a character string from a target image obtained by reading a document, or an output result based on the extraction result is output to an external device; displaying a first screen for displaying the extraction result or the output result and receiving an instruction to modify the setting information; When the instruction is received, a second screen is displayed on which setting information related to the target image can be modified; the target image includes a plurality of related character strings; the setting information includes information regarding a dictionary for identifying a character string, The processor, When one character string cannot be identified from among the plurality of related character strings as a proposal for correcting the setting information, a dictionary for identifying the one character string is estimated using a result of extracting other character strings, and the dictionary is displayed on the second screen. Information processing device.

2. On the computer, Using setting information that is information set for extracting a character string from an image, an extraction result is obtained by extracting a character string from a target image obtained by reading a document, or an output result based on the extraction result is output to an external device; displaying a first screen for displaying the extraction result or the output result and receiving an instruction to modify the setting information; When the instruction is received, a second screen is displayed on which setting information related to the target image can be modified; the target image includes a plurality of related character strings; the setting information includes information regarding a dictionary for identifying a character string, When one character string cannot be identified from among the plurality of related character strings as a proposal for correcting the setting information, a dictionary for identifying the one character string is estimated using a result of extracting other character strings, and the dictionary is displayed on the second screen. An information processing program for executing processing.

Images