Information processing device and information processing program

Abstract

To provide an information processing device capable of checking the validity whether or not a reading definition that is used when reading a document in which information is written or entered in a predetermined item is applicable to other documents of the same type.SOLUTION: The information processing device includes a processor. The processor receives read definition setting that is a definition used when reading information of a first document in which information is written or entered in the predetermined item. With respect to a second document of the same type as the first document and for which information is written or entered in the predetermined item, the information processing device displays the result of reading using the read definition.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an information processing device and an information processing program. [Background technology]

[0002] Patent Document 1 describes a technique for more efficiently creating reading position information used during reading in an optical character reader. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 10-334182 Summary of the Invention [Problem to be solved by the invention]

[0004] A reading definition for a form, in which a reading range for reading information previously written or inputted in the form is set, is often created based on a certain form. It is also assumed that a reading definition created based on a certain form is applied to another form of the same type as the certain form to read information previously written or inputted in the other form. In this case, due to differences in the information previously written or inputted in the certain form and the other form, the reading range in the reading definition may be too narrow to read necessary information, or the reading range may be too wide to read unnecessary information, so it is preferable to confirm the validity of the application of the reading definition.

[0005] Therefore, the present invention aims to make it possible to confirm the validity of whether a reading definition, which is a definition used when reading a document in which information has been written or input into predetermined fields, can be applied to other documents of the same type as the document in question. [Means for solving the problem]

[0006] An information processing device of a first aspect includes a processor, which accepts settings for a reading definition, which is a definition used when reading information from a first document in which information has been written or input into predetermined fields, and displays the results of reading a second document, which is the same type of document as the first document and in which information has been written or input into predetermined fields, using the reading definition.

[0007] An information processing device of a second aspect is an information processing device of the first aspect, wherein the processor accepts, as an adjustment to the reading definition, an adjustment to at least one of the position or dimensions of a reading range, which is the range in which information of each of the first document and the second document is read.

[0008] An information processing device of a third aspect is an information processing device of the second aspect, wherein when the processor adjusts the reading definition using the results of reading the second document, the processor displays the results of reading the first document using the adjusted reading definition.

[0009] An information processing device of a fourth aspect is an information processing device of the third aspect, wherein the processor accepts, as an adjustment to the reading definition, a first adjustment including an adjustment of at least one of the position or dimensions of the reading range, and a second adjustment different from the first adjustment, and if the accepted adjustment of the reading definition is the second adjustment, the information of the first document is not read again, and if the adjustment of the reading definition is the first adjustment, the information of the first document is read again.

[0010] An information processing device of a fifth aspect is an information processing device of any of the second to fourth aspects, wherein the processor displays frame information indicating the reading range superimposed on each of the displayed first document and the second document.

[0011] An information processing device of a sixth aspect is an information processing device of the fifth aspect, wherein, when the processor adjusts at least one of the position or dimensions of the reading range, the frame information indicating the adjusted reading range and the frame information indicating the unadjusted reading range are displayed in different manners.

[0012] An information processing device of a seventh aspect is an information processing device of any of the first to sixth aspects, wherein, when the processor searches for the second document from which information is to be read using the reading definition and the target second document is not found, a message is displayed indicating that the second document was not found.

[0013] An information processing program of the eighth aspect causes a computer to receive settings for a reading definition, which is a definition used when reading information from a first document in which information has been written or input into predetermined fields, and to execute a process to display the results of reading a second document, which is the same type of document as the first document and in which information has been written or input into predetermined fields, using the reading definition. Effect of the Invention

[0014] According to the first aspect, it becomes possible to confirm the validity of whether a reading definition, which is a definition used when reading a document in which information has been written or input into predetermined fields, can be applied to other documents of the same type as the document in question.

[0015] According to the second aspect, even if the information written or input in advance in the first document and the second document is different, the information in each document can be read using the reading definition.

[0016] According to the third aspect, it becomes possible to check the validity of whether or not the adjusted reading definition can be applied to a first document of the same type as a second document.

[0017] According to the fourth aspect, the decrease in speed of the reading process is reduced, compared to a configuration in which the information of the first document is read again regardless of the adjustment content of the received reading definition.

[0018] According to the fifth aspect, it becomes possible to confirm the range in which information on each of the first document and the second document is read.

[0019] According to the sixth aspect, the visibility of the frame information indicating the adjusted reading range is improved compared to a configuration in which the frame information indicating the adjusted reading range and the frame information indicating the unadjusted reading range are displayed in a common manner.

[0020] According to the seventh aspect, the user can be made aware that the second document was not found.

[0021] According to the eighth aspect, it becomes possible to confirm the validity of whether a reading definition, which is a definition used when reading a document in which information has been written or input into predetermined fields, can be applied to other documents of the same type as the document in question. [Brief description of the drawings]

[0022] [Figure 1] FIG. 1 is a diagram showing a schematic configuration of a form system. [Diagram 2] FIG. 2 is a block diagram showing a hardware configuration of the information processing device. [Diagram 3] 10 is a flowchart showing a flow of a display process by the information processing device. [Figure 4] 11 is a first display example displayed on the screen of a client terminal. [Diagram 5] 13 is a second display example displayed on the screen of a client terminal. [Figure 6] 13 is a third display example displayed on the screen of a client terminal. [Figure 7] 4 is a fourth display example displayed on the screen of a client terminal. [Figure 8] 5 is a fifth display example displayed on the screen of a client terminal. [Figure 9] 6 is a sixth display example displayed on the screen of a client terminal. [Figure 10] 13 is a seventh display example displayed on the screen of a client terminal. [Figure 11] 13 is an eighth display example displayed on the screen of a client terminal. [Figure 12] 13 is a ninth display example displayed on the screen of a client terminal. [Figure 13] 10 is a tenth display example displayed on the screen of a client terminal. [Figure 14] 11 is an eleventh example of a display displayed on the screen of a client terminal. [Figure 15] 12 is a twelfth example of a display displayed on the screen of a client terminal. [Figure 16] 13 is a thirteenth display example displayed on the screen of a client terminal. [Figure 17] 14 is a fourteenth display example displayed on the screen of a client terminal. [Figure 18] 15 is a fifteenth example of a display displayed on the screen of a client terminal. [Figure 19] 16 is a sixteenth display example displayed on the screen of a client terminal. [Figure 20] 17 is a seventeenth example of a display displayed on the screen of a client terminal. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0023] (First embodiment) The form system 10 according to this embodiment will be described below. FIG. 1 is a diagram showing a schematic configuration of a form system 10 according to the present embodiment.

[0024] 1, the form system 10 includes an information processing device 20, a client terminal 40, and an input device 60. These devices are connected to a network (not shown) and can communicate with each other via the network. As an example of this network, the Internet, a LAN (=Local Area Network), a WAN (=Wide Area Network), etc. are applied.

[0025] The information processing device 20 performs OCR (Optical Character Recognition) processing on image data of multiple documents including forms input through the input device 60, and manages a series of processing flows for outputting the results of the OCR processing to a predetermined output destination. The specific configuration and operation of the information processing device 20 will be described later.

[0026] The client terminal 40 transmits various instructions related to the OCR process to the information processing device 20. The various instructions include, for example, an instruction to start reading information of image data, an instruction to display the result of reading information of image data, and the like. The client terminal 40 also displays various information such as the result of the OCR process performed by the information processing device 20 in response to the various received instructions, and notifications related to the OCR process. For example, the client terminal 40 is a general-purpose computer device such as a server computer or a personal computer (PC: Personal Computer). Although only one client terminal 40 is illustrated in FIG. 1, this is not limiting, and multiple client terminals 40 may be prepared and, for example, each client terminal 40 may be used for different processes.

[0027] The input device 60 inputs image data to be subjected to OCR processing to the information processing device 20. Examples of the input device 60 include a general-purpose computer device such as a server computer or a PC, and an image forming device having a scanning function, a printer function, a FAX function, etc. In addition to the input device 60, image data may also be input to the information processing device 20 from the client terminal 40.

[0028] Next, an overview of the form system 10 will be described. The form system 10 is a system in which an information processing device 20 performs OCR processing on image data input via an input device 60, and outputs the results of the OCR processing to a predetermined output destination.

[0029] In the OCR process, the information processing device 20 manages various processes, including (1) business design and operation verification, (2) data input, (3) data reading, (4) form discrimination, confirmation and correction, (5) reading result confirmation and correction, (6) business check, (7) data output, and (8) return. In this embodiment, the OCR process refers not only to the process of simply reading characters and symbols from image data, but also to post-processing such as character correction.

[0030] As an example of the management of various processes, (1) business design and operation verification, (2) data input, (3) data reading, (6) business check, and (7) data output processes are each automatically executed by the information processing device 20. Also, as an example of the management of various processes, (4) document discrimination, confirmation, and correction, and (5) reading result confirmation and correction processes are each accepted by input by the user via the client terminal 40. Also, as an example of the management of various processes, (8) return process may be automatically executed by the information processing device 20 or may be accepted by input by the user via the client terminal 40.

[0031] In the (1) business design and operation verification process, job rules are created that include read definition settings, output settings, and business check settings. In the read definition settings, as an example, a read range is set, which is the range in which image data information is read in the process of "(3) data reading". More specifically, as an example, a definition may be set such that the item value, which is the value, is read from near the right of the item extracted as the key. In the output settings, as an example, a file format and output destination of the output data output in the process of "(7) data output". In the business check settings, as an example, a format, such as the required input items and the number of characters that can be entered, in the form to be detected in the process of "(6) business check" are set.

[0032] In the process of (2) data input, image data is accepted as input from the input device 60. The accepted input image data is registered as a job, which is an execution unit of the process of "(3) data reading."

[0033] (3) In the data reading process, the information of the image data in the job is read using a job rule for the job to be executed, selected by the user from the job rules created in the process of "(1) Business Design and Operation Verification." As an example, in this process, the form included in the image data in the job is identified (hereinafter referred to as "form identification") and characters and symbols within the reading range are read.

[0034] In the (4) form identification, confirmation, and correction process, the image data in the job is divided into records that indicate the forms included in the job based on the results of the form identification performed in the "(3) Data Reading" process. After that, in this process, the divided records are displayed, and the user can confirm and correct the form identification.

[0035] In the process of (5) checking and correcting the read result, the read result of the characters and symbols within the read range performed in the process of "(3) data reading" is displayed, and the user can check and correct the read result.

[0036] In the (6) task check process, errors in each preceding process are detected by the task check setting included in the job rule for the job selected by the user from among the job rules created in the process of "(1) Task design and operation verification." The detection results may be presented to the user.

[0037] (7) In the data output process, output data is created using the output settings included in the job rules for the job selected by the user from the job rules created in the process of "(1) Business design and operational verification," and the created output data is output to a predetermined output destination.

[0038] In the (8) return process, the process executed in the OCR process is returned to the process one or more steps before. As an example, the return is instructed by the user from the client terminal 40 during the execution of various processes such as "(4) Document discrimination, confirmation, and correction" and "(5) Read result confirmation and correction." Also, as an example, the return is instructed from the client terminal 40 of the administrator depending on the result of the check by the administrator performed between the processes of "(6) Business check" and "(7) Data output."

[0039] In the above OCR processing, the process of "(1) business design and operation verification" is executed before the processes after "(3) data reading" are performed, i.e., before the form system 10 is put into operation. Furthermore, the process of "(1) business design and operation verification" may be executed during the operation of the form system 10, when the processes after "(3) data reading" are being performed. As an example, the job rules created in the process of "(1) business design and operation verification" before the operation of the form system 10 can be appropriately modified according to the results of the process of "(5) checking and correcting the reading results" during the operation of the form system 10.

[0040] 2 is a block diagram showing a hardware configuration of the information processing device 20. As an example, the information processing device 20 is a general-purpose computer device such as a server computer or a PC.

[0041] 2, the information processing device 20 includes a CPU 21 (=Central Processing Unit), a ROM 22 (=Read Only Memory), a RAM 23 (=Random Access Memory), a storage unit 24, an input unit 25, a display unit 26, and a communication unit 27. Each component is connected to each other so as to be able to communicate with each other via a bus 28. The CPU 21 is an example of a "processor."

[0042] The CPU 21 is a central processing unit, and executes various programs and controls each part. That is, the CPU 21 reads out a program from the ROM 22 or the storage unit 24, and executes the program using the RAM 23 as a working area. The CPU 21 controls each of the above-mentioned components and performs various arithmetic processing according to the program stored in the ROM 22 or the storage unit 24. In this embodiment, the ROM 22 or the storage unit 24 stores at least an information processing program for executing a display process described later. The information processing program may be pre-installed in the information processing device 20, or may be stored in a non-volatile storage medium, or distributed via a network and appropriately installed in the information processing device 20. Examples of the non-volatile storage medium include a CD-ROM, a magneto-optical disk, a HDD (=Hard Disk Drive), a DVD-ROM, a flash memory, a memory card, and the like.

[0043] The ROM 22 stores various programs and various data. The RAM 23 serves as a working area for temporarily storing programs or data.

[0044] The storage unit 24 is configured with a storage device such as an HDD, an SSD (Solid State Drive), or a flash memory, and stores various programs including an operating system, and various data.

[0045] The input unit 25 includes a pointing device such as a mouse, and a keyboard, and is used to perform various input operations.

[0046] The display unit 26 is, for example, a liquid crystal display, and displays various information. The display unit 26 may function as the input unit 25 by adopting a touch panel system.

[0047] The communication unit 27 is an interface for communicating with other devices such as the client terminal 40. For this communication, for example, a wired communication standard such as Ethernet (registered trademark) or FDDI, or a wireless communication standard such as 4G, 5G, or Wi-Fi (registered trademark) is used.

[0048] When executing the information processing program, the information processing device 20 uses the hardware resources described above to execute processing based on the information processing program.

[0049] 3 is a flowchart showing the flow of display processing for displaying the results of reading image data of multiple documents including a form on which information has been written or input in predetermined fields by the information processing device 20 using a reading definition. The display processing is performed by the CPU 21 reading out an information processing program from the ROM 22 or the storage unit 24, expanding it in the RAM 23, and executing it. A form is an example of a "document".

[0050] In step S10 shown in Fig. 3, the CPU 21 accepts the setting of a reading definition, which is a definition used when reading information from a first form, among the multiple documents, in which information has been written or input in predetermined fields. Then, the process proceeds to step S11. In the first embodiment, as an example, the first form, that is, the first form, among the multiple forms included in one job, is set as the "first form." The first form is an example of the "first document."

[0051] A method for setting the reading definition will be described below with reference to FIGS. In the reading definition setting, the above-mentioned reading range, a dictionary to be checked to obtain the reading result of the characters and symbols in the reading range, and data correction to correct the reading result to a predetermined content are set. The set reading definition is stored in the storage unit 24, as an example.

[0052] The dictionary may include, by way of example, dictionaries for recognizing characters corresponding to hiragana, katakana, kanji, Hepburn romanization, and Arabic numerals, as well as dictionaries for recognizing symbols such as (), / , and <>.

[0053] As an example of data correction, if the read result is "(stock)", it may be corrected to "Kaisho Kaisha", or if the read result is "half-width numbers", it may be corrected to "full-width numbers".

[0054] Then, the characters and symbols within the reading range are read using one or more dictionaries selected by the user, and data correction is performed on the reading result if necessary. Note that the data correction may be performed automatically by the information processing device 20, or may be performed by the user inputting the data through the client terminal 40.

[0055] Fig. 4 is a first display example displayed on the screen of the client terminal 40. In the display example shown in Fig. 4, a thumbnail display 41, a document display 42, a result display 43, a back button 44, a next button 45, and a cancel button 46 are displayed.

[0056] In the thumbnail display 41, thumbnail images of image data included in one job are displayed. As an example, if the image data included in a job is composed of two documents, two thumbnail images labeled "Page 1" and "Page 2" are displayed in the thumbnail display 41, as shown in FIG. 4. In addition, in the thumbnail display 41, one thumbnail image with diagonal lines indicates that it is image data to be displayed in the document display 42. In other words, one thumbnail image with diagonal lines in the thumbnail display 41 is selected as image data to be displayed in the document display 42.

[0057] The document display 42 displays image data of a document corresponding to the thumbnail image selected in the thumbnail display 41. In FIG. 4, image data of the first form, which is a purchase order, is displayed as a sketch for setting a reading definition as the image data of the document. In addition, in the document display 42, the characters or symbols displayed above the underline are information that has been written or input in advance into the form. As an example, the underlined portion on the form indicates a predetermined item in which information should be written or input into the form. And, as an example, in FIG. 4, "XX Co., Ltd.", "△△", "12345", and "2020 / 12 / 25" are information that has been written or input in advance into the first form.

[0058] The result display 43 displays a reading display 43A showing the reading results of characters and symbols within a reading range set as a reading definition for one job, and an item display 43B showing the item names corresponding to the reading results. Since Fig. 4 shows an example of a display before the reading range is set, the reading results are not displayed in the reading display 43A, but after the reading range is set, the reading results are automatically displayed by the information processing device 20. Also, as an example, the item display 43B displays the item names input by the user through the client terminal 40 after the reading results are displayed in the reading display 43A.

[0059] The back button 44 is a button for changing the image data displayed in the document display 42 to the image data of the previous page of the document. As an example, when the image data of the second page of the document is displayed in the document display 42, if the back button 44 is operated, the image data of the first page of the document is displayed in the document display 42. Note that when the image data of the first page of the document is displayed in the document display 42, if the back button 44 is operated, the image data of the last page of the document is displayed in the document display 42.

[0060] Next button 45 is a button for changing the image data displayed in document display 42 to image data of the document one page later. As an example, when image data of the first page of a document is displayed in document display 42, operating next button 45 causes image data of the second page of the document to be displayed in document display 42. Note that when image data of the last page of a document is displayed in document display 42, operating next button 45 causes image data of the first page of the document to be displayed in document display 42.

[0061] The cancel button 46 is a button for changing the screen of the client terminal 40 to a predetermined display content when operated.

[0062] Fig. 5 is a second display example displayed on the screen of the client terminal 40. The display example shown in Fig. 5 shows a state after a read range has been set for a part of the information previously written or input in the first form in the image data of the first form displayed as the document display 42 in Fig. 4.

[0063] 5, the CPU 21 displays frame information 42A indicating the reading range, superimposed on the image data of the first form displayed as the document display 42. This frame information 42A is rectangular, and the letters and symbols of "XX Co., Ltd." are surrounded by a frame indicated by a dashed line.

[0064] As an example, the frame information 42A is created by a user's mouse operation. Specifically, after left-clicking and selecting a predetermined icon (not shown) on the screen of the client terminal 40, the user left-clicks any position on the document display 42, drags the mouse, and releases the left click to create the frame information 42A. The created frame information 42A can have its frame dimensions and shape changed, and can be moved to any position on the document display 42.

[0065] 5, the CPU 21 displays the result of reading the characters and symbols surrounded by the frame information 42A in the read display 43A of the result display 43. Specifically, the CPU 21 displays the characters and symbols "XX Co., Ltd." in the top read display 43A of the result display 43. Although not shown, the CPU 21 accepts a dictionary to be checked to obtain the read result of the characters and symbols surrounded by the frame information 42A and a data correction setting for the read result before displaying the read result in the read display 43A. Then, the CPU 21 reads the characters and symbols surrounded by the frame information 42A using the accepted dictionary, and, if necessary, displays the content of the data correction performed on the read result in the read display 43A.

[0066] 3, in step S11, the CPU 21 displays the results of reading the first document, and then the process proceeds to step S12.

[0067] Fig. 6 is a third display example displayed on the screen of the client terminal 40. The display example shown in Fig. 6 shows a state after an additional reading range has been set for the image data of the first form displayed as the document display 42 in Fig. 5.

[0068] 6, the CPU 21 displays frame information 42A, 42B, 42C, and 42D indicating the reading range, superimposed on the image data of the first form displayed as the document display 42. The frame information 42A, 42B, 42C, and 42D are all rectangular, and the frame information 42B surrounds the symbol "△△", the frame information 42C surrounds the characters "12345", and the frame information 42D surrounds the characters and symbols "2020 / 12 / 25" with a frame indicated by a dashed line.

[0069] 6, the CPU 21 displays the results of reading the characters and symbols surrounded by the frame information 42A, 42B, 42C, and 42D in the reading display 43A of the result display 43. Specifically, the CPU 21 displays the characters and symbols "XX Co., Ltd." in the top reading display 43A of the result display 43, the symbol "△△" in the second reading display 43A from the top, the characters "12345" in the third reading display 43A from the top, and the characters and symbols "2020 / 12 / 25" in the bottom reading display 43A. As with the above frame information 42A, the CPU 21 accepts settings for a dictionary to be collated to obtain the reading results of the characters and symbols surrounded by the frame information 42B, 42C, and 42D, and data correction settings for each reading result, before displaying the reading results in the reading display 43A. Then, the CPU 21 reads the characters and symbols enclosed in the frame information 42B, 42C, and 42D using the received dictionary, and, if necessary, reads and displays the contents of data correction made to each read result on the read display 43A.

[0070] In addition, in FIG. 6, the top item display 43B of the result display 43 displays “Company Name,” the second item display 43B displays “Name of Person in Charge,” the third item display 43B displays “Order Number,” and the bottom item display 43B displays “Order Date,” which are the item names entered by the user via client terminal 40.

[0071] Returning to FIG. 3, in step S12, the CPU 21 displays the results of reading the second form, which is the same type of document as the first form and has information written or input in predetermined fields. Then, the process ends. The above "same type of document" means that the forms are of the same type. As an example, "the same type of document" means that if the first form is a "purchase order", the second form is also a "purchase order". Also, in the first embodiment, as an example, of the multiple forms included in one job, forms other than the first form, i.e., the second form onwards, are referred to as "second forms". The second form is an example of a "second document".

[0072] Fig. 7 is a fourth display example displayed on the screen of the client terminal 40. The display example shown in Fig. 7 shows a state in which image data of a second form is displayed in the document display 42, unlike the display examples shown in Figs. 4 to 6 in which image data of a first form was displayed in the document display 42.

[0073] As an example, the CPU 21 displays the display example shown in FIG. 7 when the next button 45 is operated while the display example shown in FIG. 6 is being displayed. In FIG. 7, the result of reading the image data of the second form, which is a purchase order, by the CPU 21 using the read definition set in step S10 shown in FIG. 3 is displayed. In the first embodiment, as shown in FIG. 6 and FIG. 7, the form layouts of the first form and the second form are similar. That is, the purchase order, which becomes the first form and the second form by filling or inputting information in predetermined items (e.g., company name, person in charge name, order number, order date), is a form of a fixed format. Note that, as an example, in FIG. 7, "XX Co., Ltd.", "☆☆ □□", "56789", and "2020 / 12 / 15" are information filled or input in advance in the second form.

[0074] In Fig. 7, the CPU 21 displays frame information 42A, 42B, 42C, and 42D of the same shape and size at the same position as in Fig. 6, superimposed on the image data of the second form displayed as the document display 42. As a result, in Fig. 7, the frame information 42A surrounds the characters and symbols of "XX Co., Ltd.", the frame information 42B surrounds the symbols "☆ □□", the frame information 42C surrounds the characters "56789", and the frame information 42D surrounds the characters and symbols "2020 / 12 / 15" with a frame indicated by a dashed line. Thus, in Fig. 7, the symbol "☆" at the beginning of "☆☆ □□" among the information previously filled or inputted in the second form protrudes from the frame of the frame information 42B.

[0075] In Fig. 7, because frame information 42A, 42B, 42C, and 42D surround the characters and symbols as described above, CPU 21 displays the characters and symbols "XX Co., Ltd." in the topmost read display 43A of result display 43, the symbol "☆ □□" in the second read display 43A from the top, the characters "56789" in the third read display 43A from the top, and the characters and symbols "2020 / 12 / 15" in the bottommost read display 43A. Note that in Fig. 7, the same item names as in Fig. 6 are displayed in item display 43B of result display 43.

[0076] Here, the reading definition of a form is often created based on one form. Also, the reading definition created based on one form may be applied to another form of the same type as the one form to read information previously written or input in the other form. In this case, due to differences in the information previously written or input in the one form and the other form, the reading range in the reading definition may be too narrow to read necessary information, or the reading range may be too wide to read unnecessary information, so it is preferable to confirm the validity of the application of the reading definition.

[0077] The above problem is unlikely to occur if the range in which information is to be written or input in a predetermined item on a form is enclosed by a ruled line, but is highly likely to occur when the range in which the information is to be written or input is not enclosed by a ruled line, as in the first embodiment. This is because, when the range in which the information is to be written or input is enclosed by a ruled line, it is sufficient to create a reading range that matches the ruled line, but when the range is not enclosed by a ruled line, it is difficult to uniquely define the position and dimensions of the reading range to be created.

[0078] Therefore, in the first embodiment, the CPU 21 accepts the setting of a reading definition and displays the results of reading using the reading definition for a second form, which is a document of the same type as the first form and has information written or input in predetermined fields.

[0079] Therefore, according to the first embodiment, it is possible to confirm the validity of whether or not a reading definition, which is a definition used when reading a first form in which information has been written or input in predetermined items, can be applied to a second form of the same type as the first form. As an example, a user who sees the display example in Fig. 7 can confirm that the current reading definition cannot be applied to the second form, because "☆☆ □□" written or input in advance in the second form is displayed as "☆ □□" in the reading display 43A.

[0080] Here, in the first embodiment, the set reading definition can be adjusted. As an example, the CPU 21 accepts adjustment of at least one of the position and the size of the reading range as the adjustment of the reading definition.

[0081] Fig. 8 is a fifth display example displayed on the screen of the client terminal 40. The display example shown in Fig. 8 shows a state after the dimensions of the reading range corresponding to the frame information 42B of the display example shown in Fig. 7 have been adjusted.

[0082] As an example, the size of the reading range is adjusted by a user's mouse operation on the frame information 42B. Specifically, the size of the frame of the frame information 42B is enlarged or reduced by dragging the mouse while left-clicking a predetermined position on the frame of the frame information 42B and then releasing the left click.

[0083] In Fig. 8, the dimensions of the frame of the frame information 42B shown in Fig. 7 are enlarged, and the frame information 42B indicating the reading range surrounds the periphery of the "☆☆ □□" symbol. For this reason, in Fig. 8, the CPU 21 displays the "☆☆ □□" symbol in the second reading display 43A from the top of the result display 43. This allows a user who sees the display example of Fig. 8 to confirm that the adjusted reading definition can be applied to the second form, since the information previously written or input into the second form is correctly displayed in the reading display 43A.

[0084] With the above configuration, according to the first embodiment, even if the information pre-filled or input into each of the first and second forms, for example the amount of information such as characters and symbols pre-filled or input, differs, the information of each form can be read using the reading definition.

[0085] There is also a configuration in which the document that serves as the rough sketch for setting the read definition is not a document included in the actual operation job, but a document for creating the read definition; however, with this configuration, it requires a lot of effort to set an appropriate read definition before operation, anticipating problems that may occur during actual operation.

[0086] In contrast, in the first embodiment, the reading definition is set and adjusted using the forms included in the actual operation job of the first form and the second form, so that the reading definition can be created before the operation assuming the actual operation job. Also, in the first embodiment, the reading definition created before the operation is appropriately modified according to the results of the processing during the operation (e.g., each of the processes (4) form discrimination confirmation and correction, (5) reading result confirmation and correction, (6) business check (see FIG. 1)), so that the reading definition can be created based on the results of the processing during the operation.

[0087] As described above, in the first embodiment, the CPU 21 displays frame information indicating the reading range superimposed on the image data of each of the first and second forms displayed as the document display 42. Therefore, according to the first embodiment, it becomes possible to confirm the range in which the information of each of the first and second forms is to be read.

[0088] In the first embodiment, when at least one of the position or the size of the reading range is adjusted, the CPU 21 displays the frame information indicating the adjusted reading range and the frame information indicating the unadjusted reading range in different modes. As an example, in FIG. 8, the frame information 42B indicating the adjusted reading range is shown by a two-dot chain line, and is displayed in a different manner from the frame information 42A, 42C, and 42D indicating the unadjusted reading range shown by the dashed line. Therefore, according to the first embodiment, the visibility of the frame information indicating the adjusted reading range can be improved compared to a configuration in which the frame information indicating the adjusted reading range and the frame information indicating the unadjusted reading range are displayed in a common manner.

[0089] Furthermore, in the first embodiment, when the reading definition is adjusted using the result of reading the second form, the CPU 21 displays the result of reading the first form using the adjusted reading definition.

[0090] Fig. 9 is a sixth display example displayed on the screen of the client terminal 40. The display example shown in Fig. 9 shows a state in which image data of a first form is displayed in the document display 42, unlike the display examples of Fig. 7 and Fig. 8 in which image data of a second form was displayed in the document display 42.

[0091] As an example, when the back button 44 is operated while the display example shown in Fig. 8 is being displayed, the CPU 21 displays the display example shown in Fig. 9. In Fig. 9, the result of reading the image data of the first form by the CPU 21 using an adjusted reading definition in which the frame dimensions of the frame information 42B are enlarged from the reading definition set in step S10 shown in Fig. 3 is displayed.

[0092] In the display example shown in Fig. 9, CPU 21 displays frame information 42A, 42B, 42C, and 42D of the same shape and size at the same position as in Fig. 8, superimposed on the image data of the first form displayed as document display 42. As a result, in Fig. 9, the same reading result as in Fig. 6 is displayed in reading display 43A of result display 43.

[0093] With the above configuration, according to the first embodiment, it is possible to confirm the validity of whether the adjusted reading definition can be applied to the first form of the same type as the second form. As an example, a user who sees the display example of Fig. 9 can confirm that the adjusted reading definition can be applied to the first form, since the information previously written or inputted in the first form is correctly displayed in the reading display 43A.

[0094] Here, in the first embodiment, the CPU 21 is capable of accepting, as an adjustment of the reading definition, a first adjustment including adjustment of at least one of the position and dimensions of the reading range, and a second adjustment different from the first adjustment.

[0095] The first adjustment is an adjustment of the reading definition that requires re-reading of information previously written or input into the document, for the image data of the document displayed on the document display 42. As an example, the first adjustment includes adjusting at least one of the position and dimensions of the reading range, as well as adding or changing a dictionary.

[0096] The second adjustment is an adjustment of the reading definition that does not require re-reading of information previously written or input into the document, for the image data of the document displayed on the document display 42. As an example, the second adjustment includes changing the line type or color, etc. of the frame information indicating the reading range without changing the position and dimensions of the reading range, and performing data correction, etc.

[0097] In the first embodiment, if the adjustment of the received reading definition is the second adjustment, the CPU 21 does not re-read the information of the first form, but if the adjustment is the first adjustment, the CPU 21 re-reads the information of the first form.

[0098] Fig. 10 is a seventh display example displayed on the screen of the client terminal 40. The display example shown in Fig. 10 shows a state after the line type of the frame information 42A in the display example shown in Fig. 7 has been changed. Specifically, the line type of the frame information 42A in the display example shown in Fig. 10 is a "dotted line", which is changed from the display example shown in Fig. 7 in which the line type is a "dashed line".

[0099] As an example, the line type of the frame information 42A is changed by the user's mouse operation. Specifically, after left-clicking to select a predetermined icon (not shown) on the screen of the client terminal 40, the line type is changed by left-clicking on the frame of the frame information 42A.

[0100] Fig. 11 is an eighth display example displayed on the screen of the client terminal 40. The display example shown in Fig. 11 shows a state in which image data of a first form is displayed in the document display 42, unlike the display example of Fig. 10 in which image data of a second form is displayed in the document display 42.

[0101] As an example, when the back button 44 is operated while the display example shown in Fig. 10 is being displayed, the CPU 21 displays the display example shown in Fig. 11. In this case, since the received adjustment of the reading definition is the second adjustment, the CPU 21 does not re-read the information previously written or input in the first form, and displays the result of reading the image data of the immediately previous first form in the reading display 43A of the result display 43.

[0102] Here, the results of reading the image data of each of the first and second forms are stored in the storage unit 24, for example, and when re-reading is not performed as described above, the CPU 21 obtains the corresponding reading result from the storage unit 24 and displays it on the reading display 43A. That is, the reading display 43A in the display example shown in Fig. 11 displays the reading display 43A in the display example shown in Fig. 6 without re-reading.

[0103] With the above configuration, according to the first embodiment, the speed reduction of the OCR processing as the reading process is reduced compared to a configuration in which the information of the first form is read again regardless of the adjustment contents of the received reading definition.

[0104] Second Embodiment Next, a second embodiment will be described while omitting or simplifying parts that overlap with other embodiments.

[0105] In the second embodiment, a case will be described in which the dimensions of the read range are reduced as an adjustment to the read definition.

[0106] Fig. 12 is a ninth display example displayed on the screen of the client terminal 40. The display example shown in Fig. 12 shows a state after an additional reading range has been set for the image data of the first form displayed as the document display 42 in Fig. 5.

[0107] In Fig. 12, the CPU 21 displays frame information 42A, 42B, 42C, and 42D indicating the reading range, superimposed on the image data of the first form displayed as the document display 42. At this time, in Fig. 12, the frame information 42A, 42C, and 42D are displayed in the same positions and with the same shapes and dimensions as in Fig. 6, but the dimensions of the frame information 42B are larger than those shown in Fig. 6. Specifically, the position of the right edge of the frame in the frame information 42B shown in Fig. 12 is the same as that of the frame information 42B shown in Fig. 6, but the left edge of the frame is located further to the left than the frame information 42B shown in Fig. 6.

[0108] As described above, in FIG. 12, the dimensions of frame information 42B are different from those in FIG. 6, but the read result similar to that in FIG. 6 is displayed in read display 43A of result display 43.

[0109] Fig. 13 is a tenth display example displayed on the screen of the client terminal 40. The display example shown in Fig. 13 shows a state in which image data of a second form is displayed in the document display 42, unlike the display example of Fig. 12 in which image data of a first form was displayed in the document display 42.

[0110] As an example, when the next button 45 is operated while the display example shown in Fig. 12 is being displayed, the CPU 21 displays the display example shown in Fig. 13. In Fig. 13, the CPU 21 reads the characters and symbols surrounded by frame information 42A, 42B, 42C, and 42D displayed in the same position and with the same shape and dimensions as in Fig. 12 in the image data of the second form. As a result, in Fig. 13, although the dimensions of frame information 42B are different from those in Fig. 8, the read result similar to that in Fig. 8 is displayed in the read display 43A of the result display 43.

[0111] Fig. 14 is an eleventh display example displayed on the screen of the client terminal 40. The display example shown in Fig. 14 shows a state after the dimensions of the reading range corresponding to the frame information 42B of the display example shown in Fig. 13 have been adjusted.

[0112] In Fig. 14, the size of the frame of frame information 42B shown in Fig. 13 has been reduced, and the left edge of the frame is positioned further to the right than frame information 42B shown in Fig. 13. Thus, in Fig. 14, the size of the frame of frame information 42B shown in Fig. 13 has been reduced, but the frame surrounds the symbol "☆☆ □□". Therefore, in Fig. 14, CPU 21 displays the symbol "☆☆ □□" in read display 43A, which is the second from the top of result display 43.

[0113] Fig. 15 is a twelfth display example displayed on the screen of the client terminal 40. The display example shown in Fig. 15 shows a state in which image data of a first form is displayed in the document display 42, unlike the display examples in Fig. 13 and Fig. 14 in which image data of a second form was displayed in the document display 42.

[0114] As an example, when the back button 44 is operated while the display example shown in Fig. 14 is being displayed, the CPU 21 displays the display example shown in Fig. 15. In Fig. 15, the CPU 21 reads the characters and symbols surrounded by frame information 42A, 42B, 42C, and 42D displayed in the same position and with the same shape and dimensions as in Fig. 14 in the image data of the first form. As a result, in Fig. 15, the dimensions of frame information 42B are different from those in Fig. 12, but the same reading result as in Fig. 12 is displayed in the read display 43A of the result display 43.

[0115] (Third embodiment) Next, a third embodiment will be described while omitting or simplifying parts that overlap with other embodiments.

[0116] In the third embodiment, a case will be described in which the position of the read range is adjusted as an adjustment of the read definition.

[0117] Fig. 16 is a thirteenth display example displayed on the screen of the client terminal 40. The display example shown in Fig. 16 shows a state after an additional reading range has been set for the image data of the first form displayed as the document display 42 in Fig. 5.

[0118] In Fig. 16, the CPU 21 displays frame information 42A, 42B, 42C, and 42D indicating the reading range, superimposed on the image data of the first form displayed as the document display 42. At this time, in Fig. 16, the frame information 42A, 42C, and 42D are displayed in the same positions and with the same shapes and dimensions as in Fig. 6, but the dimensions of the frame information 42B are larger than those shown in Fig. 6. Specifically, the position of the right edge of the frame in the frame information 42B shown in Fig. 16 is the same as that of the frame information 42B shown in Fig. 6, but the left edge of the frame is located further to the left than the frame information 42B shown in Fig. 6.

[0119] In addition, the first form displayed as document display 42 in Figure 16, like the first form displayed as document display 42 in Figure 6, includes "△△" in the pre-filled or input information, but the position where the "△△" is pre-filled or input in the first form is to the left of that shown in Figure 6.

[0120] As described above, in Figure 16, the dimensions of frame information 42B and the position where "△△" is pre-filled or input in the first form are different from those in Figure 6, but the reading display 43A of result display 43 displays the same reading result as in Figure 6.

[0121] Fig. 17 is a fourteenth display example displayed on the screen of the client terminal 40. The display example shown in Fig. 17 shows a state in which image data of a second form is displayed in the document display 42, unlike the display example of Fig. 16 in which image data of a first form was displayed in the document display 42.

[0122] As an example, when the next button 45 is operated while the display example shown in FIG. 16 is being displayed, the CPU 21 displays the display example shown in FIG. 17. In FIG. 17, the CPU 21 reads the characters and symbols surrounded by the frame information 42A, 42B, 42C, and 42D displayed in the same position and with the same shape and size as in FIG. 16 in the image data of the second form. As an example, in FIG. 17, "XX Co., Ltd.", "☆☆", "56789", and "2020 / 12 / 15" are information that has been written or input in advance in the second form. The position of the first symbol of "☆☆" shown in FIG. 17 is to the left of the position of the first symbol of "☆☆ □□" shown in FIG. 7.

[0123] As a result, in FIG. 17, the frame information 42A surrounds the characters and symbols of "XX Co., Ltd.", the frame information 42C surrounds the characters of "56789," and the frame information 42D surrounds the characters and symbols of "2020 / 12 / 15" with a frame indicated by a dashed line, but the frame information 42B does not surround any of the characters and symbols. In other words, in FIG. 17, the symbol "☆☆" among the information previously written or input in the second form protrudes from the frame of the frame information 42B. Therefore, in FIG. 17, the CPU 21 displays the same reading result as in FIG. 7 in the top, third from the top, and bottom reading display 43A of the result display 43, but does not display any characters or symbols in the second from the top reading display 43A.

[0124] Fig. 18 is a fifteenth display example displayed on the screen of the client terminal 40. The display example shown in Fig. 18 shows a state after adjusting the position of the reading range corresponding to the frame information 42B of the display example shown in Fig. 17.

[0125] As an example, the position of the reading range is adjusted by a user's mouse operation on the frame information 42 B. Specifically, the position of the frame of the frame information 42 B is moved by left-clicking a predetermined position on the frame of the frame information 42 B, dragging the mouse, and releasing the left click.

[0126] In Fig. 18, the size of the frame of frame information 42B shown in Fig. 17 is not enlarged or reduced, and the position of the frame is moved so that frame information 42B indicating the reading range surrounds the "☆☆" symbol. Therefore, in Fig. 18, CPU 21 displays the "☆☆" symbols in reading display 43A, which is the second from the top of result display 43.

[0127] Fig. 19 is a 16th display example displayed on the screen of the client terminal 40. The display example shown in Fig. 19 shows a state in which image data of a first form is displayed in the document display 42, unlike the display examples in Fig. 17 and Fig. 18 in which image data of a second form was displayed in the document display 42.

[0128] As an example, when the back button 44 is operated while the display example shown in Fig. 18 is being displayed, the CPU 21 displays the display example shown in Fig. 19. In Fig. 19, the CPU 21 reads the characters and symbols surrounded by frame information 42A, 42B, 42C, and 42D displayed in the same position and with the same shape and size as in Fig. 18 in the image data of the first form. As a result, in Fig. 19, the position of frame information 42B is different from that in Fig. 16, but the read result similar to that in Fig. 16 is displayed in the read display 43A of the result display 43.

[0129] (Fourth embodiment) Next, a fourth embodiment will be described while omitting or simplifying parts that overlap with other embodiments.

[0130] In the fourth embodiment, when a second form for reading information using a reading definition is searched for and the target second form is not found, the CPU 21 displays a message to the effect that the second form was not found.

[0131] FIG. 20 is a seventeenth display example displayed on the screen of the client terminal 40. In FIG. As an example, when the CPU 21 cannot find the target second form even if the Next button 45 is operated the number of times corresponding to the number of pages (e.g., page 1, page 2, etc.) of the form specified for each job during the display of each of the display examples from Fig. 6 to Fig. 19, the CPU 21 displays the display example shown in Fig. 20. In the display example shown in Fig. 20, a message display 47, a continue button 48, and a cancel button 46 are displayed.

[0132] Message display 47 shows a message to the user. As an example, in Fig. 20, message display 47 shows "Next form not found. Continue searching?". This allows the user who sees the display example in Fig. 20 to know that the second form was not found.

[0133] The continue button 48 is a button for continuing the search for the second form. As an example, when the continue button 48 is operated while the display example shown in Fig. 20 is being displayed, the screen of the client terminal 40 changes to predetermined display content with the search for the second form continuing. Note that when the cancel button 46 is operated while the display example shown in Fig. 20 is being displayed, the screen of the client terminal 40 changes to predetermined display content with the search for the second form being stopped.

[0134] With the above configuration, according to the fourth embodiment, the user can be made aware that the second form was not found.

[0135] In the fourth embodiment, the CPU 21 may accept a setting for the presence or absence of a discrimination function for discriminating whether or not the form is the same as the form set as the sketch. As an example, when the form set as the sketch is a "purchase order" and an "invoice" is mixed in as a form included in the job, if the discrimination function is enabled, the "invoice" is not split into a record.

[0136] Then, when the discrimination function is enabled and the documents included in the job include an attachment for the form, if the target second form is not found even if the Next button 45 is operated a number of times equal to a predetermined number (e.g., 5) added to the number of pages of the form specified for each job while each of the display examples of Fig. 6 to Fig. 19 is being displayed, the CPU 21 may display the display example shown in Fig. 20. By configuring in this manner, it is possible to have the user confirm whether or not to continue searching for the second form, taking into account the attached documents, which are often a variable number of pages.

[0137] (others) In the above embodiment, the first document among multiple documents included in one job is designated as the "first document," but if the second document and subsequent documents are selected as a sketch for setting a reading definition, the second document and subsequent documents become the "first document." Also, in the above embodiment, the second document and subsequent documents among multiple documents included in one job are designated as the "second document," but if the second document and subsequent documents become the "first document," documents other than the first document, including the first document, become the "second document."

[0138] In the above embodiment, frame information indicating the reading range is created by a user's mouse operation, but this is not limiting, and frame information may be automatically created by the information processing device 20. As an example, when a layout definition is set in advance for a specific form (e.g., a purchase order), which defines which part of the form layout of the form is to be read, frame information may be automatically created using the layout definition.

[0139] In the above embodiment, the adjustment of the size of the read range is performed by the user's mouse operation on the frame information indicating the read range, but the invention is not limited to this and the size of the read range may be automatically adjusted by the information processing device 20. As an example, the information processing device 20 may recognize the size of characters, symbols, etc. that protrude from the frame of the frame information, and expand the size of the frame of the read range so that the protruding part fits within the frame. When the size of the read range is automatically adjusted, the information processing device 20 may adjust it taking into account the size of characters, symbols, etc. only of the page on which characters, symbols, etc. are not correctly read, or may adjust it taking into account the size of characters, symbols, etc. of the pages of other forms included in the job.

[0140] In the above embodiment, the first and second forms have the same form layout, but the configuration of the above embodiment can be applied to cases where the first and second forms have different form layouts. In other words, the forms that become the first and second forms by filling in or inputting information in predetermined fields (e.g., company name, person in charge name, order number, order date) may be in a non-standard format.

[0141] In the above embodiment, the CPU 21 displays the frame information indicating the adjusted reading range and the frame information indicating the unadjusted reading range in different modes, with different line types for each, but the above "different modes" are not limited to this. Examples of the above "different modes" may include making the shapes of the lines different, making the colors of the lines different, etc.

[0142] In the above embodiment, an example has been described in which the read definition is adjusted by adjusting either the position or the dimensions of the read range, but this is not limiting, and both the position and the dimensions of the read range may be adjusted.

[0143] In the above embodiment, a job rule is created in the process of "(1) business design and operational verification." In addition, a job rule set that combines multiple job rules may be created in the process of "(1) business design and operational verification."

[0144] The above embodiments and the contents described in (Others) can be combined as appropriate.

[0145] In each of the above embodiments, the term "processor" refers to a processor in a broad sense, including general-purpose processors (e.g., CPU: Central Processing Unit, etc.) and dedicated processors (e.g., GPU: Graphics Processing Unit, ASIC: Application Specific Integrated Circuit, FPGA: Field Programmable Gate Array, programmable logic device, etc.).

[0146] In addition, the operations of the processor in each of the above embodiments may be performed not only by one processor, but also by multiple processors located at physically separate locations working together. Furthermore, the order of the operations of the processor is not limited to the order described in each of the above embodiments, and may be changed as appropriate. [Explanation of symbols]

[0147] 20 Information processing device 21 CPU (an example of a processor)

Claims

1. A processor is provided. The processor, Accepts job submissions that include multiple documents, receiving a setting of a reading definition that is used when reading information from a first document in which information has been written or input among the plurality of documents in the job, and that defines at least one of a position or a dimension of a reading range that is a range in which the document information is read; After reading the information of the first document using the reading definition, reading information from a second document, which is the same type as the first document among the plurality of documents in the job and on which information has been written or input, using the reading definition, and displaying the result of reading the information of the second document; receiving, on a screen on which a result of reading the information of the second document is displayed, an adjustment of at least one of a position or a size of the reading range as an adjustment of the reading definition; after receiving the adjustment of the reading definition, displaying a result of reading the information of the first document using the adjusted reading definition; Information processing device.

2. The processor, displaying frame information indicating the adjusted read range and frame information indicating the unadjusted read range in different modes; The information processing device according to claim 1 .

3. The processor, receiving, as the adjustment of the reading definition, a first adjustment including an adjustment of at least one of a position or a dimension of the reading range and a second adjustment different from the first adjustment; 3. An information processing device according to claim 1 or 2, wherein the received adjustment of the reading definition does not re-read the information of the first document if it is the second adjustment, but re-reads the information of the first document if it is the first adjustment.

4. A processor comprising: The processor, Accepting settings of a reading definition, which is a definition to be used when reading information from a first document in which information has been written or input in predetermined items; displaying a result of scanning a second document, which is the same type as the first document and has information written or input in predetermined items, using the scanning definition; When the second document to be read using the reading definition is not found as a result of searching for the second document, a message indicating that the second document was not found and a button for continuing the search for the second document are displayed; If the button is operated while the message indicating that the second document was not found is displayed, the search for the second document is continued. Information processing device.

5. On the computer, Accepts job submissions that include multiple documents, receiving a setting of a reading definition that is used when reading information from a first document in which information has been written or input among the plurality of documents in the job, and that defines at least one of a position or a dimension of a reading range that is a range in which the document information is read; After reading the information of the first document using the reading definition, reading information from a second document, which is the same type as the first document among the plurality of documents in the job and on which information has been written or input, using the reading definition, and displaying the result of reading the information of the second document; receiving, on a screen on which a result of reading the information of the second document is displayed, an adjustment of at least one of a position or a size of the reading range as an adjustment of the reading definition; after receiving the adjustment of the reading definition, displaying a result of reading the information of the first document using the adjusted reading definition; An information processing program for executing processing.

6. A computer comprising: Accepting settings of a reading definition, which is a definition to be used when reading information from a first document in which information has been written or input in predetermined items; displaying a result of scanning a second document, which is the same type as the first document and has information written or input in predetermined items, using the scanning definition; When the second document to be read using the reading definition is not found as a result of searching for the second document, a message indicating that the second document was not found and a button for continuing the search for the second document are displayed; If the button is operated while the message indicating that the second document was not found is displayed, the search for the second document is continued. An information processing program for executing processing.

Images