Information Processing Apparatus and Information Processing Program

Abstract

To provide a function of assisting a user to verify and / or correct results of reading information written or entered at a predetermined item.SOLUTION: An information processing apparatus includes a processor configured to: display, on one screen, information written or entered at multiple predetermined items and a read result of reading the information from the items such that which piece of the information or the read result is displayed is changeable on a per item basis; and perform a function of assisting a user to at least verify or correct the read result on the displayed one screen.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to an information processing apparatus and an information processing program.

Background Art

[0002] Patent Document 1 describes a character recognition apparatus that eliminates frequent line-of-sight movement in character recognition processing and the associated operation complexity.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] When reading information entered or input into predetermined items by OCR (= Optical Character Recognition) processing, since the accuracy of the OCR processing is not 100%, at least one of the operations of confirmation and correction by the user is often performed. At this time, the more work is done by the user, the more labor costs are required, so it is desirable to complete the work by the user in a short time.

[0005] Therefore, an object of the present invention is to provide a function for assisting at least one of the operations of confirmation and correction performed by the user with respect to the result of reading information entered or input into predetermined items.

Means for Solving the Problems

[0006] The information processing apparatus according to the first aspect includes a processor, and the processor switches and displays on one screen the information entered or input in a plurality of predetermined items and the reading results of the information in the plurality of items, and executes a function of assisting at least one of confirmation and correction of the reading results by the user on the displayed one screen.

[0007] The information processing apparatus according to the second aspect is the first information processing apparatus, and the function is a first function of displaying the information and the reading results adjacent to each other on the one screen and accepting switching by the user between a display state in which the reading results are displayed and a non-display state in which the reading results are not displayed.

[0008] The information processing apparatus according to the third aspect is the second information processing apparatus, and when the processor executes the first function, in addition to the information and the reading results, the processor displays a correction unit for accepting correction of the reading results by the user on the one screen.

[0009] The information processing apparatus according to the fourth aspect is the third information processing apparatus, and when the processor accepts correction of the reading results using the correction unit, the processor switches the reading results to the non-display state.

[0010] The information processing apparatus according to the fifth aspect is the information processing apparatus according to any one of the second to fourth aspects, and when the processor executes the first function, the processor displays on the one screen adjacent to each other the plurality of reading results in which the same content is displayed and the information corresponding to the plurality of reading results, and when accepting correction of a first reading result among the plurality of reading results on the displayed one screen, the processor switches a second reading result other than the first reading result to the non-display state.

[0011] The information processing apparatus according to the sixth aspect is the information processing apparatus according to any one of the first to fifth aspects, and the function is a second function of displaying the information and the reading results in the same display area before and after switching the information and the reading results displayed on the one screen.

[0012] The information processing apparatus according to the seventh aspect is the information processing apparatus according to the sixth aspect, and when the processor executes the second function, the processor causes the information and the reading result to be displayed in the same display size.

[0013] The information processing apparatus according to the eighth aspect is the information processing apparatus according to the seventh aspect, and when the display sizes of the information and the reading result are smaller than a predetermined first size, in addition to the information and the reading result, the processor causes a correction unit for receiving a correction of the reading result by the user to be displayed, and causes a correction display displayed on the correction unit to be displayed on the single screen in a second size larger than the first size.

[0014] The information processing apparatus according to the ninth aspect is the information processing apparatus according to any one of the first to eighth aspects, and the function is a third function for switching the information and the reading result displayed on the single screen when a predetermined switching operation is received once.

[0015] The information processing apparatus according to the tenth aspect is the information processing apparatus according to the ninth aspect, and when the processor receives the switching operation once when a part of the information and the reading result for each item is displayed on the single screen, as the third function, the processor switches the information and the reading result to display another part of the information and the reading result for each item.

[0016] The information processing apparatus according to the eleventh aspect is the information processing apparatus according to any one of the first to tenth aspects, and the function is a fourth function for setting the single screen to a non-display state in which the reading result is not displayed when a predetermined input operation is received, and displaying input content corresponding to the received input operation in a display area for displaying the reading result on the single screen.

[0017] The information processing apparatus according to the twelfth aspect is the eleventh information processing apparatus, and when the processor receives a special operation different from the input operation, as the fourth function, the single screen is set to a display state in which the reading result is displayed, and accepts a correction by the user using the reading result being displayed.

[0018] The information processing program according to the thirteenth aspect causes a computer to switch and display on a single screen the information entered or input in a plurality of predetermined items and the reading results of the information read from the plurality of items, and in the displayed single screen, execute a process of executing a function of assisting at least one of confirmation and correction of the reading result by the user.

Advantages of the Invention

[0019] According to the first aspect, a function is provided to assist at least one of the confirmation and correction operations performed by the user with respect to the result of reading the information entered or input in the predetermined items.

[0020] According to the second aspect, the presence or absence of the display of the reading result displayed adjacent to the information entered or input in the predetermined items on a single screen is switched.

[0021] According to the third aspect, while confirming the information and the reading results entered or input in a plurality of predetermined items displayed on the same screen, the user can be made to perform a correction operation on the reading result.

[0022] According to the fourth aspect, compared with a configuration in which an instruction to switch the reading result to a non-display state and an instruction to accept correction of the reading result using the correction unit are separate, the man-hour of the correction operation of the reading result by the user is reduced.

[0023] According to the fifth aspect, the presence or absence of the display of some of the plurality of reading results displayed adjacent to the information entered or input in the predetermined items on a single screen is switched.

[0024] According to the sixth aspect, compared with a configuration in which information entered or input into a plurality of predetermined items before and after switching and the reading result are displayed in different display areas, the user's eye movement when checking the reading result is reduced.

[0025] According to the seventh aspect, compared with a configuration in which the display sizes of information entered or input into a plurality of predetermined items and the reading result are different, the user's eye movement when checking the reading result is reduced.

[0026] According to the eighth aspect, compared with a configuration in which only characters and symbols smaller than a predetermined first size are displayed on one screen, the visibility of the user when checking the reading result is enhanced.

[0027] According to the ninth aspect, compared with a configuration that requires a plurality of operations by the user when switching the information entered or input into a plurality of predetermined items displayed on one screen and the reading result, the man-hour of the user's work for checking the reading result is reduced.

[0028] According to the tenth aspect, compared with a configuration in which the switching of the information entered or input into a plurality of predetermined items displayed on one screen and the reading result is always performed for each item for which information has been read, the man-hour of the user's work for checking the reading result is reduced.

[0029] According to the eleventh aspect, compared with a configuration in which the instruction for making the displayed reading result non-displayed and the instruction for displaying the input content according to the input operation are separate, the man-hour of the user's work for correcting the reading result is reduced.

[0030] According to the twelfth aspect, compared with a configuration in which the displayed reading result always becomes non-displayed without exception by the user's operation, the man-hour of the user's work for correcting the reading result is reduced.

[0031] According to the thirteenth aspect, a function is provided to assist at least one of the confirmation and correction operations performed by the user on the result of reading the information entered or input into the predetermined item.

Brief Description of Drawings

[0032]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Figure 21

Figure 22

Figure 23

Figure 24

Figure 25

Mode for Carrying Out the Invention

[0033] (First Embodiment) Hereinafter, the information processing apparatus 20 according to the present embodiment will be described. FIG. 1 is a block diagram showing the hardware configuration of the information processing apparatus 20. As an example, the information processing apparatus 20 is applied to a general-purpose computer device such as a server computer or a personal computer, or a mobile terminal such as a smartphone or a tablet terminal.

[0034] As shown in FIG. 1, the information processing apparatus 20 includes a CPU 21 (= Central Processing Unit), a ROM 22 (= Read Only Memory), a RAM 23 (= Random Access Memory), a storage unit 24, an input unit 25, a display unit 26, and a communication unit 27. Each configuration is connected to be communicable with each other via a bus 28. The CPU 21 is an example of a "processor".

[0035] The CPU 21 is a central processing unit that executes various programs and controls each part. That is, the CPU 21 reads a program from the ROM 22 or the storage unit 24 and executes the program using the RAM 23 as a working area. The CPU 21 performs control of each of the above configurations and various arithmetic processes according to the program stored in the ROM 22 or the storage unit 24. In the present embodiment, the ROM 22 or the storage unit 24 stores at least an information processing program for executing the first execution process, the second execution process, the third execution process, and the fourth execution process described later. Note that the information processing program may be pre-installed in the information processing apparatus 20, or may be stored in a non-volatile storage medium, or distributed via a network, and appropriately installed in the information processing apparatus 20. Examples of non-volatile storage media include CD-ROMs, magneto-optical disks, HDDs (= Hard Disk Drives), DVD-ROMs, flash memories, memory cards, and the like.

[0036] The ROM 22 stores various programs and various data. The RAM 23 temporarily stores a program or data as a working area.

[0037] The storage unit 24 is composed of a storage device such as an HDD, an SSD (= Solid State Drive), or a flash memory, and stores various programs including an operating system and various data.

[0038] The input unit 25 includes, for example, a pointing device such as a mouse, various buttons, a keyboard, a microphone, and a camera, and is used to perform various inputs.

[0039] The display unit 26 is, for example, a liquid crystal display and displays various information. The display unit 26 may adopt a touch panel method and function as the input unit 25.

[0040] The communication unit 27 is an interface for communicating with other devices. For this communication, for example, a standard for wired communication such as Ethernet (registered trademark) or FDDI, or a standard for wireless communication such as 4G, 5G, or Wi-Fi (registered trademark) is used.

[0041] When executing the above information processing program, the information processing apparatus 20 executes processing based on the information processing program by using the above hardware resources.

[0042] Next, the flow of OCR processing performed by the information processing apparatus 20 will be described. Hereinafter, as a premise, it is assumed that a plurality of documents in which text such as characters and symbols are entered or input in a plurality of predetermined items are converted into image data by using the FAX function and the scan function of an image forming apparatus (not shown), and the image data is available for OCR processing.

[0043] In OCR processing, a reading range, which is a range for reading image data of a document to be read, is set. Then, in OCR processing, the image data included in the set reading range is read, and the result is displayed as text as the reading result.

[0044] Also, in OCR processing, when one job, which is an execution unit of the process of reading the image data included in the reading range, is executed, the image data included in the reading range of each of a plurality of sheets (e.g., 10 sheets) of documents is read. And in the first embodiment, a plurality of reading ranges for reading the image data for each of a plurality of predetermined items for each document to be read are set.

[0045] Examples of documents used in the first embodiment are shown below. FIG. 2 shows an example of a document to be read for the first job. FIG. 2(A) shows the document P1 to be read first in the first job, FIG. 2(B) shows the document P2 to be read second in the first job, and FIG. 2(C) shows the document P3 to be read tenth in the first job. Also, the documents P1 to P3 are documents in a fixed format with a similar layout for each document.

[0046] As shown in FIGS. 2(A) to (C), in the documents P1 to P3, rectangular frames located on the right side of each character of "Item 1", "Item 2", "Item 3", "Item 4", and "Item 5" described in each document are set as the reading range.

[0047] FIG. 3 shows an example of a document to be read for the second job. FIG. 3(A) shows the document P4 to be read first in the second job, FIG. 3(B) shows the document P5 to be read second in the second job, and FIG. 3(C) shows the document P6 to be read third in the second job. Also, the documents P4 to P6 are documents in an irregular format with different layouts for each document.

[0048] In FIG. 3(A), rectangular frames located on the right side of each character of "Item 1", "Item 2", and "Item 3" described in the document P4 are set as the reading range. In FIG. 3(B), rectangular frames located on the right side of each character of "Item A", "Item I", and "Item U" described in the document P5 are set as the reading range. In FIG. 3(C), rectangular frames located on the right side of each character of "Item α" and "Item β" described in the document P6 are set as the reading range.

[0049] Then, in the OCR process, regardless of whether the layouts of the documents included in a job are the same or not, the information processing device 20 reads the image data included in each frame set as the reading range, and displays the result as text in the reading result.

[0050] An example of the reading result of the image data included within the reading range in the OCR process is shown below. FIG. 4 is an example showing the reading results of the image data included within the reading ranges of documents P1 to P3 in tabular form. Further, FIG. 5 is an example showing the reading results of the image data included within the reading ranges of documents P4 to P6 in tabular form. In FIGS. 4 and 5, each document included in one job is associated with each item in each document, and the reading results obtained by reading the image data included within the reading range corresponding to each item and showing it in text are displayed.

[0051] Here, the accuracy that the reading result in the OCR process matches the text pre-entered or input in the document that is the reading target corresponding to the reading result is not 100%. Therefore, in the OCR process, at least one of the operations of confirmation and correction by the user of the displayed reading result (hereinafter referred to as "confirmation and correction operation") is often performed. At this time, since more confirmation and correction operations by the user require more labor costs, it is desirable to complete the confirmation and correction operation in a short time.

[0052] Therefore, in the information processing apparatus 20 in the first embodiment, as a function of assisting the confirmation and correction operation performed by the user on the reading result in the OCR process, the first function described below is executed.

[0053] FIG. 6 is a flowchart showing the flow of the first execution process in which the first function is executed by the information processing apparatus 20. The first execution process is performed by the CPU 21 reading an information processing program from the ROM 22 or the storage unit 24, expanding it in the RAM 23, and executing it.

[0054] In step S10 shown in FIG. 6, the CPU 21 starts the OCR process and reads the image data included within the reading ranges of a plurality of documents included in one job. Then, it proceeds to step S11.

[0055] In step S11, the CPU 21 causes the document information described below for each item of the document and the reading result of the image data of the document information to be displayed adjacent to a confirmation screen 30 described below on the display unit 26. Then, the process proceeds to step S12.

[0056] In step S12, the CPU 21 accepts a user's switching between a display state in which the reading result is displayed and a non-display state in which the reading result is not displayed for the display mode of the reading result on the confirmation screen 30. Then, the process ends. In the first embodiment, a plurality of methods for the user to switch between the display state and the non-display state are provided. This method will be described later.

[0057] Next, a display example of the display unit 26 in the first embodiment will be described. FIG. 7 is a first display example displayed on the display unit 26 of the information processing apparatus 20.

[0058] On the display unit 26 shown in FIG. 7(A), a first display example of a confirmation screen 30 for allowing the user to confirm the reading result in the OCR process is displayed. As an example, the confirmation screen 30 is displayed by a mouse operation as the input unit 25 of the user. Specifically, the CPU 21 displays the confirmation screen 30 when a predetermined icon (not shown) for displaying the confirmation screen 30 on the display unit 26 is selected by a left click. Note that the confirmation screen 30 is displayed on one screen of the display unit 26 and is an example of "one screen".

[0059] On the confirmation screen 30 shown in FIG. 7(A), an information display unit 31, a result display unit 32, and a non-display button 33 are displayed.

[0060] The information display unit 31 is a part where document information, which is information entered or input in a plurality of predetermined items of the document to be read on the confirmation screen 30, is displayed.

[0061] The result display unit 32 is a part where the reading result of the image data of the document information included in the reading range of the document to be read is displayed on the confirmation screen 30.

[0062] In the first embodiment, as shown in FIG. 7(A), the CPU 21 displays the document information displayed within the frame of the information display unit 31 and the reading result displayed within the frame of the result display unit 32 adjacent to each other vertically. Also, "displayed adjacent to each other" means that the distance h between the above-mentioned document information and the reading result is "less than or equal to the height of the rectangular frame of the information display unit 31 or the result display unit 32" or "less than or equal to the height of the text of the document information or the reading result". In the first embodiment, as the above-mentioned "displayed adjacent to each other", the distance h between the above-mentioned document information and the reading result is set to be "less than or equal to the height of the rectangular frame of the result display unit 32". Then, when the non-display button 33 is operated during the display of the confirmation screen 30 shown in FIG. 7(A), the CPU 21 switches the display mode of the reading result to the non-display state and deletes the result display unit 32 from the confirmation screen 30. That is, the non-display state in the first embodiment is a state in which the user cannot visually recognize the reading result by deleting the result display unit 32 from the confirmation screen 30.

[0063] On the display unit 26 shown in FIG. 7(B), a second display example of the confirmation screen 30 is displayed. FIG. 7(B) shows the state after the non-display button 33 is operated during the display of the confirmation screen 30 shown in FIG. 7(A).

[0064] On the display unit 26 shown in FIG. 7(B), since the result display unit 32 has been deleted from the confirmation screen 30, the text of "D", which is a part of the document information that could not be visually recognized in FIG. 7(A), has become visible. And the user who sees the confirmation screen 30 shown in FIG. 7(B) can confirm that "D" was included between "B" and "C" in the text pre-entered or input in the document to be read.

[0065] Here, the document to be read in FIG. 7 was once entered or input as "ABC" within the frame, but since the originally intended text was "ABDC", "D" was later added outside the frame. In such a case, when the document information and the reading result are displayed adjacent to each other, as shown in FIG. 7(A), the portion added outside the frame of the above-mentioned document is covered by the result display unit 32 and cannot be visually recognized.

[0066] In general OCR processing, in order to convert image data included within a frame set as a reading range into read text, portions written or input outside the frame are often not converted into text. As a result, in a configuration where the read result is always displayed when document information and the read result are displayed adjacent to each other (hereinafter referred to as "comparison configuration 1"), there is a risk that the user may overlook portions added outside the frame of the above document during the confirmation and correction operation. Also, in comparison configuration 1, there is also a possibility that, after the user has once completed the confirmation and correction operation, if a portion added outside the frame of the above document is discovered, it may be necessary to perform the confirmation and correction operation by the user again.

[0067] In the first embodiment, the CPU 21 switches and causes to be displayed on the confirmation screen 30 the document information written or input in a plurality of predetermined items of the document to be read, and the read result obtained by reading the image data of the document information included within the reading range, for each item of the document, the document information and the read result. Then, on the displayed confirmation screen 30, the CPU 21 executes a first function of displaying the document information and the read result adjacent to each other and accepting a user's switching between a display state in which the read result is displayed and a non-display state in which it is not displayed. Note that the above "written or input in an item" includes, in addition to writing or input within a frame corresponding to the item, writing or input outside the frame that protrudes from the frame corresponding to the item (see FIG. 7(B)).

[0068] According to the above configuration, according to the first embodiment, a function is provided to assist the user in performing the confirmation and correction work on the reading result. According to the first embodiment, by executing the above first function, the presence or absence of the display of the reading result displayed adjacent to the document information on the confirmation screen 30 is switched. And according to the first embodiment, when the user switches the reading result to the non-display state, the portion protruding from the frame corresponding to the item of the above document can also be confirmed. Therefore, compared with the comparative configuration 1, the oversight of the document information of the above document is suppressed. Further, according to the first embodiment, in addition to the above configuration, since the document information and the reading result are displayed adjacent to each other, it becomes easy to compare the document information and the reading result. Therefore, compared with the comparative configuration 1, the man-hours for the user to confirm and correct the reading result are reduced.

[0069] FIG. 8 is a second display example displayed on the display unit 26 of the information processing apparatus 20. On the display unit 26 shown in FIG. 8(A), a third display example of the confirmation screen 30 is displayed. On the confirmation screen 30 shown in FIG. 8(A), an information display unit 31, a result display unit 32, a non-display button 33, and a correction unit 34 are displayed. Note that the document information displayed on the information display unit 31 shown in FIG. 8(A) and the reading result displayed on the result display unit 32 are the same as those in FIG. 7(A).

[0070] The correction unit 34 is a portion where text having the same content as the reading result displayed on the result display unit 32 is displayed so as to be modifiable on the confirmation screen 30.

[0071] In order to perform the correction work as the confirmation and correction work of the reading result by the user, it is necessary to provide a function that enables the correction input of the reading result on the confirmation screen 30. Therefore, in the first embodiment, the CPU 21 accepts the correction of the reading result by the user using the correction unit 34.

[0072] On the display unit 26 shown in FIG. 8(B), a fourth display example of the confirmation screen 30 is displayed. FIG. 8(B) shows a state after the reading result has been corrected by the user using the correction unit 34 with respect to the confirmation screen 30 shown in FIG. 8(A).

[0073] In the correction part 34 shown in FIG. 8(B), text of "D" is added between "B" and "C" which were displayed as "ABC" in the correction part 34 shown in FIG. 8(A). At this time, the user can operate the non-display button 33 to delete the result display part 32 from the confirmation screen 30, and as shown in FIG. 8(B), while visually recognizing a part of the document information that could not be visually recognized in FIG. 8(A), the reading result can be corrected using the correction part 34.

[0074] As described above, when the CPU 21 executes the first function, in addition to the document information and the reading result, the correction part 34 is displayed on the confirmation screen 30. In the first embodiment, the text displayed as the document information and the reading result cannot be corrected, but the text displayed in the correction part 34 can be corrected. Therefore, the reading result can be corrected using the correction part 34. Therefore, according to the first embodiment, while confirming the document information and the reading result displayed on the same screen, the user can be made to perform the confirmation and correction work of the reading result.

[0075] Note that the correction part 34 may be pre-displayed with text having the same content as the reading result displayed on the result display part 32 as shown in FIG. 8(A), or the initial state of the correction part 34 may be a blank without text being displayed.

[0076] FIG. 9 is a third display example displayed on the display part 26 of the information processing apparatus 20. On the display part 26 shown in FIG. 9(A), a fifth display example of the confirmation screen 30 is displayed. On the confirmation screen 30 shown in FIG. 9(A), an information display part 31, a result display part 32, and a correction part 34 are displayed. Note that the document information displayed on the information display part 31 shown in FIG. 9(A) and the reading result displayed on the result display part 32 have the same content as those in FIG. 7(A).

[0077] Here, when the CPU 21 receives the correction of the reading result using the correction unit 34 during the display of the confirmation screen 30 shown in FIG. 9(A), it switches the display mode of the reading result to the non-display state and deletes the result display unit 32 from the confirmation screen 30. As an example, when the CPU 21 left-clicks on the text displayed on the correction unit 34 with the mouse and the caret 35 is displayed, the result display unit 32 is deleted from the confirmation screen 30.

[0078] The display unit 26 shown in FIG. 9(B) displays the sixth display example of the confirmation screen 30. FIG. 9(B) shows the state after the user has corrected the reading result using the correction unit 34 for the confirmation screen 30 shown in FIG. 9(A).

[0079] In the correction unit 34 shown in FIG. 9(B), the text "D" is added between "B" and "C" which were displayed as "ABC" in the correction unit 34 shown in FIG. 9(A). The addition of the text "D" is performed by the user's operation of the character keys on the keyboard as the input unit 25. At this time, in FIG. 9(B), unlike the confirmation screen 30 shown in FIG. 8, the result display unit 32 is deleted from the confirmation screen 30 without the user operating the non-display button 33. In the confirmation screen 30 shown in FIG. 9(B), based on the CPU 21 receiving the correction of the reading result using the correction unit 34, the reading result is switched to the non-display state, and the result display unit 32 is deleted from the confirmation screen 30. Therefore, according to the first embodiment, compared to the configuration where the instruction to switch the reading result to the non-display state and the instruction to receive the correction of the reading result using the correction unit 34 are separate, the man-hours for the user to confirm and correct the reading result are reduced.

[0080] Note that the reception of the correction of the reading result using the correction unit 34 is not limited to specifying by left-clicking on the text displayed on the correction unit 34 with the mouse, and it may also be specified by left-clicking on an arbitrary position within or on the frame of the correction unit 34 with the mouse.

[0081] FIG. 10 is the fourth display example displayed on the display unit 26 of the information processing apparatus 20. On the display unit 26 shown in FIG. 10(A), a seventh display example of the confirmation screen 30 is being displayed. On the confirmation screen 30 shown in FIG. 10(A), an information display unit 31 and result display units 32, 36 are being displayed.

[0082] Here, the document information displayed on the information display unit 31 shown in FIG. 10(A) and the reading results displayed on the result display units 32, 36 are the same as those in FIG. 7(A). However, on the confirmation screen 30 shown in FIG. 10, different from the confirmation screen 30 shown in FIG. 7, corrections using the reading results displayed on the result display units 32, 36 are possible.

[0083] Also, as shown in FIG. 10(A), the CPU 21 displays the document information displayed on the information display unit 31 adjacent to it while sandwiching it vertically with the reading results displayed on the result display units 32, 36.

[0084] During the display of the confirmation screen 30 shown in FIG. 10(A), when the CPU 21 receives a correction of one of the multiple reading results, the CPU 21 switches the other reading results among the multiple reading results to a non-display state and deletes the result display unit 32 or result display unit 36 on which the other reading results were displayed from the confirmation screen 30. As an example, when the CPU 21 left-clicks on the reading result displayed on the result display unit 32 or result display unit 36 and the caret 35 is displayed, the CPU 21 deletes the result display unit 32 or result display unit 36 on which the reading result where the caret 35 is not displayed was displayed from the confirmation screen 30.

[0085] On the display unit 26 shown in FIG. 10(B), an eighth display example of the confirmation screen 30 is being displayed. FIG. 10(B) shows the state after a user has corrected the reading result using the result display unit 36 with respect to the confirmation screen 30 shown in FIG. 10(A).

[0086] The result display section 36 shown in FIG. 10(B) has the text of "D" added between "B" and "C" which were displayed as "ABC" in the result display section 36 shown in FIG. 10(A). The addition of the text of "D" is performed by the user's operation of the character keys of the keyboard as the input section 25. At this time, in FIG. 10(B), since the result display section 32 has been deleted from the confirmation screen 30, the user can correct the reading result using the result display section 36 while confirming that "D" was included between "B" and "C" in the text pre-entered or input in the document to be read. In the above case, the reading result displayed on the result display section 36 becomes an example of the "first reading result", and the reading result displayed on the result display section 32 becomes an example of the "second reading result".

[0087] As described above, when the CPU 21 executes the first function, it causes the confirmation screen 30 to display a plurality of reading results in which the same content is displayed, and document information corresponding to the plurality of reading results, adjacent to each other. Then, when the CPU 21 receives the correction of one of the plurality of reading results on the displayed confirmation screen 30, it switches the display of the other reading results other than the one reading result to a non-display state. Thereby, according to the first embodiment, the presence or absence of the display of some of the plurality of reading results displayed adjacent to the document information on the confirmation screen 30 is switched. And according to the first embodiment, by making the user unable to visually recognize the reading results other than the correction target, it is possible to confirm the portion protruding from the frame corresponding to the item of the document to be read, so that overlooking of the document information of the above document is suppressed compared to the comparison configuration 1.

[0088] Next, a method of displaying the document information displayed on the information display section 31 in the first embodiment will be described.

[0089] FIG. 11 is an explanatory diagram of a method of displaying the document information displayed on the information display section 31 in the first embodiment.

[0090] FIG. 11(A) shows a document P7 to be read. As shown in FIG. 11(A), text is pre-entered or input in a plurality of items such as "Item 1" and "Item 2" in the document P7.

[0091] FIG. 11(B) shows a first display method in the information display unit 31 of the document information corresponding to each item of the document P7 shown in FIG. 11(A). In the first display method, the CPU 21 cuts out and displays an area including the text pre-entered or input in one item of the document P7. And, as an example in the first display method, when a predetermined icon (not shown) for displaying the next item on the display unit 26 is selected by a left click, the CPU 21 cuts out and displays an area including the text pre-entered or input in the next item of the document P7.

[0092] FIG. 11(C) shows a second display method in the information display unit 31 of the document information corresponding to each item of the document P7 shown in FIG. 11(A). The second display method is the same as the above-described first display method in that a part of the document P7 is displayed, but the method of displaying the text pre-entered or input in the next item is different. Specifically, in the second display method, the CPU 21 switches the area of the document P7 displayed on the information display unit 31 by operating the scroll bar 37 to scroll the screen.

[0093] In the first embodiment, on the confirmation screen 30, the document information and the reading result are displayed adjacent to each other vertically, but the direction of adjacency is not limited to this, and the document information and the reading result may be displayed adjacent to each other horizontally.

[0094] In the first embodiment, two reading results are displayed as a plurality of reading results on the confirmation screen 30, but it is not limited to this, and three or more reading results may be displayed on the confirmation screen 30.

[0095] (Second Embodiment) Next, a second embodiment of the information processing apparatus 20 will be described while omitting or simplifying overlapping parts with other embodiments.

[0096] In the information processing apparatus 20 according to the second embodiment, as a function of assisting the user in performing a confirmation and correction operation on the reading result in the OCR process, the second function described below is executed.

[0097] FIG. 12 is a flowchart showing the flow of the second execution process in which the second function is executed by the information processing apparatus 20. The second execution process is performed by the CPU 21 reading an information processing program from the ROM 22 or the storage unit 24, expanding it in the RAM 23, and executing it.

[0098] In step S20 shown in FIG. 12, the CPU 21 starts the OCR process and reads the image data included in each reading range of a plurality of documents included in one job. Then, it proceeds to step S21.

[0099] In step S21, the CPU 21 causes the document information for each item of the document and the reading result of the image data of the document information to be displayed on the confirmation screen 30 of the display unit 26. Then, it proceeds to step S22.

[0100] In step S22, the CPU 21 determines whether a switching operation for switching the document information and the reading result displayed on the confirmation screen 30 through the input unit 25 has been performed. If it is determined that the switching operation has been performed (step S22: YES), it proceeds to step S23. On the other hand, if it is determined by the CPU 21 that the switching operation has not been performed (step S22: NO), it waits until the switching operation is performed. In the second embodiment, as an example, the switching operation is an operation of the enter key or the tab key of the keyboard as the input unit 25.

[0101] In step S23, the CPU 21 switches the document information and the reading result displayed on the confirmation screen 30, and causes the document information and the reading result to be displayed in the same display area before and after the switching. Then, the process ends.

[0102] Next, a display example of the display unit 26 in the second embodiment will be described. FIG. 13 is a fifth display example displayed on the display unit 26 of the information processing apparatus 20.

[0103] On the display unit 26 shown in FIG. 13, a ninth display example of the confirmation screen 30 is displayed. On the confirmation screen 30 shown in FIG. 13, an information display unit 31 and a result display unit 32 are displayed near the center of the screen of the display unit 26. The rectangular frames of the information display unit 31 and the result display unit 32 are displayed in fixed positions, that is, the same display area, on the confirmation screen 30. And in FIG. 13, although not shown, document information of the document to be read is displayed within the frame of the information display unit 31, and a reading result of image data of document information included within the reading range of the document to be read is displayed within the frame of the result display unit 32.

[0104] Hereinafter, in the second embodiment, a case where document information and reading results for each of a plurality of items of the document P1 shown in FIG. 2(A) are switched and displayed will be described.

[0105] FIG. 14 is a sixth display example displayed on the display unit 26 of the information processing apparatus 20. FIG. 14(A) shows a tenth display example of the confirmation screen 30 in which document information and a reading result corresponding to "Item 1" of the document P1 are displayed, and FIG. 14(B) shows an eleventh display example of the confirmation screen 30 in which document information and a reading result corresponding to "Item 2" of the document P1 are displayed.

[0106] First, when a predetermined icon (not shown) for causing the CPU 21 to display the confirmation screen 30 on the display unit 26 is selected by a left click, the CPU 21 displays the confirmation screen 30 shown in FIG. 14(A). At this time, the CPU 21 causes the information display unit 31 and the result display unit 32 to display the text "ABC" corresponding to "Item 1" of the document P1 as document information and a reading result. Then, when the CPU 21 determines that a switching operation has been performed while the confirmation screen 30 shown in FIG. 14(A) is being displayed, the CPU 21 switches the document information and the reading result displayed on the confirmation screen 30. At this time, the CPU 21 causes the text "DEFG" corresponding to "Item 2" of the document P1 after switching to be displayed as document information and a reading result in the information display unit 31 and the result display unit 32, which are the same display areas as before switching. That is, in the second embodiment, since the display areas of the document information and the reading result are fixed within the respective frames of the information display unit 31 and the result display unit 32 near the center of the screen of the display unit 26, each document information and each reading result are displayed within the same frame before and after switching. And in the second embodiment, instead of displaying the document information and the reading result corresponding to a plurality of items of the document P1 within the frames of the information display unit 31 and the result display unit 32, the document information and the reading result corresponding to one item are displayed.

[0107] Here, in order to reduce the man-hours of the user's work for confirming and correcting the reading result, it is desirable to reduce the user's eye movement when confirming the reading result.

[0108] FIG. 15 is a display example of a confirmation screen 300 of a first comparative example (hereinafter referred to as "comparative configuration 2") in the second embodiment. The confirmation screen 300 shown in FIG. 15 displays an information display unit 310 and a result display unit 320.

[0109] In the information display unit 310 shown in FIG. 15, the texts "ABC" corresponding to "Item 1" of the document P1 and "DEFG" corresponding to "Item 2" are displayed vertically side by side as document information. Also, in the result display unit 320, a reading result corresponding to one item of the document P1 is displayed.

[0110] In the comparative configuration 2, as shown in FIG. 15(A), the text "ABC" displayed as document information and the text "ABC" displayed as the reading result are displayed adjacent to each other vertically. Also, in the comparative configuration 2, as shown in FIG. 15(B), the text "DEFG" displayed as document information and the text "DEFG" displayed as the reading result are displayed adjacent to each other vertically.

[0111] With the above configuration, in the comparative configuration 2, when checking a plurality of reading results, the user's line of sight will move vertically.

[0112] On the other hand, in the second embodiment, the CPU 21 executes a second function of displaying the document information and the reading result in the information display unit 31 and the result display unit 32, which are the same display areas, before and after switching the document information and the reading result displayed on the confirmation screen 30. Therefore, according to the second embodiment, compared with the configuration in which the document information and the reading result are displayed in different display areas before and after switching, the movement of the user's line of sight when checking the reading result is reduced.

[0113] Next, a second comparative example (hereinafter referred to as "comparative configuration 3") in the second embodiment will be described.

[0114] FIG. 16 is a display example of the confirmation screen 300 of the comparative configuration 3. On the confirmation screen 300 shown in FIG. 16, an information display unit 310 and a result display unit 320 are displayed. Note that the document information displayed on the information display unit 310 and the reading result displayed on the result display unit 320 shown in FIG. 16 have the same content as FIG. 15.

[0115] In the comparative configuration 3, as shown in FIG. 16(A), the display size of "ABC" displayed as document information is larger than the display size of "ABC" displayed as the reading result, and the display sizes of both are different. Also, in the comparative configuration 3, as shown in FIG. 16(B), the display size of "DEFG" displayed as document information is larger than the display size of "DEFG" displayed as the reading result, and the display sizes of both are different.

[0116] With the above configuration, in Comparative Configuration 3, it becomes difficult for the user to align the viewpoints of the text displayed as document information and the text displayed as the reading result at the same time. Therefore, in Comparative Configuration 3, as an example, after aligning the viewpoint with respect to the text displayed as the reading result, the line of sight is moved to align the viewpoint with respect to the text displayed as document information. Therefore, in Comparative Configuration 3, it is assumed that the user's line-of-sight movement increases when comparing the document information and the reading result.

[0117] In contrast, in the second embodiment, when the CPU 21 executes the second function, the document information and the reading result are displayed in the same display size.

[0118] Here, in the second embodiment, the display sizes corresponding to the width and height per text of the document information, and the height of the frames of the information display unit 31 and the result display unit 32 are set in advance and stored in the storage unit 24. And in the second embodiment, the following three types are provided as methods for making the document information and the reading result have the same display size.

[0119] Method 1 is a method using the existence range W and the number of texts N of the document information displayed on the information display unit 31. Taking FIG. 14(A) as an example, the existence range W is the width from the left end of "A" displayed as document information to the right end of "C", and the number of texts N is "3". At this time, as an example, when the existence range W is "3 cm", the width per text of the document information is calculated by dividing the existence range W by the number of texts N. In this case, the width per text of the document information is calculated as "1 cm". Then, the CPU 21 acquires the display size corresponding to the width of "1 cm" per text of the document information from the storage unit 24, and displays the reading result in the acquired display size.

[0120] Method 2 is a method that uses the height per text of the document information displayed on the information display unit 31. Taking Fig. 14(A) as an example, in Method 2, as an example, the CPU 21 calculates the average height of "A", "B", and "C" displayed as document information, obtains the display size corresponding to the calculated average height from the storage unit 24, and displays the reading result with the obtained display size.

[0121] Method 3 is a method that uses the height of the frames of the information display unit 31 and the result display unit 32. Taking Fig. 14(A) as an example, in Method 3, as an example, the CPU 21 calculates the average height of the frames of the information display unit 31 and the result display unit 32, obtains the display size corresponding to the calculated average height from the storage unit 24, and displays the reading result with the obtained display size.

[0122] With the above configuration, in the second embodiment, it is possible for the user to align the viewpoints of the text displayed as document information and the text displayed as the reading result at the same time. Therefore, according to the second embodiment, compared with a configuration in which the display sizes of the document information and the reading result are different, the user's eye movement when confirming the reading result is reduced.

[0123] Note that the above "similar display size" does not necessarily have to be exactly the same display size, and some differences are allowed. As an example, when the display size of the document information does not match the display size of the reading result prepared in advance, the CPU 21 displays the reading result in the display size closest to the display size of the above document information. Even in this case, the document information and the reading result are included in being displayed in the above "similar display size".

[0124] Also, when the display sizes of the document information and the reading result are smaller than a first size determined in advance, in addition to the document information and the reading result, the CPU 21 causes the correction unit 34 that accepts the correction of the reading result by the user to display it. Then, the CPU 21 displays a correction display, which is text with the same content as the reading result displayed on the correction unit 34, on the confirmation screen 30 in a second size larger than the first size.

[0125] FIG. 17 shows a seventh display example displayed on the display unit 26 of the information processing apparatus 20. On the display unit 26 shown in FIG. 17, a twelfth display example of the confirmation screen 30 is displayed. On the confirmation screen 30 shown in FIG. 17, an information display unit 31, a result display unit 32, and a correction unit 34 are displayed.

[0126] In the information display unit 31 shown in FIG. 17, the text of "ABCDEFGHIJKLMNOPQRTSTUVWXYZ" is displayed as document information, and in the result display unit 32, the text of "ABCDEFGHIJKLMNOPQRTSTUVWXYZ" is displayed as the reading result.

[0127] In the correction unit 34 shown in FIG. 17, "ABCDEFGHIJKLMNOPQRTSTUVWXYZ", which has the same content as the reading result, is displayed as a correction display so that it can be corrected.

[0128] Here, the display sizes of the document information and the reading result shown in FIG. 17 are smaller than the first size. Therefore, in addition to the document information and the reading result, the CPU 21 displays the correction unit 34 on the confirmation screen 30 and displays the correction display displayed on the correction unit 34 in a second size larger than the first size. Note that the second size is a fixed display size with high visibility for a predetermined user.

[0129] With the above configuration, according to the second embodiment, the visibility of the user when confirming the reading result can be improved as compared with the configuration in which only text smaller than the predetermined first size is displayed on the confirmation screen 30.

[0130] In the second embodiment, the switching operation is an operation of the enter key or the tab key of the keyboard as the input unit 25, but the switching operation is not limited to this. As an example, the switching operation may be a predetermined button operation displayed on the display unit 26, a mouse operation, or a keyboard operation different from the above enter key and tab key.

[0131] (Third Embodiment) Next, a third embodiment of the information processing apparatus 20 will be described while omitting or simplifying overlapping portions with other embodiments.

[0132] In the information processing apparatus 20 in the third embodiment, as a function of assisting the user's confirmation and correction work for the reading result in the OCR process, the third function described below is executed.

[0133] FIG. 18 is a flowchart showing the flow of the third execution process in which the third function is executed by the information processing apparatus 20. The third execution process is performed by the CPU 21 reading an information processing program from the ROM 22 or the storage unit 24, expanding it in the RAM 23, and executing it.

[0134] In step S30 shown in FIG. 18, the CPU 21 starts the OCR process and reads the image data included in each reading range of a plurality of documents included in one job. Then, it proceeds to step S31.

[0135] In step S31, the CPU 21 causes the document information for each item of the document and the reading result of the image data of the document information to be displayed on the confirmation screen 30 of the display unit 26. Then, it proceeds to step S32.

[0136] In step S32, the CPU 21 determines whether or not a switching operation for switching the document information and the reading result displayed on the confirmation screen 30 through the input unit 25 has been performed once. If it is determined that the switching operation has been performed once (step S32: YES), it proceeds to step S33. On the other hand, if it is determined by the CPU 21 that the switching operation has not been performed once (step S32: NO), it waits until the switching operation is performed once. In the third embodiment, as an example, the switching operation is the operation of the enter key or the tab key of the keyboard as the input unit 25, similar to the second embodiment.

[0137] In step S33, the CPU 21 switches and displays the document information and the reading result displayed on the confirmation screen 30, and then ends the process.

[0138] Next, a display example of the display unit 26 in the third embodiment will be described. FIG. 19 shows an eighth display example displayed on the display unit 26 of the information processing apparatus 20.

[0139] On the display unit 26 shown in FIG. 19(A), a 13th display example of the confirmation screen 30 is displayed. On the confirmation screen 30 shown in FIG. 19(A), an information display unit 31 and a result display unit 32 are displayed. In the information display unit 31 and the result display unit 32 shown in FIG. 19(A), the text "ABC" corresponding to "Item 1" of the document P1 shown in FIG. 2 is displayed as the document information and the reading result. When the CPU 21 determines that a switching operation has been performed once during the display of the confirmation screen 30 shown in FIG. 19(A), the CPU 21 switches the document information and the reading result displayed on the confirmation screen 30.

[0140] On the display unit 26 shown in FIG. 19(B), a 14th display example of the confirmation screen 30 is displayed. FIG. 19(B) shows a state after a switching operation has been performed once during the display of the confirmation screen 30 shown in FIG. 19(A). In the confirmation screen 30 shown in FIG. 19(B), the CPU 21 causes the information display unit 31 and the result display unit 32 to display the text "DEFG" corresponding to "Item 2" of the document P1 as the document information and the reading result. When the CPU 21 determines that a switching operation has been performed once during the display of the confirmation screen 30 shown in FIG. 19(B), the CPU 21 switches the document information and the reading result displayed on the confirmation screen 30.

[0141] On the display unit 26 shown in FIG. 19(C), a 15th display example of the confirmation screen 30 is displayed. FIG. 19(C) shows a state after a switching operation has been performed once during the display of the confirmation screen 30 shown in FIG. 19(B). In the confirmation screen 30 shown in FIG. 19(C), the CPU 21 causes the information display unit 31 and the result display unit 32 to display the text "HIJ" corresponding to "Item 3" of the document P1 as the document information and the reading result.

[0142] Here, in order to reduce the man-hours for the user to confirm and correct the reading result, it is desirable to speed up the switching of the reading result.

[0143] FIG. 20 is a display example of a confirmation screen 300 of a comparative example (hereinafter referred to as "comparative configuration 4") in the third embodiment. On the confirmation screen 300 shown in FIG. 20, an information display section 310, a result display section 320, and a next button 330 are displayed. In the information display section 310 and the result display section 320 shown in FIG. 20, the text "ABC" corresponding to "Item 1" of the document P1 shown in FIG. 2 is displayed as document information and a reading result.

[0144] In the comparative configuration 4, after the mouse is operated to move the mouse pointer onto the next button 330 during the display of the confirmation screen 300 shown in FIG. 20, when the mouse is left-clicked on the next button 330, the document information and the reading result displayed on the confirmation screen 300 are switched.

[0145] In a configuration where the document information and the reading result displayed by a button operation displayed on the display section 260 are switched as in the comparative configuration 4, a mouse operation is required. And generally, it is known that a mouse operation takes more time than a keyboard operation.

[0146] In recent years, the accuracy of OCR processing has improved, and the reading result is likely to match the text previously entered or input in the document to be read corresponding to the reading result, that is, the possibility that the reading result is correct has increased. Therefore, when the reading result is correct, it is desirable to switch to the next document information and reading result with a minimum of operations.

[0147] Therefore, in the third embodiment, when the CPU 21 receives an operation of the enter key or tab key of the keyboard as a switching operation once, it executes a third function of switching the document information and the reading result displayed on the confirmation screen 30. As a result, when the reading result is correct, the two operations of "confirming that the reading result is correct" and "switching to the next reading result" are completed with only one keyboard operation. Therefore, according to the third embodiment, compared with a configuration that requires a plurality of operations by the user when switching the document information and the reading result displayed on the confirmation screen 30, the man-hours for the user to confirm and correct the reading result are reduced.

[0148] Also, generally, the less the image data included in the reading range in the OCR process, for example, the shorter the text included in the reading range, the higher the possibility that the reading result is correct. On the contrary, the more the image data included in the reading range in the OCR process, for example, the longer the text included in the reading range, the lower the possibility that the reading result is correct. Therefore, when the text included in the reading range is long, due to some misrecognitions in the text, it may not be possible to complete the two operations of "confirming that the reading result is correct" and "switching to the next reading result" with only one keyboard operation.

[0149] Therefore, in the third embodiment, when the CPU 21 receives a switching operation once when a part of the document information and the reading result for each item of the document to be read is displayed on the confirmation screen 30, as the third function, it switches the document information and the reading result to display another part of the document information and the reading result for each item of the document.

[0150] FIG. 21 shows a document P8 to be read. As shown in FIG. 21, in the document P8, the texts of "ABCDE", "FGHIJK", "LMNO", "PQRST", and "UVWX" corresponding to one item are line-wrapped and pre-entered or input in the same frame line by line.

[0151] FIG. 22 shows a ninth display example displayed on the display unit 26 of the information processing apparatus 20. On the display unit 26 shown in FIG. 22(A), a 16th display example of the confirmation screen 30 is displayed. On the confirmation screen 30 shown in FIG. 22(A), an information display unit 31 and a result display unit 32 are displayed. Then, in the information display unit 31 and the result display unit 32 shown in FIG. 22(A), the text "ABCDE" pre-entered or input in the first line of the document P8 shown in FIG. 21 is displayed as document information and a reading result. When the CPU 21 determines that a switching operation has been performed once during the display of the confirmation screen 30 shown in FIG. 22(A), the CPU 21 switches the document information and the reading result displayed on the confirmation screen 30.

[0152] On the display unit 26 shown in FIG. 22(B), a 17th display example of the confirmation screen 30 is displayed. FIG. 22(B) shows a state after a switching operation has been performed once during the display of the confirmation screen 30 shown in FIG. 22(A). In the confirmation screen 30 shown in FIG. 22(B), the CPU 21 causes the information display unit 31 and the result display unit 32 to display the text "FGHIJK" pre-entered or input in the second line of the document P8 as document information and a reading result.

[0153] As described above, in the third embodiment, a plurality of texts pre-entered or input within the same frame are divided, and the divided texts are displayed on the information display unit 31 and the result display unit 32 as document information and a reading result. Thereby, in the third embodiment, even when the text included in the reading range is long, two operations, "confirmation that the reading result is correct" and "switching to the next reading result", can be completed with only one keyboard operation. Therefore, according to the third embodiment, compared with a configuration in which the switching of the document information and the reading result displayed on the confirmation screen 30 is always performed for each text included in the reading range, the man-hours for the user to confirm and correct the reading result are reduced.

[0154] In the third embodiment, the text is divided line by line, but the text division method is not limited to this. As an example, the text may be divided every N texts (e.g., every 3 texts), or may be divided by morpheme, word, clause, or sentence. At this time, the analysis of morphemes, words, clauses, and sentences in the text is performed using known techniques.

[0155] In the third embodiment, the switching operation is the operation of the enter key or tab key of the keyboard as the input unit 25, but the switching operation is not limited to this. As an example, the switching operation may be a mouse operation or a keyboard operation different from the above enter key and tab key.

[0156] (Fourth Embodiment) Next, a fourth embodiment of the information processing apparatus 20 will be described while omitting or simplifying overlapping parts with other embodiments.

[0157] In the information processing apparatus 20 according to the fourth embodiment, the fourth function described below is executed as a function for assisting the confirmation and correction work performed by the user on the reading result in the OCR process.

[0158] FIG. 23 is a flowchart showing the flow of the fourth execution process in which the fourth function is executed by the information processing apparatus 20. The fourth execution process is performed by the CPU 21 reading an information processing program from the ROM 22 or the storage unit 24, expanding it in the RAM 23, and executing it.

[0159] In step S40 shown in FIG. 23, the CPU 21 starts the OCR process and reads the image data included in each reading range of a plurality of documents included in one job. Then, it proceeds to step S41.

[0160] In step S41, the CPU 21 causes the document information for each item of the document and the reading result of the image data of the document information to be displayed on the confirmation screen 30 of the display unit 26. Then, it proceeds to step S42.

[0161] In step S42, the CPU 21 determines whether an input operation has been performed through the input unit 25 for correcting the reading result using the result display unit 32. If it is determined that the input operation has been performed (step S42: YES), the process proceeds to step S43. On the other hand, if it is determined by the CPU 21 that no input operation has been performed (step S42: NO), it waits until an input operation is performed. In the fourth embodiment, as an example, the input operation is an operation of a character key or a numeric key of the keyboard as the input unit 25.

[0162] In step S43, the CPU 21 switches the display mode of the reading result on the display unit 26 to the non-display state and deletes the reading result displayed on the result display unit 32 from the confirmation screen 30. Then, the process proceeds to step S44.

[0163] In step S44, the CPU 21 causes the result display unit 32 to display the input content corresponding to the input operation performed in step S42. Then, the process ends.

[0164] Next, a display example of the display unit 26 in the fourth embodiment will be described. FIG. 24 is a tenth display example displayed on the display unit 26 of the information processing apparatus 20.

[0165] On the display unit 26 shown in FIG. 24(A), the 18th display example of the confirmation screen 30 is displayed. On the confirmation screen 30 shown in FIG. 24(A), an information display unit 31 and a result display unit 32 are displayed. In the information display unit 31 shown in FIG. 24(A), the text "ABC" corresponding to "Item 1" of the document P1 shown in FIG. 2 is displayed as document information. In the result display unit 32 shown in FIG. 24(A), the text "XYZ" is displayed as a modifiable reading result.

[0166] As described above, on the confirmation screen 30 shown in FIG. 24(A), not a single text among the text displayed as document information and the text displayed as the reading result matches. When the CPU 21 determines that an input operation has been performed while the confirmation screen 30 shown in FIG. 24(A) is being displayed, the CPU 21 switches the display mode of the reading result in the display unit 26 to a non-display state and deletes the reading result displayed on the result display unit 32 from the confirmation screen 30. That is, in the non-display state in the fourth embodiment, the reading result displayed on the result display unit 32 is deleted from the confirmation screen 30, so that the user cannot visually recognize the reading result.

[0167] On the display unit 26 shown in FIG. 24(B), the 19th display example of the confirmation screen 30 is displayed. FIG. 24(B) shows the state after an input operation has been performed while the confirmation screen 30 shown in FIG. 24(A) is being displayed. On the confirmation screen 30 shown in FIG. 24(B), the CPU 21 deletes the reading result displayed on the confirmation screen 30 shown in FIG. 24(A) and displays the inside of the frame of the result display unit 32 as blank.

[0168] On the display unit 26 shown in FIG. 24(C), the 20th display example of the confirmation screen 30 is displayed. FIG. 24(C) shows the state after the input content corresponding to the input operation has been input to the result display unit 32 shown in FIG. 24(B).

[0169] In the result display unit 32 shown in FIG. 24(C), "ABC", which is the input content corresponding to the input operation, is added to the frame that was blank in the result display unit 32 shown in FIG. 24(B). Since the text displayed as document information and the text displayed as the reading result match, on the confirmation screen 30 shown in FIG. 24(C), the user's work of confirming and correcting the reading result is completed.

[0170] Here, in order to reduce the man-hours of the user's work of confirming and correcting the reading result, it is desirable to reduce the number of user operations when deleting the displayed reading result.

[0171] As an example, in a configuration where the displayed reading result is deleted by operating the delete key or backspace key of the keyboard, it is necessary to operate the character keys, numeric keys, etc. to input the correction content after deleting the reading result. Therefore, when the reading result does not match the text previously entered or input in the document to be read corresponding to the reading result, that is, when the reading result is incorrect, compared to the case where the reading result is correct, the man-hours for the confirmation and correction work increase by the amount of the above deletion operation.

[0172] Therefore, in the fourth embodiment, when the CPU 21 receives an input operation on the confirmation screen 30, it executes a fourth function of setting the non-display state where the reading result is not displayed, and causing the result display unit 32, which is a display area for displaying the reading result, to display the input content corresponding to the received input operation. Thereby, when the reading result is incorrect, two operations, "complete deletion of the reading result" and "input of the input content corresponding to the input operation", are completed with only one keyboard operation. Therefore, according to the fourth embodiment, compared to a configuration where the instruction for making the displayed reading result non-displayed and the instruction for displaying the input content corresponding to the input operation are separate, the man-hours for the user's confirmation and correction work of the reading result are reduced.

[0173] Also, if all the incorrect reading results are uniformly deleted, it may instead increase the man-hours for the confirmation and correction work. As an example, when the incorrect part of the reading result is one text, it may be more efficient to correct it using the reading result.

[0174] Therefore, in the fourth embodiment, when the CPU 21 receives a special operation different from the input operation, as a fourth function, it sets the display state where the reading result is displayed on the confirmation screen 30, and accepts correction by the user using the displayed reading result. In the fourth embodiment, as an example, the special operation is an operation of left-clicking and designating the reading result displayed on the result display unit 32 as the input unit 25 with the mouse.

[0175] FIG. 25 shows an eleventh display example displayed on the display unit 26 of the information processing apparatus 20. On the display unit 26 shown in FIG. 25(A), a twenty-first display example of the confirmation screen 30 is displayed. On the confirmation screen 30 shown in FIG. 25(A), an information display unit 31 and a result display unit 32 are displayed. And, in the information display unit 31 shown in FIG. 25(A), the text “ABC” corresponding to “Item 1” of the document P1 shown in FIG. 2 is displayed as document information. In the result display unit 32 shown in FIG. 25(A), the text “AC” is displayed as a readable result in a modifiable manner.

[0176] As described above, on the confirmation screen 30 shown in FIG. 25(A), the text displayed as document information and the text displayed as a readable result do not match, but the difference between the two is only that the text “B” is missing from the readable result.

[0177] Here, when the CPU 21 receives a special operation during the display of the confirmation screen 30 shown in FIG. 25(A), as a fourth function, it maintains the display state in which the readable result is displayed on the confirmation screen 30 and accepts correction by the user using the displayed readable result.

[0178] On the display unit 26 shown in FIG. 25(B), a twenty-second display example of the confirmation screen 30 is displayed. FIG. 25(B) shows the state after a special operation is performed during the display of the confirmation screen 30 shown in FIG. 25(A). On the confirmation screen 30 shown in FIG. 25(B), a caret 35 is displayed between “A” and “C” specified by a left click of the mouse, indicating that text can be added to the relevant part. And, when the CPU 21 receives an input operation during the display of the confirmation screen 30 shown in FIG. 25(B), it displays the input content corresponding to the input operation in the part where the caret 35 is displayed.

[0179] On the display unit 26 shown in FIG. 25(C), a twenty-third display example of the confirmation screen 30 is displayed. FIG. 25(C) shows the state after an input operation is performed during the display of the confirmation screen 30 shown in FIG. 25(B).

[0180] In the result display unit 32 shown in FIG. 25(C), text of "B" is added between "A" and "C" which were displayed as "AC" in the result display unit 32 shown in FIG. 25(B). And since the text displayed as document information and the text displayed as the reading result match, in the confirmation screen 30 shown in FIG. 25(C), the work of the user to confirm and correct the reading result has been completed.

[0181] With the above configuration, according to the fourth embodiment, compared with the configuration in which the reading result being displayed becomes non-displayed without exception by the user's operation, the man-hours for the user to confirm and correct the reading result are reduced.

[0182] Also, in the fourth embodiment, with the above configuration, it is possible to provide a combination of a function to delete all the reading results at once and accept an input, and a function to accept a correction using the reading result being displayed.

[0183] In the fourth embodiment, the special operation is defined as an operation of left-clicking and designating the reading result displayed on the result display unit 32 with a mouse as the input unit 25, but the special operation is not limited to this. As an example, the special operation may be an operation of left-clicking and designating an arbitrary position inside or on the frame of the result display unit 32 with a mouse, or a keyboard operation that is not used for input of text such as arrow keys.

[0184] (Others) In each of the above embodiments, the confirmation screen 30 is displayed on the display unit 26 of the information processing apparatus 20, but the terminal on which the confirmation screen 30 is displayed is not limited to the information processing apparatus 20. As an example, the information processing apparatus 20 executes at least one of the above-described first execution process, second execution process, third execution process, and fourth execution process, and the confirmation screen 30 corresponding to the result of the executed process may be displayed on the display screen of a server computer different from the information processing apparatus 20, a general-purpose computer device such as a personal computer, or a mobile terminal such as a smartphone or a tablet terminal.

[0185] In each of the above embodiments, the processor refers to a processor in a broad sense, including a general-purpose processor (e.g., CPU: Central Processing Unit, etc.) and a dedicated processor (e.g., GPU: Graphics Processing Unit, ASIC: Application Specific Integrated Circuit, FPGA: Field Programmable Gate Array, programmable logic device, etc.).

[0186] Also, the operation of the processor in each of the above embodiments may be achieved not only by one processor but also by a plurality of physically separated processors cooperating with each other. Also, the order of each operation of the processor is not limited to the order described in each of the above embodiments and may be changed as appropriate.

Description of Reference Numerals

[0187] 20 Information processing apparatus 21 CPU (an example of a processor)

Claims

1. Comprising a processor, The processor is configured to: Among the information entered or input into a plurality of predetermined items and the reading results of the information of the plurality of items, switch the information and the reading results for each item and display them on a single screen, Before and after switching the information and the reading results displayed on the single screen, execute a function of displaying the information and the reading results in the same display area respectively and displaying the information and the reading results in a similar display size, When the display sizes of the information and the reading results are smaller than a predetermined first size, in addition to the information and the reading results, display a correction unit that accepts correction of the reading results by the user, Display the correction display shown on the correction unit on the single screen in a second size larger than the first size, An information processing apparatus.

2. Comprising a processor, The processor is configured to: Among the information entered or input into a plurality of predetermined items and the reading results of the information of the plurality of items, switch the information and the reading results for each item and display them on a single screen, On the displayed single screen, execute a function of displaying the information and the reading results adjacent to the single screen and accepting switching by the user between a display state in which the reading results are displayed and a non-display state in which they are not displayed, When the function is executed, display a plurality of the reading results with the same content and the information corresponding to the plurality of reading results adjacent to the single screen, On the displayed single screen, when accepting correction of a first reading result among a plurality of the reading results, switch a second reading result other than the first reading result to the non-display state, An information processing apparatus.

3. In a computer, Among the information entered or input into a plurality of predetermined items and the reading results of the information of the plurality of items, switch the information and the reading results for each item and display them on a single screen, Before and after switching the information and the reading results displayed on the single screen, execute a function of displaying the information and the reading results in the same display area respectively and displaying the information and the reading results in a similar display size, When the display size of the said information and the said reading result is smaller than a predetermined first size, in addition to the said information and the said reading result, a correction unit that accepts correction of the said reading result by the user is displayed. The correction display displayed on the said correction unit is displayed on the said single screen in a second size larger than the said first size. An information processing program for executing processing.

4. On a computer, Among the information entered or input into a plurality of predetermined items and the reading results of the information of the plurality of items, the information and the reading results for each of the items are switched and displayed on a single screen. On the displayed single screen, the information and the reading result are displayed adjacent to the single screen, and a function is executed to accept switching by the user between a display state in which the reading result is displayed and a non-display state in which it is not displayed. When the said function is executed, a plurality of the said reading results with the same content displayed and the information corresponding to the plurality of the said reading results are displayed adjacent to the said single screen. On the displayed single screen, when correction of a first reading result among the plurality of the said reading results is accepted, the second reading result other than the first reading result is switched to the non-display state. An information processing program for executing processing.

Images