Information processing device and information processing program

Abstract

To provide an information processing device and an information processing program which reduce an operation amount of a user when setting a type in a business form image.SOLUTION: Type setting processing executed in an information processing device displays a business form image 1, a plurality of registered images 3 that has been registered in advance for each type of a business form and a setting button 4A that sets the type of the business form in the business form image 1 on a setting screen 4, and sets the type of the business form associated with the setting button 4A by a user to the business form image 1.SELECTED DRAWING: Figure 5

Description

[Technical field]

[0001] The present invention relates to an information processing device and an information processing program. [Background technology]

[0002] Patent document 1 discloses an information processing device that performs format discrimination on read document images and sorts them by document format, and includes a discrimination means that discriminates the format of a document image for which format discrimination is desired based on the similarity between the document image for which format discrimination is desired and a registered document image for which the document format is known, a storage means that stores judgment information for determining whether or not user confirmation is required for the result of the discrimination by the discrimination means, in association with the document image for which format discrimination has been performed, and a user interface means that presents document images that have been determined to require user confirmation based on the judgment information stored in the storage means, and prompts the user to confirm and correct the sorting. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2002-334333 A Summary of the Invention [Problem to be solved by the invention]

[0004] Since the information written on the document is difficult to utilize even if the document itself is saved, there is known an information processing device that performs OCR (Optical Character Recognition) processing on image data of the document to digitize and process the document information.

[0005] If the image data of a document is image data of a form having a predetermined format, i.e., a form image, the information processing device may determine the type of form image by comparing the form image with multiple registered images that are pre-registered for each type of form.

[0006] In this case, the information processing device may generate document images of unknown type whose type cannot be determined, or document images that have been determined to be of the wrong type, so the results of the information processing device's determination of the type of the document image are corrected by a human being by referring to registered images.

[0007] However, in a conventional correction operation for the type of a form image, the user displays a plurality of registered images on a screen one by one in order of similarity to the form image, and sets the type of the form image by comparing the form image with the registered image displayed on the screen. Therefore, the user needs to switch the screens on which the registered images are displayed until a screen on which a registered image that seems to be of the same type as the type of the form image is displayed is displayed.

[0008] The present invention aims to provide an information processing device and an information processing program that can reduce the amount of user operations when setting a type for a form image, compared to when setting a type for the form image by referring to multiple registered images while switching screens. [Means for solving the problem]

[0009] An information processing device according to a first aspect includes a processor, which displays on the same screen a form image for which a form type is to be set, a plurality of registered images pre-registered for each form type, and a setting operator for setting the form type to the form image, and sets the form type associated with the setting operator by a user who has referred to the plurality of registered images to the form image.

[0010] An information processing device according to a second aspect is the information processing device according to the first aspect, wherein the processor associates a type of form represented by a registered image selected by a user from among the plurality of registered images with the setting operator.

[0011] In a third aspect of the information processing device, in the information processing device of the second aspect, the processor scrolls through the multiple registered images and displays them sequentially on the screen in accordance with a user's instructions, and corresponds the type of document represented by the registered image displayed on the screen to the setting operator.

[0012] An information processing device according to a fourth aspect is an information processing device according to any one of the first to third aspects, wherein the processor further displays a selection operator on the screen for the user to select the form image, and when there are multiple form images, displays the form image selected by the user operating the selection operator on the screen.

[0013] An information processing device according to a fifth aspect is the information processing device according to the fourth aspect, wherein the processor displays on the screen, among the multiple form images, a form image for which no form type is set.

[0014] An information processing program according to a sixth aspect is a program that causes a computer to execute a process of displaying, on the same screen, a form image for which a form type is to be set, a plurality of registered images that are pre-registered for each form type, and a setting operator for setting the form type to the form image, and setting the form type that a user who has referred to the plurality of registered images has associated with the setting operator to the form image. Effect of the Invention

[0015] According to the first and sixth aspects, it is possible to reduce the amount of user operations required when setting a type for a form image, compared to when setting a type for the form image by referring to multiple registered images while switching screens.

[0016] According to the second aspect, there is an effect that the type of the form image can be associated with the setting operator without the user operating the setting operator.

[0017] According to the third aspect, there is an effect that the type of the form image can be associated with the setting operator simply by scrolling the registered image.

[0018] According to the fourth aspect, there is an effect that a different form image can be displayed on the screen without switching from the screen on which the reference image is displayed to another screen.

[0019] According to the fifth aspect, there is an effect that only form images of unknown type can be displayed on the screen without switching from the screen on which the registered image is displayed to another screen. [Brief description of the drawings]

[0020] [Figure 1] FIG. 1 is a diagram showing a schematic configuration of a form system. [Diagram 2] FIG. 13 is a diagram showing an example of a confirmation and correction screen. [Diagram 3] FIG. 2 is a diagram illustrating an example of the configuration of a main part of an electrical system in a computer constituting an information processing device. [Figure 4] 11 is a flowchart illustrating an example of a type setting process executed by the information processing device. [Diagram 5] FIG. 13 illustrates an example of a setting screen. [Figure 6] FIG. 13 is a diagram showing an example of how setting buttons are displayed. [Figure 7] FIG. 13 is a diagram showing an example of a confirmation and correction screen in which a type is set for each form image. [Figure 8] FIG. 13 is a diagram showing an example of a confirmation and correction screen in which each form image is classified into a record. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0021] Hereinafter, the present embodiment will be described with reference to the drawings. Note that the same components and processes are given the same reference numerals throughout the drawings, and duplicated explanations will be omitted.

[0022] FIG. 1 is a diagram showing a schematic configuration of a form system 10 according to this embodiment.

[0023] 1, a form system 10 includes an information processing device 20, a client terminal 40, and an input device 60. These devices are connected to a communication line (not shown) and can communicate with each other via the communication line. As an example of the communication line, the Internet, a LAN (Local Area Network), a WAN (Wide Area Network), etc. are applied.

[0024] The information processing device 20 performs OCR (Optical Character Recognition) processing on image data of documents including multiple forms input through the input device 60, and manages a series of processing flows for outputting the results of the OCR processing to a predetermined output destination. The specific configuration and operation of the information processing device 20 will be described later.

[0025] The client terminal 40 transmits various instructions related to the OCR process to the information processing device 20. The various instructions include, for example, an instruction to start reading information of image data, an instruction to display the result of reading information of image data, and the like. The client terminal 40 also displays various information such as the result of the OCR process performed by the information processing device 20 in response to the various received instructions, and notifications related to the OCR process. For example, the client terminal 40 is a general-purpose computer device such as a server computer or a personal computer (PC). Although only one client terminal 40 is illustrated in FIG. 1, this is not limiting, and multiple client terminals 40 may be prepared and, for example, the client terminals 40 may be used for different processes.

[0026] The input device 60 inputs image data to be subjected to OCR processing to the information processing device 20. Examples of the input device 60 include a general-purpose computer device such as a server computer or a PC, and an image forming device having a scanning function, a printer function, a FAX function, etc. In addition to the input device 60, image data may also be input to the information processing device 20 from the client terminal 40.

[0027] Next, an overview of the form system 10 will be described.

[0028] The form system 10 is a system in which an information processing device 20 performs OCR processing on image data input via an input device 60, and outputs the results of the OCR processing to a predetermined output destination.

[0029] In the OCR process, the information processing device 20 manages various processes, including (1) business design and operation verification, (2) data input, (3) data reading, (4) form discrimination, confirmation and correction, (5) reading result confirmation and correction, (6) business check, (7) data output, and (8) return. In this embodiment, the OCR process refers not only to the process of simply reading characters, symbols, etc. from image data, but also to post-processing such as character correction.

[0030] As an example of the management of various processes, (1) business design and operation verification, (2) data input, (3) data reading, (6) business check, and (7) data output processes are each automatically executed by the information processing device 20. Also, as an example of the management of various processes, (4) document discrimination, confirmation, and correction, and (5) reading result confirmation and correction processes are each accepted by input by the user via the client terminal 40. Also, as an example of the management of various processes, (8) return process may be automatically executed by the information processing device 20 or may be accepted by input by the user via the client terminal 40.

[0031] In the (1) business design and operation verification process, job rules are created that include read definition settings, output settings, and business check settings. In the read definition settings, as an example, a read range is set, which is the range in which image data information is read in the process of "(3) data reading". More specifically, as an example, a definition may be set such that the item value, which is the value, is read from near the right of the item extracted as the key. In the output settings, as an example, a file format and output destination of the output data output in the process of "(7) data output". In the business check settings, as an example, a format, such as the required input items and the number of characters that can be entered, in the form to be detected in the process of "(6) business check" are set.

[0032] In the (2) data input process, image data is accepted as an input from the input device 60. The accepted image data is registered as a job, which is an execution unit of the "(3) data reading" process.

[0033] (3) In the data reading process, the information of the image data in the job is read using a job rule for the job to be executed, selected by the user from the job rules created in the process of "(1) Business Design and Operation Verification." As an example, in this process, the form included in the image data in the job is identified (hereinafter referred to as "form identification") and characters and symbols within the reading range are read.

[0034] In the (4) form identification, confirmation, and correction process, the image data in the job is classified into records that indicate the forms included in the job based on the results of the form identification performed in the "(3) Data Reading" process. After that, in this process, the classified records are displayed and the user can confirm and correct the form identification.

[0035] (5) In the process of checking and correcting the read result, the read result of the characters and symbols within the read range obtained in the process of "(3) Data reading" is displayed, and the user can check and correct the read result.

[0036] In the (6) task check process, errors in each preceding process are detected by the task check setting included in the job rule for the job selected by the user from among the job rules created in the process of "(1) Task design and operation verification." The detection results may be presented to the user.

[0037] (7) In the data output process, output data is created using the output settings included in the job rules for the job selected by the user from the job rules created in the process of "(1) Business design and operational verification," and the created output data is output to a predetermined output destination.

[0038] In the (8) return process, the process executed in the OCR process is returned to the process one or more steps before. As an example, the return is instructed by the user from the client terminal 40 during the execution of various processes such as "(4) Document discrimination, confirmation, and correction" and "(5) Read result confirmation and correction." Also, as an example, the return is instructed from the client terminal 40 of the administrator depending on the result of the check by the administrator performed between the processes of "(6) Business check" and "(7) Data output."

[0039] In the above OCR processing, the process of "(1) business design and operation verification" is executed before the processes after "(3) data reading" are performed, i.e., before the form system 10 is put into operation. Furthermore, the process of "(1) business design and operation verification" may be executed during the operation of the form system 10, when the processes after "(3) data reading" are being performed. As an example, the job rules created in the process of "(1) business design and operation verification" before the operation of the form system 10 can be appropriately modified according to the results of the process of "(5) checking and correcting the reading results" during the operation of the form system 10.

[0040] Hereinafter, each piece of image data corresponding to a form will be referred to as a "form image 1." Also, a "job rule" is data that defines the processing content for a job, which is a reading unit of a form image 1 whose information is read at one time in the process of "(3) Data reading" in Fig. 1. Note that, since the information processing device 20 treats each of the form images 1 received from the input device 60 as a reading target whose information is read at one time in the process of "(3) Data reading" in Fig. 1, a job is also a collection of form images 1 received at one time from the input device 60 as a processing target in the information processing device 20.

[0041] 1, form discrimination in the process of "(3) Data reading" compares the form image 1 with a sample image (hereinafter referred to as "registered image 3") that is registered in advance for each type of form, and discriminates the type of the registered image 3 that is most similar to the form image 1 among the multiple registered images 3 as the type of the form image 1. To calculate the similarity between the form image 1 and the registered image 3, a known algorithm is applied, such as a pattern matching method using a feature vector or a template, or a method using a machine-learned neural network that takes images to be compared as input and outputs the similarity.

[0042] Although a job according to this embodiment may be a collection of form images 1 that are a collection of multiple form images 1 of the same type of form, as an example, the job will be described here as a collection of form images 1 that are a collection of multiple sets of form images 1 of an application form, each set of which includes multiple types of forms, such as "Form A-1" and "Form A-2." In other words, a job includes multiple types of form images 1. A collection of multiple types of form images 1 included in one set is called a "record."

[0043] Next, the process of "(4) document discrimination, confirmation, and correction" in the information processing device 20 will be described in detail.

[0044] As described above, the information processing device 20 classifies and displays the document images 1 in the job by record based on the results of the document discrimination performed in the process of "(3) Data Reading", and accepts user confirmation and correction of the document discrimination.

[0045] 2 is a diagram showing an example of a confirmation and correction screen 2 for accepting confirmation and correction of a document discrimination by a user. The information processing device 20 displays the confirmation and correction screen 2 on a client terminal 40 used by a user who has performed OCR processing.

[0046] In the example of Fig. 2, each form image 1 included in the job "Application D2-001" is displayed in the display area 2A together with the result of the form discrimination performed in the process of "(3) Data reading" in Fig. 1. Furthermore, a page number 2N is displayed on each form image 1 according to the order of the form images 1 in the job.

[0047] Among the form images 1, there may be some that are so unclear that the frame arrangement and characters cannot be read correctly in the process of "(3) Data reading", and some that are in an unknown format and have no corresponding registered image 3 registered in advance. In this case, "unknown" is displayed as the type of the form image 1. In other words, the type of the form image 1 being "unknown" indicates that no type has been set for the form image 1.

[0048] Furthermore, in the confirmation and correction screen 2, in order to display which form image 1 is combined with which form image 1 to form one set, the form images 1 are displayed by surrounding them with a frame line 2M on a record-by-record basis. In the example of the confirmation and correction screen 2 shown in FIG. 2, a combination of form images 1 of "Form A-1" and "Form A-2" is displayed as one record. Note that record classification is difficult when the type of form image 1 is unknown or when form images 1 of types "Form A-1" and "Form A-2" are not arranged in order. Therefore, such form images 1 are displayed on the confirmation and correction screen 2 without record classification display by the frame line 2M.

[0049] On the other hand, if all the form images 1 included in the job cannot be displayed in the display area 2A, the user operates the scroll bar 2B to display the remaining form images 1 that cannot be displayed on the confirmation and correction screen 2.

[0050] The user needs to check form images 1 that are displayed on the check and correction screen 2, particularly those whose types are unknown or those that are not classified into records (hereinafter, referred to as "form images 1 that need to be checked"). For this reason, the user may want to preferentially find form images 1 that need to be checked from among the multiple form images 1 that are displayed.

[0051] However, as the number of form images 1 displayed in the display area 2A of the confirmation and correction screen 2 increases, it becomes a time-consuming task for the user to visually view the display area 2A while operating the scroll bar 2B to find the form image 1 to be confirmed from among the multiple form images 1, coupled with the increased amount of operation of the scroll bar 2B. Therefore, search buttons 2C and 2D are displayed on the confirmation and correction screen 2.

[0052] When the user presses the search button 2C, the information processing device 20 searches among the multiple form images 1 for the form image 1 to be checked that is located before the form image 1 currently selected with a mouse or the like, i.e., the form image 1 to be checked that has been assigned a page number 2N smaller than the page number 2N of the selected form image 1 and that has the smallest difference from the page number 2N of the selected form image 1, and displays it in the display area 2A.

[0053] When the user presses the search button 2D, the information processing device 20 searches among the multiple form images 1 for a form image 1 that needs to be checked and is located behind the form image 1 currently selected with a mouse or the like, i.e., a form image 1 that needs to be checked and has a page number 2N that is larger than the page number 2N of the selected form image 1 and has a page number 2N that is the smallest in difference from the page number 2N of the selected form image 1, and displays it in the display area 2A.

[0054] If the job contains only one form image 1 to be confirmed, even if the user presses the search buttons 2C and 2D while the form image 1 to be confirmed is selected, the display of the form image 1 in the display area 2A does not change.

[0055] Note that the user's selection of the form image 1 includes not only an action of the user intentionally selecting the form image 1 with a mouse or the like, but also an action of the user operating the scroll bar 2B to display the form image 1 in the display area 2A. In other words, the form image 1 displayed in the display area 2A is also an example of the form image 1 selected by the user.

[0056] When the user finds a form image 1 of which the type is unknown, the user sets the type of the form image 1 of which the type is unknown while referring to the registered image 3 on a setting screen 4, which will be described in detail later.

[0057] In the job rules, the processing contents of each process in the information processing device 20 are defined, and therefore, for the process of "(4) Form discrimination, confirmation, and correction", a plurality of registered images 3 that the information processing device 20 refers to in order to discriminate the type of the form image 1 included in the job are defined. Therefore, when the user presses the comparison button 2F on the confirmation and correction screen 2, the plurality of registered images 3 that the information processing device 20 used to discriminate the type of the form image 1 are displayed on the setting screen 4, which will be described in detail later.

[0058] Furthermore, when the user confirms that a form image 1 has an error in record classification, the user performs a drag-and-drop operation on the form image 1 to change the order of the form image 1 so that the form image 1 is in the correct order with respect to the other form images 1 that together with the form image 1 make up a set of form images 1. When the order of the form images 1 is changed, the information processing device 20 updates the page number 2N of the form image 1 according to the new order of the changed form image 1.

[0059] Then, when the user presses the reclassification button 2E, the information processing device 20 reclassifies the form images 1 included in the job by record in accordance with the new arrangement order of the form images 1 on the confirmation and correction screen 2. The information processing device 20 displays the new classification result on the confirmation and correction screen 2 by surrounding each record of the form images 1 reclassified by record with a frame 2M.

[0060] Naturally, an unknown type of form image 1 cannot be classified into a record, and therefore an error is also observed in the classification of the records. Therefore, even if the user sets a correct type for an unknown type of form image 1, the user presses the reclassification button 2E to reclassify the form images 1 included in the job into record units.

[0061] In addition, images of documents other than forms that are registered in advance in the registered images 3 as targets for type discrimination may be mistakenly mixed in as form images 1. The type of such form images 1 is set to unknown and they are not classified by record, so the user can delete unnecessary form images 1 from the job and then press the reclassify button 2E.

[0062] The information processing device 20 displays information regarding confirmation and correction of such document images 1 that need to be confirmed in the information area 2K.

[0063] When a form image 1 of unknown type is included in a job, the information processing device 20 displays information in the information area 2K, such as "There was an unidentifiable page. Please check and correct the unknown page," to prompt the user to check and correct the type of the form image 1. In this case, the information processing device 20 may display the number of form images 1 of unknown type in the job in the information area 2K, such as "Unknown pages: 1 page," and each time the user sets a type for a form image 1 of unknown type, the number of form images 1 of unknown type may be reduced and displayed in the information area 2K.

[0064] When the user sets a type for a form image 1 whose type is unknown, the information processing device 20 displays operation guidance in the information area 2K to inform the user of what operation to perform next, such as "You have finished checking pages whose type is unknown. Please press the 'Reclassify' button. The form will be reclassified by record."

[0065] In addition, if a job includes a form image 1 that is not classified into a record, the information processing device 20 displays information in the information area 2K that prompts the user to check and correct the record in the form image 1, such as, for example, "There are pages that could not be classified by record. Please take one of the following actions: (1) Delete the pages and reclassify, or (2) Move the pages and reclassify."

[0066] In this case, the information processing device 20 may display in the information area 2K the number of form images 1 with erroneous record classification in the job, for example, "Pages not yet recorded: 1 page". Furthermore, the information processing device 20 may update the number of form images 1 with erroneous record classification and display it in the information area 2K every time the reclassification button 2E is pressed. Note that when the user performs a drag-and-drop operation to rearrange form images 1 that have already been made into records, the records including the rearranged form images 1 are temporarily released. Therefore, the information processing device 20 may increase the number of form images 1 with erroneous record classification and display it in the information area 2K every time the existing record classification is released by the user's operation.

[0067] When the user confirms that the type setting and record classification have been performed correctly for all form images 1 included in the job, he / she presses the Confirm button 2G to confirm the form discrimination and record classification for each form image 1 included in the job. Regarding this operation, when there are no form images 1 with an unknown type in the job and all form images 1 have been classified by record, the information processing device 20 may display, for example, "The form discrimination confirmation work is completed. Please press the OK button" in the information area 2K to inform the user of the next operation to be performed.

[0068] The user presses the Cancel button 2H when closing the confirmation and correction screen 2 without finalizing the form discrimination and record classification of each form image 1 included in the job. Also, when the user temporarily suspends the process of "(4) Form discrimination, confirmation and correction" and then resumes it, the user presses the Temporary save button 2J, and the state of the type and record classification set in the form image 1 at the time of pressing the Temporary save button 2J is saved in the storage device.

[0069] On the other hand, when the user presses the operation button 2L, a drop-down list is displayed with an operation menu related to checking and correcting the form image 1. The drop-down list displays an operation menu including, for example, "Reset" and "Retry."

[0070] The reset in the operation menu means canceling all the types and record classifications set in the form image 1 and returning to the state before the information processing device 20 performed form discrimination.

[0071] "Re-execute" in the operation menu means, for example, selecting a job rule other than the currently selected job rule and re-executing the form discrimination based on the newly selected job rule. The job rule to be used is specified by the user.

[0072] When the job rule is changed, the registered image 3 that the information processing device 20 refers to in order to determine the type of the form image 1 included in the job, for example, is changed in accordance with the change in the job rule, and therefore the accuracy of the form determination may be improved compared to before the job rule was changed. Therefore, for example, the operation button 2L is used when re-executing after resetting to have the information processing device 20 perform form determination according to another job rule.

[0073] The information processing device 20 that executes such document discrimination is configured using a computer 30, for example.

[0074] FIG. 3 is a diagram showing an example of the configuration of a main part of an electrical system in a computer 30 constituting the information processing device 20. As shown in FIG.

[0075] 1, a ROM (Read Only Memory) 32 that stores an information processing program that causes the computer 30 to function as the information processing device 20, a RAM (Random Access Memory) 33 that is used as a temporary working area for the CPU 31, a non-volatile memory 34, and an input / output interface (I / O) 35. The CPU 31, ROM 32, RAM 33, non-volatile memory 34, and I / O 35 are each connected via a bus 36.

[0076] The non-volatile memory 34 is an example of a storage device that maintains stored information even if the power supplied to the non-volatile memory 34 is cut off, and is, for example, a semiconductor memory or a hard disk. Information that needs to be stored even if the power supply to the information processing device 20 is cut off, such as the registered image 3, is stored in the non-volatile memory 34.

[0077] To the I / O 35, for example, a communication unit 37, an input unit 38, and a display unit 39 are connected.

[0078] The communication unit 37 is connected to a communication line and has a communication protocol for performing data communication with external devices, including the input device 60 and the client terminal 40, connected to the communication line.

[0079] The input unit 38 is a device that receives instructions from a user and notifies the CPU 31, and may be, for example, a button, a touch panel, a keyboard, or a mouse.

[0080] The display unit 39 is an example of a device that visually displays information processed by the CPU 31, and may be, for example, a liquid crystal display or an organic EL (Electro Luminescence) display.

[0081] When the information processing device 20 accepts user instructions from the client terminal 40 via the communication unit 37 and displays information processed by the information processing device 20 on the client terminal 40 via the communication unit 37, the input unit 38 and the display unit 39 are not necessarily required.

[0082] It should be noted that the nonvolatile memory 34 does not need to be built into the computer 30, and may be, for example, a portable storage device that is detachable from the computer 30. The nonvolatile memory 34 may also be provided in an external device, not in the computer 30. In this case, the computer 30 reads information stored in the nonvolatile memory 34 of the external device via the communication unit 37, and writes information to the nonvolatile memory 34 of the external device via the communication unit 37.

[0083] Next, a process of setting a type for a form image 1 whose type has been determined to be unknown in the form determination process of the information processing device 20 will be described.

[0084] 4 is a flowchart showing an example of a type setting process executed by the CPU 31 of the information processing device 20 when the user selects any one of the form images 1 whose type is unknown on the confirmation and correction screen 2 and presses the comparison button 2F. An information processing program that specifies the type setting process is stored in advance in, for example, the ROM 32 of the information processing device 20. The CPU 31 of the information processing device 20 reads the information processing program stored in the ROM 32 and executes the type setting process.

[0085] First, in step S10, the CPU 31 displays, on the display device of the client terminal 40, the setting screen 4 which is a screen for the user to set a type for a form image 1 whose type is unknown.

[0086] 5 is a diagram showing an example of the setting screen 4. The setting screen 4 displays a form image 1 of unknown type and multiple registered images 3 defined in the job rules. In the example of the setting screen 4 in FIG. 5, since the multiple registered images 3 defined in the job rules cannot be displayed on the setting screen 4 at once, the CPU 31 displays a scroll bar 4B so that the user can refer to the multiple registered images 3 on the setting screen 4.

[0087] There are no restrictions on the display form in which a plurality of registered images 3 are displayed on the setting screen 4, and the CPU 31 may thumbnail the registered images 3 and display all the registered images 3 at once on the setting screen 4. When the registered images 3 are displayed as thumbnails, the contents of the registered images 3 may become difficult to understand. Therefore, the CPU 31 may enlarge and display the thumbnail of the registered image 3 designated by the user. Naturally, even for registered images 3 that are not displayed as thumbnails, such as those displayed on the setting screen 4 of FIG. 5, when the user issues an enlargement instruction, the CPU 31 may enlarge and display the registered image 3 designated by the user.

[0088] Furthermore, the CPU 31 may display the form image 1 and the registered image 3 at the same size, and when the user performs a drag operation on the form image 1, the form image 1 may be displayed transparently so that the image behind the moving form image 1 at the overlapping position can be seen through. In this case, if the form image 1 and the registered image 3 both represent forms of the same type, the positions of the frame lines of each form in the form image 1 and the registered image 3 match, so that the user can check the similarity between the form image 1 and the registered image 3 from the result of superimposing the form image 1 and the registered image 3, and set the type of the form image 1.

[0089] Furthermore, the CPU 31 may convert the similarity between the form image 1 displayed on the setting screen 4 and each registered image 3, calculated in the form discrimination in the process of “(3) Data reading” in FIG. 1, into a numerical value and display it on the setting screen 4.

[0090] The CPU 31 displays on the same setting screen 4 the form image 1 for which the type is to be set, a plurality of registered images 3, a setting button 4A, a search button 4C, a search button 4D, a confirm button 4E, and a cancel button 4F.

[0091] The setting button 4A is an example of a setting operator for setting a type to the form image 1 displayed on the setting screen 4. When the user presses the setting button 4A, the CPU 31 displays a drop-down list showing the types of each registered image 3 used to identify the form in the “(3) Data Reading” process in FIG. 1.

[0092] FIG. 6 is a diagram showing an example of a drop-down list that is displayed when the user presses the setting button 4A.

[0093] "Form A-1", "Form A-2", "Form A-3", "Form B-1", and "Form B-2" in the drop-down list are character strings representing the types of registered images 3 defined in the job rules.

[0094] The user compares the form image 1 displayed on the setting screen 4 with each registered image 3, and selects a character string that is believed to be the type of the form image 1 displayed on the setting screen 4 from the drop-down list of the setting button 4A.

[0095] Note that "Attachment" in the drop-down list of the setting button 4A means that the form image 1 is not an image of a form as represented by the registered image 3, but an image of an attachment document, such as a driver's license or passport, that is attached to the form as an identification document. If the form image 1 is an image of an attachment document, the user selects "Attachment" from the drop-down list of the setting button 4A. This causes the CPU 31 to classify the records while ignoring the form image 1 for which "Attachment" has been set.

[0096] Also, "Delete" in the drop-down list of the setting button 4A is a setting for deleting images of documents that are not related to the form. The CPU 31 deletes the form image 1 for which "Delete" is set from the job and performs record classification.

[0097] "Unknown" in the drop-down list of the setting button 4A is a display type that is displayed in the drop-down list of the setting button 4A to indicate that the type of the form image 1 is unknown, and cannot be selected by the user.

[0098] When the user selects the type of form image 1 from the drop-down list of the setting button 4A, in step S20 of Fig. 4, the CPU 31 stops displaying the drop-down list of the setting button 4A and associates the type selected by the user from the drop-down list with the setting button 4A. For example, if the user selects the type of "Form A-1" from the drop-down list, "Form A-1" is displayed on the setting button 4A as shown in Fig. 5. That is, the type associated with the setting button 4A is displayed on the setting button 4A.

[0099] Thereafter, the user presses the confirm button 4E to confirm the type of the form image 1 as the selected type.

[0100] Therefore, in step S30, the CPU 31 determines whether or not the user has pressed the Confirm button 4E. If the user has pressed the Confirm button 4E, the process proceeds to step S40.

[0101] In step S40, the CPU 31 sets the type selected by the user, that is, the type associated with the setting button 4A, to the form image 1 as the type of the form image 1 whose type has been determined to be unknown.

[0102] On the other hand, if it is determined in the determination process of step S30 that the user has not pressed the confirmation button 4E, the process proceeds to step S50.

[0103] Since the user can change the selected type at any time, in step S50, CPU 31 determines whether the user has pressed Set button 4A again and selected a different type from the drop-down list of Set button 4A that is different from the type previously selected.

[0104] If the user has not selected a new type, the process proceeds to step S30, and the CPU 31 continues to monitor whether the user has pressed the enter button 4E.

[0105] On the other hand, if the user selects a new type, the process proceeds to step S20. As a result, the new type selected by the user is associated with the setting button 4A, and the new type selected by the user is displayed on the setting button 4A. When the user presses the confirmation button 4E in this state, the CPU 31 sets the new type associated with the setting button 4A to the form image 1 as the type of the form image 1 whose type has been determined to be unknown.

[0106] This completes the type setting process shown in FIG.

[0107] When the user presses the cancel button 4F, the CPU 31 closes the setting screen 4 without setting a type to the form image 1, and displays the confirmation and correction screen 2.

[0108] In the above, an example has been described in which the user selects the type of form image 1 from the drop-down list of the setting button 4A, but the user can also select the type of form image 1 by selecting a registered image 3. Specifically, the CPU 31 may associate the same type of registered image 3 selected by the user from among the multiple registered images 3 displayed on the setting screen 4 with the setting button 4A. In this case, even if the user does not press the setting button 4A to select the type of form image 1 from the drop-down list, the type of the selected registered image 3 can be associated with the setting button 4A simply by selecting the registered image 3 displayed on the setting screen 4.

[0109] In addition, when a user selects a registered image 3, the user may, for example, select the registered image 3 by pressing the registered image 3 with a mouse, but there are no restrictions on the method of selecting the registered image 3 as long as the method allows the user to identify which registered image 3 is being selected.

[0110] For example, as in the setting screen 4 shown in FIG. 5, when the CPU 31 scrolls and displays each registered image 3 on the setting screen 4 in sequence according to the user's operation of the scroll bar 4B, the CPU 31 may regard the registered image 3 displayed on the setting screen 4 as the registered image 3 selected by the user. Therefore, when the setting screen 4 is displayed, the type of the registered image 3 displayed first is selected as the initial value. Since the type of the registered image 3 selected by the user is associated with the setting button 4A, when the user operates the scroll bar 4B of the setting screen 4 to scroll and display the registered images 3, the type associated with the setting button 4A also changes in conjunction with the display of the registered image 3. As a result, the type displayed on the setting button 4A also changes in conjunction with the display of the registered image 3. This allows the user to select the type of the form image 1 simply by operating the scroll bar 4B.

[0111] In addition, when multiple registered images 3 are displayed on the setting screen 4 by a scroll operation, the CPU 31 may regard the registered image 3 displayed in a predetermined range, such as the center of the area where the scroll display is performed, as the registered image 3 selected by the user.

[0112] On the other hand, when the user presses the Search button 4C, similar to the Search button 2C on the confirmation and correction screen 2 shown in Fig. 2, a form image 1 of unknown type that is located before the form image 1 currently displayed on the setting screen 4 is searched for among the form images 1 in the job and displayed on the setting screen 4. Also, when the user presses the Search button 4D, similar to the Search button 2D on the confirmation and correction screen 2 shown in Fig. 2, a form image 1 of unknown type that is located after the form image 1 currently displayed on the setting screen 4 is searched for among the form images 1 in the job and displayed on the setting screen 4.

[0113] In other words, the search buttons 4C and 4D are examples of selection operators that allow the user to select a form image 1, and the user can select form images 1 of unknown type and display them sequentially on the setting screen 4 simply by operating on the setting screen 4 without switching the screen to the confirmation and correction screen 2.

[0114] Note that the operation when the user presses the search buttons 4C and 4D is an example. Even if a type is set for a form image 1, the correct type is not necessarily set. Therefore, when the user presses the search buttons 4C and 4D, the CPU 31 may select a form image 1 before or after the page number 2N of the form image 1 displayed on the setting screen 4 that is adjacent to the page number 2N, and display the selected form image on the setting screen 4.

[0115] Figure 7 shows an example of a confirmation and correction screen 2 after the type setting process shown in Figure 4 is performed on the document image 1 of unknown type shown in Figure 2 (document image 1 of the third page with page number 2N), and the type of "Document A-1" is set for document image 1 on setting screen 4.

[0116] By setting a type for the form image 1, the type of which is unknown, the information area 2K displays that the number of unknown pages has become 0, as shown in FIG.

[0117] Through the above process, the type of the form image 1, whose page number 2N is the 3rd page, has been set to "Form A-1", but the records have not yet been reclassified. Therefore, the user presses the Reclassify button 2E on the Confirm / Correct screen 2 to reclassify the form images 1 included in the job by record.

[0118] FIG. 8 is a diagram showing an example of the confirmation and correction screen 2 after the user presses the re-categorize button 2E on the confirmation and correction screen 2 shown in FIG.

[0119] 8, the example of the confirmation / correction screen 2 shows that the form image 1 on the 3rd page, which is set to the type "Form A-1," and the form image 1 on the 4th page have been classified as one record. Accordingly, the information area 2K shows that the number of pages that have not yet been recorded has become 0 pages.

[0120] The CPU 31 may disable the Confirm button 2G so that the user cannot press the Confirm button 2G until the types have been set for all the form images 1 and the records have been classified.

[0121] Although one aspect of the information processing device 20 has been described above using the embodiment, the disclosed form of the information processing device 20 is merely an example, and the form of the information processing device 20 is not limited to the scope described in the embodiment. Various modifications or improvements can be made to the embodiment without departing from the gist of the present disclosure, and forms with such modifications or improvements are also included in the technical scope of the disclosure. For example, the order of the type setting process shown in FIG. 4 may be changed without departing from the gist of the present disclosure.

[0122] In the above embodiment, the type setting process is implemented by software as an example. However, the process equivalent to the flowchart shown in Fig. 4 may be implemented by hardware. In this case, the process can be performed faster than when the type setting process is implemented by software.

[0123] In the above embodiment, the processor refers to a processor in a broad sense, including a general-purpose processor (e.g., CPU 31) and a dedicated processor (e.g., GPU: Graphics Processing Unit, ASIC: Application Specific Integrated Circuit, FPGA: Field Programmable Gate Array, programmable logic device, etc.).

[0124] In addition, the operations of the processor in the above embodiment may be performed not only by one processor but also by multiple processors located at physically separate locations working together. The order of the operations of the processor is not limited to the order described in the above embodiment and may be changed as appropriate.

[0125] In the above embodiment, an example in which the information processing program is stored in the ROM 32 has been described, but the storage destination of the information processing program is not limited to the ROM 32. The information processing program of the present disclosure can also be provided in a form recorded in a storage medium readable by the computer 30. For example, the information processing program may be provided in a form recorded in an optical disk such as a CD-ROM (Compact Disk Read Only Memory) or a DVD-ROM (Digital Versatile Disk Read Only Memory). The information processing program may also be provided in a form recorded in a portable semiconductor memory such as a USB (Universal Serial Bus) memory or a memory card. The ROM 32, the non-volatile memory 34, the CD-ROM, the DVD-ROM, the USB, and the memory card are examples of non-transitory storage media.

[0126] Furthermore, the information processing device 20 may download an information processing program from an external device connected to a communication line through the communication unit 37, and store the downloaded information processing program in the storage device. In this case, the CPU 31 of the information processing device 20 reads the information processing program downloaded from the external device from the storage device and executes a type setting process. [Explanation of symbols]

[0127] 1 form image, 2 confirmation and correction screen, 2A display area, 2B (of confirmation and correction screen) scroll bar, 2C (2D) (of confirmation and correction screen) search button, 2E reclassification button, 2F comparison button, 2G (of confirmation and correction screen) confirm button, 2H (of confirmation and correction screen) cancel button, 2J temporary save button, 2K information area, 2L operation button, 2M frame line, 2N page number, 3 registration image, 4 setting screen, 4A setting button, 4B (of setting screen) scroll bar, 4C, 4D (of setting screen) search button, 4E (of setting screen) confirm button, 4F (of setting screen) cancel button, 10 form system, 20 information processing device, 30 computer, 31 CPU, 32 ROM, 33 RAM, 34 non-volatile memory, 35 I / O, 36 bus, 37 communication unit, 38 input unit, 39 display unit, 40 client terminal, 60 input device

Claims

1. A processor is provided. The processor, displaying, on the same screen, a form image for which a form type is to be set, a plurality of registered images which are user-selectable and which the user refers to in order to distinguish the type of the form image, the registered images being registered in advance for each form type, and a setting operator for setting the form type for the form image; A user who has referred to the plurality of registered images sets the type of form associated with the setting operator in the form image. Information processing device.

2. The processor associates a type of a form represented by a registered image selected by a user from among the plurality of registered images with the setting operator.

2. The information processing device according to claim 1.

3. The processor sequentially displays the plurality of registered images on the screen while scrolling in accordance with a user's instruction, and associates the type of form represented by the registered image displayed on the screen with the setting operator.

3. The information processing device according to claim 2.

4. The processor further displays on the screen a selection operator for a user to select the form image; When there are a plurality of form images, the form image selected by the user's operation of the selection operator is displayed on the screen.

4. The information processing device according to claim 1.

5. The processor displays, on the screen, a form image for which no form type is set, among the plurality of form images.

5. The information processing device according to claim 4.

6. On the computer, displaying, on the same screen, a form image for which a form type is to be set, a plurality of registered images which are user-selectable and which the user refers to in order to distinguish the type of the form image, the registered images being registered in advance for each form type, and a setting operator for setting the form type for the form image; A process is executed in which a user who has referred to the plurality of registered images sets the type of form associated with the setting operation key in the form image. Information processing program.

Images