Information processing system, information processing device, information processing method, and information processing program

Abstract

To reduce the load of journalizing work.SOLUTION: An information processing system comprises a terminal device and an information processor. The information processor includes an input reception section that receives a request for displaying a confirmation screen for a recognition result of a document from the terminal device, and a display control section that generates screen data of the confirmation screen including a character string indicating an attribute of an issue source of the document and journalizing information corresponding to a character string indicating contents of details of the document to display it on the terminal device. The terminal device includes a display section that displays the confirmation screen including the character string indicating the attribute of the issue source and the journalizing information corresponding to the character string indicating the contents of details on the basis of the screen data.SELECTED DRAWING: Figure 13

Description

[Technical field]

[0001] The present invention relates to an information processing system, an information processing device, an information processing method, and an information processing program for performing form recognition. [Background technology]

[0002] In recent years, a system that performs form recognition on form image data has become known. Specifically, for example, a conventional system has been known that displays an input field for journal information including text data generated based on form information acquired by form recognition and past journal information whose issuer matches the form. Summary of the Invention [Problem to be solved by the invention]

[0003] In the above-mentioned conventional technology, past journal entry information with the same issuer of the form is referenced, but even for forms issued by the same issuer, the contents of the journal entries may differ depending on the branch office or department that issues the form (including both cases depending on the branch office that issues the form and the branch office that receives the form). In this case, the worker who performs the journal entry must change the journal entry, which places a burden on the worker.

[0004] The present invention has been made in consideration of the above circumstances, and has an object to reduce the burden of sorting work. [Means for solving the problem]

[0005] The disclosed technology is an information processing system including a terminal device and an information processing device, the information processing device including an input receiving unit that receives a display request for a confirmation screen of a recognition result of a form from the terminal device, a display control unit that generates screen data of the confirmation screen including a character string indicating an attribute of an issuer of the form and journal information corresponding to a character string indicating the content of the details of the form, and displays the screen data on the terminal device; A journal information acquisition unit that refers to a storage unit that stores journal determination information including a character string indicating an attribute of the issuer, a character string indicating the content of the details, and journal information corresponding to the character string indicating the content of the details, and acquires the journal information corresponding to the character string indicating the content of the details;The terminal device has a display unit that displays the confirmation screen including a character string indicating an attribute of the issuer and journal information corresponding to a character string indicating the content of the statement based on the screen data. The confirmation screen has an operation part for requesting the display of a list of character strings indicating the attributes of the issuer included in the journal entry determination information stored in the storage unit, and when the display control unit receives a display request for the list from the terminal device, the display control unit displays the list of character strings indicating the attributes of the issuer on the confirmation screen, the journal entry information acquisition unit acquires, from the storage unit, journal entry information associated with a character string selected from the list of character strings indicating the attributes of the issuer, and the display control unit changes the journal entry information included on the confirmation screen to journal entry information associated with a character string selected from the list of character strings indicating the attributes of the issuer. . Effect of the Invention

[0006] The burden of accounting work can be reduced. [Brief description of the drawings]

[0007] [Figure 1] FIG. 1 illustrates an example of a system configuration of a document recognition system. [Figure 2A] FIG. 2 illustrates an example of a hardware configuration of a server device. [Figure 2B] FIG. 2 illustrates an example of a hardware configuration of a terminal device. [Diagram 3] FIG. 2 illustrates an example of a tenant database. [Figure 4] FIG. 4 illustrates an example of an extraction definition database. [Diagram 5] FIG. 11 is a diagram illustrating an example of an extraction result database. [Figure 6] FIG. 13 is a diagram showing an example of a journal entry determination database. [Figure 7A] FIG. 2 is a diagram illustrating functions of a server device. [Figure 7B] FIG. 2 is a diagram illustrating functions of a terminal device. [Figure 8] FIG. 1 is a first sequence diagram illustrating the operation of the document recognition system. [Figure 9] FIG. 4 is a diagram illustrating an example of a job list. [Figure 10] 11 is a first flowchart illustrating a process of a document recognition processing unit. [Figure 11] FIG. 11 is a diagram showing an example of reading result information. [Figure 12] FIG. 2 is a second sequence diagram illustrating the operation of the document recognition system. [Figure 13] 13 is a flowchart illustrating a process for displaying a confirmation screen. [Figure 14] 13 is a flowchart illustrating a process for updating journal entry determination information. [Figure 15] FIG. 13 is a diagram showing a display example. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment will be described below with reference to the drawings. Fig. 1 is a diagram showing an example of a system configuration of a document recognition system.

[0009] The form recognition system 100 of this embodiment includes a server device 200, an image forming device 300, and a terminal device 400. In the form recognition system 100 of this embodiment, the server device 200, the image forming device 300, and the terminal device 400 are connected via a network.

[0010] The terminal device 400 of this embodiment is connected to a core system 500 via a network, for example. The core system 500 is a system that performs a specific process using the result of recognizing a form in the form recognition system 100 of this embodiment, for example.

[0011] In this embodiment, an invoice will be described as an example of a form. In the following description, the form recognition system 100 will be described as extracting information including the billing source that issued the invoice, invoice information related to the invoice amount, and detailed information related to the contents of the invoice details from the form image obtained by reading the invoice.

[0012] Furthermore, if the document is an invoice, the core system 500 may be an accounting system that transfers the invoice amount to a financial institution.

[0013] In the form recognition system 100 of this embodiment, the server device 200 acquires image data indicating an image of a form read by a scanner function of the image forming device 300. The server device 200 may also receive image data indicating an image of the form from the terminal device 400.

[0014] When the server device 200 acquires form image data showing an image of a form, the server device 200 extracts items and item values ​​included in the form, and converts the items and item values ​​into text data in which the items and item values ​​are associated with each other.

[0015] In the following description, an image of a form is referred to as a form image, and image data representing the form image is referred to as form image data.

[0016] In the following explanation, the process of extracting the names of items (item names) contained in a form image and the values ​​(item values) as item information for these items, and converting the item names and item values ​​into text data and matching them is referred to as form recognition.

[0017] The server device 200 of this embodiment has a storage unit 220 and a form recognition processing unit 230. The storage unit 220 is provided with an image database 240, a tenant database 245, an extraction definition database 250, an extraction result database 255, an accounting distinction database 260, and a recognition result database 265.

[0018] Form image data is stored in the image database 240. Tenant information relating to tenants is stored in the tenant database 245.

[0019] In addition, the tenant in this embodiment is, for example, a company, etc. More specifically, the tenant is, for example, a business operator, a company, an organization, etc. that has concluded a contract to use the service provided by the document recognition system 100.

[0020] Extraction definition information is stored in the extraction definition database 250. The extraction definition information is referred to by the form recognition processing unit 230 when extracting character strings contained in invoice information from a form image.

[0021] The extraction result database 255 stores character strings extracted from forms by the form recognition processing performed by the form recognition processing unit 230.

[0022] The journal entry determination database 260 stores journal entry determination information to be referenced when determining the journal entry corresponding to an invoice. The recognition result database 265 stores recognition result data indicating the result of form recognition by the form recognition processing unit 230. The recognition result database 265 may be provided for each tenant.

[0023] The form recognition processing unit 230 of this embodiment acquires form image data stored in the image database 240, performs character recognition, and extracts a group of character strings included in the form image. Then, the form recognition processing unit 230 refers to the extraction definition information stored in the extraction definition database 250, extracts character strings included in the invoice information and a group of character strings included in the statement information from the group of character strings, and stores the extraction results in the extraction result database 255.

[0024] Furthermore, the document recognition processing unit 230 of this embodiment refers to the journal entry discrimination database 260 and determines whether journal entry discrimination information exists that includes a specific character string contained in the invoice information and a character string indicating the contents of the details contained in the detail information.

[0025] The specific character string included in the invoice information is, for example, the branch name or department name of the tenant that is the invoice source, etc. In the following description, the specific character string included in the invoice information may be referred to as a journalization determining word.

[0026] Furthermore, the character string indicating the content of the details included in the detail information is, for example, the product name.

[0027] That is, in this embodiment, it is determined whether or not there is journalization discrimination information that includes the branch or department (journalization discrimination word) of the tenant and the product name included in the details of the invoice. If there is corresponding journalization discrimination information, the document recognition processing unit 230 displays the journal information based on the corresponding journalization discrimination information, together with the invoice information and the details information, on the confirmation screen for the recognition result of the document.

[0028] The specific character string (journalization determination word) included in the invoice information of this embodiment is, in other words, information associated with the issuer of the form, and is a character string indicating the attribute of the issuer of the form. Also, the character string indicating the content of the details included in the detail information is, in other words, a character string indicating the target of the journalization.

[0029] Moreover, the form recognition processing unit 230 of this embodiment stores the extraction result information stored in the extraction result database 255 in the recognition result database 265 as a part of the recognition result data indicating the result of form recognition by the form recognition processing unit 230. Moreover, in this embodiment, the journal information may be stored in the recognition result database 265 in association with the recognition result data.

[0030] In this embodiment, in this manner, in document recognition, the document confirmation screen is displayed with the journal entry information based on the attributes of the document issuer entered for the journal entry targets included in the document.

[0031] Therefore, according to this embodiment, even if the billing source is the same, the confirmation screen can be displayed with the journal information corresponding to the billing source attributes indicated by the branch or department entered, thereby reducing the workload of inputting the journal information. In other words, according to this embodiment, the workload of journalizing work can be reduced. Note that here, the branch or department is the billing source (the party that issues the form), but this is not limited to this, and the branch or department may also be the branch or department that receives the form.

[0032] In the document recognition system 100 of this embodiment, the image forming device 300 is a multifunction device having a scanner function. The image forming device 300 is equipped with applications for realizing a copy function, a FAX function, a scanner function, etc., and these functions are realized by selecting an application corresponding to each function.

[0033] The terminal device 400 of this embodiment is used by a user (tenant) who uses the form recognition system 100. The terminal device 400 displays the result of form recognition by the server device 200. The terminal device 400 of this embodiment may be, for example, a tablet terminal or a smartphone.

[0034] 1, the server device 200 has six databases in the storage unit 220, but is not limited to this. A part of each database may be provided in an external device of the server device 200, or all of each database may be provided in an external device.

[0035] 1, the server device 200 realizes the form recognition processing unit 230, but the present invention is not limited to this. The form recognition processing unit 230 may be realized by a plurality of information processing devices.

[0036] In addition, in the example of Figure 1, the document recognition system 100 includes one image forming device 300 and one terminal device 400, but the number of image forming devices 300 and terminal devices 400 included in the document recognition system 100 may be any number.

[0037] Next, a hardware configuration of the server device 200 of this embodiment will be described with reference to Fig. 2A. Fig. 2A is a diagram showing an example of the hardware configuration of the server device.

[0038] As shown in FIG. 2A, server device 200 is constructed by a computer, and as shown in FIG. 2A, it is equipped with a CPU 201, a ROM 202, a RAM 203, an HD 204, an HDD (Hard Disk Drive) controller 205, a display 206, an external device connection I / F (Interface) 208, a network I / F 209, a bus line 210, a keyboard 211, a pointing device 212, a DVD-RW (Digital Versatile Disk Rewritable) drive 214, and a media I / F 216.

[0039] Of these, the CPU 201 controls the overall operation of the server device 200. The ROM 202 stores programs used to drive the CPU 201, such as an IPL. The RAM 203 is used as a work area for the CPU 201. The HD 204 stores various data such as programs. The HDD controller 205 controls the reading and writing of various data from and to the HD 204 under the control of the CPU 201.

[0040] The display 206 displays various information such as a cursor, a menu, a window, characters, or an image. The external device connection I / F 208 is an interface for connecting various external devices. In this case, the external devices are, for example, a USB (Universal Serial Bus) memory or a printer. The network I / F 209 is an interface for data communication using a communication network. The bus line 210 is an address bus, a data bus, or the like for electrically connecting each component such as the CPU 201 shown in FIG. 2A.

[0041] The keyboard 211 is a type of input means having a plurality of keys for inputting characters, numbers, various instructions, etc. The pointing device 212 is a type of input means for selecting and executing various instructions, selecting a processing target, moving a cursor, etc. The DVD-RW drive 214 controls reading and writing of various data from a DVD-RW 213 as an example of a removable recording medium. Note that the medium is not limited to DVD-RW, and may be a DVD-R, etc. The media I / F 216 controls reading and writing (storing) of data from a recording medium 215 such as a flash memory.

[0042] Next, the hardware configuration of the terminal device 400 of this embodiment will be described with reference to Fig. 2B. Fig. 2B is a diagram showing an example of the hardware configuration of the terminal device. The terminal device 400 of this embodiment includes a CPU 401, a ROM 402, a RAM 403, an EEPROM 404, a CMOS sensor 405, an image sensor I / F 406, an acceleration / direction sensor 407, a media I / F 409, and a GPS receiver 411.

[0043] Of these, the CPU 401 is an arithmetic processing device that controls the overall operation of the terminal device 400. The ROM 402 stores the CPU 401 and programs used to drive the CPU 401, such as the IPL. The RAM 403 is used as a work area for the CPU 401. The EEPROM 404 reads or writes various data, such as smartphone programs, under the control of the CPU 401. The ROM 402, the RAM 403, and the EEPROM 404 are examples of storage devices of the terminal device 400.

[0044] The CMOS (Complementary Metal Oxide Semiconductor) sensor 405 is a type of built-in imaging means that captures an image of a subject (mainly a self-portrait) to obtain image data under the control of the CPU 401. Note that instead of a CMOS sensor, an imaging means such as a CCD (Charge Coupled Device) sensor may also be used.

[0045] The imaging element I / F 406 is a circuit that controls the driving of the CMOS sensor 405. The acceleration / direction sensor 407 is various sensors such as an electronic magnetic compass that detects geomagnetism, a gyrocompass, and an acceleration sensor. The media I / F 409 controls the reading and writing (storage) of data from and to a recording medium 408 such as a flash memory. The GPS receiver 411 receives GPS signals from GPS satellites.

[0046] The terminal device 400 also includes a long-distance communication circuit 412, an antenna 412a of the long-distance communication circuit 412, a CMOS sensor 413, an image sensor I / F 414, a microphone 415, a speaker 416, an audio input / output I / F 417, a display 418, an external device connection I / F (Interface) 419, a short-distance communication circuit 420, an antenna 420a of the short-distance communication circuit 420, and a touch panel 421.

[0047] Of these, the long-distance communication circuit 412 is a circuit that communicates with other devices via a communication network. The CMOS sensor 413 is a type of built-in imaging means that captures an image of a subject and obtains image data under the control of the CPU 401. The image sensor I / F 414 is a circuit that controls the driving of the CMOS sensor 413. The microphone 415 is a built-in circuit that converts sound into an electrical signal. The speaker 416 is a built-in circuit that converts an electrical signal into physical vibrations to generate sounds such as music and voice. The audio input / output I / F 417 is a circuit that processes the input and output of audio signals between the microphone 415 and the speaker 416 under the control of the CPU 401.

[0048] The display 418 is a type of display means such as a liquid crystal or organic EL (Electro Luminescence) that displays an image of a subject, various icons, etc. The external device connection I / F 419 is an interface for connecting various external devices. The short-range communication circuit 420 is a communication circuit such as NFC (Near Field Communication) or Bluetooth (registered trademark). The touch panel 421 is a type of input means that allows a user to operate the terminal device 400 by pressing the display 418. The display 418 is an example of a display unit that the terminal device 400 has.

[0049] The terminal device 400 may be a general computer having a hardware configuration as shown in FIG. 2A.

[0050] Next, the tenant database 245 included in the server device 200 of the present embodiment will be described with reference to Fig. 3. Fig. 3 is a diagram illustrating an example of the tenant database. The tenant database 245 of the present embodiment may be stored in the server device 200 in advance.

[0051] The tenant information stored in the tenant database 245 includes information items such as a tenant ID, company name, branch name, telephone number, and address, and the item "tenant ID" is associated with the other items.

[0052] The value of the item "Tenant ID" is identification information for identifying a tenant. In other words, the tenant ID is identification information for identifying a user of the document recognition system 100. The value of the item "Company Name" indicates the name of a tenant. In other words, the item "Company Name" indicates the name of a user. The value of the item "Branch Name" indicates the name of a branch office of the tenant.

[0053] The value of the item "telephone number" and the value of the item "address" indicate the telephone number and address of the tenant identified by the tenant ID.

[0054] The tenant information may include items other than the items shown in Fig. 3. Specifically, for example, the tenant information may include the name of a department in the tenant, information related to a department, and the like.

[0055] Fig. 4 is a diagram showing an example of the extraction definition database. Fig. 4 shows an example of extraction definition information stored in the extraction definition database 250. Fig. 4 may be provided in advance for each tenant, for example.

[0056] The extraction definition information has the following information items: item name, extraction base keyword, extraction direction, extraction range, and extraction conditions. In the extraction definition database 250, the item "item name" is associated with other items, and information including the value of the item "item name" and the values ​​of the other items constitutes the extraction definition information.

[0057] The value of the item "item name" indicates the item name associated with the item value. The value of the item "item name" is extracted based on the positional relationship between the item name and the character string indicated by the value of the corresponding item "extraction base keyword".

[0058] The value of the item "item name" is also an item of information contained in the invoice information. In the example of Figure 3, the values ​​of the item "item name" include the billing amount, billing date, billing source, branch name, department name, etc. These values ​​become items of invoice information.

[0059] The value of the item "extraction base keyword" indicates a character string that is a base point when extracting a character string that is to be the item value of the item name indicated by the value of the item name.

[0060] The value of the "Extraction direction" item indicates the positional relationship between the base character string and the character string that is the item value of the item name indicated by the value of the "Item name" item. The value of the "Extraction range / extraction conditions" item indicates the range and conditions of the character string to be extracted.

[0061] In Fig. 4, for example, the character string that is the item value of the item name "billing amount" is the character string that is immediately to the right of a specific character string such as "billing amount" or "total billing amount" among the character strings extracted from the form image. Note that the character string that is the base point for extraction of the item name "billing amount" may be a character string that partially matches a specific character string such as "billing amount" or "total billing amount".

[0062] Also, for example, the character string that becomes the item value of the item name "Billing Date" is the character string that is located immediately to the right of a specific character string such as "Billing Date" among the group of character strings extracted from the form image.

[0063] Also, for example, the character string that becomes the item value of the item name "billing source" is the character string that is located to the right of specific character strings such as "billing source" or "our company name" among the group of character strings extracted from the form image.

[0064] Also, for example, the character string that becomes the item value of the item name "branch name" is the character string that is located to the right or below a specific character string such as "billing source" or "name of our company" among the group of character strings extracted from the form image.

[0065] Next, the extraction result database 255 will be described with reference to Fig. 5. Fig. 5 is a diagram showing an example of the extraction result database.

[0066] The extraction result information stored in the extraction result database 255 of this embodiment is provided for each tenant ID. The extraction result database 255 of this embodiment also includes a registration table 255-1 in which registration information indicating the registration date of the form is stored, and a correspondence table 255-2 in which correspondence information that associates item names and item values ​​included in the detailed information extracted from the form is stored.

[0067] Registration table 255-1 has information items such as tenant ID, form ID, registration date, and attributes, which are associated with each other. The value of the item "form ID" is identification information for identifying the form (invoice), and the value of the item "registration date" indicates the date when character recognition was performed on the image data of the form (invoice). The value of the item "attribute" indicates the branch or department that issued the invoice.

[0068] The correspondence table 255-2 includes information items such as a tenant ID, a detail ID, a product name, an amount, and a unit price. The value of the item "detail ID" is identification information for identifying the contents of the detail. The value of the item "detail ID" in this embodiment includes a form ID. Specifically, for example, in the detail ID "1111-M1", "1111" indicates the form ID. Therefore, the detail ID in this embodiment can be said to be identification information for identifying the form and the details included in the form.

[0069] In the correspondence information, the statement ID includes only identification information for identifying the content of the statement, and the statement ID corresponding to the statement ID may be included in the information items. The value of the item "Product name" indicates the name of the product included in the statement information. The value of the item "Amount" indicates the product name and the corresponding payment amount, and the value of the item "Unit" indicates the product name and the corresponding unit price.

[0070] The information items included in the correspondence table 255-2 are not limited to the example shown in Fig. 5. For example, the item "product name" may be replaced with "item name". The items "product name", "amount", "unit price", etc. stored in the correspondence table 255-2 are character strings extracted by character recognition by the document recognition processing unit 230.

[0071] Next, the journal entry distinguishing database 260 of this embodiment will be described with reference to Fig. 6. Fig. 6 is a diagram showing an example of the journal entry distinguishing database.

[0072] The journal entry discrimination database 260 of this embodiment is provided for each tenant ID. The journal entry discrimination information stored in the journal entry discrimination database 260 includes, as information items, a tenant ID, a journal entry ID, a debit item, a credit item, a debit amount, a credit amount, a journal entry discrimination word, and a statement ID.

[0073] The value of the item "Journal ID" is identification information for identifying the journal discrimination information. In this embodiment, the value of the item "Journal ID" includes a document ID. Specifically, for example, in the journal ID "1111-S1", "1111" indicates the document ID. Therefore, the journal ID in this embodiment can be said to be identification information for identifying the document and the journal entry of the details included in the document.

[0074] In addition, in the journal entry determination information, the journal entry ID includes only identification information that specifies the journal entry determination information, and the journal entry ID and the corresponding document ID may be included in the information items.

[0075] The values ​​of the items "Debit Item", "Credit Item", "Debit Amount", and "Credit Amount" indicate the account item and amount of the journal entry. In this embodiment, information including the values ​​of the items "Debit Item", "Credit Item", "Debit Amount", and "Credit Amount" may be expressed as journal entry information. Therefore, the journal entry determination information in this embodiment includes journal entry information.

[0076] The value of the item "journalization determining word" indicates a specific character string included in the invoice information. In other words, the value of the item "journalization determining word" is information associated with the issuer of the form, and indicates a character string that indicates the attributes of the issuer of the form.

[0077] In FIG. 6, among the documents issued by the tenant identified by the tenant ID "101", the content of the detail identified by the detail ID "1111-M1" is associated with the journal entry ID "1111-S1".

[0078] The details identified by the detail ID "1111-M1" are the product name "Screws", the amount "1000", and the unit price "100". Therefore, the details are associated with the journal entry "Account A", debit amount "1000"... In other words, the details identified by the detail ID "1111-M1" are associated with the journal entry information included in the journal entry discrimination information identified by the journal entry ID "1111-S1".

[0079] Next, the functions of each device of the document recognition system 100 of this embodiment will be described with reference to FIGS. 7A and 7B.

[0080] FIG. 7A is a diagram illustrating the functions of the server device.

[0081] In the server device 200 of this embodiment, for example, the CPU 201 reads and executes an information processing program stored in the HD 504 or the like, thereby implementing the functions of each unit described below.

[0082] The server device 200 of this embodiment includes a form recognition processing unit 230. The form recognition processing unit 230 includes an input receiving unit 221, an authentication processing unit 222, and a form recognition unit 290.

[0083] The input reception unit 221 receives various inputs to the server device 200. Specifically, the input reception unit 221 receives an input of login information for logging in to the form recognition system 100. The login information is, for example, a tenant ID and a password. In addition, the input reception unit 221 receives an input of form image data transmitted from the image forming device 300, for example.

[0084] The authentication processing unit 222 performs authentication based on the login information input and accepted by the input accepting unit 221. The authentication processing unit 222 may transmit the input login information to an authentication server provided outside the server device 200, for example, and obtain the result of authentication by the authentication server. When the user is authenticated, the authentication processing unit 222 may pass the form image data accepted by the input accepting unit 221 to the form recognition unit 290.

[0085] The document recognition unit 290 of this embodiment has an image data storage unit 281, a job list generation unit 282, an image data acquisition unit 283, a character recognition unit 284, an extraction result management unit 285, a search unit 286, a journal information acquisition unit 287, a display control unit 288, a recognition result generation unit 291, an information update unit 292, and an output unit 293.

[0086] When the image data storage unit 281 receives form image data from the image forming apparatus 300, it stores the data in the image database 240. When the image data storage unit 281 receives form image data from the terminal apparatus 400, it stores the data in the image database 240.

[0087] Job list generating unit 282 receives form image data input from image forming apparatus 300 via input receiving unit 221, registers the job in a job list, and manages the job list. Details of the job list will be described later.

[0088] The image data acquisition unit 283 acquires the form image data stored in the image database 240 .

[0089] The character recognition unit 284 extracts character strings and information indicating the positions where the character strings are arranged from the form image data, and stores the extracted character strings as read result information. Therefore, the read result information includes a plurality of character strings extracted from the form image data. In the following description, a plurality of character strings extracted from the form image data and included in the read result information may be referred to as a character string group. The read result information will be described in detail later.

[0090] The extraction result management unit 285 stores the multiple character strings extracted from the form image data in the extraction result database 255 as extraction result information in which the multiple character strings are associated with item names and item values.

[0091] The search unit 286 uses the journal entry discrimination words included in the extraction result information as search keys to search the journal entry discrimination database 260. Specifically, the search unit 286 searches the journal entry discrimination database 260 using the branch name and the like, which are attributes of the billing source included in the extraction result information.

[0092] The journal information acquisition unit 287 acquires the journal information that is the search result of the search unit 286. The display control unit 288 controls the display of a screen in the terminal device 400 or the like. Specifically, the display control unit 288 may generate screen data showing a recognition result confirmation screen to be displayed on the terminal device 400.

[0093] The recognition result generating unit 291 generates recognition result data including invoice information included in the extraction result information. The information updating unit 292 updates the journalization determination database 260 in response to an input from the terminal device 400. The output unit 293 outputs screen data showing the recognition result confirmation screen generated by the display control unit 288 to the terminal device 400. In other words, the output unit 293 displays the recognition result confirmation screen generated by the display control unit 288 on a web browser (display unit) of the terminal device 400. In addition, the output unit 293 converts the recognition result data into data in a format compatible with the core system 500 and outputs it.

[0094] Next, functions of the terminal device 400 will be described with reference to Fig. 7B. Fig. 7B is a diagram illustrating the functional configuration of the terminal device.

[0095] The terminal device 400 of this embodiment has an input receiving unit 430, a display unit 440, and a communication unit 450. The input receiving unit 430 receives various inputs to the terminal device 400. The display unit 440 controls the display of the display 418 of the terminal device 400. The display unit 440 may be realized, for example, by a browser or the like, or may be realized by an application for using the document recognition system 100. The communication unit 450 transmits and receives information between the terminal device 400 and each of the other devices.

[0096] Next, the operation of form recognition in the form recognition system 100 of this embodiment will be described with reference to Fig. 8. Fig. 8 is a first sequence diagram illustrating the operation of the form recognition system.

[0097] In the form recognition system 100, when the image forming apparatus 300 receives a request from a user to start an application for performing form recognition (step S801), the image forming apparatus 300 starts the application (step S802). The user may be, for example, a tenant administrator.

[0098] Next, when the image forming apparatus 300 receives login information including a tenant ID input from the user (step S803), the image forming apparatus 300 transmits the login information to the server apparatus 200 and makes an authentication request (step S804).

[0099] Upon receiving the authentication request, the server device 200 performs authentication using the authentication processing unit 222, and notifies the image forming device 300 of the result (step S805). Note that the operation shown here is that in which the user is authenticated.

[0100] Next, the image forming apparatus 300 receives an instruction to scan the form (step S806), scans the form, and obtains form image data (step S807). Next, the image forming apparatus 300 transmits the form image data to the server apparatus 200 (step S808).

[0101] When the input receiving unit 221 of the server device 200 receives the input of the form image data, the authentication processing unit 222 passes this form image data to the form recognition unit 290 (step S809). In the example of Fig. 8, the form image data is passed to the form recognition unit 290 via the authentication processing unit 222, but this is not limiting. The form image data may be passed to the form recognition unit 290 without passing through the authentication processing unit 222.

[0102] When the form recognition unit 290 of the server device 200 receives the form image data, the job list generation unit 282 registers the job in the job list (step S810). Next, the form recognition unit 290 stores the form image data in the image database 240 by the image data storage unit 281 (step S811).

[0103] Next, the form recognition unit 290 causes the image data acquisition unit 283 to acquire form image data to be recognized from the image database 240 (step S812), and executes processing to recognize the form image (step S813).

[0104] Specifically, the document recognition unit 290 of this embodiment extracts invoice information from a group of character strings included in the read result information acquired by the character recognition unit 284, and generates recognition result data including the invoice information by the recognition result generation unit 291. The process of step S813 will be described in detail later.

[0105] Next, the form recognition unit 290 stores the recognition result data generated by the recognition result generation unit 291 in the recognition result database 265 (step S814), and ends the form recognition process.

[0106] Here, a job list generated by the job list generating unit 282 of this embodiment will be described with reference to Fig. 9. Fig. 9 is a diagram showing an example of a job list.

[0107] When the server device 200 of this embodiment receives form image data from the image forming device 300, the job list generating unit 282 stores the form image data in association with a job ID as a job list.

[0108] The job list 91 of this embodiment has the following information items: job ID, tenant ID, form image file path, recognition result file path, and status.

[0109] The value of the item "Job ID" is an identifier that identifies the job. In other words, the value of the item "Job ID" is an identifier that identifies the form image data received from the image forming apparatus 300. The value of the item "Image File Path" is information that indicates the location where the form image data is stored. The value of the item "Recognition Result File Path" is information that indicates the location where the recognition result data resulting from recognizing the form image is stored.

[0110] The value of the item "status" indicates the progress of the recognition of the form image by the user (tenant), in other words, the value of the item "status" indicates the state of the job.

[0111] In this embodiment, there are four values ​​for the item "status": unprocessed state, draft saved state, confirmed state, and externally output state. Each state is as follows. The value of the item "status" may be included in the recognition result data. Also, the "status" may indicate each state of a job, and is not limited to the four states or names shown below.

[0112] Unprocessed state (state 1): This is the state immediately after the recognition result data has been obtained by form recognition, and the recognition results have not yet been confirmed.

[0113] Draft saved state (state 2): The state in which the recognition result data is in the middle of being confirmed, etc., and the recognition result data has not yet been finalized.

[0114] Confirmed state (state 3): The state in which the confirmation of the recognition result data and other operations have been completed and the data has been stored in the recognition result database 265 as confirmed information.

[0115] External output completed state (state 4): A state in which the output of the recognition result data to an accounting system or the like linked with the document recognition system 100 has been completed.

[0116] When the server device 200 of this embodiment receives form image data from the image forming device 300, the job list generation unit 282 assigns a job ID to the form image data, associates the tenant ID acquired as login information, and adds a record to the job list 91. Then, when the form image data is stored in the image database 240, the job list generation unit 282 adds information indicating the storage destination as the value of the item "image file path."

[0117] Furthermore, when the job list generation unit 282 identifies form definition information to be referenced in the recognition of a form image, it adds a definition ID as identification information for that information as the value of the item "definition ID." Then, when the job list 91 is completed and the recognition result data is stored in the recognition result database 265, the job list generation unit 282 adds information indicating the storage destination as the value of the item "recognition result file path" and sets the value of the item "status" to "completed."

[0118] In this embodiment, for example, a job list generated by the job list generating unit 282 may be displayed. In this case, the user can check the progress of recognition of the form image via the job list screen displayed based on the job list.

[0119] Next, the form recognition process performed by the form recognition processing unit 230 will be described with reference to FIG.

[0120] Fig. 10 is a first flow chart for explaining the process of the form recognition processing unit 230. Fig. 12 shows the details of the process of the form recognition processing unit 230 in step S813 in Fig. 8.

[0121] The form recognition unit 290 of this embodiment acquires form image data from the image database 240 by the image data acquisition unit 283 (step S1001).

[0122] Next, the form recognition unit 290 uses the character recognition unit 284 to cut out the area in which characters are formed (hereinafter referred to as the character field) from the form image, cuts out and recognizes the characters in the cut-out character field, and obtains coordinates indicating the position of the cut-out characters (step S1002).

[0123] Next, the document recognition unit 290 generates read result information based on the positional relationship of each character recognized by the character recognition unit 284, and identifies the character string and its coordinates (step S1003). The read result information will be described in detail later.

[0124] Next, the document recognition unit 290, through the extraction result management unit 285, refers to the extraction definition database 250 and extracts item names and corresponding item values ​​based on the extraction definition information (step S1004).

[0125] Next, the document recognition processing unit 230 causes the extraction result management unit 285 to store the extraction result in the extraction result database 255 (step S1005), and ends the process.

[0126] Next, character recognition will be further described with reference to Fig. 11. Fig. 11 is a diagram showing an example of read result information.

[0127] Information 111 shown in FIG. 11 is the result of character recognition performed by the character recognition unit 284 on the form image data.

[0128] Information 111 shows an example in which a character field is cut out, and the results of recognizing characters in the character field and the coordinates indicating the positions of the characters are extracted.

[0129] The character recognition unit 284 of this embodiment recognizes a character string by connecting adjacent characters from this information 111. Specifically, the character recognition unit 284 may recognize a combination of characters in which the distance between the characters is within a predetermined number of pixels as one word.

[0130] 11 is information indicating the character string recognized by the character recognition unit 284 and the area of ​​the character string, and is information indicating the result of the reading of the form image by the character recognition unit 284.

[0131] Furthermore, the character recognition unit 284 recognizes an area divided by vertical and horizontal lines from the form image data as one cell, and assigns identification information (cell ID) for identifying the cell to each cell.

[0132] Information 112 shown in FIG. 11 is information indicating the association between the area of ​​each cell recognized from the form image and the cell ID.

[0133] In FIG. 11, for example, the area in which the character string "Branch A" is recognized is specified from the height and width in the information 111, with the position indicated by the X coordinate and the Y coordinate as the reference.

[0134] It can also be seen that the area in which the character string "Branch A" is recognized is included in the cell ID "17" in the information 111. Therefore, the character string "Branch A" is associated with the cell ID "17" as a character string included in the reading result information.

[0135] In this manner, the form recognition unit 290 of this embodiment associates character strings with cells from the form image data.

[0136] Next, an operation of displaying recognition result data in the form recognition system 100 will be described with reference to Fig. 12. Fig. 12 is a second sequence diagram illustrating the operation of the form recognition system.

[0137] In the form recognition system 100, when the terminal device 400 receives an instruction to display a list of forms from a user (step S1201), the terminal device 400 transmits a request to acquire a form list screen to the server device 200 (step S1202).

[0138] When the server device 200 receives the request to obtain the list screen, the display control unit 288 transmits an instruction to display a login screen to the terminal device 400 (step S1203). The terminal device 400 receives the display instruction and displays the login screen (step S1204).

[0139] When the terminal device 400 accepts input of login information including a tenant ID from the user (step S1205), the terminal device 400 transmits a login request together with the login information to the server device 200 (step S1206). Note that the following describes a case where the tenant is authenticated based on the login information.

[0140] When the server device 200 accepts the login request, it causes the authentication processing unit 222 to execute authentication processing (step S1207), and returns the authenticated tenant ID to the display control unit 288 as a login result (step S1208).

[0141] The display control unit 288 holds this tenant ID (step S1209), and acquires information indicating a list of invoices (documents) corresponding to this tenant ID from the storage unit 220 (step S1210). Specifically, the display control unit 288 refers to the recognition result database 265 corresponding to the tenant ID, and acquires information indicating the list of invoices.

[0142] Next, the server device 200 transmits, via the display control unit 288, an instruction to display information showing a list of invoices to the terminal device 400 (step S1211).

[0143] The terminal device 400 accepts this display instruction and displays a list screen showing a list of invoices (step S1212).

[0144] Furthermore, when the terminal device 400 accepts the selection of an invoice on the list screen (step S1213), it transmits a display request for a confirmation screen of the recognition result data to the server device 200 (step S1214). This display request includes an invoice ID (form ID) for identifying the invoice selected on the list screen.

[0145] When the server device 200 receives a request to display a confirmation screen via the input receiving unit 221, the display control unit 288 retrieves from the memory unit 220 the recognition result data corresponding to the invoice ID received along with the display request, as well as the accounting information indicated by the attributes of the billing source for the accounting target in the invoice corresponding to the invoice ID (step S1215).

[0146] Next, when the accounting information is acquired, the document recognition unit 290 inputs the acquired accounting information into screen data for displaying a confirmation screen (step S1217). The process of step S1217 will be described in detail later.

[0147] Next, the document recognition unit 290 passes screen data of a confirmation screen of the recognition result data into which the journal information has been input to the display control unit 288 (step S1218). The display control unit 288 transmits this display instruction to the terminal device 400 (step S1219).

[0148] Upon receiving this display instruction, the terminal device 400 displays a confirmation screen for the recognition result data (step S1220).

[0149] Here, in FIG. 12, for example, a case will be described where the journal determining word is changed on the confirmation screen.

[0150] The terminal device 400 accepts the change of the journalizing discrimination word by the user and the input of the journalizing information corresponding to the journalizing discrimination word (step S1221). Next, when the terminal device 400 accepts a confirmation operation (step S1222), it transmits a confirmation instruction to the server device 200 to instruct the progress of the recognition of the form image to be confirmed (step S1223). At this time, the changed journalizing information is also transmitted to the server device 200.

[0151] When the server device 200 receives the confirmation instruction in the document recognition unit 290, the server device 200 updates the initially input journal information to the changed journal information (step S1224), and stores the updated information in the recognition result database 265 in association with the recognition result data (step S1225). The process in step S1224 will be described in detail later.

[0152] In this embodiment, when new journal distinguishing words and journal information are added on the confirmation screen displayed on the terminal device 400 in step S1220, the document recognition unit 290 updates the journal distinguishing database 260 (step S1226). The process of step S1226 will be described in detail later.

[0153] Next, the process of the document recognition processing unit 230 in step S1217 in Fig. 12 will be described with reference to Fig. 13. Fig. 13 is a flowchart illustrating the process of displaying a confirmation screen.

[0154] The document recognition processing unit 230 of this embodiment accepts the selection of a document (invoice) with a status of "unprocessed" from the list of documents displayed on the terminal device 400 in step S1212 of FIG. 12 (step S1301).

[0155] Next, the document recognition processing unit 230 judges whether or not a character string that is a journal discrimination word has been extracted by the journal information acquisition unit 287 (step S1302). Specifically, the journal information acquisition unit 287 judges whether or not a billing source attribute corresponding to the document ID of the selected document has been extracted.

[0156] In step S1302, if no journalizing determining word has been extracted, the display control unit 288 generates screen data for a confirmation screen on which no journalizing information has been input (step S1303), and ends the process.

[0157] In step S1303, if a journal entry discrimination word is extracted, the document recognition processing unit 230, via the journal entry information acquisition unit 287, refers to the journal entry discrimination database 260 and determines whether or not there is journal entry information that includes the product name included in the detailed information of the selected document (step S1304).

[0158] In step S1304, if there is no corresponding journal information, the document recognition processing unit 230 proceeds to step S1303.

[0159] In step S1304, if the corresponding journal information exists, the document recognition processing unit 230 acquires the corresponding journal information by the journal information acquisition unit 287 (step S1305). Next, the document recognition processing unit 230 generates screen data of a confirmation screen in which the acquired journal information is input by the display control unit 288 (step S1306), and ends the process.

[0160] In this embodiment, the process shown in FIG. 13 is executed when an unprocessed form is selected in the list of forms, but the timing for executing the process shown in FIG. 13 is not limited to this.

[0161] The process shown in FIG. 13 may be executed as part of the form recognition process in step S913 in FIG.

[0162] Next, updating of the journal information will be described with reference to Fig. 14. Fig. 14 is a flowchart explaining the process of updating the journal determination information. The process in Fig. 14 shows details of the processes in steps S1225 and S1226 in Fig. 12.

[0163] In addition, the processing from step S1401 to step S1404 in FIG. 14 indicates the processing that is performed when a change to the journal discrimination word displayed on the confirmation screen is accepted, and the processing from step S1405 to step S1407 indicates the processing that is performed when a new journal discrimination word is added.

[0164] The document recognition processing unit 230 of this embodiment determines whether or not a display instruction for past journalization discrimination words has been received from the terminal device 400 (step S1401). If the corresponding display instruction has not been received in step S1401, the document recognition processing unit 230 proceeds to step S1405 described later.

[0165] In step S1401, when the corresponding display instruction is received, the document recognition processing unit 230 causes the display control unit 288 to display a list of journal discrimination words stored in the journal discrimination database 260 (step S1402). The list displayed here is a list of journal discrimination words associated with the tenant ID indicating the issuer of the invoice selected in step S1213.

[0166] Next, the document recognition processing unit 230 judges whether or not the selection of the journal distinction word from the list has been accepted (step S1403). If the selection has not been accepted in step S1403, the document recognition processing unit 230 waits until the selection is accepted.

[0167] In step S1403, when the selection of a journal entry discrimination word is accepted, the document recognition processing unit 230 acquires the journal entry information corresponding to the selected journal entry discrimination word via the journal entry information acquisition unit 287, changes the journal entry information displayed on the confirmation screen to the acquired journal entry information (step S1404), and terminates the processing.

[0168] In step S1401, if the corresponding display instruction is not received, the document recognition processing unit 230 receives an input of the journal discrimination word and the journal information from the terminal device 400 (step S1405).

[0169] Next, the document recognition processing unit 230 determines whether or not an operation for associating the journal identification word with the journal information has been received (step S1406). If the corresponding operation has not been received in step S1406, the document recognition processing unit 230 waits until an operation is received.

[0170] In step S1406, if a corresponding operation is received, the document recognition processing unit 230 causes the information update unit 292 to associate the journal entry discrimination word with the journal entry information, stores the information in the journal entry discrimination database 260 (step S1407), and terminates the process.

[0171] Next, a display example of this embodiment will be described with reference to Fig. 15. Fig. 15 is a diagram showing a display example of a terminal device.

[0172] A screen 151 shown in FIG. 15 is an example of a confirmation screen displayed on the terminal device 400 in step S1220 of FIG.

[0173] The screen 151 includes display fields 152 and 153 , an input field 154 , a display field 157 , and operation components 155 and 156 .

[0174] A form image indicated by the form image data is displayed in display field 152. In the example of Fig. 15, the form is an invoice, and the form image includes area 152a indicating the name of the requesting company and the branch name, and area 152b indicating the details.

[0175] The display field 153 displays the recognition result data resulting from the form recognition performed by the form recognition unit 290 on the form image data indicating the form image displayed in the display field 152. Specifically, the display field 153 displays invoice information and detailed information extracted from the form image data indicating the form image displayed in the display field 152.

[0176] In the input field 154, an input field for inputting an accounting entry for the form image (invoice image) displayed in the display field 152 is displayed.

[0177] A display field 157 displays the value of the item “status” of the job list 91 .

[0178] Operation component 155 is an operation component for changing the status value of job list 91 from an unprocessed state to a draft saved state. When operation component 155 is operated in a state in which "unprocessed" is displayed in display field 175, the display in display field 157 changes from "unprocessed" to "draft saved."

[0179] The operation component 156 is an operation component for changing the status value of the job list 91 to the confirmed state. In this embodiment, when the operation component 156 is operated, the status value of the job list 91 is changed to the confirmed state. In this embodiment, the recognition result data whose status has been changed to the confirmed state can be converted by the output unit 293 into data in a format compatible with the core system 500.

[0180] The following describes the display field 153. The display field 153 includes an input field 153a, an operation component 153b, an input field 153c, and operation components 153d, 153e, and 153f.

[0181] The journalization determining word extracted from the area 152a is input into the input field 153a. In other words, the input field 153a is displayed with a character string indicating the attributes of the billing source input.

[0182] 15, it is assumed that the biller "OOXX Furniture Center Co., Ltd." and the branch name "A Branch" are extracted from the area 152a and stored in the extraction result database 255. Also, in the example of FIG. 15, the product name, unit price, and amount are extracted from the area 152b and stored in the extraction result database 255.

[0183] In this case, when displaying the screen 151, the document recognition processing unit 230 identifies the tenant ID of the billing source extracted from the area 152a and references the journal entry determination database 260 corresponding to the tenant ID. Then, the journal entry information acquisition unit 287 determines whether or not the referenced journal entry determination database 260 contains a document ID for identifying the document whose image data is displayed in the display field 152, and journal entry determination information including the journal entry determination words "Branch A" and the product name "screw."

[0184] Here, the tenant ID is "101" and the document ID is "1111." Therefore, the journal entry information acquisition unit 287 refers to the journal entry determination database 260 of the tenant ID "101" and identifies the journal entry determination information including the journal entry determination word "A branch office" and the detailed ID "1111-M1" that identifies the detailed content including the product name "screw" (see FIG. 5).

[0185] In this case, the journal entry discrimination database 260 for the tenant ID "101" contains journal entry discrimination information including the journal entry discrimination word "Branch A" and the statement ID "1111-M1" (see FIG. 6). Therefore, the journal entry information acquisition unit 287 acquires the journal entry information contained in the journal entry discrimination information and displays the screen 151 with the information entered in the input field 154. In this embodiment, when the confirmation screen for the recognition result data is displayed, it can be displayed with the journal information associated with the character string indicating the attribute of the issuer of the document entered.

[0186] Also, in this embodiment, for example, when the operation component 153b is selected, a list of all journal discrimination words included in the journal discrimination information stored in the journal discrimination database 260 for the tenant ID "101" may be displayed in the input field 153a. Then, in this embodiment, when a journal discrimination word is selected from the list, the selected journal discrimination word may be input into the input field 153a.

[0187] Then, when the operation component 153f is operated, the document recognition processing unit 230 may obtain the journal entry information corresponding to the journal entry discrimination word selected from the list, and change the journal entry information entered in the input field 154 to the journal entry information corresponding to the selected journal entry discrimination word.

[0188] In this way, even if the journal entry discrimination word is not extracted correctly, for example, past journal entry information can be automatically entered by selecting a past journal entry discrimination word, thereby reducing the effort required to correct the journal entry information.

[0189] In addition, in this embodiment, for example, if the journal entry discrimination database 260 does not contain journal entry discrimination information including the journal entry discrimination word "Branch A" and the detail ID "1111-M1", the contents of the detail entered into the terminal device 400 can be matched with the journal entry information.

[0190] Specifically, for example, it is assumed that the product name "Screw" is selected in the area 152b of the display field 152 on the screen 151.

[0191] In this case, the display control unit 288 may refer to the extraction result database 255, identify the details corresponding to the product name "screw", and input the details into the input field 153c. Then, when the journal information corresponding to the product name "screw" is input into the input field 154 and the operation component 153d is selected, the details entered into the input field 153c and the journal information entered into the input field 154 are associated with each other. At this time, in this embodiment, a journal ID is assigned to the details entered into the input field 153c and the journal information entered into the input field 154, and the details ID specifying the details, the tenant ID, and the journal discrimination word are further associated with each other and stored in the journal discrimination database 260 as journal discrimination information.

[0192] In this manner, in this embodiment, when new journalization is performed based on the details, the details are associated with the journalization information, and the journalization determination database 260 can be updated.

[0193] In addition, in this embodiment, by operating the operation component 153e, a new input field 153c, an operation component 153d, and an input field 154 can be displayed. The new input field 153c is a blank input field 153c. Therefore, in this embodiment, it is possible to create new journalization determination information that associates the contents of the details with the journalization information.

[0194] In this way, in this embodiment, a confirmation screen for checking the results of document recognition can be displayed with accounting information associated with a character string indicating the attributes of the document issuer entered.

[0195] In addition, in this embodiment, even if the issuer is the same, past accounting information is managed for each issuer attribute, such as the department or branch that actually issued the report, and the accounting information corresponding to the issuer attribute is entered into the confirmation screen.

[0196] Therefore, in this embodiment, even if the issuer has different accounting procedures depending on the branch office, it is easy to check whether the accounting procedures are appropriate.

[0197] As described above, in this embodiment, it is possible to reduce the work of inputting and checking journal information.

[0198] Each function of the above-described embodiments can be realized by one or more processing circuits. Here, the term "processing circuit" in this specification includes a processor programmed to execute each function by software, such as a processor implemented by an electronic circuit, and a device such as an ASIC (Application Specific Integrated Circuit), a DSP (digital signal processor), an FPGA (field programmable gate array), or a conventional circuit module designed to execute each function described above.

[0199] Additionally, the devices described in the embodiments are merely representative of one of multiple computing environments for implementing the embodiments disclosed herein.

[0200] In one embodiment, server apparatus 200 includes multiple computing devices, such as a server cluster, configured to communicate with each other over any type of communications link, including a network, shared memory, etc., to perform the processes disclosed herein. Similarly, server apparatus 200 may include multiple computing devices configured to communicate with each other.

[0201] Furthermore, the server device 200 can be configured to share the disclosed processing steps in various combinations. For example, the processes performed by the server device 200 can be performed by other server devices. Similarly, the functions of the server device 200 can be performed by other server devices. Also, the server device and each element of the other server devices can be integrated into one server device or separated into multiple devices.

[0202] The correspondence table in the statement may be generated by the learning effect of machine learning. Also, by classifying character strings that may be included in the description of transaction contents and account items by machine learning, it is not necessary to use the correspondence table.

[0203] Here, machine learning is a technology that allows a computer to acquire human-like learning capabilities, in which the computer autonomously generates algorithms necessary for judgments such as data identification from learning data that is previously loaded, and applies these to new data to make predictions. The learning method for machine learning may be any of supervised learning, unsupervised learning, semi-supervised learning, reinforcement learning, and deep learning, or may be a combination of these learning methods; any learning method for machine learning is acceptable.

[0204] Although the present invention has been described above based on the embodiments, the present invention is not limited to the requirements shown in the above embodiments. These points can be changed without departing from the spirit of the present invention, and can be appropriately determined according to the application form. [Explanation of symbols]

[0205] 100 Document Recognition System 200 Server device 220 Storage section 230 Form recognition processing unit 240 Image Database 245 tenant databases 250 Extraction Definition Database 255 Extraction Results Database 260 Journal entry discrimination database 265 Recognition Result Database 281 Image data storage unit 282 Job List Generation Unit 283 Image data acquisition unit 284 Character recognition section 285 Extraction result management department 286 Search Department 287 Journal Information Acquisition Department 288 Display control section 290 Recognition processing section 291 Recognition result generation unit 292 Information Update Department 293 Output section 300 Image forming device 400 Terminal Equipment [Prior art documents] [Patent documents]

[0206] [Patent Document 1] Patent Publication No. 2021-60801

Claims

1. An information processing system including a terminal device and an information processing device, The information processing device includes: an input receiving unit that receives a display request for a confirmation screen of a recognition result of a form from the terminal device; a display control unit that generates screen data of the confirmation screen including a character string indicating an attribute of the issuer of the document and journal information corresponding to the character string indicating the content of the details of the document, and displays the screen data on the terminal device; A journal information acquisition unit that refers to a storage unit that stores journal determination information including a character string indicating an attribute of the issuer, a character string indicating the content of the details, and journal information corresponding to the character string indicating the content of the details, and acquires the journal information corresponding to the character string indicating the content of the details, The terminal device A display unit displays the confirmation screen including a character string indicating an attribute of the issuer and journal information corresponding to the character string indicating the content of the statement based on the screen data, The confirmation screen is An operation part for requesting display of a list of character strings indicating attributes of the issuer included in the journalization discrimination information stored in the storage unit, The display control unit is When a display request for the list is received from the terminal device, a list of character strings indicating attributes of the issuer is displayed on the confirmation screen; The journal information acquisition unit Acquire, from the storage unit, journal information associated with a character string selected from a list of character strings indicating the attribute of the issuer; The display control unit is An information processing system that changes the journal information included in the confirmation screen to journal information associated with a character string selected from a list of character strings indicating attributes of the issuer.

2. The information processing device includes: an extraction result management unit that extracts a character string indicating an attribute of the issuer and a character string indicating the content of the statement from read result information obtained by character recognition processing of image data indicating the statement; The display control unit is The information processing system according to claim 1 , wherein the screen data includes the journal information acquired by the journal information acquisition unit.

3. The confirmation screen is an input field in which a character string indicating the content of the statement and journal information corresponding to the character string indicating the content of the statement are input; an operation component for instructing association of a character string indicating the content of the detail inputted in the input field with journal information corresponding to the character string indicating the content of the detail, The information processing device includes: The information processing system of claim 2 further comprises an information update unit which, upon receiving an instruction for the association from the terminal device, creates journal entry discrimination information by associating a character string indicating the contents of the detail entered in the input field with journal entry information corresponding to the character string indicating the contents of the detail, and a character string indicating the attributes of the issuer, and stores the information in the memory unit.

4. an input receiving unit that receives a request to display a confirmation screen for a recognition result of the form; a display control unit that generates screen data of the confirmation screen including a character string indicating an attribute of the issuer of the document and journal information corresponding to the character string indicating the content of the details of the document, and displays the screen data on a terminal device; A journal information acquisition unit that refers to a storage unit that stores journal determination information including a character string indicating an attribute of the issuer, a character string indicating the content of the details, and journal information corresponding to the character string indicating the content of the details, and acquires the journal information corresponding to the character string indicating the content of the details, The confirmation screen is An operation part for requesting display of a list of character strings indicating attributes of the issuer included in the journalization discrimination information stored in the storage unit, The display control unit is When a display request for the list is received from the terminal device, a list of character strings indicating attributes of the issuer is displayed on the confirmation screen; The journal information acquisition unit Acquire, from the storage unit, journal information associated with a character string selected from a list of character strings indicating the attribute of the issuer; The display control unit is An information processing device that changes the journal information included in the confirmation screen to journal information associated with a character string selected from a list of character strings indicating an attribute of the issuer.

5. an extraction result management unit that extracts a character string indicating an attribute of the issuer and a character string indicating the content of the statement from read result information obtained by character recognition processing of image data indicating the statement; The display control unit is The information processing apparatus according to claim 4 , wherein the screen data includes the journal information acquired by the journal information acquisition unit.

6. The confirmation screen is an input field in which a character string indicating the content of the statement and journal information corresponding to the character string indicating the content of the statement are input; an operation component for instructing association of a character string indicating the content of the detail inputted in the input field with journal information corresponding to the character string indicating the content of the detail, An information processing device as described in claim 5, having an information update unit that, when it receives an instruction for the association from the terminal device, associates a character string indicating the contents of the detail entered in the input field with journal entry information corresponding to the character string indicating the contents of the detail, and a character string indicating the attributes of the issuer, as journal entry determination information, and stores it in the memory unit.

7. An information processing method by an information processing system including a terminal device and an information processing device, The information processing device, an input receiving unit receives a request for displaying a confirmation screen of the recognition result of the form from the terminal device; a display control unit that generates screen data for the confirmation screen including a character string indicating an attribute of the issuer of the document and journal information corresponding to the character string indicating the content of the details of the document, and displays the screen data on the terminal device; A journal information acquisition unit refers to a storage unit in which journal determination information including a character string indicating an attribute of the issuer, a character string indicating the content of the detail, and journal information corresponding to the character string indicating the content of the detail is stored, and acquires the journal information corresponding to the character string indicating the content of the detail; The terminal device, displaying the confirmation screen including a character string indicating an attribute of the issuer and journal information corresponding to a character string indicating the content of the statement based on the screen data; The confirmation screen is An operation part for requesting display of a list of character strings indicating attributes of the issuer included in the journalization discrimination information stored in the storage unit, The information processing device, The display control unit When a display request for the list is received from the terminal device, a list of character strings indicating attributes of the issuer is displayed on the confirmation screen; The journal information acquisition unit: Acquire, from the storage unit, journal information associated with a character string selected from a list of character strings indicating the attribute of the issuer; The display control unit An information processing method for changing the journal information included in the confirmation screen to journal information associated with a character string selected from a list of character strings indicating an attribute of the issuer.

8. The information processing device, extracting a character string indicating an attribute of the issuer and a character string indicating the content of the statement from read result information obtained by character recognition processing of the image data indicating the statement; The information processing method according to claim 7 , further comprising the step of: including the acquired journal information in the screen data.

9. The confirmation screen is an input field in which a character string indicating the content of the statement and journal information corresponding to the character string indicating the content of the statement are input; an operation component for instructing association of a character string indicating the content of the detail inputted in the input field with journal information corresponding to the character string indicating the content of the detail, The information processing device, An information processing method as described in claim 8, wherein when an instruction for the correspondence is received from the terminal device, a character string indicating the contents of the detail entered in the input field and journal entry information corresponding to the character string indicating the contents of the detail are treated as journal entry determination information that corresponds to a character string indicating the attributes of the issuer, and the information stored in the memory unit is updated.

10. A process of receiving a request to display a confirmation screen for the recognition result of the form; A process of generating screen data of the confirmation screen including a character string indicating an attribute of the issuer of the document and journal information corresponding to a character string indicating the content of the details of the document, and displaying the screen data on a terminal device; a process of referring to a storage unit in which journal entry determination information including a character string indicating an attribute of the issuer, a character string indicating the content of the detail, and journal entry information corresponding to the character string indicating the content of the detail is stored, and acquiring the journal entry information corresponding to the character string indicating the content of the detail; The confirmation screen is An operation part for requesting display of a list of character strings indicating attributes of the issuer included in the journalization discrimination information stored in the storage unit, The process of displaying the information processing device includes: When a display request for the list is received from the terminal device, a list of character strings indicating attributes of the issuer is displayed on the confirmation screen; The acquiring process includes: acquires, from the storage unit, journal information associated with a character string selected from a list of character strings indicating the attribute of the issuer; The process of displaying the information processing device includes: An information processing program that executes a process of changing the journal information included in the confirmation screen to journal information associated with a character string selected from a list of character strings indicating an attribute of the issuer.

Images