Information processing device, information processing system, and information processing program

The information processing device simplifies the confirmation of document compliance with workflow conditions by using a processor to identify the current step and apply a key-value list for efficient extraction and validation of document elements.

JP7669729B2Active Publication Date: 2025-04-30FUJIFILM BUSINESS INNOVATION CORP
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2021036451
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-03-08
Publication Date
2025-04-30
Estimated Expiration
2041-03-08

AI Technical Summary

Technical Problem

Existing systems require complex tasks to confirm whether a document meets the conditions for each step in a workflow, leading to inefficiencies and potential errors due to varying requirements across different document formats and workflow steps.

Method used

An information processing device equipped with a processor that identifies the current step in a workflow and determines if a document meets predefined conditions by extracting specific characters or images using a key-value list, thereby simplifying the confirmation process.

Benefits of technology

This solution enables efficient confirmation of document compliance with workflow conditions without requiring complex tasks, reducing errors and improving workflow efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007669729000001
    Figure 0007669729000001
  • Figure 0007669729000002
    Figure 0007669729000002
  • Figure 0007669729000003
    Figure 0007669729000003
Patent Text Reader

Abstract

To provide an information processing device, an information processing system, and an information processing program, capable of checking whether a read document fulfills a condition to be satisfied at a current step of workflows without performing complicated work to check points to be checked for each step of the workflows.SOLUTION: An acquisition section 50 acquires, from an information processing terminal 14, ledger data generated by that an image forming device 12 reads a ledger, an identifying section 52 identifies at which step of workflows the acquired ledger data is, a condition extraction section 54 extracts a condition to be satisfied by the ledger at the identified step of workflows, a determination section 58 determines whether or not the leger data acquired by the acquisition section 50 fulfills the condition to be satisfied by the ledger at the step of the workflows, and an output section 60 outputs a determination result of the determination section 58 to the information processing terminal 14.SELECTED DRAWING: Figure 4
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an information processing device, an information processing system, and an information processing program. [Background technology]

[0002] Patent Document 1 proposes a technique for automatically associating data extracted from a receipt with data registered for a workflow.

[0003] Specifically, the management server associates a specific user ID, receipt image data, and receipt information data contained in the expense data received from the terminal device with the expense ID and stores them in the basic information DB and detailed information DB, identifies a service ID associated with the specific user ID stored in the basic information DB and detailed information DB from the service information DB that stores service information including service IDs and user IDs, associates it with the expense ID associated with the specific user ID, and stores the identified service ID in the basic information DB and detailed information DB. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2015-162077 A Summary of the Invention [Problem to be solved by the invention]

[0005] Even for the same document, the points to be checked differ for each step of the workflow, which requires tedious work to check the points to be checked. Even if the points to be checked for each document format are determined in advance, the points to be checked differ for each step, so even if the points are set uniformly for each document format, there will be waste or insufficiency in the check points.

[0006] Therefore, an object of the present invention is to provide an information processing device, an information processing system, and an information processing program that are capable of checking whether a scanned document meets the conditions that must be satisfied at the current step of a workflow, without having to perform the cumbersome task of checking points that must be checked at each step of the workflow. [Means for solving the problem]

[0007] In order to achieve the above object, an information processing device according to a first aspect includes a processor, and the processor performs a process of identifying which step of a workflow including a plurality of steps a read document belongs to, and notifying a result of determining whether the document corresponds to a predetermined condition that the document should satisfy in the identified step. When the processor detects the start of each step, the processor extracts specific characters or images around the characters of the key as a value using specific characters included in the document as a key, and extracts confirmation items from the document according to a key-value list predetermined for each step to determine whether the document satisfies the condition. .

[0008] In addition, an information processing device according to a second aspect is the information processing device according to the first aspect, wherein the processor: In the case where the presence or absence of a seal is detected as the condition, it is judged whether the condition is met by detecting whether a seal is present in a seal area detected from an image obtained by reading the document in the past or in a position coordinate registered in advance. .

[0009] In addition, in an information processing device according to a third aspect, in the information processing device according to the second aspect, the start of the step is detected by detecting the registration of the document to be processed, to which specific information for identifying the step has been assigned.

[0010] In addition, in the information processing device according to a fourth aspect, in the information processing device according to any one of the first to third aspects, the processor further performs a process of returning the request when the condition is not met.

[0011] In addition, in an information processing device according to a fifth aspect, in the information processing device according to any one of the first to fourth aspects, the processor extracts predetermined items from the document corresponding to the identified step and determines whether the conditions are met.

[0012] In addition, in the information processing device according to a sixth aspect, in the information processing device according to the fifth aspect, the processor extracts, from the document, items that should be confirmed by the person in charge for each step as the predetermined items.

[0013] In addition, an information processing system according to a seventh aspect includes the above-mentioned information processing device, a reading device that reads the document output by the person in charge of each step, and an information processing terminal that is operated by the person in charge of each step and requests the information processing device to execute a process to notify the result of determining whether the document is relevant, and displays the result.

[0014] An information processing program according to an eighth aspect of the present invention is an information processing program for causing a computer to execute a process of identifying which step of a workflow including a plurality of steps a read document belongs to, and notifying a result of a determination as to whether the document corresponds to a predetermined condition that the document should satisfy in the identified step. When the start of each step is detected, a specific character included in the document is used as a key, and a specific character or image around the character of the key is extracted as a value. A confirmation item is extracted from the document according to a key-value list that is predetermined for each step, and it is determined whether the document satisfies the condition. . Effect of the Invention

[0015] According to the first aspect, it is possible to provide an information processing device that can check whether a scanned document satisfies the conditions that should be satisfied in the current step of a workflow, without having to carry out the cumbersome task of checking points that should be checked for each step of the workflow. and be able to identify the current step in the workflow. do.

[0016] According to the second aspect, Judgment on the presence or absence of a seal This becomes possible.

[0017] According to the third aspect, it is possible to detect the start of the current step.

[0018] According to the fourth aspect, it is possible to notify that the scanned document does not satisfy the conditions of the current step.

[0019] According to the fifth aspect, it is possible to extract from the document items for checking whether or not the conditions for each step are met.

[0020] According to the sixth aspect, it is possible to extract from the document the items that should be checked by the person in charge at each step.

[0021] According to the seventh aspect, it is possible to provide an information processing system that can check whether a scanned document meets the conditions that must be satisfied at the current step of a workflow, without having to perform the tedious task of checking points that must be checked at each step of the workflow.

[0022] According to the eighth aspect, it is possible to provide an information processing program that can check whether a scanned document satisfies the conditions that should be satisfied in the current step of a workflow, without performing the cumbersome task of checking points that should be checked for each step of the workflow. and be able to identify the current step in the workflow. do. [Brief description of the drawings]

[0023] [Figure 1] 1 is a diagram showing a schematic configuration of an information processing system according to an embodiment of the present invention. [Diagram 2] 2 is a block diagram showing a configuration of a main part of an electrical system of the image forming apparatus according to the embodiment; [Diagram 3] 2 is a block diagram showing the configuration of a main part of an electrical system of the information processing terminal and the cloud server according to the embodiment; FIG. [Figure 4] 2 is a functional block diagram showing the functional configuration of a cloud server in the information processing system according to the embodiment. FIG. [Diagram 5] 13A to 13C are diagrams showing examples of receipts for small amounts, large amounts with stamps, and large amounts without stamps. [Figure 6] 11 is a flowchart showing an example of the flow of processing carried out at an information processing terminal operated by an applicant when applying for settlement of a travel expense receipt in the information processing system according to the present embodiment. [Figure 7] 11 is a flowchart showing an example of the flow of processing performed when an application form is registered in a cloud server of the information processing system according to the present embodiment. [Figure 8] FIG. 13 is a diagram showing an example of a key-value list of an application step. [Figure 9] FIG. 9 is a diagram showing an example of an extraction result list for Nos. 1 to 7 of the key-value list in FIG. [Figure 10] FIG. 13 is a diagram showing an example of conditions of an application step. [Figure 11] 11 is a flowchart showing an example of the flow of processes performed at an information processing terminal operated by an approver when approving settlement of a receipt for travel expenses in the information processing system according to the present embodiment. [Figure 12] 13 is a flowchart showing an example of the flow of processing performed when an approved application form is registered in a cloud server of the information processing system according to the present embodiment. [Figure 13] FIG. 13 is a diagram showing an example of a key-value list of an approval step. [Figure 14] 13A and 13B are diagrams showing an extraction result list at the time of application before approval and a list to which the results after approval have been added. [Figure 15] 11 is a flowchart showing an example of the flow of processing carried out at an information processing terminal operated by a settler when settling a travel expense receipt in the information processing system according to the present embodiment. [Figure 16] 13 is a flowchart showing an example of the flow of processing performed when a settled application form is registered in a cloud server of the information processing system according to the present embodiment. [Figure 17] FIG. 13 is a diagram showing an example of a key-value list of a payment step. [Figure 18] 13A and 13B are diagrams showing an extraction result list before payment and a list to which the results after payment have been added. [Figure 19] FIG. 11 is a diagram for explaining a first method for detecting the presence or absence of a seal from a document. [Figure 20] FIG. 11 is a diagram for explaining a second method for detecting the presence or absence of a seal from a document. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0024] An example of the present embodiment will be described in detail below with reference to the drawings. In the present embodiment, an information processing system in which a plurality of image forming devices as an example of a reading device, a plurality of information processing terminals, and a cloud server as an example of an information processing device are connected to each other via a communication line such as a network will be described as an example. Fig. 1 is a diagram showing a schematic configuration of an information processing system 10 according to the present embodiment.

[0025] As shown in Fig. 1, the information processing system 10 according to the present embodiment includes a plurality of image forming apparatuses 12a, 12b, ..., a plurality of information processing terminals 14a, 14b, ..., and a cloud server 16. When it is not necessary to distinguish between the image forming apparatuses 12a, 12b, ... and the information processing terminals 14a, 14b, ..., the alphabets at the end of the reference numerals may be omitted. In addition, in the present embodiment, an example is described in which the image forming apparatuses 12a, 12b, ... and the information processing terminals 14a, 14b, ... are included, but the number of image forming apparatuses 12 may be one.

[0026] The image forming apparatuses 12, the information processing terminals 14, and the cloud server 16 are each connected to one another via a communication line 18 such as a LAN (Local Area Network), a WAN (Wide Area Network), the Internet, an intranet, etc. The image forming apparatuses 12, the information processing terminals 14, and the cloud server 16 are each capable of transmitting and receiving various data to and from one another via the communication line 18.

[0027] FIG. 2 is a block diagram showing the main configuration of an electrical system of the image forming apparatus 12 according to this embodiment.

[0028] As shown in Fig. 3, the image forming apparatus 12 according to this embodiment includes a control unit 20 including a CPU (Central Processing Unit) 20A, a ROM (Read Only Memory) 20B, and a RAM (Random Access Memory) 20C. The CPU 20A controls the overall operation of the image forming apparatus 12. The RAM 20C is used as a work area when the CPU 20A executes various programs. The ROM 20B stores various control programs, various parameters, and the like in advance. In the image forming apparatus 12, each component of the control unit 20 is electrically connected to each other via a system bus 42.

[0029] On the other hand, the image forming apparatus 12 according to the present embodiment includes a HDD (hard disk drive) 26 that stores various data, application programs, and the like. The image forming apparatus 12 is also connected to a user interface 22 and includes a display control unit 28 that controls the display of various operation screens, etc., on the display of the user interface 22. The image forming apparatus 12 is also connected to the user interface 22 and includes an operation input detection unit 30 that detects operation instructions input via the user interface 22. In the image forming apparatus 12, the HDD 26, the display control unit 28, and the operation input detection unit 30 are electrically connected to a system bus 42. In the image forming apparatus 12 according to the present embodiment, the HDD 26 is used as a storage unit, but this is not limiting, and a non-volatile storage unit such as a flash memory may be used.

[0030] The image forming apparatus 12 according to the present embodiment includes a reading control unit 32 that controls the optical image reading operation by the document reading unit 44 and the document feeding operation by the document transport unit, and an image forming control unit 34 that controls the image forming process by the image forming unit 24 and the transport of paper to the image forming unit 24 by the transport unit 25. The image forming apparatus 12 also includes a communication line I / F (interface) unit 36 ​​that is connected to the communication line 18 and transmits and receives communication data to and from other external devices such as the cloud server 16 connected to the communication line 18. The image forming apparatus 12 also includes a facsimile I / F (interface) unit 38 that is connected to a telephone line (not shown) and transmits and receives facsimile data to and from a facsimile device connected to the telephone line. The image forming apparatus 12 also includes a transmission / reception control unit 40 that controls the transmission and reception of facsimile data via the facsimile I / F unit 38. In the image forming device 12, the transmission / reception control unit 40, the reading control unit 32, the image forming control unit 34, the communication line I / F unit 36, the facsimile I / F unit 38, and the log collection unit 46 are electrically connected to the system bus 42.

[0031] With the above configuration, the image forming apparatus 12 according to the present embodiment executes access to the RAM 20C, the ROM 20B, and the HDD 26 by the CPU 20A. The image forming apparatus 12 also executes control of display of information such as an operation screen and various messages on the display 22A of the user interface 22 via the display control unit 28 by the CPU 20A. The image forming apparatus 12 also executes control of operation of the document reading unit 44 and the document transport unit via the reading control unit 32 by the CPU 20A. The image forming apparatus 12 also executes control of operation of the image forming unit 24 and the transport unit 25 via the image formation control unit 34, and control of transmission and reception of communication data via the communication line I / F unit 36 ​​by the CPU 20A. The image forming apparatus 12 also executes control of transmission and reception of facsimile data via the facsimile I / F unit 38 by the transmission and reception control unit 40 by the CPU 20A. Furthermore, in the image forming apparatus 12, the CPU 20A grasps the operation content in the user interface 22 based on the operation information detected by the operation input detection unit 30, and executes various controls based on the operation content.

[0032] Next, a description will be given of the main configuration of the electrical system of information processing terminal 14 and cloud server 16 according to this embodiment. Fig. 3 is a block diagram showing the main configuration of the electrical system of information processing terminal 14 and cloud server 16 according to this embodiment. Note that information processing terminal 14 and cloud server 16 are basically configured as general computers, so cloud server 16 will be described here as a representative.

[0033] As shown in FIG. 3, the cloud server 16 according to the present embodiment includes a CPU 16A, a ROM 16B, a RAM 16C, a HDD 16D, a keyboard 16E, a display 16F, and a communication line I / F (interface) unit 16G. The CPU 16A controls the overall operation of the cloud server 16. The ROM 16B stores various control programs and various parameters in advance. The RAM 16C is used as a work area when the CPU 16A executes various programs. The HDD 16D stores various data and application programs. The keyboard 16E is used to input various information. The display 16F is used to display various information. The communication line I / F unit 16G is connected to the communication line 18 and transmits and receives various data to and from other devices connected to the communication line 18. The above-mentioned units of the cloud server 16 are electrically connected to each other via a system bus 16H. In addition, in the cloud server 16 according to the present embodiment, the HDD 16D is used as a storage unit, but the present invention is not limited to this, and other non-volatile storage units such as flash memory may be used.

[0034] With the above configuration, cloud server 16 according to this embodiment executes, by CPU 16A, access to ROM 16B, RAM 16C, and HDD 16D, acquisition of various data via keyboard 16E, and display of various information on display 16F. Cloud server 16 also executes, by CPU 16A, control of transmission and reception of communication data via communication line I / F unit 16G.

[0035] In the information processing system 10 configured as described above, the cloud services provided by the cloud server 16 are made available from the information processing terminal 14 .

[0036] In the information processing system 10 configured as described above, when processing is performed according to a workflow including a plurality of steps using a form, a form checking service is provided as a cloud service for checking the form for each step of the workflow.

[0037] Here, a functional configuration will be described that is realized by the CPU 16A expanding a program stored in the ROM 16B into the RAM 16C and executing it when the cloud server 16 of the information processing system according to this embodiment provides a document checking service. Fig. 4 is a functional block diagram showing the functional configuration of the cloud server 16 in the information processing system 10 according to this embodiment.

[0038] The cloud server 16 has the functions of an acquisition unit 50, a specification unit 52, a condition extraction unit 54, a determination unit 58, and an output unit 60.

[0039] The acquiring unit 50 acquires form data generated by reading a form using the image forming device 12 or the like from the information processing terminal 14 or the like. For example, in a workflow including a plurality of steps, a person in charge of each step transmits form data generated by reading a form using the image forming device 12 from the information processing terminal 14, and the acquiring unit 50 acquires the form data.

[0040] The identification unit 52 identifies which step of the workflow the form data acquired from the information processing terminal 14 corresponds to. For example, the step of the workflow may be identified by identifying the person in charge of the information processing terminal 14, or the application number of the form may be extracted from the form data and used as the application number. In this case, information on the authenticated user may be acquired to identify whether the person is an applicant or an approver, thereby confirming whether the workflow is following the correct steps.

[0041] The condition extraction unit 54 extracts conditions that the form should satisfy in the steps of the workflow specified by the specification unit 52. Specifically, conditions that the form should satisfy corresponding to each step of the workflow are stored in advance in the condition DB 56, and the conditions corresponding to the steps are read out. In addition, when extracting conditions, since items to be extracted from the form data for each step are different, a key value list to be extracted for each step is also stored in advance in the condition DB (database) 56, and a key value list corresponding to the step is extracted. Note that the key value list is a list that is predetermined for each step of the workflow when a specific character included in the document of the form is detected as a key and a specific character or image around the character of the key is extracted as a value. In addition, hereinafter, detecting a specific character or image as a key and extracting a specific character or image around the character or image of the key as a value may be referred to as key value extraction.

[0042] The determination unit 58 determines whether or not the form data acquired by the acquisition unit 50 corresponds to the condition that the form should satisfy in the workflow step extracted by the condition extraction unit 54 .

[0043] The output unit 60 outputs the result of the judgment by the judgment unit 58 to the information processing terminal 14 or the like. For example, if the judgment unit 58 finds that the conditions are met, it notifies the information processing terminal 14 of the next person in charge in the workflow. On the other hand, if the judgment unit 58 finds that there is a part that does not meet the conditions, it returns the form data to the information processing terminal 14 of the applicant for correction or resubmission.

[0044] Next, the document checking service provided by the cloud server 16 will be described with a concrete example.

[0045] The document confirmation service provided by the cloud server 16 will be described below by taking a workflow for settling travel expense receipts as an example.

[0046] The workflow for settling travel expense receipts includes an application step in which application documents are prepared and submitted, an approval step in which the applicant's superior or other person reviews and approves the application documents, and a settlement step in which the accounting department or other department settles the approved application documents.

[0047] Since the contents to be checked differ even for the same form at each step of the application step, approval step, and settlement step, the form is checked for each step using the form checking service provided by cloud server 16. For example, since the seal impression to be checked at each step differs even for the same form, cloud server 16 performs processing to check the presence or absence of a seal impression for each step. Note that, although affixing a seal is hereinafter expressed as "sealing," this embodiment includes not only "signing and sealing" but also "sealing" which is a signature seal.

[0048] Here, the workflow will be briefly explained. In the application step, a receipt or other document is read by the image forming device 12 to generate document data, and the applicant operates the information processing terminal 14 to input an application request, prepares an application form, and transmits the application form to the information processing terminal 14 of a superior or the like to make an application. The application form includes application details such as the application date, payment date, and face value, as well as document data generated by reading the applicant's stamped receipt by the image forming device 12, and in the case of a high-value receipt, a decision-making document. For example, as shown in FIG. 5, receipts are classified into a small amount, a large amount with a stamp, and a large amount without a stamp. In FIG. 5, a receipt of less than 50,000 yen that does not require a revenue stamp is shown as a small amount, a receipt of 50,000 yen or more that requires a revenue stamp is shown as a large amount, and a receipt that requires a revenue stamp but does not require a stamp (approved by the tax office) is shown as a large amount without a stamp.

[0049] In the approval step, the application content and the document data of the application form are received, and it is judged whether there are any problems with the procedure. For example, it is confirmed whether the contents of the document data are in accordance with the predetermined rules. If there are no problems, the document data such as receipt data is output as a paper document by the image forming device 12, and an approval seal is affixed, and the document data is read again by the image forming device 12 to generate the document data and notify the decision maker of the application request, or an electronic seal or electronic signature of approval is affixed to the document data such as the receipt data and notify the decision maker of the application request, and if there is a problem, the document is returned to the applicant and notified of the error.

[0050] In the settlement step, the application request notification is received and the contents of the application request are checked. For example, it is determined whether the application conforms to predefined procedural rules. If there are no problems, the settlement process is carried out, but if there are problems, the application is returned to the approver or applicant and notified of the error.

[0051] In the report cloud service, since the conditions to be checked differ at each step of the above-mentioned workflow, the service identifies the step, reads the conditions, determines whether the application form meets the conditions, and notifies the person in charge of each step of the determination result.

[0052] Next, specific processes performed in each unit of the information processing system 10 according to this embodiment configured as described above will be described.

[0053] First, the process performed by the information processing terminal 14 operated by the applicant when applying for the settlement of a travel expense receipt will be described. Fig. 6 is a flow chart showing an example of the flow of the process performed by the information processing terminal 14 operated by the applicant when applying for the settlement of a travel expense receipt in the information processing system 10 according to this embodiment. Note that the process in Fig. 6 starts, for example, when an application step of a predetermined workflow for applying for the settlement of a travel expense receipt is designated.

[0054] In step 100, the CPU 14A assigns an application status to the designated workflow, and the process proceeds to step .

[0055] In step 102, the CPU 14A performs a process to obtain the results of reading the paper form, and then proceeds to step 104. In this process, for example, the applicant operates the information processing terminal 14 to create an application form as a form and outputs it from the image forming device 12. Then, the applicant stamps the output paper application form and receipt, etc., and the image forming device 12 reads the stamped application form and receipt, etc., to generate form data, which the information processing terminal 14 obtains. Alternatively, the applicant operates the information processing terminal 14 to input the application details. Then, the applicant stamps the receipt, and the image forming device 12 generates the stamped application receipt, which the information processing terminal 14 generates as form data.

[0056] In step 104, CPU 14A determines whether or not a system registration instruction has been issued. This is done by determining whether or not registration has been made with cloud server 16. The process waits until the determination is affirmative, and proceeds to step .

[0057] In step 106, CPU 14A registers the form data in the system, and ends the series of processes. That is, the application form is registered in cloud server 16 from information processing terminal 14 as a document to be processed.

[0058] Next, a process performed in the cloud server 16 when an application form is registered in the cloud server 16 will be described. Fig. 7 is a flow chart showing an example of the flow of processes performed when form data is registered in the cloud server 16 of the information processing system 10 according to this embodiment. Note that the process in Fig. 7 starts, for example, when the form data is registered in the cloud server 16 in step 106 described above. Alternatively, it may start when the form data is stored in a predetermined folder for applications.

[0059] In step 200, the CPU 16A identifies the application step and proceeds to step 202. That is, the identification unit 52 identifies which step of the workflow the form data acquired from the information processing terminal 14 corresponds to. For example, the application step is identified by confirming that an application status is assigned to the workflow as specific information for the registered application form. Specifically, the workflow in the system is identified using the application number of the registered application form or the like as a key, and it is identified that the current phase is an application step from the assigned status.

[0060] In step 202, the CPU 16A extracts the key value list in the application step and proceeds to step 204. That is, when the condition extraction unit 54 extracts the conditions that the form should satisfy in the steps of the workflow specified by the specifying unit 52, since the items to be extracted for each step from the form data are different, the key value list to be extracted for each step is extracted from the condition DB 56. For example, as an example of the key value list in the application step, the key value list shown in FIG. 8 is extracted. FIG. 8 shows the key value list in the application step in which the items to be confirmed, the extraction items, and the processing contents are determined in advance. In the example of FIG. 8, seven key value lists numbered 1 to 7 are shown. Specifically, No. 1 is the item to confirm the presence or absence of the application seal. By detecting the presence or absence of the seal impression by image processing, registering the applicant's seal in advance, and collating, the presence or absence of the application seal is extracted. No. 2 is the item to confirm the name of the addressee, company name, and applicant name. By detecting a character string such as "applicant name", extracting the surrounding character strings, detecting a character string such as "様" for the name of the addressee, and performing character recognition on the company name and name from the surrounding character strings, the description contents of the company name and applicant name are extracted. No. 3 is the item to confirm the face value. By detecting the character strings of "¥" and "円" and extracting the adjacent numbers, the numerical value of the face value is extracted. No. 4 is the item to confirm the presence or absence of the stamp paper. By registering the stamp paper image and collating by image processing, the presence or absence of the stamp paper is extracted. No. 5 is the item to confirm the omission of the stamp paper. It outputs "1" twice the number of character strings extracted and "0" if not extracted, and extracts the character strings of "stamp paper tax", "declaration and payment", "tax office", and "approval". No. 6 is the item to confirm the split stamp on the stamp paper. For example, by detecting whether there is a seal impression in the stamp paper area by color detection image processing or the like, the presence or absence of the split stamp is extracted. No. 7 is the item to confirm the presence or absence of attached documents. At the time of application to the system, by detecting the upload of attached documents such as receipts and minutes of resolutions in addition to the receipt, the presence or absence of attached documents is extracted.

[0061] In step 204, the CPU 16A extracts the confirmation items from the form data and proceeds to step 206. That is, the extraction items in the key value list of FIG. 8 are extracted.

[0062] In step 206, the CPU 16A generates an extraction result list of the confirmation items and proceeds to step 208. For example, an extraction result list is generated as shown in FIG. 9. FIG. 9 shows an extraction result list for No. 1 to No. 7 of the key-value list in FIG. 8. In the example of FIG. 9, "Yes" is extracted as the confirmation value for the presence or absence of the applicant seal in No. 1, "ABC (Stock Company)" and "Hakone Tobari" are extracted as the confirmation values ​​for the company name and applicant name in No. 2, "500,000" is extracted as the acknowledgement of the face value in No. 3, "Yes" is extracted as the confirmation value for the presence or absence of a stamp in No. 4, "0" is extracted as the confirmation value for the omission of a stamp in No. 5, "Yes" is extracted as the confirmation value for the stamp punctuation in No. 6, "Yes" is extracted as the confirmation value for the presence or absence of an attached document in No. 7, and "Yes" is extracted as the presence or absence of an application status in No. 8.

[0063] In step 208, the CPU 16A checks the extraction result list against the predetermined conditions of the application step, and proceeds to step 210. That is, the determination unit 58 determines whether or not the form data acquired by the acquisition unit 50 corresponds to the conditions that the form should satisfy in the workflow step extracted by the condition extraction unit 54. For example, an example of the conditions of the application step is shown in FIG. Figure 10 shows an example where the conditions are as follows: if the rule value of No. 1 is Yes, the rule value of No. 2 is ABC (Stock) and Hakone Tobori, the rule value of No. 3 remains a numeric value, and the rule value of No. 4 is that if stamp is not extracted (No. 5 = 0), then face value (the value of No. 3) ≧ required stamp amount is set to “Yes”, and face value < required stamp amount is set to “No”, the rule value of No. 5 remains a numeric value, the rule value of No. 6 is that stamp is omitted (the value of No. 5 = 0), stamp is present (the value of No. 4 = “Yes”), and stamp punctuation is present (the value of No. 6 = “Yes”), and none otherwise, the rule value of No. 7 is “Yes” if the face value (the value of No. 3) ≧ a predetermined amount, and “No” otherwise, and the rule value of No. 8 is Yes.

[0064] In step 210, the CPU 16A judges whether the condition is met. This judges whether the condition matches the collation result of the extraction result list. If the judgement is negative, the process proceeds to step 212, and if the judgement is positive, the process proceeds to step 214.

[0065] In step 212, the CPU 16A notifies the applicant of the content of the deficiency, and the series of processes ends. That is, the output unit 60 notifies the applicant of the content of the deficiency to the information processing terminal 14 of the applicant.

[0066] On the other hand, in step 214, the CPU 16A transmits an approval request to the information processing terminal 14 of the approver, and ends the series of processes.

[0067] Next, a process performed by the information processing terminal 14 operated by the approver when approving the settlement of a travel expense receipt will be described. Fig. 11 is a flow chart showing an example of the flow of the process performed by the information processing terminal 14 operated by the approver when approving the settlement of a travel expense receipt in the information processing system 10 according to this embodiment. Note that the process in Fig. 11 starts, for example, when an approval request is received from the cloud server 16 and the approver gives an instruction to start the approval process.

[0068] In step 300, the CPU 14A obtains a list of judgment values ​​of the collation results at the time of application, displays it on the display 14F, and then proceeds to step 302.

[0069] In step 302, the CPU 14A judges whether or not there is a problem with the judgment value list. If the judgment is negative, the process proceeds to step 304, and if the judgment is positive, the process proceeds to step 306.

[0070] In step 304, CPU 14A registers the inadequacy of the application content in the system, and ends the series of processes. That is, CPU 14A registers in cloud server 16 that the application content is inadequate.

[0071] In step 306, the CPU 14A performs a process for obtaining the results of reading the paper form, and then proceeds to step 308. In the process for obtaining the results of reading, for example, the approver operates the information processing terminal 14 to output an application form, receipt, etc. from the image forming device 12. Then, the information processing terminal 14 performs a process for obtaining form data generated by stamping the application form, receipt, etc. with the image forming device 12 and reading the stamped application form, receipt, etc.

[0072] In step 308, CPU 14A assigns an approval status to the workflow, registers the approval details in the system, and ends the series of processes. That is, the approved form data is registered in cloud server 16 as a document to be processed.

[0073] Next, a process performed in the cloud server 16 when the approved form data is registered in the cloud server 16 will be described. Fig. 12 is a flowchart showing an example of the flow of a process performed in the cloud server 16 of the information processing system 10 according to this embodiment when the approved form data is registered. The process in Fig. 12 starts, for example, when the form data approved in the above-mentioned step 308 is registered in the cloud server 16. Alternatively, it may start when the form data is stored in a predetermined folder for approval.

[0074] In step 400, the CPU 16A identifies the approval step and proceeds to step 402. That is, the identification unit 52 identifies which step of the workflow the form data acquired from the information processing terminal 14 corresponds to. For example, the application step is identified by confirming that an approval status is assigned to the workflow as specific information for the registered form data. Specifically, the workflow in the system is identified using the application number of the registered form data or the like as a key, and the current phase is identified as an approval step from the assigned status.

[0075] In step 402, the CPU 16A extracts a key value list for the approval step and proceeds to step 404. That is, when the condition extraction unit 54 extracts the conditions that the form must satisfy in the steps of the workflow identified by the identification unit 52, the items extracted from the form data differ for each step, so the key value list to be extracted for each step is extracted from the condition DB 56. For example, as an example of a key value list for an approval step, the key value list shown in FIG. 13 is extracted. FIG. 13 shows a key value list for an approval step in which the items to be confirmed, the items to be extracted, and the processing contents are predetermined. The example in FIG. 13 shows a key value list for one approval step, No. 1. Specifically, No. 1 is an item for which the presence or absence of an approval stamp should be confirmed, and the presence or absence of a seal impression is detected by image processing to register the approver's seal in advance, and the presence or absence of the approval stamp is extracted by comparing the items.

[0076] In step 404, the CPU 16A extracts confirmation items from the form data, and the process proceeds to step 406. That is, the CPU 16A extracts the extraction items of the key-value list in FIG.

[0077] In step 406, the CPU 16A generates an extraction result list of confirmation items and proceeds to step 408. For example, an extraction result list is generated as shown in Fig. 14. Fig. 14 shows an extraction result list at the time of application before approval, and a list to which the results after approval have been added. The example in Fig. 14 shows an example in which a confirmation value for the presence or absence of an approval stamp (No. 9) and a confirmation value for the presence or absence of an approval status (No. 10) have been added to the list before approval.

[0078] In step 408, the CPU 16A checks the conditions of the approval step against the extraction result list, and proceeds to step 410. That is, the determination unit 58 determines whether or not the form data acquired by the acquisition unit 50 corresponds to the conditions that the form should satisfy in the workflow step extracted by the condition extraction unit 54. Note that a detailed description of the conditions of the approval step will be omitted, but similar to the application step, the conditions of the approval step are determined in advance and checked against the extraction result list.

[0079] In step 410, the CPU 16A judges whether the condition is met. This judges whether the condition matches the collation result of the extraction result list. If the judgement is negative, the process proceeds to step 412, and if the judgement is affirmative, the process proceeds to step 414.

[0080] In step 412, the CPU 16A notifies the subject of the deficiency content and ends the series of processes. That is, the output unit 60 notifies the subject of the deficiency content to the information processing terminal 14. The subject to be notified is at least one of the applicant and the approver.

[0081] On the other hand, in step 414, the CPU 16A transmits a settlement request to the information processing terminal 14 of the settler, and ends the series of processes.

[0082] Next, the process performed by the information processing terminal 14 operated by the settlor when settling the travel expense receipt will be described. Fig. 15 is a flow chart showing an example of the flow of the process performed by the information processing terminal 14 operated by the settlor when settling the travel expense receipt in the information processing system 10 according to this embodiment. Note that the process in Fig. 15 starts when, for example, a payment request is received from the cloud server 16 and the settlor instructs the start of the payment process.

[0083] In step 500, the CPU 14A obtains a list of judgment values ​​of the comparison results at the time of authentication, displays it on the display 14F, and then the process proceeds to step 502.

[0084] In step 502, the CPU 14A judges whether or not there is a problem with the judgment value list. If the judgment is negative, the process proceeds to step 504, and if the judgment is positive, the process proceeds to step 506.

[0085] In step 504, CPU 14A registers the inadequacy of the application content in the system, and ends the series of processes. That is, CPU 14A registers in cloud server 16 that the application content is inadequate.

[0086] In step 506, the CPU 14A performs a process for obtaining the results of reading the paper document, and then proceeds to step 508. In the process for obtaining the results of reading, for example, the settlor operates the information processing terminal 14 to output the application form, receipt, etc. from the image forming device 12. Then, the settlor seal is stamped on the output paper application form, receipt, etc., and the stamped application form, receipt, etc. are read by the image forming device 12, generating form data, which is then obtained by the information processing terminal 14.

[0087] In step 508, CPU 14A assigns the payment status to the workflow, registers the payment details in the system, and ends the series of processes. That is, the approved form data is registered in cloud server 16 as a document to be processed.

[0088] Next, a process performed in the cloud server 16 when a settled application form is registered in the cloud server 16 will be described. Fig. 16 is a flow chart showing an example of a process flow performed when settled form data is registered in the cloud server 16 of the information processing system 10 according to this embodiment. The process in Fig. 16 starts, for example, when settled form data is registered in the cloud server 16 in step 508 described above. Alternatively, it may start when form data is stored in a predetermined folder for settlement.

[0089] In step 600, the CPU 16A identifies the settlement step and proceeds to step 602. That is, the identification unit 52 identifies which step of the workflow the form data acquired from the information processing terminal 14 corresponds to. For example, the settlement step is identified by confirming that a settlement status is assigned to the workflow as identification information for the registered form data. Specifically, the application number or the like of the registered form data is used as a key to identify the workflow in the system, and the assigned status identifies that the current phase is the settlement step.

[0090] In step 602, the CPU 16A extracts a key value list for the payment step and proceeds to step 604. That is, when the condition extraction unit 54 extracts the conditions that the form must satisfy in the steps of the workflow identified by the identification unit 52, the items extracted from the form data differ for each step, so the key value list to be extracted for each step is extracted from the condition DB 56. For example, as an example of a key value list for a payment step, the key value list shown in FIG. 17 is extracted. FIG. 17 shows a key value list for a payment step in which the items to be confirmed, the items to be extracted, and the processing contents are predetermined. The example in FIG. 17 shows a key value list for one payment step, No. 1. Specifically, No. 1 is an item for which the presence or absence of a payment stamp should be confirmed, and the presence or absence of a seal impression is detected by image processing to register the payment person's stamp in advance, and the presence or absence of an approval stamp is extracted by comparing the items.

[0091] In step 604, the CPU 16A extracts confirmation items from the form data, and the process proceeds to step 606. That is, the CPU 16A extracts the extraction items of the key-value list in FIG.

[0092] In step 606, the CPU 16A generates an extraction result list of confirmation items and proceeds to step 608. For example, an extraction result list is generated as shown in FIG. 18. FIG. 18 shows the extraction result list before payment and a list with the results after payment added. The example in FIG. 18 shows an example in which a confirmation value for the presence or absence of an approval stamp (No. 11) and a confirmation value for the presence or absence of a payment status (No. 12) have been added before payment. Also shown is an example in which the system judgment value for each has been judged to be "OK".

[0093] In step 608, the CPU 16A checks the conditions of the payment step against the extraction result list, and proceeds to step 610. That is, the determination unit 58 determines whether or not the form data acquired by the acquisition unit 50 corresponds to the conditions that the form should satisfy in the workflow step extracted by the condition extraction unit 54. Note that a detailed description of the conditions of the payment step will be omitted, but similar to the application step, the conditions of the payment step are determined in advance and checked against the extraction result list.

[0094] In step 610, the CPU 16A judges whether the condition is met. This judges whether the condition matches the result of checking the extraction result list. If the judgement is negative, the process proceeds to step 612, and if the judgement is affirmative, the process proceeds to step 614.

[0095] In step 612, the CPU 16A notifies the subject of the deficiency and ends the series of processes. That is, the output unit 60 notifies the subject of the deficiency to the information processing terminal 14. The subject to be notified is at least one of the applicant, approver, and settler.

[0096] On the other hand, in step 614, the CPU 16A carries out a settlement process in accordance with the contents of the application, and ends the series of processes.

[0097] Here, a specific method for detecting the presence or absence of a seal from a document will be briefly described. As a method for detecting the presence or absence of a seal, for example, there are the following two methods, the first method and the second method.

[0098] Fig. 19 is a diagram for explaining a first method for detecting the presence or absence of a seal from a document. In the first method, images of past application forms are scanned and registered in the travel expense settlement past application DB 64, and the two are compared at the time of application to detect the seal. For example, the area where the seal is placed is detected by detecting a red circle or the like from the past application form using image processing. Then, it is determined whether or not a seal is detected on the current application form in the area where the seal was detected. If no seal is detected in the past area, it is determined that the seal has been left unstamped.

[0099] Fig. 20 is a diagram for explaining a second method for detecting the presence or absence of a seal from a document. In the second method, the position coordinates of the seal field are registered in advance in the seal position DB 66. For example, the coordinates of the location of the "seal" in Fig. 20 are registered. Then, the presence or absence of a seal near the corresponding coordinates on the read application form is detected. For example, the presence or absence of a seal is judged by determining through image processing whether or not there is a red component or a circular element near the registered coordinates.

[0100] In the above embodiment, the workflow for settling receipts for travel expenses is described as an example, but the workflow is not limited to this. For example, confirmation at a bank counter, confirmation of drawings, part specifications, etc. may be applied.

[0101] For example, in checking at a bank counter, the image forming device 12 reads the document, and the predetermined entry items (e.g., address, name, etc.) are used as keys, and only whether or not there is any character string written to the right of the items is judged. Then, in the examination phase, the key-value extraction is the same, but since it is necessary to confirm that the address is correct, the address is extracted as a key-value and searched to confirm the existence of the address. Also, although it is not necessary to read or extract a key-value from the attached documents (e.g., resident's certificate, etc.) at the time of acceptance, the key-value is extracted to check whether it matches the application form at the time of examination. Even in such a workflow, the items for key-value extraction differ for each step of the workflow, so as in the above embodiment, key-value extraction may be performed for each step, and the result of determining whether the condition to be checked at each step is met may be displayed.

[0102] In addition, when checking drawings or part specifications, there are cases where checking is required for each page, each assigned drawing, or each assigned part for drawings or part specifications that span multiple pages. In this case, the items for which key values ​​are extracted differ for each page, each assigned drawing, or each assigned part. For example, even in the image forming device 12, the person in charge is different even if they are nearby units such as a paper tray person and a paper feeder person. In addition, such checking may be completed by a unit and checked by the next unit, so that the phase is specified and the confirmation information of the related unit in that phase is specified, and the items to be obtained as key values ​​extracted differ for each phase. Therefore, as in the above embodiment, key values ​​may be extracted for each phase, and the results of determining whether the conditions to be checked in each phase are met may be displayed.

[0103] In the above embodiment, an example of providing cloud services using a single cloud server 16 has been described, but this is not limited to this, and multiple cloud servers 16 may work together to provide cloud services such as a document confirmation service.

[0104] In addition, in the above embodiment, the CPU has been described as an example of a processor, but the term "processor" refers to a processor in a broad sense, and includes general-purpose processors (e.g., CPUs, etc.) and dedicated processors (e.g., GPU: Graphics Processing Unit, ASIC: Application Specific Integrated Circuit, FPGA: Field Programmable Gate Array, programmable logic devices, etc.).

[0105] In addition, the operations of the processor in the above embodiments may be performed not only by one processor, but also by multiple processors located at physically separate locations working together. The order of the operations of the processor is not limited to the order described in the above embodiments, and may be changed as appropriate.

[0106] The processes performed by each unit of the information processing system 10 according to the above embodiment may be processes performed by software, may be processes performed by hardware, or may be processes that combine both. The processes performed by each unit of the information processing system 10 may be stored as a program in a storage medium and distributed.

[0107] Furthermore, the present invention is not limited to the above, and it goes without saying that various modifications can be made without departing from the spirit and scope of the present invention. [Explanation of symbols]

[0108] 10. Information Processing Systems 12 Image forming device 14 Information processing terminal 16 Cloud Server 16A CPU 50 Acquisition 52 Specific Department 54 Conditional extraction unit 56 Judgment Department 60 Output Department

Claims

1. a processor, the processor comprising: Identifying which step of a workflow including multiple steps corresponds to the scanned document; An information processing device that performs a process of notifying a result of determining whether the document corresponds to a predetermined condition that the document should satisfy in the specified step, When the processor detects the start of each step, it uses specific characters contained in the document as a key and extracts specific characters or images around the characters of the key as a value, extracts confirmation items from the document according to a key-value list predetermined for each step, and determines whether the document meets the conditions.

2. The information processing device according to claim 1, wherein when detecting the presence or absence of a seal as the condition, the processor determines whether the condition is met by detecting a seal area detected from an image read from a past document, or whether a seal has been applied to a position coordinate that has been registered in advance.

3. 3. The information processing apparatus according to claim 2, wherein the start of the step is detected by detecting registration of the document to be processed to which specific information for identifying the step is added.

4. 4. The information processing device according to claim 1, wherein the processor further performs a process of returning the document if the condition is not met.

5. 5. The information processing apparatus according to claim 1, wherein the processor extracts from the document a predetermined item corresponding to the identified step and determines whether the item satisfies the condition.

6. The information processing apparatus according to claim 5 , wherein the processor extracts, from the document, items to be confirmed by the person in charge of each step as the predetermined items.

7. An information processing device according to any one of claims 1 to 6; a reading device for reading the document output by the person in charge of each step; an information processing terminal which is operated by a person in charge of each step, requests the information processing device to execute a process of notifying the result of determining whether the document corresponds to the document, and displays the result; An information processing system comprising:

8. On the computer, Identifying which step of a workflow including multiple steps corresponds to the scanned document; An information processing program for executing a process of notifying a result of determining whether the document corresponds to a predetermined condition that the document should satisfy in the specified step, the information processing program comprising: An information processing program that, when it detects the start of each of the steps, uses specific characters contained in the document as a key and extracts specific characters or images around the characters of the key as a value, extracts confirmation items from the document according to a key-value list predetermined for each step, and determines whether the document meets the conditions.

Citation Information

Patent Citations

  • Document processor and processing method

    JP2008293221A

  • Information processor, information processing method, program and storage medium

    JP2009015376A

  • Data management program, data management system, and data management server

    JP2015162077A

  • System and method of processing workflow

    JP2016115009A

  • Work support system, work support method, and program

    JP2019191904A