Information processing device and program

The information processing device addresses defects in form entries and signatures by creating a blank second image for resubmission, ensuring the original form's integrity is maintained.

JP7581678B2Active Publication Date: 2024-11-13FUJIFILM BUSINESS INNOVATION CORP
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2020119051
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2020-07-10
Publication Date
2024-11-13
Estimated Expiration
2040-07-10

AI Technical Summary

Technical Problem

Existing form processing devices fail to handle defects such as missing signatures or seals in forms, requiring resubmission with the original form saved in association, which complicates the handling of defective reading objects.

Method used

An information processing device that recognizes defects in form entries and signatures, creating a blank second image to output for resubmission, ensuring the original is preserved.

Benefits of technology

Enables the output of a corrected image for resubmission while guaranteeing the integrity of the original form, addressing defects in entries and signatures.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007581678000001
    Figure 0007581678000001
  • Figure 0007581678000002
    Figure 0007581678000002
  • Figure 0007581678000003
    Figure 0007581678000003
Patent Text Reader

Abstract

To provide an information processing device and a program for outputting a resubmission image in place of a read target with defects, if any, while guaranteeing the original.SOLUTION: In an information processing system, the information processing device includes a control unit that acquires a recognition result for a resubmission form image read from a form which has one or more first columns 11a to 11e in which characters are filled, which has second columns 12a and 12b provided for signature or stamp, and at the first columns and second columns of which are filled or stamped, respectively; that forms a resubmission form image 10c in which the signature column 12a and the stamp column 12b remain blank when there is a defect in one of the first columns (for example, address columns 11a); and that forms the resubmission form image 10c with the signature columns 12a and the stamp columns 12b blank when the signature columns 12a or the stamp columns 12b have a defect, and that outputs the formed resubmission form image 10c.SELECTED DRAWING: Figure 6
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an information processing device and a program. [Background technology]

[0002] In recent years, a document processing device has been proposed that generates a refill document with a field for refilling when the content entered in the field of a document does not satisfy the constraint conditions previously set in the field (see, for example, Patent Document 1).

[0003] The form processing device described in Patent Document 1 comprises a first recognition means for recognizing the contents entered in the fill-in fields from a form image obtained by reading the form with the fill-in fields filled in after the form data has been printed; a generation means for generating refill form data including a fill-in field for refill and additional information indicating the refill form and causing a printing means to print the data if the recognition result by the first recognition means does not satisfy the constraint conditions previously set for the fill-in fields; and a second recognition means for recognizing the contents entered in the refill field from the form image if additional information is detected from the form image obtained by optically reading the form printed by the printing means and with the refill field filled in. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2016-53876 A Summary of the Invention [Problem to be solved by the invention]

[0005] If there is an error in a document that requires a signature or seal, and the originally submitted document is considered the original, the resubmitted document will need to be associated with the originally submitted document and saved.

[0006] An object of the present invention is to provide an information processing device and a program that, when a defect is found in a read object, outputs an image for resubmission in place of the defective read object while guaranteeing the authenticity of the original. [Means for solving the problem]

[0007] [1] A reading object having one or more first fields in which characters are written and a second field in which a signature or seal is affixed, No. and obtaining a recognition result in which characters are recognized from a first image of the object to be read in which a character is written or stamped in each of the first and second columns, and forming a second image in which the first and second columns in which there is a defect are left blank if there is a defect in any of the first columns, and forming a second image in which the second column is left blank if there is a defect in the second column, and outputting the formed second image. 。 [2 ] A read object having one or more first fields in which characters are written and a second field in which a signature or seal is affixed, No. A recognition result is obtained by recognizing characters in the first image of the object to be read, which is written or stamped in each of the columns of 2, If there is a defect in any of the first columns, a second image is formed in which the defective first column and the defective second column are left blank, and if there is a defect in the second column, a second image is formed in which the second column is left blank; A program for outputting the formed second image. Effect of the Invention

[0008] Claim 1, 2 According to the invention, if there is a defect in the read object, it is possible to output an image for resubmission in place of the defective read object while guaranteeing the original. 。 [Brief description of the drawings]

[0009] [Figure 1]FIG. 1 is a block diagram showing an example of a schematic configuration of an information processing system according to a first embodiment of the present invention. [Diagram 2] FIG. 2 is a diagram showing an example of a form. [Diagram 3] FIG. 3 is a diagram illustrating an example of a form item information table. [Figure 4] FIG. 4 is a diagram showing an example of a form image. [Diagram 5] FIG. 5 is a diagram showing an example of a form item information table in which the recognition results are recorded. [Figure 6] FIG. 6 is a diagram showing an example of a form image for resubmission. [Figure 7] FIG. 7 is a flowchart showing an example of the operation of the information processing device. [Figure 8] FIG. 8 is a block diagram showing an example of a schematic configuration of an information processing system according to the second embodiment of the present invention. [Figure 9] FIG. 9 is a diagram showing an example of a form image including a marker. [Figure 10] FIG. 10 is a flowchart showing an example of the operation of the information processing device. [Figure 11] FIG. 11 is a diagram showing an example of a separate sheet according to the first modification. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. In each drawing, components having substantially the same functions are denoted by the same reference numerals, and duplicated explanations will be omitted.

[0011] [Summary of the embodiment] The information processing device of this embodiment is equipped with a processor which recognizes characters on a first image of the reading object having one or more first columns into which characters are entered and a second column into which a signature or seal is placed, and which obtains a recognition result in which characters are recognized on the first image of the reading object in which the first column and the second column are entered or stamped, respectively, and, if there is an error in any of the first columns, forms a second image in which the defective first column and second column are left blank, and, if there is an error in the second column, forms a second image in which the second column is left blank, and outputs the formed second image.

[0012] "Read object" refers to an object from which characters are read, and refers to paper documents or electronic documents that contain handwritten characters. Examples of read objects include documents such as application forms, invoices, and delivery notes, as well as contracts and specifications. When the read object is a paper document, the "first image of the read object" refers to the image obtained by reading the paper document, and when the read object is an electronic document, the first image refers to the electronic document itself.

[0013] An "irregularity" refers to an error in filling in or stamping something that should have been done. There are formal irregularities and substantive irregularities. For example, formal irregularities include cases where an area that should have been filled in is left blank (for example, an account number of five digits or less is filled in where a six-digit account number should have been filled in, or an optional symbol (circle, check, etc.) is omitted, or there is no seal impression, or the seal impression extends significantly beyond the seal area, etc. Substantial irregularities include cases where there is an error in the contents of the address, etc., or where the recognition rate is low (for example, characters are faint, distorted, or some characters extend beyond the frame, resulting in a low recognition rate (for example, below 90%), or the seal impression is so faint that it cannot be detected, etc. It is not necessary to strictly distinguish between formal irregularities and substantive irregularities.

[0014] Character "recognition" refers to converting handwritten or typed character patterns contained in an image to be read into character codes such as JIS code. For example, the recognition method may convert the character pattern to be recognized into a vector, convert a standard pattern corresponding to the character code into a vector, and determine the recognition result as an index represented by the distance (e.g., Euclidean distance) or similarity (e.g., cosine similarity) between the two vectors that is below a threshold. Character recognition may also use a learning model trained by machine learning such as deep learning.

[0015] [First embodiment] FIG. 1 is a block diagram showing an example of a schematic configuration of an information processing system according to a first embodiment of the present invention.

[0016] This information processing system 1 comprises an image forming device 2 that reads an image from a form (hereinafter referred to as a "form image"), and an information processing device 3 that performs character recognition processing on the form image read by the image forming device 2. Note that, although one image forming device 2 and one information processing device 3 are shown in the figure, there may be multiple of either one or both in consideration of throughput. A form is an example of an object to be read.

[0017] The image forming apparatus 2 and the information processing apparatus 3 are connected via a network 4. The network 4 is, for example, a local area network (LAN), a wide area network (WAN), an intranet, the Internet, etc., and may be wired or wireless.

[0018] The image forming device 2 and the information processing device 3 are installed, for example, at the counter or reception desk of a bank, ward office, insurance company, etc. used by users, and are operated by a person who performs counter work (hereinafter referred to as an "operator"). Note that the installation locations of the image forming device 2 and the information processing device 3 are not limited to the above locations, and may be other locations such as a factory, office, or business premises. Furthermore, the image forming device 2 and the information processing device 3 may be installed in locations separate from each other. The following description will be given taking as an example a case where the image forming device 2 and the information processing device 3 are installed at a bank counter.

[0019] (Configuration of Image Forming Apparatus) The image forming device 2 is, for example, a multifunction device having a scan function, a print function, a copy function, an e-mail function, a facsimile function, etc. Note that the image forming device 2 may have both a scan function and a print function.

[0020] The image forming apparatus 2 includes a control unit 20, a storage unit 21, an operation display unit 22, an image reading unit 23, an image forming unit 24, and a communication unit 25.

[0021] The control unit 20 is composed of a processor such as a CPU (Central Processing Unit), an interface, etc. The control unit 20 executes a program stored in the storage unit 21 to control the execution of each function.

[0022] The storage unit 21 is composed of a ROM (Read Only Memory), a RAM (Random Access Memory), a hard disk, etc., and stores information such as programs and form images.

[0023] The operation display unit 22 is used for inputting and displaying information. The operation display unit 22 is, for example, a touch panel display, and has a configuration in which a touch panel is superimposed on a display such as a liquid crystal display.

[0024] The image reading unit 23 includes an automatic document feeder provided on the document table, and a scanner that optically reads an original image from an original placed on the document table or an original sent by the automatic document feeder.

[0025] The image forming unit 24 creates a print by forming an image on a sheet of paper fed from a paper feed cassette using, for example, an electrophotographic method or an inkjet method.

[0026] The communication unit 25 communicates with the information processing device 3 via the network 4 .

[0027] (Configuration of information processing device) The information processing device 3 has a control unit 30 that controls each part of the information processing device 3, and this control unit 30 is connected to a memory unit 31, an input unit 32 realized by a keyboard, a mouse, etc., a display unit 33 realized by an LCD display, etc., and a communication unit 34 that communicates with external devices such as an image forming device 2 via a network 4.

[0028] The control unit 30 is composed of a processor such as a CPU (Central Processing Unit), an interface, etc. The control unit 30 executes a program 310 stored in the storage unit 31 to function as a character recognition unit 300, a seal impression detection unit 301, a defect determination unit 302, a resubmission form creation unit 303, etc. Each unit 300 to 303 will be described later.

[0029] The memory unit 31 is composed of a ROM (Read Only Memory), a RAM (Random Access Memory), a hard disk, etc., and stores various information such as a program 310, a form item information table 311 (see FIG. 3), an address database 312, a bank database 313, a recognition dictionary 314, a form image 10b (see FIG. 4), and resubmission form images 10c and 10d (see FIG. 6). The form image 10b is an example of a first image. The resubmission form image 10c is an example of a second image. The resubmission form image 10d, which is filled in and stamped on the resubmission form image 10c, is an example of a third image.

[0030] Japanese addresses are registered in the address database 312. The imperfection determination unit 302 determines that the address has been correctly written even when the street name, block code, and house number of the address indication are abbreviated. For example, if the address indication is "XX 2-chome 11-ban 6-go", the imperfection determination unit 302 determines that the address has been correctly written even when the address indication is abbreviated to "XX 2-11-6".

[0031] The bank database 313 stores the names of banks and their branches in Japan.

[0032] The recognition dictionary 314 stores standard patterns for each character code, such as the JIS code.

[0033] Fig. 2 is a diagram showing an example of a form. The form 10a shown in the figure is printed on paper and has an address column 11a, a bank name column 11b, a branch name column 11c, an account number column 11d, and an account holder column 11e (hereinafter also referred to as "first column 11") to be filled in by the user, and a signature column 12a and a seal column 12b (hereinafter also referred to as "second column 12") to be signed and sealed by the user. The dashed lines in the figure indicate a rectangular reading area 13 that is not actually recorded on the form 10a but is set in advance. The reading area refers to an area in which a character pattern filled in the reading area 13 is converted into a character code.

[0034] 3 is a diagram showing an example of a form item information table 311. The form item information table 311 is assigned a management number (A001 in this example) for each user and is stored in the storage unit 31. The form item information table 311 has a number of items such as "read item," "item type," "recognition result," and "read coordinate information." Of the form item information consisting of these items, the read item, item type, and read coordinate information are set in advance according to the type of form.

[0035] The "read items" record the item names of the first column 11 and the second column 12. The read items of address, name, seal, bank name, branch name, account number, and account holder correspond to the address column 11a, signature column 12a, seal column 12b, bank name column 11b, branch name column 11c, account number column 11d, and account holder column 11e, respectively.

[0036] "Item type" records one of the following types: entry, signature, or seal impression. Entry is the item type for the address field 11a, bank name field 11b, branch name field 11c, account number field 11d, and account holder field 11e, where anything other than the signature is entered. Signature is the item type for the signature field 12a. Seal impression is the item type for the seal field 12b.

[0037] The "recognition result" field records the results of character recognition and the detection of a seal impression. That is, if the item type is "entry", a character string is recorded as the recognition result, and if the item type is "seal impression", a seal impression is recorded as the recognition result.

[0038] The "read coordinate information" records the coordinate information (upper left coordinate, lower right coordinate) of the rectangular read area set for each read item. In the figure, a1 and b1 indicate the coordinates (x, y) of the upper left corner of the rectangle, and c1 and d1 indicate the coordinates (x, y) of the lower right corner of the rectangle.

[0039] Next, each of the components 300 to 303 of the control unit 30 will be described.

[0040] The character recognition unit 300 extracts the reading area 13 from the form image 10b and the resubmitted form image 10d by referring to the reading coordinate information in the form item information table 311, performs recognition processing on the characters entered in the reading area 13, and records the recognition result in the "recognition result" item of the form item information table 311. The recognition processing, for example, converts the entered character pattern into a vector, converts a standard pattern corresponding to a character code registered in the recognition dictionary 314 into a vector, and determines a character code whose evaluation value expressed as the distance or similarity between the two vectors is equal to or less than a threshold value as the recognition result.

[0041] The seal impression detection unit 301 extracts the red parts from the form image 10b and the resubmitted form image 10c by referring to the reading coordinate information in the form item information table 311, detects the seal impression, and records it in the ``recognition result'' item of the form item information table 311.

[0042] The defect determination unit 302 compares the recognition result of the characters entered in the address field 11a with the address database 312, and if the recognition result is not registered in the address database 312, determines that the address field 11a is defective. Furthermore, the defect determination unit 302 compares the recognition result of the characters entered in the bank name field 11b and the branch name field 11c with the bank database 313, and if the recognition result is not registered in the bank database 313, determines that the bank name field 11b or the branch name field 11c is defective. Furthermore, the defect determination unit 302 may use a personal name dictionary or the like for the name in the signature field 12a. For the account number field 11d and the account holder field 11e, the corresponding databases may be used.

[0043] If any of the columns 11a to 11e of the first column 11 is defective, the resubmission form creation unit 303 creates a resubmission form image 10c in which the defective first column 11 and the second column 12 are left blank, and if the second column 12 is defective, forms a resubmission form image 10c in which the second column 12 is left blank, and transmits the formed form image 10c to the image forming device 2 to print it on paper to create a resubmission form. The resubmission form image 10d obtained by reading the filled-in and stamped form for resubmission is the target for reading.

[0044] When creating the form image 10c for resubmission, the first column 11 without defects may remain handwritten, or the form image 10c for resubmission may be created by reflecting the recognition result. By reflecting the type of the recognition result, it is possible to obtain a high recognition rate when recognizing the form image 10d for resubmission in which blank spaces are filled in.

[0045] When leaving the defective first column 11 and second column 12 blank, the characters may be erased by turning the reading area 13 white, or the characters may be erased by filling the reading area 13 with the background color that is the base color of the document 10a. By filling the reading area 13 with the background color, it is possible to eliminate documents with a different background color from the original.

[0046] (Operation of information processing system) Next, an example of the operation of the information processing system 1 will be described with reference to Fig. 4 to Fig. 7. Fig. 7 is a flowchart showing an example of the operation of the information processing device 3.

[0047] The operator receives the filled-in and stamped form 10a from the user, places it on the platen of the image reading unit 23 of the image forming device 2, and causes the form image 10b to be read from the form 10a. The image reading unit 23 reads the form image 10b from the form 10a using a scanner in color mode. The control unit 20 transmits the read form image 10b to the information processing device 3 via the communication unit 25 and the network 4. Note that if there are multiple forms 10a, an automatic paper feeder may be used.

[0048] 4 is a diagram showing an example of a form image 10b. In the form image 10b, characters are handwritten in the address field 11a, the bank name field 11b, the branch name field 11c, the account number field 11d, the account holder field 11e, and the signature field 12a, and a red seal impression is formed by stamping in the seal field 12b.

[0049] The control unit 30 of the information processing device 3 receives the form image 10b transmitted from the image forming device 2 via the communication unit 34, and stores it in the storage unit 31 (S1).

[0050] The control unit 30 recognizes the written characters from the form image 10b and detects the seal impression (S2).

[0051] Specifically, the character recognition unit 300 extracts the reading area 13 from the form image 10b by referring to the reading coordinate information in the form item information table 311, performs recognition processing on the characters written in the reading area 13, and records the recognition result in the form item information table 311 as shown in FIG. 5.

[0052] The seal impression detection unit 301 extracts the red part from the form image 10b by referring to the reading coordinate information in the form item information table 311, detects the seal impression, and records it in the form item information table 311 as shown in Fig. 5. Note that the name recognition process may detect the seal impression first, and then perform character recognition process using the area to the left of the detected seal impression as the reading area. This eliminates the need to set the reading area 13 in the seal column 12b.

[0053] Next, the defect determination unit 302 determines whether there is a defect (S3). For example, for characters entered in the address field 11a, the recognition result is compared with the address database 312, and if the recognition result is not registered in the address database 312, the address field 11a is determined to be a defect. Also, for characters entered in the bank name field 11b and the branch name field 11c, the recognition result is compared with the bank database 313, and if the recognition result is not registered in the bank database 313, the bank name field 11b or the branch name field 11c is determined to be a defect.

[0054] When it is determined that there is no defect (S3: No), the process ends. When it is determined that there is no defect and the process ends, the control unit 30 may erase the form image 10b from the storage unit 31 because the form image 10b is the original but the corresponding data is recorded in the form item information table 311.

[0055] If it is determined that there is an incomplete portion (S3: Yes), the resubmission form creation unit 303 refers to the form item information table 311 and determines whether the item type of the incomplete portion is filled in or not (S4).

[0056] If it is determined that the text has been written (S4: Yes), the resubmission form creation unit 303 fills in the reading area 13 of the defective portion with the background color (S5). That is, the characters written in the reading area 13 of the form image 10b are erased by filling in the reading area 13 with the background color, which is the base color of the form 10a.

[0057] Next, the resubmission form creation unit 303 erases the seal imprint (S6), that is, erases the red seal imprint from the form image 10b.

[0058] Next, the resubmission form creation unit 303 fills in the reading area 13 of the signature field 12a with the background color (S7). That is, the characters written in the reading area 13 of the signature field 12a in the form image 10b are filled in with the background color, which is the background color of the form 10a, to erase the signature.

[0059] Next, the resubmission form creation unit 303 replaces parts of the form image 10b that are free of defects with the type of the recognition result recorded in the form item information table 311, and creates the form image 10b as a form image 10c for resubmission (S8).

[0060] The resubmission form creation unit 303 transmits the resubmission form image 10c to the image forming apparatus 2 and instructs it to print (S9).

[0061] The image forming unit 24 of the image forming device 2 prints and outputs the resubmission form image 10c on a form sheet.

[0062] Fig. 6 is a diagram showing an example of a form image 10c for resubmission. The form image 10c for refilling shown in the figure shows a case where there is an error in the address field 11a. In the form image 10c for resubmission, the address field 11a is filled in with the background color and left blank, and the signature field 12a is also filled in with the background color and left blank. In addition, the seal field 12b has had the seal impression erased.

[0063] The operator hands the resubmission form on which the resubmission form image 10c is printed to the user. The user receives the resubmission form, writes their address in the blank address field 11a, writes their name in the blank signature field 12a, and affixes a seal in the seal field 12b from which the seal impression has been erased, and hands it over to the operator.

[0064] The operator places the filled-in and stamped resubmission form given by the user on the platen of the image reading unit 23 of the image forming device 2, and causes the image reading unit 23 to read the resubmission form image 10d from the resubmission form. The image reading unit 23 reads the resubmission form image 10d from the resubmission form using a scanner in color mode. The control unit 20 transmits the read resubmission form image 10d to the information processing device 3.

[0065] The control unit 30 of the information processing device 3 receives the form image 10d transmitted from the image forming device 2 via the communication unit 34, and stores it in the storage unit 31 (S1).

[0066] The control unit 30 extracts the reading area 13 from the resubmitted form image 10d, as with the initial form 10a, performs recognition processing on the characters written in the reading area 13, records the recognition results in the form item information table 311, and detects the seal impression (S2).

[0067] Since the non-defective parts have the recognized characters written in them, they are recognized with a high recognition rate, so it is determined that there are almost no defects (S3: No), and the process ends.

[0068] When the control unit 30 determines that there are no defects and ends the process, the form image 10d for resubmission becomes the original, but since the corresponding data is recorded in the form item information table 311, the form images 10c and 10d for resubmission may be deleted from the storage unit 31. For parts without defects, the previous recognition result may be used to recognize only the characters entered this time.

[0069] If there is an incomplete portion (S3: Yes), the processes of steps S4 to S9 are carried out as described above.

[0070] [Second embodiment] 8 is a block diagram showing an example of a schematic configuration of an information processing system according to a second embodiment of the present invention. In the first embodiment, the defect determination unit 302 determines whether or not there is a defect, but in this embodiment, the defect is detected by the marker detection unit 304 without using the defect determination unit 302. The following mainly describes the points that are different from the first embodiment.

[0071] The information processing device 3 includes a control unit 30, a storage unit 31, an input unit 32, a display unit 33, and a communication unit , similarly to the first embodiment.

[0072] The control unit 30 is composed of a processor such as a CPU (Central Processing Unit), an interface, etc. By executing a program 310 stored in the storage unit 31, the control unit 30 functions as a character recognition unit 300, a seal impression detection unit 301, a resubmission form creation unit 303, a marker detection unit 304, etc., but does not function as a defect determination unit 302.

[0073] As in the first embodiment, the memory unit 31 stores various types of information such as a program 310, a form item information table 311 (see Figure 3), an address database 312, a bank database 313, a recognition dictionary 314, a form image 10b (see Figure 4), and form images 10c and 10d for resubmission (see Figure 6).

[0074] The marker detection unit 304 detects the marker 14 by extracting a portion of a specific color from the form image 10b. The color of the marker 14 can be set by operating the input unit 32. The color of the marker 14 is preferably a specific color (e.g., green or blue) other than the color of the writing (e.g., black) or the color of the seal impression (e.g., red). Using a specific color as the color of the marker 14 makes it easier to extract only the marker 14 from the form image. In this embodiment, the marker 14 is linear, but it may be a closed shape such as a circle or a rectangle, or other shape.

[0075] The resubmission form creation unit 303 sets the rectangular area circumscribing the marker 14 as the reading area 13, and fills the reading area 13 with the background color to leave it blank. That is, for the portion where the marker 14 has been added, the rectangular area circumscribing the marker 14 is set as the reading area 13 without using the reading area information in the form item information table 311. In this case, the operator can specify the defective portion at his / her discretion. Even if the marker 14 is not circumscribing, a range wider than the marker 14 may be set as the reading area 13 by leaving some margin. This makes it possible to erase characters even if the marker 14 cannot be added accurately.

[0076] (Operation of information processing system) Next, an example of the operation of the information processing system 1 will be described with reference to Fig. 9 and Fig. 10. Fig. 10 is a flowchart showing an example of the operation of the information processing device 3.

[0077] The operator receives the filled-in and stamped form 10a from the user and determines whether there are any defects. If an defect is found, the operator adds a marker 14 to the defective portion and places the form 10a on the platen of the image reading unit 23 of the image forming device 2 to read a form image 10b from the form 10a. The image reading unit 23 reads the form image 10b from the form 10a using a scanner in color mode. The control unit 20 transmits the read form image 10b to the information processing device 3 via the network 4 through the communication unit 25. Note that if there are multiple forms 10a, an automatic paper feeder may be used.

[0078] 9 is a diagram showing an example of a form image 10b. In the form image 10b, characters are handwritten in the address field 11a, the bank name field 11b, the branch name field 11c, the account number field 11d, the account holder field 11e, and the signature field 12a. A red seal impression is formed by stamping in the seal field 12b. A marker 14 is added to the address field 11a because the address was entered incorrectly. If the operator is suspicious of the entry of the address, bank name, or branch name, for example, the operator may input the characters entered on the form into the input unit 32 and search the address database 312 and the bank database 313 to determine whether a corresponding entry exists.

[0079] The control unit 30 of the information processing device 3 receives the form image 10b transmitted from the image forming device 2 via the communication unit 34, and stores it in the storage unit 31 (S11).

[0080] The marker detection unit 304 judges whether or not there is a marker 14 of a specific color (S12). That is, if a portion of a specific color can be extracted from the form image 10b, the marker 14 is detected.

[0081] If the marker 14 cannot be detected (S12: No), the control unit 30 recognizes the written characters from the form image 10b, detects the seal impression, records the recognition result and the detection result in the form item information table 311 (S13), and ends the process, as in the first embodiment. If the control unit 30 determines that there is no marker 14 and ends the process, the form image 10b may be erased from the storage unit 31 because the corresponding data is recorded in the form item information table 311, although the form image 10b is the original.

[0082] If the marker 14 is detected (S12: Yes), the form item information table 311 is referenced to determine whether the item type at the location of the marker 14 is "filled in" (S14).

[0083] If it is determined that writing has been done (S14: Yes), the resubmission form creation unit 303 sets the area circumscribing the marker 14 as the reading area 13, and fills the reading area 13 with the background color (S15). That is, the characters and the marker 14 written in the reading area 13 in the form image 10b are filled with the background color, which is the base color of the form 10a, to erase the characters and the marker 14.

[0084] Next, the resubmission form creation unit 303 erases the seal imprint (S16), that is, erases the red seal imprint from the form image 10b.

[0085] Next, the resubmission form creation unit 303 fills in the reading area 13 of the signature section 12a with the background color (S17). That is, the characters written in the reading area 13 of the signature section 12a in the form image 10b are filled in with the background color, which is the background color of the form 10a, to erase the signature.

[0086] Next, the resubmission form creation unit 303 replaces the parts that are free of defects with the characters of the recognition result recorded in the form item information table 311, and creates the form image 10b as the form image 10c to be submitted (S18).

[0087] The control unit 30 transmits the form image 10c for resubmission to the image forming apparatus 2 and instructs it to print (S19).

[0088] The image forming unit 24 of the image forming apparatus 2 prints and outputs the resubmission form image 10c shown in FIG. 6 on a form sheet.

[0089] The operator hands the resubmission form on which the resubmission form image 10c is printed to the user. The user receives the resubmission form, writes their address in the blank address field 11a, writes their name in the blank signature field 12a, and affixes a seal in the seal field 12b from which the seal impression has been erased, and hands it over to the operator.

[0090] The operator places the filled-in and stamped resubmission form given by the user on the platen of the image reading unit 23 of the image forming device 2, and causes the image reading unit 23 to read the resubmission form image 10d from the resubmission form. The image reading unit 23 reads the resubmission form image 10d from the resubmission form using a scanner in color mode. The control unit 20 transmits the read resubmission form image 10d to the information processing device 3.

[0091] The control unit 30 of the information processing device 3 receives the form image 10d transmitted from the image forming device 2 via the communication unit 34, and stores it in the storage unit 31 (S11).

[0092] The control unit 30 determines whether or not there is a marker (S12), and if there is no marker 14 (S12: No), extracts the reading area 13 from the resubmitted form image 10d, as with the initial form 10a, performs recognition processing on the characters written in the reading area 13, records the recognition result in the form item information table 311, and detects the seal impression (S13). Since the parts without the marker 14 are written with type characters of the recognition result, they are recognized with a high recognition rate, and it is determined that there are almost no defects, that is, there is no marker 14 (S12: No).

[0093] When the process is completed with the marker 14 not being present, the control unit 30 may erase the resubmitted form images 10c and 10d from the storage unit 31 in the same manner as in the first embodiment.

[0094] If the marker 14 is present (S12: Yes), the processes of steps S14 to S19 are carried out as described above.

[0095] (Variation 1) When creating the form image 10c for resubmission, the resubmission form creation unit 303 also creates a separate sheet showing the defective parts and outputs it from the image forming device 2. The user can fill in and affix a seal for resubmission while looking at the separate sheet.

[0096] FIG. 11 is a diagram showing an example of an attachment. Attachment 10e has a message 15 and a form image 10c for resubmission. The form image 10c for resubmission uses a red highlighted line 16 as a frame to indicate a field with an error (address field 11a in FIG. 11). The highlighted line 16 may be in a different form from fields that did not have errors, such as a line that is thicker than the other frames or a double line. The highlighted line 16 is an example of a form that allows a field with an error to be distinguished from fields that did not have errors. Also, the location of the error may be indicated by adding a marker such as an arrow without highlighting the frame. Attachment 10e is an example of another image.

[0097] (Variation 2) The control unit 30 may transmit and receive the form images 10b to 10d online between the user terminal and the information processing device 3. In this case, the control unit 30 may require a document for personal authentication. The control unit 30 receives the form image 10b and the form image 10d for resubmission transmitted from the user terminal via the network 4, and stores them in the storage unit 31.

[0098] Documents for identity verification include, for example, a driver's license, insurance card, and My Number card. These documents are also received online. Submitting a form online makes it more difficult to determine whether the person submitted it, compared to a direct interview, but documents for identity verification make identity verification easier than when these documents are not present. Attachment 10e of Modification 1 may also be sent online.

[0099] (Variation 3) The control unit 30 may display the form image 10b including the defective portion on the display unit 33, and create a form for resubmission if the operator gives permission. The defect determination unit 302 may make an erroneous determination, and such an erroneous determination can be suppressed by having a human being make the determination.

[0100] (Variation 4) In the above embodiments, the form has a seal column, but it may have no seal column. In this case, if there is an error in the first column 11, the defective first column 11 and the signature column 12a are left blank to create a form for resubmission.

[0101] Although the embodiment of the present invention has been described above, the embodiment of the present invention is not limited to the above embodiment, and various modifications and implementations are possible.

[0102] Each means of the processor may be configured in part or in whole by a hardware circuit such as a field programmable gate array (FPGA) or an application specific integrated circuit (ASIC).

[0103] In the above embodiments, the processor refers to a processor in a broad sense, and includes general-purpose processors (e.g., CPU: Central Processing Unit, etc.) and dedicated processors (e.g., GPU: Graphics Processing Unit, ASIC, FPGA, programmable logic device, etc.).

[0104] In addition, the operations of the processor in the above embodiment may be performed not only by one processor but also by multiple processors located at physically separate locations working together. The order of the operations of the processor is not limited to the order described in the above embodiment, and may be changed as appropriate.

[0105] In addition, some of the components of the above-described embodiments may be omitted or modified. In addition, in the flow of the above-described embodiments, steps may be added, deleted, modified, or replaced. In addition, the programs used in the above-described embodiments may be provided by recording them on a computer-readable recording medium such as a CD-ROM, or may be stored in an external server such as a cloud server and used via a network. [Explanation of symbols]

[0106] 1...information processing system, 2...image forming apparatus, 3...information processing apparatus, 4...network, 10a...document, 10b...document image, 10c, 10d...document image for resubmission, 10e...Attachment, 11...First column, 11a...Address column, 11b...Bank name column, 11c...Branch name column, 11d...Account number column, 11e...Account name column, 12...Second column, 12a: signature area; 12b: seal area; 13: reading area; 14: marker; 15: message; 16: highlight line; 20: control unit; 21: memory unit; 22: operation display unit, 23: image reading unit, 24: image forming unit, 25: communication unit, 30: control unit, 31: memory unit, 32: input unit, 33: display unit, 34: communication unit, 300: character recognition unit; 301: seal impression detection unit; 302: defect determination unit; 303: a submission form creation unit; 304: a marker detection unit; 310: a program; 311: form item information table; 312: address database; 313...bank database, 314...recognition dictionary

Claims

1. An information processing device comprising: a processor for obtaining a recognition result in which characters are recognized from a first image of the reading object having one or more first columns into which characters are written and a second column into which a signature or seal is placed, and, if there is an error in any of the first columns, forming a second image in which the first column and the second column having an error are left blank, and, if there is an error in the second column, forming a second image in which the second column is left blank, and outputting the formed second image.

2. On the computer, A reading target has one or more first fields into which characters are written and a second field into which a signature or a seal is affixed, and a recognition result is obtained in which characters are recognized from a first image of the reading target in which the first fields and the second fields are respectively written or affixed; If there is a defect in any of the first fields, a second image is formed in which the defective first field and the defective second field are left blank, and if there is a defect in the second field, a second image is formed in which the second field is left blank; A program for outputting the formed second image.

Citation Information

Patent Citations

  • Business form processing device, business form processing system, and program

    JP2016053876A

  • Document processing device and program

    JP2018032231A

  • Application processing apparatus and program

    JP2020024727A

  • Information processing apparatus and program

    JP2020052480A

  • Method and apparatus for enhanced document capture

    US20130148914A1