Information processing device, information processing system, and program

Abstract

To provide an information processing device capable of more efficiently supporting finding forgery of a signature on a document such as documentary evidence.SOLUTION: An information processing device for processing document data includes: an extraction part for extracting an image of a prescribed area from the data; a determination part for determining whether a handwritten signature is included in the image extracted by the extraction part; a first specification part for specifying a person in charge associated with identification information for identifying a document related to data of an extraction source of the image of the prescribed area by using first information stored with the identification information for identifying the document associated with the person in charge taking charge of the document when the determination part determines that the handwritten signature is included; and a storage part for storing the image data of an extracted signature column in a storage position associated with the specified person in charge.SELECTED DRAWING: Figure 5

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, an information processing system, and a program.

Background Art

[0002] In business transactions between companies, authenticating documents such as an order form or an inspection certificate including a signature column (an example of a document including a signature column) are used. For example, in the signature column, the signer signs by handwriting or stamping. Verification of the authenticity of the signature made in the signature column is performed by manual processing such as visual inspection by the user.

[0003] For example, Patent Document 1 describes a technique in which an operator authenticates a signature by collating and displaying the signature of the card user entered when using the card and the signature of the card owner previously stored at the time of card registration or the like (see, for example, Patent Document 1).

Summary of the Invention

Problems to be Solved by the Invention

[0004] In business transactions between companies, for example, the above-described authenticating documents are received from many trading partners such as customers and suppliers. Therefore, it is required to efficiently verify the authenticity of the signature made in the signature column of the authenticating document and efficiently detect forgery of the signature. Note that the technique of Patent Document 1 is for the purpose of authenticating the signature of the card user and the card owner, and thus it takes time to obtain the signature of the card owner for authentication in advance.

[0005] An object of the present disclosure is to provide an information processing apparatus that can more efficiently support detection of forgery of a signature made on a document such as an authenticating document.

Means for Solving the Problems

[0006] One embodiment of the present invention is an information processing apparatus that processes document data, comprising: an extraction unit that extracts an image of a predetermined area from the data; a determination unit that determines whether a handwritten signature is included in the image extracted by the extraction unit; and when it is determined by the determination unit that a handwritten signature is included, a first specifying unit that specifies a destination associated with identification information for identifying the document related to the data from which the image of the predetermined area was extracted, using first information in which the identification information for identifying the document and the destination in charge of the document are stored in association with each other, and a storage unit that stores the extracted image in a storage location associated with the specified destination.

Advantages of the Invention

[0007] According to the present disclosure, it is possible to more efficiently support the discovery of forgery of signatures made on documents such as certificates.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10A

Figure 10B

Figure 10C

Figure 11

Figure 12

Figure 13A

Figure 13B

Figure 14

Figure 15

MODE FOR CARRYING OUT THE INVENTION

[0009] Hereinafter, each embodiment of the present invention will be described with reference to the accompanying drawings. In this embodiment, as an example, a document including a signature column will be described as an example of a credential document. A credential document is a document issued in, for example, order receipt and issue between companies, such as an order form or an inspection certificate. Note that the companies in this embodiment include stock companies, limited companies, various organizations, or individual business owners, etc.

[0010] [First Embodiment] [System Configuration] FIG. 1 is a configuration diagram of an example of an information processing system 1 according to the first embodiment. The information processing system 1 shown in FIG. 1 includes an information processing apparatus 10 and one or more user terminals 12. The information processing apparatus 10 and the user terminals 12 communicate with each other via a network 18. The network 18 is, for example, the Internet or a LAN (Local Area Network).

[0011] The information processing apparatus 10 processes, for example, data of credentials. The credentials processed by the information processing apparatus 10 are digitized as document data including image data, and are stored in the information processing apparatus 10 or an information processing apparatus other than the information processing apparatus 10. The document data including image data is, for example, data stored in the PDF (Portable Document Format) format or the Word format (hereinafter referred to as PDF data). The file name of the PDF data of the credentials stored in the information processing apparatus 10 or an information processing apparatus other than the information processing apparatus 10 includes, for example, a case number.

[0012] The case number is, for example, an example of identification information for identifying a case such as a transaction between companies. The case number is associated with the PDF data of the credentials, and is described, for example, in the file name of the credentials or the PATH information described later. Further, the case number is associated with the person in charge of the credentials as described later. The person in charge is a person in charge of handling the credentials or the place where the person in charge belongs (for example, the department or organization to which the person belongs). The person in charge is, for example, a salesperson who communicates with a business partner using the credentials or a manager who manages the credentials. Further, the person in charge may be the signatory of the credentials or the place where the signatory belongs (for example, the company, department, organization, etc. to which the signatory belongs). In the following, the person in charge is described as a representative example.

[0013] The information processing apparatus 10 converts the PDF data of the certificate to be processed into image data. The image data is data stored in, for example, the JPEG format (JPEG data) or the PNG format (PNG data). JPEG data is an example of image data that is easy to perform image processing for cutting out (extracting) a part from an image. The information processing apparatus 10 extracts the image data of the signature field from the image data of the certificate to be processed based on the position information specifying the range of the signature field of the certificate.

[0014] The information processing apparatus 10 identifies the type of signature entered in the signature field extracted as image data as described below. For example, the information processing apparatus 10 identifies the image of the handwritten signature field from the extracted image of the signature field. Note that the image data of the handwritten signature field includes, in addition to the image data obtained by scanning the signature entered in the paper signature field, the image data directly input to a tablet terminal or the like using a handwriting recognition function. Further, the information processing apparatus 10 may identify an image of a handwritten signature field, a stamped signature field, a signature field electronically input by a PC (Personal Computer) or the like, or a blank signature field with no input from the extracted image of the signature field. A stamp refers to a state in which a seal is pressed and the impression is reflected in the signature field, and the seal includes a corporate seal, an impressed seal, an actual seal, and the like.

[0015] The information processing apparatus 10 determines whether the signature made in the signature field is a handwritten signature based on the identified result. The information processing apparatus 10 can classify the extracted image data of the signature field based on a specific result. The information processing apparatus 10 may also determine that it is a handwritten signature even if a part of the signature made in the signature field is handwritten. For example, even if the signature of the company name made in the signature field is described other than by handwriting such as stamping or electronic input, if the signature of the name is a handwritten signature, the information processing apparatus 10 may determine that it is a handwritten signature. Although an example in which there are description fields for the company name and name items in the signature field has been described, the signature field may include description fields for other items such as address and position. Also in this case, if the signature of the name is handwritten, even if the other items are not handwritten, it may be determined that it is a handwritten signature.

[0016] The information processing apparatus 10 identifies the person in charge of the certificate corresponding to the certificate to be processed and the case number, and distributes and stores the image data of the handwritten signature column in the storage location associated with the person in charge (for example, a folder that is a file storage location including the identification information of the person in charge as the name). When the storage location associated with the person in charge has not been created, the information processing apparatus 10 may create and store the storage location associated with the person in charge.

[0017] The information processing apparatus 10 may also distribute and store the image data of the handwritten signature column in the storage location associated with the identified person in charge and signature type (for example, a folder including the identification information of the person in charge and the signature type as the name). The signature type indicates the type of signature entered in the signature column such as a handwritten signature. Note that there may be a storage location associated with the signature type (for example, a folder including the signature type as the name) in the storage location associated with the identified person in charge (for example, a folder including the identification information of the person in charge as the name). When the storage location associated with the person in charge and signature type has not been created, the information processing apparatus 10 may create and store the storage location associated with the person in charge and signature type.

[0018] The information processing apparatus 10 is realized by executing a program on, for example, a PC (Personal Computer) or a workstation. The information processing apparatus 10 may also be realized by using an ASP (Application Service Provider) or cloud computing.

[0019] The user terminal 12 is an information processing terminal operated by a user. The user terminal 12 is operated by a user who visually checks the authenticity of the signature made on the certificate and determines whether there is forgery of the signature.

[0020] The user operates the user terminal 12, opens the folder associated with the person in charge, and displays in a thumbnail format (reduced format), for example, by icon display, the image data of the signature field written by hand in a list (hereinafter referred to as reduced (thumbnail) display), making it easy to compare the images of the signature fields of the documents of the cases handled by the same person in charge. The operation of opening the folder may be an operation of opening a folder performed on the file system.

[0021] The user terminal 12 is realized by executing a program on, for example, a PC, a mobile phone, a smartphone, a tablet terminal, a game machine, or a PDA (Personal Digital Assistant), etc. The user terminal 12 may display a UI such as a Web user interface (UI) provided by the information processing apparatus 10.

[0022] Note that the configuration of the information processing system 1 shown in FIG. 1 is an example. For example, at least a part of the functions of the information processing apparatus 10 may be provided outside the information processing apparatus 10, or may be provided in the user terminal 12. Further, the information processing apparatus 10 may be provided as a cloud service. Furthermore, the information processing apparatus 10 may be realized by being distributed among a plurality of computers.

[0023] The information processing apparatus 10 may be, for example, an MFP (Multifunction Peripheral) which is an example of an image forming apparatus. The information processing apparatus 10 may be a PJ (Projector), an IWB (Interactive White Board: a white board having an electronic blackboard function capable of mutual communication), an output device such as a digital signage, an industrial machine, an imaging device, a sound collecting device, a medical device, a network home appliance, or a connected car, etc. Also, the user terminal 12 may be an HMD (Head Mounted Display) device, or a digital camera, etc.

[0024] <Hardware Configuration> 《Smartphone》 The user terminal 12 is realized by, for example, a smartphone 400 with the hardware configuration shown in FIG. 2. FIG. 2 is a hardware configuration diagram of an example of the smartphone 400.

[0025] The smartphone 400 includes a CPU (Central Processing Unit) 401, a ROM (Read Only Memory) 402, a RAM (Random Access Memory) 403, an EEPROM 404, a CMOS (Complementary Metal Oxide Semiconductor) sensor 405, an imaging device I / F (Interface) 406, an acceleration / azimuth sensor 407, a media I / F 409, and a GPS receiver 411.

[0026] The CPU 401 controls the operation of the entire smartphone 400. The ROM 402 stores programs used for driving the CPU 401 such as the CPU 401 and IPL. The RAM 403 is used as a work area for the CPU 401. The EEPROM 404 reads or writes various data such as smartphone programs according to the control of the CPU 401.

[0027] The CMOS sensor 405 is a type of built-in imaging means that captures a subject (mainly a self-image) according to the control of the CPU 401 to obtain image data. Note that an imaging means such as a CCD (Charge Coupled Device) sensor may be used instead of the CMOS sensor. The imaging device I / F 406 is a circuit that controls the driving of the CMOS sensor 405. The acceleration / azimuth sensor 407 is various sensors such as an electronic magnetic compass that detects geomagnetism, a gyrocompass, and an acceleration sensor. The media I / F 409 controls the reading or writing (storage) of data to / from a recording medium 408 such as a flash memory. The GPS receiver 411 receives GPS signals from GPS satellites.

[0028] In addition, the smartphone 400 includes a long-distance communication circuit 412, a CMOS sensor 413, an imaging device I / F 414, a microphone 415, a speaker 416, an audio input / output I / F 417, a display 418, an external device connection I / F 419, a short-distance communication circuit 420, an antenna 420a for the short-distance communication circuit 420, and a touch panel 421. The long-distance communication circuit 412 is a circuit that communicates with other devices via the network 18. The CMOS sensor 413 is a type of built-in imaging means that captures a subject according to the control of the CPU 401 to obtain image data. The imaging device I / F 414 is a circuit that controls the driving of the CMOS sensor 413. The microphone 415 is a built-in circuit that converts sound into an electrical signal. The speaker 416 is a built-in circuit that converts an electrical signal into physical vibration to generate sounds such as music and voices.

[0029] The audio input / output I / F 417 is a circuit that processes the input / output of audio signals between the microphone 415 and the speaker 416 according to the control of the CPU 401. The display 418 is a type of display means such as a liquid crystal or an organic EL (Electro Luminescence) that displays an image of a subject, various icons, etc. In addition, the external device connection I / F 419 is an interface for connecting various external devices.

[0030] The short-distance communication circuit 420 is a communication circuit such as NFC (Near Field Communication) or Bluetooth (registered trademark). The touch panel 421 is a type of input means for operating the smartphone 400 when the user presses the display 418. In addition, the smartphone 400 includes a bus line 410. The bus line 410 is an address bus, a data bus, etc. for electrically connecting each component such as the CPU 401 shown in FIG. 2.

[0031] 《Computer》 The information processing apparatus 10 is realized by, for example, a computer 500 having the hardware configuration shown in FIG. 3. Also, the user terminal 12 may be realized by a computer 500 having the hardware configuration shown in FIG. 3. FIG. 3 is a hardware configuration diagram of an example of the computer 500 according to the first embodiment.

[0032] The computer 500 includes a CPU 501, a ROM 502, a RAM 503, an HD 504, an HDD (Hard Disk Drive) controller 505, a display 506, an external device connection I / F 508, a network I / F 509, a data bus 510, a keyboard 511, a pointing device 512, a DVD-RW (Digital Versatile Disk Rewritable) drive 514, and a media I / F 516.

[0033] The CPU 501 controls the operation of the entire computer 500 according to a program. The ROM 502 stores programs used for driving the CPU 501 such as the IPL. The RAM 503 is used as a work area for the CPU 501. The HD 504 stores various data such as programs. The HDD controller 505 controls the reading or writing of various data to and from the HD 504 according to the control of the CPU 501.

[0034] The display 506 displays various information such as a cursor, a menu, a window, characters, or an image. The display 506 may be, for example, an HMD or an HUD (Head Up Display) device. The external device connection I / F 508 is an interface for connecting various external devices. The external device in this case is, for example, a USB (Universal Serial Bus) memory or the like.

[0035] The network I / F 509 is an interface for performing data communication using the network 18. The data bus 510 is an address bus, a data bus, etc. for electrically connecting each component such as the CPU 501.

[0036] The keyboard 511 is a type of input means having a plurality of keys for inputting characters, numerical values, various instructions, etc. The pointing device 512 is a type of input means for selecting and executing various instructions, selecting a processing target, moving a cursor, etc. The DVD-RW drive 514 controls reading or writing of various data with respect to the DVD-RW 513 as an example of a removable recording medium. Note that it is not limited to DVD-RW, and it may be DVD-R or the like. The media I / F 516 controls reading or writing (storage) of data with respect to a recording medium 515 such as a flash memory.

[0037] Note that the hardware configuration shown in FIG. 3 is an example, and a configuration may be one without some of the components shown in FIG. 3, or a configuration including components other than those shown in FIG. 3.

[0038] 《Multifunction Device》 The information processing apparatus 10 may be realized by, for example, a multifunction device 900 having the hardware configuration shown in FIG. 4. FIG. 4 is a hardware configuration diagram of an example of the multifunction device 900 according to the first embodiment.

[0039] The multifunction device 900 includes a controller 910, a short-range communication circuit 920, an engine control unit 930, an operation panel 940, and a network I / F 950.

[0040] Among these, the controller 910 has a CPU 901 which is the main part of a computer, a system memory (MEM-P) 902, a north bridge (NB) 903, a south bridge (SB) 904, an ASIC (Application Specific Integrated Circuit) 906, a local memory (MEM-C) 907 which is a storage unit, an HDD controller 908, and an HD 909 which is a storage unit, and is configured to connect between the NB 903 and the ASIC 906 by an AGP (Accelerated Graphics Port) bus 921.

[0041] Among these, the CPU 901 is a control unit that performs overall control of the multifunction device 900. The NB 903 is a bridge for connecting the CPU 901 to the MEM-P 902, SB 904, and the AGP bus 921, and has a memory controller that controls read / write operations on the MEM-P 902, and a PCI (Peripheral Component Interconnect) master and an AGP target.

[0042] The MEM-P 902 consists of a ROM 902a which is a memory for storing programs and data for realizing each function of the controller 910, and a RAM 902b which is used as a memory for program and data expansion, and for drawing during memory printing. Note that the program stored in the RAM 902b may be configured to be recorded on a computer-readable recording medium such as a CD-ROM, CD-R, or DVD in an installable or executable file format and provided.

[0043] The SB 904 is a bridge for connecting the NB 903 to PCI devices and peripheral devices. The ASIC 906 is an IC (Integrated Circuit) for image processing applications that has hardware elements for image processing, and serves as a bridge for connecting the AGP bus 921, PCI bus 922, HDD 908, and MEM-C 907 respectively.

[0044] This ASIC 906 consists of a PCI target and an AGP master, an arbiter (ARB) that forms the core of the ASIC 906, a memory controller that controls the MEM-C 907, a plurality of DMACs (Direct Memory Access Controllers) that perform operations such as rotation of image data by means of hardware logic, etc., and a PCI unit that performs data transfer via the PCI bus 922 between the scanner unit 931 and the printer unit 932. Note that a USB interface or an IEEE1394 (Institute of Electrical and Electronics Engineers 1394) interface may be connected to the ASIC 906.

[0045] MEM-C907 is local memory used as an image buffer for copying and a code buffer. HD909 is storage for accumulating image data, font data used during printing, and forms. HD909 controls the reading or writing of data to HD909 according to the control of CPU901. The AGP bus 921 is a bus interface for a graphics accelerator card proposed to speed up graphic processing. By directly accessing MEM-P902 with high throughput, the graphics accelerator card can be made faster. Also, the short-range communication circuit 920 is equipped with a short-range communication circuit 920a. The short-range communication circuit 920 is a communication circuit such as NFC or Bluetooth.

[0046] Furthermore, the engine control unit 930 is composed of a scanner unit 931 and a printer unit 932. Also, the operation panel 940 includes a panel display unit 940a such as a touch panel that displays a start key or the like for receiving a setting screen, a selection screen, a copy start instruction, etc. and receives input from the operator, and an operation panel 940b composed of numeric keys or the like for receiving setting values of conditions related to image formation such as density setting conditions. The controller 910 controls the entire multifunction device 900, for example, controls drawing, communication, input from the operation panel 940, etc. The scanner unit 931 or the printer unit 932 includes an image processing part such as error diffusion or gamma conversion.

[0047] Note that the multifunction device 900 can sequentially switch and select the document box function, copy function, printer function, and facsimile function by using the application switching key on the operation panel 940. When the document box function is selected, it becomes the document box mode, when the copy function is selected, it becomes the copy mode, when the printer function is selected, it becomes the printer mode, and when the facsimile mode is selected, it becomes the facsimile mode.

[0048] The network I / F 950 is an interface for data communication using the network 18. The short-range communication circuit 920 and the network I / F 950 are electrically connected to the ASIC 906 via the PCI bus 922.

[0049] When the multifunction device 900 uses authentication by an IC card, an IC card reader is built-in or externally attached. The multifunction device 900 wirelessly reads identification information unique to the IC card from an RF tag embedded in the IC card. Note that the IC card may be one built into a smart device such as the smartphone 400. Also, the multifunction device 900 may use other than an IC card reader, and may use a biometric authentication device (fingerprint, palmprint, iris, face, etc.), a barcode reader, or the like.

[0050] <Functional Configuration> The information processing system 1 according to the first embodiment is realized, for example, with the functional configuration shown in FIG. 5. FIG. 5 is a functional configuration diagram of an example of the information processing system 1 according to the first embodiment. Note that the functional configuration diagram shown in FIG. 5 appropriately omits configurations unnecessary for the description of the first embodiment. The information processing apparatus 10 and the user terminal 12 realize the functional configuration shown in FIG. 5 by executing programs such as an OS (Operating System) and an application.

[0051] The information processing apparatus 10 shown in FIG. 5 includes an information acquisition unit 30, a selection unit 32, a conversion unit 34, an extraction unit 36, a determination unit 38, a first specifying unit 40, a second specifying unit 41, a storage unit 42, a display control unit 44, a data storage unit 50, an information storage unit 52, and a distribution result storage unit 54. The user terminal 12 includes an input reception unit 60, a display unit 62, and a communication control unit 64.

[0052] The information acquisition unit 30 acquires the first information and the second information described later. For example, the information acquisition unit 30 acquires the first information and the second information from business support tools that are routinely created in business transactions between companies, folders for storing files, and the like. Note that the business support tools that are routinely created in business transactions between companies and the folders for storing files may be within the information processing apparatus 10 or in another apparatus (server). The information acquisition unit 30 stores the acquired information in the information storage unit 52.

[0053] The selection unit 32 selects the PDF data of the document to be processed. For example, when the PDF data of the document is stored in the data storage unit 50, the selection unit 32 selects the PDF data to be processed from the PDF data of the document stored (stored) in the data storage unit 50. Further, for example, when the PDF data of the document is stored in an information processing apparatus other than the information processing apparatus 10, the selection unit 32 selects the PDF data to be processed from the PDF data of the document stored in the information processing apparatus other than the information processing apparatus 10.

[0054] The conversion unit 34 converts the PDF data of the document to be processed into image data such as JPEG data. Note that the PDF data of the document to be processed may be copied and the copied file may be converted into image data. The extraction unit 36 extracts an image of the signature field from the image data of the document to be processed based on the position information specifying the range of the signature field of the document. The position information specifying the range of the signature field of the document is stored in the information storage unit 52. The position information specifying the range of the signature field of the document may be specified for each document type. Although the method of converting the PDF data to JPEG data by the conversion unit 34 and then extracting the image of the signature field in the JPEG data by the extraction unit 36 has been described, the signature field in the PDF data may be extracted by the extraction unit 36 and then only the image of the extracted signature field may be converted into JPEG data by the conversion unit 34.

[0055] The second specifying unit 41 specifies an image of a signature column that is handwritten from the image of the signature column extracted by the extraction unit 36 by inferring the signature type (for example, a signature by handwriting) of the signature included in the image of the signature column using a learned machine learning model. Note that the second specifying unit 41 may specify not only a handwritten signature column but also a stamped signature column, a signature column signed by a PC, or a blank signature column.

[0056] Machine learning is a technology for enabling a computer to acquire learning capabilities like those of humans. Machine learning refers to a technology in which a computer autonomously generates an algorithm necessary for judgment such as data identification from learning data that has been pre-loaded, and applies this to new data to make a prediction. The learning method for machine learning may be any one of supervised learning, unsupervised learning, semi-supervised learning, reinforcement learning, and deep learning, and furthermore, a learning method combining these learning methods may also be used, and the learning method for machine learning is not limited.

[0057] Based on the result specified by the second specifying unit 41, the determination unit 38 determines whether the signature included in the extracted image of the signature column is a signature by handwriting. Although it is described that the determination unit 38 makes a determination based on the specification result of the second specifying unit 41, the determination unit 38 may also determine whether the signature included in the image of the signature column is a signature by handwriting using a learned machine learning model.

[0058] The first specifying unit 40 specifies the person in charge associated with the document to be processed and the case number. The storage unit 42 stores the image data of the handwritten signature column determined by the determination unit 38 in a folder associated with the person in charge specified by the first specifying unit 40. Further, the storage unit 42 may also store the image data of the signature column by sorting it for each signature type in a folder associated with the person in charge specified by the first specifying unit 40 and the signature type specified by the second specifying unit 41. A folder for each signature type may be created in the folder associated with the person in charge specified by the first specifying unit 40, and sorted and stored for each signature type.

[0059] The display control unit 44 causes the image data of the handwritten signature field saved in the folders of the responsible persons etc. sorted by the storage unit 42 to be listed for each folder of the responsible persons etc. in, for example, a reduced (thumbnail) display.

[0060] The data storage unit 50 stores the PDF data of the authentication document to be processed and the image data converted from the PDF data. The information storage unit 52 stores the first information and the second information described later. The information storage unit 52 also stores the position information specifying the range of the signature field of the authentication document. The distribution result storage unit 54 stores the image data of the handwritten signature field distributed to the folders associated with the responsible persons etc.

[0061] The input reception unit 60 receives an input from a user who operates the user terminal 12. The display unit 62 causes a screen to be displayed on the display 418. The display unit 62 lists and displays the image data of the handwritten signature field saved in the folders associated with the responsible persons etc. in, for example, a reduced (thumbnail) display. The communication control unit 64 controls the communication with the information processing apparatus 10.

[0062] FIG. 6 is a configuration diagram of an example of the first information. The first information is association information in which the identification information for identifying the authentication document and the destination in charge of the authentication document are stored in association with each other, and is stored as a list as shown in FIG. 6, for example. The first information shown in FIG. 6 includes, as items of the record, the case number, document type, identification information of the person in charge, identification information of the organization to which the person in charge belongs, identification information of the signatory, and identification information of the signing organization. The first information is an example of information associating, as an example of the identification information of the authentication document, the case number, the document type of the authentication document, the identification information of the person in charge, the identification information of the organization to which the person in charge belongs, the identification information of the signatory, and the identification information of the signing organization.

[0063] The document type is information indicating the type of documentary evidence such as an order form or a receiving inspection form. The identification information of the person in charge is the name, employee number, etc. of the person in charge. The identification information of the organization to which the person in charge belongs is the company name or organization name, etc. of the organization to which the person in charge belongs. The identification information of the signatory is the name, employee number, etc. of the signatory who signed in the signature column of the documentary evidence. The identification information of the signing organization is the company name or organization name, etc. of the signing organization that signed in the signature column of the documentary evidence.

[0064] Figure 7 is a configuration diagram of an example of the second information. The second information is association information in which identification information for identifying a documentary evidence and the storage destination of the data of the documentary evidence are stored in association with each other, and is stored as a list as shown in Figure 7, for example. The storage destination of the data of the documentary evidence is, for example, PATH information. PATH information is a character string representing the position of a file or directory in a storage managed by a file system, and the PATH information of PDF data indicates a link to PDF data associated with a case number, for example. The second information shown in Figure 7 includes, as items of a record, a case number and the PATH information of PDF data. Note that although the first information and the second information are described separately, they may be grouped into one piece of information.

[0065] <Process> In the first embodiment, the information processing system 1 supports the discovery of forgery of a signature made in a signature column in the procedure shown in Figure 8, for example. Figure 8 is an example of a flowchart showing the processing procedure of the information processing system 1 according to the first embodiment.

[0066] In step S10, the selection unit 32 of the information processing apparatus 10 selects, copies, or downloads the PDF data of the documentary evidence to be processed using the PATH information of the PDF data of the second information shown in Figure 7, for example. The process of step S10 may be performed at regular intervals (for example, once a month, etc.). Note that the method for specifying the PDF data of the documentary evidence to be processed is not limited to this, and it is sufficient if the PDF data of the documentary evidence to be processed can be specified.

[0067] FIG. 9 is an image diagram of an example of the document 1000 to be processed. The document 1000 in FIG. 9 includes a signature column 1002. "Signature" means writing one's name, etc. on a document such as an order form or a receipt, and in this document, a predetermined area (signature column 1002) is provided so that a signature can be made. Since the authenticity of a document signed in the predetermined signature column 1002 by a signature creator, etc. is presumed, the authenticity of the signature in business transactions is very important for companies, etc. Note that the signature and the signature column in the present invention are examples, and the names may vary depending on the document, such as a signature, a sign, etc. and a corresponding signature column, a sign column, etc., but those shall also be included as having the same gist. The range of the signature column 1002 is specified, for example, by the position information of the signature column 1002 stored in the information storage unit 52. Note that the position information of the signature column 1002 may be specified for each document type. Furthermore, the range of the signature column 1002 may be estimated from the PDF data or the image data of the document 1000 using image recognition technology.

[0068] In step S12, the conversion unit 34 converts the PDF data of the document 1000 selected in step S10 into image data such as JPEG data. Also, the conversion unit 34 may adjust the orientation of the converted image data of the document 1000, for example, by vertical and horizontal correction.

[0069] In step S14, the extraction unit 36 extracts the image of the signature column 1002 from the image data of the document 1000 to be processed based on the position information specifying the range of the signature column 1002 of the document 1000.

[0070] In step S16, the determination unit 38 infers the type of the signature described in the signature column 1002 in the image of the signature column 1002 extracted in step S14 using, for example, a learned machine learning model, and determines the image data of the handwritten signature column 1002.

[0071] In step S18, the first specifying unit 40 specifies the identification information of the person in charge associated with the document to be processed 1000 by the case number using the first information shown in FIG. 6. The storage unit 42 stores the image data of the handwritten signature column 1002 determined by the determination unit 38 in the folder associated with the person in charge specified by the first specifying unit 40. The folder associated with the person in charge is, for example, a folder including the identification information of the person in charge in at least a part of the folder name.

[0072] In step S20, the display control unit 44 displays the image data of the handwritten signature column 1002 stored in the folder of the person in charge or the like assigned in step S18, for example, in a reduced (thumbnail) display for each folder of the person in charge or the like.

[0073] In step S16, a step of determining whether the signature in the image of the signature column 1002 is a handwritten signature by the determination unit 38 has been described. However, the second specifying unit 41 may specify the signature type, and based on the specified signature type, the determination unit may determine the handwritten signature column 1002. In this case, before step S16, a step of specifying the signature type is added.

[0074] FIGS. 10A to 10C are exemplary conceptual diagrams showing the processing contents of the information processing system 1 according to the first embodiment. In FIGS. 10A and 10C, for example, the PDF data of the case number "001" is described as "PDF001", and the image data of the case number "001" is described as "image001".

[0075] The conversion unit 34 of the information processing apparatus 10 converts a plurality of PDF data of the document 1000 into a plurality of image data. For example, the conversion unit 34 converts the PDF data "PDF001" of the case number "001" into the image data "image001".

[0076] Next, the extraction unit 36 of the information processing apparatus 10 extracts an image of the signature field 1002 from a plurality of image data of the credential document 1000 based on position information specifying the range of the signature field 1002 of the credential document 1000. In FIG. 10A, for example, the image data of the signature field 1002 extracted from the PDF data of the case number "001" is described as "signature field 001".

[0077] Next, the determination unit 38 of the information processing apparatus 10 infers the type of signature described in the extracted signature field 1002 using, for example, a learned machine learning model, and determines the image data of the signature field 1002 with a handwritten or stamped signature. In FIGS. 10A and 10C, the image data of the signature field 1002 of the handwritten case number "001" is described as "handwritten signature field 001", and the image data of the signature field 1002 of the stamped case number "003" is described as "stamped signature field 003".

[0078] Next, the storage unit 42 of the information processing apparatus 10 uses the first information shown in FIG. 6 to distribute and store the image data of the handwritten signature field 1002 determined by the determination unit 38 in the folder 1100 of the person in charge associated with the credential document 1000 to be processed and the case number as shown in FIG. 10A.

[0079] Further, the storage unit 42 of the information processing apparatus 10 may distribute and store the image data of the signature field 1002 in which the second specifying unit 41 has specified the signature type for each folder 1100 of the signature type of the person in charge associated with the credential document 1000 to be processed and the case number for each signature type as shown in FIG. 10C.

[0080] In FIG. 10B, an example is shown in which the image data of the handwritten signature field 1002 determined by the determination unit 38 is distributed and stored in the folder 1100 of the signature type of the person in charge associated with the credential document 1000 to be processed and the case number, and is displayed in a reduced (thumbnail) form.

[0081] For example, in the folder of the signature type "handwritten" of the person in charge "Taro Ricoh", the image data of the signature fields 1002, namely "Signature Field 001 Handwritten", "Signature Field 002 Handwritten", and "Signature Field 004 Handwritten", are allocated and stored. In the folder of the signature type "handwritten" of the person in charge "Taro Ricoh" shown in FIG. 10A, the image data of the signature fields 1002 signed by a plurality of signers such as customers in charge of a single person in charge "Taro Ricoh" are allocated and stored. Note that FIG. 10A is described as "Signature Field 001 Handwritten" as an example for easy understanding, but the file name is not limited to this, as long as each file can be identified.

[0082] As shown in the folder of the signature type "handwritten" of the person in charge "Taro Ricoh" in FIG. 10B, according to the information processing system 1 according to the first embodiment, by opening one folder and displaying it in a reduced (thumbnail) form, the authenticity of signatures by customers, etc. in charge of a single person can be efficiently confirmed, and forgery of signatures can be efficiently detected. For example, according to the information processing system 1 according to the first embodiment, if the handwriting of signatures by a plurality of signers displayed in a reduced (thumbnail) form is similar, it is possible to detect the possibility of forgery (fraud) of signatures such as forgery by the same person such as the person in charge. The display control unit 44 may assist in detecting forgery (fraud) of signatures such as forgery by the person in charge by also displaying the signature of the person in charge of the opened folder.

[0083] Note that in the above, in step S16 of FIG. 8, an example was shown in which, for example, inference was performed using a learned machine learning model to determine the image data of the handwritten signature field 1002, but the type of signature described in the signature field 1002 may be determined in advance.

[0084] When it is necessary to pre-determine the type of signature described in the signature field 1002, for example, as in the first piece of information in FIG. 11, add "signature type" to the record items. FIG. 11 is a configuration diagram of an example of the first piece of information. When it is necessary to pre-determine the type of signature described in the signature field 1002, classify the type of signature described in the signature field 1002 using, for example, the first piece of information in FIG. 11, and determine the image data of the handwritten signature field 1002.

[0085] Also, in the above, in step S16 of FIG. 8, an example of determining one type of signature described in the signature field 1002 was shown. In the signature field 1002, there may be cases where multiple types of signatures, such as signatures by handwriting and seals, are mixed and performed by the signatory. For example, when multiple types of signatures, such as signatures by handwriting and seals, are mixed in the signature field 1002, the information processing apparatus 10 may determine multiple signature types, or assign priorities to the signature types and determine one signature type with the highest priority. The information processing apparatus 10 may determine the signature field 1002 in which multiple types of signatures are mixed as a handwritten signature, or as a seal, or as other.

[0086] [Second Embodiment] The first embodiment is an example of sorting and storing the image data of the signature field into folders created for each person in charge. The second embodiment is an example of sorting and storing the image data of the signature field into folders created for each signatory or signature organization. Note that since the second embodiment is the same as the first embodiment except for a part, the description will be omitted as appropriate.

[0087] The information processing system 1 according to the second embodiment uses, for example, the first piece of information shown in FIG. 6. The information processing system 1 according to the second embodiment sorts and stores the image data of the signature field into folders created for each signatory or signature organization according to the procedure shown in FIG. 12, for example. FIG. 12 is an example of a flowchart showing the processing procedure of the information processing system 1 according to the second embodiment.

[0088] In step S30, the selection unit 32 of the information processing apparatus 10 selects the PDF data of the certificate to be processed using, for example, the PATH information of the PDF data of the second information shown in FIG. 7, and copies or downloads it. The process of step S30 may be performed at regular intervals (for example, once a month, etc.). Note that the method for specifying the PDF data of the certificate to be processed is not limited to this, as long as the PDF data of the certificate to be processed can be specified.

[0089] In step S32, the conversion unit 34 converts the PDF data of the certificate 1000 selected in step S30 into image data such as JPEG data. Further, the conversion unit 34 may adjust the orientation of the converted image data of the certificate 1000, for example, by vertical and horizontal correction.

[0090] In step S34, the extraction unit 36 extracts the image of the signature field 1002 from the image data of the certificate 1000 to be processed based on the position information specifying the range of the signature field 1002 of the certificate 1000.

[0091] In step S36, the determination unit 38 infers the type of signature described in the signature field 1002 in the image of the signature field 1002 extracted in step S34 using, for example, a learned machine learning model, and determines the image data of the handwritten signature field 1002.

[0092] In step S38, the first identification unit 40 uses the first information shown in FIG. 6 to identify the identification information of the signatory or the identification information of the signing organization associated with the certificate 1000 to be processed by the case number. The storage unit 42 stores the image data of the handwritten signature field 1002 determined by the determination unit 38 in a folder associated with the signatory or signing organization identified by the first identification unit 40. The folder associated with the signatory or signing organization is a folder that includes at least a part of the folder name and the identification information of the signatory or the identification information of the signing organization.

[0093] In step S40, the display control unit 44 displays, for example, in a reduced (thumbnail) display, the image data of the handwritten signature field 1002 stored in the folder of the signer or the signing organization assigned in step S38, in a list for each folder of the signer or the signing organization.

[0094] Figs. 13A to 13B are exemplary images showing the processing content of the information processing system 1 according to the second embodiment. Fig. 13A shows the process of sorting and storing the image data of the signature field 1002 among the processing contents shown in Fig. 10A.

[0095] The storage unit 42 of the information processing apparatus 1 uses the first information shown in Fig. 6 to sort and store the image data of the handwritten signature field 1002 determined by the determination unit 38 in the folder 1200 of the signer associated with the document of trust 1000 to be processed and the case number, as shown in Fig. 13A.

[0096] Also, the storage unit 42 of the information processing apparatus 1 may sort and store the image data of the handwritten signature field 1002 in which the second specifying unit 41 has specified the signature type, in the folder 1200 for each signature type of the signer associated with the document of trust 1000 to be processed and the case number.

[0097] Fig. 13B shows an example in which the image data of the handwritten signature field 1002 determined by the determination unit 38 is sorted and stored in the folder 1200 for each signature type of the signer associated with the document of trust 1000 to be processed and the case number, and is displayed in a reduced (thumbnail) display.

[0098] For example, in the folder of the signature type "handwritten" of the signer "Natsuko Suzuki", the image data of signature fields 1002, namely "Signature Field 002 Handwritten" and "Signature Field 004 Handwritten", are allocated and stored. In the folder of the signature type "handwritten" of the signer "Natsuko Suzuki" shown in FIG. 13B, the image data of signature field 1002 signed by a single signer "Natsuko Suzuki" are allocated and stored. Note that, for clarity, FIG. 13A describes it as, for example, "Signature Field 002 Handwritten", but the file name is not limited to this, as long as each file can be identified.

[0099] As shown in the folder of the signature type "handwritten" of the signer "Natsuko Suzuki" in FIG. 13B, according to the information processing system 1 according to the second embodiment, by opening one folder and displaying it in a reduced (thumbnail) form, the authenticity of the signature by a single signer can be efficiently confirmed, and signature forgery can be efficiently discovered. For example, according to the information processing system 1 according to the second embodiment, if the handwriting of the signature by a single signer displayed in a reduced (thumbnail) form is different, the possibility of signature forgery (fraud), such as forgery by another person (e.g., the person in charge, etc.), can be discovered.

[0100] FIG. 14 is an example image diagram showing the processing content of the information processing system 1 according to the second embodiment. FIG. 14 shows the process of allocating and storing the image data of signature field 1002 among the processing contents shown in FIG. 10A.

[0101] The storage unit 42 of the information processing apparatus 1 uses the first information shown in FIG. 6 to allocate and store the image data of the signed signature field 1002 determined by the determination unit 38 in the folder 1300 of the signature organization associated with the document of trust 1000 to be processed and the case number.

[0102] Further, the storage unit 42 of the information processing apparatus 1 may allocate and store the image data of the signed signature field 1002 determined by the determination unit 38 in the folder 1300 for each signature type of the signature organization associated with the document of trust 1000 to be processed and the case number.

[0103] In the case of FIG. 14, for the folder 1300 for each signature type of the signature organization associated with the certificate document 1000 to be processed and the case number, the image data of the signed signature field 1002 determined by the determination unit 38 is distributed and displayed.

[0104] For example, in the folder of the signature type "seal impression" of the signature organization "C Co., Ltd.", the image data of the signature field 1002, "signature field 003 seal impression" and "signature field 010 seal impression", are distributed and stored. Note that, for clarity, FIG. 14 shows the description such as "signature field 003 seal impression", but the file name is not limited to this, as long as each file can be identified.

[0105] According to the information processing system 1 according to the second embodiment, by opening one folder and displaying it in a reduced (thumbnail) form, it is possible to efficiently confirm the authenticity of the signature by seal impression of one signature organization and efficiently detect signature forgery.

[0106] For example, according to the information processing system 1 according to the second embodiment, if the imprints of the signatures by seal impression of one signature organization displayed in a reduced (thumbnail) form are different, it is possible to detect the possibility of signature forgery (fraud), such as a seal impression made with a forged company seal.

[0107] [Third Embodiment] The first to second embodiments may be realized by, for example, an information processing system 2 having the system configuration shown in FIG. 15. FIG. 15 is a configuration diagram of an example of the information processing system 2 according to the third embodiment. Since the system configuration of the information processing system 2 shown in FIG. 15 is the same as the system configuration diagram of FIG. 1 except for a part, the description will be omitted as appropriate.

[0108] The information processing system 2 shown in FIG. 15 has a configuration in which a data storage device 14 is added to the information processing system 1 of FIG. 1. The data storage device 14 stores the PDF data of the certificate documents processed by the information processing device 1, the first information, and the second information.

[0109] The information processing apparatus 10 acquires PDF data of a certificate to be processed, first information, and second information from the data storage device 14, and performs a process of sorting and storing the image data of the signature field of the certificate to be processed shown in the first embodiment or the second embodiment in a folder.

[0110] The data storage device 14 stores the image data of the signature field sorted by the information processing apparatus 10 and stored in a folder. Then, the user terminal 12 accesses the data storage device 14 and displays a list of the image data of the signature field sorted and stored in a folder, for example, in a reduced (thumbnail) form.

[0111] According to the third embodiment, the first and second embodiments can be realized by the information processing system 1 having the configuration shown in FIG. 15.

[0112] According to the above first to third embodiments, unlike the conventional mechanism for determining and authenticating the consistency with a registered signature (handwriting) in which the signature (sign) written by the user is registered in advance, it is possible to detect signatures (signs) that do not match (signs with doubtful consistency) among a plurality of signatures (signs) written by the user, and furthermore, it can be said that the work process of tracing the factor (for example, the person in charge, etc.) from the information corresponding to the document having the signature corresponding to that can be made more efficient by assisting. By introducing such an early detection mechanism, it is also possible to contribute to obtaining the trust of all stakeholders of the company.

[0113] Each function of the embodiment described above can be realized by one or a plurality of processing circuits. Here, the "processing circuit" in this specification includes a processor programmed to execute each function by software, such as a processor implemented by an electronic circuit, an ASIC (Application Specific Integrated Circuit) designed to execute each function described above, a DSP (digital signal processor), an FPGA (field programmable gate array), and devices such as conventional circuit modules.

[0114] The device group described in the embodiments only shows one of a plurality of computing environments for implementing the embodiments disclosed in this specification. The present invention is not limited by this embodiment, and the components in this embodiment include those that can be easily conceived by those skilled in the art, those that are substantially the same, and those within the so-called equivalent scope. Furthermore, various omissions, substitutions, changes, and combinations of components can be made without departing from the gist of this embodiment.

Explanation of Reference Numerals

[0115] 1, 2 Information processing system 10 Information processing device 12 User terminal 14 Data storage device 18 Network 36 Extraction unit 38 Determination unit 40 First identification unit 41 Second identification unit 42 Storage unit 44 Display control unit 62 Display unit

Prior Art Documents

Patent Documents

[0116]

Patent Document 1

Claims

1. An information processing apparatus for processing document data, comprising: an extraction unit that extracts an image of a predetermined area from the data; a determination unit that determines whether a handwritten signature is included in the image extracted by the extraction unit; when it is determined by the determination unit that a handwritten signature is included, using first information in which identification information for identifying a document and a destination in charge of the document are stored in association with each other, a first specifying unit that specifies a destination in charge associated with the identification information of the document related to the data from which the image of the predetermined area is extracted; a storage unit that stores the extracted image in a storage location associated with the specified destination in charge; An information processing apparatus having the above.

2. having a second specifying unit that specifies which signature type among a plurality of signature types including at least a handwritten signature; the determination unit determines whether the image includes a handwritten signature based on the specification result by the second specifying unit, The information processing apparatus according to claim 1.

3. The plurality of signature types further includes at least one of a signature by seal, a signature by electronic input, and a blank, The information processing apparatus according to claim 2.

4. The destination in charge is any one of a person in charge of the document, an affiliation of the person in charge, a signatory who signed the document, or an affiliation of the signatory, The information processing apparatus according to any one of claims 1 to 3.

5. The storage location associated with the destination in charge is a file storage location including, as a name, the identification information of the destination in charge associated with the identification information of the document, The information processing apparatus according to any one of claims 1 to 3.

6. The determination unit detects an image of a handwritten signature using a learned machine learning model, The information processing apparatus according to any one of claims 1 to 3.

7. further having a display control unit that displays a list of the images stored in the storage location in a reduced display format for each storage location, The information processing apparatus according to claim 1 or 2.

8. An information processing apparatus for processing document data, comprising: an extraction unit that extracts an image of a predetermined area from the data; a second specifying unit that specifies which signature type among a plurality of signature types including at least a handwritten signature; Using first information in which identification information for identifying a document and a destination in charge of the document are stored in association with each other, a first specifying unit that specifies a destination associated with the identification information for identifying a document related to data from which an image of a predetermined area is extracted; A storage unit that stores the extracted image in association with a signature type specified by a second specifying unit in a storage location associated with the destination specified by the first specifying unit; An information processing apparatus having the above.

9. An information processing system in which an information processing apparatus that processes document data and a user terminal operated by a user are communicably connected, The information processing apparatus includes: An extraction unit that extracts an image of a predetermined area from the data; A determination unit that determines whether a handwritten signature is included in the image extracted by the extraction unit; When it is determined by the determination unit that a handwritten signature is included, using first information in which identification information for identifying a document and a destination in charge of the document are stored in association with each other, a first specifying unit that specifies a destination associated with the identification information for identifying a document related to data from which an image of a predetermined area is extracted; A storage unit that stores the extracted image in a storage location associated with the specified destination; Having the above, The user terminal includes: A display unit that displays the image stored in the storage location; Having the above Information processing system.

10. In an information processing apparatus that processes document data, An extraction procedure for extracting an image of a predetermined area from the data, A determination procedure for determining whether a handwritten signature is included in the image extracted by the extraction procedure, When it is determined by the determination procedure that a handwritten signature is included, using first information in which identification information for identifying a document and a destination in charge of the document are stored in association with each other, a first specifying procedure for specifying a destination associated with the identification information for identifying a document related to data from which an image of a predetermined area is extracted; A storage procedure for storing the extracted image in a storage location associated with the specified destination; A program for causing the above to be executed.

Images