Program, information processing apparatus, and method

Abstract

To read a variety of applications or financial statements of customers to be registered on a master, which are reflected in various services, as a service for accounting firms.SOLUTION: In an accounting system 1, memory 25, 26 of a server stores form image data obtained by scanning unclassified forms, in a predetermined region, and registers, as a master database, text data obtained by reading form image data in the past through OCR processing. The system is configured to: read the form image data stored in the predetermined region through OCR processing; estimate, based on the read text data, whether the text data has been registered on the master database; determine whether it is necessary to reflect the text data in the master database; reflect, when the necessity of reflection in the master database is determined, the text data in the master database for registration; and present a predetermined service based on the master database with the text data reflected therein.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present disclosure relates to a program, an information processing apparatus, and a method.

Background Art

[0002] As patent documents of a system that reads form data by OCR processing and performs various registrations, acquiring a plurality of form image data of the same layout, analyzing the form image data by OCR or image recognition, identifying differences from a master table based on the analysis result, newly registering a form file in the master table, and classifying whether the character string of the form image data is variable character data or fixed character data (item name) based on the analysis result and registering the variable character data have already been disclosed (see Patent Documents 1 and 2).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0004] In an accounting firm, it is necessary to process settlement and filing within a deadline based on various data received from customers, and there is also a litigation risk due to the expiration of the deadline, so deadline management is important.

[0005] An object of the present disclosure is to provide a system that reads various application forms (such as various tax selection declaration forms) and financial statements of customers by OCR as a service for accounting firms, registers them on a master, and reflects them in various services (such as deadline management).

Means for Solving the Problems

[0006] According to an embodiment of the present disclosure, there is provided a program for operating a computer including a processor and a memory. In the memory, invoice image data obtained by scanning an invoice is stored in a predetermined area in an unclassified state, and text data obtained by reading the invoice image data by OCR processing in the past is registered as a master database. The program causes the processor to perform a first step of reading the invoice image data stored in the predetermined area by OCR processing and obtaining text data as a result of the reading, a second step of inferring whether the text data is registered in the master database based on the text data obtained as a result of the reading in the first step, and determining whether it is necessary to reflect the text data in the master database, and a third step of reflecting and registering the text data in the master database when it is determined in the second step that it is necessary to reflect the text data in the master database, and a fourth step of presenting a predetermined service based on the master database reflected in the third step.

Effect of the Invention

[0007] According to the present disclosure, it is possible to provide a system that reads various application forms (such as various tax selection declaration forms) and financial statements of customers by OCR as a service for accounting offices, registers them on a master, and reflects them in various services (such as deadline management).

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Embodiments for Carrying Out the Invention

[0009] Hereinafter, embodiments of the present invention will be described with reference to the drawings. The following description and drawings are examples for explaining the present invention, and for the sake of clarity of explanation, omissions and simplifications are made as appropriate. The present invention can be implemented in various other forms. Unless otherwise limited, each component may be singular or plural.

[0010] In the drawings for explaining the embodiments, the same reference numerals are given to parts having the same function, and repeated explanations thereof are omitted.

[0011] In the drawings, the positions, sizes, shapes, ranges, etc. of the respective components shown may not represent the actual positions, sizes, shapes, ranges, etc. in order to facilitate understanding of the invention. For this reason, the present invention is not necessarily limited to the positions, sizes, shapes, ranges, etc. disclosed in the drawings.

[0012] In the following description, various types of information may be described using expressions such as "table", "list", "queue", etc. However, the various types of information may be represented by data structures other than these. In order to indicate that it does not depend on the data structure, "XX table", "XX list", etc. may be referred to as "XX information". When explaining identification information, expressions such as "identification information", "identifier", "name", "ID", "number", etc. are used, and these can be mutually replaced.

[0013] Also, in the following description, the configuration of each table is an example. One table may be divided into two or more tables, or all or part of two or more tables may be one table.

[0014] When there are multiple components having the same or similar functions, they may be described with the same reference numeral and different subscripts. However, when it is not necessary to distinguish these multiple components, the subscripts may be omitted in the description.

[0015] Also, in the following description, there may be cases where the processing performed by executing a program is described. However, the program is executed by a processor (e.g., CPU, GPU), and in order to perform the defined processing while appropriately using a storage resource (e.g., memory) and / or an interface device (e.g., communication port), etc., the subject of the processing may be the processor. Similarly, the subject of the processing performed by executing the program may be a controller, device, system, computer, node having a processor. The subject of the processing performed by executing the program may be an arithmetic unit, and may include a dedicated circuit (e.g., FPGA or ASIC) for performing a specific processing.

[0016] Also, in the following description, the "processor (section)" is one or more processors. At least one processor is typically a microprocessor such as a CPU (Central Processing Unit), but may also be other types of processors such as a GPU (Graphics Processing Unit). At least one processor may be single-core or multi-core.

[0017] Also, at least one processor may be a processor in a broad sense, such as a hardware circuit (e.g., FPGA (Field-Programmable Gate Array) or ASIC (Application Specific Integrated Circuit)) that performs part or all of the processing.

[0018] Also, in the following description, the "memory section" is one or more memories, and may typically be a main memory device. At least one memory in the memory section may be a volatile memory or a non-volatile memory.

[0019] The program may be installed from a program source into a device such as a computer. The program source may be, for example, a program distribution server or a computer-readable storage medium. When the program source is a program distribution server, the program distribution server includes a storage resource for storing the processor and the program to be distributed, and the processor of the program distribution server may distribute the program to be distributed to other computers. Also, in the following description, two or more programs may be realized as one program, or one program may be realized as two or more programs.

[0020] The functions realized by the components described in this specification may be implemented in circuitry or processing circuitry, including a general-purpose processor, an application-specific processor, an integrated circuit, ASICs, a CPU, conventional circuits, and / or combinations thereof, programmed to realize the described functions. The processor includes transistors and other circuits and is regarded as circuitry or processing circuitry. The processor may be a programmed processor that executes a program stored in a memory.

[0021] In this specification, circuitry, unit, and means are hardware programmed to realize the described functions or hardware that executes the functions. The hardware may be any hardware disclosed in this specification or any hardware known to be programmed or execute to realize the described functions.

[0022] When the hardware is a processor regarded as a type of circuitry, the circuitry, means, or unit is a combination of hardware and software used to configure the hardware and / or the processor.

[0023] In this disclosure, the storage device includes one storage drive such as one HDD (Hard Disk Drive) or SSD (Solid State Drive), a RAID device including multiple storage drives, and multiple RAID devices. Also, when the drive is an HDD, for example, it may include a SAS (Serial Attached SCSI) HDD or an NL-SAS (Nearline SAS) HDD.

[0024] Also, in the following description, an identification number is used as identification information for various objects, but identification information of other types (for example, an identifier including letters and symbols) may be adopted.

[0025] In the following description, when describing elements of the same type without distinction, reference signs (or common signs among the reference signs) are used, and when describing elements of the same type separately, identification numbers (or reference signs) of the elements may be used.

[0026] In the following description, control lines and information lines indicate those considered necessary for explanation, and not all control lines and information lines on the product are necessarily shown. All components may be interconnected.

[0027] <0 Overview of the System> Hereinafter, an accounting system according to the present disclosure will be described.

[0028] In the accounting system according to the present disclosure, by way of example and not limitation, invoice image data obtained by scanning an invoice is stored in a predetermined area in the memory of a server constituting the system in an unclassified state, and text data obtained by reading past invoice image data by OCR (Optical Character Recognition) processing is registered as a master database in this memory. The server constituting the system reads the invoice image data stored in the predetermined area by OCR processing and acquires the text data that is the result of the reading. Next, based on the text data that is the result of the reading, it is speculated whether the text data is registered in the master database, and it is determined whether it is necessary to reflect the text data in the master database. Then, when it is determined that it is necessary to reflect in the master database, the text data is reflected and registered in the master database, and based on the reflected master database, a predetermined service is presented.

[0029] The accounting system according to the present disclosure is a system for providing accounting processing services for enterprises and individual business owners who are clients of a user who is an operator providing accounting processing such as an accounting firm. Accounting processing performed by enterprises and individual business owners is to manage transactions of receipts and payments such as purchases, sales, and borrowings, record (post) the transactions in books (journal, general ledger), create a trial balance as an accounting process at a predetermined settlement period, and create an income statement and a balance sheet which are financial statements. Also, the creation of settlement documents for tax processing is also performed. The accounting system according to the present disclosure is a computer system that accepts the input of receipts and payments transactions such as purchases and sales, posts them to books, and supports the creation of trial balances and financial statements. Further, the accounting system according to the present disclosure is a system provided as a so-called SaaS (Software as a Service) as a web service by, for example, a cloud server or the like, and is configured to be accessible by a user who is an operator through predetermined authentication.

[0030] In such accounting services, a predetermined period (one year) is set as the accounting year (business year), and for example, at the time of quarterly settlements every three months and semi-annual settlements every six months, the above-mentioned accounting processes performed by enterprises and the like are supported. And when the accounting year ends, a user such as an accounting firm needs to process final tax returns and the like within the deadline based on various data held from the client, and there is also a risk of litigation due to missing the deadline, so deadline management is important.

[0031] Therefore, as a service for users such as accounting firms, the accounting system according to the present disclosure reads various application forms (selection declaration forms for various taxes, etc.) and settlement documents of clients by OCR, registers them on the master, and reflects them in various services (deadline management, etc.).

[0032] More specifically, the accounting system according to the present disclosure, by way of example and not limitation, registers the contents of various application forms and settlement documents of clients on the master and reflects them in various services according to the following procedures.

[0033] The invoice image data (image data) such as the client's application forms and financial statements is stored (in an unorganized state in any order). The invoice image data may be provided by the accounting system according to the present disclosure, or may be stored in a cloud storage outside the accounting system, or may be stored in the memory (storage) of the server owned by the accounting system. The invoice image data may or may not be classified according to the types such as financial statements.

[0034] The server of the accounting system reads the invoice image data through OCR processing and obtains the text data of the read result. The timing of obtaining the text data is not particularly limited, and it is possible to obtain the text data periodically or when a certain capacity of invoice image data is stored.

[0035] Next, the server of the accounting system determines whether it is necessary to register the described content in the master database and the items that need to be registered in the master database from the text data read from the invoice image data. Specifically, the text data obtained from the invoice image data is compared with the content of the master database, etc., and a duplication determination is made as to whether the same content is registered in both. When different contents are registered for the same item, determinations such as registration, overwriting, and non-registration are made.

[0036] Then, based on the above determination result, the server of the accounting system registers the content of the read text data in the master database, and reflects it in various services based on the content registered in the master database. As an example, the server of the accounting system reads various application forms related to taxation through OCR, registers them on the master database, and manages the deadlines. Alternatively, the server of the accounting system reads the financial statements through OCR, registers them on the master database, and reflects them.

[0037] In the accounting system according to the present disclosure, the documents related to the document image data are the documents necessary for the client to perform operations based on transaction data. Such documents are well-known, and examples include estimates, order forms (purchase orders), delivery notes, receipts, inspection reports, invoices, and the like. As long as the documents are necessary for the user to perform operations based on transaction data, there are no particular limitations on their names or contents, and various documents with different names and contents can be managed and created in the accounting system according to the present disclosure.

[0038] <Embodiment 1> Hereinafter, the accounting system 1 will be described. In the following description, for example, when the terminal device 10 accesses the server 20, the server 20 responds with information for generating a screen on the terminal device 10. The terminal device 10 generates and displays a screen based on the information received from the server 20.

[0039] <1 Overall Configuration of Accounting System 1> FIG. 1 is a diagram showing the overall configuration of the accounting system 1 according to Embodiment 1. As shown in FIG. 1, the accounting system 1 (hereinafter simply referred to as "system 1") includes a plurality of terminal devices (in FIG. 1, terminal device 10A and terminal device 10B are shown. Hereinafter, they may be collectively referred to as "terminal device 10") and a server 20. The terminal device 10 and the server 20 are communicably connected to each other via a network 80. The network 80 is composed of a wired or wireless network. In this embodiment, the server 20 is a server having a function as a Web server (including a cloud server), and exchanges information with the terminal device 10 via a Web page. Further, although a Web page browser for browsing Web pages is installed in the terminal device 10, a dedicated application for providing the services of the server 20 may be installed and configured to be browsable by the dedicated application.

[0040] The terminal device 10 is a device operated by the person in charge of the user. In the present embodiment, the user is a person in charge of a business operator (for example, an accounting firm) who concludes a predetermined contract with a client using the accounting management service realized by the system 1 of the present embodiment and provides the accounting management service to this client in a form such as SaaS. The client is a person in charge of a company that conducts various business transactions, or an individual business owner, etc., and provides document image data to the system 1 of the present embodiment to use various accounting management services. The terminal device 10 is realized by a stationary PC (Personal Computer), a laptop PC, etc. In addition, the terminal device 10 may be a mobile terminal such as a tablet or a smartphone corresponding to, for example, a mobile communication system.

[0041] The terminal device 10 is communicably connected to the server 20 via the network 80. The terminal device 10 is connected to the network 80 by communicating with communication devices such as a radio base station 81 corresponding to communication standards such as 4G, 5G, and LTE (Long Term Evolution), and a wireless LAN router 82 corresponding to wireless LAN (Local Area Network) standards such as IEEE (Institute of Electrical and Electronics Engineers) 802.11. As shown as the terminal device 10B in FIG. 1, the terminal device 10 includes a communication IF (Interface) 12, an input device 13, an output device 14, a memory 15, a storage unit 16, and a processor 19.

[0042] The communication IF12 is an interface for inputting and outputting signals for the terminal device 10 to communicate with an external device. The input device 13 is an input device (for example, a keyboard, a touch panel, a touch pad, a pointing device such as a mouse, etc.) for receiving input operations from the user. The output device 14 is an output device (display, speaker, etc.) for presenting information to the user. The memory 15 is for temporarily storing programs and data processed by programs, etc., and is a volatile memory such as a DRAM (Dynamic Random Access Memory). The storage unit 16 is a storage device for storing data, such as a flash memory or an HDD (Hard Disc Drive). The processor 19 is hardware for executing an instruction set described in a program, and is composed of an arithmetic unit, registers, peripheral circuits, etc.

[0043] The server 20 performs OCR processing on the invoice image data according to the instructions of the user who is the user of the terminal device 10 to obtain text data, compares it with the text data obtained by performing OCR processing on past invoice image data, determines whether it is necessary to reflect it in the master database, and if it is determined that reflection is necessary, reflects the text data obtained from the invoice image data in the master database, and presents various services based on the reflected master database. The server 20 stores a master database in which text data obtained by performing OCR processing on past invoice image data is stored. The server 20 accepts from the user via the terminal device 10 the designation of the invoice image data to be compared with the master database, performs OCR processing on the designated invoice image data, and obtains text data. Then, this text data is compared with the master database, and various processes are performed.

[0044] The server 20 is a computer connected to the network 80. The server 20 includes a communication IF22, an input / output IF23, a memory 25, a storage 26, and a processor 29.

[0045] The communication IF 22 is an interface for inputting and outputting signals for the server 20 to communicate with external devices. The input / output IF 23 functions as an interface for an input device that receives input operations from the user and an output device that presents information to the user. The memory 25 is for temporarily storing programs and data processed by programs, etc., and is a volatile memory such as a DRAM (Dynamic Random Access Memory). The storage 26 is a storage device for storing data, such as a flash memory or an HDD (Hard Disc Drive). The processor 29 is hardware for executing an instruction set described in a program and is composed of an arithmetic unit, registers, peripheral circuits, etc.

[0046] <1.1 Configuration of the terminal device 10> Figure 2 is a block diagram showing the functional configuration of the terminal device 10 that constitutes the accounting system 1 in Figure 1. As shown in Figure 2, the terminal device 10 includes a plurality of antennas (antenna 111, antenna 112), wireless communication units (first wireless communication unit 121, second wireless communication unit 122) corresponding to each antenna, an operation reception unit 130 (including a keyboard 131 and a mouse 132), a display 150, a storage unit 170, and a control unit 180. The terminal device 10 also has functions and configurations not particularly shown in Figure 2 (for example, a battery for holding power, a power supply circuit for controlling the supply of power from the battery to each circuit, etc.). As shown in Figure 2, each block included in the terminal device 10 is electrically connected by a bus or the like.

[0047] The antenna 111 radiates the signal emitted by the terminal device 10 as a radio wave. Also, the antenna 111 receives a radio wave from space and gives the received signal to the first wireless communication unit 121.

[0048] The antenna 112 radiates the signal emitted by the terminal device 10 as a radio wave. Also, the antenna 112 receives a radio wave from space and gives the received signal to the second wireless communication unit 122.

[0049] The first wireless communication unit 121 performs modulation / demodulation processing and the like for transmitting and receiving signals via the antenna 111 so that the terminal device 10 can communicate with other wireless devices. The second wireless communication unit 122 performs modulation / demodulation processing and the like for transmitting and receiving signals via the antenna 112 so that the terminal device 10 can communicate with other wireless devices. The first wireless communication unit 121 and the second wireless communication unit 122 are communication modules including a tuner, an RSSI (Received Signal Strength Indicator) calculation circuit, a CRC (Cyclic Redundancy Check) calculation circuit, a high-frequency circuit, and the like. The first wireless communication unit 121 and the second wireless communication unit 122 perform modulation / demodulation and frequency conversion of the wireless signals transmitted and received by the terminal device 10, and supply the received signals to the control unit 180.

[0050] The operation reception unit 130 has a mechanism for receiving input operations of the user. Specifically, the operation reception unit 130 includes a keyboard 131 and a mouse 132.

[0051] The keyboard 131 receives input operations of the user of the terminal device 10. The keyboard 131 is a device for inputting characters, and outputs the input character information to the control unit 180 as an input signal.

[0052] The mouse 132 receives input operations of the user of the terminal device 10. The mouse 132 is a pointing device for selecting a displayed object on the display 150 and the like, and outputs the position information selected on the screen and the information indicating that a button is pressed to the control unit 180 as input signals.

[0053] The display 150 displays data such as images, videos, and texts according to the control of the control unit 180. The display 150 is realized by, for example, an LCD (Liquid Crystal Display) or an organic EL (Electro-Luminescence) display. Note that the display 150 may be a touch screen that detects the contact position of the user with respect to the touch panel by using, for example, a capacitive touch panel, and may be configured to include functions such as the above-described keyboard.

[0054] The storage unit 170 is composed of, for example, a memory 15 such as a flash memory and a storage unit 16, and stores data and programs used by the terminal device 10. In a certain aspect, the storage unit 170 stores user information 1701 and form image data 1702.

[0055] The user information 1701 is information of a user who performs analysis work or the like of form image data, which is a function of the system 1 of the present embodiment, using the terminal device 10. The user information includes information (user ID) for identifying the user.

[0056] The form image data 1702 is, for example, form image data of accounting documents related to the business of the client directly provided to the user from the client of the user. Here, the accounting documents are documents used for accounting processing, and are a concept including general ledger, financial statements, balance sheets, etc. The form image data 1702 may be document data such as PDF (Portable Document Format) of accounting documents, image data obtained by scanning accounting documents, or photo image data obtained by photographing accounting documents. Note that when the form image data 2024 (see FIG. 3) is directly provided from the client to the server 20 of the system 1 of the present embodiment described later, there may be a mode in which the form image data 1702 is not stored in the storage unit 170 of the terminal device 10.

[0057] The control unit 180 is constituted by, for example, the processor 19, reads the program stored in the storage unit 170, and controls the operation of the terminal device 10 by executing the instructions included in the program. The control unit 180 functions as an input operation reception unit 1801, a transmission / reception unit 1802, a data processing unit 1803, and a notification control unit 1804 by operating according to a program which is, for example, an application pre-installed (stored in the storage unit 170) in the terminal device 10.

[0058] The input operation reception unit 1801 performs a process of receiving a user's input operation on an input device such as the keyboard 131.

[0059] The transmission / reception unit 1802 performs a process for the terminal device 10 to transmit and receive data to and from an external device such as the server 20 according to a communication protocol.

[0060] The data processing unit 1803 performs a process of performing an operation on the data input by the terminal device 10 according to a program and outputting the operation result to a memory or the like.

[0061] The notification control unit 1804 performs a process of presenting information to the user. The notification control unit 1804 performs a process of displaying a display image on the display 150, a process of outputting sound to a speaker (not shown), and the like.

[0062] <1.2 Functional Configuration of Server 20> FIG. 3 is a diagram showing the functional configuration of the server 20 that constitutes the accounting system 1 of FIG. 1. As shown in FIG. 3, the server 20 functions as a communication unit 201, a storage unit 202, and a control unit 203.

[0063] The communication unit 201 performs a process for the server 20 to communicate with an external device.

[0064] The storage unit 202 is composed of, for example, a memory 25 and a storage 26, and stores data and programs used by the server 20. The storage unit 202 stores an accounting basic database (DB), 2022, a master DB 2023, voucher image data 2024, client information DB 2025, teacher data 2026, a learning model 2027, and the like.

[0065] The accounting basic DB 2022 is a database for holding various types of information related to accounting, such as account items registered in advance in the accounting system 1 and account items registered as account items normally used by accounting services. Details will be described later.

[0066] The master DB 2023 is a database in which text data read by performing OCR processing on voucher image data in the past (that is, prior to the analysis processing of voucher image data by the system 1 of the present embodiment) is stored. The text data stored in the master DB 2023 is not limited to the text data read by performing OCR processing by the server 20 of the present embodiment, more specifically, the text data acquisition module 2034, and may be text data acquired from outside the server 20 (that is, OCR processed outside the server 20). Details will be described later.

[0067] Similar to the voucher image data 1702 stored in the storage unit 170 of the terminal device 10, the voucher image data 2024 is, for example, voucher image data of accounting documents related to the client's business directly provided to the user from the user's client. The voucher image data 2024 may be document data such as a PDF of an accounting document, image data obtained by scanning an accounting document, or photo image data obtained by photographing an accounting document. Note that the voucher image data may be in a cloud storage outside the server 20, and in this case, there may be a mode in which the voucher image data 2024 is not stored in the storage unit 202 of the server 20.

[0068] The client information DB2025 is a database for storing information (client ID) for identifying clients who enjoy the accounting processing service in the system 1 of this embodiment, information such as the name of the client (company name), and the corporate number of the client. The client information DB2025 is created in advance by the user and stored in the storage unit 202. Details will be described later.

[0069] The teacher data 2026 is teacher data for generating a learning model 2027 described later. It is teacher data that takes two types of text data as input and outputs a determination result as to whether or not these text data match.

[0070] The learning model 2027 is obtained by causing a machine learning model to perform machine learning according to a model learning program (not shown) based on the teacher data 2026. The learning model 2027 uses the text data obtained from the form image data 2024 and the text data stored in the master DB2023 as explanatory variables, and the determination result as to whether or not to update the master DB2023 with the text data obtained from the form image data 2024 as the objective variable. Therefore, when the text data obtained from the form image data 2024 and the text data stored in the master DB2023 are input to the learning model, the determination result as to whether or not to update the master DB2023 with the text data obtained from the form image data 2024 is output as the inference result. When the text data stored in the master DB2023 is input, the determination result as to whether or not to update the master DB2023 with the text data obtained from the form image data 2024 is output as the inference result.

[0071] The learning model 2027 according to this embodiment is, for example, a parameterized composite function in which a plurality of functions are combined. The parameterized composite function is defined by a combination of a plurality of adjustable functions and parameters. The prediction model according to this embodiment may be any parameterized composite function that satisfies the above requirements, but is assumed to be a multi-layer network model (hereinafter referred to as a multi-layered network). A prediction model using a multi-layered network has an input layer, an output layer, and at least one intermediate layer or hidden layer provided between the input layer and the output layer. The prediction model is assumed to be used as a program module that is part of artificial intelligence software.

[0072] As the multi-layered network according to this embodiment, for example, a deep neural network (DNN) that is a multi-layer neural network targeted for deep learning can be used. As the DNN, for example, a convolution neural network (CNN) targeted for images may be used.

[0073] Also, the above is merely an example of the prediction model, and the prediction model may have other configurations.

[0074] The control unit 203 causes the processor 29 of the server 20 to perform processing according to the application program 2021 stored in the storage unit 202, thereby exhibiting the functions shown as the reception control module 2031, the transmission control module 2032, the form image data acquisition module 2033, the text data acquisition module 2034, the master DB reflection determination module 2035, the service presentation module 2036, and the presentation control module 2037 as various modules.

[0075] The reception control module 2031 controls the process in which the server 20 receives a signal from an external device according to a communication protocol.

[0076] The transmission control module 2032 controls the process in which the server 20 transmits a signal to an external device according to a communication protocol. These reception control module 2031 and transmission control module 2032 provide the function for the server 20 to operate as a web server with respect to external devices including the terminal device 10 accessed via the network 80.

[0077] When the user designates and inputs the form image data 1702 stored, for example, in the storage unit 170 of the terminal device 10, the form image data acquisition module 2033 acquires the form image data 1702 from the storage unit 170 of the terminal device 10 based on this designated input and stores it in the storage unit 202 as form image data 2024. As described above, the form image data may exist only in the cloud storage. In this case, if the user of the terminal device 10 designates and inputs the storage location (information such as a directory) of the form image data, this storage location is temporarily stored in the storage unit 202.

[0078] The text data acquisition module 2034 reads the form image data acquired by the form image data acquisition module 2033 (this form image data may be the form image data 2024 stored in the storage unit 202, or may be the form image data on the cloud storage if the form image data exists only in the cloud storage), and acquires text data related to the text included in this form image data.

[0079] The method for acquiring text data by the text data acquisition module 2034 is arbitrary. As an example, a method of acquiring by a well-known OCR process is preferably cited. The OCR process may include a process of acquiring text data by performing image processing to match known font data, or a process of inputting form image data into a learning model using known font data as teacher data to acquire text data.

[0080] In addition, when registering text data based on invoice image data in the master DB 2023, the text data acquisition module 2034 is also used when acquiring this text data.

[0081] Based on the text data acquired by the text data acquisition module 2034, the master DB reflection determination module 2035 estimates whether the text data is registered in the master DB 2023, and determines whether it is necessary to reflect the text data in the master DB 2023. When it is determined that reflection in the master DB 2023 is necessary, the master DB reflection determination module 2035 reflects and registers the text data in the master DB 2023.

[0082] The content of the reflection in the master DB 2023 by the master DB reflection determination module 2035 and specific examples of the determination by the master DB reflection determination module 2035 may include the following. · Reflection of data (company name, address, etc.) of a client who is a customer of the user (such as an accounting firm) using the system 1 of this embodiment · Detection of the need for a client to change from a consumption tax-exempt business operator to a simplified tax-paying business operator (when the taxable sales amount exceeds 10 million yen, it is detected that the client can no longer be an exempt business operator) · Whether a client needs to make interim tax payments (targeted when the final corporate tax amount for the previous business year exceeds 200,000 yen)

[0083] The speculation operation by the master DB reflection determination module 2035 on whether the text data acquired by the text data acquisition module 2034 is registered in the master DB 2023 based on the text data, and the details of the determination operation on whether it is necessary to reflect the text data in the master DB 2023 are not particularly limited. As an example, when the text data is not registered in the master DB 2023, a method can be cited where the master DB reflection determination module 2035 determines that it is necessary to newly register the text data in the master DB 2023. At this time, when a predetermined item included in the text data does not match a predetermined item registered in the master DB 2023, the master DB reflection determination module 2035 may determine that it is necessary to newly register in the master DB 2023. Examples of the predetermined items mentioned here include, as an example, user ID, company name, name, key items, etc.

[0084] Also, when the text data is registered in the master DB 2023, the master DB reflection determination module 2035 may determine that it is necessary to update the master DB 2023 with the text data, or may determine that reflection in the master DB 2023 is unnecessary.

[0085] Furthermore, when a predetermined item included in the text data does not match a predetermined item registered in the master DB 2023, the master DB reflection determination module 2035 may determine that it is necessary to update the master DB 2023 with the text data. Examples of the predetermined items mentioned here include variable items such as the amount included in the form image data 2024.

[0086] Furthermore, the master DB reflection determination module 2035 can input the text data into the learning model 2027 to obtain, as an inference result, a determination result on whether to update the master DB 2023 with the text data obtained from the form image data 2024, and this determination result can also be used as the determination result by the master DB reflection determination module 2035.

[0087] Here, as will be described later, the master DB 2023 in the system 1 of the present embodiment classifies and stores the text data acquired by the text data acquisition module 2034 in predetermined items, and this classification refers to the items of basic accounting documents stored in the accounting basic DB 2022. Therefore, although the information of each item in the master DB 2023 is text data, the master DB 2023 as a whole has a database structure in which classification is performed for each item. Of course, in the system 1 of the present embodiment, it is not essential to have a database structure like the master DB 2023 described later, and the text data itself obtained by OCR processing, which is acquired by the text data acquisition module 2034, may be used as the master DB 2023 in which so-called CSV format data with item units separated by commas or the like is stored. However, considering that the master DB reflection determination module 2035 performs comparison for each item, it is preferable that the master DB 2023 is classified for each item in accordance with the items of accounting documents.

[0088] Based on the master DB 2023 in which a predetermined reflection has been made by the master DB reflection determination module 2035, the service presentation module 2036 presents a predetermined service. The predetermined service mentioned here is preferably various services provided by an accounting firm to its clients since the system 1 of the present embodiment is an accounting system 1 and its user is an accounting firm or the like.

[0089] Specific examples of the services presented by the service presentation module 2036 may include the following. · Change from a tax-exempt business operator to a taxable business operator. More specifically, read the invoice image data regarding sales and the like in the previous year's financial statements and tax returns by OCR, and if it exceeds 10 million yen, it is set as an alert target and an alert is issued before March 31 of the same year. · Interim tax payment. More specifically, read the invoice image data regarding the corporate tax amount in the previous year's tax return by OCR, and if it exceeds 200,000 yen, it is set as an alert target and an alert is issued before the timing of interim tax payment in the following fiscal year.

[0090] As an example, the service presentation module 2036 performs expiration management based on the expiration information registered in the master DB 2023 in which text data is reflected. Then, when the expiration date arrives, the service presentation module 2036 notifies the user that the expiration date has arrived. As described above, the system 1 of this embodiment is an accounting system 1, and since the users of the accounting system 1 are accounting firms or the like, the expiration notice destination is first the user of the accounting firm or the like. However, when the contact information of the client is registered in the client information DB 2025, a notice that the expiration date has arrived may be sent to the client.

[0091] Alternatively, the service presentation module 2036 may perform registration in the accounting system based on the amount information registered in the master DB 2023 in which text data is reflected. The accounting system referred to here may be the accounting system 1 of this embodiment or an accounting system outside the system 1 of this embodiment.

[0092] The presentation control module 2037 cooperates with the reception control module 2031 and the transmission control module 2032 to transmit display control data for displaying a predetermined screen on the display 150 of the terminal device 10 to the terminal device 10 in accordance with the operations of the form image data acquisition module 2033, the text data acquisition module 2034, the master DB reflection determination module 2035, and the service presentation module 2036. The terminal device 10 displays a predetermined screen on the display 150 of the terminal device 10 based on this display control data.

[0093] <2 Data Structure> FIG. 4 is a diagram showing an example of the data structure of the accounting basic DB 2022 stored in the server 20 of FIG. 3. FIG. 5 is a diagram showing an example of the data structure of the master DB 2023 stored in the server 20 of FIG. 3. FIG. 6 is a diagram showing an example of the data structure of the client information DB 2025 stored in the server 20 of FIG. 3.

[0094] As shown in FIG. 4, each record of the accounting basic DB2022 includes an item "management ID", an item "major category (department) name", an item "accounting item information", etc.

[0095] The item "management ID" is information that identifies each classification of assets / liabilities, which is an item described in the balance sheet managed by the accounting system 1.

[0096] The item "major category (department) name" is a name indicating the asset department / liability department / net asset department, which is an item described in the balance sheet managed by the accounting system 1.

[0097] The item "accounting item information" is information on accounting items, which is an item described in the balance sheet managed by the accounting system 1. Specifically, it includes an item "accounting item ID", an item "medium category name", an item "accounting item", an item "remarks", etc.

[0098] The item "accounting item ID" is information that identifies each accounting item used in the accounting system 1.

[0099] The item "medium category name" is a name of the type that classifies the accounting items used in the accounting system 1. The accounting items in the balance sheet are divided into, for example, current assets, fixed assets, and current assets in the case of the asset department. Therefore, information indicating such classification is stored.

[0100] The item "accounting item" is the name of the accounting item used in the accounting system 1. For example, as shown in FIG. 4, names such as "cash", "accounts receivable", and "accounts payable" are stored.

[0101] The item "remarks" is information related to the accounting items used in the accounting system 1. For example, as described above, when the character string of the accounting item is registered in association with the user's attribute, the user's attribute (industry type) is stored.

[0102] As shown in FIG. 5, each record of the master DB2023 includes an item "user ID", an item "closing period", an item "closing (reading) information", etc.

[0103] The item "Client ID" is information that identifies each client who receives services from the accounting system 1, and is, for example, identification information registered as information that identifies each business operator (corporation or individual business owner).

[0104] The item "Closing (Reading) Information" is closing information obtained by performing closing processing using the accounting system 1, or information obtained by reading a balance sheet to set the opening balance, and specifically includes the item "Accounting Item ID", the item "Accounting Item", the item "Amount", etc.

[0105] The item "Accounting Item ID" is information that identifies each accounting item used in the accounting system 1, and corresponds to the item "Accounting Item ID" in the accounting basic database 2022.

[0106] The item "Accounting Item" is the name of the accounting item when performing closing processing in the accounting system 1, or the name of the accounting item when reading a balance sheet to set the opening balance, and corresponds to the item "Accounting Item" in the accounting basic database 2022.

[0107] The item "Amount" is the amount of each accounting item when performing closing processing in the accounting system 1, or the amount of each accounting item when reading a balance sheet to set the opening balance.

[0108] Note that the items in the accounting basic DB 2022 shown in FIG. 4 and the master DB 2023 shown in FIG. 5 have items according to the balance sheet because the target voucher image data relates to the balance sheet, but the data structures of the accounting basic DB 2022 and the master database 2023 may vary as appropriate according to the type of the target voucher image data. Therefore, the data structures shown in FIGS. 4 and 5 are merely examples, and the data structure is not limited to the illustrated examples.

[0109] As shown in FIG. 6, each record in the client information DB 2025 includes an item "client ID", an item "company name", an item "corporate number", an item "address", an item "contact information", an item "industry type", etc.

[0110] The item "client ID" is information for identifying a client who is a business partner of a user who is an administrator of the accounting system 1, and is common to the item "client ID" in the master DB 2023.

[0111] The item "name" is information indicating the corporate name of the second business operator or the personal name identified by the item "client ID".

[0112] The item "corporate number" is information indicating the corporate number of the second business operator identified by the item "client ID".

[0113] The item "address" is information indicating the address of the second business operator identified by the item "client ID".

[0114] The item "contact information" is information indicating the contact information of the person in charge of transactions in the second business operator identified by the item "client ID".

[0115] <3 Operations> Hereinafter, with reference to FIGS. 7 to 8, the processing by the accounting system 1 in Embodiment 1 will be described.

[0116] FIGS. 7 and 8 are flowcharts showing an example of the flow of processing performed by the accounting system 1 according to the present disclosure.

[0117] As the process of step S700, in server 20, user authentication is performed in order to provide users with transaction data itself by accounting system 1, work processes and work statuses of transaction data, and accounting services including them. Therefore, an input request for account information and password is made to the user, and user authentication is performed by checking whether the information input matches the registered information based on the input information. If they match, the user logs in to server 20.

[0118] In step S701, the invoice image data acquisition module 2033 of server 20 acquires invoice image data in storage unit 170 of terminal device 10, on cloud storage, etc. based on an instruction input from the user using terminal device 10. Then, the invoice image data acquisition module 2033 stores the acquired invoice image data in storage unit 202 as invoice image data 2024.

[0119] Next, in step S702, the text data acquisition module 2034 of server 20 performs OCR processing etc. on the invoice image data 2024 acquired in step S701 to read this invoice image data 2024 and acquires text data from the invoice image data 2024. The text data acquisition module 2034 temporarily stores the acquired text data in storage unit 202.

[0120] In step S703, the master DB reflection determination module 2035 of server 20 collates the text data acquired in step S702 with master DB 2023 and determines whether there is a match in content including a match at the item unit.

[0121] Next, in step S704, the master DB reflection determination module 2035 of the server 20 determines whether the text data obtained in step S702 is registered in the master DB 2023 based on the collation result in step S703. If the master DB reflection determination module 2035 determines that it is registered (YES in step S704), the program proceeds to step S705. If the master DB reflection determination module 2035 determines that it is not registered (NO in step S704), the program proceeds to step S800 in FIG. 8.

[0122] In step S705, the master DB reflection determination module 2035 of the server 20 determines whether a predetermined item included in the text data obtained in step S702 matches a predetermined item in the master DB 2023. If it is determined that the predetermined items match (YES in step S705), the program proceeds to step S706. If it is determined that the predetermined items do not match (NO in step S705), the program proceeds to step S801 in FIG. 8.

[0123] In step S706, the master DB reflection determination module 2035 of the server 20 determines that reflection of the master DB 2023 by the text data obtained in step S702 is unnecessary and proceeds to step S802 in FIG. 8.

[0124] Proceeding to FIG. 8, in step S800, the master DB reflection determination module 2035 of the server 20 newly registers the master DB 2023 with the text data obtained in step S702. After this, the program proceeds to step S802.

[0125] In step S801, the master DB reflection determination module 2035 of the server 20 updates and registers the master DB 2023 with the text data obtained in step S702. After this, the program proceeds to step S802.

[0126] In step S802, the service presentation module 2036 of the server 20 presents a predetermined service to the user and further to the client based on the master DB 2023 in which the text data acquired in step S702 has been subjected to a predetermined reflection.

[0127] <4 Screen Example> Hereinafter, with reference to FIG. 9, a screen example of the processing by the accounting system 1 will be described.

[0128] FIG. 9 is a diagram showing an example of a login screen 900 displayed on the display 150 of the terminal device 10. Since the user operates the terminal device 10 to access the server 20, the URL of the login screen is transmitted according to the instruction of the server 20, and the login screen is displayed. Alternatively, the login screen is displayed according to the instruction of an application pre-installed in the terminal device 10. By these operations, a login screen 900 as shown in FIG. 10 is displayed on the display 150 of the terminal device 10.

[0129] When a login screen 900 as shown in FIG. 9 is displayed on the display 150 of the terminal device 10, the user inputs his or her account information (email address in this embodiment) and password into the account input field 901 and the password input field 902 provided on the login screen 900 by operating the operation reception unit 130. Thereafter, user authentication is performed by pressing the login button 903, and the user logs in to the server 20.

[0130] <5. Parentheses> As described above, the server 20 of the present embodiment determines, from the text data read from the acquired form image data 2024, whether registration in the master DB 2023 is necessary for the described content and the items that need to be registered in the master database, and based on the determination result, registers the content of the read text data in the master DB 2023 and reflects it in various services based on the content registered in the master DB 2023. Thus, according to the system 1 of the present embodiment, as a service for accounting offices, a system can be provided that reads various customer application forms (such as various tax selection declaration forms) and balance sheets by OCR, registers them on the master, and reflects them in various services (such as deadline management).

[0131] <6. Supplementary Note> Note that the above-described embodiments have been described in detail for the purpose of clearly explaining the present disclosure, and are not necessarily limited to those having all the configurations described. Also, for a part of the configuration of each embodiment, addition, deletion, or replacement with other configurations is possible.

[0132] In addition, each of the above configurations, functions, processing units, processing means, etc. may be realized in hardware by designing part or all of them, for example, by using an integrated circuit. Also, the present invention can be realized by a program code of software that realizes the functions of the embodiments. In this case, a storage medium recording the program code is provided to a computer, and a processor included in the computer reads the program code stored in the storage medium. In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the program code itself and the storage medium storing it constitute the present invention. As a storage medium for supplying such a program code, for example, a flexible disk, CD-ROM, DVD-ROM, hard disk, SSD, optical disk, magneto-optical disk, CD-R, magnetic tape, non-volatile memory card, ROM, etc. are used.

[0133] Furthermore, the program code for implementing the functions described in this embodiment can be implemented in a wide range of programs or script languages such as assembler, C / C++, perl, Shell, PHP, Java (registered trademark), etc.

[0134] Furthermore, by distributing the program code of the software that realizes the functions of the embodiment via a network, it can be stored in storage means such as a computer's hard disk or memory, or a storage medium such as a CD-RW or CD-R, and the processor provided in the computer reads and executes the program code stored in the storage means or the storage medium.

[0135] The matters described in each of the above embodiments are appended below.

[0136] (Appendix 1) A program for operating a computer (20) including a processor (29) and memories (25, 26), wherein in the memories (25, 26), form image data (2024) obtained by scanning a form is stored in a predetermined area in an unclassified state, and text data obtained by reading form image data by OCR processing in the past is registered as a master database (2023). The program causes the processor (29) to perform a first step (S702) of reading the form image data (2024) stored in the predetermined area by OCR processing and obtaining text data as a result of the reading; a second step (S703) of inferring whether or not the text data is registered in the master database (2023) based on the text data obtained as a result of the reading in the first step (S702), and determining whether or not it is necessary to reflect the text data in the master database (2023); a third step (S800, S801) of reflecting and registering the text data in the master database (2023) when it is determined in the second step (S703) that reflection in the master database (2023) is necessary; and a fourth step of presenting a predetermined service based on the master database (2023) reflected in the third step (S800, S801). (Appendix 2) In the second step (S703), when the text data is not registered in the master database (2023), determine that new registration in the master database (2023) is necessary, the program described in Appendix 1. (Appendix 3) In the second step (S703), when a predetermined item included in the text data does not match a predetermined item registered in the master database (2023), determine that new registration in the master database (2023) is necessary, the program described in Appendix 2. (Appendix 4) In the second step (S703), when the text data is registered in the master database (2023), determine whether an update to the master database (2023) is necessary, or determine that reflection in the master database (2023) is unnecessary, the program described in Appendix 1. (Appendix 5) In the second step (S703), when a predetermined item included in the text data does not match a predetermined item registered in the master database (2023), determine that an update to the master database (2023) is necessary, the program described in Appendix 4. (Appendix 6) In the second step (S703), use a machine learning model that infers whether the text data is registered in the master database (2023), the program described in Appendix 1. (Appendix 7) In the fourth step (S802), perform deadline management based on the deadline information registered in the master database (2023) in which the text data is reflected, the program described in Appendix 1. (Appendix 8) In the fourth step (S802), when the deadline arrives, notify the user, the program described in Appendix 7. (Appendix 9) In the fourth step (S802), a program described in Supplementary Note 7 that performs registration in the accounting system based on the amount information registered in the master database (2023) in which the text data is reflected. (Supplementary Note 10) An information processing apparatus including a processor (29) and memories (25, 26), wherein the memories (25, 26) store the invoice image data (2024) obtained by scanning an invoice in an unclassified state in a predetermined area, and text data obtained by reading the invoice image data by OCR processing in the past is registered as a master database (2023). The processor (29) reads the invoice image data (2024) stored in the predetermined area by OCR processing, and a first step of obtaining text data as a result of the reading; a second step (S703) of inferring whether or not the text data is registered in the master database (2023) based on the text data obtained as a result of the reading in the first step (S702), and determining whether or not it is necessary to reflect the text data in the master database (2023); a third step (S800, S801) of reflecting and registering the text data in the master database (2023) when it is determined in the second step (S703) that reflection in the master database (2023) is necessary; and a fourth step (S802) of presenting a predetermined service based on the master database (2023) reflected in the third step (S800, S801). (Supplementary Note 11) A method executed by a computer (20) comprising a processor (29) and memories (25, 26), wherein the memories (25, 26) store unclassified invoice image data (2024) scanned from an invoice in a predetermined area, and text data obtained by reading invoice image data by OCR processing in the past is registered as a master database (2023). The processor (29) performs a first step of reading the invoice image data (2024) stored in the predetermined area by OCR processing and obtaining text data as a result of the reading; a second step (S703) of inferring whether the text data is registered in the master database (2023) based on the text data obtained as a result of the reading in the first step (S702) and determining whether it is necessary to reflect the text data in the master database (2023); a third step (S800, S801) of reflecting and registering the text data in the master database (2023) when it is determined in the second step (S703) that reflection in the master database (2023) is necessary; and a fourth step (S802) of presenting a predetermined service based on the master database reflected in the third step (S800, S801).

Explanation of Signs

[0137] 1 Accounting system 10 10A, 10B Terminal device, 20 Server, 25 Memory, 29 Processor, 80 Network, 150 Display, 170 Storage unit, 180 Control unit, 202 Storage unit, 203 Control unit, 2021 Application program, 2022 Accounting basic DB, 2023 Master DB, 2024 Invoice image data, 2025 Client information DB, 2026 Teacher data, 2027 Learning model, 2033 Invoice image data registration module, 2034 Text data acquisition module, 2035 Master DB reflection determination module, 2036 Service presentation module, 2037 Presentation control module

Claims

1. A program for operating a computer comprising a processor and a memory, wherein the memory stores invoice image data obtained by scanning an invoice in an unclassified state in a predetermined area, and text data obtained by reading the invoice image data by OCR processing in the past is registered as a master database, the program causes the processor to perform a first step of reading the invoice image data stored in the predetermined area by OCR processing and obtaining text data as a result of the reading, perform a second step of inferring whether the text data is registered in the master database based on the text data obtained in the first step and determining whether it is necessary to reflect the text data in the master database, perform a third step of reflecting and registering the text data in the master database when it is determined in the second step that reflection in the master database is necessary, perform a fourth step of presenting a predetermined service based on the master database reflected in the third step and execute the program.

2. The program according to claim 1, wherein in the second step, when the text data is not registered in the master database, it is determined that new registration in the master database is necessary.

3. The program according to claim 2, wherein in the second step, when a predetermined item included in the text data does not match a predetermined item registered in the master database, it is determined that new registration in the master database is necessary.

4. The program according to claim 1, wherein in the second step, when the text data is registered in the master database, it is determined whether it is necessary to update the master database or whether reflection in the master database is unnecessary.

5. The program according to claim 4, wherein in the second step, when a predetermined item included in the text data does not match a predetermined item registered in the master database, it is determined that updating the master database is necessary.

6. The program according to claim 1, wherein in the second step, a machine learning model for inferring whether the text data is registered in the master database is used.

7. The program according to claim 1, wherein in the fourth step, expiration management is performed based on the expiration information registered in the master database in which the text data is reflected.

8. The program according to claim 7, wherein in the fourth step, when the expiration date arrives, a notification is sent to the user.

9. The program according to claim 7, wherein in the fourth step, registration to an accounting system is performed based on the amount information registered in the master database in which the text data is reflected.

10. An information processing apparatus comprising a processor and a memory, wherein the memory stores invoice image data obtained by scanning an invoice in an unclassified state in a predetermined area, and text data obtained by reading the invoice image data by OCR processing in the past is registered as a master database, the processor performs a first step of reading the invoice image data stored in the predetermined area by OCR processing and obtaining text data as a result of the reading, performs an inference as to whether the text data is registered in the master database based on the text data obtained as a result of the reading in the first step, and determines whether it is necessary to reflect the text data in the master database in a second step, performs a third step of reflecting and registering the text data in the master database when it is determined in the second step that reflection in the master database is necessary, and performs a fourth step of presenting a predetermined service based on the master database reflected in the third step An information processing apparatus that executes.

11. A method executed by a computer comprising a processor and a memory, wherein the memory stores invoice image data obtained by scanning an invoice in an unclassified state in a predetermined area, and text data obtained by reading the invoice image data by OCR processing in the past is registered as a master database, the processor A first step of reading the form image data stored in the predetermined area by OCR processing and obtaining text data as the result of the reading; A second step of inferring whether the text data is registered in the master database based on the text data which is the result of the reading in the first step, and determining whether it is necessary to reflect the text data in the master database; A third step of reflecting and registering the text data in the master database when it is determined in the second step that reflection in the master database is necessary; A fourth step of presenting a predetermined service based on the master database reflected in the third step; A method of executing.

Images