System and method for expense management using optical character recognition and computer program for the same

Abstract

An expense management system may include: a receiving module configured to receive evidence images related to expense expenditure from one or more devices associated with a user; a recognition module configured to extract text information including one or more items and the amount of each of the one or more items from the evidence images; and a classification module configured to generate expense application data for tax processing regarding expense expenditure based on the text information. In this case, the expense application data may include purchase history information generated based on the text information and including one or more purchased items and the purchase amount of each of the one or more purchased items, and tax information corresponding to the one or more purchased items. By using the expense management system, evidence data for expense expenditure, such as card receipts, is recognized using an Optical Character Recognition (OCR) function, and detailed purchased items are recognized to automatically input and convert the purchased items into data, and tax information, such as taxable / non-taxable / exempt classification for each purchased item, is provided together, thereby facilitating tax tasks such as VAT refunds.

Description

Technology Field

[0001] The embodiments relate to an expense management system and method and a computer program for the same. More specifically, the embodiments relate to a technology that facilitates the convenience of expense processing and simplifies tax processing, such as VAT refunds, by recognizing detailed purchase items of expenditure records from supporting data, such as card receipts, using Optical Character Recognition (OCR). Background Technology

[0002] Companies typically issue corporate cards or individual corporate cards to their employees for the convenience of expense execution. However, since it is not possible to issue corporate cards to all employees, those who have not been issued are required to use their personal cards to cover expenses and submit a corresponding expenditure resolution, along with supporting documents (e.g., receipts), to the company's expense processing manager.

[0003] For the processing of corporate expenses, the expense applicant or the person in charge of expense processing must prepare detailed purchase records corresponding to receipts. Traditionally, this preparation process was performed manually, but recently, advancements in Optical Character Recognition (OCR) technology have made it possible for computer systems to automatically recognize the contents of receipts. For example, Korean Patent Publication No. 10-2022-0003818 discloses a receipt reading system that converts receipt images into text using OCR technology, and an automated accounting receipt expense processing system equipped with such a system.

[0004] However, conventional technologies providing receipt OCR services, such as those disclosed in Korean Patent Publication No. 10-2022-0003818, are limited to recognizing representative items of a receipt—such as total purchase history, card information, and payment date and time—as text and displaying the recognized items. According to these conventional technologies, individual purchased items on a receipt cannot be converted into data. Consequently, when managers, such as those in charge of corporate expense processing, wish to verify purchased items, they face the difficulty of having to examine receipt images one by one and manually check and verify receipts from numerous users.

[0005] In addition, conventional technology cannot distinguish between taxable and non-taxable items among purchased items listed on receipts, so when processing tax matters regarding expense expenditures based on receipts, there has been a limitation in that the person in charge must individually check the receipts to record the purchased items and tax information. Prior art literature

[0006] Published Patent Application No. 10-2022-0003818 The problem to be solved

[0007] According to one aspect of the present invention, unlike conventional receipt Optical Character Recognition (OCR) services, an expense management system and method and a computer program for the same can be provided, which provide a higher level of convenience in receipt registration and expense processing tasks by recognizing detailed purchased items within a receipt and automatically converting the purchased items into data, and facilitate tax processing such as VAT refunds by providing tax information such as taxable items and non-taxable items together. means of solving the problem

[0008] An expense management system according to one aspect of the present invention comprises: a receiving module configured to receive evidence images related to expense expenditure from one or more devices related to a user; a recognition module configured to extract text information including one or more items and the amount of each of the one or more items from the evidence images; and a classification module configured to generate expense application data for tax processing regarding expense expenditure based on the text information. In this case, the expense application data is generated based on the text information and includes purchase history information including one or more purchased items and the purchase amount of each of the one or more purchased items, and tax information corresponding to the one or more purchased items.

[0009] In one embodiment, the tax information includes the tax classification of each of the one or more purchased items, and the value-added tax amount corresponding to the taxable item among the one or more purchased items.

[0010] An expense management system according to one embodiment further includes a user management module in which industry information corresponding to the user is stored. In this case, the classification module is further configured to determine the tax classification of each of the one or more purchased items or the value-added tax amount corresponding to each of the one or more purchased items based on the industry information.

[0011] An expense management system according to one embodiment further includes a verification module configured to verify one or more of the purchase history information and the tax information of the expense application data based on the text data.

[0012] In one embodiment, the text information includes a total usage amount extracted from the evidence image, and the verification module includes a purchase amount verification unit configured to verify whether the sum of the purchase amounts of the expense application data matches the total usage amount.

[0013] In one embodiment, the text information includes one or more of the total supply amount, total value-added tax amount, and tax-exempt amount extracted from the proof image, and the verification module includes a tax verification unit configured to verify one or more of the tax classification of each of the one or more purchased items and the value-added tax amount corresponding to the taxable item among the one or more purchased items based on the text information.

[0014] In one embodiment, the tax amount verification unit is further configured to verify whether the sum of the purchase amounts of taxable items among the one or more purchased items matches the total supply amount.

[0015] In one embodiment, the tax amount verification unit is further configured to verify whether the sum of the value-added tax amounts corresponding to taxable items among the one or more purchased items matches the total value-added tax amount.

[0016] In one embodiment, the tax amount verification unit is further configured to verify whether the sum of the purchase amounts of non-taxable items among the one or more purchased items matches the tax exemption amount.

[0017] An expense management method according to one aspect of the present invention comprises: a step in which an expense management system receives an evidence image associated with expense expenditure from one or more devices associated with a user; a step in which the expense management system extracts text information including one or more items and the amount of each of the one or more items from the evidence image; and a step in which the expense management system generates expense application data for tax processing regarding expense expenditure based on the text information.

[0018] An expense management method according to one embodiment further includes the step of the expense management system storing industry information corresponding to the user in the expense management system. At this time, the step of generating the expense application data includes the expense management system, and the classification module, determining one or more of the tax classification of each of the one or more purchased items and the value-added tax amount corresponding to each of the one or more purchased items based on the industry information.

[0019] An expense management method according to one embodiment further includes the step of the expense management system verifying one or more of the purchase history information and the tax information of the expense application data based on the text data.

[0020] In one embodiment, the text information includes the total usage amount extracted from the evidence image. In this case, the verification step includes the step of the expense management system verifying whether the sum of the purchase amounts of the expense application data matches the total usage amount.

[0021] In one embodiment, the text information includes the total supply amount extracted from the evidence image. The verification step includes the step of the expense management system verifying whether the sum of the purchase amounts of taxable items among the one or more purchased items matches the total supply amount.

[0022] In one embodiment, the text information includes the total value-added tax amount extracted from the evidence image. The verification step includes the step of the expense management system verifying whether the sum of the value-added tax amounts corresponding to taxable items among the one or more purchased items matches the total value-added tax amount.

[0023] In one embodiment, the text information includes a tax-exempt amount extracted from the evidence image. In this case, the verification step includes the step of the expense management system verifying whether the sum of the purchase amounts of non-taxable items among the one or more purchased items matches the tax-exempt amount.

[0024] A computer program according to one embodiment may be stored on a computer-readable medium for executing a security management method according to the embodiments described above, combined with hardware. Effects of the invention

[0025] According to an expense management system and method in one aspect of the present invention, by using an Optical Character Recognition (OCR) function to recognize supporting data for expense expenditures, such as card receipts, and by recognizing detailed purchased items within the supporting data to automatically input and convert the purchased items into data, a higher level of convenience can be provided for receipt registration and expense processing tasks.

[0026] In addition, by providing tax information, such as classification of taxable or non-taxable items for each purchased item, there is an advantage in that it facilitates tax work such as VAT refunds.

[0027] Furthermore, by providing a verification function for the total amount of purchased items, it is possible to enhance the convenience of expense processing for users applying for expense processing, and by preventing fraudulent or false entry of expenses, it offers the advantage of providing enhanced monitoring functions to administrators, such as those in charge of expense processing within a company. Brief explanation of the drawing

[0028] FIG. 1 is a schematic block diagram showing the configuration of a security management system according to one embodiment. FIG. 2 is a schematic block diagram showing the hardware configuration of a security management system according to one embodiment. FIG. 3 is a flowchart showing each step of an expense management method according to one embodiment. FIG. 4 is a conceptual diagram showing an exemplary user interface of a security management system according to one embodiment. FIG. 5 is a flowchart illustrating a verification process by an expense management method according to one embodiment. FIG. 6 is a conceptual diagram showing another exemplary user interface of a security management system according to one embodiment. Specific details for implementing the invention

[0029] Hereinafter, embodiments of the present invention will be examined in detail with reference to the drawings.

[0030] FIG. 1 is a schematic block diagram of a security management system according to one embodiment.

[0031] Referring to FIG. 1, the expense management system (2) according to the present embodiment may communicate and operate with a user device (1) of a user, such as an employee of a company, who applies for expense processing, via a wired and / or wireless network. In one embodiment, the expense management system (2) may further communicate and operate with an information provider server (4) that provides tax information, such as the National Tax Service’s hometax system, for the purpose of verifying tax information. In another embodiment, the expense management system (2) may further communicate and operate with an OCR server (3), which is an external service server that provides Optical Character Recognition (OCR) functions. Furthermore, in one embodiment, the expense management system (2) may further communicate and operate with a financial management server (not shown) of a user organization, such as a company.

[0032] Wired and / or wireless networks for communication between a security management system (2), a user device (1), an OCR server (3), and an information provider server (4) are LAN (Local Area Network), MAN (Metropolitan Area Network), GSM (Global System for Mobile Network), EDGE (Enhanced Data GSM Environment), HSDPA (High Speed ​​Downlink Packet Access), W-CDMA (Wideband Code Division Multiple Access), CDMA (Code Division Multiple Access), TDMA (Time Division Multiple Access), Bluetooth, Zigbee, Wi-Fi, VoIP (Voice over Internet Protocol), LTE Advanced, IEEE802.16m, WirelessMAN-Advanced, HSPA+, 3GPP Long Term Evolution (LTE), Mobile WiMAX (IEEE 802.16e), UMB (formerly EV-DO Rev. C), Flash-OFDM, iBurst, and MBWA (IEEE 802.20) systems, A communication network may be referred to by one or more communication methods selected from the group consisting of HIPERMAN, Beam-Division Multiple Access (BDMA), Wi-MAX (World Interoperability for Microwave Access), and ultrasonic communication, but is not limited thereto.

[0033] The expense management system (2) according to the embodiments may receive supporting data related to expenditure details for which expense processing is requested from a user device (1) used by employees of an enterprise, etc. For example, the supporting data may be an image of the user's card expenditure receipt, but is not limited thereto. Meanwhile, in another embodiment, the expense management system (2) may receive such supporting data from a financial management server (not shown) of a user organization such as an enterprise. For example, the financial management server may be a server corresponding to an Enterprise Resource Planning (ERP) system used by the user organization for purchasing and sales management or personnel management.

[0034] The number or form of the user device (1) shown in FIG. 1 is merely exemplary. For example, in FIG. 1, the user device (1) is shown in the form of a smartphone, but in other embodiments, the user device (1) may be implemented in the form of any computing device, such as a mobile communication terminal, a personal computer, a notebook computer, a PDA (personal digital assistant), a tablet, or a set-top box for IPTV (Internet Protocol Television).

[0035] The evidence data transmitted from the expense applicant to the expense management system (2) may be an image of a receipt (100) taken by the expense applicant when purchasing goods or services at a merchant (10) using cash or a card. The expense management system (2) according to the embodiments may extract information about the purchased items from the image of the receipt (100) using an OCR method. Additionally, the expense management system (2) may generate expense application data including tax information for each purchased item based on information previously stored in the expense management system (2) or information received from the information provider server (4).

[0036] In one embodiment, the expense management system (2) includes a receiving module (21), a recognition module (22), and a classification module (23). In one embodiment, the expense management system (2) further includes a user management module (24). Furthermore, in one embodiment, the expense management system (2) further includes a verification module (25). The verification module (25) may include a purchase amount verification unit (251) and / or a tax amount verification unit (252). Meanwhile, each of these units or modules (21-25) may be realized by utilizing at least partially the hardware of the expense management system (2).

[0037] That is, the expense management system (2) according to the embodiments and each unit or module (21-25) included therein may have aspects that are entirely hardware or partially hardware and partially software. For example, each unit and module (21-25) of the expense management system (2) may collectively refer to hardware and related software for processing data of a specific format and content or / or exchanging it via electronic communication. In this specification, terms such as “unit,” “module,” “device,” “terminal,” “server,” or “system” are intended to refer to a combination of hardware and software driven by said hardware. For example, the hardware may be a data processing device including a CPU or other processor. Additionally, the software driven by the hardware may refer to a running process, object, executable file, thread of execution, program, etc.

[0038] Additionally, each element constituting the security management system (2) is not intended to refer to a separate device that is physically separated from one another. That is, the parts and modules (21-25) of the security management system (2) illustrated in FIG. 1 are merely functionally separated hardware constituting the security management system (2) according to the operation performed by the hardware, and each part must not necessarily be provided independently of each other. Of course, depending on the embodiment, it is possible for one or more of the aforementioned parts and modules (21-25) to be implemented as separate devices that are physically separated from one another.

[0039] The receiving module (21) can receive proof images, such as a captured image of a receipt (100), from one or more devices related to the user who is the expense applicant. For example, the receiving module (21) can receive an image of a receipt (100) from a user device (1) used by the expense applicant, or receive a proof image from a server (not shown) of a user organization, such as a company corresponding to the expense applicant.

[0040] The recognition module (22) is configured to recognize one or more items corresponding to the expense applicant's purchase history and the amount of each of these items from the proof image by extracting text information from the proof image using an OCR method. In one embodiment, the recognition module (22) may also obtain text information through communication with the OCR server (3).

[0041] The classification module (23) is configured to generate expense application data for tax processing regarding the expense applicant's expenditure details based on text information recognized by the recognition module (22) using an OCR method. In this specification, tax processing refers to the process of calculating part or all of the amount spent using cash, the expense applicant's personal card, or the corporate card of the corporation to which the expense applicant belongs, as business expenses of the user institution when calculating taxes to be paid by the user institution.

[0042] At this time, the expense management system (2) according to the embodiments is differentiated from conventional receipt OCR services in that the recognition module (22) recognizes one or more purchased items and the purchase amount of each of these purchased items within the proof image, and the classification module (23) generates tax information corresponding to each purchased item, and this information constitutes expense application data. For example, the tax information corresponding to each purchased item may include the tax classification of each purchased item and / or the value-added tax amount of the taxable item among the purchased items (hereinafter also referred to as VAT).

[0043] In order to derive tax information corresponding to each purchased item, industry information corresponding to the user may be stored in the user management module (24) of the expense management system (2). Industry information corresponding to the user refers to industry information of a user organization, such as a company to which the user, who is the expense applicant, belongs. In addition, in one embodiment, the receiving module (21) may obtain industry information from an information provider server (4), such as the National Tax Service Home Tax System, and store it in the user management module (24).

[0044] In one embodiment, the verification module (25) of the expense management system (2) can verify the purchase history and / or tax information of the expense application data generated in correspondence with the image of the receipt (100).

[0045] In one embodiment, the purchase amount verification unit (251) of the verification module (25) can verify whether the sum of the purchase amounts of the expense application data generated by recognizing the purchased items using an OCR method, based on the total amount of use recognized from the image of the receipt (100), matches the total amount of use on the receipt (100).

[0046] In addition, in one embodiment, the tax verification unit (252) of the verification module (25) can perform verification of tax information of the expense application data, such as the tax classification and / or value-added tax amount for each purchased item.

[0047] For example, the tax verification unit (252) can calculate the sum of the purchase amounts of taxable items among the purchase items of the expense application data and verify whether the calculated sum matches the supply amount recognized from the receipt (100) image. As another example, the tax verification unit (252) can calculate the sum of the value-added tax on taxable items among the purchase items of the expense application data and verify whether the calculated sum matches the value-added tax recognized from the receipt (100) image. As yet another example, the tax verification unit (252) can calculate the sum of the purchase amounts of non-taxable items among the purchase items of the expense application data and verify whether the calculated sum matches the tax-exempt amount recognized from the receipt (100) image.

[0048] In the embodiment illustrated in FIG. 1, the expense management system (2) is illustrated in the form of a server communicating with a user device (1), but in other embodiments, the expense management system (2) itself may be implemented in the form of a computing device, such as a smartphone, used by the expense applicant. For example, the user may directly photograph the receipt (100) and generate expense application data using the expense management system (2) implemented in the form of a smartphone, and in this case, the user device (1) illustrated in FIG. 1 may be omitted.

[0049] The specific process for generating and verifying expense application data by the expense management system (2) according to the embodiments will be described in detail later with reference to FIGS. 3 to 6.

[0050] FIG. 2 is a schematic block diagram showing the hardware configuration of a security management system according to one embodiment.

[0051] Referring to FIG. 2, the security management system according to the embodiments is implemented in the form of a computing device including hardware (200) and may include memory (210), a processor (220), a communication module (230), and an input / output unit (240).

[0052] The memory (210) is a non-transient computer-readable recording medium and may include a permanent mass storage device such as RAM (random access memory), ROM (read only memory), disk drive, SSD (solid state drive), flash memory, etc. Here, the permanent mass storage device such as ROM, SSD, flash memory, disk drive, etc. may be included in the device or server described above as a separate permanent storage device distinct from the memory (210).

[0053] Additionally, the memory (210) may store an operating system and at least one program code (e.g., code for a security module or an application installed to provide a specific service). These software components may be loaded from a computer-readable recording medium separate from the memory (210). This separate computer-readable recording medium may include a computer-readable recording medium such as a floppy drive, disk, tape, DVD / CD-ROM drive, or memory card.

[0054] In another embodiment, software components may be loaded into memory (210) via a communication module (230) rather than a computer-readable recording medium. For example, at least one program may be loaded into memory (210) based on a computer program installed by files provided over a network by developers or a file distribution system (e.g., an application store service server) that distributes installation files for applications.

[0055] The processor (220) may be configured to process instructions of a computer program by performing basic arithmetic, logic, and input / output operations. Instructions may be provided to the processor (220) by memory (210) or a communication module (230). For example, the processor (220) may be configured to execute instructions received according to program code stored in a recording device such as memory (210).

[0056] The communication module (230) can provide a function for the security management system (2) to communicate with a user device (1), an OCR server (3), and / or an information provider server (4), etc., via a network. Additionally, the communication module (230) can provide a function for the security management system (2) to communicate with one or more other devices via a wired and / or wireless network. That is, the communication module (230) is a part that realizes each of the function modules described above with reference to FIG. 1, by controlling its function by a processor (220) that references memory (210).

[0057] The input / output unit (240) may be a means for interfacing with an external input / output device (not shown). For example, the external input device may include devices such as a keyboard, mouse, microphone, camera, etc., and the external output device may include devices such as a display, speaker, haptic feedback device, etc. As another example, the input / output unit (240) may be a means for interfacing with a device in which the functions for input and output are integrated into one, such as a touchscreen.

[0058] Additionally, in other embodiments, the security management system (2) may include more hardware components than those shown in FIG. 2 depending on the nature of the device to which it is applied. For example, when the security management system (2) is applied to a terminal device used by a user, it may be implemented to include at least some of the input / output devices described above, or it may include additional components such as a transceiver, a GPS (Global Positioning System) module, a camera, various sensors, a database, etc. As a more specific example, when the terminal device is a smartphone, it may be implemented to include additional components such as an accelerometer or gyroscope sensor, a camera module, various physical buttons, buttons using a touch panel, input / output ports, and a vibrator for vibration, which are generally included in smartphones.

[0059] The expense management method described below may be performed by an expense management system implemented in the form of a computing device including the hardware (200) configuration described above with reference to FIG. 2. As an example, the expense management method may be provided to a user in the form of a service based on at least one of an application, software, and other programs that operates based on a user device and / or a server.

[0060] FIG. 3 is a flowchart showing each step of an expense management method according to one embodiment.

[0061] Referring to FIG. 3, an expense applicant who wishes to apply for a refund for expenses incurred using cash or cards, etc., can first use a user device (1) to take an image of evidence data such as a receipt for the expense (S11).

[0062] An expense management system (2) according to one embodiment can receive proof images from a user device (1) via a communication method through a network (S12). For example, the above operation is performed using an application (or app) running on a user device (1), such as a user's mobile device, and the expense management system (2) can function as an application service server that enables the operation of such an application.

[0063] However, this is exemplary, and in other embodiments, the expense management system (2) may be a web server that provides a web page, etc., through which a user can upload proof images, and may be configured to communicate with a user device (1) through said web page. Furthermore, in other embodiments, the expense management system (2) itself may be implemented in the form of a computing device used by a user, in which case step S12 shown in FIG. 1 may be omitted.

[0064] The expense management system (2) can extract text information from the proof image using an OCR method. Additionally, the expense management system (3) may store the proof image in the expense management system (2) for storage. The text information extracted from the proof image may include one or more items corresponding to the purchase history of the image and their amounts.

[0065] In the embodiment illustrated in FIG. 3, the expense management system (2) extracts text information from an evidence image through an OCR server (3) of an external service provider that provides an OCR function. That is, the expense management system (2) transmits the evidence image to the OCR server (3) (S13) and receives text information as a response to the image from the OCR server (3) (S14). However, this is exemplary, and in other embodiments, the expense management system (2) may be configured to perform the OCR function for extracting text information from an image itself.

[0066] When text information corresponding to the proof image is obtained, the expense management system (2) can generate expense application data by determining one or more purchased items and their purchase amounts based on this text information. For example, one or more purchased items may refer to some or all of the items listed on the receipt, and the purchase amount of each purchased item may refer to the amount of each item listed on the receipt.

[0067] At this time, the expense management system (2) according to the embodiments can automatically generate tax information to constitute expense application data by classifying the tax type of each purchased item based on the industry information of the user organization (e.g., company) corresponding to the user (S15).

[0068] In one embodiment, the expense management system (2) may further perform verification of whether the expense application data was generated normally by comparing the sum of the purchase amounts of the generated expense application data with the total usage amount on the proof image (S16). This operation will be described in detail below with reference to FIG. 4.

[0069] FIG. 4 is a conceptual diagram showing an exemplary user interface (UI) of a security management system according to one embodiment.

[0070] Referring to FIG. 4, the expense management system according to the present embodiment can recognize text information from an image of a receipt (110) on the left side of the drawing and generate expense application data as shown in the area (200) on the right side of the drawing. At this time, the item area (210) of the expense application data may include one or more purchased items (211) corresponding to each item of the text information and the purchase amount (214) of each purchased item. In one embodiment, the purchase amount (214) may be calculated through the unit price (212) and quantity (213) of each purchased item.

[0071] In addition, the expense application data includes tax information (215) indicating the tax classification of each of one or more purchased items. The tax information (215) refers to information classifying the tax type of each purchased item as taxable or non-taxable depending on whether the purchased item can be recognized as a business expense in the expense processing of the user enterprise corresponding to the expense applicant. By automatically generating this tax information (210) based on the industry information of the user institution, the tax processing of the user institution can be facilitated.

[0072] More specifically, the classification module (23; FIG. 1) of the expense management system stores a database that matches pre-set industry classification information with the names of taxable purchase items and / or non-taxable purchase items, and based on this database and the industry information of the user institution, it can determine whether a specific purchase item is a taxable item or a non-taxable item in the industry corresponding to the user institution.

[0073] For example, when a corporate user purchases goods or receives services related to its business scope, the costs incurred for such goods or services can be deducted from the output tax as input tax when paying value-added tax. Furthermore, even if a company purchases goods exempt from value-added tax and thus has no input tax, in certain cases—such as in the food service or restaurant industries—a certain amount calculated by deeming that a specific input tax is included in the purchase price can be deducted from the output tax as deemed input tax. For instance, assuming a case where a company purchases items unrelated to its business scope, such as rice, a TV, or a notebook, using a corporate credit card, it is possible to deduct the deemed input tax for the purchase of rice where the merchant's business type is food service or a restaurant.

[0074] At this time, the classification module (23; FIG. 1) can provide tax information (210) for a purchased item to the user by determining, based on the business type of the company and / or the business type information of the franchisee (10), whether each purchased item is related to the business scope of the company and is eligible for input tax deduction or / also whether each purchased item is eligible for deemed input tax deduction. In the example illustrated in FIG. 5, the tax information (210) being marked as 'taxable' means that the purchased item is eligible for input tax deduction or deemed input tax deduction.

[0075] As another example, the classification of whether a purchased item is taxable or non-taxable by the classification module may be performed by a machine learning-based classification method rather than a fixed database. For example, the classification module includes an analysis model trained using training data in which the business operator's industry, the item name of the purchased item, and the tax type of the item are labeled. When a new purchased item is recognized, the tax type of the purchased item may be classified as taxable or non-taxable by applying the business operator's industry information and the item name of the purchased item as input data to this analysis model.

[0076] Meanwhile, the expense application data may include usage information (240) corresponding to the merchant information of the receipt (110). Additionally, the expense application data may include a usage amount (220) derived from the sum of each purchase amount listed in the item area (210), and a supply amount (230) derived from the sum of taxable items among each purchased item. The display form of the expense application data illustrated in the drawing is merely exemplary, and the display method of the expense application data according to the embodiments is not limited thereto.

[0077] In one embodiment, the expense management system may generate expense application data by recognizing each purchased item and determining tax information, and then perform verification on whether the total amount used (220), which corresponds to the sum of the purchase amounts of each purchased item in the expense application data, matches the total amount used on the receipt (110) (89,000 won in the example of the drawing).

[0078] Referring again to FIG. 3, the expense management system (2) is created as described above and can transmit expense application data, including one or more purchased items, their purchase amounts and tax information, to a user device (1) for verification by the expense applicant (S17).

[0079] The user checks the contents of the automatically generated expense application data (S18), and if there are no issues, transmits the corresponding response to the expense management system (2) to apply for expense processing corresponding to the expense application data (S19). At this time, an expense application means an application for the user's affiliated organization, such as a company, to refund the amount spent by the user in cash or by card to the user. The user organization refunds the amount for which the expense application is approved to the user, and when filing the user organization's tax return, the amount is calculated as an expense incurred for the business to calculate the user organization's profit, etc.

[0080] In one embodiment, the expense management system (2) may be configured to further transmit expense application data, for which an expense application has been made from a user device (1), to a user device (not shown) of a manager, such as an accounting officer of an institution, or to a financial management server (not shown), such as an ERP system of a company.

[0081] FIG. 5 is a flowchart illustrating a verification process by an expense management method according to one embodiment.

[0082] Referring to FIG. 5, in this embodiment, the expense management system (2) may store industry information corresponding to the user for tax classification of purchased items (S22). Industry information corresponding to the user refers to the industry on the business registration information of the user institution, such as the company to which the user belongs. For example, the expense management system (2) may receive such industry information from the user or the manager of the relevant user institution. Alternatively, the expense management system (2) may query the industry information of the user institution from an information provider server (4), such as the National Tax Service Home Tax System, based on the identification information of the user institution (e.g., business registration number) entered into the expense management system (2) (S21).

[0083] The expense management system (2) receives proof images, such as receipt images, from the user device (1) of the user who is the expense applicant (S23), recognizes each purchased item from the proof images, and can proceed with tax classification of each purchased item based on the aforementioned industry information (S24). Since this is identical to the corresponding process of the embodiment described above with reference to FIGS. 3 and 4, a detailed explanation is omitted.

[0084] Meanwhile, in this embodiment, the expense management system (2) can verify the supply amount, value-added tax and / or tax-exempt amount of one or more purchased items based on the tax information of each purchased item (S25). This verification process can be performed by comparing the relevant information on the expense application data, which is automatically generated through tax classification by item, with the relevant item in the receipt image, and will be explained in detail below with reference to FIG. 6.

[0085] FIG. 6 is a conceptual diagram showing another exemplary UI of a security management system according to one embodiment.

[0086] Referring to FIG. 6, the expense application data (300) generated by recognizing text information from an image of a receipt (120) may include an item area (310) containing a purchased item (311), unit price (312), quantity (313), purchase amount (314), and tax information (315), as well as a total usage amount (320) in which the purchase amounts of each purchased item are summed, a supply amount (330) in which the purchase amounts of taxable items among each purchased item are summed, a value-added tax (340) in which the value-added tax of taxable items among each purchased item is summed, and a tax-exempt amount (350) in which the purchase amounts of non-taxable items among each purchased item are summed.

[0087] At this time, the expense management system can perform verification on whether the supply amount (330), value-added tax (340), and tax-exempt amount (350) on the expense application data match the supply price, value-added tax, and tax-exempt amount on the receipt (120), respectively. Additionally, the expense management system can perform verification on whether the usage amount (320), which is the sum of the purchase amounts (314), matches the total sales amount (or total purchase amount, etc.) on the receipt (120).

[0088] Referring again to FIG. 5, the expense management system (2) can transmit verified expense application data to the user device (1) for user confirmation and expense application (S26). At this time, the expense management system (2) can generate expense application data to display the results of the aforementioned verification separately to the user by referring to FIG. 4 or FIG. 6 (S27).

[0089] For example, if the total purchase amount does not match the total usage amount on the receipt, if the total purchase amount of taxable goods does not match the supply amount on the receipt, if the total value-added tax on taxable goods does not match the value-added tax on the receipt, or if the total purchase amount of tax-exempt goods does not match the tax-exempt amount on the receipt, the expense application data can be provided to the user device (1) to display items with such discrepancies in information in the list of purchased items using a separate font, color, or other UI element.

[0090] The operation of the expense management method according to the embodiments described above may be implemented at least partially as a computer program and recorded on a computer-readable recording medium. A computer-readable recording medium on which a program for implementing the operation of the expense management method according to the embodiments is recorded includes all types of recording devices in which data readable by a computer is stored. Examples of computer-readable recording media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc. Additionally, the computer-readable recording medium may be distributed across networked computer systems, and computer-readable code may be stored and executed in a distributed manner. Furthermore, the functional programs, codes, and code segments for implementing the present embodiment will be easily understood by a person skilled in the art to which the present embodiment belongs.

[0091] The present invention described above has been explained with reference to the embodiments illustrated in the drawings, but this is merely illustrative and those skilled in the art will understand that various modifications and variations of the embodiments are possible therefrom. However, such modifications should be considered to be within the technical scope of protection of the present invention. Accordingly, the true technical scope of protection of the present invention should be determined by the technical spirit of the appended claims.

Claims

Claim 1 As an expense management system, a receiving module configured to receive evidence images related to expense expenditures and identification information of a user agency corresponding to the user from one or more devices related to the user, and to obtain industry information corresponding to the user from an information provider server using the identification information of the user agency; a recognition module configured to extract text information including one or more items and the amount of each of the one or more items from the evidence images; a classification module configured to generate expense application data for tax processing regarding expense expenditures based on the text information; and a user management module storing industry information corresponding to the user. and includes a verification module configured to verify purchase history information and tax information of the expense application data based on the text information, wherein the expense application data is generated based on the text information and includes purchase history information including one or more purchased items and the purchase amount of each of the one or more purchased items, and tax information corresponding to the one or more purchased items, wherein the tax information includes the tax classification of each of the one or more purchased items and the value-added tax amount corresponding to the taxable item among the one or more purchased items, and the classification module determines whether each of the one or more purchased items is related to the business scope of the user and is eligible for input tax or deemed input tax deduction based on the industry information, and determines the value-added tax amount corresponding to the purchased items based on the determination of whether each of the one or more purchased items is eligible for input tax or deemed input tax deduction, and includes a machine learning-based analysis model trained using training data in which the business operator's industry, the item names of the purchased items, and the tax type of each item are labeled.The system is further configured to classify the taxation type of each of the one or more purchased items as taxable or non-taxable by using the above-mentioned industry information and the item names of the one or more purchased items as input data for the above-mentioned analysis model, and the above-mentioned text information includes the total supply amount, total value-added tax amount, tax-exempt amount, and total usage amount extracted from the above-mentioned proof image; the verification module is further configured to verify whether the sum of the purchase amounts of taxable items among the one or more purchased items in the expense application data, the sum of the value-added tax amounts corresponding to the taxable items, and the sum of the purchase amounts of non-taxable items among the one or more purchased items match the total supply amount, total value-added tax amount, and tax-exempt amount extracted from the above-mentioned proof image, respectively, and includes a purchase amount verification unit further configured to verify whether the sum of the purchase amounts in the expense application data matches the total usage amount; the expense management system provides the expense application data to one or more devices related to the user, wherein the sum of the purchase amounts of taxable items among the one or more purchased items in the expense application data, the sum of the value-added tax amounts corresponding to the taxable items, and the above An expense management system further configured to provide expense application data by displaying, using preset fonts, colors, or user interface elements, items among the purchase amounts of non-taxable items among one or more purchased items that do not match the corresponding information items of the text information, and to receive a response requesting expense processing corresponding to the expense application data from one or more devices associated with the user. Claim 2 delete Claim 3 delete Claim 4 delete Claim 5 delete Claim 6 delete Claim 7 delete Claim 8 delete Claim 9 delete Claim 10 As an expense management method, the expense management system receives evidence images related to expense expenditure and identification information of a user agency corresponding to the user from one or more devices related to the user; the expense management system obtains industry information corresponding to the user from an information provider server using the identification information of the user agency; the expense management system stores the industry information corresponding to the user in the expense management system; and the expense management system extracts text information including one or more items and the amount of each of the one or more items from the evidence images. The expense management system comprises the step of generating expense application data for tax processing regarding expense expenditure based on the text information, wherein the expense application data is generated based on the text information and includes purchase history information including one or more purchased items and the purchase amount of each of the one or more purchased items, and tax information corresponding to the one or more purchased items, wherein the tax information includes the tax classification of each of the one or more purchased items and the value-added tax amount corresponding to the taxable item among the one or more purchased items, and the step of generating the expense application data comprises the step of the expense management system determining one or more of the tax classification of each of the one or more purchased items and the value-added tax amount corresponding to each of the one or more purchased items based on the industry information, and the expense management method further comprises the step of the expense management system verifying the purchase history information and the tax information of the expense application data based on the text information, wherein the expense management system includes a machine learning-based analysis model trained using training data in which the business operator's industry, the item names of the purchased items, and the tax type of each item are labeled.The step of determining one or more of the tax classification of each of the one or more purchased items and the value-added tax amount corresponding to each of the one or more purchased items comprises the step of the expense management system classifying the tax type of each of the one or more purchased items as taxable or non-taxable by using the industry information and the item name of the one or more purchased items as input data for the analysis model, wherein the text information includes the total supply amount, total value-added tax amount and tax-exempt amount, and total usage amount extracted from the evidence image, and the verification step comprises the step of the expense management system verifying whether the sum of the purchase amounts of taxable items among the one or more purchased items in the expense application data, the sum of the value-added tax amounts corresponding to the taxable items, and the sum of the purchase amounts of non-taxable items among the one or more purchased items match the total supply amount, total value-added tax amount, and tax-exempt amount extracted from the evidence image, respectively. The expense management system comprises the step of verifying whether the sum of the purchase amounts of the expense application data matches the total usage amount, and the expense management method comprises the step of the expense management system providing the expense application data to one or more devices related to the user, wherein the expense application data is provided by displaying, by means of a preset font, color, or user interface element, items that do not match the corresponding information items of the text information among the sum of the purchase amounts of taxable items among the one or more purchased items of the expense application data, the sum of the value-added tax amounts corresponding to the taxable items, and the purchase amounts of non-taxable items among the one or more purchased items; and the expense management system further comprises the step of receiving a response from one or more devices related to the user requesting expense processing corresponding to the expense application data. Claim 11 delete Claim 12 delete Claim 13 delete Claim 14 delete Claim 15 delete Claim 16 delete Claim 17 delete Claim 18 A computer program stored on a computer-readable recording medium to be combined with hardware to execute the expense management method under Paragraph 10..

Images