Automatic accounting method and system

Abstract

The present invention discloses an automatic accounting method and system, and relates to the field of accounting technology. The automatic accounting method comprises: monitoring the payment operation of the user; obtaining the payment page when the user pays successfully; extracting the accounting data according to the payment page; and recording the account book information on the accounting page according to the accounting data. The automatic accounting method according to the embodiment of the present invention can simplify the accounting process, encourage more users to continue to use the accounting software, and then develop good consumption habits; decouple from the third-party accounting software and payment software, and be compatible with the usage habits of different users; no third-party accounting software and payment software need to be changed or provide an interface, and the interaction of the two-party data is realized in a non-invasive manner; the code is modularized, and each module can be expanded to adapt to changing needs.

Description

Technical Field

[0001] The present invention relates to the technical field of bookkeeping, and in particular to an automatic bookkeeping method and system. Background Art

[0002] As online payment becomes more and more convenient, many softwares have built-in payment functions. As payment channels increase, the accounting software in mobile phones also relies more on manual registration of each expenditure record to accurately count, which brings inconvenience to users.

[0003] At present, in order to improve the convenience and accuracy of accounting software, the method adopted is: the accounting software manufacturer cooperates with the payment channel to regularly or manually read and import the payment data of the payment channel into the accounting software through the data interface. This solution has the following problems:

[0004] 1. It relies on the data cooperation between accounting software manufacturers and payment channels. This process involves business issues and data security issues. Even most payment software does not open payment data reading interfaces to third-party manufacturers for data security reasons. Therefore, this solution has great limitations.

[0005] 2. For ordinary mobile phone users, there are multiple options for both accounting software and payment software. It is difficult to completely and quickly solve the data heterogeneity problem between the two types of software by relying solely on cooperation agreements between manufacturers. Summary of the invention

[0006] The present invention aims to solve at least one of the technical problems existing in the prior art. To this end, the present invention proposes an automatic accounting method and system, which can improve the convenience of accounting.

[0007] In a first aspect, an automatic accounting method according to an embodiment of the present invention is applied to automatic accounting software, and the automatic accounting method comprises the following steps:

[0008] Monitor the user's payment operations;

[0009] When the user pays successfully, get the payment page;

[0010] Extracting accounting data according to the payment page;

[0011] According to the accounting data, the account book information is recorded on the accounting page.

[0012] According to some embodiments of the present invention, the automatic accounting software is provided with a monitoring module; the step of monitoring the payment operation of the user comprises:

[0013] Monitor the current foreground application through the monitoring module;

[0014] When the foreground application is a payment channel application that the automatic accounting software supports identification and processing, model identification is performed on the page of the foreground application.

[0015] According to some embodiments of the present invention, the step of monitoring the current foreground application by the monitoring module includes:

[0016] Get the list of apps through the usage statistics service;

[0017] The application list is arranged according to the most recent use time, and the application with the most recent use time is obtained as the current foreground application.

[0018] According to some embodiments of the present invention, when the foreground application is a payment channel application that the automatic accounting software supports identification processing, the step of performing model identification on the page of the foreground application includes:

[0019] Use the MediaProjection API to monitor the current screen content in real time and pass it to the YOLO model built into the automatic accounting software;

[0020] The YOLO model is used to perform feature recognition and classification recognition on the current screen content to determine whether the current screen content is a payment page.

[0021] According to some embodiments of the present invention, the automatic accounting software is provided with an identification module; the step of obtaining the payment page when the user pays successfully includes:

[0022] When the payment result page appears in the current foreground application, take a screenshot to obtain the payment page;

[0023] The payment page is sent to the identification module.

[0024] According to some embodiments of the present invention, the step of extracting payment information according to the payment page includes:

[0025] The recognition module performs text recognition on the payment page through OCR technology;

[0026] The identification module converts the unstructured data of the payment page into structured data to obtain accounting data.

[0027] According to some embodiments of the present invention, after the step of extracting accounting data according to the payment page, the step further includes:

[0028] When the accounting data is missing or the identification module has an identification anomaly, the automatic accounting software will pop up a window to prompt;

[0029] The automatic accounting software records the abnormal operation log and returns to the background to continue monitoring.

[0030] According to some embodiments of the present invention, the automatic accounting software further includes a processing module and a reporting module; after the step of extracting accounting data according to the payment page, it also includes:

[0031] The processing module performs at least one processing operation of removing spaces, converting dates, converting full-width and half-width characters, and removing unnecessary information on the accounting data;

[0032] The processing module obtains the time when the payment behavior occurs, and sends the processed accounting data and the time when the payment behavior occurs to the reporting module.

[0033] According to some embodiments of the present invention, the step of recording the account book information on the accounting page according to the accounting data includes:

[0034] Binding the automatic accounting software to a third-party accounting software;

[0035] The reporting module calls the third-party accounting software to the front desk;

[0036] According to the operating logic of the third-party accounting software, the processed accounting data is filled into the accounting page through RPA technology to obtain the account book information.

[0037] In a second aspect, an automatic accounting system according to an embodiment of the present invention includes:

[0038] The monitoring module is used to monitor the user's payment operation and obtain the payment page when the user pays successfully;

[0039] An identification module, used to extract accounting data according to the payment page;

[0040] The reporting module is used to record the account book information on the accounting page according to the accounting data.

[0041] The automatic accounting method and system according to the embodiments of the present invention have at least the following beneficial effects: the accounting process can be simplified, so that more users can continue to use the accounting software and thus develop good consumption habits; it is decoupled from third-party accounting software and payment software, and can be compatible with the usage habits of different users; there is no need for third-party accounting software and payment software to be modified or to provide interfaces, and the interaction of data between the two parties is achieved in a non-invasive manner; the code is modularized, and each module can be expanded to adapt to changing needs.

[0042] Additional aspects and advantages of the present invention will be given in part in the following description and in part will be obvious from the following description, or will be learned through practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] The above and / or additional aspects and advantages of the present invention will become apparent and easily understood from the description of the embodiments in conjunction with the following drawings, in which:

[0044] Figure 1 A flowchart of the steps of the automatic accounting method according to an embodiment of the present invention;

[0045] Figure 2 A schematic diagram of the process of the automatic accounting software according to an embodiment of the present invention;

[0046] Figure 3 1 is a schematic diagram of the home page of the third-party accounting software A according to an embodiment of the present invention;

[0047] Figure 4 is a schematic diagram of an accounting page of third-party accounting software A according to an embodiment of the present invention;

[0048] Figure 5 Schematic diagram of the home page of third-party accounting software B in an embodiment of the present invention;

[0049] Figure 6 is a schematic diagram of an accounting page of a third-party accounting software B according to an embodiment of the present invention;

[0050] Figure 7 It is a complete flow chart of the automatic accounting method according to an embodiment of the present invention. DETAILED DESCRIPTION

[0051] Embodiments of the present invention are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present application, and are not to be construed as limitations on the present application. For the step numbers in the following embodiments, they are only provided for the convenience of explanation, and the order between the steps is not limited in any way, and the execution order of each step in the embodiment can be adaptively adjusted according to the understanding of those skilled in the art.

[0052] In the description of the present invention, it should be understood that descriptions involving orientations, such as up, down, front, back, left, right, etc., and orientations or positional relationships indicated are based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as a limitation on the present invention.

[0053] The terms "first", "second", "third" and "fourth" etc. in the specification and claims of the present invention and the drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units that are not listed, or may optionally include other steps or units that are inherent to these processes, methods, products or devices.

[0054] Reference to "embodiments" in the present invention means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present invention. The appearance of the phrase in various places in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0055] As online payment becomes more and more convenient, many softwares have built-in payment functions. As payment channels increase, the accounting software in mobile phones also relies more on manual registration of each expenditure record to accurately count, which brings inconvenience to users.

[0056] At present, in order to improve the convenience and accuracy of accounting software, the method adopted is: the accounting software manufacturer cooperates with the payment channel to regularly or manually read and import the payment data of the payment channel into the accounting software through the data interface. This solution has the following problems:

[0057] 1. It relies on the data cooperation between accounting software manufacturers and payment channels. This process involves business issues and data security issues. Even most payment software does not open payment data reading interfaces to third-party manufacturers for data security reasons. Therefore, this solution has great limitations.

[0058] 2. For ordinary mobile phone users, there are multiple options for both accounting software and payment software. It is difficult to completely and quickly solve the data heterogeneity problem between the two types of software by relying solely on cooperation agreements between manufacturers.

[0059] In order to solve the above problems, this application proposes an automatic accounting method and system based on RPA technology + OCR technology, which realizes automatic accounting without the need for modification of payment software and accounting software and without data docking, solves the heterogeneous gap between the two types of APPs, and provides convenience for users.

[0060] RPA technology (Robotic process automation) refers to robotic process automation. RPA can simulate various human operations and can perform automated operations such as mouse clicks, keyboard input, and information reading on any application, freeing people from non-subjective decision-making, highly logical, and highly regular work. OCR (Optical Character Recognition) technology refers to the process in which an electronic device (such as a scanner or digital camera) checks the characters printed on paper, determines their shape by detecting dark and light patterns, and then uses character recognition methods to translate the shape into computer text; that is, for printed characters, optically converts the text in a paper document into a black and white dot matrix image file, and uses recognition software to convert the text in the image into text format for further editing and processing by word processing software.

[0061] On the one hand, the embodiment of the present invention provides an automatic accounting method, which is applied to automatic accounting software, such as Figure 1 As shown, the method includes:

[0062] Step S100: monitoring the user's payment operation;

[0063] Step S200: When the user pays successfully, obtain the payment page;

[0064] Step S300: extract accounting data according to the payment page;

[0065] Step S400: Record the account book information on the accounting page according to the accounting data.

[0066] Specifically, in this application, RPA+OCR is used as the technical basis to develop automatic accounting software for mobile phones. The automatic accounting software monitors the user's payment operation, and when the user pays successfully and the success result page appears, the automatic accounting function is automatically triggered (it can also be in the form of a floating window for the user to trigger manually). The automatic accounting function uses RPA technology to take a screenshot of the payment page, and then uses OCR technology to perform text recognition on the screenshot of the payment page, extract payment amount, time, transaction party and other accounting data, and then uses RPA technology to automatically open the accounting page of the automatic accounting software or the accounting page of a third-party accounting software, and enter the expenditure data on the accounting page to record the account book information.

[0067] It should be noted that the automatic accounting software exists independently and is not limited by the type of third-party accounting software installed in the mobile phone and the type of payment software used for expenditure transactions. The automatic entry (accounting) operation of common third-party accounting software will be implemented by RPA automated entry scripts, and it also supports the automatic entry of expenditure and income scenarios. The automatic accounting software will have a built-in RPA script engine to support the operation of automated entry scripts in the mobile phone system. Users can develop and configure scripts by themselves, and import and export automated scripts in the APP.

[0068] like Figure 2 As shown, in some embodiments of the present application, the automatic accounting software module includes a monitoring module 100, an identification module 200, a processing module 300 and a reporting module 300. Among them:

[0069] Monitoring module 100: responsible for monitoring the user's current foreground application name and application payment success page. For the payment success page, the target detection algorithm YOLO is used to realize model recognition of the payment success page of common payment apps such as WeChat, Alipay, Douyin, and Meituan;

[0070] Identification module 200: responsible for performing text recognition on the payment success page through OCR technology and converting unstructured data into structured data.

[0071] Processing module 300: responsible for removing spaces, converting dates, converting full-width and half-width characters, removing unnecessary information, etc. on the identified data. The specific operations support expansion.

[0072] Reporting module 400: responsible for reporting the identified data to the accounting page of the automatic accounting software or the accounting page of a common third-party accounting software. This module includes a series of RPA scripts, which use RPA technology to open the third-party accounting software and automatically input information by capturing interface elements. The functions of reporting module 400 support expansion.

[0073] In addition, the automatic accounting software may also include other modules for user preference settings, log recording, demand submission, etc., and support expansion; it may also include adaptation and update modules for updating and adapting different types of accounting software or payment software.

[0074] Specifically, in some embodiments of the present application, the above step S100: monitoring the user's payment operation includes the following two steps:

[0075] (1) Monitor the current foreground application through the monitoring module 100;

[0076] (2) When the foreground application is a payment channel application that supports identification and processing by automatic accounting software, model identification is performed on the foreground application page.

[0077] The automatic accounting software is initially in the background running state, and the monitoring module 100 continuously and automatically monitors the name of the current foreground running application of the mobile phone. In order to identify the current foreground application, the user's application list is obtained through the usage statistics service (such as UsageStatsManager service, etc.); then the application list is arranged according to the most recent use time, and the application with the most recent use time is obtained as the current foreground application. This method can obtain the application package name, and then compare it with the package name of common payment channel applications to determine whether the current foreground application is a payment channel application that the automatic accounting software supports identification and processing, such as WeChat (package name com.tencent.mm), Alipay (package name com.eg.android.AlipayGphone), Meituan (package name com.sankuai.meituan) and other common payment software. By continuously polling this operation, the monitoring effect of the current foreground application can be achieved.

[0078] When the foreground application is a payment channel application that the automatic accounting software supports identification and processing, the page of the foreground application is model recognized. Taking the Android mobile phone system as an example, the MediaProjection API is used to monitor the current screen content of the mobile phone system in real time, and pass it to the YOLO model built into the automatic accounting software. The YOLO model is used to perform feature recognition and classification recognition on the current screen content, and then it is determined whether the current screen content is the payment channel application "Payment Success" and related payment pages. Regarding YOLO model training, a large number of mobile phone screenshots of payment channel applications "Payment Success" and related payment pages are used for classification and annotation to form a training set and train the model so that the model can recognize specific payment pages and the name of the payment channel to which the page belongs.

[0079] If the application currently running in the foreground is not a payment channel application that the automatic accounting software supports identification and processing, the automatic accounting software is kept running in the background and continues to monitor.

[0080] If the application currently running in the foreground is a payment channel application that the automatic accounting software supports identification and processing, and the page on the mobile phone screen is identified as "Payment Successful" or a related payment information page, the automatic accounting software is triggered to take a screenshot of the current mobile phone page and pass it to the identification module 200 to identify and capture the content in the page, otherwise the YOLO model is continuously used to identify the page content.

[0081] Further, in some embodiments of the present application, the above step S300: extracting accounting data according to the payment page includes the following two steps:

[0082] (1) The recognition module 200 performs text recognition on the payment page using OCR technology;

[0083] (2) The recognition module 200 converts the unstructured data of the payment page into structured data to obtain accounting data.

[0084] Specifically, the recognition module 200 uses OCR technology to perform text recognition on the "Payment Successful" or related payment information page, performs structured processing and captures necessary accounting data such as payment method, payment recipient, payment amount, etc., records the current payment channel name, and triggers the processing module 300 to further process the structured data. If there is a situation where necessary accounting data on the payment page is missing or the recognition is abnormal, a prompt box will pop up to prompt the user "The payment accounting is abnormal, please record it manually", and record the abnormal operation log of the automatic accounting software. The automatic accounting software returns to the background running state and continues to monitor. Since the payment pages of different payment channels are different, the corresponding specific implementation logic will also be different. This step is described using the recognition of WeChat and Alipay platforms as an example:

[0085] a) Identify WeChat:

[0086] like Figure 3 As shown, since the WeChat "Payment Success" page only displays the payment recipient and payment amount information, it would be a better way to obtain information from the "Payment Verification" page. When the foreground WeChat application is on the "Payment Verification" page, text recognition is performed to obtain the payment recipient, payment amount, and payment method data. When the user enters the payment password and the page enters the "Payment Success" page from the "Payment Verification" page, the payment channel is recorded as "WeChat", and the processing module 300 is triggered to further process the structured data. If the "Payment Success" page is not identified, and the "Payment Verification" page is not identified at the same time, it is determined that the user has terminated the payment behavior, and the automatic accounting software returns to the monitoring stage.

[0087] b) Identify Alipay:

[0088] For the Alipay payment channel, the "Payment Success" page displays the payment amount, payment recipient, and payment method information, so the information can be directly obtained from the "Payment Success" page. When the foreground Alipay application is on the "Payment Success" page, text recognition is performed to obtain the payment recipient, payment amount, and payment method data. The automatic accounting software records the payment channel as "Alipay" and triggers the processing module 300 to further process the structured data.

[0089] Furthermore, in some embodiments of the present application, since unnecessary interference information may appear in the process of using OCR for text recognition, and the formats of text information captured by different payment channels may be different, after receiving the data, the processing module 300 will perform secondary processing on it, including but not limited to the following operations:

[0090] a) Remove spaces: For example, convert the payment amount “□31.□68□□” to “31.68”

[0091] b) Date conversion: For example, convert "28-3-24" to "2024 / 03 / 24"

[0092] c) Full-width and half-width character conversion: For example, convert "Payee-ABcde" to "Payee-ABcde"

[0093] d) Remove unnecessary information: For example, remove the “￥” symbol in the payment amount or the possible thousandth separator “,”, etc.

[0094] The processing module 300 will also record the current mobile phone system date and time as the time when the payment behavior occurred, triggering the reporting module 400 to perform subsequent operations.

[0095] Further, in some embodiments of the present application, the above step S400: recording the account book information on the account book page according to the account book data, includes the following three steps:

[0096] (1) Binding the automatic accounting software to a third-party accounting software;

[0097] (2) The reporting module calls the third-party accounting software to the front desk;

[0098] (3) Based on the operating logic of the third-party accounting software, the processed accounting data is filled into the accounting page through RPA technology to obtain account book information.

[0099] Specifically, after installing the automatic accounting software on the mobile phone, and installing the third-party accounting software that supports the operation, when running the automatic accounting software for the first time, it is necessary to set the third-party accounting software that the automatic accounting software operates by default when filling in the report. When the reporting module 400 wants to fill in the accounting data into the third-party software, the structured data (payment amount, payment recipient, payment method, payment channel, payment time) obtained in the processing stage is opened by the third-party accounting software through RPA technology, and automatically recorded as a payment record. Although the interaction logic of different third-party accounting software is different, the necessary accounting data are all payment amount, payment recipient, payment method, payment channel, and payment time fields, which have been obtained in the payment data processing stage in this solution. The RPA automation script used in this step can be developed by the user, the input logic can be configured and imported into the automatic accounting software. The following will take the two third-party accounting software, third-party accounting software A and third-party accounting software B, as examples for a general description:

[0100] a) Fill in the accounting information for the third-party accounting software A, such as Figure 3 and Figure 4 As shown:

[0101] *Using the RPA automation script, click the "Record" menu button at the bottom of the software homepage and enter the accounting page.

[0102] *On the accounting page, select or add "Payment Recipient" as the expenditure category field, click the Payment Method option and select or add "Payment Method" as the payment method in the menu, click the calendar icon button and set the "Payment Time" in the menu, enter "Payment Channel" as the accounting note in the Notes text box, and finally use the numeric keypad to enter "Payment Amount" as the expenditure amount.

[0103] *Click the “OK” button to complete the accounting reporting operation and the software will return to the home page.

[0104] b) Fill in the third-party accounting software B, such as Figure 5 and Figure 6 As shown:

[0105] *Use the RPA automation script to click the "+" icon menu button at the bottom of the software homepage to enter the accounting page.

[0106] *On the accounting page, select or add "Payment Recipient" as the expenditure category field, click the Payment Method option and select or add "Payment Method" as the payment method in the menu, click the Date button and set the "Payment Time" in the menu, click the Notes icon and enter "Payment Channel" in the text box as the accounting note, and finally use the numeric keypad to enter "Payment Amount" as the expenditure amount.

[0107] *Click the “OK” button to complete the accounting reporting operation and the software will return to the home page.

[0108] After the reporting module 400 completes the reporting, the application to which the "Payment Success" page belongs is called to the foreground, the automatic accounting operation is completed, and the automatic accounting software continues to monitor. If the reporting module 400 fails to operate due to failure to call up the third-party accounting software or operation failure, the user is prompted that "the third-party accounting software is operating abnormally, please record manually".

[0109] The complete operation process of the automatic accounting method according to the embodiment of the present invention is as follows: Figure 7 As shown, this method has the following advantages:

[0110] Simplify the accounting process, encourage more users to continue using accounting software, and thus develop good consumption habits;

[0111] 2. Decoupled from third-party accounting software and payment software, compatible with the usage habits of different users;

[0112] 3. No need for third-party accounting software and payment software to change or provide interfaces, and the data interaction between the two parties can be achieved in a non-intrusive way;

[0113] 4. The code is modular, and each module can be expanded to adapt to changing needs.

[0114] On the other hand, based on the above-mentioned automatic accounting method, the embodiment of the present invention also proposes an automatic accounting system, such as Figure 2 As shown, the system includes:

[0115] The monitoring module 100 is used to monitor the user's payment operation and obtain the payment page when the user pays successfully;

[0116] The identification module 200 is used to extract accounting data according to the payment page;

[0117] The reporting module 400 is used to record the account book information on the accounting page according to the accounting data.

[0118] Furthermore, in some embodiments of the present application, the automatic accounting system also includes a processing module 300, which is responsible for removing spaces, converting dates, converting full-width and half-width characters, removing unnecessary information, and other operations on the identified data, and the specific operations support expansion.

[0119] The automatic accounting system according to the embodiment of the present invention can simplify the accounting process, encourage more users to continue to use the accounting software, and thus develop good consumption habits; it is decoupled from third-party accounting software and payment software, and can be compatible with the usage habits of different users; it does not require third-party accounting software and payment software to be modified or provide interfaces, and a non-invasive method is used to achieve the interaction of data between the two parties; the code is modularized, and each module can be expanded to adapt to changing needs.

[0120] On the other hand, an embodiment of the present invention further provides an electronic device, including:

[0121] A memory for storing program instructions;

[0122] The processor is used to call the program instructions stored in the memory and execute the automatic accounting method described in the above-mentioned embodiment according to the obtained program instructions.

[0123] On the other hand, an embodiment of the present invention further provides a storage medium, which is a computer-readable storage medium and stores a computer program. When the computer program is executed by a processor, the above-mentioned automatic accounting method is implemented.

[0124] As a non-transient computer-readable storage medium, the memory can be used to store non-transient software programs and non-transient computer executable programs. In addition, the memory may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage devices. In some embodiments, the memory may optionally include a memory remotely arranged relative to the processor, and these remote memories may be connected to the processor via a network. Examples of the above-mentioned networks include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and a combination thereof. The device embodiments described above are merely schematic, wherein the units described as separate components may or may not be physically separated, and are implemented to be located in one place, or may also be distributed to multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the present embodiment.

[0125] Although specific embodiments are described herein, those of ordinary skill in the art will recognize that many other modifications or alternative embodiments are also within the scope of the present disclosure. For example, any of the functions and / or processing capabilities described in conjunction with a particular device or component may be performed by any other device or component. In addition, although various exemplary implementations and architectures have been described according to embodiments of the present disclosure, those of ordinary skill in the art will recognize that many other modifications to the exemplary implementations and architectures described herein are also within the scope of the present disclosure.

[0126] Some aspects of the present disclosure are described above with reference to the block diagram and flow chart of the system, method, system and / or computer program product according to the exemplary embodiments.It should be understood that the combination of one or more blocks in the block diagram and the flow chart and the blocks in the block diagram and the flow chart can be realized by executing computer executable program instructions respectively.Equally, according to some embodiments, some blocks in the block diagram and the flow chart may not need to be executed in the order shown, or may not need to be executed in full.In addition, additional components and / or operations beyond those components and / or operations shown in the blocks in the block diagram and the flow chart may be present in certain embodiments.

[0127] Therefore, the blocks in the block diagrams and flow charts support the combination of devices for performing the specified functions, the combination of elements or steps for performing the specified functions, and the program instruction devices for performing the specified functions. It should also be understood that each block in the block diagrams and flow charts and the combination of blocks in the block diagrams and flow charts can be implemented by a special-purpose hardware computer system or a combination of special-purpose hardware and computer instructions that performs a specific function, element or step.

[0128] The program modules, applications, etc. described herein may include one or more software components, including, for example, software objects, methods, data structures, etc. Each such software component may include computer-executable instructions that, in response to execution, cause at least a portion of the functionality described herein (e.g., one or more operations of the illustrative methods described herein) to be performed.

[0129] Software components can be encoded with any of various programming languages. An exemplary programming language can be a low-level programming language, such as an assembly language associated with a specific hardware architecture and / or an operating system platform. Software components comprising assembly language instructions may need to be converted to executable machine code by an assembler before being executed by hardware architecture and / or platform. Another exemplary programming language can be a higher-level programming language, which can be transplanted across multiple architectures. Software components comprising a higher-level programming language may need to be converted to an intermediate representation by an interpreter or a compiler before execution. Other examples of programming languages ​​include but are not limited to macro languages, shells or command languages, job control languages, scripting languages, database queries or search languages ​​or report writing languages. In one or more exemplary embodiments, a software component comprising the instructions of one of the above-mentioned programming language examples can be directly executed by an operating system or other software components, without first being converted into another form.

[0130] Software components may be stored as files or other data storage structures. Software components of similar type or related functions may be stored together, such as in a specific directory, folder, or library. Software components may be static (e.g., preset or fixed) or dynamic (e.g., created or modified at execution time).

[0131] The embodiments of the present invention are described in detail above with reference to the accompanying drawings, but the present invention is not limited to the above embodiments, and various changes can be made within the knowledge scope of ordinary technicians in the relevant technical field without departing from the purpose of the present invention.

Claims

1. An automatic accounting method, characterized in that: Applied to automatic accounting software, the automatic accounting method comprises the following steps: Monitor the user's payment operations; When the user pays successfully, get the payment page; Extracting accounting data according to the payment page; According to the accounting data, the account book information is recorded on the accounting page.

2. The automatic accounting method according to claim 1, characterized in that: The automatic accounting software is provided with a monitoring module; the step of monitoring the payment operation of the user comprises: Monitor the current foreground application through the monitoring module; When the foreground application is a payment channel application that the automatic accounting software supports identification and processing, model identification is performed on the page of the foreground application.

3. The automatic accounting method according to claim 2, characterized in that: The step of monitoring the current foreground application through the monitoring module includes: Get the list of apps through the usage statistics service; The application list is arranged according to the most recent use time, and the application with the most recent use time is obtained as the current foreground application.

4. The automatic accounting method according to claim 2, characterized in that: When the foreground application is a payment channel application that the automatic accounting software supports identification and processing, the step of performing model identification on the page of the foreground application includes: Use the MediaProjection API to monitor the current screen content in real time and pass it to the YOLO model built into the automatic accounting software; The YOLO model is used to perform feature recognition and classification recognition on the current screen content to determine whether the current screen content is a payment page.

5. The automatic accounting method according to claim 1, characterized in that: The automatic accounting software is provided with an identification module; the step of obtaining the payment page when the user pays successfully includes: When the payment result page appears in the current foreground application, take a screenshot to obtain the payment page; The payment page is sent to the identification module.

6. The automatic accounting method according to claim 5, characterized in that: The step of extracting payment information according to the payment page includes: The recognition module performs text recognition on the payment page through OCR technology; The identification module converts the unstructured data of the payment page into structured data to obtain accounting data.

7. The automatic accounting method according to claim 6, characterized in that: After the step of extracting accounting data according to the payment page, the method further includes: When the accounting data is missing or the identification module has an identification anomaly, the automatic accounting software will pop up a window to prompt; The automatic accounting software records the abnormal operation log and returns to the background to continue monitoring.

8. The automatic accounting method according to claim 1, characterized in that: The automatic accounting software also includes a processing module and a reporting module; after the step of extracting accounting data according to the payment page, it also includes: The processing module performs at least one processing operation of removing spaces, converting dates, converting full-width and half-width characters, and removing unnecessary information on the accounting data; The processing module obtains the time when the payment behavior occurs, and sends the processed accounting data and the time when the payment behavior occurs to the reporting module.

9. The automatic accounting method according to claim 8, characterized in that: The step of recording the account book information on the account book page according to the account book data comprises: Binding the automatic accounting software to a third-party accounting software; The reporting module calls the third-party accounting software to the front desk; According to the operating logic of the third-party accounting software, the processed accounting data is filled into the accounting page through RPA technology to obtain the account book information.

10. An automatic accounting system, characterized in that: include: The monitoring module is used to monitor the user's payment operation and obtain the payment page when the user pays successfully; An identification module, used to extract accounting data according to the payment page; The reporting module is used to record the account book information on the accounting page according to the accounting data.

Images