Data processing method and device based on financial system, electronic equipment and medium
By determining associated service software in the financial system, creating timed tasks and transaction flow tables, and obtaining and comparing transaction data, the deviation and efficiency of data verification between banks and third-party companies are solved, and the automated comparison and efficient verification of data are realized. .
Patent Information
- Application Number
- CN202411500837.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-25
- Publication Date
- 2025-02-07
AI Technical Summary
In customer acquisition projects in bank scenarios, due to the lack of direct interface support, the data returned by third-party companies may not be consistent with the transaction flow information within the bank, resulting in deviations in the data verification process, and the lack of automated interface support leads to data Verification requires manual operation, which is time-consuming and labor-intensive and prone to errors.
A data processing method based on financial system is proposed. By determining the associated service software bound to the financial system, obtaining the software category of each associated service software, creating timing tasks and transaction flow tables, and obtaining the financial system and associated service software transaction data, field correlation and comparison, and realize automated data comparison.
It realizes automated data comparison, improves the overall efficiency of data comparison, reduces manual intervention, reduces data verification costs and error rates, and ensures data accuracy and completeness.
Smart Images

Figure CN119398897A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of financial technology, and in particular to a data processing method, device, electronic device and medium based on a financial system. Background Art
[0002] In the customer acquisition project of the bank scenario, it is a common marketing strategy to distribute WeChat discount coupons to new credit card users through cooperation with third-party companies outside the bank. However, after the new users use these discount coupons, the third-party company needs to send the verified transaction flow information back to the bank, and needs to check it with the transaction flow information within the bank in order to reimburse the third-party company. Since this project is outsourced and does not directly involve the bank's internal business system, the bank's various business systems cannot directly provide interfaces to support data transmission and storage.
[0003] Due to the lack of direct interface support, the data sent back by the third-party company may not be consistent with the transaction flow information within the bank, resulting in deviations in the data verification process. In addition, in the absence of automated interface support, data verification may need to be done manually, which is not only time-consuming and labor-intensive, but also prone to errors. Due to the complexity and inefficiency of data verification, the reimbursement process may become cumbersome and slow, affecting overall work efficiency. Summary of the invention
[0004] The main purpose of the embodiments of the present application is to propose a data processing method, device, electronic device and medium based on a financial system, which can realize automatic comparison of data and improve the overall efficiency of data comparison.
[0005] To achieve the above-mentioned purpose, a first aspect of an embodiment of the present application proposes a data processing method based on a financial system, the data processing method comprising: Determine the associated service software bound to the financial system, and obtain the software category of the associated service software; For each of the associated service software, a scheduled task is created according to the software category, and a transaction flow table is created according to the scheduled task, wherein the transaction flow table includes a plurality of flow table fields; Obtaining transaction flow records of the financial system within a preset period of time; Acquire a transaction file of the associated service software within the preset time period based on the scheduled task, wherein the transaction file is used to represent the transaction flow details of the associated service software within the preset time period; Associating the fields of the transaction table with the transaction file to obtain a wide transaction table; The transaction file and the transaction flow record are compared through the transaction wide table to obtain a data analysis result.
[0006] In some embodiments, the step of creating a transaction flow table according to the scheduled task includes: Obtaining the data acquisition time of the scheduled task and configuring connection information, wherein the connection information is used to characterize parameter information during data transmission; Configure the file name and file type, and configure the flow table field according to the data acquisition time, the connection information and the file name; A transaction flow table is created according to the flow table fields and the file type.
[0007] In some embodiments, the acquiring of the transaction files of the associated service software within the preset time period based on the scheduled task includes: Obtaining the data acquisition time of the scheduled task; generating a data collection signal in response to the data acquisition time; Sending the data collection signal to the associated service software, so that the associated service software collects transaction flow details within the preset time period, and performs data verification on the transaction flow details to obtain a transaction file; Receive the transaction file sent by the associated service software.
[0008] In some embodiments, the data verification of the transaction flow details to obtain the transaction file includes: Obtain all transaction bills in the transaction details and obtain the bill numbers of the transaction bills; Determine the transaction information corresponding to the bill number; When a target bill number corresponding to the bill number exists in the database of the associated service software, the information of the target bill number is updated according to the transaction information to obtain a transaction file. or, When the target bill number corresponding to the bill number does not exist in the database of the associated service software, the bill number and the transaction information are added to the database to obtain a transaction file.
[0009] In some embodiments, after receiving the transaction file sent by the associated service software, the data processing method further includes: Determine a receiving time of the transaction file and a target table name corresponding to the transaction file; The file name of the transaction file is set according to the receiving time and the target table name.
[0010] In some embodiments, after receiving the transaction file sent by the associated service software, the data processing method further includes: Determine a receiving time of the transaction file and a target table name corresponding to the transaction file; The file name of the transaction file is set according to the receiving time and the target table name.
[0011] In some embodiments, the step of comparing the transaction file with the transaction flow record through the transaction wide table to obtain a data analysis result includes: Obtain the serial number to be analyzed in the transaction wide table; Determining a first content corresponding to the serial number to be analyzed in the transaction file, and determining a second content corresponding to the serial number to be analyzed in the transaction record; A data comparison is performed on the first content and the second content to obtain a data analysis result.
[0012] To achieve the above-mentioned purpose, a second aspect of an embodiment of the present application proposes a data processing device based on a financial system, the device comprising: A software determination module, used to determine the associated service software bound to the financial system and obtain the software category of the associated service software; A task creation module, used for creating a scheduled task for each of the associated service software according to the software category, and creating a transaction flow table according to the scheduled task, wherein the transaction flow table includes a plurality of flow table fields; A transaction flow acquisition module, used to acquire transaction flow records of the financial system within a preset time period; A transaction acquisition module, used to acquire a transaction file of the associated service software within the preset time period based on the scheduled task, wherein the transaction file is used to represent the transaction flow details of the associated service software within the preset time period; A field association module, used for performing field association between the flow table field and the transaction file to obtain a transaction wide table; The record comparison module is used to compare the transaction file and the transaction flow record through the transaction wide table to obtain a data analysis result.
[0013] To achieve the above-mentioned purpose, the third aspect of an embodiment of the present application proposes an electronic device, an electronic device comprising a memory and a processor, the memory storing a computer program, and the processor implementing the data processing method based on the financial system as described in the first aspect when executing the computer program.
[0014] To achieve the above objectives, the fourth aspect of an embodiment of the present application proposes a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, it implements the data processing method based on the financial system as described in the first aspect.
[0015] The data processing method, device, electronic device and storage medium based on the financial system proposed in the present application first determine the associated service software bound to the financial system and obtain the software category of each associated service software. By determining multiple third-party software bound to the financial system, it is convenient to perform data analysis on different associated service software later. For each associated service software, a scheduled task is created according to the software category so that different associated service software can obtain data according to their corresponding scheduled tasks, and a transaction flow table is created according to the scheduled tasks, so that transaction data from different sources can be managed through the transaction flow table, reducing manual intervention, and reducing the cost and error rate of data verification. Afterwards, the transaction flow records of the financial system within a preset time period are obtained to realize the collection of transaction flow records, which is convenient for analyzing the financial system. The transaction status of the associated service software is obtained based on the scheduled task, and the transaction files of the associated service software within the preset time are obtained, so that the transaction flow details of the associated service software within the preset time can be obtained. The automated scheduled task can reduce manual intervention and reduce data errors caused by human factors. Next, the flow table fields and transaction files are associated with each other. Through the association, it can be checked whether the transaction records of the financial system and the associated service software are consistent to ensure the accuracy and completeness of the data. The automated association operation can reduce the workload of manual reconciliation, so that multiple data sources can be integrated to obtain a wide transaction table, making data analysis simpler and more direct. Finally, the transaction wide table is used to compare transaction files and transaction flow records, which avoids the complexity of arranging data from scratch, realizes automated data comparison, and improves the efficiency and accuracy of reconciliation. BRIEF DESCRIPTION OF THE DRAWINGS
[0016] Figure 1 is a flow chart of a data processing method based on a financial system provided in an embodiment of the present application; Figure 2 A flow chart of a method for creating a transaction flow table based on a scheduled task provided in an embodiment of the present application; Figure 3 yes Figure 1 Flow chart of step S104 in FIG. Figure 4 A flow chart of a method for performing data verification on transaction flow details provided in an embodiment of the present application; Figure 5 is a flow chart of a temperature control method provided by another embodiment of the present application; Figure 6 yes Figure 1 Flow chart of step S105 in FIG. Figure 7 yes Figure 1 Flow chart of step S106 in FIG. Figure 8is a structural diagram of a data processing device based on a financial system provided in an embodiment of the present application; Fig. 9 It is a schematic diagram of the hardware structure of the electronic device provided in the embodiment of the present application. DETAILED DESCRIPTION
[0017] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.
[0018] It should be noted that, although the functional modules are divided in the device schematic diagram and the logical order is shown in the flowchart, in some cases, the steps shown or described may be performed in a different order than the module division in the device or the order in the flowchart. The terms "first", "second", etc. in the specification, claims and the above drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence.
[0019] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein are only for the purpose of describing the embodiments of this application and are not intended to limit this application.
[0020] First, some nouns involved in this application are analyzed: Natural Language Processing (NLP): NLP uses computers to process, understand, and apply human languages (such as Chinese, English, etc.). NLP is a branch of artificial intelligence and an interdisciplinary subject between computer science and linguistics. It is often referred to as computational linguistics. Natural language processing includes grammatical analysis, semantic analysis, and text understanding. Natural language processing is commonly used in technical fields such as machine translation, handwritten and printed character recognition, speech recognition and text-to-speech conversion, information intent recognition, information extraction and filtering, text classification and clustering, public opinion analysis, and opinion mining. It involves data mining related to language processing, machine learning, knowledge acquisition, knowledge engineering, artificial intelligence research, and linguistic research related to language computing.
[0021] Secure File Transfer Protocol (SFTP): SFTP is a network protocol used to securely transfer files across a network. It is based on the SSH (Secure Shell) protocol and provides data encryption, identity authentication, and integrity checking to ensure the security of file transfers.
[0022] Internet Protocol (IP): IP is a set of rules used to locate devices and transmit data on a network. It defines how to route data packets from the source address to the destination address. An IP address is a unique identifier assigned to each device on the network.
[0023] Structured Query Language (SQL): SQL is a programming language used to manage and operate relational databases. It is used to perform database queries, insert, update, and delete data, and is an indispensable tool in database management.
[0024] Based on this, the embodiments of the present application provide a data processing method and device, an electronic device and a storage medium based on a financial system, which can realize automatic comparison of data and improve the overall efficiency of data comparison.
[0025] The data processing method and device based on the financial system, electronic device and storage medium provided in the embodiments of the present application are specifically illustrated through the following embodiments. First, the data processing method based on the financial system in the embodiments of the present application is described.
[0026] The embodiments of the present application can acquire and process relevant data based on artificial intelligence technology. Artificial Intelligence (AI) is the theory, method, technology and application system that uses digital computers or machines controlled by digital computers to simulate, extend and expand human intelligence, perceive the environment, acquire knowledge and use knowledge to obtain the best results.
[0027] The basic technologies of artificial intelligence generally include sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, big data processing technology, operation / interaction systems, mechatronics, etc. Artificial intelligence software technologies mainly include computer vision technology, robotics technology, biometrics technology, module management technology of online meeting systems, natural language processing technology, and machine learning / deep learning.
[0028] The data processing method based on the financial system provided in the embodiment of the present application relates to the field of financial technology. The data processing method based on the financial system provided in the embodiment of the present application can be applied to the terminal, can also be applied to the server side, and can also be software running in the terminal or the server side. In some embodiments, the terminal can be a smart phone, a tablet computer, a laptop computer, a desktop computer, etc.; the server side can be configured as an independent physical server, or it can be configured as a server cluster or a distributed system composed of multiple physical servers, and can also be configured as a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms; the software can be an application that implements a data processing method based on a financial system, etc., but is not limited to the above forms.
[0029] The present application can be used in many general or special computer system environments or configurations. For example: personal computers, server computers, handheld or portable devices, tablet devices, multiprocessor systems, microprocessor-based systems, set-top boxes, programmable consumer electronics, network PCs, minicomputers, mainframe computers, distributed computing environments including any of the above systems or devices, etc. The present application can be described in the general context of computer-executable instructions executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform specific tasks or implement specific abstract data types. The present application can also be practiced in distributed computing environments, in which tasks are performed by remote processing devices connected through a communication network. In a distributed computing environment, program modules can be located in local and remote computer storage media including storage devices.
[0030] It should be noted that in each specific implementation of the present application, when it comes to the need to perform relevant processing based on data related to user identity or characteristics such as user information, user behavior data, user historical data, and user location information, the user's permission or consent will be obtained first, and the collection, use, and processing of these data will comply with the relevant laws, regulations, and standards of the relevant countries and regions. In addition, when the embodiment of the present application needs to obtain the user's sensitive personal information, the user's separate permission or consent will be obtained through a pop-up window or by jumping to a confirmation page. After clearly obtaining the user's separate permission or consent, the necessary user-related data for the normal operation of the embodiment of the present application will be obtained.
[0031] In the customer acquisition project of the bank scenario, it is a common marketing strategy to distribute WeChat discount coupons to new credit card users through cooperation with third-party companies outside the bank. However, after the new users use these discount coupons, the third-party company needs to send the verified transaction flow information back to the bank, and needs to check it with the transaction flow information within the bank in order to reimburse the third-party company. Since this project is outsourced and does not directly involve the bank's internal business system, the bank's various business systems cannot directly provide interfaces to support data transmission and storage.
[0032] Due to the lack of direct interface support, the data sent back by the third-party company may not be consistent with the transaction flow information within the bank, resulting in deviations in the data verification process. In addition, in the absence of automated interface support, data verification may need to be done manually, which is not only time-consuming and labor-intensive, but also prone to errors. Due to the complexity and inefficiency of data verification, the reimbursement process may become cumbersome and slow, affecting overall work efficiency.
[0033] In order to solve the above problems, the present embodiment provides a data processing method, device, electronic device and storage medium based on the financial system. First, the associated service software bound to the financial system is determined, and the software category of each associated service software is obtained. By determining multiple third-party software bound to the financial system, it is convenient to perform data analysis on different associated service software later. For each associated service software, a scheduled task is created according to the software category, so that different associated service software can obtain data according to its corresponding scheduled task, and a transaction flow table is created according to the scheduled task, so that transaction data from different sources can be managed through the transaction flow table, reducing manual intervention, and reducing the cost and error rate of data verification. Afterwards, the transaction flow record of the financial system within a preset time period is obtained to realize the collection of transaction flow records, which is convenient for classification. Analyze the transaction status of the financial system, and then obtain the transaction files of the associated service software within the preset time based on the scheduled task, so as to obtain the transaction flow details of the associated service software within the preset time. The automated scheduled task can reduce human intervention and reduce data errors caused by human factors. Next, the flow table fields and transaction files are associated with each other. Through the association, it can be checked whether the transaction records of the financial system and the associated service software are consistent to ensure the accuracy and completeness of the data. The automated association operation can reduce the workload of manual reconciliation, so that multiple data sources can be integrated to obtain a wide transaction table, making data analysis simpler and more direct. Finally, the transaction files and transaction flow records are compared through the wide transaction table to avoid the complexity of arranging data from scratch, realize automatic comparison of data, and improve the efficiency and accuracy of reconciliation.
[0034] The following is a detailed description with reference to the accompanying drawings.
[0035] Figure 1is an optional flowchart of a data processing method based on a financial system provided in an embodiment of the present application. Figure 1 The method may include but is not limited to steps S101 to S106.
[0036] Step S101, determining the associated service software bound to the financial system, and obtaining the software category of the associated service software.
[0037] In step S101 of some embodiments, the associated service software bound to the financial system, that is, the third-party service software bound to the financial system, such as WeChat, QQ, Alipay, etc., is determined, and the software category of the associated service software is obtained, so that data analysis can be performed on software of different categories to improve service quality and enhance customer trust.
[0038] Step S102: for each associated service software, a scheduled task is created according to the software category, and a transaction flow table is created according to the scheduled task, wherein the transaction flow table includes a plurality of flow table fields.
[0039] In step S102 of some embodiments, for each associated service software, a scheduled task is created according to the software category, so that different associated service software can obtain data according to their corresponding scheduled tasks, and a transaction flow table is created according to the scheduled tasks to facilitate subsequent data analysis and auditing work, and realize rapid query and analysis of transaction conditions within a specific time period.
[0040] Step S103, obtaining transaction flow records of the financial system within a preset time period.
[0041] In step S103 of some embodiments, the transaction flow records of the financial system within a preset period of time are obtained to collect the transaction flow records, thereby facilitating the analysis of the transaction status of the financial system.
[0042] It should be noted that the preset duration in the embodiment of the present application can be one month, fifteen days, ten days, five days, etc., and the embodiment of the present application does not make any specific restrictions.
[0043] Step S104, obtaining transaction files of the associated service software within a preset time period based on the scheduled task.
[0044] It should be noted that the transaction file is used to represent the transaction flow details of the associated service software within a preset time period.
[0045] In step S104 of some embodiments, transaction files of the associated service software within a preset time period are obtained based on a scheduled task, and preventing the storage of duplicate data can save storage space and reduce storage costs. Reducing duplicate data can increase the speed of database query and processing because the database does not need to operate on a large number of duplicate records.
[0046] Step S105, associate the fields of the transaction table with the transaction file to obtain a wide transaction table.
[0047] In step S105 of some embodiments, field association is performed on the flow table fields and the transaction file. Through the association operation, it can be ensured that the information in different data sources is consistent, and a wide transaction table is obtained. In addition, the wide table integrates multiple data sources, reduces the table connection operations required during query, improves the accuracy and reliability of the data, and facilitates subsequent data comparison through the wide data table.
[0048] Step S106, comparing the transaction file and the transaction flow record through the transaction wide table to obtain data analysis results.
[0049] In step S106 of some embodiments, transaction documents and transaction flow records are compared through transaction wide tables to identify data differences and obtain data analysis results, thereby ensuring data consistency and accuracy, avoiding decision-making errors due to data errors, and being able to timely discover and prevent potential risks, thereby increasing customer trust in the company.
[0050] See also Figure 2 , Figure 2 A flow chart of a method for creating a transaction flow table based on a scheduled task provided in an embodiment of the present application, the method includes but is not limited to steps S201 to S203.
[0051] Step S201, obtain the data acquisition time of the scheduled task and configure the connection information.
[0052] It should be noted that the connection information is used to represent parameter information during data transmission.
[0053] Step S202, configure the file name and file type, and configure the flow table fields according to the data acquisition time, connection information and file name.
[0054] Step S203, creating a transaction flow table according to the flow table fields and file type.
[0055] In steps S201 to S203 of some embodiments, in the process of creating a transaction flow table according to a scheduled task, the embodiment of the present application first obtains the data acquisition time of the scheduled task, for example, the first, fifth, tenth, fifteenth, etc. of each month, and configures the connection information, so as to increase the flexibility of the network and avoid port conflicts with other services. Then configure the file name and file type. By specifying the file name and type, it can ensure that only the required data is read, avoid interference from irrelevant information, improve the accuracy and efficiency of data processing, and clearly specify the file name and type to reduce the risk of incorrectly reading or processing the wrong file, and configure the flow table field according to the data acquisition time, connection information and file name. Through precise configuration, it can ensure the accuracy of the time point of data acquisition and the source of data, avoid data confusion and errors, thereby improving the accuracy and reliability of data, and then create a transaction flow table according to the flow table field and file type, so that the transaction flow table can record detailed transaction information, facilitate subsequent data analysis and auditing work, and realize rapid query and analysis of transaction conditions within a specific time period.
[0056] It should be noted that the connection information in the embodiments of the present application includes but is not limited to the IP, port, user name, password, etc. of the SFTP service, which are key parameters required to establish a secure connection to the SFTP server and perform identity authentication. Specifically, the IP address refers to the network address of the SFTP server, which is used to identify the location of the server in the network. The port refers to the network port that the SFTP service listens on. The user name is the account name used to log in to the SFTP server. The password is the password associated with the user name, which is used to verify the user's identity.
[0057] It is understandable that a reasonable configuration of fields can reduce unnecessary data scanning and improve query efficiency. For example, partitioning can quickly locate data on a specific date, and using a columnar storage format can improve reading efficiency.
[0058] In some embodiments, in practical applications, the embodiments of the present application may also involve key pair (public key and private key) authentication, in which case the connection credentials may include the path of the key file. These credentials usually need to be kept confidential to ensure account security.
[0059] See also Figure 3 In some embodiments, step S104 may also include but is not limited to steps S301 to S304.
[0060] Step S301, obtaining the data acquisition time of the scheduled task.
[0061] Step S302, generating a data collection signal in response to the data acquisition time.
[0062] Step S303, sending a data collection signal to the associated service software, so that the associated service software collects transaction flow details within a preset time period, and performs data verification on the transaction flow details to obtain a transaction file.
[0063] Step S304, receiving the transaction file sent by the associated service software.
[0064] In steps S301 to S304 of some embodiments, in the process of obtaining the transaction files of the associated service software within a preset time period based on the scheduled task, the data acquisition time of the scheduled task is first obtained, for example, the first, fifteenth, twentieth, etc. of each month. When the data acquisition time is reached, the embodiment of the present application generates a data collection signal in response to the data acquisition time, and sends the data collection signal to the associated service software, so that the associated service software collects the transaction flow details within the preset time period. Specifically, the associated service software collects data from the transaction flow details of the previous month through the scheduled task call interface, and performs data verification on the transaction flow details. By verifying and avoiding the entry of duplicate data, the accuracy and reliability of the data can be improved to obtain the transaction file. The embodiment of the present application receives the transaction file after data verification of the associated service software, and prevents the storage of duplicate data, which can save storage space and reduce storage costs. In addition, reducing duplicate data can increase the speed of database query and processing because the database does not need to operate in a large number of duplicate records.
[0065] It should be noted that after the associated service software collects the transaction flow details within the preset time period, the transaction flow details will be stored in the database and written into Excel through the EasyExcel plug-in to generate an xls type transaction file.
[0066] Specifically, taking WeChat as the associated service software, the transaction flow details of the embodiment of the present application can be WeChat voucher batch number, WeChat voucher ID, transaction serial number, voucher verification time, voucher status, etc., and the preset duration can be one month, fifteen days, five days, etc., and the embodiment of the present application does not make specific restrictions.
[0067] It is understandable that EasyExcel is a Java-based Excel processing tool. By using the data stream in memory, EasyExcel makes it more efficient to process large files, simplifies the operation steps, and improves development efficiency.
[0068] See also Figure 4 , Figure 4 A flow chart of a method for performing data verification on transaction flow details provided in an embodiment of the present application, the method including but not limited to steps S401 to S404.
[0069] Step S401, obtain all transaction bills in the transaction details, and obtain the bill number of the transaction bill.
[0070] Step S402, determining the transaction information corresponding to the bill number.
[0071] Step S403, when there is a target bill number corresponding to the bill number in the database of the associated service software, the information of the target bill number is updated according to the transaction information to obtain a transaction file.
[0072] In steps S401 to S403 of some embodiments, in the process of performing data verification on the transaction flow details, the embodiment of the present application first obtains all transaction bills in the transaction flow details, and obtains the bill number of the transaction bill, wherein each transaction bill has a one-to-one corresponding bill number, and then determines the transaction information corresponding to the bill number, that is, the information bound to the bill number. For example, taking the bill number as a mobile phone number as an example, there may be multiple consumption records for one mobile phone number, so the embodiment of the present application needs to determine the transaction information corresponding to the same mobile phone number, and then determine whether there is a bill number corresponding to the bill number in the database of the associated service software. When there is a target bill number corresponding to the bill number in the database of the associated service software, the information of the target bill number is updated according to the transaction information, so as to realize real-time update of the information, update the detailed data of the target bill number, obtain the transaction file, and avoid duplicate data entry through verification, so as to improve the accuracy and reliability of the data, and provide a higher quality data foundation for data analysis and decision-making.
[0073] It is understandable that in the database of the associated service software, duplicate data may lead to data inconsistency. Verification can ensure the integrity and consistency of the data. Reducing duplicate data can increase the speed of database query and processing. Verification can avoid repeated data entry, reduce data redundancy, and make data management more efficient.
[0074] Step S404, when the target bill number corresponding to the bill number does not exist in the database of the associated service software, the bill number and transaction information are added to the database to obtain a transaction file.
[0075] In step S404 of some embodiments, when the target bill number corresponding to the bill number does not exist in the database of the associated service software, it means that there was no transaction information related to the bill number before. The bill number and transaction information can be directly added to the database to obtain the transaction file, realize real-time sorting of data, avoid information omissions, and improve the accuracy of data collection.
[0076] See also Figure 5 , Figure 5 is a flowchart of a data processing method based on a financial system provided by another embodiment of the present application. Figure 5The method may include but is not limited to steps S501 to S502.
[0077] It should be noted that step S501 to step S502 occur after receiving the transaction file sent by the associated service software.
[0078] Step S501, determining the receiving time of the transaction file and the target table name corresponding to the transaction file.
[0079] Step S502, setting the file name of the transaction file according to the receiving time and the target table name.
[0080] In steps S501 to S502 of some embodiments, after receiving the transaction file sent by the associated service software, the embodiments of the present application will determine the receiving time of the transaction file and the target table name corresponding to the transaction file. By recording the receiving time, the timeliness of the data can be ensured, which is convenient for subsequent data analysis and processing. The file name of the transaction file is then set according to the receiving time and the target table name. By clarifying the target table name, data can be prevented from falling into the wrong table, thereby improving data accuracy. Knowing the specific receiving time and target table name helps maintain data integrity during data transmission and processing, and avoids data loss or duplication.
[0081] It is worth noting that since the server of the embodiment of the present application is a public service, it will store files of n projects. In order to avoid duplication of file names, the transaction file needs to start with the offline analysis library table name, and the offline analysis library table name needs to be followed by the return time, that is, the time when the server receives the transaction file, for example, BANK_APPLY_COUPON_20230808.xls. In addition, the table name is also the table name that will be subsequently included in the offline analysis library, and duplication is not allowed. This name can also be used to know which table the data falls into, thereby improving the efficiency of data comparison and facilitating the rapid verification of subsequent data.
[0082] See also Figure 6 In some embodiments, step S105 may also include but is not limited to steps S601 to S606.
[0083] Step S601, obtaining the file content of the transaction file, and dividing the file content into multiple content intervals, wherein each content interval is provided with a content identifier.
[0084] Step S602: Arrange the file contents according to the content identifiers to obtain a sequential sequence.
[0085] Step S603, performing field parsing on the content interval by using a preset parsing tool and a sequential sequence to obtain a plurality of transaction fields.
[0086] Step S604, mapping the flow table fields and the transaction fields to obtain a mapping result.
[0087] Step S605, storing the mapping result in a preset offline analysis library to obtain a return transaction flow table, wherein the return transaction flow table includes a plurality of return flow table fields.
[0088] Step S606, associate the returned transaction table field with the transaction table field to obtain a transaction wide table.
[0089] In steps S601 to S606 of some embodiments, in the process of associating the flow table fields with the transaction files, the embodiments of the present application first obtain the file content of the transaction file, and divide the file content into multiple content intervals, and each content interval is provided with a content identifier, and then the file content is arranged according to the content identifier to obtain a sequential sequence, so as to facilitate the subsequent field parsing according to the sorting rules of the sequential sequence to avoid field omissions, and then the content interval is parsed by a preset parsing tool and a sequential sequence to obtain multiple transaction fields. Specifically, by parsing the fields of the content interval through EasyExcel, the embodiments of the present application can set the first line of the transaction file as the table field name, and the second line as the data content. The first line is read first to put the field name into an array, and starting from reading the second line, the content interval is parsed according to the sequential sequence to obtain multiple transaction fields. segment, then, perform field mapping on the flow table field and the transaction field, that is, map the transaction fields and the flow table fields in the transaction file one by one to obtain the mapping result, thereby obtaining the mapping relationship between the transaction fields and the flow table fields, and then store the mapping result in the preset offline analysis library to obtain the return transaction flow table, wherein the return transaction flow table includes multiple return flow table fields, and finally, associate the return flow table field with the flow table field to obtain a transaction wide table. Specifically, the embodiment of the present application can use the association operation in the SQL query or programming language to perform field association on the flow table field and the transaction field to obtain the transaction wide table, so that multiple data sources can be integrated together. Through the association operation, it can be ensured that the information in different data sources is consistent, and the wide table reduces the table connection operation required for query by integrating multiple data sources, improves the accuracy and reliability of the data, and facilitates the subsequent data comparison through the data wide table.
[0090] See also Figure 7 In some embodiments, step S106 may also include but is not limited to steps S701 to S703.
[0091] Step S701, obtaining the serial number to be analyzed in the transaction wide table.
[0092] Step S702, determining the first content corresponding to the serial number to be analyzed in the transaction file, and determining the second content corresponding to the serial number to be analyzed in the transaction record.
[0093] Step S703: perform data comparison on the first content and the second content to obtain a data analysis result.
[0094] In steps S701 to S703 of some embodiments, in the process of comparing the transaction file and the transaction flow record through the transaction wide table, the embodiment of the present application first obtains the serial number to be analyzed in the transaction wide table, and then determines the first content corresponding to the serial number to be analyzed in the transaction file, and determines the second content corresponding to the serial number to be analyzed in the transaction flow record. Then, data comparison is performed on the first content and the second content. Specifically, data cleaning is performed on the first content and the second content to ensure the accuracy and consistency of the data, and then the mapping relationship between the corresponding fields in the two data is determined to ensure the consistency of the comparison. Then, the first content and the second content are compared one by one to identify data differences and obtain data analysis results to ensure data consistency and accuracy, avoid decision-making errors due to data errors, and be able to timely discover and prevent potential risks, thereby improving customer trust in the company.
[0095] It is understandable that the data comparison here refers to the transaction flow records of the financial system and the associated service software bound to it, such as the usage records of the third-party WeChat coupons, to ensure that the data on both sides can be aligned, so that the third party can find the bank for reimbursement. Specifically, taking the associated service software as WeChat and the financial system as the bank as an example, a transaction will generate a transaction flow number in the financial system at the same time, and a transaction flow number will also be generated on the WeChat side. The same transaction flow number is the same. The flow information on the WeChat side is obtained by the third party and then returned through the SFTP service. The bank's is stored in the bank's business system. In the end, all these data will be sent to the offline analysis library. There is a platform in the bank that can use Hive SQL to associate the two tables of the offline analysis library through the transaction flow number, and set a batch run every day or at a specified time to drop the data after the table is associated into a new offline large wide table. The business can compare the data by downloading the table data, so as to more intuitively reflect the difference between the transaction data in the bank and the third party.
[0096] See also Figure 8 The embodiment of the present application further provides a data processing device based on a financial system, the device comprising: The software determination module 801 is used to determine the associated service software bound to the financial system and obtain the software category of the associated service software; The task creation module 802 is used to create a scheduled task for each associated service software according to the software category, and to create a transaction flow table according to the scheduled task, wherein the transaction flow table includes a plurality of flow table fields; The transaction flow acquisition module 803 is used to acquire the transaction flow records of the financial system within a preset time period; The transaction acquisition module 804 is used to acquire the transaction files of the associated service software within a preset time period based on the scheduled task, wherein the transaction files are used to represent the transaction flow details of the associated service software within the preset time period; The field association module 805 is used to associate the fields of the flow table with the transaction file to obtain a wide transaction table; The record comparison module 806 is used to compare the transaction file and the transaction flow record through the transaction wide table to obtain the data analysis result.
[0097] The specific implementation of the financial system-based data processing device is substantially the same as the specific implementation of the financial system-based data processing method described above, and will not be described in detail herein.
[0098] The embodiment of the present application also provides an electronic device, the electronic device comprising: a memory, a processor, a program stored in the memory and executable on the processor, and a data bus for realizing connection and communication between the processor and the memory, and the program is executed by the processor to realize the above-mentioned data processing method based on the financial system. The electronic device can be any intelligent terminal including a tablet computer, a car computer, etc.
[0099] See also Fig. 9 , Fig. 9 The hardware structure of an electronic device of another embodiment is illustrated, and the electronic device includes: The processor 901 may be implemented by a general-purpose CPU (Central Processing Unit), a microprocessor, an application-specific integrated circuit (Application Specific Integrated Circuit, ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of the present application; The memory 902 can be implemented in the form of a read-only memory (ROM), a static storage device, a dynamic storage device, or a random access memory (RAM). The memory 902 can store an operating system and other application programs. When the technical solution provided in the embodiment of this specification is implemented by software or firmware, the relevant program code is stored in the memory 902, and the processor 901 calls and executes the data processing method based on the financial system in the embodiment of this application; Input / output interface 903, used to implement information input and output; Communication interface 904, used to realize communication interaction between the device and other devices, which can be realized through wired mode (such as USB, network cable, etc.) or wireless mode (such as mobile network, WIFI, Bluetooth, etc.); A bus 905 that transmits information between various components of the device (e.g., the processor 901, the memory 902, the input / output interface 903, and the communication interface 904); The processor 901 , the memory 902 , the input / output interface 903 and the communication interface 904 are connected to each other in communication within the device via a bus 905 .
[0100] An embodiment of the present application also provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the above-mentioned data processing method based on the financial system is implemented.
[0101] The memory, as a non-transient computer-readable storage medium, can be used to store non-transient software programs and non-transient computer executable programs. In addition, the memory may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some embodiments, the memory may optionally include a memory remotely disposed relative to the processor, and these remote memories may be connected to the processor via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.
[0102] The data processing method, device, electronic device and storage medium based on the financial system provided by the embodiments of the present application first determine the associated service software bound to the financial system, and obtain the software category of each associated service software. By determining multiple third-party software bound to the financial system, it is convenient to perform data analysis on different associated service software later. For each associated service software, a scheduled task is created according to the software category so that different associated service software can obtain data according to its corresponding scheduled task, and a transaction flow table is created according to the scheduled task, so that transaction data from different sources can be managed through the transaction flow table, reducing manual intervention, and reducing the cost and error rate of data verification. Afterwards, the transaction flow record of the financial system within a preset time period is obtained to realize the collection of transaction flow records, which is convenient for analyzing the financial system. The system's transaction status is collected, and then the transaction files of the associated service software within the preset time are obtained based on the scheduled task, so that the transaction flow details of the associated service software within the preset time can be obtained. The automated scheduled task can reduce manual intervention and reduce data errors caused by human factors. Next, the flow table fields and transaction files are associated with each other. Through the association, it can be checked whether the transaction records of the financial system and the associated service software are consistent to ensure the accuracy and completeness of the data. The automated association operation can reduce the workload of manual reconciliation, so that multiple data sources can be integrated to obtain a wide transaction table, making data analysis simpler and more direct. Finally, the transaction files and transaction flow records are compared through the wide transaction table to avoid the complexity of arranging data from scratch, realize automatic comparison of data, and improve the efficiency and accuracy of reconciliation.
[0103] The embodiments described in the embodiments of the present application are intended to more clearly illustrate the technical solutions of the embodiments of the present application and do not constitute a limitation on the technical solutions provided in the embodiments of the present application. Those skilled in the art will appreciate that with the evolution of technology and the emergence of new application scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.
[0104] It can be understood by those skilled in the art that Figure 1-9 The technical solutions shown in the figure do not constitute a limitation on the embodiments of the present application, and may include more or fewer steps than those shown in the figure, or a combination of certain steps, or different steps.
[0105] The device embodiments described above are merely illustrative, and the units described as separate components may or may not be physically separated, that is, they may be located in one place or distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0106] Those skilled in the art will appreciate that all or some of the steps in the methods disclosed above, and the functional modules / units in the systems and devices may be implemented as software, firmware, hardware, or a suitable combination thereof.
[0107] The terms "first", "second", "third", "fourth", etc. (if any) in the specification of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.
[0108] It should be understood that in the present application, "at least one (item)" means one or more, and "plurality" means two or more. "And / or" is used to describe the association relationship of associated objects, indicating that three relationships may exist. For example, "A and / or B" can mean: only A exists, only B exists, and A and B exist at the same time, where A and B can be singular or plural. The character " / " generally indicates that the objects associated before and after are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, c can be single or multiple.
[0109] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the above units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0110] The units described above as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0111] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.
[0112] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including multiple instructions to enable a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, referred to as ROM), random access memory (Random Access Memory, referred to as RAM), disk or optical disk and other media that can store programs.
[0113] The preferred embodiments of the present invention are described above with reference to the accompanying drawings, but the scope of the rights of the present invention is not limited thereto. Any modification, equivalent substitution and improvement made by a person skilled in the art without departing from the scope and essence of the present invention should be within the scope of the rights of the present invention.
Claims
1. A data processing method based on a financial system, characterized in that: The data processing method comprises: Determine the associated service software bound to the financial system, and obtain the software category of the associated service software; For each of the associated service software, a scheduled task is created according to the software category, and a transaction flow table is created according to the scheduled task, wherein the transaction flow table includes a plurality of flow table fields; Obtaining transaction flow records of the financial system within a preset period of time; Acquire a transaction file of the associated service software within the preset time period based on the scheduled task, wherein the transaction file is used to represent the transaction flow details of the associated service software within the preset time period; Associating the fields of the transaction table with the transaction file to obtain a wide transaction table; The transaction file and the transaction flow record are compared through the transaction wide table to obtain a data analysis result.
2. The data processing method based on the financial system according to claim 1, characterized in that: The step of creating a transaction flow table according to the scheduled task includes: Obtaining the data acquisition time of the scheduled task and configuring connection information, wherein the connection information is used to characterize parameter information during data transmission; Configure the file name and file type, and configure the flow table field according to the data acquisition time, the connection information and the file name; A transaction flow table is created according to the flow table fields and the file type.
3. The data processing method based on the financial system according to claim 1, characterized in that: The acquiring the transaction file of the associated service software within the preset time period based on the scheduled task includes: Obtaining the data acquisition time of the scheduled task; generating a data collection signal in response to the data acquisition time; Sending the data collection signal to the associated service software, so that the associated service software collects transaction flow details within the preset time period, and performs data verification on the transaction flow details to obtain a transaction file; Receive the transaction file sent by the associated service software.
4. The data processing method based on the financial system according to claim 3, characterized in that: The data verification of the transaction flow details is performed to obtain a transaction file, including: Obtain all transaction bills in the transaction details and obtain the bill numbers of the transaction bills; Determine the transaction information corresponding to the bill number; When a target bill number corresponding to the bill number exists in the database of the associated service software, the information of the target bill number is updated according to the transaction information to obtain a transaction file. or, When the target bill number corresponding to the bill number does not exist in the database of the associated service software, the bill number and the transaction information are added to the database to obtain a transaction file.
5. The data processing method based on the financial system according to claim 3, characterized in that: After receiving the transaction file sent by the associated service software, the data processing method further includes: Determine a receiving time of the transaction file and a target table name corresponding to the transaction file; The file name of the transaction file is set according to the receiving time and the target table name.
6. The data processing method based on the financial system according to claim 1, characterized in that: The step of associating the fields of the transaction table with the transaction file to obtain a wide transaction table includes: Acquire the file content of the transaction file, and divide the file content into multiple content intervals, wherein each content interval is provided with a content identifier; Arrange the contents of the file according to the content identifier to obtain a sequential sequence; Performing field parsing on the content interval using a preset parsing tool and the sequential sequence to obtain a plurality of transaction fields; Performing field mapping on the flow table field and the transaction field to obtain a mapping result; The mapping result is stored in a preset offline analysis library to obtain a return transaction flow table, wherein the return transaction flow table includes a plurality of return flow table fields; The return flow table field is associated with the flow table field to obtain a transaction wide table.
7. The data processing method based on the financial system according to claim 1, characterized in that: The step of comparing the transaction file with the transaction flow record through the transaction wide table to obtain a data analysis result includes: Obtain the serial number to be analyzed in the transaction wide table; Determining a first content corresponding to the serial number to be analyzed in the transaction file, and determining a second content corresponding to the serial number to be analyzed in the transaction record; A data comparison is performed on the first content and the second content to obtain a data analysis result.
8. A data processing device based on a financial system, characterized in that: The device comprises: A software determination module, used to determine the associated service software bound to the financial system and obtain the software category of the associated service software; A task creation module, used for creating a scheduled task for each of the associated service software according to the software category, and creating a transaction flow table according to the scheduled task, wherein the transaction flow table includes a plurality of flow table fields; A transaction flow acquisition module, used to acquire transaction flow records of the financial system within a preset time period; A transaction acquisition module, used to acquire the transaction file of the associated service software within the preset time period based on the scheduled task, wherein the transaction file is used to represent the transaction flow details of the associated service software within the preset time period; A field association module, used for performing field association between the flow table field and the transaction file to obtain a transaction wide table; The record comparison module is used to compare the transaction file and the transaction flow record through the transaction wide table to obtain a data analysis result.
9. An electronic device, characterized in that: The electronic device comprises a memory and a processor, the memory stores a computer program, and the processor implements the data processing method based on the financial system as claimed in any one of claims 1 to 7 when executing the computer program.
10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the financial system-based data processing method according to any one of claims 1 to 7 is implemented.
Citation Information
Cited By
Riding transaction verification method and device, equipment and storage medium
CN119784392A