Data processing method, system and terminal based on digital technology

Abstract

The invention discloses a data processing method and system based on a digital technology, and a terminal. The method comprises the following steps: collecting original business data of a target business platform system; performing data processing on the original business data, the data processing including data cleaning and data conversion, and obtaining target business data after data processing; performing data analysis on the target business data, the data analysis including data rule analysis and settlement data analysis, and obtaining a data analysis result after data analysis; and performing settlement service calculation according to the data analysis result, and generating and outputting a settlement report. According to the invention, the data of the target business platform system is collected, cleaned, stored and analyzed in real time by using a big data technology, automatic matching and checking of the data are realized, manual intervention and errors are reduced, a settlement report is rapidly and accurately output, and the efficiency and accuracy of data processing are improved.

Description

Technical Field

[0001] The present invention relates to the field of data processing technology, and in particular to a data processing method, system, terminal and computer-readable storage medium based on digital technology. Background Art

[0002] With the rapid development of digital technology, the content industry is becoming increasingly prosperous, and the cooperation between partners (CP) and platforms is becoming closer and closer. However, data processing in traditional settlement methods often has problems such as low efficiency, high error rate, and high cost, which makes it difficult to meet the rapidly developing market needs.

[0003] Therefore, the prior art still needs to be improved and developed. Summary of the invention

[0004] The main purpose of the present invention is to provide a data processing method, system, terminal and computer-readable storage medium based on digital technology, aiming to solve the problems of low efficiency, high error rate and high cost in data processing in existing settlement methods.

[0005] To achieve the above object, the present invention provides a data processing method based on digital technology, and the data processing method based on digital technology comprises the following steps:

[0006] Collect original business data of the target business platform system;

[0007] Performing data processing on the original business data, wherein the data processing includes data cleaning and data conversion, to obtain target business data after data processing;

[0008] Performing data analysis on the target business data, wherein the data analysis includes data rule analysis and settlement data analysis, and obtaining data analysis results after the data analysis;

[0009] Perform settlement business calculations based on the data analysis results, generate and output a settlement report.

[0010] Optionally, the data processing method based on digital technology, wherein the data processing method based on digital technology further comprises:

[0011] Establish an exception handling mechanism to monitor and identify abnormal situations that occur during the settlement business calculation process in real time, analyze the abnormal situations to obtain abnormal problems, and issue early warnings and handle them based on the abnormal problems.

[0012] Optionally, the data processing method based on digital technology, wherein the collecting of original business data of the target business platform system further comprises:

[0013] An automated verification system is designed, and the automated verification system is interfaced with the target business platform system. The collected original business data is matched and verified with the actual real data through the automated verification system. If errors are detected in the original business data, the original business data of the target business platform system is re-collected.

[0014] Optionally, in the data processing method based on digital technology, the data cleaning includes removing duplicate information, correcting erroneous information, processing invalid values, processing outliers and processing missing values.

[0015] Optionally, in the data processing method based on digital technology, the data conversion is used to convert the original business data into standard structure data.

[0016] In addition, to achieve the above-mentioned purpose, the present invention further provides a data processing system based on digital technology, wherein the data processing system based on digital technology comprises:

[0017] Data collection module, used to collect original business data of the target business platform system;

[0018] A data processing module is used to process the original business data, wherein the data processing includes data cleaning and data conversion to obtain target business data after data processing;

[0019] A data analysis module, used to perform data analysis on the target business data, wherein the data analysis includes data rule analysis and settlement data analysis, and obtain data analysis results after the data analysis;

[0020] The result generation module is used to perform business calculations based on the data analysis results, generate and output a settlement report.

[0021] Optionally, the data processing system based on digital technology, wherein the data processing system based on digital technology further includes:

[0022] The exception monitoring module is used to establish an exception handling mechanism. During the settlement business calculation process, it monitors and identifies abnormal situations that occur during the settlement process in real time, obtains abnormal problems based on the abnormal situation analysis, and issues early warnings and handles the abnormal problems based on the abnormal problems.

[0023] Optionally, the data processing system based on digital technology, wherein the data processing system based on digital technology further includes:

[0024] The data verification module is used to design an automated verification system, which interfaces with the target business platform system. The automated verification system matches and verifies the collected original business data with the actual real data. If errors are detected in the original business data, the original business data of the target business platform system is re-collected.

[0025] In addition, to achieve the above-mentioned purpose, the present invention also provides a terminal, wherein the terminal includes: a memory, a processor, and a data processing program based on digital technology stored in the memory and executable on the processor, and when the data processing program based on digital technology is executed by the processor, the steps of the data processing method based on digital technology as described above are implemented.

[0026] In addition, to achieve the above-mentioned purpose, the present invention also provides a computer-readable storage medium, wherein the computer-readable storage medium stores a data processing program based on digital technology, and when the data processing program based on digital technology is executed by a processor, the steps of the data processing method based on digital technology as described above are implemented.

[0027] In the present invention, the original business data of the target business platform system is collected; the original business data is processed, and the data processing includes data cleaning and data conversion to obtain the target business data after data processing; the target business data is analyzed, and the data analysis includes data rule analysis and settlement data analysis to obtain the data analysis results after data analysis; settlement business calculations are performed according to the data analysis results, and settlement reports are generated and output. The present invention uses big data technology to collect, clean, store and analyze the data of the target business platform system in real time, realize automatic matching and verification of data, reduce manual intervention and errors, and thus quickly and accurately output settlement reports, thereby improving the efficiency and accuracy of data processing. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] Figure 1 It is a flow chart of a preferred embodiment of the data processing method based on digital technology of the present invention;

[0029] Figure 2 It is a schematic diagram of the data processing process of a preferred embodiment of the data processing method based on digital technology of the present invention;

[0030] Figure 3 It is a structural diagram of a preferred embodiment of the data processing system based on digital technology of the present invention;

[0031] Figure 4 It is a structural diagram of a preferred embodiment of the terminal of the present invention. DETAILED DESCRIPTION

[0032] In order to make the purpose, technical solution and advantages of the present invention clearer and more specific, the present invention is further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0033] The data processing method based on digital technology described in the preferred embodiment of the present invention is as follows: Figure 1 and Figure 2 As shown, the data processing method based on digital technology includes the following steps:

[0034] Step S10: Collect original business data of the target business platform system.

[0035] Specifically, the target business platform system refers to some platforms with large data transaction volumes (such as banks, payment platforms). The original business data of the target business platform system (such as transaction data, payment data, business volume data, etc. over a period of time) is collected, and an automated verification system is designed. The automated verification system is interfaced with the target business platform system, and the collected original business data is matched and verified with the actual real data through the automated verification system (for example, the payment data collected from a certain platform is verified with the actual order payment data), so as to reduce manual intervention and errors. If serious errors are detected in the original business data, the serious error data is deleted, and the original business data of the target business platform system is re-collected.

[0036] Step S20: performing data processing on the original business data, wherein the data processing includes data cleaning and data conversion to obtain target business data after data processing.

[0037] Specifically, the raw business data is cleaned, and the data cleaning includes removing duplicate information, correcting erroneous information, processing invalid values, processing outliers, and processing missing values; data cleaning refers to the process of re-examining and verifying data, aiming to discover and correct errors in data files and ensure the consistency and accuracy of data. This process includes removing duplicate information, correcting errors, and processing invalid values ​​and missing values ​​to ensure the "clean" state of data. Data cleaning occupies a core position in data analysis because dirty data will have a negative impact on the analysis results. By cleaning the data, the accuracy and reliability of the analysis results can be ensured, and misleading conclusions caused by data errors can be avoided. Data cleaning is usually completed automatically by computers instead of manual review, which improves processing efficiency and accuracy. In data warehouses, data cleaning is an important step to ensure data quality, because data may come from multiple business systems and contain historical data, which is prone to errors or conflicts.

[0038] The original business data is subjected to data conversion (data conversion is the process of changing data from one representation form to another. Data conversion technology plays a vital role in the information age. It not only involves the effective conversion of different data formats, but also focuses on the structure and semantics of the data). The data conversion is used to convert the original business data into standard structure data. For example, the data conversion includes Box-Cox conversion, Yeo-Johnson conversion, rank conversion, reciprocal conversion and binning conversion (discretization).

[0039] Data conversion technology refers to the process of converting data from one format, structure or semantics to another, with the aim of improving the availability and interoperability of data. In today's rapidly developing information technology, various data sources are complex and diverse, and enterprises and organizations are faced with the problem of how to effectively use these data. Data conversion is not just a technical operation, it also involves a deep understanding of business needs to ensure that the converted data can meet the actual application needs. This technology is usually divided into several forms, including format conversion, structure conversion and semantic conversion. Format conversion usually refers to the conversion between different data storage formats, such as converting CSV files to JSON format; structure conversion involves changes in database table structure, such as migrating from relational databases to non-relational databases; and semantic conversion is to redefine and adjust the meaning of data while ensuring that the content remains unchanged, so that it can be better understood and used in different business contexts. In practical applications, the use of appropriate data conversion technology can greatly improve data processing efficiency and reduce the error rate in subsequent analysis. This not only helps to improve decision-making support capabilities, but also helps enterprises seize the initiative in competition. Therefore, understanding and mastering data conversion technology is particularly important for professionals engaged in information management, data analysis and related fields.

[0040] Step S30: performing data analysis on the target business data, wherein the data analysis includes data rule analysis and settlement data analysis, and obtaining data analysis results after the data analysis.

[0041] Specifically, after processing the original business data to obtain the target business data, it is necessary to further perform data rule analysis and settlement data analysis on the target business data to analyze the data rules and characteristics of the settlement data. For example, in different settlement businesses, each partner will have different rules for settlement. The system must be configured according to the corresponding rules, and the settlement data also needs to be summarized and processed.

[0042] Step S40: Perform settlement business calculations based on the data analysis results, generate and output a settlement report.

[0043] Specifically, after obtaining the data analysis results, it is necessary to further perform settlement business calculations based on the data analysis results to provide accurate data support for settlement. After the calculation is completed, a settlement report is generated and output. For example, the settlement report may include the original sales data, the partners involved in the profit sharing, the profit sharing ratio, the profit sharing amount and other information.

[0044] Furthermore, an exception handling mechanism is established to monitor and identify abnormal situations occurring in the settlement process in real time during the settlement business calculation process, analyze the abnormal situations to obtain abnormal problems, and issue early warnings and handle them based on the abnormal problems to ensure the smooth progress of the settlement process; for example: the sales order amount is inconsistent with the payment order amount, the sales order is missed, etc. The early warning method is usually a message notification, and the handling mechanism: the system initiates an automatic compensation capture mechanism.

[0045] Furthermore, if Figure 3 As shown, based on the above-mentioned data processing method based on digital technology, the present invention also provides a data processing system based on digital technology, wherein the data processing system based on digital technology includes:

[0046] The data collection module 51 is used to collect the original business data of the target business platform system;

[0047] A data processing module 52 is used to process the original business data, wherein the data processing includes data cleaning and data conversion to obtain target business data after data processing;

[0048] A data analysis module 53 is used to perform data analysis on the target business data, wherein the data analysis includes data rule analysis and settlement data analysis, and obtain data analysis results after the data analysis;

[0049] The result generation module 54 is used to perform business calculations according to the data analysis results, and generate and output a settlement report.

[0050] The data processing system based on digital technology also includes:

[0051] The exception monitoring module is used to establish an exception handling mechanism. During the settlement business calculation process, it monitors and identifies abnormal situations that occur during the settlement process in real time, obtains abnormal problems based on the abnormal situation analysis, and issues early warnings and handles the abnormal problems based on the abnormal problems.

[0052] The data processing system based on digital technology also includes:

[0053] The data verification module is used to design an automated verification system, which interfaces with the target business platform system. The automated verification system matches and verifies the collected original business data with the actual real data. If errors are detected in the original business data, the original business data of the target business platform system is re-collected.

[0054] Furthermore, if Figure 4 As shown, based on the above-mentioned data processing method and system based on digital technology, the present invention also provides a terminal accordingly, and the terminal includes a processor 10, a memory 20 and a display 30. Figure 4 Only some components of the terminal are shown, but it should be understood that it is not required to implement all of the components shown, and more or fewer components may be implemented instead.

[0055] The memory 20 may be an internal storage unit of the terminal in some embodiments, such as a hard disk or memory of the terminal. The memory 20 may also be an external storage device of the terminal in other embodiments, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (SecureDigital, SD) card, a flash card (Flash Card), etc. equipped on the terminal. Further, the memory 20 may also include both an internal storage unit of the terminal and an external storage device. The memory 20 is used to store application software and various types of data installed in the terminal, such as the program code of the installation terminal. The memory 20 may also be used to temporarily store data that has been output or is to be output. In one embodiment, a data processing program 40 based on digital technology is stored on the memory 20, and the data processing program 40 based on digital technology can be executed by the processor 10, thereby realizing the data processing method based on digital technology in the present application.

[0056] In some embodiments, the processor 10 may be a central processing unit (CPU), a microprocessor or other data processing chip, used to run the program code or process data stored in the memory 20, such as executing the data processing method based on digital technology.

[0057] In some embodiments, the display 30 may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, an OLED (Organic Light-Emitting Diode) touch device, etc. The display 30 is used to display information on the terminal and to display a visual user interface. The processor 10, the memory 20, and the display 30 of the terminal communicate with each other via a system bus.

[0058] In one embodiment, when the processor 10 executes the data processing program 40 based on digital technology in the memory 20, the following steps are implemented:

[0059] Collect original business data of the target business platform system;

[0060] Performing data processing on the original business data, wherein the data processing includes data cleaning and data conversion, to obtain target business data after data processing;

[0061] Performing data analysis on the target business data, wherein the data analysis includes data rule analysis and settlement data analysis, and obtaining data analysis results after the data analysis;

[0062] Perform settlement business calculations based on the data analysis results, generate and output a settlement report.

[0063] Wherein, the data processing method based on digital technology also includes:

[0064] Establish an exception handling mechanism to monitor and identify abnormal situations that occur during the settlement business calculation process in real time, analyze the abnormal situations to obtain abnormal problems, and issue early warnings and handle them based on the abnormal problems.

[0065] The collecting of the original business data of the target business platform system further includes:

[0066] An automated verification system is designed, and the automated verification system is interfaced with the target business platform system. The collected original business data is matched and verified with the actual real data through the automated verification system. If errors are detected in the original business data, the original business data of the target business platform system is re-collected.

[0067] The data cleaning includes removing duplicate information, correcting erroneous information, processing invalid values, processing outliers and processing missing values.

[0068] The data conversion is used to convert the original business data into standard structure data.

[0069] The present invention also provides a computer-readable storage medium, wherein the computer-readable storage medium stores a data processing program based on digital technology, and when the data processing program based on digital technology is executed by a processor, the steps of the data processing method based on digital technology as described above are implemented.

[0070] In summary, the present invention provides a data processing method, system, terminal and computer-readable storage medium based on digital technology, the method comprising: collecting original business data of a target business platform system; performing data processing on the original business data, the data processing comprising data cleaning and data conversion, and obtaining target business data after data processing; performing data analysis on the target business data, the data analysis comprising data rule analysis and settlement data analysis, and obtaining data analysis results after data analysis; performing settlement business calculations according to the data analysis results, and generating and outputting settlement reports. The present invention utilizes big data technology to collect, clean, store and analyze data of a target business platform system in real time, realize automatic matching and verification of data, reduce manual intervention and errors, thereby quickly and accurately outputting settlement reports, and improving the efficiency and accuracy of data processing.

[0071] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal. In the absence of further restrictions, an element defined by the sentence "includes a ..." does not exclude the existence of other identical elements in the process, method, article or terminal including the element.

[0072] Of course, those skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be implemented by instructing related hardware (such as a processor, a controller, etc.) through a computer program, and the program can be stored in a computer-readable storage medium that can be read by a computer, and the program can include the processes of the above-mentioned method embodiments when executed. The computer-readable storage medium can be a memory, a disk, an optical disk, etc.

[0073] It should be understood that the application of the present invention is not limited to the above examples. For ordinary technicians in this field, improvements or changes can be made based on the above description. All these improvements and changes should fall within the scope of protection of the claims attached to the present invention.

Claims

1. A data processing method based on digital technology, characterized in that: The data processing method based on digital technology includes: Collect original business data of the target business platform system; Performing data processing on the original business data, wherein the data processing includes data cleaning and data conversion, to obtain target business data after data processing; Performing data analysis on the target business data, wherein the data analysis includes data rule analysis and settlement data analysis, and obtaining data analysis results after the data analysis; Perform settlement business calculations based on the data analysis results, generate and output a settlement report.

2. The data processing method based on digital technology according to claim 1, characterized in that: The data processing method based on digital technology also includes: Establish an exception handling mechanism to monitor and identify abnormal situations that occur during the settlement business calculation process in real time, analyze the abnormal situations to obtain abnormal problems, and issue early warnings and handle them based on the abnormal problems.

3. The data processing method based on digital technology according to claim 1, characterized in that: The collecting of the original business data of the target business platform system further includes: An automated verification system is designed, and the automated verification system is interfaced with the target business platform system. The collected original business data is matched and verified with the actual real data through the automated verification system. If errors are detected in the original business data, the original business data of the target business platform system is re-collected.

4. The data processing method based on digital technology according to claim 1, characterized in that: The data cleaning includes removing duplicate information, correcting erroneous information, processing invalid values, processing outliers and processing missing values.

5. The data processing method based on digital technology according to claim 1, characterized in that: The data conversion is used to convert the original business data into standard structure data.

6. A data processing system based on digital technology, characterized in that: The data processing system based on digital technology includes: Data collection module, used to collect original business data of the target business platform system; A data processing module is used to process the original business data, wherein the data processing includes data cleaning and data conversion to obtain target business data after data processing; A data analysis module, used to perform data analysis on the target business data, wherein the data analysis includes data rule analysis and settlement data analysis, and obtain data analysis results after the data analysis; The result generation module is used to perform business calculations based on the data analysis results, generate and output a settlement report.

7. The data processing system based on digital technology according to claim 6, characterized in that: The data processing system based on digital technology also includes: The exception monitoring module is used to establish an exception handling mechanism. During the settlement business calculation process, it monitors and identifies abnormal situations that occur during the settlement process in real time, obtains abnormal problems based on the abnormal situation analysis, and issues early warnings and handles the abnormal problems based on the abnormal problems.

8. The data processing system based on digital technology according to claim 6, characterized in that: The data processing system based on digital technology also includes: The data verification module is used to design an automated verification system, which interfaces with the target business platform system. The automated verification system matches and verifies the collected original business data with the actual real data. If errors are detected in the original business data, the original business data of the target business platform system is re-collected.

9. A terminal, characterized in that: The terminal includes: a memory, a processor, and a data processing program based on digital technology stored in the memory and executable on the processor. When the data processing program based on digital technology is executed by the processor, the steps of the data processing method based on digital technology as described in any one of claims 1 to 5 are implemented.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a data processing program based on digital technology, and when the data processing program based on digital technology is executed by a processor, the steps of the data processing method based on digital technology as described in any one of claims 1 to 5 are implemented.

Images