A processing system based on financial data
By designing a processing system based on financial data, the problems of high development costs, long online cycles and high maintenance costs in existing data processing systems are solved, and standardized management and structured processing of semi-structured data are realized, reducing the The complexity of data transmission and management, and provides the functions of timely notification and visual presentation.
Patent Information
- Application Number
- CN202311594223.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-11-24
- Publication Date
- 2025-02-25
- Estimated Expiration
- 2043-11-24
AI Technical Summary
The existing data processing system has problems such as high development costs, long online cycles and high maintenance costs. There are many errors or abnormal data in semi-structured data and the large amount of data, which leads to difficulty in manual verification. Historical semi-structured data lacks unified data. Management tools, the lack of reasonable upload mechanism for data results leads to disconnection from the data middle platform, the lack of visual front-end display leads to management difficulties, and the lack of timely notification of data results leads to difficult to implement sales management methods in a timely manner.
A processing system based on financial data is designed, including management end, business end and data end. The management end obtains data files and generates structured data through the first generation module according to preset tasks. The first sending module will structured data. Send to the data end, the data end obtains historical information and returns to the management end, the management end filters out qualified data and sends it to the data end, the data end generates summary data and sends it to the management end, and when there are different data in the summary data, the management end generates emails and send the information to the service end.
Through this system, the cost of development and maintenance is reduced, the online cycle is shortened, and the standardized management and structured processing of semi-structured data is realized. The transmission of data between systems is more convenient, and a visual front-end display and timely notification mechanism is provided. , improves the directness and response speed of data management.
Smart Images

Figure CN117633074B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of data processing, and in particular to a processing system based on financial data. Background Art
[0002] In the process of business development, some business links involving finance are not accurately included in the business system according to the financial caliber due to the general gaps in the business and financial systems; at the same time, because it is part of the business process, such data is not included in the financial system. The data generated in these links are not generated by standardized system links, and most of them require manual processing. In this process, the standardized structure of the data is changed or destroyed. Most existing technologies choose to try to connect the business and financial systems, and try to remove manual operations that are out of the standardized system during the business development process, thereby avoiding damage to the structure of the data and realizing the structuring of semi-structured data.
[0003] Currently, existing data processing systems have problems such as high development cost, long launch cycle and high maintenance cost.
[0004] That is, the existing data processing system has the following five pain points that cannot solve the target application scenarios: 1. Semi-structured data contains many errors or abnormal data and the huge amount of data makes manual verification extremely difficult; 2. Historical semi-structured data lacks a unified data management tool; 3. The data results lack a reasonable upload mechanism, resulting in a disconnection with the data middle platform; 4. The lack of a visual front-end display leads to management difficulties; 5. The lack of timely notification of data results makes it difficult to implement sales management measures in a timely manner. Summary of the invention
[0005] In view of the above problems, the present application is proposed to provide a financial data-based processing system that overcomes the above problems or at least partially solves the above problems, comprising:
[0006] A processing system based on financial data, the system involves a management end, a business end and a data end, wherein the management end includes a first generating module, a first sending module, a second sending module, a third sending module and a server for storing data files;
[0007] The first generating module is used for the management end to obtain a data file in the server according to a preset timed task, and to generate structured data according to the data file;
[0008] The first sending module is used for the management end to generate a write request according to the structured data, and send the write request to the data end; the data end is used to obtain historical information according to the write request, and send the historical information to the management end;
[0009] The second sending module is used for the management end to screen out qualified data from the structured data according to the historical information, and send the qualified data to the data end; the data end is used to generate summary data according to the qualified data, and send the summary data to the management end;
[0010] The third sending module is used for, when there is difference data in the summary data, the management end generating a first email message according to the difference data in the summary data, and sending the difference data and the first email message to the service end.
[0011] Furthermore, it also includes:
[0012] The first storage module is used for storing the source data in the server when the management end receives the source data sent by the service end.
[0013] Furthermore, the first generating module includes:
[0014] A first determination submodule, configured for the management terminal to determine change data in the data file, wherein the change data includes unstructured data and semi-structured data;
[0015] The first generating submodule is used for, when the change data is the semi-structured data, for the management end to perform structured processing on the semi-structured data to generate structured data.
[0016] Furthermore, the second sending module includes:
[0017] A second determination submodule, configured for the management terminal to determine a data type corresponding to the structured data according to the structured data and the historical information, wherein the data type includes abnormal data and non-abnormal data;
[0018] The third determination submodule is configured to, when the data type of the structured data is the non-abnormal data, cause the management end to determine that the current structured data is the qualified data.
[0019] Furthermore, it also includes:
[0020] A fourth determination submodule, configured to, when the data type of the structured data is the abnormal data, determine by the management end that the current structured data is unqualified data;
[0021] The first sending submodule is used for the management end to generate a second email message according to the unqualified data, and send the unqualified data and the second email message to the service end.
[0022] Furthermore, the fourth determining submodule includes:
[0023] A first acquisition unit, configured for the management end to acquire data attributes of the structured data, wherein the data attributes include a data structure or a data format;
[0024] The first determination unit is used to determine that the current structured data is the unqualified data when the data structure is inconsistent with the preset structure; or, when the data structure is inconsistent with the preset format, the management end determines that the current structured data is the unqualified data.
[0025] An embodiment of the present application further discloses a processing system based on financial data, the system involving a management end, a business end and a data end, wherein the data end includes a first acquisition module, a fourth sending module and a fifth sending module;
[0026] The first acquisition module is used for, when the data end receives a write request sent by the management end, the data end acquires historical data from the historical database according to the write request;
[0027] The fourth sending module is used for the data end to generate historical information according to the historical data, and send the historical information to the management end; the management end is used to determine qualified data according to the historical information, and send the qualified data to the data end;
[0028] The fifth sending module is used for the data end to generate summary data according to the qualified data and a preset hierarchical processing model, and send the summary data to the management end.
[0029] Furthermore, the fourth sending module includes:
[0030] A second generating submodule, configured for the data end to generate a qualification standard for evaluating structured data based on the historical data;
[0031] The third generation submodule is used by the data end to generate historical information based on the historical data and the qualification standard.
[0032] Furthermore, it also includes:
[0033] A sixth sending module is used for the data end to generate a report based on the summary data and send the report to the business end.
[0034] An embodiment of the present application further discloses a processing system based on financial data, the system involving a management end, a business end and a data end, wherein the business end includes a first acquisition module, a seventh sending module and a first allocation module;
[0035] The first acquisition module is used for the service end to acquire the data to be transmitted through a human-computer interaction method in response to the data transmission demand of the user;
[0036] The seventh sending module is used for the service end to pre-process the data to be transmitted to generate source data, and send the source data to the management end; the management end is used to obtain difference data and first email information based on the source data, or the management end is used to obtain unqualified data and second email information based on the source data;
[0037] The first allocation module is used for allocating the difference data and the first email message to the first target object when the business end receives the difference data and the first email message sent by the management end; or, when the business end receives the unqualified data and the second email message sent by the management end, the business end allocates the unqualified data and the second email message to the second target object; or, when the business end receives the report sent by the data end, the business end allocates the report to a third target object.
[0038] This application has the following advantages:
[0039] In the embodiments of the present application, compared with the prior art of "high development cost, long online cycle and high maintenance cost, semi-structured data contains many errors or abnormal data and the huge amount of data makes manual verification extremely difficult; historical semi-structured data lacks a unified data management tool; data results lack a reasonable upload mechanism, resulting in disconnection with the data middle platform; lack of visual front-end display leads to management difficulties; lack of timely notification of data results leads to difficulty in timely implementation of sales management measures", the present application provides a solution of "a processing system based on financial data", specifically: "A processing system based on financial data, the system involves a management end, a business end and a data end, wherein the management end includes a first generation module, a first sending module, a second sending module, a third sending module and a server for storing data files; the first generation module is used for the management end to send data files according to a preset timed task The server obtains a data file and generates structured data based on the data file; the first sending module is used for the management end to generate a write request based on the structured data and send the write request to the data end; the data end is used to obtain historical information based on the write request and send the historical information to the management end; the second sending module is used for the management end to filter out qualified data from the structured data based on the historical information and send the qualified data to the data end; the data end is used to generate summary data based on the qualified data and send the summary data to the management end; the third sending module is used for the management end to generate a first email message based on the difference data in the summary data when there is difference data in the summary data, and send the difference data and the first email message to the business end. Through the "management end, business end and data end", the problems of "high development cost, long online cycle and high maintenance cost, semi-structured data contains many errors or abnormal data and the huge amount of data makes manual verification extremely difficult; historical semi-structured data lacks a unified data management tool; data results lack a reasonable upload mechanism, resulting in disconnection with the data middle platform; lack of visual front-end display leads to management difficulties; lack of timely notification of data results makes it difficult to implement sales management measures in a timely manner" were solved, achieving the effect of "reducing development and maintenance costs, shortening the online cycle, selecting processing solutions according to differential data, standardizing data management, and making data transmission between systems more convenient; visual data makes data management more directly reflected, and problems with the data can be fed back and processed in a timely manner." BRIEF DESCRIPTION OF THE DRAWINGS
[0040] In order to more clearly illustrate the technical solution of the present application, the drawings required for use in the description of the present application will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.
[0041] Figure 1 It is a structural block diagram of a financial data processing system provided in one embodiment of the present application. DETAILED DESCRIPTION
[0042] In order to make the objects, features and advantages of the present application more obvious and understandable, the present application is further described in detail below in conjunction with the accompanying drawings and specific implementation methods. Obviously, the described embodiments are part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without creative work are within the scope of protection of the present application.
[0043] The inventors found through analysis of the prior art that:
[0044] The processing of semi-structured financial data refers to the process of standardized access to some financial data that has not been generated by a standardized system during the business process. This process includes the collection and storage of semi-structured financial data, data identification and verification, processing and transmission, structured docking of data platforms or data middle platforms, the construction of relevant data models, and feedback of data results. In this process, managers can perform structured management and query on semi-structured data that has not been connected to the data platform.
[0045] In the process of business development, some business links involving finance are not accurately included in the business system according to the financial caliber due to the general gaps in the business and financial systems; at the same time, because it is part of the business process, such data is not included in the financial system. The data generated in these links are not generated by standardized system links, and most of them require manual processing. In this process, the standardized structure of the data is changed or destroyed. Most existing technologies choose to try to connect the business and financial systems, and try to remove manual operations that are out of the standardized system during the business development process, thereby avoiding damage to the structure of the data and realizing the structuring of semi-structured data.
[0046] 1) High development cost: The connection between the financial system and the business system can be global or single-functional. The common point between the two is that they both involve system-level connection, which requires a lot of manpower and time cost investment. The connection between the business system and the financial system involves the two most important and complex management platforms of the company. Therefore, various difficulties such as compliance issues, process integrity issues, inaccurate mapping of various links of business and finance, and differences in historical data (structure, content) of business and finance will lead to extremely high technical difficulty and cost requirements for the global connection between systems. Although the difficulty and corresponding cost of single-functional connection are significantly lower than those of global connection, since it still belongs to the development work at the system level, it also has the disadvantages of long process and high development cost. In addition, the reusability of single-functional connection is low: if there are similar data problems in the future, it is likely that relevant development will need to be carried out again in a targeted manner. Such a high investment cost often makes the return that the project itself can bring seem like a drop in the bucket, and the rate of return is greatly reduced; if it is a non-essential project, many daily problems cannot be well solved due to the above reasons.
[0047] 2) Long launch cycle: a derivative problem caused by high time cost. Whether it is global or single-functional system connection, it requires process integration, data mapping, a large amount of compatibility development, and underlying database joint debugging. Because it involves production data, in order to ensure stability and accuracy, the time cycle brought by risk assessment is also relatively long. In general, the development time required for connecting a single-functional system alone is in the unit of months, which has a great impact on the timely resolution of problems.
[0048] 3) High maintenance cost: The integration of single-functional systems mostly forms the connection of local data between systems. This type of non-global data integration often causes inconsistent data in the production environment. Although the "connection" of data under this functional domain well meets the structuring of semi-structured data (directly eliminating the uncertainty of human operation), the lack of global architecture deployment often leads to inconsistent data in the production environment, which brings challenges to the data governance level and greatly increases the subsequent maintenance costs.
[0049] The existing data processing system has the following five pain points that cannot solve the target application scenarios: 1. Semi-structured data contains many errors or abnormal data and the huge amount of data makes manual verification extremely difficult; 2. Historical semi-structured data lacks a unified data management tool; 3. The data results lack a reasonable upload mechanism, resulting in a disconnection with the data middle platform; 4. The lack of a visual front-end display leads to management difficulties; 5. The lack of timely notification of data results makes it difficult to implement sales management measures in a timely manner.
[0050] Reference Figure 1, showing a structural block diagram of a processing system based on financial data provided by an embodiment of the present application;
[0051] A processing system based on financial data, the system involves a management end, a business end and a data end, wherein the management end includes a first generating module, a first sending module, a second sending module, a third sending module and a server for storing data files;
[0052] The first generating module is used for the management end to obtain a data file in the server according to a preset timed task, and to generate structured data according to the data file;
[0053] The first sending module is used for the management end to generate a write request according to the structured data, and send the write request to the data end; the data end is used to obtain historical information according to the write request, and send the historical information to the management end;
[0054] The second sending module is used for the management end to screen out qualified data from the structured data according to the historical information, and send the qualified data to the data end; the data end is used to generate summary data according to the qualified data, and send the summary data to the management end;
[0055] The third sending module is used for, when there is difference data in the summary data, the management end generating a first email message according to the difference data in the summary data, and sending the difference data and the first email message to the service end.
[0056] In the embodiments of the present application, compared with the prior art of "high development cost, long online cycle and high maintenance cost, semi-structured data contains many errors or abnormal data and the huge amount of data makes manual verification extremely difficult; historical semi-structured data lacks a unified data management tool; data results lack a reasonable upload mechanism, resulting in disconnection with the data middle platform; lack of visual front-end display leads to management difficulties; lack of timely notification of data results leads to difficulty in timely implementation of sales management measures", the present application provides a solution of "a processing system based on financial data", specifically: "A processing system based on financial data, the system involves a management end, a business end and a data end, wherein the management end includes a first generation module, a first sending module, a second sending module, a third sending module and a server for storing data files; the first generation module is used for the management end to send data files according to a preset timed task The server obtains a data file and generates structured data based on the data file; the first sending module is used for the management end to generate a write request based on the structured data and send the write request to the data end; the data end is used to obtain historical information based on the write request and send the historical information to the management end; the second sending module is used for the management end to filter out qualified data from the structured data based on the historical information and send the qualified data to the data end; the data end is used to generate summary data based on the qualified data and send the summary data to the management end; the third sending module is used for the management end to generate a first email message based on the difference data in the summary data when there is difference data in the summary data, and send the difference data and the first email message to the business end. Through the "management end, business end and data end", the problems of "high development cost, long online cycle and high maintenance cost, semi-structured data contains many errors or abnormal data and the huge amount of data makes manual verification extremely difficult; historical semi-structured data lacks a unified data management tool; data results lack a reasonable upload mechanism, resulting in disconnection with the data middle platform; lack of visual front-end display leads to management difficulties; lack of timely notification of data results makes it difficult to implement sales management measures in a timely manner" were solved, achieving the effect of "reducing development and maintenance costs, shortening the online cycle, selecting processing solutions according to differential data, standardizing data management, and making data transmission between systems more convenient; visual data makes data management more directly reflected, and problems with the data can be fed back and processed in a timely manner."
[0057] Next, a processing system based on financial data in this exemplary embodiment will be further described.
[0058] In one embodiment of the present invention, the management end has several servers for storing data files; and according to preset scheduled tasks, the target server, that is, the target server of each branch unit, is accessed on several servers, the target server is accessed through the SSH protocol to obtain the data in the target server, the data in the target server is scanned, the specific data that causes the data change is determined, and the specific data is used as a data file; the data files are batch processed to obtain structured data, and then the structured data is sent to the data end, the data end returns historical information, the structured data is screened through the historical information to determine qualified data, and then the qualified data is sent to the data end; the data end returns summary data, and when there is difference data in the summary data, a first email message is generated according to the difference data, wherein the first email message is used to explain what kind of specific difference exists in the difference data, and the corresponding difference data and the first email message are sent to the business end.
[0059] In a specific implementation, the target server data content is directly accessed through the SSH protocol, and the data files are scanned regularly to detect data content that has undergone data changes. In a specific example, it is also possible to query whether the data file content meets the established work task goals for automatic review and thus scan.
[0060] For data files that are consistent with the work target data content requirements, that is, have the same data rows, the corresponding data batch processing process will be triggered to structure the semi-structured data to form structured data; at the same time, regardless of whether the data triggers any work task goals, the source data will be standardized and batch processed through a general data preprocessing mechanism, and the processed data will be stored in the data middle platform, that is, the data end, to facilitate data preservation and backtracking.
[0061] For data files that trigger work task objectives, files with data content that is inconsistent with the core system or with incorrect data formats will be identified as unqualified data, and will be integrated and reported to the corresponding responsible persons and supervisors for centralized identification and early warning via email.
[0062] In a specific example, the management end can be implemented using Python language.
[0063] In one embodiment of the present invention, it also includes:
[0064] The first storage module is used for storing the source data in the server when the management end receives the source data sent by the service end.
[0065] It should be noted that before the management end obtains the data file through the server, the management end will continuously receive the source data sent by the business end and store the corresponding source data in the server.
[0066] In one embodiment of the present invention, the first generating module includes:
[0067] A first determination submodule, configured for the management terminal to determine change data in the data file, wherein the change data includes unstructured data and semi-structured data;
[0068] The first generating submodule is used for, when the change data is the semi-structured data, for the management end to perform structured processing on the semi-structured data to generate structured data.
[0069] It should be noted that, after the data files are obtained from the server and the changed data are scanned and determined, the changed data are classified, that is, the changed data includes unstructured data and semi-structured data, among which unstructured data refers to data that is neither semi-structured data nor structured data, and semi-structured data needs to be further processed to become structured data.
[0070] In a specific implementation, among several changed data, it is determined which ones are unstructured data, which ones are semi-structured data, and which ones are structured data, the semi-structured data is processed to become structured data, and then combined with the already structured data, it is sent to the data end.
[0071] In one embodiment of the present invention, the second sending module includes:
[0072] A second determination submodule, configured for the management terminal to determine a data type corresponding to the structured data according to the structured data and the historical information, wherein the data type includes abnormal data and non-abnormal data;
[0073] The third determination submodule is configured to, when the data type of the structured data is the non-abnormal data, cause the management end to determine that the current structured data is the qualified data.
[0074] It should be noted that the data type corresponding to the structured data is determined based on the structured data and historical information, wherein the data type includes abnormal data and non-abnormal data; when the data type of the structured data is non-abnormal data, the management end determines that the current structured data is qualified data.
[0075] In a specific implementation, when the data type of the structured data is non-abnormal data, the corresponding structured data is determined to be qualified data.
[0076] In one embodiment of the present invention, it also includes:
[0077] A fourth determination submodule, configured to, when the data type of the structured data is the abnormal data, determine by the management end that the current structured data is unqualified data;
[0078] The first sending submodule is used for the management end to generate a second email message according to the unqualified data, and send the unqualified data and the second email message to the service end.
[0079] It should be noted that when the data type of the structured data is abnormal data, the management end determines that the current structured data is unqualified data, and generates a second email message based on the unqualified data, and sends the unqualified data and the second email message to the business end.
[0080] In a specific implementation, intelligent identification of unqualified data is implemented in the management end, and the unqualified data is formed into a second email message, which is notified to the business end in the form of an email.
[0081] In a specific example, the data returned by the data middle platform, i.e., the data end, will form part of the data standard to verify the data content uploaded by the business end at the management end; the management end will mark completely unstructured data and classify it as unqualified; the data content that fails the verification will be returned by the management end to the front-line business management node in the form of an email, and the sales management department, i.e., the business end, will be notified to urge it to modify the uploaded data through the upload tool on the business end.
[0082] In an embodiment of the present invention, the fourth determining submodule includes:
[0083] A first acquisition unit, configured for the management end to acquire data attributes of the structured data, wherein the data attributes include a data structure or a data format;
[0084] The first determination unit is used to determine that the current structured data is the unqualified data when the data structure is inconsistent with the preset structure; or, when the data structure is inconsistent with the preset format, the management end determines that the current structured data is the unqualified data.
[0085] It should be noted that the data attributes of structured data are used to determine whether the data is unqualified. That is, when the data content is inconsistent with the core system, or the data format is incorrect, the data will be determined as unqualified data and reported to the corresponding responsible persons and supervisors after integration;
[0086] In a specific implementation, data files with extremely chaotic formats and no structure and data files that trigger sensitive words will be centrally identified and warned via email.
[0087] An embodiment of the present application further discloses a processing system based on financial data, the system involving a management end, a business end and a data end, wherein the data end includes a first acquisition module, a fourth sending module and a fifth sending module;
[0088] The first acquisition module is used for, when the data end receives a write request sent by the management end, the data end acquires historical data from the historical database according to the write request;
[0089] The fourth sending module is used for the data end to generate historical information according to the historical data, and send the historical information to the management end; the management end is used to determine qualified data according to the historical information, and send the qualified data to the data end;
[0090] The fifth sending module is used for the data end to generate summary data according to the qualified data and a preset hierarchical processing model, and send the summary data to the management end.
[0091] It should be noted that when the data end receives a write request sent by the management end, the data end obtains historical data in the historical database through the write request, wherein the historical data includes structured data information stored in the past, and generates historical information through the historical data, and sends the historical information to the management end; the management end obtains qualified data by screening the historical information, and sends the qualified data to the data end; the data end generates summary data based on the qualified data and the preset hierarchical processing model, and sends the summary data to the management end.
[0092] In a specific implementation, the structured data processed by the management end interacts with the data middle platform, i.e., the data end. The data source from the business end will be written into the data middle platform, i.e., the data end, after being structured by the management end. At the same time, the data middle platform, i.e., the data end, will also provide historical data for evaluating semi-structured data for the business's qualification standards.
[0093] A hierarchical processing model for structured data has been established within the data middle platform, i.e. the data end, which can effectively handle data updates, record data trajectories, and save inventory analysis content, and effectively summarize and compare with other business and financial data on the data middle platform, i.e. the data end.
[0094] The summary data formed by the data middle platform, i.e. the data end, includes: other list data and / or difference data of the data middle platform, i.e. the data end, wherein the difference data is the difference between the semi-structured data and the financial data or the business data; when there is difference data, the data end will summarize the difference data and other list data and send them to the management end together, and use the email sending service of the management end to automatically notify the front-line business management department and the sales management department, i.e. the business end, in the form of a weekly report.
[0095] In one embodiment of the present invention, the fourth sending module includes:
[0096] A second generating submodule, configured for the data end to generate a qualification standard for evaluating structured data based on the historical data;
[0097] The third generation submodule is used by the data end to generate historical information based on the historical data and the qualification standard.
[0098] It should be noted that historical data can be used to evaluate the eligibility criteria of structured data, and historical information can be generated in combination with historical data, and the historical information can be sent to the management end, and the management end determines the qualified data based on the historical information.
[0099] In one embodiment of the present invention, it also includes:
[0100] A sixth sending module is used for the data end to generate a report based on the summary data and send the report to the business end.
[0101] It should be noted that the data end will flow other list data together to the front-end report for use by the business department, i.e. the business end.
[0102] An embodiment of the present application further discloses a processing system based on financial data, the system involving a management end, a business end and a data end, wherein the business end includes a first acquisition module, a seventh sending module and a first allocation module;
[0103] The first acquisition module is used for the service end to acquire the data to be transmitted through a human-computer interaction method in response to the data transmission demand of the user;
[0104] The seventh sending module is used for the service end to pre-process the data to be transmitted to generate source data, and send the source data to the management end; the management end is used to obtain difference data and first email information based on the source data, or the management end is used to obtain unqualified data and second email information based on the source data;
[0105] The first allocation module is used for allocating the difference data and the first email message to the first target object when the business end receives the difference data and the first email message sent by the management end; or, when the business end receives the unqualified data and the second email message sent by the management end, the business end allocates the unqualified data and the second email message to the second target object; or, when the business end receives the report sent by the data end, the business end allocates the report to a third target object.
[0106] It should be noted that the business end includes the sales management department and front-line salesmen; the email information sent by the management end is allocated to the corresponding target object.
[0107] In a specific implementation, the application scenario on the business side is the semi-structured data between the financial system and the business system; at this point, the front-line business management personnel will upload the semi-structured data files generated in their daily work to the server under the management side through the front-end upload tool.
[0108] In a specific example, during the file upload process, the business department can choose direct office work files represented by Excel files, TXT files, and Word files. Unless there are pre-established work task goals, there is no restriction on the specific uploaded data content structure.
[0109] Beneficial effects of the present invention:
[0110] Semi-structured data reading and structured processing, semi-structured data file management, abnormal data identification, and automatic email notification are realized through the management end; middle-end data query and result summary are realized through the data end.
[0111] After the data completes the previous batch processing, that is, structured data is formed in the management end and enters the data middle platform, that is, the data end, the data middle platform, that is, the data end, provides corresponding standards for batch processing and real-time processing for the corresponding structured data, realizing the process integration from source data to structured data to data middle platform, that is, data end to BI front-end interface / data push, that is, business end.
[0112] After the data is displayed on the BI front end or pushed to the target business platform, business personnel can implement structured cross-query or data application of the uploaded data and other business data.
[0113] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.
[0114] Although the preferred embodiments of the present application have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present application.
[0115] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements.
[0116] The above is a detailed introduction to a financial data processing system provided by the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea. At the same time, for general technical personnel in this field, according to the idea of the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.
Claims
1. A processing system based on financial data, characterized in that: The system involves a management end, a service end and a data end, wherein the management end includes a first generating module, a first sending module, a second sending module, a third sending module and a server for storing data files; The first generation module is used for the management end to obtain a data file in the server according to a preset timed task, and generate structured data according to the data file; the first generation module includes: a first determination submodule, used for the management end to determine the change data in the data file, wherein the change data includes unstructured data and semi-structured data; the first generation submodule is used for when the change data is the semi-structured data, the management end performs structured processing on the semi-structured data to generate structured data; The first sending module is used for the management end to generate a write request according to the structured data, and send the write request to the data end; the data end is used to obtain historical information according to the write request, and send the historical information to the management end; The second sending module is used for the management end to screen out qualified data from the structured data according to the historical information, and send the qualified data to the data end; the data end is used to generate summary data according to the qualified data, and send the summary data to the management end; The third sending module is used for, when there is difference data in the summary data, the management end generating a first email message according to the difference data in the summary data, and sending the difference data and the first email message to the service end; The data end includes a first acquisition module, a fourth sending module and a fifth sending module; the first acquisition module is used for the data end to acquire historical data in a historical database according to the write request when the data end receives a write request sent by the management end; the fourth sending module is used for the data end to generate historical information according to the historical data and send the historical information to the management end; the management end is used to determine qualified data according to the historical information and send the qualified data to the data end; the fifth sending module is used for the data end to generate summary data according to the qualified data and a preset hierarchical processing model and send the summary data to the management end; wherein the historical data includes structured data information stored in the past; The fourth sending module includes: a second generating submodule, which is used by the data end to generate a qualified standard for evaluating structured data according to the historical data; a third generating submodule, which is used by the data end to generate historical information according to the historical data and the qualified standard; the historical data is used to evaluate the qualified standard of structured data, and the historical information is generated in combination with the historical data, and the historical information is sent to the management end, and the management end determines the qualified data according to the historical information; A sixth sending module, configured for the data end to generate a report based on the summary data, and send the report to the business end; The business end includes a first acquisition module, a seventh sending module and a first allocation module; the first acquisition module is used for the business end to obtain the data to be transmitted through human-computer interaction in response to the user's data transmission requirements; the seventh sending module is used for the business end to pre-process the data to be transmitted to generate source data, and send the source data to the management end; the management end is used to obtain difference data and a first email message based on the source data, or the management end is used to obtain unqualified data and a second email message based on the source data; the first allocation module is used for when the business end receives the difference data and the first email message sent by the management end, the business end allocates the difference data and the first email message to a first target object; or, when the business end receives the unqualified data and the second email message sent by the management end, the business end allocates the unqualified data and the second email message to a second target object; or, when the business end receives the report sent by the data end, the business end allocates the report to a third target object.
2. The system according to claim 1, characterized in that Also includes: The first storage module is used for storing the source data in the server when the management end receives the source data sent by the service end.
3. The system according to claim 1, characterized in that The second sending module includes: A second determination submodule, configured for the management terminal to determine a data type corresponding to the structured data according to the structured data and the historical information, wherein the data type includes abnormal data and non-abnormal data; The third determination submodule is configured to, when the data type of the structured data is the non-abnormal data, cause the management end to determine that the current structured data is the qualified data.
4. The system according to claim 3, characterized in that Also includes: A fourth determination submodule, configured to, when the data type of the structured data is the abnormal data, determine by the management end that the current structured data is unqualified data; The first sending submodule is used for the management end to generate a second email message according to the unqualified data, and send the unqualified data and the second email message to the service end.
5. The system according to claim 4, characterized in that The fourth determining submodule includes: A first acquisition unit, configured for the management end to acquire data attributes of the structured data, wherein the data attributes include a data structure or a data format; The first determination unit is used to determine that the current structured data is the unqualified data when the data structure is inconsistent with the preset structure; or when the data format is inconsistent with the preset format, the management end determines that the current structured data is the unqualified data.
Citation Information
Patent Citations
Data processing method and device, electronic equipment and storage medium
CN113269547A
Data verification method and device, electronic equipment and storage medium
CN117034035A