Method for processing automatic data bid drop based on new bank system
Through automated data delisting processing methods, data consistency and accuracy problems in the bank's core system are solved, accurate data matching and delisting are achieved, system stability and security are improved, and customer information and financial data are ensured. sex.
Patent Information
- Application Number
- CN202410956162.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-17
- Publication Date
- 2024-11-08
AI Technical Summary
There are problems in the bank's core system with insufficient consistency of basic data, inconsistent data formats, lack of standardization of field naming and inaccurate data accuracy, resulting in data redundancy, duplication or error, affecting the accuracy of system operation and data analysis, and increasing the system The complexity and risks of maintenance and management.
Through automated data delisting processing methods, we can define the scope of delisting data of the bank system, calibrate key features and delisting items, collect data dictionary template root dictionary, and perform global and local key features matching to ensure accurate delisting of data and improve data consistency and accuracy.
It improves the accuracy and reliability of data, reduces the complexity and risks of data management, improves the stability and security of the banking system, and ensures the confidentiality and integrity of customer information and financial data.
Smart Images

Figure CN118916705A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of banking systems, and in particular to a processing method for automatically marking data based on a newly built banking system. Background Art
[0002] At present, many core banking system data management problems exist, such as insufficient consistency of basic data, inconsistent data formats, lack of standardization in field naming, confusion of data types, and inaccurate data precision. In banking systems, insufficient consistency of basic data may lead to data redundancy, duplication or errors, affecting the overall operation of the system and the accuracy of data analysis. At the same time, inconsistent data formats will also make data analysis and processing difficult, increasing the complexity of system maintenance and management. In addition, inaccurate data precision will also affect the accuracy of data analysis results, increasing the possibility of risks and misjudgments.
[0003] In the real world, data standardization and governance of the core banking system is particularly necessary. By ensuring the consistency of basic data, data format, standardized field naming, unified data types, and improved data accuracy, data accuracy and reliability can be improved, and the complexity and risk of data management can be reduced. At the same time, standardized data management processes and operating specifications can also help improve the stability and security of banking systems and protect the confidentiality and integrity of customer information and financial data. Summary of the invention
[0004] In view of the above problems, the present invention is proposed to provide a processing method for automated data tagging based on a new bank system that overcomes the above problems or at least partially solves the above problems.
[0005] According to one aspect of the present invention, a method for processing data drop based on bank system automation is provided, the method comprising:
[0006] Define the scope of the bid-losing data in the banking system;
[0007] Identify key features of bid-drop data in banking systems;
[0008] Mark the bidding data items of the banking system;
[0009] Calibrating key features of data dictionary template;
[0010] Collection data dictionary template root dictionary;
[0011] Collect key features of data dictionary template data and drop item model;
[0012] The bidding data of the banking system is matched with all key features;
[0013] The local key features of the bid-lost data in the banking system are matched and the details of the unbidden data are calibrated.
[0014] Optionally, the scope of the bank system bid data may include:
[0015] Set the range of the bank system's bid rejection data, i.e. the starting and ending positions, to facilitate customizing the impact range of bid rejection and narrow the scope of bid rejection to the table and business area level.
[0016] Optionally, the key features of the calibrated bank system bid data specifically include:
[0017] Select the key features of the dropped label data, use the Chinese name plus length of the dropped label field as the feature, and use the Chinese name plus field type as the feature;
[0018] Feature calibration includes: calibrating the data features of the in-line data dictionary template for subsequent similarity matching between the two.
[0019] Optionally, the items for marking the bidding data of the calibrated bank system specifically include:
[0020] Set the field attributes of the marked data when matching similarity.
[0021] Optionally, the field attributes specifically include: the length of the marked data, the data type, the Chinese name, the English name and the enumeration value.
[0022] Optionally, the key features of the calibration data dictionary template specifically include:
[0023] Select key features of the data dictionary template, including using the Chinese name plus length of the unmarked field as a feature, and using the Chinese name plus field type as a feature.
[0024] Optionally, the collected data dictionary template root dictionary specifically includes:
[0025] In the case where similarity matching cannot be completed, a second backup bid is conducted by splitting the keyword roots and combining similarity matching bids.
[0026] Optionally, the key features of the data dictionary template data and the bid item model specifically include:
[0027] Connect to the in-line data dictionary platform and store the data dictionary template in the memory in the form of data key feature key-data label item calibration value as the data template value for key feature similarity matching.
[0028] Optionally, the bank system bidding data full key feature matching bidding specifically includes:
[0029] Used for similarity matching of key features of bidding data in the banking system and key features of collected data dictionary template data and key values in the bidding item template;
[0030] The similarity threshold is set by yourself, and a similarity of 90% or more is recommended;
[0031] In case of multiple similarity matches, the highest similarity is selected.
[0032] Optionally, the local key feature matching of the bidding data of the bank system specifically includes:
[0033] As a backup for all key feature matching, when full labeling cannot be completed, we will perform similarity matching based on word roots to complete field labeling. Labeling can only complete field labeling.
[0034] The attribute values of the field include the length of the data, data type, Chinese name, English name, and enumeration value, which need to be manually checked and confirmed later.
[0035] The present invention provides a processing method based on the automated data bidding of the banking system, the processing method comprising: delineating the bidding data range of the banking system; calibrating the key features of the bidding data of the banking system; calibrating the bidding items of the bidding data of the banking system; calibrating the key features of the data dictionary template; collecting the root dictionary of the data dictionary template; collecting the key features of the data dictionary template data and the bidding item model; matching the bidding data of the banking system with all key features; matching the bidding data of the banking system with local key features, and calibrating the details of the failed data. The stability and security of the banking system are improved, and the confidentiality and integrity of customer information and financial data are guaranteed.
[0036] The above description is only an overview of the technical solution of the present invention. In order to more clearly understand the technical means of the present invention, it can be implemented according to the contents of the specification. In order to make the above and other purposes, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are listed below. BRIEF DESCRIPTION OF THE DRAWINGS
[0037] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative work.
[0038] Figure 1 A flowchart of a method for processing automated data tagging based on a banking system is provided in an embodiment of the present invention. DETAILED DESCRIPTION
[0039] The exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although the exemplary embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided to enable a more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.
[0040] The terms "comprises" and "having" and any variations thereof in the description embodiments, claims and drawings of the present invention are intended to cover non-exclusive inclusions, for example, including a series of steps or units.
[0041] The technical solution of the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments.
[0042] like Figure 1 As shown, a processing method based on automated data tagging of a banking system comprises:
[0043] Step S1: In the newly created system, the data to be tagged is firstly filtered out from the database or data table file through the preset filtering conditions or algorithms. The filtering conditions are based on the source, type, timestamp, and system attributes of the data. The filtered data will be marked as "data to be tagged" and stored in a special buffer or temporary data table.
[0044] Step S2: Next, the data to be marked is analyzed in detail to extract key features for calibration. Key features may include specific field values, text content, and image features of the data, such as the Chinese name of the field, the length of the field, and the type of the field. Combinations such as "Chinese name", "Chinese name plus length", and "field name plus length plus field type" are used as key features for matching, which is convenient for subsequent matching with the data dictionary template within the row.
[0045] Step S3: On the basis of the above, the data to be marked is marked, and the marking item to which it should belong is determined according to the key features of the data to be marked. The marking item may be a predefined "field English name", "field length", "field type", or "character enumeration value". The field marking of these marking items is completed during the subsequent automatic matching.
[0046] Step S4: After completing the calibration and collection of the key features of the data to be marked, start the calibration of the key features of the standard template data; select or connect the standard template data within the bank, which will be used as a reference for subsequent data marking, and calibrate the key features of these template data to ensure that these features can accurately represent the characteristics of the template data.
[0047] The key features should be consistent with the above step S2 (such as the Chinese name of the field, "Chinese name plus length", "field name plus length plus field type").
[0048] Step S5: After completing step S4, start collecting the standard template root dictionary. The root collection here should be a fallback when the key features of the data to be marked in the above steps S2 and S4 cannot match the key features of the template data. The field name of the data to be marked will be split in the form of word segmentation, such as splitting "account name" into "account" plus "name"; then match and mark each word with the standard root template, and finally splice them to complete the automatic marking of the data.
[0049] Step S6: After completing the above step S5, collect the key features of the standard template data and the model of the dropped items. The collection here is to integrate the key features of the standard template data and the dropped items into a model, which is a rule-based classifier, machine learning model, etc. The collected model parameters and configuration information will also be stored in a special buffer or temporary data table.
[0050] Step S7: After completing the preparations of the above steps S1-S6, start to complete the full key feature matching of the data to be marked.
[0051] Match all key features of the data to be marked with the key features of the standard template data, and use appropriate matching algorithms (such as similarity calculation, distance measurement) to evaluate the accuracy of the match. If the match is successful, mark the data to be marked according to the marking items of the template data.
[0052] Step S8: For data that failed to be successfully tagged in the full key feature matching, try to match the local key features. Local matching may focus on a specific part or attribute of the data, not the entire data set, such as splitting "account name" into "account" plus "name", and matching each word with the standard root template, and also tagged the data according to the tag items of the template data.
[0053] Step S9: For data that still cannot be successfully tagged after the above steps, the failure details of the data that have not been successfully tagged are calibrated and the failure details are recorded. The failure details may include the cause of failure, matching results, data characteristics and other information; the failure details are stored in a special log or database for subsequent problem analysis and improvement.
[0054] Beneficial effects: By ensuring the consistency of basic data, data format consistency, standard field naming, unified data types and improved data precision, the accuracy and reliability of data can be improved, and the complexity and risk of data management can be reduced. At the same time, standardized data management processes and operating specifications can also help improve the stability and security of the banking system and protect the confidentiality and integrity of customer information and financial data.
[0055] The above specific implementation methods further illustrate the objectives, technical solutions and beneficial effects of the present invention in detail. It should be understood that the above are only specific implementation methods of the present invention and are not intended to limit the scope of protection of the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the scope of protection of the present invention.
Claims
1. A method for processing automated data bids based on a banking system. It is characterized in that The processing method comprises: Define the scope of the bid-losing data in the banking system; Identify key features of bid-drop data in banking systems; Mark the bidding data items of the banking system; Calibrating key features of data dictionary template; Collection data dictionary template root dictionary; Collect key features of data dictionary template data and drop item model; The bank system’s bidding data is matched with all key features; The local key features of the bid-lost data in the banking system are matched and the details of the unbidden data are calibrated.
2. A method for processing bank system automated data tags according to claim 1, It is characterized in that The scope of the bank system bid-losing data specifically includes: Set the range of the bank system's bid rejection data, i.e. the starting and ending positions, to facilitate customizing the impact range of bid rejection and narrow the scope of bid rejection to the table and business area level.
3. A method for processing bank system automated data tags according to claim 1, It is characterized in that The key features of the calibrated bank system bid data specifically include: Select the key features of the dropped label data, use the Chinese name plus length of the dropped label field as the feature, and use the Chinese name plus field type as the feature; Feature calibration includes: calibrating the data features of the in-line data dictionary template for subsequent similarity matching between the two.
4. A method for processing bank system automated data bids according to claim 1, It is characterized in that The items for the data of the calibrated bank system include: Set the field attributes of the marked data when matching similarity.
5. A method for processing bank system automated data bids according to claim 4, It is characterized in that The field attributes specifically include: the length of the marked data, the data type, the Chinese name, the English name and the enumeration value.
6. A method for processing bank system automated data drop according to claim 1, It is characterized in that The key features of the calibration data dictionary template specifically include: Select key features of the data dictionary template, including using the Chinese name plus length of the unmarked field as a feature, and using the Chinese name plus field type as a feature.
7. A method for processing bank system automated data drop according to claim 1, It is characterized in that The collection data dictionary template root dictionary specifically includes: In the case where similarity matching cannot be completed, a second backup bid is conducted by splitting the keyword roots and combining similarity matching bids.
8. A method for processing bank system automated data tags according to claim 1, It is characterized in that The key features of the data collection dictionary template data and the drop item model specifically include: Connect to the in-line data dictionary platform and store the data dictionary template in the memory in the form of data key feature key-data label item calibration value as the data template value for key feature similarity matching.
9. A method for processing bank system automated data drop according to claim 1, It is characterized in that The bank system bid data full key feature matching bid specifically includes: Used for similarity matching of key features of bidding data in the banking system and key features of collected data dictionary template data and key values in the bidding item template; The similarity threshold is set by yourself, and a similarity of 90% or more is recommended; In case of multiple similarity matches, the highest similarity is selected.
10. A method for processing data drop based on bank system automation according to claim 1, It is characterized in that The local key feature matching and bidding of the bidding data of the banking system specifically includes: As a backup for all key feature matching, when full labeling cannot be completed, we will perform similarity matching based on word roots to complete field labeling. Labeling can only complete field labeling. The attribute values of the field include the length of the data, data type, Chinese name, English name, and enumeration value, which need to be manually checked and confirmed later.
Citation Information
Patent Citations
Benchmarking method and system for data items, files and databases
CN110196834A
Data standardization method and device and electronic equipment
CN111078639A
Optimization management method based on data standard system bidding
CN111680029A
Method and system for cleaning government affair data through standard data elements
CN111858567A
Data standardization method and system based on cloud block chain technology
CN114417859A
