A method, system, device and medium for benchmarking financial industry data standards
By using an automated data standard benchmarking method, the problems of large fluctuations in data standard benchmarking quality and low efficiency in the financial industry have been solved, achieving improved data quality stability and efficiency, and simplifying the data governance process.
Patent Information
- Application Number
- CN202410797333.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-06-20
- Publication Date
- 2024-11-29
- Estimated Expiration
- 2044-06-20
AI Technical Summary
In existing technologies, the benchmarking of data standards in the financial industry relies on manual processing, resulting in large fluctuations in quality and low efficiency, making it difficult to meet the needs of improving data quality.
This paper provides a data standard benchmarking method for the financial industry. By acquiring a data dictionary, configuring tags, performing keyword benchmarking, similarity benchmarking, and data detail benchmarking, benchmarking results are generated and manually reviewed, thereby achieving automation and quality stability of data standard benchmarking.
It has improved the quality, stability, and efficiency of data standard benchmarking in the financial industry, unified the benchmarking process of data dictionaries, and simplified data governance work.
Smart Images

Figure CN118365290B_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the technical field of data standard benchmarking, and specifically relates to a method, system, device and medium for data standard benchmarking in the financial industry. Background Art
[0002] With the improvement of data quality requirements in the financial industry, relevant application systems have been established for data modeling and data governance. However, there are still many difficulties in actual data management and control, especially in data standard benchmarking. The existing data standard benchmarking scheme mainly relies on manual experience in business attributes and technical attributes carried by data fields, combined with the classification, name, business definition, business rules, standard basis, data category, data length, data code value and other information of data standards, to perform manual matching and judgment, and finally complete data benchmarking. Due to the differences in the time it takes for each person to understand the business and the differences in each person's business capabilities, the quality of data standard benchmarking varies from person to person and fluctuates greatly. In addition, data benchmarking is done through manual processing and manual table matching, which is extremely inefficient and not conducive to the subsequent data governance and data quality improvement work.
[0003] In short, data standard benchmarking is an important part of improving data quality. The existing data standard benchmarking scheme relies on manual work. Due to individual differences, the quality of data standard benchmarking fluctuates greatly, and the efficiency of manual benchmarking is low.
[0004] This is a shortcoming of the prior art. Therefore, in view of the above-mentioned defects in the prior art, it is very necessary to provide a method, system, equipment and medium for benchmarking data standards in the financial industry. Summary of the invention
[0005] The above-mentioned data standard benchmarking in the prior art is an important part of improving data quality. The existing data standard benchmarking scheme relies on manual operation. Due to individual differences, the benchmarking quality of data standards fluctuates greatly, and the manual benchmarking efficiency is low. The present invention provides a method, system, device and medium for data standard benchmarking in the financial industry to solve the above-mentioned technical problems.
[0006] In a first aspect, the present invention provides a method for benchmarking financial industry data standards, comprising the following steps:
[0007] S1. Obtain the data dictionary of the application system to be benchmarked against data standards as the data dictionary to be benchmarked, and set a benchmarking mechanism for the data dictionary to be benchmarked;
[0008] S2. Configure labels for data standards in the data standard library, and configure labels for the data dictionary to be benchmarked after the benchmarking mechanism is set up;
[0009] S3. Perform keyword benchmarking, similarity benchmarking, and data detail benchmarking on the data dictionary and data standards to be benchmarked that have completed label configuration according to the benchmarking mechanism, and generate benchmarking results;
[0010] S4. Query data benchmarking suggestions based on the benchmarking results, and conduct manual benchmarking and benchmarking review based on the data benchmarking suggestions.
[0011] Furthermore, the specific steps of step S1 are as follows:
[0012] S11. Obtain a benchmarking request, and parse the benchmarking data dictionary of the application system from the benchmarking request;
[0013] S12. Selecting a data standard to be used for benchmarking for the data dictionary to be benchmarked, and generating a data standard library;
[0014] S13. Select a benchmarking mechanism and a benchmarking mode for the data dictionary to be benchmarked.
[0015] Further, in step S13, a benchmarking mechanism and a benchmarking mode are selected for each to-be-benchmarked data dictionary as a whole or a benchmarking mechanism and a benchmarking mode are selected for each to-be-benchmarked data dictionary in sequence according to a set order;
[0016] The benchmarking mechanism includes keyword benchmarking, similarity benchmarking and data detail benchmarking, and the benchmarking modes include real-time mode and batch operation mode.
[0017] Furthermore, the specific steps of step S2 are as follows:
[0018] S21. Obtain each data standard in the data standard library, and locate each data standard in turn;
[0019] S22. Using a keyword processing method to obtain candidate keywords based on the definition of the positioning data standard;
[0020] S23. Determine the final keyword from the candidate keywords in response to the selection of the benchmarking personnel;
[0021] S24. Use the final keyword to complete the label configuration of the located data standard.
[0022] Furthermore, the specific steps of step S22 are as follows:
[0023] S221. Obtaining definition information of positioning data standards;
[0024] S222. Perform word segmentation processing on the definition information of the located data standard, conduct correlation analysis on the word segmentation results and the standard subject, standard category and standard subcategory, and determine the candidate keywords and priority order;
[0025] Step S23 is specifically as follows:
[0026] S231. The benchmarking personnel obtains the attributes of the definition information of the located data standard, wherein the attributes of the definition information of the data standard include business definition, business rules, standard basis, data category and code encoding;
[0027] S232. The benchmarking personnel select the final keyword from the candidate keywords based on the attributes of the definition information of the data standard.
[0028] Furthermore, the specific steps of step S3 are as follows:
[0029] S31. Obtaining the benchmarking mechanism of the data dictionary to be benchmarked;
[0030] S32. When the keyword benchmarking in the benchmarking mechanism has been configured, obtain the definition information of the data dictionary to be benchmarked, and use the keyword processing method to obtain the data dictionary keywords and priority order;
[0031] S33. Match the identified data dictionary keywords with the final keywords of each data standard in the data standard library in order of priority, and recommend the data standards whose matching degree exceeds the threshold to the data dictionary;
[0032] S34. When similarity benchmarking has been configured in the benchmarking mechanism, query each benchmarked data dictionary in the application system to which the data dictionary to be benchmarked belongs;
[0033] S35. After deconstructing the definition attributes of the data dictionary to be benchmarked and each benchmarked data dictionary, keywords are extracted, similarity analysis is performed based on the keywords, the benchmarked data dictionary with the highest similarity is identified as the similar data dictionary, and the data standard followed by the similar data dictionary is recommended to the data dictionary to be benchmarked;
[0034] S36. When the data detail benchmarking in the benchmarking mechanism has been configured, the master data stored in the data dictionary to be benchmarked is scanned and feature analyzed to locate the actual business meaning of the data dictionary to be benchmarked, and the data standards related to the actual business meaning are recommended to the data dictionary to be benchmarked;
[0035] S37. Generate benchmarking results to complete the recommended data standards of the data dictionary of the benchmarking content in the benchmarking mechanism.
[0036] Furthermore, the specific steps of step S4 are as follows:
[0037] S41. Receive a request from a benchmarking person to query the recommended data standard of the data dictionary in the benchmarking result and generate a benchmarking suggestion;
[0038] S42. Receive instructions from the benchmarking personnel, determine the final data standard to be used from the data standards recommended by the benchmarking suggestions or perform manual benchmarking;
[0039] S43. Receive instructions from auditors, and review and publish approved data standards from the application system dimension or data dictionary dimension.
[0040] In a second aspect, the present invention provides a system for benchmarking financial industry data standards, including:
[0041] A data dictionary benchmarking mechanism setting module is used to obtain a data dictionary to be benchmarked by the application system as the data dictionary to be benchmarked, and to set a benchmarking mechanism for the data dictionary to be benchmarked;
[0042] The label configuration module for data standards and data dictionaries is used to configure labels for data standards in the data standard library, and to configure labels for the data dictionary to be benchmarked after the benchmarking mechanism is set up;
[0043] The benchmarking module is used to perform keyword benchmarking, similarity benchmarking and data detail benchmarking on the data dictionary and data standards to be benchmarked after the label configuration is completed according to the benchmarking mechanism, and generate the benchmarking results;
[0044] The benchmarking verification module is used to query data benchmarking suggestions based on the benchmarking results, and to perform manual benchmarking and benchmarking review based on the data benchmarking suggestions.
[0045] Furthermore, the data dictionary benchmarking mechanism setting module includes:
[0046] A benchmarking request unit, used to obtain a benchmarking request and parse the benchmarking data dictionary of the application system from the benchmarking request;
[0047] A data standard library selection unit is used to select a data standard for the data dictionary to be benchmarked and generate a data standard library;
[0048] The benchmarking mechanism setting unit is used to select a benchmarking mechanism and a benchmarking mode for the data dictionary to be benchmarked.
[0049] Furthermore, the label configuration module of the data standard and data dictionary includes:
[0050] A data standard positioning unit is used to obtain each data standard in the data standard library and locate each data standard in turn;
[0051] A candidate keyword generating unit, used for obtaining candidate keywords by using a keyword processing method according to the definition of the located data standard;
[0052] A final keyword determination unit, used to determine a final keyword from the candidate keywords in response to the selection of the benchmarking personnel;
[0053] The data standard label configuration unit is used to complete the label configuration of the located data standard using the final keyword.
[0054] Furthermore, the benchmarking module includes:
[0055] A benchmarking mechanism acquisition unit, used to acquire a benchmarking mechanism of a data dictionary to be benchmarked;
[0056] A keyword benchmarking unit, when keyword benchmarking is configured in the benchmarking mechanism, obtains definition information of the data dictionary to be benchmarked, and uses a keyword processing method to obtain data dictionary keywords and priority order;
[0057] A keyword matching unit, used to match the identified data dictionary keywords with the final keywords of each data standard in the data standard library in order of priority, and recommend the data standards whose matching degree exceeds a threshold to the data dictionary;
[0058] A similarity benchmarking unit, used for querying each benchmarked data dictionary in the application system to which the data dictionary to be benchmarked belongs when similarity benchmarking has been configured in the benchmarking mechanism;
[0059] A similarity matching unit is used to extract keywords after deconstructing the definition attributes of the data dictionary to be benchmarked and each benchmarked data dictionary, perform similarity analysis based on the keywords, identify the benchmarked data dictionary with the highest similarity as the similar data dictionary, and recommend the data standard followed by the similar data dictionary to the data dictionary to be benchmarked;
[0060] The data detail benchmarking unit is used to scan and analyze the characteristics of the master data stored in the data dictionary to be benchmarked, locate the actual business meaning of the data dictionary to be benchmarked, and recommend data standards related to the actual business meaning to the data dictionary to be benchmarked when the data detail benchmarking in the benchmarking mechanism has been configured;
[0061] The benchmarking result generating unit is used to generate the benchmarking result for the recommended data standard of the data dictionary of the benchmarking content in the benchmarking mechanism.
[0062] Furthermore, the benchmarking and verification module includes:
[0063] A benchmarking suggestion generating unit, used for receiving a request from a benchmarking person to query the recommended data standard of the data dictionary in the benchmarking result and generating a benchmarking suggestion;
[0064] A benchmark determination unit, used to receive instructions from benchmark personnel, determine the final data standard to be used from the data standards recommended by the benchmarking suggestions, or perform manual benchmarking;
[0065] The data standard review unit is used to receive instructions from reviewers and review and publish the approved data standards from the application system dimension or data dictionary dimension.
[0066] In a third aspect, the present invention provides a device, comprising a processor and a memory;
[0067] The memory is used to store a computer program, and the processor is used to call and run the computer program from the memory, so that the device executes the method described in the first aspect above.
[0068] In a fourth aspect, the present invention provides a storage medium,
[0069] The storage medium stores instructions, which, when executed on a computer, enable the computer to execute the method described in the first aspect.
[0070] The beneficial effects of the present invention are:
[0071] The method, system, device and medium for benchmarking data standards in the financial industry provided by the present invention unify the process of benchmarking data standards using the data dictionary of the financial industry application system, achieve quality stability of the benchmarking data standards, and improve the efficiency of the benchmarking.
[0072] In addition, the invention has a reliable design principle, a simple structure and a very broad application prospect.
[0073] It can be seen that compared with the prior art, the present invention has outstanding substantive features and significant progress, and the beneficial effects of its implementation are also obvious. BRIEF DESCRIPTION OF THE DRAWINGS
[0074] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.
[0075] Figure 1 It is a flowchart of an embodiment of the method for benchmarking financial industry data standards of the present invention.
[0076] Figure 2 It is a flow chart of another embodiment of the method for benchmarking financial industry data standards of the present invention.
[0077] Figure 3 It is a schematic diagram of the device for benchmarking financial industry data standards in the present invention. DETAILED DESCRIPTION
[0078] In order to enable those skilled in the art to better understand the technical solutions in the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.
[0079] Embodiment 1:
[0080] like Figure 1 As shown, the present invention provides a method for benchmarking financial industry data standards, comprising the following steps:
[0081] S1. Obtain the data dictionary of the application system to be benchmarked against data standards as the data dictionary to be benchmarked, and set a benchmarking mechanism for the data dictionary to be benchmarked;
[0082] S2. Configure labels for data standards in the data standard library, and configure labels for the data dictionary to be benchmarked after the benchmarking mechanism is set up;
[0083] S3. Perform keyword benchmarking, similarity benchmarking, and data detail benchmarking on the data dictionary and data standards to be benchmarked that have completed label configuration according to the benchmarking mechanism, and generate benchmarking results;
[0084] S4. Query data benchmarking suggestions based on the benchmarking results, and conduct manual benchmarking and benchmarking review based on the data benchmarking suggestions.
[0085] Embodiment 2:
[0086] like Figure 2 As shown, the present invention provides a method for benchmarking financial industry data standards, comprising the following steps:
[0087] S1. Obtain the data dictionary of the application system to be benchmarked as the data dictionary to be benchmarked, and set a benchmarking mechanism for the data dictionary to be benchmarked; the specific steps of step S1 are as follows:
[0088] S11. Obtain a benchmarking request, and parse the benchmarking data dictionary of the application system from the benchmarking request;
[0089] S12. Selecting a data standard to be used for benchmarking for the data dictionary to be benchmarked, and generating a data standard library;
[0090] Data dictionary definitions mainly include classification attributes, name attributes, business attributes, technical attributes, and management attributes;
[0091] S13. Selecting a benchmarking mechanism and a benchmarking mode for the data dictionary to be benchmarked; selecting a benchmarking mechanism and a benchmarking mode for each data dictionary to be benchmarked as a whole or selecting a benchmarking mechanism and a benchmarking mode for each data dictionary to be benchmarked in sequence according to a set order; the benchmarking mechanism includes keyword benchmarking, similarity benchmarking and data detail benchmarking, and the benchmarking mode includes a real-time mode and a batch operation mode;
[0092] S2. Configure labels for the data standards in the data standard library, and configure labels for the data dictionary to be benchmarked after the benchmarking mechanism is set up; the specific steps of step S2 are as follows:
[0093] S21. Obtain each data standard in the data standard library, and locate each data standard in turn;
[0094] S22. The keyword processing method is used to obtain candidate keywords based on the definition of the positioning data standard; the specific steps of step S22 are as follows:
[0095] S221. Obtaining definition information of positioning data standards;
[0096] S222. Perform word segmentation processing on the definition information of the located data standard, conduct correlation analysis on the word segmentation results and the standard subject, standard category and standard subcategory, and determine the candidate keywords and priority order;
[0097] S23. Determine the final keyword from the candidate keywords in response to the selection of the benchmarking personnel; Step S23 is as follows:
[0098] S231. The benchmarking personnel obtains the attributes of the definition information of the located data standard, wherein the attributes of the definition information of the data standard include business definition, business rules, standard basis, data category and code encoding;
[0099] S232. The benchmarking personnel selects the final keyword from the candidate keywords according to the attributes of the definition information of the data standard;
[0100] For example, for the following data standard configuration tags:
[0101] Standard topic: Participants
[0102] Standard Category: Organization
[0103] Standard name: Operation period start date
[0104] Business definition: The start date of the business term as specified in the organization's articles of association
[0105] Business rules: should be the start date of the business term in the organization's business license
[0106] Data type: Date
[0107] Among them, the definition information of the "operating period starting date" data standard is processed by the keyword processing method to form a keyword recommendation result, which is based on the priority of "participant", "organization", "operating period", "starting date", "start", "date", "business license", "articles of association", etc., and then the data standard maintenance personnel judge and select "organization", "operating period", "starting date", "business license" as keywords based on the candidate keywords in the application system for subsequent processing;
[0108] S24. Use the final keyword to complete the label configuration of the located data standard;
[0109] S3. Perform keyword matching, similarity matching and data detail matching on the data dictionary and data standard to be matched after tag configuration is completed according to the matching mechanism, and generate matching results; the specific steps of step S3 are as follows:
[0110] S31. Obtaining the benchmarking mechanism of the data dictionary to be benchmarked;
[0111] S32. When the keyword benchmarking in the benchmarking mechanism has been configured, obtain the definition information of the data dictionary to be benchmarked, and use the keyword processing method to obtain the data dictionary keywords and priority order;
[0112] S33. Match the identified data dictionary keywords with the final keywords of each data standard in the data standard library in order of priority, and recommend the data standards whose matching degree exceeds the threshold to the data dictionary;
[0113] For example, the following data dictionary keywords are mapped:
[0114] Classification attributes: Data dictionary
[0115] Name attribute
[0116] Application system: corporate customer information management
[0117] Database table English name: TBCCOIP0
[0118] Chinese name of database table: Participant table
[0119] Field English name: Oprt_Trm_StDt
[0120] Field Chinese name: Business license operation start date
[0121] Business attributes
[0122] Business scenario: Maintenance and use of basic information of corporate customers
[0123] Resource status: In use
[0124] Technical attributes
[0125] Data Type: Date
[0126] Manage properties
[0127] Affiliated department: Corporate Finance Department
[0128] Keyword matching is to introduce a language model, segment and understand the data dictionary definition information and other contents through keyword processing methods, and match the identified keywords with the configured data standard keywords according to their priorities. If you need to set keywords for the data dictionary manually, you can do so through the data dictionary label configuration function.
[0129] For example, in the above-mentioned "Business License Operation Start Date" data dictionary, the final application system keyword results are: "corporate customer", "participant", "business license", "start date", "operation"; the matching degree with the "operation period start date" data standard keywords "operation period", "start date", "business license" is high, so the application system recommends that the data dictionary adopt the "operation period start date" data standard;
[0130] S34. When similarity benchmarking has been configured in the benchmarking mechanism, query each benchmarked data dictionary in the application system to which the data dictionary to be benchmarked belongs;
[0131] S35. After deconstructing the definition attributes of the data dictionary to be benchmarked and each benchmarked data dictionary, keywords are extracted, similarity analysis is performed based on the keywords, the benchmarked data dictionary with the highest similarity is identified as the similar data dictionary, and the data standard followed by the similar data dictionary is recommended to the data dictionary to be benchmarked;
[0132] For example, the following data dictionaries are similarly benchmarked:
[0133] Classification attributes: Data dictionary
[0134] Name attribute
[0135] Application system: corporate customer information management
[0136] Database table English name: TBCCEBD0
[0137] Chinese name of database table: Enterprise basic information table
[0138] Field English name: Oprt_StDt
[0139] Field name in Chinese: The license indicates the start date of operation
[0140] Business attributes
[0141] Business scenario: Maintenance and use of corporate customer certificate information
[0142] Resource status: In use
[0143] Technical attributes
[0144] Data Type: Date
[0145] Manage properties
[0146] Affiliated department: Corporate Finance Department
[0147] The keyword processing method is used to form keyword recommendations for the above data dictionary definition information, namely "license", "indication", "operation", and "start date". Through the keyword recommendation of the data dictionary, keyword fuzzy matching is performed in the application system, and the recommended result "business license operation start date" data dictionary that has matched the data standard can be queried, and then the "license indication operation start date" is recommended to adopt the "operation period start date" data standard;
[0148] S36. When the data detail benchmarking in the benchmarking mechanism has been configured, the master data stored in the data dictionary to be benchmarked is scanned and feature analyzed to locate the actual business meaning of the data dictionary to be benchmarked, and the data standards related to the actual business meaning are recommended to the data dictionary to be benchmarked;
[0149] For example, if the data dictionary master data is scanned and analyzed for features, the ID card number is initially identified. Then the application system can match the recommended "ID card number" data standard based on this result;
[0150] S37. Generate benchmarking results for the recommended data standards of the data dictionary of the benchmarking content in the benchmarking mechanism;
[0151] S4. Query data benchmarking suggestions based on the benchmarking results, and perform manual benchmarking and benchmarking review based on the data benchmarking suggestions; the specific steps of step S4 are as follows:
[0152] S41. Receive a request from a benchmarking person to query the recommended data standard of the data dictionary in the benchmarking result and generate a benchmarking suggestion;
[0153] S42. Receive instructions from the benchmarking personnel, determine the final data standard to be used from the data standards recommended by the benchmarking suggestions or perform manual benchmarking;
[0154] S43. Receive instructions from auditors, and review and publish approved data standards from the application system dimension or data dictionary dimension.
[0155] Embodiment 3:
[0156] like Figure 3 As shown, a system for benchmarking financial industry data standards includes:
[0157] The data dictionary benchmarking mechanism setting module is used to obtain the data dictionary to be benchmarked by the application system as the data dictionary to be benchmarked, and set a benchmarking mechanism for the data dictionary to be benchmarked; the data dictionary benchmarking mechanism setting module includes:
[0158] A benchmarking request unit, used to obtain a benchmarking request and parse the benchmarking data dictionary of the application system from the benchmarking request;
[0159] A data standard library selection unit is used to select a data standard for the data dictionary to be benchmarked and generate a data standard library;
[0160] A benchmarking mechanism setting unit, used for selecting a benchmarking mechanism and a benchmarking mode for a data dictionary to be benchmarked;
[0161] The label configuration module of data standards and data dictionaries is used to configure labels for data standards in the data standard library, and to configure labels for the data dictionary to be benchmarked after the benchmarking mechanism is set up; the label configuration module of data standards and data dictionaries includes:
[0162] A data standard positioning unit is used to obtain each data standard in the data standard library and locate each data standard in turn;
[0163] A candidate keyword generating unit, used for obtaining candidate keywords by using a keyword processing method according to the definition of the located data standard;
[0164] A final keyword determination unit, used to determine a final keyword from the candidate keywords in response to the selection of the benchmarking personnel;
[0165] A data standard label configuration unit, used to complete the label configuration of the located data standard using the final keyword;
[0166] The benchmarking module is used to perform keyword benchmarking, similarity benchmarking and data detail benchmarking on the data dictionary and data standard to be benchmarked after the label configuration is completed according to the benchmarking mechanism, and generate the benchmarking results; the benchmarking module includes:
[0167] A benchmarking mechanism acquisition unit, used to acquire a benchmarking mechanism of a data dictionary to be benchmarked;
[0168] A keyword benchmarking unit, when keyword benchmarking is configured in the benchmarking mechanism, obtains definition information of the data dictionary to be benchmarked, and uses a keyword processing method to obtain data dictionary keywords and priority order;
[0169] A keyword matching unit, used to match the identified data dictionary keywords with the final keywords of each data standard in the data standard library in order of priority, and recommend the data standards whose matching degree exceeds a threshold to the data dictionary;
[0170] A similarity benchmarking unit, used for querying each benchmarked data dictionary in the application system to which the data dictionary to be benchmarked belongs when similarity benchmarking has been configured in the benchmarking mechanism;
[0171] A similarity matching unit is used to extract keywords after deconstructing the definition attributes of the data dictionary to be benchmarked and each benchmarked data dictionary, perform similarity analysis based on the keywords, identify the benchmarked data dictionary with the highest similarity as the similar data dictionary, and recommend the data standard followed by the similar data dictionary to the data dictionary to be benchmarked;
[0172] The data detail benchmarking unit is used to scan and analyze the characteristics of the master data stored in the data dictionary to be benchmarked, locate the actual business meaning of the data dictionary to be benchmarked, and recommend data standards related to the actual business meaning to the data dictionary to be benchmarked when the data detail benchmarking in the benchmarking mechanism has been configured;
[0173] A benchmarking result generating unit, used to generate a benchmarking result for a recommended data standard of a data dictionary of benchmarking content in a benchmarking mechanism;
[0174] The benchmarking verification module is used to query data benchmarking suggestions based on the benchmarking results, and to perform manual benchmarking and benchmarking review based on the data benchmarking suggestions; the benchmarking verification module includes:
[0175] A benchmarking suggestion generating unit, used for receiving a request from a benchmarking person to query the recommended data standard of the data dictionary in the benchmarking result and generating a benchmarking suggestion;
[0176] A benchmark determination unit, used to receive instructions from benchmark personnel, determine the final data standard to be used from the data standards recommended by the benchmarking suggestions, or perform manual benchmarking;
[0177] The data standard review unit is used to receive instructions from reviewers and review and publish the approved data standards from the application system dimension or data dictionary dimension.
[0178] Embodiment 4:
[0179] The present invention provides a device, comprising a processor and a memory;
[0180] The memory is used to store a computer program, and the processor is used to call and run the computer program from the memory, so that the device executes the method described in the above-mentioned embodiment 1 or embodiment 2.
[0181] Embodiment 5:
[0182] The present invention provides a storage medium.
[0183] The storage medium stores instructions, which, when executed on a computer, enable the computer to execute the method described in the above-mentioned embodiment 1 or embodiment 2.
[0184] Although the present invention has been described in detail with reference to the accompanying drawings and in combination with the preferred embodiments, the present invention is not limited thereto. Without departing from the spirit and essence of the present invention, a person of ordinary skill in the art may make various equivalent modifications or substitutions to the embodiments of the present invention, and these modifications or substitutions shall be within the scope of the present invention. Any person of ordinary skill in the art may easily think of changes or substitutions within the technical scope disclosed by the present invention, and these shall be within the scope of protection of the present invention.
Claims
1. A method for benchmarking financial industry data standards, characterized in that: The steps include: S1. Obtain the data dictionary of the application system to be benchmarked against data standards as the data dictionary to be benchmarked, and set a benchmarking mechanism for the data dictionary to be benchmarked; S2. Configure labels for the data standards in the data standard library, and configure labels for the data dictionary to be benchmarked after the benchmarking mechanism is set up; the specific steps of step S2 are as follows: S21. Obtain each data standard in the data standard library, and locate each data standard in turn; S22. Using a keyword processing method to obtain candidate keywords based on the definition of the positioning data standard; S23. Determine the final keyword from the candidate keywords in response to the selection of the benchmarking personnel; S24. Use the final keyword to complete the label configuration of the located data standard; S3. Perform keyword matching, similarity matching and data detail matching on the data dictionary and data standard to be matched after tag configuration is completed according to the matching mechanism, and generate matching results; the specific steps of step S3 are as follows: S31. Obtaining the benchmarking mechanism of the data dictionary to be benchmarked; S32. When the keyword benchmarking in the benchmarking mechanism has been configured, obtain the definition information of the data dictionary to be benchmarked, and use the keyword processing method to obtain the data dictionary keywords and priority order; S33. Match the identified data dictionary keywords with the final keywords of each data standard in the data standard library in order of priority, and recommend the data standards whose matching degree exceeds the threshold to the data dictionary; S34. When similarity benchmarking has been configured in the benchmarking mechanism, query each benchmarked data dictionary in the application system to which the data dictionary to be benchmarked belongs; S35. After deconstructing the definition attributes of the data dictionary to be benchmarked and each benchmarked data dictionary, keywords are extracted, similarity analysis is performed based on the keywords, the benchmarked data dictionary with the highest similarity is identified as the similar data dictionary, and the data standard followed by the similar data dictionary is recommended to the data dictionary to be benchmarked; S36. When the data detail benchmarking in the benchmarking mechanism has been configured, the master data stored in the data dictionary to be benchmarked is scanned and feature analyzed to locate the actual business meaning of the data dictionary to be benchmarked, and the data standards related to the actual business meaning are recommended to the data dictionary to be benchmarked; S37. Generate benchmarking results for the recommended data standards of the data dictionary of the benchmarking content in the benchmarking mechanism; S4. Query data benchmarking suggestions based on the benchmarking results, and conduct manual benchmarking and benchmarking review based on the data benchmarking suggestions.
2. The method for benchmarking financial industry data standards as claimed in claim 1, characterized in that: The specific steps of step S1 are as follows: S11. Obtain a benchmarking request, and parse the benchmarking data dictionary of the application system from the benchmarking request; S12. Selecting a data standard to be used for benchmarking for the data dictionary to be benchmarked, and generating a data standard library; S13. Select a benchmarking mechanism and a benchmarking mode for the data dictionary to be benchmarked.
3. The method for benchmarking financial industry data standards as claimed in claim 2, characterized in that: In step S13, a benchmarking mechanism and a benchmarking mode are selected for each to-be-benchmarked data dictionary as a whole or a benchmarking mechanism and a benchmarking mode are selected for each to-be-benchmarked data dictionary in sequence according to a set order; The benchmarking mechanism includes keyword benchmarking, similarity benchmarking and data detail benchmarking, and the benchmarking modes include real-time mode and batch operation mode.
4. The method for benchmarking financial industry data standards as claimed in claim 2, characterized in that: The specific steps of step S22 are as follows: S221. Obtaining definition information of positioning data standards; S222. Perform word segmentation processing on the definition information of the located data standard, conduct correlation analysis on the word segmentation results and the standard subject, standard category and standard subcategory, and determine the candidate keywords and priority order; Step S23 is specifically as follows: S231. The benchmarking personnel obtains the attributes of the definition information of the located data standard, wherein the attributes of the definition information of the data standard include business definition, business rules, standard basis, data category and code encoding; S232. The benchmarking personnel select the final keyword from the candidate keywords based on the attributes of the definition information of the data standard.
5. The method for benchmarking financial industry data standards as claimed in claim 2, characterized in that: The specific steps of step S4 are as follows: S41. Receive a request from a benchmarking person to query the recommended data standard of the data dictionary in the benchmarking result and generate a benchmarking suggestion; S42. Receive instructions from the benchmarking personnel, determine the final data standard to be used from the data standards recommended by the benchmarking suggestions or perform manual benchmarking; S43. Receive instructions from auditors, and review and publish approved data standards from the application system dimension or data dictionary dimension.
6. A system for implementing the method for benchmarking financial industry data standards as described in any one of claims 1 to 5, characterized in that: include: A data dictionary benchmarking mechanism setting module is used to obtain a data dictionary to be benchmarked by the application system as the data dictionary to be benchmarked, and to set a benchmarking mechanism for the data dictionary to be benchmarked; The label configuration module for data standards and data dictionaries is used to configure labels for data standards in the data standard library, and to configure labels for the data dictionary to be benchmarked after the benchmarking mechanism is set up; The benchmarking module is used to perform keyword benchmarking, similarity benchmarking and data detail benchmarking on the data dictionary and data standards to be benchmarked after the label configuration is completed according to the benchmarking mechanism, and generate the benchmarking results; The benchmarking verification module is used to query data benchmarking suggestions based on the benchmarking results, and to perform manual benchmarking and benchmarking review based on the data benchmarking suggestions.
7. A device, characterized in that: including a processor and a memory; The memory is used to store a computer program, and the processor is used to call and run the computer program from the memory, so that the device executes the method described in any one of claims 1 to 5.
8. A storage medium, characterized in that: The storage medium stores instructions, which, when executed on a computer, enable the computer to execute the method described in any one of claims 1 to 5.
Citation Information
Patent Citations
Intelligent system for applying NLP and ML to data standard benchmarking
CN116644151A
Data standard benchmarking method and device, electronic equipment and readable storage medium
CN117390170A
