Data standard system construction method and device, storage medium and electronic equipment

Abstract

The present application discloses a method and device for constructing a data standard system, a storage medium and an electronic device, which can be applied to the financial field or other fields. The method includes: determining multiple business systems that have been constructed, and collecting metadata for each business system to obtain a set of data items. Determine the first standard element information corresponding to each data item in the data item set; perform ambiguity elimination processing on the first standard element information corresponding to each data item to obtain the second standard element information corresponding to each data item; perform deduplication processing on the data item set based on each second standard element information to obtain a processed data item set; determine multiple data standards based on the second standard element information corresponding to each data item in the processed data item set to construct a data standard system. By applying the method of the present application, data standards can be established based on the metadata of a large number of business systems, and the resulting data standard system has a wide coverage and good management capabilities.

Description

Technical Field

[0001] The present invention relates to the field of data governance technology, and in particular to a method and device for constructing a data standard system, a storage medium, and an electronic device. Background Art

[0002] With the development of digitalization and informatization, more and more data is accumulating in the information systems of enterprises and organizations. To improve the data asset management capabilities of enterprises and organizations, a data standards system is usually established to manage data through data standards. Data standards refer to the consistent agreement on the expression, format, and definition of data.

[0003] Currently, the data standards in the data standards systems of enterprises and organizations are usually built based on existing general standards such as national standards and industry standards. General standards are usually formulated for core data or common data.

[0004] In actual application scenarios, enterprises and organizations are deploying an increasing number of business systems, involving an ever-increasing amount of data and a wide variety of data types. Existing approaches to building data standards systems have limited application coverage, providing only a reference for core or common data. However, a large amount of data is difficult to effectively manage using data standards systems, resulting in poor data asset management capabilities. Summary of the Invention

[0005] In view of this, an embodiment of the present invention provides a method for constructing a data standard system to solve the problems of limited application coverage and poor management capabilities in existing data standard systems constructed based on general standards.

[0006] The embodiment of the present invention also provides a data standard system construction device to ensure the actual implementation and application of the above method.

[0007] To achieve the above objectives, the embodiments of the present invention provide the following technical solutions:

[0008] A method for constructing a data standard system, comprising:

[0009] Determine multiple business systems that have been built, and collect metadata for each of the business systems to obtain a data item set, where the data item set includes multiple data items corresponding to each of the business systems;

[0010] Determining first standard element information corresponding to each data item in the data item set;

[0011] performing ambiguity elimination processing on the first standard element information corresponding to each of the data items to obtain second standard element information corresponding to each of the data items;

[0012] Deduplication processing is performed on the data item set according to the second standard element information corresponding to each of the data items to obtain a processed data item set;

[0013] Based on the second standard element information corresponding to each data item in the processed data item set, multiple data standards are determined to construct a data standard system corresponding to the multiple data standards.

[0014] In the above method, optionally, determining the first standard element information corresponding to each data item in the data item set includes:

[0015] Determining a management user corresponding to each of the data items in the data item set;

[0016] For each data item in the data item set, the data item is sent to a corresponding management user, and the management user is prompted to determine a data standard element item corresponding to the data item according to a plurality of preset element attributes;

[0017] The data standard element item corresponding to each of the data items is received, and the data standard element item corresponding to each of the data items is used as the first standard element information corresponding to each of the data items.

[0018] In the above method, optionally, the preset multiple element attributes include: English name of the data item, Chinese name of the data item, definition of the data item, data classification, data type, data format and code value range.

[0019] Optionally, in the above method, performing deduplication processing on the set of data items based on the second standard element information corresponding to each of the data items includes:

[0020] Comparing the second standard element information corresponding to each of the data items to determine whether there is a repeated data group in the data item set, the repeated data group including multiple data items, and the second standard element information corresponding to each of the data items in the repeated data group is the same;

[0021] If the duplicate data group exists in the data item set, each data item in the duplicate data group is merged to perform deduplication processing on the data item set.

[0022] Optionally, in the above method, determining multiple data standards based on the second standard element information corresponding to each data item in the processed data item set includes:

[0023] Classifying each data item in the processed data item set to obtain a data item set corresponding to each preset data category;

[0024] For each set of data items corresponding to the preset data category, the data item constraint information is determined based on the second standard element information corresponding to each data item in the data item set, and the data standard corresponding to the data item constraint information is determined, and the data standard corresponding to the data item constraint information is used as the data standard corresponding to the preset data category.

[0025] The above method may optionally further include:

[0026] For each data item in the data item set corresponding to each preset data category, a mapping relationship between the data item and the data standard corresponding to the preset data category is established.

[0027] A data standard system construction device, comprising:

[0028] A first determining unit is configured to determine a plurality of established business systems and collect metadata for each of the business systems to obtain a data item set, wherein the data item set includes a plurality of data items corresponding to each of the business systems;

[0029] a second determining unit, configured to determine first standard element information corresponding to each data item in the data item set;

[0030] a first processing unit, configured to perform ambiguity elimination processing on the first standard element information corresponding to each of the data items to obtain second standard element information corresponding to each of the data items;

[0031] a second processing unit, configured to perform deduplication processing on the data item set based on the second standard element information corresponding to each of the data items to obtain a processed data item set;

[0032] The third determining unit is configured to determine a plurality of data standards based on the second standard element information corresponding to each data item in the processed data item set, so as to construct a data standard system corresponding to the plurality of data standards.

[0033] In the above device, optionally, the second determining unit includes:

[0034] A first determining subunit, configured to determine a management user corresponding to each data item in the data item set;

[0035] a sending subunit, configured to send each data item in the data item set to a corresponding management user, and prompt the management user to determine a data standard element item corresponding to the data item according to a plurality of preset element attributes;

[0036] The receiving subunit is configured to receive the data standard element item corresponding to each of the data items, and use the data standard element item corresponding to each of the data items as the first standard element information corresponding to each of the data items.

[0037] A storage medium includes stored instructions, wherein when the instructions are executed, the device where the storage medium is located is controlled to execute the above-mentioned data standard system construction method.

[0038] An electronic device includes a memory and one or more instructions, wherein the one or more instructions are stored in the memory and configured to be executed by one or more processors to implement the above-mentioned data standard system construction method.

[0039] A method for constructing a data standard system based on the above-mentioned embodiment of the present invention includes: determining multiple business systems that have been constructed, and collecting metadata for each business system to obtain a set of data items. Determine the first standard element information corresponding to each data item in the data item set, and perform ambiguity elimination processing on the first standard element information corresponding to each data item to obtain the second standard element information corresponding to each data item. Based on the second standard element information corresponding to each data item, deduplicate the data item set to obtain a processed data item set. Based on the second standard element information corresponding to each data item in the processed data item set, determine multiple data standards to construct a data standard system. By applying the method provided by the embodiment of the present invention, data standards can be established in combination with a large number of data items of a large number of business systems, and a data standard system covering all existing systems and existing data can be obtained. The application coverage of the data standard system is wide, which is conducive to improving the effectiveness of the data standard system and then improving data asset management capabilities. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are merely embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying any creative work.

[0041] Figure 1 A flow chart of a method for constructing a data standard system provided by an embodiment of the present invention;

[0042] Figure 2 A flowchart of another method for constructing a data standard system provided by an embodiment of the present invention;

[0043] Figure 3 An example diagram of a data standard system construction process provided by an embodiment of the present invention;

[0044] Figure 4 A schematic diagram of the structure of a data standard system construction device provided by an embodiment of the present invention;

[0045] Figure 5 Another structural diagram of a data standard system construction device provided by an embodiment of the present invention;

[0046] Figure 6 A schematic structural diagram of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0047] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of the present invention.

[0048] In this application, the terms "comprises," "comprising," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or apparatus that includes a list of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not preclude the presence of additional identical elements in the process, method, article, or apparatus that includes the element.

[0049] The embodiment of the present invention provides a method for constructing a data standard system. The method can be applied to a data standard system construction system. The execution subject can be a server of the system. The method flow chart of the method is as follows: Figure 1 Shown, including:

[0050] S101: Determine multiple established business systems, and collect metadata for each of the business systems to obtain a data item set, where the data item set includes multiple data items corresponding to each of the business systems;

[0051] In the method provided by the embodiment of the present invention, when it is necessary to establish a data standard, the user can send a trigger instruction through the front end. When the server receives the corresponding instruction, it can determine the multiple business systems that have been currently constructed based on the pre-configured system information, and collect the metadata of each business system based on the pre-established connection, collect all data items of each business system, and then obtain a data item set.

[0052] Specifically, the constructed business systems refer to the business systems that need to be covered by the data standard system. They can be all the business systems in the information architecture of the enterprise organization, or they can be part of the business systems, such as newly added business systems.

[0053] S102: Determine first standard element information corresponding to each data item in the data item set;

[0054] In the method provided in an embodiment of the present invention, first standard element information corresponding to each collected data item can be determined based on a preset element collection strategy. The first standard element information includes multiple element data corresponding to the corresponding data item, such as the Chinese name of the data item, the data item definition of the data item, the data type of the data item, etc. Specifically, the preset element collection strategy can be to send each collected data item to relevant staff, who will then enter the first standard element information corresponding to the data item into the data standard system construction system.

[0055] S103: performing ambiguity elimination processing on the first standard element information corresponding to each of the data items to obtain second standard element information corresponding to each of the data items;

[0056] In the method provided by an embodiment of the present invention, the first standard element information includes a data item name (the Chinese name of the corresponding data item) and a data item definition (the data item definition of the corresponding data item). An ambiguity check can be performed on the first standard element information corresponding to each data item to determine whether each data item has an ambiguity problem. The existence of an ambiguity problem in a data item refers to if there is an ambiguity problem between a group of data items (at least two data items), that is, the data item names contained in the first standard element information corresponding to these data items are the same but the data item definitions are different, or the data item definitions are the same but the data item names are different. If there is an ambiguity problem between the data items, the first standard element information of these data items is modified to eliminate the ambiguity, that is, to ensure that the data item definitions corresponding to the same data item names are the same, and the data item names corresponding to the same data item definitions are the same.

[0057] In the method provided by an embodiment of the present invention, during the ambiguity resolution process, for unambiguous data items, the first standard element information corresponding to the data item is used as the second standard element information corresponding to the data item. For ambiguous data items, the corresponding first standard element information is modified, and the modified first standard element information is used as the second standard element information corresponding to the data item.

[0058] S104: performing deduplication processing on the data item set according to the second standard element information corresponding to each of the data items to obtain a processed data item set;

[0059] In the method provided by an embodiment of the present invention, it is determined whether the second standard element information corresponding to each data item is the same. If there are data items with the same second standard element information, the corresponding data items with the same second standard element information are merged to deduplicate the data item set and obtain a processed data item set. The second standard element information corresponding to each data item in the processed data item set is different from each other.

[0060] S105: Determine multiple data standards based on the second standard element information corresponding to each data item in the processed data item set, so as to construct a data standard system corresponding to the multiple data standards.

[0061] In the method provided by the embodiment of the present invention, a data standard is established based on the second standard element information corresponding to each data item in the processed data item set to construct a data standard system.

[0062] Based on the method provided by the embodiment of the present invention, when it is necessary to build a data standard, metadata can be collected for each business system that has been built to obtain a set of data items, and the first standard element information corresponding to each data item in the data item set can be determined. The first standard element information corresponding to each data item is subjected to ambiguity elimination processing to obtain the second standard element information corresponding to each data item. Based on each second standard element information, the data item set is deduplicated, and multiple data standards are established based on the second standard element information corresponding to each data item in the processed data item set to build a data standard system. By applying the method provided by the embodiment of the present invention, data standards can be established in combination with the data items of all business systems in actual application scenarios, and a data standard system covering all existing systems and existing data can be obtained. The application coverage of the data standard system is wide, which is conducive to improving the effectiveness of the data standard system and then improving the data asset management capabilities.

[0063] Based on the method provided in the above embodiment, Figure 2 As shown in the flowchart, in the method provided by the embodiment of the present invention, the step S102 of determining the first standard element information corresponding to each data item in the data item set includes:

[0064] S201: Determine the management user corresponding to each data item in the data item set;

[0065] In the method provided by the embodiments of the present invention, users can pre-assign data item information supplementation tasks within the data standard system construction system. This involves assigning management users to each data item, specifically, user accounts. Management users are individuals who need to supplement the data standard elements of the corresponding data item.

[0066] S202: For each data item in the data item set, the data item is sent to its corresponding management user, and the management user is prompted to determine the data standard element item corresponding to the data item according to a plurality of preset element attributes;

[0067] In the method provided by the embodiment of the present invention, each data item can be sent to its corresponding management user through system push or email, and the management user is prompted to supplement the content of the data standard element item template corresponding to the data item according to multiple preset element attributes (which can be specifically presented by the data standard element item template). That is, fill in the specific content of each element attribute in the data standard element item template, such as the Chinese name of the data item, the data item definition, etc. The supplemented data standard element item template is then the data standard element item corresponding to the data item. Each management user can submit the data standard element item obtained by supplementing the template to the system.

[0068] S203: Receive the data standard element item corresponding to each of the data items, and use the data standard element item corresponding to each of the data items as the first standard element information corresponding to each of the data items.

[0069] In the method provided by the embodiment of the present invention, the system can receive the data standard element items submitted by each management user as required, and use the data standard element items as the first standard element information.

[0070] Based on the method provided in the above embodiment, in the method provided in the embodiment of the present invention, the preset multiple element attributes include: English name of the data item, Chinese name of the data item, data item definition, data classification, data type, data format and code value range.

[0071] In the method provided by an embodiment of the present invention, the element attributes in the data standard element item include the English name of the data item, the Chinese name of the data item, the data item definition, the data classification, the data type, the data format and the code value range, that is, the management user needs to supplement the above content of the data item and submit it to the system.

[0072] exist Figure 1 On the basis of the method shown, in the method provided by the embodiment of the present invention, the step S104 mentioned in which the data item set is deduplicated based on the second standard element information corresponding to each data item includes:

[0073] Comparing the second standard element information corresponding to each of the data items to determine whether there is a repeated data group in the data item set, the repeated data group including multiple data items, and the second standard element information corresponding to each of the data items in the repeated data group is the same;

[0074] In the method provided by the embodiment of the present invention, each piece of second standard element information can be compared with other pieces of second standard element information. If there is duplicate second standard element information, the data items corresponding to these duplicate second standard element information are formed into a duplicate data group. A duplicate data group includes at least two data items.

[0075] It should be noted that, in a specific implementation, a data item set may contain no duplicate data groups, one duplicate data group, or multiple duplicate data groups. The specific number of duplicate data groups is determined by the actual data item content and does not affect the functionality of the method provided in the embodiments of the present invention. If multiple duplicate data groups exist, the subsequent operations can be performed on each duplicate data group.

[0076] If the duplicate data group exists in the data item set, each data item in the duplicate data group is merged to perform deduplication processing on the data item set.

[0077] In the method provided by an embodiment of the present invention, if there is a repeated data group in the data item set, the data items in the repeated data group are merged, that is, the data items in which the second standard element information is repeated are merged into one data item. It can be understood that only one data item is retained among these data items, and the redundant data items are removed from the data item set.

[0078] exist Figure 1 On the basis of the method shown in FIG. 1 , in the method provided by the embodiment of the present invention, the step S105 mentioned in FIG. 105 determines multiple data standards based on the second standard element information corresponding to each data item in the processed data item set, including:

[0079] Classifying each data item in the processed data item set to obtain a data item set corresponding to each preset data category;

[0080] In the method provided by an embodiment of the present invention, after deduplication is performed on a set of data items, each data item may be classified based on the second standard element information corresponding to each data item, for example, into business data, indicator data, technical data, etc. Data items classified into the same preset data category are considered a data item set, corresponding to the preset data category.

[0081] For each set of data items corresponding to the preset data category, the data item constraint information is determined based on the second standard element information corresponding to each data item in the data item set, and the data standard corresponding to the data item constraint information is determined, and the data standard corresponding to the data item constraint information is used as the data standard corresponding to the preset data category.

[0082] In the method provided by the embodiment of the present invention, for each set of data items corresponding to a preset data category, a data structure abstraction can be performed based on the second standard element information corresponding to the data item to determine data item constraint information, that is, a summary description of the constraints on the data content in these data items, such as the data type of data of a certain attribute, field length, etc. The data standard corresponding to the corresponding set of data items is determined based on the data item constraint information. Specifically, the data item constraint information can be sent to relevant technical personnel, prompting the technical personnel to formulate data standards based on the information, and obtaining the data standards input by the technical personnel as the data standards corresponding to the data item constraint information. Alternatively, some data standards can be set in advance based on national standards, industry standards, etc. By matching the data item constraint information with the constraint information of the preset data standard, the preset data standard corresponding to the data item constraint information can be determined, and the preset data standard can be sent to the relevant technical personnel for confirmation. Upon receiving the confirmation instruction from the technical personnel, the preset data standard is determined as the data standard corresponding to the data item constraint information.

[0083] On the basis of the method provided in the above embodiment, the method provided in the embodiment of the present invention further includes:

[0084] For each data item in the data item set corresponding to each preset data category, a mapping relationship between the data item and the data standard corresponding to the preset data category is established.

[0085] In the method provided by the embodiment of the present invention, after determining each data standard, the data standard corresponding to each preset data category can be used as the data standard corresponding to each data item in its corresponding data item set, and a mapping relationship between each data item and its corresponding data standard is established, that is, data standard labeling is performed.

[0086] In order to better illustrate the method provided by the embodiment of the present invention, in combination with actual application scenarios, the embodiment of the present invention provides another method for building a data standard system. The method provided by the embodiment of the present invention is applied to the data standard system construction scenario of an enterprise organization. The method can be applied to the enterprise-level data standard construction system. This tool is for Figure 1 An instantiation of the method shown, the system mainly includes the following modules:

[0087] Data source management module: The administrator user configures the UAT environment data source information, including database type, application system, IP address, port number and other database connection information. After the data source is successfully added, the data source information is collected. After the data table information is successfully collected, the data table is displayed in the task allocation module.

[0088] Task Assignment Module: Technical administrators can query detailed table information and status by system name, database name, table name, and status (assigned, unassigned, all). This module supports batch assignment of tables to specific users. After assignment, tasks are displayed in the operator's task list, which the operator can then sort through.

[0089] Task Adjustment Module: supports reassigning users of assigned tasks, including unprocessed and in-process tasks.

[0090] Data standard construction module: Supplement all data items in the table according to the data standard element item template, fill in the Chinese name of the data item in the "basic word + class word" format, support downloading all field information in the entire table, and perform offline supplementation and batch import of details.

[0091] Task tracking module: You can (fuzzily) query relevant detailed information based on the system name and processing status, such as the Chinese name of the table, the English name of the table, the operator, processing progress, etc.

[0092] Business system data item modification module: By default, all the data items that have been sorted out by this system are displayed. The corresponding data items can be queried according to one or more filled-in field information, and the field information of one or more data items can be modified.

[0093] Ambiguity check module: For the Chinese names and definitions of data items that have been standardized, ambiguity checks and modifications are performed on the two situations where the names are the same but the definitions are different (same name but different meanings) and the definitions are the same but the names are different (same meaning but different names), eliminating ambiguity and ensuring a one-to-one correspondence between the two.

[0094] Data standard generation module: After all data items in the system have been ambiguous, data items that do not have duplicates (duplication here means that the standardized Chinese name of the data item and the data item definition are completely consistent) can be directly entered into the data standard list. Duplicate data items need to be deduplicated and then the data standard needs to be generated.

[0095] refer to Figure 3 As shown in the example diagram, the process of constructing the data standard (system) provided by the embodiment of the present invention mainly includes:

[0096] Formulate data standard elements: Determine the language to describe the data standard, that is, how to define a data standard. The data standard elements need to include the English name of the data item, the Chinese name of the data item, the definition of the data item, the data classification, the data type, the data format, the code value range, etc.

[0097] Metadata asset inventory: Inventory the data items of all business systems within the enterprise, collect and inventory all data items in a unified manner, that is, collect data items from business systems.

[0098] Supplementary data item elements: For all the business system data items collected within the enterprise, fill in the additional data according to the requirements of the data standard element items, that is, save the collected data items according to the preset template.

[0099] Standardize the meaning of data item names: Standardize the Chinese names of all business system data items within the enterprise. This requires selecting standardized terms from a continuously developing word root library to ensure accurate descriptions of the names. The meaning of the data items must also be described in detail, with standardized data item names corresponding one-to-one with their meanings. The system supplements and standardizes data item element information. The supplemented information is reviewed and submitted by the technical administrator, and then reviewed and improved by business personnel. If the business personnel do not approve the review, the process of supplementing and standardizing the data item element information must be returned.

[0100] Data item classification: To facilitate the subsequent application and management of data standards, all business system data items within the enterprise are classified, including business data, indicator data, technical data, etc.

[0101] Data item deduplication and merging (data item matching and deduplication): perform ambiguity checks on standardized data items, deduplication and merge data items that do not have ambiguity, and form data standards item by item.

[0102] Generate enterprise-level data standards: Generate data standards based on the deduplicated and merged data item sets.

[0103] Benchmarking against national and industry standards: We conduct checks on established data standards, primarily analyzing and aligning them with national and industry data standards. This involves mapping business system data items to enterprise-level data standards.

[0104] Based on the method provided in the embodiment of the present invention, a "bottom-up" method for establishing enterprise-level data standards can be implemented, and a tool to support the data standard establishment process is provided. Metadata automatic extraction technology is used to obtain metadata sets in business systems. Combined with the metadata status of all business systems of the enterprise, data items are collected, supplemented, standardized, classified and deduplicated by using tools to establish "comprehensive, unified, standardized and universal" enterprise-level data standards.

[0105] A standardized plan covering all enterprise data can be established. The established data standards can cover all business and management data, and a mapping relationship between current data and data standards can be established. It is the cornerstone of enterprise data governance, can realize standardized management of data standards, build a digital standard system, and is conducive to activating the potential of data elements.

[0106] and Figure 1Corresponding to the data standard system construction method shown in FIG, the embodiment of the present invention also provides a data standard system construction device for Figure 1 The specific implementation of the method shown in is shown in the structural diagram. Figure 4 As shown, including:

[0107] The first determining unit 301 is configured to determine a plurality of established business systems and collect metadata for each of the business systems to obtain a data item set, wherein the data item set includes a plurality of data items corresponding to each of the business systems;

[0108] A second determining unit 302 is configured to determine first standard element information corresponding to each data item in the data item set;

[0109] A first processing unit 303 is configured to perform ambiguity elimination processing on the first standard element information corresponding to each of the data items to obtain second standard element information corresponding to each of the data items;

[0110] A second processing unit 304 is configured to perform deduplication processing on the data item set based on the second standard element information corresponding to each of the data items to obtain a processed data item set;

[0111] The third determining unit 305 is configured to determine a plurality of data standards based on the second standard element information corresponding to each data item in the processed data item set, so as to construct a data standard system corresponding to the plurality of data standards.

[0112] Based on the device provided by the embodiment of the present invention, when it is necessary to build a data standard, metadata collection can be performed on each business system that has been built to obtain a set of data items, and the first standard element information corresponding to each data item in the data item set can be determined. The first standard element information corresponding to each data item is subjected to ambiguity elimination processing to obtain the second standard element information corresponding to each data item. Based on each second standard element information, the data item set is deduplicated, and multiple data standards are established based on the second standard element information corresponding to each data item in the processed data item set to build a data standard system. By applying the device provided by the embodiment of the present invention, data standards can be established in combination with the data items of all business systems in actual application scenarios, and a data standard system covering all existing systems and existing data can be obtained. The application coverage of the data standard system is wide, which is conducive to improving the effectiveness of the data standard system and then improving the data asset management capabilities.

[0113] The embodiment of the present invention provides another data standard system construction device, the structural diagram of which is as follows: Figure 5 As shown, in Figure 4On the basis of the device shown in FIG. 1 , in the device provided by the embodiment of the present invention, the second determining unit 302 includes:

[0114] A first determining subunit 306 is configured to determine a management user corresponding to each data item in the data item set;

[0115] The sending subunit 307 is configured to send each data item in the data item set to a corresponding management user, and prompt the management user to determine the data standard element item corresponding to the data item according to a plurality of preset element attributes;

[0116] The receiving subunit 308 is configured to receive the data standard element item corresponding to each of the data items, and use the data standard element item corresponding to each of the data items as the first standard element information corresponding to each of the data items.

[0117] Based on the device provided in the above embodiment, in the device provided in the embodiment of the present invention, the preset multiple element attributes include: English name of the data item, Chinese name of the data item, data item definition, data classification, data type, data format and code value range.

[0118] On the basis of the apparatus provided in the above embodiment, in the apparatus provided in the embodiment of the present invention, the second processing unit 304 includes:

[0119] a second determining subunit, configured to compare the second standard element information corresponding to each of the data items to determine whether there is a repeated data group in the data item set, the repeated data group including a plurality of data items, and the second standard element information corresponding to each of the data items in the repeated data group being identical;

[0120] The merging subunit is configured to merge the data items in the duplicate data group if the duplicate data group exists in the data item set, so as to perform deduplication processing on the data item set.

[0121] On the basis of the apparatus provided in the above embodiment, in the apparatus provided in the embodiment of the present invention, the third determining unit 305 includes:

[0122] a classification subunit, configured to classify each data item in the processed data item set to obtain a data item set corresponding to each preset data category;

[0123] The third determination subunit is used to determine the data item constraint information for each data item set corresponding to the preset data category based on the second standard element information corresponding to each data item in the data item set, and determine the data standard corresponding to the data item constraint information, and use the data standard corresponding to the data item constraint information as the data standard corresponding to the preset data category.

[0124] On the basis of the apparatus provided in the above embodiment, the apparatus provided in the embodiment of the present invention further includes:

[0125] The mapping subunit is configured to establish, for each data item in the data item set corresponding to each preset data category, a mapping relationship between the data item and the data standard corresponding to the preset data category.

[0126] An embodiment of the present invention further provides a storage medium, which includes stored instructions, wherein when the instructions are executed, the device where the storage medium is located is controlled to execute the above-mentioned data standard system construction method.

[0127] The embodiment of the present invention further provides an electronic device, the structural diagram of which is shown in FIG. Figure 6 As shown, the system specifically includes a memory 401 and one or more instructions 402, wherein the one or more instructions 402 are stored in the memory 401 and are configured to be executed by one or more processors 403 to perform the following operations:

[0128] Determine multiple business systems that have been built, and collect metadata for each of the business systems to obtain a data item set, where the data item set includes multiple data items corresponding to each of the business systems;

[0129] Determining first standard element information corresponding to each data item in the data item set;

[0130] performing ambiguity elimination processing on the first standard element information corresponding to each of the data items to obtain second standard element information corresponding to each of the data items;

[0131] Deduplication processing is performed on the data item set according to the second standard element information corresponding to each of the data items to obtain a processed data item set;

[0132] Based on the second standard element information corresponding to each data item in the processed data item set, multiple data standards are determined to construct a data standard system corresponding to the multiple data standards.

[0133] It should be noted that the data standards system construction method and apparatus, storage medium, and electronic device provided by the present invention can be used in the financial sector or other fields. For example, they can be used in bank data governance applications within the financial sector. Other fields are any fields other than finance, such as the telecommunications services sector. The above is merely illustrative and does not limit the application areas of the data standards system construction method and apparatus, storage medium, and electronic device provided by the present invention.

[0134] Each embodiment in this specification is described in a progressive manner. The same or similar parts between the embodiments can be referred to each other. Each embodiment focuses on the differences from other embodiments. In particular, for system or system embodiments, since they are basically similar to method embodiments, the description is relatively simple. For relevant parts, refer to the partial description of the method embodiment. The system and system embodiments described above are merely schematic, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. A person of ordinary skill in the art can understand and implement it without expending creative work.

[0135] Professionals may further appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the above description has generally described the components and steps of each example according to their functions. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians may use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present invention.

[0136] The above description of the disclosed embodiments is intended to enable one skilled in the art to implement or use the present invention. Various modifications to these embodiments will be readily apparent to one skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention is not limited to the embodiments shown herein but is intended to conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A method for constructing a data standard system, characterized in that: include: Determine multiple business systems that have been built, and collect metadata for each of the business systems to obtain a data item set, where the data item set includes multiple data items corresponding to each of the business systems; Determining first standard element information corresponding to each data item in the data item set, including: determining a management user corresponding to each data item in the data item set; For each data item in the data item set, the data item is sent to a corresponding management user, and the management user is prompted to determine the data standard element item corresponding to the data item according to a plurality of preset element attributes; the data standard element item corresponding to each data item is received, and the data standard element item corresponding to each data item is used as the first standard element information corresponding to each data item; performing ambiguity elimination processing on the first standard element information corresponding to each of the data items to obtain second standard element information corresponding to each of the data items; Deduplication processing is performed on the data item set according to the second standard element information corresponding to each of the data items to obtain a processed data item set; Based on the second standard element information corresponding to each data item in the processed data item set, multiple data standards are determined to construct a data standard system corresponding to the multiple data standards.

2. The method according to claim 1, characterized in that The preset multiple element attributes include: data item English name, data item Chinese name, data item definition, data classification, data type, data format and code value range.

3. The method according to claim 1, characterized in that The deduplication processing of the data item set according to the second standard element information corresponding to each of the data items includes: Comparing the second standard element information corresponding to each of the data items to determine whether there is a repeated data group in the data item set, the repeated data group including multiple data items, and the second standard element information corresponding to each of the data items in the repeated data group is the same; If the duplicate data group exists in the data item set, each data item in the duplicate data group is merged to perform deduplication processing on the data item set.

4. The method according to claim 1, wherein The determining of multiple data standards based on the second standard element information corresponding to each data item in the processed data item set includes: Classifying each data item in the processed data item set to obtain a data item set corresponding to each preset data category; For each set of data items corresponding to the preset data category, the data item constraint information is determined based on the second standard element information corresponding to each data item in the data item set, and the data standard corresponding to the data item constraint information is determined, and the data standard corresponding to the data item constraint information is used as the data standard corresponding to the preset data category.

5. The method according to claim 4, characterized in that Also includes: For each data item in the data item set corresponding to each preset data category, a mapping relationship between the data item and the data standard corresponding to the preset data category is established.

6. A data standard system construction device, characterized in that: include: A first determining unit is configured to determine a plurality of established business systems and collect metadata for each of the business systems to obtain a data item set, wherein the data item set includes a plurality of data items corresponding to each of the business systems; a second determining unit, configured to determine first standard element information corresponding to each data item in the data item set; a first processing unit, configured to perform ambiguity elimination processing on the first standard element information corresponding to each of the data items to obtain second standard element information corresponding to each of the data items; a second processing unit, configured to perform deduplication processing on the data item set based on the second standard element information corresponding to each of the data items to obtain a processed data item set; a third determining unit, configured to determine a plurality of data standards based on the second standard element information corresponding to each data item in the processed data item set, so as to construct a data standard system corresponding to the plurality of data standards; The second determining unit includes: A first determining subunit, configured to determine a management user corresponding to each data item in the data item set; a sending subunit, configured to send each data item in the data item set to a corresponding management user, and prompt the management user to determine a data standard element item corresponding to the data item according to a plurality of preset element attributes; The receiving subunit is configured to receive the data standard element item corresponding to each of the data items, and use the data standard element item corresponding to each of the data items as the first standard element information corresponding to each of the data items.

7. A storage medium, characterized in that: The storage medium includes stored instructions, wherein when the instructions are executed, the device where the storage medium is located is controlled to execute the data standard system construction method according to any one of claims 1 to 5.

8. An electronic device, characterized in that: The system comprises a memory and one or more instructions, wherein the one or more instructions are stored in the memory and configured to be executed by one or more processors to execute the data standard system construction method according to any one of claims 1 to 5.

Images