Data asset checking method and device, computer equipment, readable storage medium and program product

Abstract

The invention relates to a data asset checking method and device, computer equipment, a computer readable storage medium and a computer program product. The method comprises the steps that to-be-checked metadata are acquired, and the to-be-checked metadata represent changed metadata; determining a first data asset and a second data asset according to the to-be-checked metadata; wherein the first data assets represent existing historical data assets; the second data assets represent the current data assets; comparing the link attribute of the first data asset with the link attribute of the second data asset through the data asset link blood relationship, and determining the type of the second data asset; and issuing attribute information of the second data assets to the asset directory according to the types of the second data assets to complete checking. By adopting the method, automation of data asset checking can be realized, the checking error rate is reduced while the working efficiency of data asset checking is improved, and the checking accuracy is improved.

Description

Technical Field

[0001] The present application relates to the field of data processing technology, and in particular to a data asset inventory method, apparatus, computer equipment, computer-readable storage medium, and computer program product. Background Art

[0002] As a "special asset" of an enterprise, it is crucial to take inventory of data assets.

[0003] Traditional data asset inventory involves developing data asset inventory templates, collecting data through data warehouses or data marts, manually identifying and defining asset-related attributes, confirming the value of data, and defining and acknowledging the source and application scenarios of the data. This inventory method is labor-intensive and inefficient. Summary of the invention

[0004] Based on this, it is necessary to provide a data asset inventory method, device, computer equipment, computer-readable storage medium and computer program product that can improve inventory efficiency in response to the above technical problems.

[0005] In a first aspect, the present application provides a data asset inventory method, the method comprising:

[0006] Acquire metadata to be counted, wherein the metadata to be counted represents metadata that has changed;

[0007] Determine a first data asset and a second data asset according to the metadata to be counted; wherein the first data asset represents an existing historical data asset; and the second data asset represents a current data asset;

[0008] Comparing the link attributes of the first data asset and the link attributes of the second data asset through the data asset link blood relationship to determine the type of the second data asset;

[0009] According to the type of the second data asset, the attribute information of the second data asset is published to the asset catalog to complete the inventory.

[0010] In one embodiment, the attribute information includes basic asset attributes; before comparing the link attributes of the first data asset and the link attributes of the second data asset through the data asset link lineage relationship, it also includes:

[0011] Acquire the basic asset attributes of the second data asset, and extract the comparison theme from the basic asset attributes;

[0012] According to the comparison subject, obtain key fields;

[0013] For each of the key fields, a target field identical to the key field is obtained from the first data asset; if the content corresponding to the target field is identical to the content corresponding to the key field, it indicates that the second data asset has the same basic asset attribute as the first data asset;

[0014] If the content corresponding to the target field is different from the content corresponding to the key field, then the second data asset and the first data asset have different basic asset attributes.

[0015] In one embodiment, comparing the link attribute of the first data asset with the link attribute of the second data asset through the data asset link lineage relationship to determine the type of the second data asset includes:

[0016] Comparing the link attributes of the first data asset and the link attributes of the second data asset through the blood relationship, and determining the link difference information corresponding to the second data asset;

[0017] The type of the second data asset is determined according to the link difference information.

[0018] In one embodiment, the data asset link lineage relationship includes a first data asset link lineage relationship and a second data asset link lineage relationship; comparing the link attribute of the first data asset with the link attribute of the second data asset through the data asset link lineage relationship to determine the link difference information corresponding to the second data asset, including:

[0019] Acquire a first link snapshot and a second link snapshot, wherein the first link snapshot is determined based on a first lineage link combination in the first data asset link lineage relationship; and the second link snapshot is determined based on a second lineage link combination in the second data asset link lineage relationship;

[0020] Compare each of the second lineage links in the second link snapshot with the first lineage link in the first link snapshot to determine link difference information corresponding to the second data asset;

[0021] The determining the type of the second data asset according to the link difference information includes:

[0022] If the underlying asset attributes of the second data asset and the first data asset are different, it indicates that the type of the second data asset is a newly added data asset;

[0023] If the second data asset has the same basic asset attribute as the first data asset, and the link difference information indicates that the second link snapshot is different from the first link snapshot, it indicates that the type of the second data asset is a changed data asset.

[0024] In one embodiment, publishing the attribute information of the second data asset to the asset catalog according to the type of the second data asset to complete the inventory includes:

[0025] Determining a publishing process for the second data asset according to the type of the second data asset;

[0026] According to the publishing process, the attribute information corresponding to the second data asset is published to the asset catalog to complete the inventory.

[0027] In one embodiment, the attribute information further includes link attributes; and publishing the attribute information corresponding to the second data asset to the asset catalog according to the publishing process to complete the inventory includes:

[0028] If the type of the second data asset is a newly added data asset, adding the second data asset and the link attribute and the basic asset attribute of the second data asset to the asset catalog according to the publishing process to complete the inventory;

[0029] If the type of the second data asset is a changed data asset, the link attribute of the first data asset in the asset catalog is replaced with the link attribute of the second data asset to complete the inventory.

[0030] In a second aspect, the present application further provides a data asset inventory device, the device comprising:

[0031] An acquisition module, used for acquiring metadata to be counted, wherein the metadata to be counted represents metadata that has changed;

[0032] A determination module, configured to determine a first data asset and a second data asset according to the metadata to be counted; wherein the first data asset represents an existing historical data asset; and the second data asset represents a current data asset;

[0033] A link attribute comparison module, used to compare the link attribute of the first data asset with the link attribute of the second data asset through the data asset link lineage relationship, and determine the type of the second data asset;

[0034] The inventory module is used to publish the attribute information of the second data asset to the asset catalog according to the type of the second data asset to complete the inventory.

[0035] In a third aspect, the present application further provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of the above method when executing the computer program.

[0036] In a fourth aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program implements the steps of the above method when executed by a processor.

[0037] In a fifth aspect, the present application also provides a computer program product, including a computer program, which implements the steps of the above method when executed by a processor.

[0038] The above-mentioned data asset inventory method, device, computer equipment, computer-readable storage medium and computer program product, first, automatically trigger the inventory by acquiring the metadata that has changed, that is, the metadata to be inventoried; thereby timely discovering the changed data assets and taking inventory of the changed data assets; reducing the workload of inventorying all data assets; secondly, determining the first data asset and the second data asset based on the metadata to be inventoried; wherein the first data asset represents an existing historical data asset; and the second data asset represents a current data asset; then, through the data asset link blood relationship, the link attributes of the first data asset and the link attributes of the second data asset are compared to determine the type of the second data asset; through the blood link analysis, the current asset data can be automatically compared with the historical data assets to determine the type of the second data asset, which not only improves the efficiency of the type determination of the second data asset, but also improves the accuracy of the type determination of the second data asset compared to the manual participation of the prior art. Finally, according to the type of the second data asset, the attribute information of the second data asset is automatically supplemented and published to the asset catalog to complete the inventory. This can realize the automation of data asset inventory, improve the work efficiency of data asset inventory, reduce the error rate of inventory and improve the accuracy of inventory. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the drawings required for use in the embodiments of the present application or related technical descriptions will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0040] Figure 1 A schematic diagram of a process of a data asset inventory method in one embodiment;

[0041] Figure 2 A schematic diagram of a process of comparing basic asset attributes in an embodiment;

[0042] Figure 3 A schematic diagram of a process for determining the type of a second data asset in one embodiment;

[0043] Figure 4 A schematic diagram of a flow chart for determining the type of a second data asset in another embodiment;

[0044] Figure 5 A schematic diagram of a process of publishing an inventory in an embodiment;

[0045] Figure 6 A schematic diagram of a process of publishing an inventory in another embodiment;

[0046] Figure 7 It is a structural block diagram of a data asset inventory device in one embodiment;

[0047] Figure 8 FIG. 4 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION

[0048] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0049] In one embodiment, Figure 1 As shown, a data asset inventory method is provided. This embodiment uses the method applied to a terminal as an example for illustration. It can be understood that the method can also be applied to a server, and can also be applied to a system including a terminal and a server, and is implemented through the interaction between the terminal and the server. In this embodiment, the method includes the following steps:

[0050] Step S102: obtaining metadata to be counted.

[0051] The metadata to be counted represents metadata that has changed.

[0052] Metadata is data about data, providing information to describe, define, locate, understand, manage, and retrieve other data. Metadata can be considered as a "label" or "instruction manual" for data, which is used to help users, systems, or applications understand the meaning, source, structure, format, quality, permissions, and other related attributes of data. Metadata to be counted represents metadata that has changed, such as metadata that has changed when at least one of the following actions is added, changed, or deleted in the database.

[0053] Optionally, the metadata to be counted is a trigger condition for starting the inventory count. For example, at a certain moment, new data is added to the database, resulting in metadata changes. The server detects the changed metadata, which is the metadata to be counted, and triggers the start of the inventory count. For another example, during a certain period of time, new data is added to the database and some data is deleted, resulting in metadata changes. The server detects the changed metadata, which is the metadata to be counted, and triggers the start of the inventory count.

[0054] Step S104: determining the first data asset and the second data asset according to the metadata to be counted.

[0055] The first data asset represents the historical data asset that already exists in the asset library or database; the second data asset represents the current data asset.

[0056] Optionally, the server determines the first asset data and the second asset data to be compared based on the metadata to be counted. A mapping relationship between the metadata to be counted and the first asset data and the second asset data of the same type is pre-established. The first data asset and the second data asset are determined based on the metadata to be counted and the pre-established mapping relationship.

[0057] Optionally, determining the first data asset and the second data asset according to the metadata to be counted includes: determining the inventory type according to the metadata to be counted; obtaining the first data asset corresponding to the inventory type according to the inventory type; and reading the second data asset corresponding to the inventory type from the metadata to be counted.

[0058] Furthermore, the server determines the inventory type based on the metadata to be counted, such as personal information asset inventory, enterprise information asset inventory, product information asset inventory, contract information asset inventory, financial information asset inventory, etc. Each inventory type corresponds to a set of inventory processes. According to the inventory type, the server obtains the first data asset corresponding to the inventory type; if the inventory type is personal information asset, the server obtains the existing historical personal information asset, that is, the first asset data, from the asset or database. The server reads the current personal information asset from the metadata to be counted. It is convenient to compare the current personal information asset with the historical personal information asset later.

[0059] Step S106: Compare the link attributes of the first data asset and the link attributes of the second data asset through the data asset link blood relationship to determine the type of the second data asset.

[0060] Optionally, the attribute information of the second data asset may include both link attributes and basic asset attributes. Link attributes include the source, destination, and change process of the data, such as data from the source table (such as user table, order table) through a series of ETL processes (such as cleaning, transformation, loading), and finally stored in the target table (such as report table, analysis table); ETL is the abbreviation of Extract, Transform, Load, that is, the process of data extraction (Extract), transformation (Transform), and loading (Load).

[0061] Basic asset attributes include basic attributes, business attributes, management attributes, security attributes, etc. For example, basic attributes include field name, field type, etc.; business attributes include the business to which the data belongs, such as credit business, transaction business, etc.; management attributes include information set according to asset management specifications; security attributes include security level information, encryption level information, etc.

[0062] Optionally, the server performs a single-link comparison on the link attributes of the second data asset through the data asset link lineage relationship to determine the type of the second data asset. The server also compares the basic asset attributes of the second data asset, such as basic attributes, business attributes, management attributes, and security attributes, through a field-by-field comparison method to determine the type of the second data asset.

[0063] Step S108, publishing the attribute information of the second data asset to the asset catalog according to the type of the second data asset to complete the inventory.

[0064] Optionally, the server obtains attribute information of the second data asset, including link attributes and basic asset attributes, based on the type of the second data asset; and determines whether the second data asset meets the publishing requirements. If so, the attribute information of the second data asset is published to the asset catalog to complete the inventory; if not, the second data asset and the attribute information of the second data asset are temporarily stored in the asset library or database.

[0065] In the above data asset inventory method, firstly, by acquiring the metadata that has changed, that is, the metadata to be counted, the inventory is automatically triggered; thereby timely discovering the changed data assets and taking inventory of the changed data assets; reducing the workload of the inventory of all data assets; secondly, according to the metadata to be counted, the first data asset and the second data asset are determined; wherein the first data asset represents the existing historical data asset; the second data asset represents the current data asset; then the link attribute of the first data asset and the link attribute of the second data asset are compared through the data asset link lineage relationship to determine the type of the second data asset; through the lineage link analysis, the current asset data can be automatically compared with the historical data asset to determine the type of the second data asset, compared with the manual participation of the prior art, the efficiency of the type determination of the second data asset is improved, and the accuracy of the type determination of the second data asset is improved. Finally, according to the type of the second data asset, the attribute information of the second data asset is automatically supplemented, and the attribute information of the second data asset is published to the asset catalog to complete the inventory, which can realize the automation of data asset inventory, while improving the work efficiency of data asset inventory, reducing the inventory error rate and improving the inventory accuracy.

[0066] In the above embodiment, the underlying asset attributes are compared, such as Figure 2 As shown, the attribute information includes the basic asset attributes; before comparing the link attributes of the first data asset and the link attributes of the second data asset through the blood relationship, the following steps S202 to S208 are included. Among them:

[0067] Step S202: Obtain the basic asset attributes of the second data asset, and extract the comparison theme from the basic asset attributes.

[0068] Among them, the basic asset attributes include basic attributes, business attributes, management attributes, security attributes, etc.

[0069] Optionally, the server obtains the basic asset attributes of the second data asset, and extracts a comparison subject from the basic asset attributes, such as the comparison subject being an address, or the comparison subject being a name.

[0070] Step S204, obtaining key fields according to the comparison theme.

[0071] Optionally, the server obtains name comparison, synonym comparison, semantic comparison, etc. of the comparison subject according to the comparison subject, so as to obtain key fields. If the comparison subject is an address, the key fields include a mailing address, a home address, etc. If the comparison subject is a name, the key fields include a user ID, a user name, an account ID, etc.

[0072] It should be noted that there can be multiple comparison topics.

[0073] Step S206, for each key field, obtain the target field that is the same as the key field from the first data asset; if the content corresponding to the target field is the same as the content corresponding to the key field, it indicates that the second data asset has the same basic asset attribute as the first data asset.

[0074] Optionally, for each key field, the server obtains a target field that is identical to the key field from the first data asset; and compares the target field under the same benchmark, such as comparing the home address in the second data asset with the home address in the first data asset. If the content corresponding to the target field is identical to the content corresponding to the key field, then it indicates that the second data asset has the same underlying asset attributes as the first data asset.

[0075] Step S208: If the content corresponding to the target field is different from the content corresponding to the key field, the basic asset attributes of the second data asset and the first data asset are different.

[0076] Optionally, if the content corresponding to the target field is different from the content corresponding to the key field, it indicates that the underlying asset attributes of the second data asset and the first data asset are different.

[0077] In this embodiment, direct field content comparison is used to determine whether the underlying asset attributes are the same or different, so as to subsequently determine the type of the second data asset, thereby improving the accuracy of type judgment and reducing the error rate of inventory counting.

[0078] In an exemplary embodiment, Figure 3 As shown, the link attribute of the first data asset is compared with the link attribute of the second data asset through the data asset link blood relationship to determine the type of the second data asset, including steps S302 to S304. Among them:

[0079] Step S302 : comparing the link attributes of the first data asset and the link attributes of the second data asset through the data asset link blood relationship to determine the link difference information corresponding to the second data asset.

[0080] Optionally, the server compares the link attributes of the first data asset with the link attributes of the second data asset through the data asset link blood relationship, that is, compares the source, destination and change process of the second data asset with the source, destination and change process of the first data asset, to determine whether the second data asset has corresponding link difference information.

[0081] Step S304: determine the type of the second data asset according to the link difference information.

[0082] Optionally, the server determines whether the type of the second data asset is a newly added asset according to the link difference information.

[0083] In this embodiment, the type of the second data asset can be accurately determined based on the link difference information, thereby improving the accuracy of the inventory.

[0084] In an exemplary embodiment, Figure 4 As shown, the data asset link lineage relationship includes a first data asset link lineage relationship and a second data asset link lineage relationship; the link attribute of the first data asset is compared with the link attribute of the second data asset through the data asset link lineage relationship to determine the link difference information corresponding to the second data asset, including steps S402 to S404. Among them:

[0085] Step S402, obtaining a first link snapshot and a second link snapshot, wherein the first link snapshot is determined based on a first lineage link combination in a first data asset link lineage relationship; and the second link snapshot is determined based on a second lineage link combination in a second data asset link lineage relationship.

[0086] The first lineage link and the second lineage link both refer to the links that generate asset value. Link snapshots include the first link snapshot and the second link snapshot. Link snapshots refer to static records or snapshots of the complete process (i.e., lineage relationship) of data changes during its life cycle at a specific moment. Capture all aspects of data from origin, transmission, storage, processing to use, and show the dependencies and associations between them.

[0087] Optionally, before obtaining the first link snapshot and the second link snapshot, a method for determining the second link snapshot includes: enumerating the initial lineage links of the second data asset based on the data circulation nodes of the second data asset; eliminating the initial lineage links of the second data asset that do not meet the asset specifications to obtain the second lineage links of the second data asset; and combining the second lineage links of the second data asset to determine the second link snapshot.

[0088] Furthermore, the server enumerates all the initial lineage links of the second data asset according to the data circulation nodes of the second data asset, such as the four nodes A, B, C, and D, which are 4 in total, such as ABC, ABD, ACD, and BCD. According to the asset specification, the initial lineage links of the second data asset that do not meet the asset specification are eliminated to obtain the second lineage link of the second data asset. If the initial lineage link ABC is a logical processing of the technical caliber and does not generate asset value, the initial lineage link ABC is eliminated, and the remaining second lineage links are 3, namely ABD, ACD, and BCD. The server combines the three second lineage links to obtain a second link snapshot.

[0089] It should be noted that the number of data circulation nodes, the data of the initial bloodline link, and the number of second college links are not limited here.

[0090] Optionally, the first link snapshot is determined based on a combination of first lineage links in the first data asset link lineage relationship, such as a combination of three first lineage links ABD, ACD, and BCD to determine the first link snapshot. The server obtains the first link snapshot and the second link snapshot.

[0091] Step S404: compare each second lineage link in the second link snapshot with the first lineage link in the first link snapshot to determine link difference information corresponding to the second data asset.

[0092] Optionally, the server compares each second bloodline link in the second link snapshot with the first bloodline link in the first link snapshot. If the first link snapshot is based on the first bloodline link ABD, ACD, and BCD, and the second link snapshot is based on the second bloodline link ABD, ACD, and BCD, then the link difference information corresponding to the second data asset is that the second data asset is the same as the first data asset.

[0093] If the first link snapshot is based on the first bloodline link ABD; ACD; BCD; the second link snapshot is based on the second college link ABD; ACD; CD; or the second link snapshot is based on ABD; ACD; BD; at this time, the link difference information corresponding to the second data asset is that the second data asset is different from the first data asset.

[0094] Determine the type of the second data asset according to the link difference information, including steps S406 to S408:

[0095] Step S406: When the second data asset has different basic asset attributes from the first data asset, it indicates that the type of the second data asset is a newly added data asset.

[0096] Among them, newly added data assets indicate assets with different attributes from the underlying assets.

[0097] Optionally, when the basic asset attributes of the second data asset and the first data asset are different, there is no need to judge the link difference information. The link difference information indicates that the second link snapshot is different or the same as the first link snapshot, indicating that the type of the second data asset is a new data asset.

[0098] Step S408: When the second data asset has the same basic asset attribute as the first data asset, and the link difference information indicates that the second link snapshot is different from the first link snapshot, it indicates that the type of the second data asset is a changed data asset.

[0099] Among them, the changed data asset indicates an asset with the same basic asset attributes but different link attributes.

[0100] Optionally, when the second data asset has the same basic asset attribute as the first data asset, and the link difference information indicates that the second link snapshot is different from the first link snapshot, it indicates that the type of the second data asset is a changed data asset.

[0101] In this embodiment, link difference information is obtained by comparing the second link snapshot with the first link snapshot, and the type of the second asset data is accurately determined according to the difference information.

[0102] In an exemplary embodiment, Figure 5 As shown, according to the type of the second data asset, the attribute information of the second data asset is published to the asset catalog to complete the inventory, including steps S502 to S504.

[0103] Step S502: Determine the publishing process of the second data asset according to the type of the second data asset.

[0104] Optionally, the server determines the publishing process of the second data asset according to the type of the second data asset. If the type of the second data asset is a new asset, the server determines the publishing process of the new asset; if the type of the second data asset is a changed asset, the server determines the publishing process of the changed asset.

[0105] Step S504: Publish the attribute information corresponding to the second data asset to the asset catalog in accordance with the publishing process to complete the inventory.

[0106] Optionally, if the type of the second data asset is a newly added asset, the attribute information corresponding to the second data asset is obtained, and relevant basic attributes, business attributes, management attributes, technical attributes, security attributes, blood relationship attributes and other information are collected from the corresponding business system or data platform for automatic acquisition. This information may exist in the database, document or code. The attribute information corresponding to the second data asset is published to the asset catalog to complete the inventory.

[0107] Optionally, if the type of the second data asset is a change asset, the attribute information is changed within the scope allowed by the set asset specification. If it exceeds the scope of the asset specification, manual intervention is required to change the attribute information, and the attribute information corresponding to the second data asset is published to the asset catalog in accordance with the publishing process to complete the inventory.

[0108] In this embodiment, different publishing processes are determined according to different types of second data assets, the attribute information corresponding to the second data assets is obtained, and the attribute information corresponding to the second data assets is published to the asset catalog according to the publishing process to complete the inventory. The attribute information corresponding to the second data assets can be automatically supplemented, reducing the operation of manually intervening in identifying and defining attribute information, thereby improving efficiency.

[0109] In an exemplary embodiment, Figure 6 As shown, the attribute information also includes link attributes; according to the publishing process, the attribute information corresponding to the second data asset is published to the asset directory to complete the inventory, including steps S602 to S604.

[0110] Step S602: If the type of the second data asset is a newly added data asset, the second data asset and the link attributes and basic asset attributes of the second data asset are added to the asset catalog according to the publishing process to complete the inventory.

[0111] Optionally, if the type of the second data asset is a newly added data asset, the second data asset and its link attributes and basic asset attributes are added to the asset catalog according to the publishing process to complete the inventory, and after review, the newly added second data asset in the asset target is published.

[0112] Step S604: If the type of the second data asset is a changed data asset, the link attribute of the first data asset in the asset catalog is replaced with the link attribute of the second data asset to complete the inventory.

[0113] Optionally, if the type of the second data asset is a changed data asset, the link attribute of the first data asset in the asset catalog is replaced with the link attribute of the second data asset to complete the inventory, and after review, the changed second data asset in the asset target is published.

[0114] In this embodiment, different publishing processes are determined by different types of second data assets; attribute information of the second data assets is obtained according to the publishing process, and newly added assets or changed assets in the asset target are published to realize automated inventory.

[0115] In an exemplary embodiment, the metadata to be counted on the server is a trigger condition for starting the inventory count. For example, at a certain moment, new data is added to the database, resulting in changes in metadata. The server detects the changed metadata, i.e., the metadata to be counted, and triggers the start of the inventory count. For another example, at a certain time period, new data is added to the database and some data is deleted, resulting in changes in metadata. The server detects the changed metadata, i.e., the metadata to be counted, and triggers the start of the inventory count.

[0116] According to the metadata to be counted, the first data asset and the second data asset are determined, including: determining the inventory type according to the metadata to be counted; according to the inventory type, obtaining the first data asset corresponding to the inventory type; reading the second data asset corresponding to the inventory type from the metadata to be counted, and the server determines the inventory type according to the metadata to be counted. Among them, the first data asset represents the existing historical data asset; the second data asset represents the current data asset. Such as personal information asset inventory, enterprise information asset inventory, product information asset inventory, contract information asset inventory, financial information asset inventory, etc. Each inventory type corresponds to a set of inventory processes. According to the inventory type, the server obtains the first data asset corresponding to the inventory type; if the inventory type is a personal information asset, the server obtains the existing historical personal information asset from the asset or database, that is, the first asset data. The server reads the current personal information asset from the metadata to be counted. It is convenient to compare the current personal information asset with the historical personal information asset in the future.

[0117] The attribute information includes the attributes of the underlying asset; the server obtains the attributes of the underlying asset of the second data asset, and extracts the comparison subject from the attributes of the underlying asset, for example, the comparison subject is an address, and for example, the comparison subject is a name. According to the comparison subject, the server obtains the name comparison, synonym comparison, semantic comparison, etc. of the comparison subject, thereby obtaining the key field. If the comparison subject is an address, the key field includes a mailing address, a home address, etc. If the comparison subject is a name, the key field includes a user ID, a user name, an account ID, etc. The comparison subject can be multiple. For each key field, the server obtains the target field that is the same as the key field from the first data asset; the comparison is performed under the same benchmark, such as comparing the home address in the second data asset with the home address in the first data asset. If the content corresponding to the target field is the same as the content corresponding to the key field, it indicates that the underlying asset attributes of the second data asset and the first data asset are the same. If the content corresponding to the target field is different from the content corresponding to the key field, it indicates that the underlying asset attributes of the second data asset and the first data asset are different.

[0118] Before obtaining the first link snapshot and the second link snapshot, the method for determining the second link snapshot includes: enumerating the initial lineage links of the second data asset according to the data circulation nodes of the second data asset; eliminating the initial lineage links of the second data asset that do not meet the asset specifications to obtain the second lineage links of the second data asset; and combining the second lineage links of the second data asset to determine the second link snapshot.

[0119] Furthermore, the server enumerates all the initial lineage links of the second data asset according to the data circulation nodes of the second data asset, such as the four nodes A, B, C, and D, which are 4 in total, such as ABC, ABD, ACD, and BCD. According to the asset specification, the initial lineage links of the second data asset that do not meet the asset specification are eliminated to obtain the second lineage link of the second data asset. If the initial lineage link ABC is a logical processing of the technical caliber and does not generate asset value, the initial lineage link ABC is eliminated, and the remaining second lineage links are 3, namely ABD, ACD, and BCD. The server combines the three second lineage links to obtain a second link snapshot.

[0120] The data asset link lineage relationship includes the first data asset link lineage relationship and the second data asset link lineage relationship. The first link snapshot is determined based on the first lineage link combination in the first data asset link lineage relationship; the server compares each second lineage link in the second link snapshot with the first lineage link in the first link snapshot. If the first link snapshot is based on the first lineage link ABD; ACD; BCD composition; the second link snapshot is based on the second college link ABD; ACD; BCD composition; at this time, the link difference information corresponding to the second data asset is that the second data asset is the same as the first data asset. If the first link snapshot is based on the first lineage link ABD; ACD; BCD composition; the second link snapshot is based on the second college link ABD; ACD; CD composition; or the second link snapshot is based on ABD; ACD; BD; at this time, the link difference information corresponding to the second data asset is that the second data asset is different from the first data asset. In the case where the underlying asset attributes of the second data asset and the first data asset are different, there is no need to judge the link difference information. If the link difference information is different or the same as the first link snapshot, it indicates that the type of the second data asset is a newly added data asset. When the second data asset has the same basic asset attribute as the first data asset, and the link difference information indicates that the second link snapshot is different from the first link snapshot, it indicates that the type of the second data asset is a changed data asset.

[0121] The attribute information also includes link attributes; if the type of the second data asset is a newly added data asset, the second data asset and the link attributes and basic asset attributes of the second data asset are added to the asset catalog according to the publishing process to complete the inventory. After review, the newly added second data asset in the asset target is published.

[0122] If the type of the second data asset is a changed data asset, the link attribute of the first data asset in the asset catalog is replaced with the link attribute of the second data asset to complete the inventory, and after review, the changed second data asset in the asset target is released.

[0123] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0124] Based on the same inventive concept, the embodiment of the present application also provides a data asset inventory device for implementing the data asset inventory method involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in one or more data asset inventory device embodiments provided below can refer to the limitations of the data asset inventory method above, and will not be repeated here.

[0125] In an exemplary embodiment, Figure 7 As shown, a data asset inventory device is provided, including: an acquisition module 701, a determination module 702, a link attribute comparison module 703 and an inventory module 704, wherein:

[0126] The acquisition module 701 is used to acquire metadata to be counted, wherein the metadata to be counted represents metadata that has changed.

[0127] The determination module 702 is used to determine the first data asset and the second data asset according to the metadata to be counted; wherein the first data asset represents the existing historical data asset; and the second data asset represents the current data asset.

[0128] The link attribute comparison module 703 is used to compare the link attribute of the first data asset with the link attribute of the second data asset through the data asset link lineage relationship to determine the type of the second data asset.

[0129] The inventory module 704 is used to publish the attribute information of the second data asset to the asset catalog according to the type of the second data asset to complete the inventory.

[0130] In an exemplary embodiment, the attribute information includes basic asset attributes; a data asset inventory device further includes:

[0131] The basic asset attribute comparison module is used to obtain the basic asset attributes of the second data asset and extract the comparison theme from the basic asset attributes; according to the comparison theme, the key field is obtained; for each key field, the target field that is the same as the key field is obtained from the first data asset; if the content corresponding to the target field is the same as the content corresponding to the key field, it indicates that the basic asset attributes of the second data asset and the first data asset are the same; if the content corresponding to the target field is different from the content corresponding to the key field, the basic asset attributes of the second data asset and the first data asset are different.

[0132] In an exemplary embodiment, the link attribute comparison module 703 includes:

[0133] The link difference determination unit is used to compare the link attribute of the first data asset with the link attribute of the second data asset through the blood relationship, and determine the link difference information corresponding to the second data asset.

[0134] The type determination unit is used to determine the type of the second data asset according to the link difference information.

[0135] In an exemplary embodiment, the data asset link lineage relationship includes a first data asset link lineage relationship and a second data asset link lineage relationship; the link difference determination unit includes:

[0136] The acquisition subunit is used to acquire a first link snapshot and a second link snapshot, wherein the first link snapshot is determined based on a first lineage link combination in a first data asset link lineage relationship; and the second link snapshot is determined based on a second lineage link combination in a second data asset link lineage relationship.

[0137] The snapshot comparison subunit is used to compare each second lineage link in the second link snapshot with the first lineage link in the first link snapshot to determine link difference information corresponding to the second data asset.

[0138] Type determination unit, including:

[0139] The newly added asset determination subunit is used to indicate that the type of the second data asset is a newly added data asset when the second data asset has different basic asset attributes from the first data asset.

[0140] The changed asset determination subunit is used to indicate that the type of the second data asset is a changed data asset when the second data asset has the same basic asset attribute as the first data asset and the link difference information indicates that the second link snapshot is different from the first link snapshot.

[0141] In an exemplary embodiment, the inventory module 704 includes:

[0142] The process determination unit is used to determine the publishing process of the second data asset according to the type of the second data asset.

[0143] The publishing unit is used to publish the attribute information corresponding to the second data asset to the asset catalog according to the publishing process to complete the inventory.

[0144] In an exemplary embodiment, the attribute information further includes link attributes; the publishing unit includes:

[0145] The newly added data asset publishing subunit is used to add the second data asset and the link attributes and basic asset attributes of the second data asset to the asset catalog according to the publishing process if the type of the second data asset is a newly added data asset, so as to complete the inventory.

[0146] The changed data asset publishing subunit is used to replace the link attribute of the first data asset in the asset catalog with the link attribute of the second data asset in order to complete the inventory if the type of the second data asset is a changed data asset.

[0147] Each module in the above-mentioned data asset inventory device can be implemented in whole or in part by software, hardware, or a combination thereof. Each of the above-mentioned modules can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute the operations corresponding to each of the above modules.

[0148] In an exemplary embodiment, a computer device is provided. The computer device may be a server, and its internal structure diagram may be as shown in FIG. Figure 8 As shown. The computer device includes a processor, a memory, an input / output interface (Input / Output, referred to as I / O) and a communication interface. The processor, the memory and the input / output interface are connected through a system bus, and the communication interface is connected to the system bus through the input / output interface. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store data asset data. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a data asset inventory method is implemented.

[0149] Those skilled in the art will understand that Figure 8 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0150] In one embodiment, a computer device is further provided, including a memory and a processor, wherein a computer program is stored in the memory, and the processor implements the steps in the above method embodiments when executing the computer program.

[0151] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps in the above-mentioned method embodiments are implemented.

[0152] In one embodiment, a computer program product is provided, including a computer program, which implements the steps in the above method embodiments when executed by a processor.

[0153] A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment method can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, an artificial intelligence (AI) processor, etc., but are not limited to this.

[0154] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0155] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A data asset inventory method, characterized in that: The method comprises: Acquire metadata to be counted, wherein the metadata to be counted represents metadata that has changed; Determine a first data asset and a second data asset according to the metadata to be counted; wherein the first data asset represents an existing historical data asset; and the second data asset represents a current data asset; Comparing the link attributes of the first data asset and the link attributes of the second data asset through the data asset link blood relationship to determine the type of the second data asset; According to the type of the second data asset, the attribute information of the second data asset is published to the asset catalog to complete the inventory.

2. The method according to claim 1, characterized in that The attribute information includes basic asset attributes; before comparing the link attributes of the first data asset and the link attributes of the second data asset through the data asset link lineage relationship, it also includes: Acquire the basic asset attributes of the second data asset, and extract the comparison theme from the basic asset attributes; According to the comparison subject, obtain key fields; For each of the key fields, a target field identical to the key field is obtained from the first data asset; if the content corresponding to the target field is identical to the content corresponding to the key field, it indicates that the second data asset has the same basic asset attribute as the first data asset; If the content corresponding to the target field is different from the content corresponding to the key field, then the second data asset and the first data asset have different basic asset attributes.

3. The method according to claim 2, characterized in that The comparing the link attribute of the first data asset with the link attribute of the second data asset through the data asset link blood relationship to determine the type of the second data asset includes: Comparing the link attributes of the first data asset and the link attributes of the second data asset through the blood relationship, and determining the link difference information corresponding to the second data asset; The type of the second data asset is determined according to the link difference information.

4. The method according to claim 3, characterized in that The data asset link lineage relationship includes a first data asset link lineage relationship and a second data asset link lineage relationship; comparing the link attribute of the first data asset with the link attribute of the second data asset through the data asset link lineage relationship to determine the link difference information corresponding to the second data asset, including: Acquire a first link snapshot and a second link snapshot, wherein the first link snapshot is determined based on a first lineage link combination in the first data asset link lineage relationship; and the second link snapshot is determined based on a second lineage link combination in the second data asset link lineage relationship; Compare each of the second lineage links in the second link snapshot with the first lineage link in the first link snapshot to determine link difference information corresponding to the second data asset; The determining the type of the second data asset according to the link difference information includes: If the underlying asset attributes of the second data asset and the first data asset are different, it indicates that the type of the second data asset is a newly added data asset; If the second data asset has the same basic asset attribute as the first data asset, and the link difference information indicates that the second link snapshot is different from the first link snapshot, it indicates that the type of the second data asset is a changed data asset.

5. The method according to claim 3, characterized in that: The step of publishing the attribute information of the second data asset to the asset catalog according to the type of the second data asset to complete the inventory includes: Determining a publishing process for the second data asset according to the type of the second data asset; According to the publishing process, the attribute information corresponding to the second data asset is published to the asset catalog to complete the inventory.

6. The method according to claim 5, characterized in that The attribute information also includes link attributes; and according to the publishing process, publishing the attribute information corresponding to the second data asset to the asset catalog to complete the inventory, including: If the type of the second data asset is a newly added data asset, adding the second data asset and the link attribute and the basic asset attribute of the second data asset to the asset catalog according to the publishing process to complete the inventory; If the type of the second data asset is a changed data asset, the link attribute of the first data asset in the asset catalog is replaced with the link attribute of the second data asset to complete the inventory.

7. A data asset inventory device, characterized in that: The device comprises: An acquisition module, used for acquiring metadata to be counted, wherein the metadata to be counted represents metadata that has changed; A determination module, configured to determine a first data asset and a second data asset according to the metadata to be counted; wherein the first data asset represents an existing historical data asset; and the second data asset represents a current data asset; A link attribute comparison module, used to compare the link attribute of the first data asset with the link attribute of the second data asset through the data asset link lineage relationship, and determine the type of the second data asset; The inventory module is used to publish the attribute information of the second data asset to the asset catalog according to the type of the second data asset to complete the inventory.

8. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 6 are implemented.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

Images