Data asset management method and system based on big data

By obtaining real-time update of asset information in the database and performing desensitization processing, determining the evaluation information and building an evaluation model, the problems of lag, untrustworthy and difficult evaluation in data asset management are solved, and real-time update and authenticity confirmation of data assets are achieved. , improves management efficiency and accuracy of decision support.

CN119047718AInactive Publication Date: 2024-11-29SHENZHEN TUOBAO SOFTWARE CO LTD

Patent Information

Application Number
CN202411545502.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-11-01
Publication Date
2024-11-29
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

The existing data asset management methods cannot obtain real-time updated data asset information, resulting in lag in information; the authenticity of data asset information cannot be confirmed, resulting in untrustworthy information; the authentic data asset information cannot be evaluated, affecting data asset management efficiency and decision support.

Method used

Obtain real-time update asset information in the database, generate verification asset information through desensitization processing, determine evaluation information, including evaluation tags and evaluation indicators, build evaluation models and generate evaluation results, and use historical transaction data to calculate transaction risk coefficients.

Benefits of technology

Realize real-time updates and authenticity confirmation of data assets, improve the efficiency and accuracy of data asset management, provide timely and accurate decision-making support, ensure the credibility and reliability of data asset information, and effectively identify and filter false information. Data helps enterprises better utilize data assets and improve competitiveness.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119047718A_ABST
    Figure CN119047718A_ABST
Patent Text Reader

Abstract

The invention provides a data asset management method and system based on big data. The method comprises the steps of obtaining real-time update asset information in a database; performing desensitization processing on the updated asset information to generate verification asset information; evaluation information is determined according to the verification asset information, and the evaluation information comprises an evaluation label and an evaluation index; constructing an evaluation model according to the evaluation label, the evaluation index and a transaction risk coefficient obtained through calculation of historical transaction data of the verification asset information; and generating an evaluation result according to the evaluation model and the to-be-evaluated data asset information. The data asset information updated in real time can be obtained, so that the efficiency and the accuracy of data asset management are greatly improved; and data change can be responded more quickly, so that more timely and more accurate decision support is provided for enterprises.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of data asset technology, and in particular to a data asset management method and system based on big data. Background Art

[0002] Data assets refer to data resources that are owned or controlled by individuals or enterprises and can bring future economic benefits to enterprises and are recorded in physical or electronic form. Data assets are data sets in cyberspace that have data ownership (exploration rights, use rights, ownership rights), are valuable, measurable, and readable. Data asset management methods mainly achieve the value-added and efficient use of data assets through the collection, storage, processing and analysis of data. Among them, big data processing technology refers to the technology of collecting, storing, processing and analyzing large-scale data through computer systems, which can help enterprises extract valuable information from large amounts of data. Data asset management technology refers to the technology of collecting, storing, processing and analyzing data assets to achieve the value-added and efficient use of data assets. The field of computer science refers to the field of science and technology that studies computer systems, which involves aspects such as the hardware, software and network of computer systems.

[0003] The existing data asset management methods are mainly implemented through steps such as data collection, data storage, data processing and analysis. Data collection refers to the collection of data through various channels, including networks, sensors, databases, etc.; data storage refers to the storage of collected data in computer systems for subsequent processing and analysis; data processing refers to the cleaning, filtering, conversion, aggregation and other operations on stored data in order to obtain useful data; data analysis refers to the statistics, analysis, mining and other operations on the obtained useful data in order to discover valuable information.

[0004] However, existing data asset management methods have some problems in practical applications. Existing data asset management methods are usually unable to obtain real-time updated data asset information, which will lead to a lag in data asset information; existing data asset management methods are usually unable to confirm the authenticity of data asset information, which will lead to unreliability of data asset information; existing data asset management methods are usually unable to perform data evaluation on authentic data asset information. Summary of the invention

[0005] In view of the above problems, the present application is proposed to provide a data asset management method and system based on big data that overcomes the above problems or at least partially solves the above problems, including: A data asset management method based on big data, the method comprising: Get real-time updated asset information in the database; Desensitizing the updated asset information to generate verification asset information; Determining evaluation information based on the verified asset information, wherein the evaluation information includes an evaluation label and an evaluation index; Constructing an evaluation model based on the evaluation label, the evaluation index, and a transaction risk coefficient calculated from the historical transaction data of the verification asset information; An evaluation result is generated based on the evaluation model and the data asset information to be evaluated.

[0006] Furthermore, the step of acquiring real-time updated asset information in the database includes: The database is divided into a first partition with a high priority and a second partition with a low priority according to preset user needs and usage frequency; Determining a first update cycle corresponding to the first partition and a second update cycle corresponding to the second partition according to the data update instruction, wherein an update frequency of the first update cycle is greater than an update frequency of the second update cycle; Determining an update frequency according to the first update period and the second update period; Reordering the first partition and the second partition according to the update frequency to generate an updated data partition; Obtain each updated asset information in the updated data partition in turn; The real-time updated asset information is generated according to each of the updated asset information.

[0007] Furthermore, the step of performing desensitization processing on the updated asset information to generate verification asset information includes: Determining whether sensitive information exists in the updated asset information; When the sensitive information exists, determining a keyword type in the updated asset information, wherein the keyword type includes name, identity ID and contact information; determining a number of sensitive information in the updated asset information according to the keyword type; Desensitizing the plurality of sensitive information to generate a plurality of desensitized information; Performing hash mapping on a number of the desensitized information to generate a target hash value; The verification asset information is determined based on the keyword type, the target hash value, and the desensitized information.

[0008] Furthermore, the step of determining the verification asset information according to the keyword type, the target hash value and the desensitized information includes: Determine a hash table according to the target hash value, wherein the hash table includes a plurality of data blocks and a plurality of indexes corresponding to the plurality of data blocks; Determining a plurality of target data blocks within a plurality of the data blocks according to the keyword type; Determining a plurality of target indexes according to a plurality of the target data blocks; Determining the information to be replaced in the desensitized information according to the plurality of target indexes; The verification asset information is generated after replacing the information to be replaced according to a plurality of the target indexes.

[0009] Further, the step of determining evaluation information based on the verified asset information, wherein the evaluation information includes evaluation tags and evaluation indicators, comprises: Acquire the evaluation data of the verified asset information within a preset time range, wherein the evaluation data includes asset type, asset flow direction, asset change time point and asset value; Constructing an indicator model based on the asset type, the asset flow direction, the asset change time point and the asset value; Determine the evaluation indicators based on the indicator model and the preset asset early warning rules; Generate an evaluation value based on the evaluation index, the verified asset information and the preset asset early warning rule; Determining an evaluation label according to the evaluation value and the verified asset information; The evaluation information is generated according to the evaluation label and the evaluation index.

[0010] Furthermore, the step of constructing an evaluation model based on the evaluation label, the evaluation index and the transaction risk coefficient calculated from the historical transaction data of the verification asset information includes: Obtaining historical transaction data in the verification asset information, and calculating and generating the transaction risk coefficient; wherein the historical transaction data includes data cost and data risk dimensions; generating a value evaluation index according to the data cost, the data risk dimension and the transaction risk coefficient; An evaluation model is constructed based on the value evaluation index, the evaluation label and the evaluation index.

[0011] Furthermore, the step of generating an evaluation result based on the evaluation model and the data asset information to be evaluated includes: Obtain cost information and revenue information from the data asset information to be evaluated; An evaluation result is generated according to the cost information, the benefit information and the evaluation model.

[0012] An embodiment of the present application further discloses a data asset management system based on big data, the system comprising: The acquisition module is used to obtain real-time updated asset information in the database; A first generating module, configured to perform desensitization processing on the updated asset information to generate verification asset information; A determination module, configured to determine evaluation information based on the verified asset information, wherein the evaluation information includes an evaluation label and an evaluation index; A construction module, used to construct an evaluation model based on the evaluation label, the evaluation index and the transaction risk coefficient calculated from the historical transaction data of the verification asset information; The second generating module is used to generate an evaluation result according to the evaluation model and the data asset information to be evaluated.

[0013] An embodiment of the present application also discloses a computer device, including a processor, a memory, and a computer program stored in the memory and capable of running on the processor, and when the computer program is executed by the processor, the steps of a data asset management method based on big data as described above are implemented.

[0014] An embodiment of the present application further discloses a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the data asset management method based on big data as described above are implemented.

[0015] This application has the following advantages: In the embodiments of the present application, relative to the prior art that "existing data asset management methods are usually unable to obtain real-time updated data asset information, which will cause a lag in data asset information; existing data asset management methods are usually unable to confirm the authenticity of data asset information, which will cause the data asset information to be unreliable; existing data asset management methods are usually unable to perform data evaluation on authentic data asset information", the present application provides a solution that can realize real-time updating of data assets, ensure the credibility of data assets, and thus perform data evaluation, specifically: "obtain real-time updated asset information in the database; desensitize the updated asset information to generate verification asset information; determine evaluation information based on the verification asset information, wherein the evaluation information includes evaluation labels and evaluation indicators; construct an evaluation model based on the evaluation labels, the evaluation indicators and the transaction risk coefficient calculated from the historical transaction data of the verification asset information; generate evaluation results based on the evaluation model and the data asset information to be evaluated". By "obtaining real-time updated asset information in the database", "desensitizing the updated asset information to generate verification asset information" and "generating evaluation results based on the evaluation model and the data asset information to be evaluated", the problems of "existing data asset management methods are usually unable to obtain real-time updated data asset information, which leads to delays in data asset information; existing data asset management methods are usually unable to confirm the authenticity of data asset information, which leads to unreliability of data asset information; existing data asset management methods are usually unable to perform data evaluation on authentic data asset information" are solved, achieving "being able to obtain real-time updated data asset information, which greatly improves the efficiency and accuracy of data asset management; being able to respond to data changes more quickly, thereby It can provide enterprises with more timely and accurate decision support; it can confirm the authenticity of data asset information, which improves the credibility and reliability of data asset information; it can effectively identify and filter out false or untrue data, thereby providing enterprises with more reliable data asset information; it can evaluate data on authentic data asset information, which helps to understand the value of data assets, thereby providing enterprises with more effective data asset management; it can more accurately evaluate the value of data assets, thereby helping enterprises to better utilize their data assets and improve their competitiveness; it has significant advantages in data updating, authenticity confirmation, data evaluation, automated processing and application scenarios, and can provide enterprises with more efficient, accurate and reliable data asset management services. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the technical solution of the present application, the drawings required for use in the description of the present application will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0017] Figure 1 It is a flowchart of a data asset management method based on big data provided by an embodiment of the present application; Figure 2 This is a structural block diagram of a data asset management system based on big data provided by an embodiment of the present application; Figure 3 It is a structural schematic diagram of a computer device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0018] In order to make the objects, features and advantages of the present application more obvious and understandable, the present application is further described in detail below in conjunction with the accompanying drawings and specific implementation methods. Obviously, the described embodiments are part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without creative work are within the scope of protection of the present application.

[0019] The inventors have found through analysis of the prior art that the existing data asset management methods are mainly implemented through steps such as data collection, data storage, data processing and analysis. Among them, data collection refers to collecting data through various channels, including networks, sensors, databases, etc.; data storage refers to storing the collected data in a computer system for subsequent processing and analysis; data processing refers to cleaning, filtering, converting, aggregating and other operations on the stored data in order to obtain useful data; data analysis refers to statistics, analysis, mining and other operations on the obtained useful data in order to discover valuable information. However, the existing data asset management methods have some problems in practical applications. First, the existing data asset management methods are usually unable to obtain real-time updated data asset information, which will lead to a lag in data asset information, thereby affecting the efficiency and accuracy of data asset management. Secondly, the existing data asset management methods are usually unable to confirm the authenticity of data asset information, which will lead to the unreliability of data asset information, thereby affecting the reliability and security of data asset management. Finally, the existing data asset management methods are usually unable to perform data evaluation on authentic data asset information, which will lead to the unknowability of data asset value, thereby affecting the effectiveness and decision support of data asset management.

[0020] Reference Figure 1, showing a flowchart of a data asset management method based on big data provided by an embodiment of the present application; A data asset management method based on big data, the method comprising: S110, obtaining real-time updated asset information in the database; S120, performing desensitization processing on the updated asset information to generate verification asset information; S130, determining evaluation information according to the verified asset information, wherein the evaluation information includes an evaluation label and an evaluation index; S140, constructing an evaluation model based on the evaluation label, the evaluation index, and the transaction risk coefficient calculated from the historical transaction data of the verification asset information; S150: Generate an evaluation result based on the evaluation model and the data asset information to be evaluated.

[0021] In the embodiments of the present application, relative to the prior art that "existing data asset management methods are usually unable to obtain real-time updated data asset information, which will cause a lag in data asset information; existing data asset management methods are usually unable to confirm the authenticity of data asset information, which will cause the data asset information to be unreliable; existing data asset management methods are usually unable to perform data evaluation on authentic data asset information", the present application provides a solution that can realize real-time updating of data assets, ensure the credibility of data assets, and thus perform data evaluation, specifically: "obtain real-time updated asset information in the database; desensitize the updated asset information to generate verification asset information; determine evaluation information based on the verification asset information, wherein the evaluation information includes evaluation labels and evaluation indicators; construct an evaluation model based on the evaluation labels, the evaluation indicators and the transaction risk coefficient calculated from the historical transaction data of the verification asset information; generate evaluation results based on the evaluation model and the data asset information to be evaluated". By "obtaining real-time updated asset information in the database", "desensitizing the updated asset information to generate verification asset information" and "generating evaluation results based on the evaluation model and the data asset information to be evaluated", the problems of "existing data asset management methods are usually unable to obtain real-time updated data asset information, which leads to delays in data asset information; existing data asset management methods are usually unable to confirm the authenticity of data asset information, which leads to unreliability of data asset information; existing data asset management methods are usually unable to perform data evaluation on authentic data asset information" are solved, achieving "being able to obtain real-time updated data asset information, which greatly improves the efficiency and accuracy of data asset management; being able to respond to data changes more quickly, thereby It can provide enterprises with more timely and accurate decision support; it can confirm the authenticity of data asset information, which improves the credibility and reliability of data asset information; it can effectively identify and filter out false or untrue data, thereby providing enterprises with more reliable data asset information; it can evaluate data on authentic data asset information, which helps to understand the value of data assets, thereby providing enterprises with more effective data asset management; it can more accurately evaluate the value of data assets, thereby helping enterprises to better utilize their data assets and improve their competitiveness; it has significant advantages in data updating, authenticity confirmation, data evaluation, automated processing and application scenarios, and can provide enterprises with more efficient, accurate and reliable data asset management services.

[0022] Next, a data asset management method based on big data in this exemplary embodiment will be further described.

[0023] As described in step S110, the real-time updated asset information is obtained in the database.

[0024] In an embodiment of the present invention, the specific process of "obtaining real-time updated asset information in the database" in step S110 can be further explained in combination with the following description.

[0025] As described in the following steps, S210, dividing the database into a first partition with a high priority and a second partition with a low priority according to preset user needs and usage frequency; S220, determining a first update period corresponding to the first partition and a second update period corresponding to the second partition according to the data update instruction, wherein an update frequency of the first update period is greater than an update frequency of the second update period; S230, determining an update frequency according to the first update period and the second update period; S240, reordering the first partition and the second partition according to the update frequency to generate an updated data partition; S250, sequentially obtain each updated asset information in the updated data partition; S260: Generate the real-time updated asset information according to each updated asset information.

[0026] It should be noted that the database partitioning method is to place high-priority asset data into the first partition according to preset user needs and specific usage frequency, and place low-priority asset data into the second partition according to preset user needs and specific usage frequency. This can improve data processing efficiency when processing asset data.

[0027] As an example, a database is divided into a first partition with a high priority and a second partition with a low priority according to preset user needs and usage frequency; a first update period corresponding to the first partition and a second update period corresponding to the second partition are determined through data update instructions, wherein the update frequency of the first update period is greater than the update frequency of the second update period, and partitions with higher priorities are updated more frequently; the update frequency is determined according to the first update period and the second update period, and the first update frequency corresponding to the data in the first partition is obtained through the first update period, and the second update frequency corresponding to the data in the second partition is obtained through the second update period; after integrating the first update frequency and the second update frequency, the first partition and the second partition are reordered to generate an updated data partition; each updated asset information in the updated data partition is obtained in turn; and the real-time updated asset information is generated according to each updated asset information.

[0028] As described in step S120, the updated asset information is desensitized to generate verified asset information.

[0029] In an embodiment of the present invention, the specific process of "desensitizing the updated asset information to generate the verification asset information" in step S120 can be further explained in combination with the following description.

[0030] As described in the following steps, S310, determining whether there is sensitive information in the updated asset information; S320: When the sensitive information exists, determining a keyword type in the updated asset information, wherein the keyword type includes name, identity ID, and contact information; S330, determining a number of sensitive information in the updated asset information according to the keyword type; S340, performing desensitization processing on the plurality of sensitive information to generate a plurality of desensitized information; S350, performing hash mapping on a plurality of the desensitized information to generate a target hash value; S360: Determine the verification asset information according to the keyword type, the target hash value, and the desensitized information.

[0031] It should be noted that hash mapping is a data structure that stores data based on key-value pairs, providing efficient data search, insertion, and deletion operations; the core idea of ​​hash mapping is to use a hash function to convert a key into an array index, and quickly locate the storage location of the data through the index.

[0032] As an example, first determine whether there is sensitive information in the updated asset information, then determine the keywords in the sensitive information, classify them according to the keywords, and then determine the sensitive information in the updated asset information based on the keyword type, and desensitize the sensitive information to obtain desensitized information, and then perform hash mapping on the desensitized information to obtain the target hash value, and then combine the keyword type and the desensitized information to obtain the verified asset information.

[0033] In a specific implementation, when processing sensitive information, it is necessary to perform hash mapping on each sensitive information and obtain the corresponding target hash value, and then use the target hash value to obtain the verification asset information.

[0034] As described in step S360, the verification asset information is determined based on the keyword type, the target hash value and the desensitized information.

[0035] In one embodiment of the present invention, the specific process of "determining the verification asset information according to the keyword type, the target hash value and the desensitized information" in step S360 can be further explained in combination with the following description.

[0036] As described in the following steps, S410, determining a hash table according to the target hash value, wherein the hash table includes a plurality of data blocks and a plurality of indexes corresponding to the plurality of data blocks; S420, determining a plurality of target data blocks within a plurality of the data blocks according to the keyword type; S430, determining a plurality of target indexes according to a plurality of the target data blocks; S440, determining information to be replaced in the desensitized information according to a plurality of the target indexes; S450, replacing the information to be replaced according to a plurality of the target indexes and generating the verification asset information.

[0037] It should be noted that the hash table stores data blocks and indexes corresponding to the data blocks.

[0038] As an example, a hash table is determined based on a target hash value; a number of target data blocks within a number of data blocks are determined by a keyword type, and only the data blocks related to the keyword type need to be determined; a number of target indexes are determined by the target data blocks, and the corresponding target indexes are obtained from the corresponding target data blocks; information to be replaced is determined in the desensitized information based on the target indexes, and the information to be replaced in the desensitized information is determined by the target index; verification asset information is generated after replacing the information to be replaced with the target indexes, and the replaced information is marked as verification asset information.

[0039] In a specific implementation, the technical solution uses the method of confirming the authenticity of the acquired data asset information; after replacing the information through the index, the verification asset information is obtained, thereby confirming the authenticity of the data.

[0040] As described in step S130, the evaluation information is determined based on the verified asset information, wherein the evaluation information includes an evaluation label and an evaluation index.

[0041] In an embodiment of the present invention, the specific process of "determining evaluation information according to the verified asset information, wherein the evaluation information includes an evaluation label and an evaluation index" in step S130 can be further explained in combination with the following description.

[0042] As described in the following steps, S510, obtaining evaluation data of the verified asset information within a preset time range, wherein the evaluation data includes asset type, asset flow direction, asset change time point and asset value; S520, constructing an indicator model according to the asset type, the asset flow direction, the asset change time point and the asset value; S530, determining the evaluation index according to the index model and the preset asset early warning rules; S540, generating an evaluation value according to the evaluation index, the verified asset information and the preset asset warning rule; S550, determining an evaluation tag according to the evaluation value and the verified asset information; S560: Generate the evaluation information according to the evaluation label and the evaluation index.

[0043] It should be noted that asset types include structured data, semi-structured data, unstructured data, metadata, derivative data, transaction data, interaction data, mobile data, Internet of Things data and third-party data.

[0044] It should be noted that asset flow is used to determine the source of data assets and the process of their circulation.

[0045] It should be noted that the asset change time point is used to determine the time range within which data assets change.

[0046] It should be noted that asset value includes historical cost, market price, present value of income, replacement cost and use value.

[0047] As an example, structured data refers to data stored in a fixed format, usually stored in a relational database, and is easy to retrieve and analyze through query languages ​​such as SQL; such as table data in a database, data in a spreadsheet, etc. Semi-structured data refers to data that has no fixed format but has a certain structure, usually stored in a NoSQL database; such as data in JSON and XML formats, log files, etc. Unstructured data refers to data that has no fixed format and structure and is difficult to store and manage through traditional database management systems; such as text data, pictures, audio, video, etc. Metadata refers to data that describes data, including information such as the source, format, content, creator, and creation time of the data; metadata is very important for data management, data governance, and data analysis. Derived data refers to new data generated by processing, analyzing, and converting existing data; such as statistical reports and predictive models generated by data analysis. Transaction data refers to data generated by an enterprise in its daily operations; such as sales data, procurement data, financial data, etc. Interaction data refers to data generated during the interaction between an enterprise and external entities (such as customers, partners, etc.); such as customer feedback, social media data, etc. Mobile data refers to data generated on mobile devices, such as location data, application usage data, etc. IoT data refers to data collected through IoT devices, such as sensor data, device operation data, etc. Third-party data refers to data obtained by enterprises from external sources, such as market research reports, industry data, etc.

[0048] As an example, historical cost refers to the original purchase price or development cost of an asset. Market price refers to the current trading price of similar assets in the market. Present value of benefits refers to the present value of the expected future benefits of an asset. Replacement cost refers to the cost of repurchasing or rebuilding the same or similar asset. Use value refers to the specific use and benefits that an asset provides to the owner.

[0049] In a specific implementation, evaluation data of verified asset information within a preset time range is obtained, and an indicator model is constructed through the evaluation data. The indicator model is used to determine the evaluation indicators corresponding to the verified asset information, and the evaluation indicators are determined based on the indicator model and preset asset early warning rules, wherein the preset asset early warning rules include regular monitoring, setting asset usage rights, asset maintenance plans, asset depreciation, asset scrapping and asset compliance. The evaluation indicators are determined in the indicator model through the set thresholds corresponding to the above-mentioned preset asset early warning rules, and the evaluation values ​​are generated through the evaluation indicators, the verified asset information and the preset evaluation rules. The evaluation values ​​are used to determine which of the different labels in the verified asset information can be used as evaluation labels, and the evaluation labels are determined through the evaluation values ​​and the verified asset information, and then the evaluation information is obtained from the evaluation labels and the evaluation indicators.

[0050] As described in step S140, an evaluation model is constructed based on the evaluation label, the evaluation index, and the transaction risk coefficient calculated from the historical transaction data of the verification asset information.

[0051] In one embodiment of the present invention, the specific process of "constructing an evaluation model based on the evaluation label, the evaluation index and the transaction risk coefficient calculated from the historical transaction data of the verification asset information" in step S140 can be further explained in combination with the following description.

[0052] As described in the following steps, S610, obtaining historical transaction data in the verification asset information, and calculating and generating the transaction risk coefficient; wherein the historical transaction data includes data cost and data risk dimensions; S620, generating a value evaluation index according to the data cost, the data risk dimension, and the transaction risk coefficient; S630: construct an evaluation model based on the value evaluation index, the evaluation label and the evaluation index.

[0053] It should be noted that the transaction risk coefficient is calculated through historical transaction data.

[0054] As an example, the data cost is evaluated with the average cost of the same type of data to obtain the cost evaluation coefficient, and the data risk dimension is evaluated with the average value of the same type of data risk dimension to obtain the risk evaluation coefficient. The value evaluation index is then determined by the cost evaluation coefficient, the risk evaluation coefficient and the transaction risk coefficient. Finally, the evaluation model is obtained by combining the evaluation labels and evaluation indicators.

[0055] In a specific implementation, this technical solution uses an evaluation model to perform data evaluation on data asset information with authenticity. Data analysis, data mining, data visualization, etc. can be achieved through the evaluation model. Data analysis can count and analyze data to discover the inherent laws and value of data, data mining can discover potential patterns and associations in data, and data visualization can intuitively display the value and trend of data; data analysis uses Tableau tools to count and analyze data to discover the inherent laws and value of data; data mining uses RapidMiner tools to discover potential patterns and associations in data; data visualization uses Power BI tools to intuitively display the value and trend of data.

[0056] As described in step S150, an evaluation result is generated based on the evaluation model and the data asset information to be evaluated.

[0057] In an embodiment of the present invention, the specific process of "generating an evaluation result according to the evaluation model and the data asset information to be evaluated" in step S150 can be further explained in combination with the following description.

[0058] As described in the following steps, S710, obtaining cost information and revenue information in the data asset information to be evaluated; S720: Generate an evaluation result based on the cost information, the benefit information and the evaluation model.

[0059] It should be noted that cost information includes material prices and manpower, and revenue information includes business type and business value.

[0060] As an example, the target data asset valuation model is obtained by generating valuation results through cost information, revenue information and valuation model, wherein corresponding valuation analysis information is output through cost-benefit analysis, return on investment, net present value, internal rate of return and break-even analysis of the above-mentioned different items, and the valuation result is obtained by integrating the above-mentioned valuation analysis information.

[0061] In a specific implementation, the evaluation result includes the specific evaluation value of each data asset in the data asset information to be evaluated, and the specific evaluation value is used to indicate the importance of the value of the data asset; the data asset information is uniformly managed by the importance of the value, which may include functions such as data asset catalog, data asset label, and data asset authority to achieve the classification, retrieval, sharing and authorization management of data assets; it may also be to apply data asset information to various business scenarios, such as data analysis, data prediction, data decision-making, etc., and provide a variety of data service interfaces such as RESTful API interfaces according to different situations to support the integration, call and application of data assets; data asset information can also be managed securely, which may include functions such as data encryption, data backup, and data audit to ensure the security and confidentiality of data assets; data encryption uses the AES-256 encryption algorithm, data backup uses a combination of full backup and incremental backup, and data audit uses a combination of log audit and real-time monitoring. The above steps are run on a server cluster, which includes at least 10 servers.

[0062] As for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0063] Reference Figure 2 , shows a structural block diagram of a data asset management system based on big data provided by an embodiment of the present application; A data asset management system based on big data, the system comprising: The acquisition module 210 is used to acquire the real-time updated asset information in the database; A first generating module 220, configured to perform desensitization processing on the updated asset information to generate verification asset information; A determination module 230, configured to determine evaluation information based on the verified asset information, wherein the evaluation information includes an evaluation label and an evaluation index; A construction module 240 is used to construct an evaluation model based on the evaluation label, the evaluation index and the transaction risk coefficient calculated from the historical transaction data of the verification asset information; The second generating module 250 is used to generate an evaluation result according to the evaluation model and the data asset information to be evaluated.

[0064] In one embodiment of the present invention, the acquisition module 210 includes: A first classification submodule, used to divide the database into a first partition with a high priority and a second partition with a low priority according to preset user needs and usage frequency; A first determining submodule, configured to determine a first update period corresponding to the first partition and a second update period corresponding to the second partition according to a data update instruction, wherein an update frequency of the first update period is greater than an update frequency of the second update period; A second determining submodule, configured to determine an update frequency according to the first update period and the second update period; A first generating submodule, configured to reorder the first partition and the second partition according to the update frequency to generate an updated data partition; A first acquisition submodule is used to sequentially acquire each updated asset information in the updated data partition; The second generating submodule is used to generate the real-time updated asset information according to each updated asset information.

[0065] In one embodiment of the present invention, the first generating module 220 includes: A third determination submodule is used to determine whether there is sensitive information in the updated asset information; A fourth determination submodule, configured to determine a keyword type in the updated asset information when the sensitive information exists, wherein the keyword type includes name, identity ID, and contact information; A fifth determination submodule, configured to determine a number of sensitive information in the updated asset information according to the keyword type; A third generating submodule is used to perform desensitization processing on the plurality of sensitive information to generate a plurality of desensitized information; A fourth generation submodule, used for performing hash mapping on a plurality of the desensitized information to generate a target hash value; The sixth determination submodule is used to determine the verification asset information based on the keyword type, the target hash value and the desensitized information.

[0066] In one embodiment of the present invention, the sixth determining submodule includes: A first determining unit, configured to determine a hash table according to the target hash value, wherein the hash table includes a plurality of data blocks and a plurality of indexes corresponding to the plurality of data blocks; A second determining unit, configured to determine a number of target data blocks within a number of the data blocks according to the keyword type; A third determining unit, configured to determine a plurality of target indexes according to a plurality of the target data blocks; A fourth determining unit, configured to determine the information to be replaced in the desensitized information according to a plurality of the target indexes; The first generating unit is used to replace the information to be replaced according to a plurality of the target indexes and then generate the verification asset information.

[0067] In one embodiment of the present invention, the determining module 230 includes: A second acquisition submodule is used to acquire evaluation data of the verification asset information within a preset time range, wherein the evaluation data includes asset type, asset flow direction, asset change time point and asset value; A first construction submodule is used to construct an indicator model according to the asset type, the asset flow direction, the asset change time point and the asset value; A sixth determination submodule, used to determine the evaluation index according to the index model and the preset asset early warning rules; A fifth generating submodule, configured to generate an evaluation value according to the evaluation index, the verification asset information and the preset asset warning rule; A seventh determination submodule, configured to determine an evaluation tag according to the evaluation value and the verification asset information; The sixth generation submodule is used to generate the evaluation information according to the evaluation label and the evaluation index.

[0068] In one embodiment of the present invention, the construction module 240 includes: The third acquisition submodule is used to acquire the historical transaction data in the verification asset information and calculate and generate the transaction risk coefficient; wherein the historical transaction data includes data cost and data risk dimensions; A seventh generating submodule, configured to generate a value evaluation index according to the data cost, the data risk dimension and the transaction risk coefficient; The second construction submodule is used to construct an evaluation model according to the value evaluation index, the evaluation label and the evaluation index.

[0069] In one embodiment of the present invention, the second generating module 250 includes: The fourth acquisition submodule is used to obtain cost information and revenue information in the data asset information to be evaluated; An eighth generating submodule is used to generate an evaluation result according to the cost information, the revenue information and the evaluation model.

[0070] Reference Figure 3 , showing a computer device of a data asset management method based on big data of the present invention, which may specifically include the following: The computer device 12 is in the form of a general-purpose computing device, and the components of the computer device 12 may include but are not limited to: one or more processors or processing units 16, a system memory 28, and a bus 18 connecting different system components (including the system memory 28 and the processing unit 16).

[0071] The bus 18 represents one or more of several types of bus 18 structures, including a memory bus 18 or memory controller, a peripheral bus 18, an accelerated graphics port, a processor, or a local bus 18 using any of a variety of bus 18 architectures. These architectures include, by way of example, but are not limited to, an Industry Standard Architecture (ISA) bus 18, a Micro Channel Architecture (MAC) bus 18, an Enhanced ISA bus 18, an Audio Video Electronics Standards Association (VESA) local bus 18, and a Peripheral Component Interconnect (PCI) bus 18.

[0072] The computer device 12 typically includes a variety of computer system readable media. These media can be any available media that can be accessed by the computer device 12, including volatile and non-volatile media, removable and non-removable media.

[0073] System memory 28 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 30 and / or cache memory 32. Computer device 12 may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, storage system 34 may be used to read and write to non-removable, non-volatile magnetic media (commonly referred to as a "hard drive"). Although Figure 3 Not shown, a disk drive for reading and writing to a removable non-volatile disk (such as a "floppy disk"), and an optical disk drive for reading and writing to a removable non-volatile optical disk (such as a CD-ROM, DVD-ROM or other optical medium) may be provided. In these cases, each drive may be connected to the bus 18 via one or more data medium interfaces. The memory may include at least one program product having a set (e.g., at least one) of program modules 42, which are configured to perform the functions of various embodiments of the present invention.

[0074] A program / utility 40 having a set (at least one) of program modules 42 may be stored in, for example, a memory, such program modules 42 including, but not limited to, an operating system, one or more application programs, other program modules 42, and program data, each of which or some combination may include an implementation of a network environment. The program modules 42 generally perform the functions and / or methods of the embodiments described herein.

[0075] The computer device 12 may also communicate with one or more external devices 14 (e.g., keyboards, pointing devices, displays 24, cameras, etc.), one or more devices that enable a user to interact with the computer device 12, and / or any device that enables the computer device 12 to communicate with one or more other computing devices (e.g., network cards, modems, etc.). Such communication may be performed via an input / output (I / O) interface 22. Furthermore, the computer device 12 may also communicate with one or more networks (e.g., local area networks (LANs)), wide area networks (WANs), and / or public networks (e.g., the Internet) via a network adapter 20. As shown, the network adapter 20 communicates with other modules of the computer device 12 via a bus 18. It should be understood that although Figure 3 Not shown, other hardware and / or software modules may be used in conjunction with the computer device 12, including but not limited to: microcode, device drivers, redundant processing units 16, external disk drive arrays, RAID systems, tape drives, and data backup storage systems 34, etc.

[0076] The processing unit 16 executes various functional applications and data processing by running programs stored in the system memory 28, such as implementing a data asset management method based on big data provided in an embodiment of the present invention.

[0077] That is, when the processing unit 16 executes the program, it achieves: obtaining real-time updated asset information in the database; performing desensitizing processing on the updated asset information to generate verified asset information; determining evaluation information based on the verified asset information, wherein the evaluation information includes evaluation labels and evaluation indicators; constructing an evaluation model based on the evaluation labels, the evaluation indicators and the transaction risk coefficient calculated from the historical transaction data of the verified asset information; and generating an evaluation result based on the evaluation model and the data asset information to be evaluated.

[0078] In an embodiment of the present invention, the present invention further provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements a data asset management method based on big data as provided in all embodiments of the present application: That is, when the program is executed by the processor, it is implemented as follows: obtaining real-time updated asset information in the database; desensitizing the updated asset information to generate verified asset information; determining evaluation information based on the verified asset information, wherein the evaluation information includes evaluation labels and evaluation indicators; constructing an evaluation model based on the evaluation labels, the evaluation indicators and the transaction risk coefficient calculated from the historical transaction data of the verified asset information; and generating an evaluation result based on the evaluation model and the data asset information to be evaluated.

[0079] Any combination of one or more computer-readable media may be used. A computer-readable medium may be a computer readable signal medium or a computer-readable storage medium. A computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared or semiconductor system, device or device, or any combination thereof. More specific examples of computer-readable storage media (a non-exhaustive list) include: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In this document, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in conjunction with an instruction execution system, device or device.

[0080] Computer-readable signal media may include a data signal propagated in baseband or as part of a carrier wave, which carries a computer-readable program code. Such propagated data signals may take a variety of forms, including, but not limited to, electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0081] The computer program code for performing the operation of the present invention can be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as an independent software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computer (for example, using an Internet service provider to connect through the Internet). The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same and similar parts between the various embodiments can be referred to each other.

[0082] Although the preferred embodiments of the present application have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present application.

[0083] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements.

[0084] The above is a detailed introduction to a data asset management method and system based on big data provided by the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea; at the same time, for general technical personnel in this field, according to the idea of ​​the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A data asset management method based on big data, It is characterized in that The method comprises: Get real-time updated asset information in the database; Desensitizing the updated asset information to generate verification asset information; Determining evaluation information based on the verified asset information, wherein the evaluation information includes an evaluation label and an evaluation index; Constructing an evaluation model based on the evaluation label, the evaluation index, and a transaction risk coefficient calculated from the historical transaction data of the verification asset information; An evaluation result is generated based on the evaluation model and the data asset information to be evaluated.

2. The method according to claim 1, It is characterized in that The step of obtaining real-time updated asset information in the database includes: The database is divided into a first partition with a high priority and a second partition with a low priority according to preset user needs and usage frequency; Determining a first update cycle corresponding to the first partition and a second update cycle corresponding to the second partition according to the data update instruction, wherein an update frequency of the first update cycle is greater than an update frequency of the second update cycle; Determining an update frequency according to the first update period and the second update period; Reordering the first partition and the second partition according to the update frequency to generate an updated data partition; Obtain each updated asset information in the updated data partition in turn; The real-time updated asset information is generated according to each of the updated asset information.

3. The method according to claim 1, It is characterized in that The step of performing desensitization processing on the updated asset information to generate verification asset information includes: Determining whether sensitive information exists in the updated asset information; When the sensitive information exists, determining a keyword type in the updated asset information, wherein the keyword type includes name, identity ID and contact information; determining a number of sensitive information in the updated asset information according to the keyword type; Desensitizing the plurality of sensitive information to generate a plurality of desensitized information; Performing hash mapping on a number of the desensitized information to generate a target hash value; The verification asset information is determined based on the keyword type, the target hash value, and the desensitized information.

4. The method according to claim 3, It is characterized in that The step of determining the verification asset information according to the keyword type, the target hash value and the desensitized information includes: Determine a hash table according to the target hash value, wherein the hash table includes a plurality of data blocks and a plurality of indexes corresponding to the plurality of data blocks; Determining a plurality of target data blocks within a plurality of the data blocks according to the keyword type; Determining a plurality of target indexes according to a plurality of the target data blocks; Determining the information to be replaced in the desensitized information according to the plurality of target indexes; The verification asset information is generated after replacing the information to be replaced according to a plurality of the target indexes.

5. The method according to claim 1, It is characterized in that The step of determining evaluation information based on the verified asset information, wherein the evaluation information includes evaluation labels and evaluation indicators, comprises: Acquire the evaluation data of the verified asset information within a preset time range, wherein the evaluation data includes asset type, asset flow direction, asset change time point and asset value; Constructing an indicator model based on the asset type, the asset flow direction, the asset change time point and the asset value; Determine the evaluation indicators based on the indicator model and the preset asset early warning rules; Generate an evaluation value based on the evaluation index, the verified asset information and the preset asset early warning rule; Determining an evaluation label according to the evaluation value and the verified asset information; The evaluation information is generated according to the evaluation label and the evaluation index.

6. The method according to claim 1, It is characterized in that The step of constructing an evaluation model based on the evaluation label, the evaluation index, and the transaction risk coefficient calculated from the historical transaction data of the verification asset information includes: Obtaining historical transaction data in the verification asset information, and calculating and generating the transaction risk coefficient; wherein the historical transaction data includes data cost and data risk dimensions; generating a value evaluation index according to the data cost, the data risk dimension and the transaction risk coefficient; An evaluation model is constructed based on the value evaluation index, the evaluation label and the evaluation index.

7. The method according to claim 1, It is characterized in that The step of generating an evaluation result based on the evaluation model and the data asset information to be evaluated includes: Obtain cost information and revenue information from the data asset information to be evaluated; An evaluation result is generated according to the cost information, the benefit information and the evaluation model.

8. A data asset management system based on big data, It is characterized in that The system comprises: The acquisition module is used to obtain real-time updated asset information in the database; A first generating module, configured to perform desensitization processing on the updated asset information to generate verification asset information; A determination module, configured to determine evaluation information based on the verified asset information, wherein the evaluation information includes an evaluation label and an evaluation index; A construction module, used to construct an evaluation model based on the evaluation label, the evaluation index and the transaction risk coefficient calculated from the historical transaction data of the verification asset information; The second generating module is used to generate an evaluation result according to the evaluation model and the data asset information to be evaluated.

9. A computer device, It is characterized in that The method comprises a processor, a memory, and a computer program stored in the memory and capable of running on the processor, wherein the computer program implements the method according to any one of claims 1 to 7 when executed by the processor.

10. A computer-readable storage medium, It is characterized in that The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.

Citation Information

Patent Citations

  • Asset cost method valuation model for fixed assets

    CN112884535A

  • Big data asset value evaluation system and method

    CN113361980A

  • Business data intelligent storage method and system based on data-in-data platform

    CN116821428A

  • Method for operating IT asset data in data governance platform

    CN117874109A

  • Data asset evaluation method and device, equipment, storage medium and program product

    CN118279001A

Cited By

  • Automatic decision-making system and method for information asset large model

    CN119557810A