Data asset management system, method and equipment

Abstract

The invention provides a data asset management system, method and device, and relates to the technical field of big data. Comprising a data governance module used for collecting system data and data information of each piece of system data from each target business system, preprocessing the system data according to a preset data governance strategy and the data information of each piece of system data to obtain preprocessed data, integrating the preprocessed data and generating a data source; the data management module is used for analyzing a business target and a business process of the target business scene, determining data signs and data sources related to the business target and the business process in the target business scene, receiving and analyzing management element information sent by a user, extracting corresponding data signs from the data sources, and generating business data; and the data display module is used for generating a visual interface according to the business data, and the visual interface at least comprises the business data.

Description

Technical Field

[0001] This application relates to the field of big data technology, and particularly to a data asset management system, method, and device. Background Art

[0002] With the rapid development of the Internet industry, more and more enterprises begin to attach importance to data value. However, due to the existence of data islands, data cannot be effectively utilized, resulting in waste of resources.

[0003] Currently, data platforms mainly solve the above problems by providing data warehouse services. However, data warehouses can only meet the needs of some data applications and cannot fully meet all the data application needs of enterprises. Moreover, the data provided by data warehouses is processed data, lacking an explanation of the data source, making it difficult for business personnel to understand the meaning of the data, thus affecting the data application efficiency. Summary of the Invention

[0004] This application provides a data asset management system, method, and device to solve the problem of low data application efficiency in the prior art.

[0005] In a first aspect, an embodiment of this application provides a data asset management system, which includes: A data governance module, configured to collect system data and data information of each system data from various target business systems, and preprocess the system data according to a preset data governance strategy and the data information of each system data to obtain preprocessed data, and integrate the preprocessed data to generate a data source. The data information includes at least data structure, data type, data format, and data source. The data governance strategy includes at least one of data cleaning, data conversion, data standardization, data desensitization, data archiving, and data auditing. The various target business systems represent systems that generate, store, or manage specific system data. The data source represents the original data source of data features; A data management module, configured to analyze the business objectives and business processes of a target business scenario, determine the data features and data sources related to the business objectives and business processes in the target business scenario, receive and parse management element information sent by a user, extract corresponding data features from the data source, and generate business data. The target business scenario represents a specific business environment that an enterprise needs to improve. The data features represent data indicators of the target business scenario. The management element information represents specific conditions for extracting the data features; A data display module, configured to generate a visualization interface according to the business data, and the visualization interface at least displays the business data under each target business scenario.

[0006] Optionally, the data management module includes a data metric traceability unit, and the data metric traceability unit is configured to: Extract data metrics from the data signs; Determine the definition description of the data metric, where the definition description at least includes the calculation method and the basic data set of the data metric; Identify associated data metrics according to the calculation method and the basic data set, where the associated data metrics represent other data metrics that the data metric depends on; Determine the association logic between the data metric and the associated data metrics.

[0007] Optionally, the data display module includes a source context display unit, and the source context display unit is configured to: Construct a source context framework diagram; Fill the association logic and the data sources on which the data metrics depend into the source context framework diagram to generate a source context diagram.

[0008] Optionally, the data display module includes a data display unit, and the data display unit is configured to: Construct a layout method according to preset display requirements, where the layout method represents the positions of the business data and the source context diagram in the visualization interface; Determine visualization elements according to the data type of the business data, where the visualization elements represent the display methods of the business data; Draw the business data according to the visualization elements to generate a data chart; Integrate the data chart and the source context diagram together according to the layout method to generate the visualization interface.

[0009] Optionally, it further includes an early warning notice generation module, and the early warning notice generation module is configured to: Determine the early warning status of the business data according to the early warning criteria; In the case where the early warning status is a severe early warning status, fill the business data metrics, the early warning criteria, and the early warning status into the first position of the early warning notice template; Determine the associated data metrics of the business data, and fill the associated data metrics of the business data into the second position of the early warning notice template to generate an early warning notice.

[0010] Optionally, it further includes a data asset evaluation module, and the data asset evaluation module is configured to: Determine the usage frequencies of each data sign in each target business scenario; Determine the contribution degree of each data feature in each target business scenario according to the usage frequency of each data feature in each target business scenario; Clean the data features below the target threshold according to the contribution degree of each data feature in each target business scenario.

[0011] Optionally, it further includes a standardized interface module, and the standardized interface module is used for: Obtain interface requirements, and the interface requirements at least include an interaction system and an interaction function; Construct an interface specification according to the interface requirements, and the interface specification at least includes a data format, a communication protocol, an authentication and authorization mechanism, and an interface function scope; Generate an interface document according to the interface specification, and the interface document at least includes the URL path of each interface, the interface request method, the request parameters, and the response format; Generate interface code according to the interface document; Use the interface code to construct a standardized interface, and the standardized interface is used to receive the system data and the data information of each system data, and send the business data.

[0012] Optionally, it further includes a report management module, and the report management module is used for: Construct a standard report template; Extract the key information in the visualization interface, and the key information at least includes the business data and the source context diagram; Fill the business data and the source context diagram into the standard report template to generate a management report, and the management report represents the source context of each business indicator in the business data.

[0013] In a second aspect, an embodiment of the present application further provides a data asset management method, and the data asset management method includes the following steps: Collect system data and the data information of each system data from each target business system, and preprocess the system data according to a preset data governance strategy and the data information of each system data to obtain preprocessed data, and integrate the preprocessed data to generate a data source. The data information at least includes a data structure, a data type, a data format, and a data source. The data governance strategy includes at least one of data cleaning, data conversion, data standardization, data desensitization, data archiving, and data auditing. Each target business system represents a system that generates, stores, or manages specific system data, and the data source represents the original data source of the data features; Analyze the business objectives and business processes of the target business scenario, determine the data characteristics and data sources related to the business objectives and business processes in the target business scenario, receive and parse the management element information sent by the user, extract the corresponding data characteristics from the data sources, generate business data. The target business scenario represents the specific business environment that the enterprise needs to improve. The data characteristics represent the data indicators of the target business scenario. The management element information represents the specific conditions for extracting the data characteristics; Generate a visualization interface based on the business data. The visualization interface at least displays the business data under each target business scenario.

[0014] In a third aspect, an embodiment of the present application further provides an electronic device, including: a processor; a memory for storing executable instructions of the processor; wherein, the processor is configured to execute the instructions to implement the data asset management method as described above.

[0015] In a fourth aspect, an embodiment of the present application further provides a computer-readable storage medium. When the instructions in the computer-readable storage medium are executed by the processor of the terminal, the terminal can execute the data asset management method as described above.

[0016] In a fifth aspect, an embodiment of the present application further provides a computer program product. The computer program product includes a computer program, and when the computer program is executed by the processor, it implements the data asset management method as described above.

[0017] In the present application, through preset data governance strategies, the system data of each business system is preprocessed and integrated to generate data sources, and according to the requirements of the business scenario, data characteristics are extracted from the data sources and business data is generated. The business data is presented using a visualization interface, which not only realizes the flexible extraction of business data according to user requirements, but also realizes the unified management of the data of each business system. The business data is displayed in a visual way, which is convenient for business personnel to quickly understand the meaning of the data and improves the data application efficiency. Description of the Drawings

[0018] Figure 1 Shows a schematic diagram of the architecture of a data asset management system provided by an embodiment of the present application; Figure 2 Shows a first example diagram of the visualization interface provided by an embodiment of the present application; Figure 3 Shows a second schematic diagram of the visualization interface provided by an embodiment of the present application; Figure 4 Shows a schematic diagram of the architecture of a data asset management system provided by another embodiment of the present application; Figure 5Shows a schematic diagram of a data asset management system architecture provided by another embodiment of the present application; Figure 6 Shows a schematic diagram of a data asset management system architecture provided by another embodiment of the present application; Figure 7 Shows a schematic diagram of a data asset management system architecture provided by another embodiment of the present application; Figure 8 Shows a schematic diagram of a data asset management system architecture provided by another embodiment of the present application; Figure 9 Shows a schematic diagram of a data asset management system architecture provided by another embodiment of the present application; Figure 10 Shows a flowchart of steps of a data asset management method provided by an embodiment of the present application; Figure 11 Shows a block diagram of an electronic device provided by an exemplary embodiment of the present application. Detailed implementation manners

[0019] To make the above objects, features, and advantages of the present application more obvious and understandable, the present application will be further described in detail below with reference to the accompanying drawings and specific implementation manners.

[0020] Embodiment 1 Refer to Figure 1 , an embodiment of the present application provides a data asset management system. As Figure 1 shown, the data asset management system includes: A data governance module 100, configured to collect system data and data information of each system data from each target business system, and preprocess the system data according to a preset data governance strategy and the data information of each system data to obtain preprocessed data, and integrate the preprocessed data to generate a data source. The data information includes at least data structure, data type, data format, and data source. The data governance strategy includes at least one of data cleaning, data conversion, data standardization, data desensitization, data archiving, and data auditing. The each target business system represents a system that generates, stores, or manages specific system data. The data source represents the original data source of data features.

[0021] Specifically, the data governance module 100 is used to integrate the system data in multiple target business systems and the data information of the system data. By collecting the system data and the data information of each system data, the collected data is preprocessed according to a preset data governance strategy, and the data governance strategy can be flexibly set according to the actual situation. After collecting the system data and then preprocessing the system data, the preprocessed data is integrated together to generate a data source. The data source represents the set of all possible data signs extracted from each target business system.

[0022] Exemplarily, the data governance module 100 can obtain the system data from the target business system through ways such as API (Application Programming Interface), SDK (Software Development Kit), etc. The data governance module 100 can also directly access the database in the target business system to obtain the system data, and can also obtain the system data from the target business system through other ways, which will not be elaborated here one by one. The preset data governance strategy includes but is not limited to data cleaning, data conversion, data standardization, data archiving, and data auditing. Data cleaning includes removing duplicate data and invalid data. Data conversion includes format conversion and unit conversion. Data standardization includes unifying data standards. Data desensitization includes protecting sensitive information. Data archiving includes long-term storage. Data auditing includes verifying the integrity and accuracy of data. By integrating the data processed in each target business system, reliable data support is provided for data asset management.

[0023] The data management module 200 is used to analyze the business objectives and business processes of the target business scenario, determine the data signs and data sources related to the business objectives and business processes in the target business scenario, receive and parse the management element information sent by the user, extract the corresponding data signs from the data source, and generate business data. The target business scenario represents the specific business environment that the enterprise needs to improve. The data sign represents the data index of the target business scenario. The management element information represents the specific conditions for extracting the data sign.

[0024] In the process of determining data signs, it is first necessary to clarify the business objectives of the target business scenario. The business objectives are set through preset settings. After determining the business objectives, by sorting out the business processes related to the business objectives, the data signs closely related to the business objectives and business processes are identified. Data signs are data indicators in the target business scenario that can reflect business status and trends. Based on the data signs, the data sources of the data signs can be located. Exemplarily, the business objectives involve improving production efficiency, optimizing customer service, and increasing sales revenue. The business processes include a series of activities from raw material procurement to product production, sales, and after-sales service. The data signs include sales volume, customer satisfaction, inventory turnover rate, etc.

[0025] Specifically, the management element information is set based on the actual needs of the user. Different management element information corresponds to different data signs. Exemplarily, by parsing the management element information sent by the user, the management element information is converted into computer-recognizable instructions or parameters, and these instructions or parameters are used to guide the specific operations of extracting data signs from the data source. After extracting the data signs, through further processing of the data signs, after data cleaning or data aggregation, business data that meets the business requirements is generated. By converting the user's management element information into a specific operable processing flow and generating business data that meets the business requirements, data support is provided.

[0026] Exemplarily, after the data governance module 100 completes the data governance work, it will transmit the data source to the data management module 200. The data management module 200 can extract the required data signs from the data source and generate business data. The data management module 200 first needs to analyze the business objectives and business processes of the target business scenario to determine the data signs and data sources related to the business objectives and business processes in the target business scenario. For example, if the business objective of the target business scenario is to improve customer satisfaction, then the related data signs may be the age, gender, occupation, income level, consumption habits, etc. of the customers, and the related data sources may be the customer relationship management system (CRM), transaction system, marketing system, etc. If it is necessary to improve customer satisfaction, then it is necessary to focus on the related data signs such as customer feedback, complaints, evaluations, etc., rather than focusing on the data signs such as product performance and price. The data management module 200 will then receive and parse the management element information sent by the user to determine the required business data. The management element information is the specific conditions used by the user to extract data signs, such as time interval, geographical scope, population attributes, etc. The data management module 200 can extract the required data signs from the data source according to the management element information and generate business data.

[0027] The data display module 300 is used to generate a visual interface according to the business data, and the visual interface at least displays the business data under each target business scenario.

[0028] Specifically, business data is transformed into an easy-to-understand form through a visualization interface using charts, graphs, etc., enabling users to intuitively understand and analyze the data, gain insights into business trends, discover business problems, and provide support for business decisions. By switching the various target business scenarios in the visualization interface, the business data related to the target business scenario can be intuitively displayed.

[0029] Exemplarily, such as Figure 2 and Figure 3 As shown, the visualization page displays the names of the various target business scenarios, which include administrative office management, strategic and performance management, investment management, financial and fund management, human resources management, science and technology management, audit management, legal affairs management, full-cycle project engineering management, tendering and procurement management, work safety supervision management, environmental protection management, quality management, project management, operating budget management, overseas business management, market development management. When the user clicks on the location where the name of science and technology management is located and the visualization interface switches to the science and technology management target business scenario, the visualization interface shows the number of national science and technology platforms, the number of provincial science and technology platforms, the number of group and science and technology platforms, the number of valid patents, the number of valid invention patents, the number of software copyrights over the years; as well as a list of major events related to science and technology management, operating income, total profit, newly signed contract amount, and also shows the planned value, actual value, and completion rate. In addition, the visualization interface also shows the number of various projects differentiated by region, the real-time monitoring of the project site, and the performance completion situation. In another example, the visualization interface also shows the inflow and outflow of various funds, as well as the changing trends of bulk purchases and major product sales.

[0030] In this embodiment, by constructing a data asset management system and integrating the data governance module 100, the data management module 200, and the data display module 300, the problems of ineffective data utilization and resource waste caused by current data islands are effectively solved. The data governance module 100 generates a data source containing a detailed description of the data source by collecting, preprocessing, and integrating the system data and its data information in multiple target business systems, solving the problem of the lack of source description of the data in the data warehouse. The data management module 200 determines relevant data features and data sources according to the business objectives and business processes of the target business scenario, extracts data features according to the management element information of the user, generates business data, improves the application efficiency of the data, and extracts data features according to the specific needs of the user, improving the flexibility of the extraction of business data. Finally, the data display module 300 presents the business data to the user in an easy-to-understand form through a visual interface to support business decisions. It effectively solves the problems of resource waste and low data utilization efficiency caused by data islands in the prior art, and achieves the technical effects of efficient data integration and utilization, clearer understanding of data sources, and support for business decisions.

[0031] In this application, through a preset data governance strategy, the system data of each business system is preprocessed and integrated to generate a data source, and according to the requirements of the business scenario, data features are extracted from the data source and business data is generated. The business data is presented using a visual interface. This not only realizes the flexible extraction of business data according to user needs, but also realizes the unified management of the data of each business system. The business data is displayed visually, which is convenient for business personnel to quickly understand the meaning of the data and improves the data application efficiency.

[0032] As Figure 4 shown, the data management module 200 includes a data index traceability unit 210, and the data index traceability unit 210 is used for: Extracting the data index in the data feature.

[0033] Determining the definition description of the data index, and the definition description includes at least the calculation method and the basic data set of the data index.

[0034] According to the calculation method and the basic data set, identifying associated data indexes, and the associated data indexes represent other data indexes on which the data index depends.

[0035] Determining the association logic between the data index and the associated data indexes.

[0036] Specifically, since the data feature may contain various types of data and information, by extracting the data index in the data feature, the key value for measuring a specific business can be determined, providing a clear direction for subsequent data analysis and processing. By extracting the data index, the workload of data processing can also be reduced, and the efficiency of data processing can be improved.

[0037] After determining the data metrics, the data metric traceability unit 210 will further search for and determine the definition description of the data metrics. The definition description includes at least the calculation method and the basic data set of the data metrics. The calculation method describes how to calculate the value of the data metrics based on the basic data set, and the basic data set refers to the set of basic data required in the calculation process. According to the calculation method and the basic data set, other data metrics on which the data metrics depend are identified. By clarifying the association logic between the data metrics and the associated data metrics, it helps to understand the interaction and influence between the data metrics, providing more comprehensive data support for subsequent data processing and analysis.

[0038] As Figure 5 shown, the data display module 300 includes a source context display unit 310, and the source context display unit 310 is used for: Construct a source context framework diagram.

[0039] Fill the association logic and the data sources on which the data metrics depend into the source context framework diagram to generate a source context diagram.

[0040] Specifically, the source context framework diagram, as a structured representation, is used to display the data metrics, the data sources corresponding to each data metric, and the association logic between each data metric. Using the source context framework diagram helps to clearly display the source and destination of the data, and it is also easier to identify and understand the relationship between the data.

[0041] By filling the association logic and the data sources on which the data metrics depend into the source context framework diagram to generate a source context diagram, the dependence relationship between each data metric is clearly displayed, the type and location of the data sources are clarified, and the connection relationship between the data sources and the data metrics is determined, which helps to improve the visualization effect. Through the source context diagram, it is easier to trace the source and destination of the data and improve the data visualization effect.

[0042] As Figure 5 shown, the data display module 300 includes a data display unit 320, and the data display unit 320 is used for: Construct a layout method according to the preset display requirements. The layout method represents the positions of the business data and the source context diagram in the visualization interface.

[0043] Specifically, the layout method represents the positional relationship between the business data and the source context diagram in the visualization interface, including the arrangement order, relative size, and spatial distribution, etc. By constructing the layout method, it is ensured that the business data and the source context diagram are arranged in an orderly manner and reasonably distributed in the visualization interface, which not only improves the aesthetics and readability of the interface, but also helps users quickly locate and understand the key information, enhancing the effect of data display.

[0044] Determine the visualization elements according to the data type of the business data, where the visualization elements represent the display method of the business data.

[0045] Specifically, the visualization elements are the specific embodiments of the display method of the business data, including various types such as bar charts, line charts, pie charts, scatter plots, etc. Different data types are suitable for different visualization elements, which helps to more intuitively express the characteristics and trends of the data and improve the readability of the data.

[0046] Draw the business data according to the visualization elements to generate a data chart.

[0047] Specifically, drawing the business data according to the visualization elements can clearly display information such as the quantity, proportion, and change trend of the data. By drawing the business data, a clear and accurate data chart is generated, which helps users to more intuitively understand the characteristics and trends of the business data. This not only improves the intuitiveness of data display but also helps users to make decisions and judgments more quickly.

[0048] Integrate the data chart and the source context diagram together according to the layout method to generate a visualization interface.

[0049] Specifically, integrating the data chart and the source context diagram together according to the layout method to generate a visualization interface not only intuitively displays the business data but also shows the source and dependency relationship of the data, providing comprehensive information support for users.

[0050] In this embodiment, through a series of steps such as constructing the layout method, determining the visualization elements, drawing the business data, and integrating the data chart and the source context diagram, the efficient and intuitive display of the business data and the source context diagram is realized.

[0051] As Figure 6 shown, it further includes a warning notice letter generation module 400, and the warning notice letter generation module 400 is used for: Determine the warning status of the business data according to the warning criteria.

[0052] In the case where the warning status is a severe warning status, fill the business data indicators, warning criteria, and warning status into the first position of the warning notice letter template.

[0053] Determine the associated data indicators of the business data, fill the associated data indicators of the business data into the second position of the warning notice letter template, and generate a warning notice letter.

[0054] In the case where the warning status is a severe warning status, fill the business data indicators, warning criteria, and warning status into the first position of the warning notice letter template.

[0055] Determine the associated data metrics of the business data, fill the associated data metrics of the business data into the second position of the warning prompt letter template, and generate a warning prompt letter.

[0056] Specifically, when the business data metric is lower than the warning standard, determine the warning status according to the warning standard line. In the case of a severe warning status, filling the business data metric, warning standard, warning status, and associated data metrics into the warning prompt letter template helps to understand the associated data metrics and warning status of the business data metric, as well as the business logic behind the business data metric.

[0057] Exemplarily, when the warning metric is the total profit, the monthly breakdown metric is 6000, and the actual value from January to June is 1574.63. Since the warning standard is 2739.51 and the actual value from January to June is lower than the warning standard, it can be determined that the warning status is a severe warning. In another embodiment, when the warning metric is the net cash flow from operating activities, the annual budget value is 6480, the actual value from January to June is -3604.26, and the warning standard is 2268. Since the actual value from January to June is lower than the warning standard, it can be determined that the warning status is a severe warning. By determining the data association metrics of the total profit and the net cash flow from operating activities, filling the data association metrics of the total profit and the net cash flow from operating activities, the monthly breakdown metric of the total profit, the actual value from January to June of the total profit, the warning standard and warning status of the total profit, the annual budget value of the net cash flow from operating activities, the actual value from January to June, the warning standard and warning status of the net cash flow from operating activities into the warning prompt letter template, a warning prompt letter related to the net cash flow from operating activities and the total profit is generated. This not only helps with the business status of the net cash flow from operating activities and the total profit but also enables the discovery of anomalies in the associated data metrics through the data association metrics and quickly determines the reasons for the warning.

[0058] Refer to Figure 7 , and also includes a data asset evaluation module 500, and the data asset evaluation module 500 is used for: Determine the usage frequency of each data feature in each target business scenario.

[0059] According to the usage frequency of each data feature in each target business scenario, determine the contribution degree of each data feature in each target business scenario.

[0060] According to the contribution degree of each data feature in each target business scenario, clean up the data features below the target threshold.

[0061] Specifically, based on the usage frequency of each data feature in each target business scenario, as well as the business impact degree and regular audit situation of each data feature in each target business scenario, the asset level of each data feature in each target business scenario can be determined. By determining the asset level, a storage strategy can be determined to clean up the data features with a low asset level and optimize the storage cost.

[0062] As Figure 8 shown, it also includes a standardized interface module 600, and the standardized interface module 600 is used for: Obtaining interface requirements, where the interface requirements at least include an interaction system and interaction functions.

[0063] Specifically, the interface requirements refer to the requirements for the interaction system and interaction functions. The interface requirements at least include the type of the interaction system, the required interaction functions, and the specific requirements for data exchange. By obtaining the interface requirements, a clear direction and basis are provided for constructing the interface specification, ensuring the rationality and practicability of the interface design and meeting the actual needs of the data asset management system.

[0064] According to the interface requirements, constructing an interface specification, where the interface specification at least includes a data format, a communication protocol, an authentication and authorization mechanism, and an interface function scope.

[0065] Specifically, the interface specification at least includes key elements such as a data format, a communication protocol, an authentication and authorization mechanism, and an interface function scope. By constructing the interface specification, it is ensured that the data formats between different systems are consistent, the communication protocols are compatible, the authentication and authorization mechanisms are secure, and the interface function scopes are clear, which helps to achieve seamless docking and data exchange between systems and improve the overall performance and stability of the data asset management system.

[0066] According to the interface specification, generating an interface document, where the interface document at least includes the URL path of each interface, the interface request method, request parameters, and a response format.

[0067] Specifically, the interface document is used to provide a clear and detailed interface design description to help users quickly understand and implement the interface functions. At the same time, the interface document, as an important basis for system maintenance and upgrade, helps to ensure the sustainability and scalability of the data asset management system.

[0068] According to the interface document, generating interface code.

[0069] Specifically, through the interface code, the interface design is transformed into actual system functions to achieve data exchange and communication between systems, which helps to ensure the functional integrity and performance stability of the system and improve the overall operation efficiency of the data asset management system.

[0070] Using interface code, a standardized interface is constructed. The standardized interface is used to receive system data and data information of each system data, as well as to send business data.

[0071] Specifically, constructing a standardized interface can achieve seamless communication and data exchange between systems, ensuring data consistency and accuracy, thereby improving the overall performance of the system.

[0072] In this embodiment, through a series of steps such as obtaining interface requirements, constructing interface specifications, generating interface documents, generating interface code, and constructing a standardized interface, smooth communication and data exchange between systems are realized, providing a strong guarantee for the stable operation and sustainable development of the data asset management system.

[0073] As Figure 9 shown, it further includes a report management module 700. The report management module 700 is used for: Constructing a standard report template.

[0074] Specifically, the standard report template is a predefined report format that contains the structure, style, and layout required for the report. The standard report template ensures report consistency, facilitating quick understanding and analysis of the report content. At the same time, using the standard report template simplifies the report generation process and improves work efficiency.

[0075] Extracting key information from the visualization interface. The key information includes at least business data and the source context diagram.

[0076] Filling the business data and the source context diagram into the standard report template to generate a management report, where the management report represents the source context of each business indicator in the business data.

[0077] Specifically, by extracting key information from the visualization interface, it ensures that the management report contains the most accurate and relevant data to the report itself, helps to deeply understand the meaning and background of the business data, and thus makes more informed decisions. By extracting key information from the visualization interface, it simplifies the data collection and collation process and improves the generation efficiency of the management report.

[0078] Embodiment 2 As Figure 10 shown, the embodiment of the present application further provides a data asset management method. The data asset management method includes the following steps: S601. Collect system data from each target business system and the data information of each system data. According to the preset data governance strategy and the data information of each system data, preprocess the system data to obtain preprocessed data, and integrate the preprocessed data to generate a data source. The data information includes at least data structure, data type, data format, and data source. The data governance strategy includes at least one of data cleaning, data conversion, data standardization, data desensitization, data archiving, and data auditing. Each target business system represents a system that generates, stores, or manages specific system data. The data source represents the original data source of data characteristics. S602. Analyze the business objectives and business processes of the target business scenario, determine the data characteristics and data sources related to the business objectives and business processes in the target business scenario, receive and parse the management element information sent by the user, extract the corresponding data characteristics from the data source, and generate business data. The target business scenario represents a specific business environment that an enterprise needs to improve. The data characteristics represent the data indicators of the target business scenario. The management element information represents the specific conditions for extracting the data characteristics. S603. Generate a visual interface based on the business data. The visual interface at least displays the business data under each target business scenario.

[0079] In some embodiments, S602. Analyze the business objectives and business processes of the target business scenario, determine the data characteristics and data sources related to the business objectives and business processes in the target business scenario, receive and parse the management element information sent by the user, extract the corresponding data characteristics from the data source, and generate business data. The target business scenario represents a specific business environment that an enterprise needs to improve. The data characteristics represent the data indicators of the target business scenario. The management element information represents the specific conditions for extracting the data characteristics, including the following steps: Extract the data indicators in the data characteristics; Determine the definition description of the data indicators. The definition description includes at least the calculation method and the basic data set of the data indicators; According to the calculation method and the basic data set, identify the associated data indicators. The associated data indicators represent other data indicators that the data indicators depend on; Determine the association logic between the data indicators and the associated data indicators.

[0080] In some embodiments, S603. Generate a visual interface based on the business data. The visual interface at least includes the business data, including the following steps: Construct a source context framework diagram; Populate the data sources on which the association logic and data metrics depend into the source context framework diagram to generate a source context diagram.

[0081] In some embodiments, S603. Generate a visualization interface based on the business data, where the visualization interface at least includes the business data, and further includes the following steps: Construct a layout method according to the preset display requirements, where the layout method represents the positions of the business data and the source context diagram in the visualization interface; Determine visualization elements according to the data type of the business data, where the visualization elements represent the display methods of the business data; Draw the business data according to the visualization elements to generate a data chart; Integrate the data chart and the source context diagram together according to the layout method to generate a visualization interface.

[0082] In some embodiments, it further includes the following steps: Determine the warning status of the business data according to the warning criteria.

[0083] In the case where the warning status is a severe warning status, fill the business data metrics, warning criteria, and warning status into the first position of the warning notice letter generation template.

[0084] Determine the associated data metrics of the business data, fill the associated data metrics of the business data into the second position of the warning notice letter generation template, and generate a warning notice letter.

[0085] In some embodiments, it further includes the following steps: Determine the usage frequencies of the various data signs in each target business scenario.

[0086] Determine the contribution degrees of the various data signs in each target business scenario according to the usage frequencies of the various data signs in each target business scenario.

[0087] Clean up the data signs below the target threshold according to the contribution degrees of the various data signs in each target business scenario.

[0088] In some embodiments, it further includes the following steps: Obtain interface requirements, where the interface requirements at least include an interaction system and interaction functions; Construct an interface specification according to the interface requirements, where the interface specification at least includes a data format, a communication protocol, an authentication and authorization mechanism, and an interface function scope; Generate an interface document according to the interface specification, where the interface document at least includes the URL paths of the various interfaces, the interface request methods, the request parameters, and the response formats; Generate interface code according to the interface document; Using interface codes, a standardized interface is constructed. The standardized interface is used to receive system data and data information of each system data, as well as to send service data.

[0089] In some embodiments, the following steps are further included: Construct a standard report template; Extract key information from the visualization interface. The key information includes at least service data and a source context diagram; Fill the service data and the source context diagram into the standard report template to generate a management report, which represents the source context of each service metric in the service data.

[0090] For method embodiments, since they are basically similar to system embodiments, the description is relatively simple. For related parts, refer to the corresponding descriptions in the system embodiments.

[0091] Each embodiment in this specification is described in a progressive manner. Each embodiment focuses on the differences from other embodiments. For the same or similar parts among the embodiments, reference can be made to each other.

[0092] Embodiment III Refer to Figure 11 , in order to implement the above embodiments, the present application also provides an electronic device, as Figure 11 shown. The electronic device includes: A processor.

[0093] A memory for storing executable instructions of the processor.

[0094] Wherein, the processor is configured to execute instructions to implement any one of the data asset management methods.

[0095] In this embodiment, the computer device includes a processor, a memory, and a network interface connected through a system bus.

[0096] Wherein, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store data samples. The network interface of the computer device is used to communicate with an external terminal through a network connection. The computer program, when executed by the processor, implements any one of the data asset management methods.

[0097] Those skilled in the art can understand, Figure 7The structure shown is only a block diagram of some structures related to the solution of this application, and does not constitute a limitation on the computer device to which the solution of this application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine some components, or have a different component layout.

[0098] Embodiment 4 The embodiment of this application also provides a computer-readable storage medium. When the instructions in the computer-readable storage medium are executed by the processor of the terminal, the terminal can execute any one of the data asset management methods.

[0099] The above-mentioned computer-readable storage medium can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory, electrically erasable programmable read-only memory, erasable programmable read-only memory, programmable read-only memory, read-only memory, magnetic memory, flash memory, magnetic disk or optical disk. The readable storage medium can be any available medium accessible by a general-purpose or special-purpose computer.

[0100] Optionally, the readable storage medium is coupled to the processor so that the processor can read information from the readable storage medium and write information to the readable storage medium. Of course, the readable storage medium can also be a component of the processor. The processor and the readable storage medium can be located in an application specific integrated circuit (ASIC). Of course, the processor and the readable storage medium can also exist as discrete components in the device.

[0101] Embodiment 5 The embodiment of this application also provides a computer program product. The computer program product includes a computer program, and when the computer program is executed by the processor, it implements any one of the data asset management methods.

[0102] Those skilled in the art should understand that the embodiments of the present invention can be provided as a method, a system, or a computer program product. Therefore, the present invention can take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present invention can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk memory, CD-ROM, optical memory, etc.) containing computer-usable program code.

[0103] The present invention is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It should be understood that each flow and / or block in the flowchart illustrations and / or block diagrams, and combinations of flows and / or blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions executed by the processor of the computer or other programmable data processing apparatus create means for implementing the functions specified in the flowchart flow or flows and / or block or blocks. Figure 1 in one flow or more flows and / or blocks Figure 1 or in one block or more blocks.

[0104] These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means that implement the functions specified in the flowchart flow or flows and / or block or blocks. Figure 1 in one flow or more flows and / or blocks Figure 1 or in one block or more blocks.

[0105] These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process, such that the instructions executed on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and / or block or blocks. Figure 1 in one flow or more flows and / or blocks Figure 1 or in one block or more blocks.

[0106] Although the preferred embodiments of the present invention have been described, additional changes and modifications can be made by those skilled in the art once they learn of the basic inventive concept. Therefore, the appended claims are intended to be construed to include the preferred embodiments and all changes and modifications that fall within the scope of the present invention.

[0107] It is apparent that those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalent technologies, the present invention is also intended to include these modifications and variations.

[0108] The above has introduced in detail the data asset management system, method, and device provided by this application. Specific examples have been used in this article to elaborate on the principle and implementation manner of this application. The description of the above embodiments is only used to help understand the method and its core idea of this application; at the same time, for those of ordinary skill in the art, according to the idea of this application, there will be changes in the specific implementation manner and application scope. In summary, the content of this specification should not be construed as a limitation on this application.

Claims

1. A data asset management system, characterized in that, Including: A data governance module, which is used to collect system data and data information of each system data from various target business systems, and preprocess the system data according to a preset data governance strategy and the data information of each system data to obtain preprocessed data, and integrate the preprocessed data to generate a data source. The data information at least includes data structure, data type, data format and data source. The data governance strategy includes at least one of data cleaning, data conversion, data standardization, data desensitization, data archiving, and data auditing. The various target business systems represent systems that generate, store, or manage specific system data. The data source represents the original data source of data signs. A data management module, which is used to analyze the business objectives and business processes of a target business scenario, determine the data signs and data sources related to the business objectives and business processes in the target business scenario, receive and parse the management element information sent by the user, extract the corresponding data signs from the data source, and generate business data. The target business scenario represents a specific business environment that an enterprise needs to improve. The data signs represent the data indicators of the target business scenario. The management element information represents the specific conditions for extracting the data signs. A data display module, which is used to generate a visual interface according to the business data. The visual interface at least displays the business data under each target business scenario.

2. The data asset management system according to claim 1, wherein The data management module includes a data index tracing unit, and the data index tracing unit is used for: Extracting the data index in the data signs; Determining the definition description of the data index, and the definition description at least includes the calculation method and the basic data set of the data index; Identifying associated data indexes according to the calculation method and the basic data set, and the associated data indexes represent other data indexes that the data index depends on; Determining the association logic between the data index and the associated data indexes.

3. The data asset management system according to claim 2, wherein The data display module includes a source context display unit, and the source context display unit is used for: Constructing a source context framework diagram; Filling the association logic and the data source on which the data index depends into the source context framework diagram to generate a source context diagram.

4. The data asset management system according to claim 3, wherein The data display module includes a data display unit, and the data display unit is used for: Constructing a layout method according to a preset display requirement, and the layout method represents the positions of the business data and the source context diagram in the visual interface; Determining visual elements according to the data type of the business data, and the visual elements represent the display methods of the business data; Drawing the business data according to the visual elements to generate a data chart; Integrating the data chart and the source context diagram together according to the layout method to generate the visual interface.

5. The data asset management system according to any one of claims 2-4, characterized in that, It also includes a warning notice generation module, and the warning notice generation module is used for: Determining the warning status of the business data according to a warning standard; In the case that the warning state is a severe warning state, fill the service data metrics, the warning criteria, and the warning state into the first position of the warning prompt letter template; Determine the associated data metrics of the service data, fill the associated data metrics of the service data into the second position of the warning prompt letter template, and generate a warning prompt letter.

6. The data asset management system according to claim 1, wherein It further includes a data asset evaluation module, and the data asset evaluation module is used for: Determine the usage frequency of each data feature in each target business scenario; Determine the contribution degree of each data feature in each target business scenario according to the usage frequency of each data feature in each target business scenario; Clean the data features below the target threshold according to the contribution degree of each data feature in each target business scenario.

7. The data asset management system according to claim 1, wherein It further includes a standardization interface module, and the standardization interface module is used for: Obtain interface requirements, where the interface requirements at least include an interaction system and an interaction function; Construct an interface specification according to the interface requirements, where the interface specification at least includes a data format, a communication protocol, an authentication and authorization mechanism, and an interface function scope; Generate an interface document according to the interface specification, where the interface document at least includes the URL path of each interface, the interface request method, the request parameters, and the response format; Generate interface code according to the interface document; Use the interface code to construct a standardized interface, and the standardized interface is used to receive the system data and the data information of each system data, and send the service data.

8. The data asset management system according to claim 4, wherein It further includes a report management module, and the report management module is used for: Construct a standard report template; Extract the key information in the visualization interface, where the key information at least includes the service data and the source context diagram; Fill the service data and the source context diagram into the standard report template to generate a management report, and the management report represents the source context of each business metric in the service data.

9. A data asset management method, applied to the data asset management system according to any one of claims 1-8, characterized in that, It includes the following steps: Collect the system data and the data information of each system data from each target business system, and preprocess the system data according to the preset data governance strategy and the data information of each system data to obtain preprocessed data, and integrate the preprocessed data to generate a data source. The data information at least includes a data structure, a data type, a data format, and a data source. The data governance strategy includes at least one of data cleaning, data conversion, data standardization, data desensitization, data archiving, and data auditing. Each target business system represents a system that generates, stores, or manages specific system data. The data source represents the original data source of the data features; Analyze the business objectives and business processes of the target business scenario, determine the data signs and data sources related to the business objectives and business processes in the target business scenario, receive and parse the management element information sent by the user, extract the corresponding data signs from the data sources, and generate business data. The target business scenario represents the specific business environment that the enterprise needs to improve. The data signs represent the data indicators of the target business scenario. The management element information represents the specific conditions for extracting the data signs. Generate a visualization interface based on the business data. The visualization interface at least displays the business data under each target business scenario.

10. An electronic device, characterized in that, Comprising: A processor; A memory for storing the executable instructions of the processor; Wherein, the processor is configured to execute the instructions to implement the data asset management method as described in claim 9.

Images