Data asset governance method and system based on big data platform

Abstract

The application provides a data asset management method and system based on a big data platform, wherein the method comprises the following steps: S1, collecting data asset information of multiple management targets through the big data platform; and S2, performing multi-modal management on the data asset information of each management target. The data asset management method and system based on the big data platform automatically collect the data asset information of multiple management targets through the big data platform, and automatically perform multi-modal management on the data asset information of each management target, thereby greatly improving the storage, management and analysis capabilities of the system for diversified, massive data sources and constantly changing data requirements.

Description

Technical Field

[0001] This invention relates to the field of big data technology, and in particular to a data asset governance method and system based on a big data platform. Background Technology

[0002] Currently, data assets refer to the various data resources accumulated by enterprises in their daily operations, including customer data, transaction records, market research data, etc. These data represent the core information assets of an enterprise, possessing enormous potential value and capable of supporting enterprise decision-making, driving business innovation and optimization.

[0003] However, as the volume of data assets continues to grow, the storage, management, and analysis of these assets become increasingly complex. Traditional data management methods are no longer effective in addressing the diverse and massive data sources and ever-changing data needs. Summary of the Invention

[0004] One of the objectives of this invention is to provide a data asset governance method based on a big data platform. By automatically collecting data asset information from multiple management objectives through the big data platform, and automatically performing multimodal governance on the data asset information of each management objective, the system's ability to store, manage, and analyze data asset information from diverse and massive data sources and constantly changing data needs is greatly improved.

[0005] The data asset governance method based on a big data platform provided in this embodiment of the invention includes:

[0006] Collect data asset information for multiple management objectives through a big data platform;

[0007] Multimodal governance of data asset information for various management objectives.

[0008] Optional data asset governance methods based on big data platforms also include:

[0009] Analyze the data asset information for each management objective, and generate a data asset quality evaluation report and a data asset inventory report;

[0010] Output data asset quality assessment reports and data asset inventory reports.

[0011] Optionally, the multimodal governance of data asset information for each management objective includes:

[0012] Perform data quality management on data asset information for each management objective;

[0013] And / or,

[0014] Metadata management is performed on the data asset information for each management objective;

[0015] And / or,

[0016] Implement data security and privacy management for data assets related to various management objectives;

[0017] And / or,

[0018] Standardize the management of data asset information for each management objective;

[0019] And / or,

[0020] Perform data lifecycle management on the data asset information of each management objective.

[0021] Optionally, the data quality management steps include at least: data cleaning, verification, and standardization.

[0022] Optionally, the metadata management steps include at least: data definition and description, data source management, and usage scenario management.

[0023] Optionally, the data security and privacy management steps include at least: data encryption, access control, sensitive data protection, and data compliance management.

[0024] Optionally, the standardization management steps include at least the following: defining the basis for unified data naming, data definition, data type, and assignment rules.

[0025] Optionally, the data lifecycle management steps include at least: full-process data retention, archiving, and disposal of data from creation to archiving or disposal.

[0026] Optional data asset governance methods based on big data platforms also include:

[0027] Based on the data asset information after multimodal governance, a visualization model is constructed;

[0028] Data asset monitoring and early warning are based on visualization models;

[0029] The data asset monitoring and early warning based on the visualization model includes:

[0030] Virtual participation in an early warning meeting using a visual model for multiple managers; during the early warning meeting, the visual model displays the early warning event to each virtual manager; within a preset time after the trigger time, it detects whether the distribution of virtual participants' locations in the early warning meeting changes;

[0031] When changes occur, the visualization model is optimized to display the future timeline of the early warning event based on the information on changes in the distribution of attendees' locations;

[0032] The steps for obtaining the trigger time are as follows:

[0033] When a virtual attendee generates the first Nj standard attendee actions in the same standard attendee action set consecutively, the moment when the attendee generates any of the next j standard attendee actions in the same standard attendee action set is taken as the trigger moment; N is the total number of standard attendee actions in the standard attendee action set.

[0034] And / or,

[0035] The trigger point is the moment when at least two virtual participating managers maintain a standard mutual relationship for a duration threshold.

[0036] Among these improvements, based on information about changes in the distribution of attendees' locations, the visualization model is optimized to display the future timeline of early warning events, including:

[0037] When the change in the distribution of meeting locations indicates that the meeting locations of at least two virtual participating managers are now adjacent, multiple joint objectives are determined based on the personnel profiles of the corresponding at least two virtual participating managers.

[0038] Calculate the joint time for each joint objective; where the joint time is the corresponding value in the time library of the content type related to the joint objective that the visualization model displays during the period from the previous trigger time to the time before the trigger time.

[0039] The content within the target time frame on the future display timeline is optimized to match the joint objective; where the target time is the average of the joint times exceeding the time threshold, and the joint objective is the joint objective when the joint time exceeds the time threshold.

[0040] This invention provides a data asset governance system based on a big data platform, comprising:

[0041] The big data platform module is used to collect data asset information for multiple management objectives through the big data platform;

[0042] The data asset governance module is used to perform multimodal governance of data asset information for various management objectives.

[0043] Optionally, a data asset governance system based on a big data platform may also include:

[0044] The report analysis module is used for:

[0045] Analyze the data asset information for each management objective, and generate a data asset quality evaluation report and a data asset inventory report;

[0046] Output data asset quality assessment reports and data asset inventory reports.

[0047] Optionally, the data asset governance module performs multimodal governance on the data asset information of various management objectives, including:

[0048] Perform data quality management on data asset information for each management objective;

[0049] And / or,

[0050] Metadata management is performed on the data asset information for each management objective;

[0051] And / or,

[0052] Implement data security and privacy management for data assets related to various management objectives;

[0053] And / or,

[0054] Standardize the management of data asset information for each management objective;

[0055] And / or,

[0056] Perform data lifecycle management on the data asset information of each management objective.

[0057] Optionally, the data quality management steps include at least: data cleaning, verification, and standardization.

[0058] Optionally, the metadata management steps include at least: data definition and description, data source management, and usage scenario management.

[0059] Optionally, the data security and privacy management steps include at least: data encryption, access control, sensitive data protection, and data compliance management.

[0060] Optionally, the standardization management steps include at least the following: defining the basis for unified data naming, data definition, data type, and assignment rules.

[0061] Optionally, the data lifecycle management steps include at least: full-process data retention, archiving, and disposal of data from creation to archiving or disposal.

[0062] Optionally, a data asset governance system based on a big data platform may also include:

[0063] The visual monitoring and early warning module is used for:

[0064] Based on the data asset information after multimodal governance, a visualization model is constructed;

[0065] Data asset monitoring and early warning are based on visualization models;

[0066] The data asset monitoring and early warning based on the visualization model includes:

[0067] Virtual participation in an early warning meeting using a visual model for multiple managers; during the early warning meeting, the visual model displays the early warning event to each virtual manager; within a preset time after the trigger time, it detects whether the distribution of virtual participants' locations in the early warning meeting changes;

[0068] When changes occur, the visualization model is optimized to display the future timeline of the early warning event based on the information on changes in the distribution of attendees' locations;

[0069] The steps for obtaining the trigger time are as follows:

[0070] When a virtual attendee generates the first Nj standard attendee actions in the same standard attendee action set consecutively, the moment when the attendee generates any of the next j standard attendee actions in the same standard attendee action set is taken as the trigger moment; N is the total number of standard attendee actions in the standard attendee action set.

[0071] And / or,

[0072] The trigger point is the moment when at least two virtual participating managers maintain a standard mutual relationship for a duration threshold.

[0073] Among these improvements, based on information about changes in the distribution of attendees' locations, the visualization model is optimized to display the future timeline of early warning events, including:

[0074] When the change in the distribution of meeting locations indicates that the meeting locations of at least two virtual participating managers are now adjacent, multiple joint objectives are determined based on the personnel profiles of the corresponding at least two virtual participating managers.

[0075] Calculate the joint time for each joint objective; where the joint time is the corresponding value in the time library of the content type related to the joint objective that the visualization model displays during the period from the previous trigger time to the time before the trigger time.

[0076] The content within the target time frame on the future display timeline is optimized to match the joint objective; where the target time is the average of the joint times exceeding the time threshold, and the joint objective is the joint objective when the joint time exceeds the time threshold.

[0077] Other features and advantages of the invention will be set forth in the description which follows, and will be apparent in part from the description, or may be learned by practicing the invention. The objects and other advantages of the invention may be realized and obtained by means of the structures particularly pointed out in the written description and the accompanying drawings.

[0078] The technical solution of the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. Attached Figure Description

[0079] The accompanying drawings are provided to further illustrate the invention and form part of the specification. They are used in conjunction with embodiments of the invention to explain the invention and do not constitute a limitation thereof. In the drawings:

[0080] Figure 1 This is a schematic diagram of a data asset governance method based on a big data platform in an embodiment of the present invention;

[0081] Figure 2 This is another schematic diagram of the data asset governance method based on a big data platform in an embodiment of the present invention;

[0082] Figure 3 This is another schematic diagram of the data asset governance method based on a big data platform in an embodiment of the present invention;

[0083] Figure 4 This is a schematic diagram of a data asset governance system based on a big data platform in an embodiment of the present invention. Detailed Implementation

[0084] The preferred embodiments of the present invention will be described below with reference to the accompanying drawings. It should be understood that the preferred embodiments described herein are for illustration and explanation only and are not intended to limit the present invention.

[0085] This invention provides a data asset governance method based on a big data platform, such as... Figure 1 As shown, it includes:

[0086] S1. Collect data asset information for multiple management objectives through a big data platform;

[0087] S2. Conduct multimodal governance of data asset information for various management objectives;

[0088] The multimodal governance of data asset information for each management objective includes:

[0089] Perform data quality management on data asset information for each management objective;

[0090] And / or,

[0091] Metadata management is performed on the data asset information for each management objective;

[0092] And / or,

[0093] Implement data security and privacy management for data assets related to various management objectives;

[0094] And / or,

[0095] Standardize the management of data asset information for each management objective;

[0096] And / or,

[0097] Perform data lifecycle management on the data asset information of each management objective.

[0098] The management objectives can be various parts within the same enterprise. Leveraging the massive data collection and storage capabilities of the big data platform, data asset information for each management objective is collected, including at least: customer data, transaction records, and market research data. After collection, multimodal governance is implemented on the data asset information of each management objective, including but not limited to data quality management, metadata management, data security and privacy management, standardization management, and data lifecycle management.

[0099] This application automatically collects data asset information for multiple management objectives through a big data platform and automatically performs multimodal governance on the data asset information of each management objective, thereby improving the system's ability to store, manage, and analyze data asset information from diverse and massive data sources and constantly changing data needs.

[0100] In one embodiment, a data asset governance method based on a big data platform, such as Figure 2 As shown, it also includes:

[0101] S3. Analyze the data asset information for each management objective and generate a data asset quality evaluation report and a data asset inventory report;

[0102] S4. Output a data asset quality evaluation report and a data asset inventory report.

[0103] When generating a data asset quality assessment report, the data asset quality is evaluated based on the data asset information for each management objective, according to the data asset quality assessment system, before the report is generated. Technical personnel pre-set the data asset quality assessment system; the types of data asset quality assessment include at least: accuracy, completeness, validity, timeliness, and consistency. Secondly, when generating a data asset inventory report, a comprehensive inventory is conducted on the source, storage location, usage, and compliance with business needs of the data asset information for each management objective before the report is generated.

[0104] This invention performs quality analysis and inventory of data assets, generating corresponding reports, enabling enterprises to manage and utilize their data assets more effectively.

[0105] In one embodiment, the data quality management steps include at least: data cleaning, verification, and standardization.

[0106] The steps of metadata management include at least: data definition and description, data source management, and usage scenario management.

[0107] The steps for data security and privacy management include at least: data encryption, access control, sensitive data protection, and data compliance management.

[0108] The standardized management steps include at least the following: defining the basis for unified data naming, data definition, data type, and assignment rules.

[0109] The steps of the data lifecycle management include at least: full-process data retention, archiving, and disposal of data from creation to archiving or disposal.

[0110] The data quality management steps described above can determine the accuracy and consistency of data; the metadata management steps provide the definition, source, usage scenarios and management strategies of data; the data security and privacy management steps can ensure the security and privacy of data; the standardization management steps can unify the definition benchmarks of data; and the data lifecycle management can manage the entire lifecycle of data.

[0111] In one embodiment, a data asset governance method based on a big data platform, such as Figure 3 As shown, it also includes:

[0112] S5. Based on the data asset information after multimodal governance, construct a visualization model;

[0113] In S5, when building a visualization model, it can be based on a data visualization template pre-set by technical personnel; the visualization model can show the different data asset situations reflected by the data asset information after multimodal governance, etc.

[0114] S6. Based on a visualization model, perform data asset monitoring and early warning;

[0115] S6, which involves monitoring and issuing early warnings for data assets based on a visualization model, includes:

[0116] S61. Virtual participation in an early warning meeting using a visualization model for multiple managers; during the early warning meeting, the visualization model displays the early warning event to each virtually participating manager; S62. Within a preset time after the trigger time, detect whether the distribution of virtual participants' locations in the early warning meeting changes;

[0117] S63. When changes occur, optimize the visualization model to display the future timeline of the early warning event based on the information on changes in the distribution of attendees' locations;

[0118] A virtual warning meeting is used to conduct early warning meetings for the visualization model. A virtual round table is set up, with seats around it for virtual managers to attend. Managers choose a seat, and that seat becomes their designated meeting position. A large virtual screen is also set up next to the virtual round table for the visualization model to display information. The trigger time is when a virtual manager might change their meeting position to express their personalized participation idea. The preset time can be set to 2 minutes. Each time the meeting time is reached, the distribution of virtual meeting positions for managers is checked for changes within the preset time. When a change occurs, the information reflecting the manager's personalized participation idea is used to optimize the visualization model's future display timeline for warning events, allowing the model to adapt to these personalized participation ideas and continue displaying warning events. Warning events are data asset anomaly events detected by the visualization model. When displaying warning events, the visualization model plans the order and timing of different information displays to form the future display timeline.

[0119] The steps for obtaining the trigger time are as follows:

[0120] When a virtual attendee generates the first Nj standard attendee actions in the same standard attendee action set consecutively, the moment when the attendee generates any of the next j standard attendee actions in the same standard attendee action set is taken as the trigger moment; N is the total number of standard attendee actions in the standard attendee action set.

[0121] And / or,

[0122] The trigger point is the moment when at least two virtual participating managers maintain a standard mutual relationship for a duration threshold.

[0123] In the first method of obtaining the trigger time, a standard set of meeting actions is set, which includes multiple standard meeting actions that would be generated consecutively if an administrator wanted to express their personalized meeting ideas, such as talking with other administrators or switching to viewing the first virtual screen for more than 5 minutes. This indicates that the recently displayed content on the first virtual screen has attracted their attention, and they have generated a personalized meeting idea that the content of the first virtual screen can be optimized based on their attention. However, in order to detect proactively, when an administrator generates the first Nj standard meeting actions in the same set of standard meeting actions consecutively, if they generate any of the next j standard meeting actions in the same set of standard meeting actions, this moment is taken as the trigger time; i can be a positive integer not exceeding 3.

[0124] In the second method of obtaining the trigger moment, a standard mutual relationship is set, which includes a mutual relationship between an administrator and other administrators that will continuously exceed a duration threshold when the administrator wants to express their personalized participation ideas. For example, if two administrators are talking, it means that they want the content of the first virtual screen to be optimized based on their conversation. Therefore, when at least two virtual participating administrators continuously maintain the standard mutual relationship to the duration threshold, this moment is taken as the trigger moment; the duration threshold can be set to 5 minutes.

[0125] Among these improvements, based on information about changes in the distribution of attendees' locations, the visualization model is optimized to display the future timeline of early warning events, including:

[0126] When the change in the distribution of meeting locations indicates that the meeting locations of at least two virtual participating managers are now adjacent, multiple joint objectives are determined based on the personnel profiles of the corresponding at least two virtual participating managers.

[0127] Calculate the joint time for each joint objective; where the joint time is the corresponding value in the time library of the content type related to the joint objective that the visualization model displays during the period from the previous trigger time to the time before the trigger time.

[0128] The content within the target time frame of the future display timeline is optimized to align with the joint objective; where the target time is the average of the joint times exceeding the time threshold, and the joint objective is the joint objective achieved when the joint time exceeds the time threshold.

[0129] And / or,

[0130] When the change in the distribution of meeting locations indicates that the meeting location of multiple virtual meeting managers is now closer to the first virtual screen for displaying early warning events in the visualization model, the corresponding virtual meeting managers are traversed in reverse order according to the order in which their information is now closer to the first virtual screen.

[0131] Each time a virtual meeting administrator is traversed, the overlapping virtual field of view of the traversed virtual meeting administrator and the nearest virtual meeting administrator to be traversed is obtained in the visible area of ​​the first virtual screen.

[0132] When the content type of the content in the visible area matches the standard content type and / or the content in the visible area is related to all the virtual attendees, stop traversing the next corresponding virtual attendee. Based on the distribution of the attendee positions of the traversed virtual attendees and the virtual attendees to be traversed, determine the setting position next to the virtual round table and set up a second virtual screen at the setting position. At the same time, based on the content in the visible area, generate extended content and control the second virtual screen to display the extended content.

[0133] Among them, based on the distribution of the virtual attendees and the virtual attendees to be traversed, the locations next to the virtual round table are determined, including:

[0134] Generate the minimum circular range that encloses the distribution of participant positions;

[0135] Determine the target diameter within the circular area that is parallel to the display plane of the first virtual screen;

[0136] Rotate the target diameter counterclockwise or clockwise, and determine the first target semicircle and the second target semicircle from the two semicircles divided by the target diameter during the rotation process; wherein, the first number of virtual participating managers in the first target semicircle is greater than the second number of virtual participating managers in the second target semicircle.

[0137] When the first target semicircle and the second target semicircle conditions are met, or when the second condition is met without meeting the first condition, the target diameter is stopped from being rotated further, and the free display plane position that is parallel to the rotated target diameter and adjacent to the display plane of the first virtual screen is taken as the setting position.

[0138] Among them, condition one includes: the first target semicircle and the second target semicircle have not alternated in history, and the first number increases by 1, while the second number decreases by 1 or remains unchanged;

[0139] Condition 2 includes: the first target semicircle and the second target semicircle alternate for the first time.

[0140] In the first method of optimizing the future display timeline based on changes in participant location distribution, when the meeting locations of at least two virtual participants become adjacent, it indicates that these two virtual participants want to have a private conversation. In this case, an independent communication channel can be established for them, preventing other participants from hearing their conversation, while they can continue viewing the first virtual screen. However, identifying their joint purpose is crucial for optimizing the future display timeline. The joint purpose refers to their decision-making objectives during their private conversation. Identifying the joint purpose is based on the personnel profiles of their managers. For example, if the personnel profiles of two managers indicate that they share the same management responsibility of eliminating invalid data assets, then their joint purpose is to discuss how to find invalid data assets and how to eliminate them accordingly. However, the personnel profiles can reflect many possible joint purposes, and their private conversation may involve multiple factors. In reality, it's not necessarily about achieving every joint objective. Therefore, it's necessary to filter out the joint objectives that actually need to be achieved. During the filtering process, the joint time for each joint objective is calculated. The larger the joint time, the greater the likelihood that the private conversation actually achieves the corresponding joint objective. The content displayed on the future timeline within the target time frame is then optimized to match the target joint objective. For example, prioritizing the display of relevant invalid asset situations, etc., that is, setting the target joint objective as the joint objective whose joint time exceeds the time threshold. Specifically, a time library is set up, containing the joint time corresponding to different content types displayed for different warning events. The content type displayed for warning events must be the content based on their private conversation. Therefore, the standard decision-making discussion time required for the content type displayed for warning events can be used as the basis for determining the time for future optimization. The target time is then set as the average of the joint times exceeding the time threshold.

[0141] In the second method of optimizing the future display timeline based on changes in the distribution of meeting participants, when a participant's location is "newly closer to the first virtual screen," it means that some managers are jointly paying attention to some content displayed on the first virtual screen. The later a manager moves to be closer to the first virtual screen, the more subjectively they want to share content with those who moved to be closer to the first virtual screen earlier. Therefore, the virtual participants are traversed in reverse order of their newest proximity to the first virtual screen. When managers move to be closer to the first virtual screen and subsequently view it, they will interact closely with the closest manager. Therefore, the overlapping virtual field of vision of the traversed virtual participants and the nearest virtual participant to be traversed is obtained as the visible area on the first virtual screen. Virtual participants will have a virtual field of vision in the early warning meeting, and the overlapping part of the virtual fields of vision of the two managers is the overlapping virtual field of vision, which will correspond to a visible display area within their field of vision on the first virtual screen.

[0142] The standard content type represents the type of content within the visible area that the new administrators closer to the first virtual screen are jointly interested in. For example, if a visualization model requires multiple people to perform data asset maintenance, this can be immediately identified. Additionally, when the content within the visible area is relevant to all the virtual attendees being traversed, it can be determined that the new administrators closer to the first virtual screen are jointly interested in the visible area. Once identified, traversing to the next corresponding virtual attendee can be stopped, improving traversal efficiency, reducing traversal resources, and enhancing the responsiveness of adapting settings for the second virtual screen. The second virtual screen is set up based on the attendee location distribution. Extended content can be related to the content within the visible area. The second virtual screen displays this extended content, allowing these administrators to collaboratively view it. This entire process completes the adaptation of display resources.

[0143] Next to the virtual round table, multiple adjacent display plane positions are set up for the virtual large screen. When the conditions of the first target semicircle and the second target semicircle are met, it means that the viewing angle represented by the diameter of the target after rotation is not only distinguishable from the first virtual large screen, but also suitable for most managers. When the conditions of the second condition are met without meeting the first condition, the viewing angle represented by the diameter of the target after rotation is sufficiently distinguishable, so as to avoid affecting the viewing angle of more managers.

[0144] The alternation between the first and second target semicircles refers to one semicircle changing from the first target semicircle to the second target semicircle, and the other semicircle changing from the second target semicircle to the first target semicircle.

[0145] The embodiments of the present invention solve the following problems in the prior art:

[0146] Traditional meetings often have limitations in collaboration and interaction, especially in virtual meetings, where managers may not have enough opportunities for real-time feedback and interaction, affecting the collaborative efficiency of decision-making.

[0147] Furthermore, different managers may have different focuses and decision-making needs in the same meeting, and traditional methods are unlikely to respond flexibly to individual needs, resulting in low management efficiency.

[0148] The embodiments of the present invention achieve the corresponding technical effects:

[0149] By integrating various data assets into a visualization model through multimodal data governance, the status of data assets can be displayed in real time. The model can also be dynamically optimized based on the behavior and needs of managers. When data anomaly warnings are issued, the model can adaptively adjust the warning display content based on information such as changes in the location and behavior of participants, thereby improving the timeliness and accuracy of decision-making.

[0150] By triggering a time-based mechanism, the system can detect managers' personalized participation ideas in a timely manner, enhancing the interactivity and flexibility of the meeting, and enabling the visualization model to accurately optimize the displayed content based on the actual needs of managers in the future.

[0151] By introducing virtual roundtables and virtual large screens, and by creating dedicated private conversation channels for managers and adjusting the displayed content, the collaborative effectiveness of meetings has been improved. Especially when managers engage in private discussions, the system can automatically adjust the timeline of the displayed content by identifying and optimizing shared objectives, ensuring that future presentations better align with the managers' decision-making goals, thereby enhancing meeting efficiency and decision-making quality.

[0152] By analyzing the changes in the location of virtual attendees as they approach the first virtual screen, the second virtual screen was precisely configured. The configuration of display resources on the virtual screens was intelligently optimized, improving the adaptability, efficiency, and collaborative effect of the virtual screen displays. Ultimately, this improved the utilization rate of virtual meeting display resources, enhanced information transmission, and optimized the collaborative efficiency of management personnel.

[0153] This invention provides a data asset governance system based on a big data platform, such as... Figure 4 The following are included:

[0154] Big Data Platform Module 1 is used to collect data asset information for multiple management objectives through the big data platform;

[0155] Data Asset Governance Module 2 is used for multimodal governance of data asset information for various management objectives.

[0156] Optionally, a data asset governance system based on a big data platform may also include:

[0157] The report analysis module is used for:

[0158] Analyze the data asset information for each management objective, and generate a data asset quality evaluation report and a data asset inventory report;

[0159] Output data asset quality assessment reports and data asset inventory reports.

[0160] Optionally, the data asset governance module 2 performs multimodal governance on the data asset information of various management objectives, including:

[0161] Perform data quality management on data asset information for each management objective;

[0162] And / or,

[0163] Metadata management is performed on the data asset information for each management objective;

[0164] And / or,

[0165] Implement data security and privacy management for data assets related to various management objectives;

[0166] And / or,

[0167] Standardize the management of data asset information for each management objective;

[0168] And / or,

[0169] Perform data lifecycle management on the data asset information of each management objective.

[0170] Optionally, the data quality management steps include at least: data cleaning, verification, and standardization.

[0171] Optionally, the metadata management steps include at least: data definition and description, data source management, and usage scenario management.

[0172] Optionally, the data security and privacy management steps include at least: data encryption, access control, sensitive data protection, and data compliance management.

[0173] Optionally, the standardization management steps include at least the following: defining the basis for unified data naming, data definition, data type, and assignment rules.

[0174] Optionally, the data lifecycle management steps include at least: full-process data retention, archiving, and disposal of data from creation to archiving or disposal.

[0175] Optionally, a data asset governance system based on a big data platform may also include:

[0176] The visual monitoring and early warning module is used for:

[0177] Based on the data asset information after multimodal governance, a visualization model is constructed;

[0178] Data asset monitoring and early warning are based on visualization models;

[0179] The data asset monitoring and early warning based on the visualization model includes:

[0180] Virtual participation in an early warning meeting using a visual model for multiple managers; during the early warning meeting, the visual model displays the early warning event to each virtual manager; within a preset time after the trigger time, it detects whether the distribution of virtual participants' locations in the early warning meeting changes;

[0181] When changes occur, the visualization model is optimized to display the future timeline of the early warning event based on the information on changes in the distribution of attendees' locations;

[0182] The steps for obtaining the trigger time are as follows:

[0183] When a virtual attendee generates the first Nj standard attendee actions in the same standard attendee action set consecutively, the moment when the attendee generates any of the next j standard attendee actions in the same standard attendee action set is taken as the trigger moment; N is the total number of standard attendee actions in the standard attendee action set.

[0184] And / or,

[0185] The trigger point is the moment when at least two virtual participating managers maintain a standard mutual relationship for a duration threshold.

[0186] Among these improvements, based on information about changes in the distribution of attendees' locations, the visualization model is optimized to display the future timeline of early warning events, including:

[0187] When the change in the distribution of meeting locations indicates that the meeting locations of at least two virtual participating managers are now adjacent, multiple joint objectives are determined based on the personnel profiles of the corresponding at least two virtual participating managers.

[0188] Calculate the joint time for each joint objective; where the joint time is the corresponding value in the time library of the content type related to the joint objective that the visualization model displays during the period from the previous trigger time to the time before the trigger time.

[0189] The content within the target time frame on the future display timeline is optimized to match the joint objective; where the target time is the average of the joint times exceeding the time threshold, and the joint objective is the joint objective when the joint time exceeds the time threshold.

[0190] Obviously, those skilled in the art can make various modifications and variations to this invention without departing from its spirit and scope. Therefore, if these modifications and variations fall within the scope of the claims of this invention and their equivalents, this invention also intends to include these modifications and variations.

Claims

1. A method for data asset governance based on a big data platform, characterized in that, The method comprises the following steps: collecting data asset information of multiple management targets through a big data platform; performing multi-modal governance on the data asset information of each management target; constructing a visualization model based on the data asset information after multi-modal governance; performing data asset monitoring and early warning based on the visualization model; the step of performing data asset monitoring and early warning based on the visualization model comprises the following steps: virtually participating in an early warning meeting of the visualization model by multiple managers; in the early warning meeting, the visualization model displays early warning events to the managers virtually participating in the meeting; detecting whether the meeting position distribution of the managers virtually participating in the early warning meeting changes within a preset time after a triggering moment; when the change occurs, optimizing a future display time axis of the visualization model for displaying the early warning events based on the change information of the meeting position distribution.

2. The big data platform based data asset governance method of claim 1, wherein, The method further comprises the following steps: analyzing the data asset information of each management target to generate a data asset quality evaluation report and a data asset inventory report; outputting the data asset quality evaluation report and the data asset inventory report.

3. The big data platform based data asset governance method of claim 1, wherein, The step of performing multi-modal governance on the data asset information of each management target comprises the following steps: performing data quality management on the data asset information of each management target; and / or, performing metadata management on the data asset information of each management target; and / or, performing data security and privacy management on the data asset information of each management target; and / or, performing standardized management on the data asset information of each management target; and / or, performing data lifecycle management on the data asset information of each management target.

4. The big data platform based data asset governance method of claim 3, wherein, The data quality management step at least comprises data cleaning, checking and standardization.

5. The big data platform based data asset governance method of claim 3, wherein, The metadata management step at least comprises data definition and description, data source management and use scenario management.

6. The big data platform based data asset governance method of claim 3, wherein, The data security and privacy management step at least comprises data encryption, access control, sensitive data protection and data compliance management.

7. The big data platform based data asset governance method of claim 3, wherein, The standardized management step at least comprises the definition of unified data naming, data definition, data type and assignment rule.

8. The big data platform based data asset governance method of claim 3, wherein, The data lifecycle management step at least comprises full-process data retention, archiving and disposal of data lifecycle from creation to archiving or disposal. 9.A data asset governance system based on a big data platform, characterized in that, The method comprises the following steps: a big data platform module for collecting data asset information of multiple management targets through a big data platform; a data asset governance module for performing multi-modal governance on the data asset information of each management target; The method further comprises a visualization early warning management module for: constructing a visualization model based on the data asset information after multi-modal governance; performing data asset monitoring and early warning based on the visualization model; the step of performing data asset monitoring and early warning based on the visualization model comprises the following steps: virtually participating in an early warning meeting of the visualization model by multiple managers; in the early warning meeting, the visualization model displays early warning events to the managers virtually participating in the meeting; detecting whether the meeting position distribution of the managers virtually participating in the early warning meeting changes within a preset time after a triggering moment; when the change occurs, optimizing a future display time axis of the visualization model for displaying the early warning events based on the change information of the meeting position distribution.

Images