A data middle platform operation and maintenance method, device, equipment and medium

Abstract

The application discloses a data middle platform operation and maintenance method, device, equipment and medium. The method comprises the following steps: collecting operation and maintenance data corresponding to a data middle platform; wherein the operation and maintenance data comprises running data corresponding to a plurality of monitoring items, at least comprising monitoring data, log data and security device data; acquiring user behavior data corresponding to the data middle platform, and performing cross-validation on the user behavior data to generate corresponding user operation portrait; determining a life cycle corresponding to the data middle platform and each business running node contained in the life cycle based on the user operation portrait; determining an operation and maintenance dimension corresponding to the data middle platform, analyzing the operation and maintenance data under each business running node for different operation and maintenance dimensions to obtain corresponding analysis results, and performing operation and maintenance on the data middle platform according to the analysis results.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of data middle platform operation and maintenance, and particularly relates to a data middle platform operation and maintenance method, device, equipment and medium. BACKGROUND

[0002] In the process of big data processing, data middle platform operation and maintenance is an important link, which can guarantee the management efficiency of data resources and data security. However, due to the differences in data processed by different users, it is impossible to associate with existing businesses. In the process of digital construction, the common data middle platform operation and maintenance method does not involve the construction of the data life cycle, and cannot realize the whole-process data operation and maintenance. SUMMARY

[0003] In order to solve the above problems, the present application provides a data middle platform operation and maintenance method, which comprises the following steps:

[0004] acquiring user behavior data corresponding to the data middle platform, and cross- verifying the user behavior data to generate a corresponding user operation portrait;

[0005] determining a life cycle corresponding to the data middle platform and each business running node contained in the life cycle based on the user operation portrait;

[0006] determining an operation and maintenance dimension corresponding to the data middle platform, analyzing the operation and maintenance data under each business running node for different operation and maintenance dimensions to obtain a corresponding analysis result, and performing operation and maintenance on the data middle platform according to the analysis result.

[0007] In an implementation manner of the present application, before acquiring the operation and maintenance data corresponding to the data middle platform, the method further comprises:

[0008] determining a data flow transfer logic corresponding to the data middle platform and a plurality of data flow transfer nodes contained in the data flow transfer logic, and performing a burying point processing on the data flow transfer nodes to collect corresponding log data in response to a data operation corresponding to the data flow transfer node at the burying point;

[0009] performing a burying point processing on a business system corresponding to the data middle platform to collect corresponding monitoring data and security device data at the burying point.

[0010] In an implementation manner of the present application, the analysis of the operation and maintenance data under each business running node for different operation and maintenance dimensions to obtain a corresponding analysis result specifically comprises:

[0011] Based on the log operation and maintenance dimension, the log data corresponding to each of the aforementioned business operation nodes is analyzed to obtain the corresponding log data analysis report;

[0012] Based on the monitoring and operation dimension, the monitoring data corresponding to each of the business operation nodes is analyzed to determine whether there are security events in the data platform, the server corresponding to the data platform, and the application process.

[0013] Based on the equipment operation and maintenance dimension, the security equipment data corresponding to each of the aforementioned business operation nodes are analyzed to determine whether there are security events in the security equipment.

[0014] In one implementation of this application, the data platform is operated and maintained based on the analysis results, specifically including:

[0015] Based on the log data analysis report, the abnormal units in the data platform are located and alarms are issued for the abnormal units.

[0016] The security event is traced to determine the specified monitoring item that caused it; wherein the specified monitoring item includes the server, application process, and security device.

[0017] In one implementation of this application, the method further includes:

[0018] Determine the operational and maintenance requirements of the data platform, generate new monitoring items that match the operational and maintenance requirements using a preset script, and add the new monitoring items to the corresponding monitoring items of the data platform.

[0019] In one implementation of this application, before analyzing the operation and maintenance data under each of the aforementioned business operation nodes, the method further includes:

[0020] For different business operation nodes, the historical operation and maintenance data of the business operation nodes are analyzed in order to determine the threshold parameter range of the monitoring items corresponding to the business operation nodes based on the historical operation and maintenance data.

[0021] Based on the range of threshold parameters for the monitoring items, recommended threshold parameters for specific monitoring items are provided for analyzing the operation and maintenance data; wherein, the threshold parameters for specific monitoring items conform to the range of threshold parameters for the monitoring items.

[0022] In one implementation of this application, after obtaining the corresponding analysis results, the method further includes:

[0023] Generate a monitoring interface corresponding to the data platform and display the analysis results on the monitoring interface.

[0024] This application provides a data platform operation and maintenance device, characterized in that the device includes:

[0025] The data acquisition unit is used to collect the operation and maintenance data corresponding to the data platform; wherein, the operation and maintenance data includes the operation data corresponding to multiple monitoring items, including at least monitoring data, log data and security device data;

[0026] The user operation profile generation unit is used to obtain user behavior data corresponding to the data platform, perform cross-validation on the user behavior data, and generate a corresponding user operation profile.

[0027] The lifecycle determination unit is used to determine the lifecycle of the data platform and the business operation nodes included in the lifecycle based on the user operation profile.

[0028] The analysis unit is used to determine the operation and maintenance dimensions corresponding to the data platform, analyze the operation and maintenance data under each business operation node for different operation and maintenance dimensions, obtain the corresponding analysis results, and perform operation and maintenance on the data platform based on the analysis results.

[0029] This application embodiment provides a data middleware operation and maintenance device, characterized in that the device includes:

[0030] At least one processor; and,

[0031] A memory communicatively connected to the at least one processor; wherein,

[0032] The memory stores instructions executable by the at least one processor, which, when executed by the at least one processor, enable the at least one processor to:

[0033] The data collection platform includes operation and maintenance data corresponding to the data collection platform; wherein, the operation and maintenance data includes operational data corresponding to multiple monitoring items, including at least monitoring data, log data and security device data;

[0034] Obtain user behavior data corresponding to the data platform, and perform cross-validation on the user behavior data to generate a corresponding user operation profile;

[0035] Based on the user operation profile, the lifecycle corresponding to the data platform and the business operation nodes included in the lifecycle are determined.

[0036] The operation and maintenance dimensions corresponding to the data platform are determined. For different operation and maintenance dimensions, the operation and maintenance data under each business operation node are analyzed to obtain the corresponding analysis results. Based on the analysis results, the data platform is operated and maintained.

[0037] This application provides a non-volatile computer storage medium storing computer-executable instructions, characterized in that the computer-executable instructions are configured as follows:

[0038] The data collection platform includes operation and maintenance data corresponding to the data collection platform; wherein, the operation and maintenance data includes operational data corresponding to multiple monitoring items, including at least monitoring data, log data and security device data;

[0039] Obtain user behavior data corresponding to the data platform, and perform cross-validation on the user behavior data to generate a corresponding user operation profile;

[0040] Based on the user operation profile, the lifecycle corresponding to the data platform and the business operation nodes included in the lifecycle are determined.

[0041] The operation and maintenance dimensions corresponding to the data platform are determined. For different operation and maintenance dimensions, the operation and maintenance data under each business operation node are analyzed to obtain the corresponding analysis results. Based on the analysis results, the data platform is operated and maintained.

[0042] The data platform operation and maintenance method proposed in this application can bring the following beneficial effects:

[0043] Based on user operation profiles, the operation and maintenance data under each business operation node in the lifecycle are analyzed, and then the data middle platform operation and maintenance is realized based on the analysis results. The user profile can reflect the lifecycle of the data flowing when different users perform business operations. It can monitor the monitoring data of the entire data lifecycle, such as data generation, aggregation, processing, use, and destruction, to support the operation and maintenance, security, and business operation status of the data middle platform. Attached Figure Description

[0044] The accompanying drawings, which are included to provide a further understanding of this application and form part of this application, illustrate exemplary embodiments and are used to explain this application, but do not constitute an undue limitation of this application. In the drawings:

[0045] Figure 1 A flowchart illustrating a data platform operation and maintenance method provided in this application embodiment;

[0046] Figure 2 This application provides an architectural diagram of a data platform operation and maintenance system.

[0047] Figure 3 A schematic diagram of the structure of a data platform operation and maintenance device provided in this application embodiment;

[0048] Figure 4 This is a schematic diagram of the structure of a data middleware operation and maintenance device provided in an embodiment of this application. Detailed Implementation

[0049] To make the objectives, technical solutions, and advantages of this application clearer, the technical solutions of this application will be clearly and completely described below in conjunction with specific embodiments and corresponding drawings. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of them. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0050] The technical solutions provided by the various embodiments of this application are described in detail below with reference to the accompanying drawings.

[0051] like Figure 1 As shown in the embodiment of this application, a data platform operation and maintenance method includes:

[0052] S101: Collect the operation and maintenance data corresponding to the data platform; among which, the operation and maintenance data includes the running data corresponding to multiple monitoring items, including at least monitoring data, log data and security device data.

[0053] A data middle platform is a platform that uses technology to connect big data computing and storage capabilities and uses business to connect data application scenarios. It can collect, compute, store, and process massive amounts of data through data technology, while unifying standards and definitions.

[0054] In this embodiment, the server can collect operation and maintenance data corresponding to the data platform through page tracking or interface tracking. After collecting the operation and maintenance data, it uniformly stores the data in a centralized data storage platform for subsequent analysis. The operation and maintenance data includes operational data corresponding to multiple monitoring items, including at least monitoring data, log data, and security device data. It should be noted that this embodiment supports customized operation and maintenance requirements. After determining the operation and maintenance requirements, the server can also generate new monitoring items matching the above requirements through preset scripts and add the new monitoring items to the corresponding monitoring items in the data platform, thereby meeting actual application scenarios and improving applicability.

[0055] Specifically, the data flow logic corresponding to the data platform and the multiple data flow nodes included in the data flow logic are determined. Data entry points are then implemented at these data flow nodes. This allows for the collection of corresponding log data in response to data operations at these entry points. Additionally, the server can also implement data entry points for the business systems corresponding to the data platform, thereby collecting corresponding monitoring data and security device data at these entry points. It should be noted that the data collected through these entry points are business logs related to the security of the data platform. Besides these, business production logs can also be directly collected for subsequent analysis. Monitoring data includes data platform monitoring data, server monitoring data, and application process data. Security device data includes security-related information such as VPN, firewall, IPS, and WAP.

[0056] S102: Obtain user behavior data corresponding to the data platform, cross-validate the user behavior data, and generate corresponding user operation profiles.

[0057] Different users generate different data when performing business operations. Common data platform operation and maintenance methods can only manage the data under a single business operation, and cannot consider the entire data flow process for specific business operations performed by different users. Therefore, the server needs to acquire user behavior data from the data platform, and generate corresponding user operation profiles through cross-validation and in-depth analysis of the user behavior data. User operation profiles can reflect the lifecycle of data flowing when different users perform business operations, and can monitor the entire data lifecycle, including data generation, aggregation, processing, use, and destruction, to support the operation, security, and business operation status of the data platform.

[0058] S103: Based on user operation profiles, determine the lifecycle of the data platform and the various business operation nodes included in the lifecycle.

[0059] The user operation profile generated through the above process can determine the lifecycle of data in the data platform and the various business operation nodes included in the lifecycle. Thus, based on the different business operation nodes under this lifecycle, the entire process of data platform operation and maintenance can be realized.

[0060] S104: Determine the corresponding operation and maintenance dimensions of the data platform, analyze the operation and maintenance data of each business operation node for different operation and maintenance dimensions, obtain the corresponding analysis results, and perform operation and maintenance of the data platform based on the analysis results.

[0061] When performing operations and maintenance on the data platform, this application embodiment also sets up multiple operations and maintenance dimensions to match the dimensions of the operations and maintenance data, namely log operations and maintenance dimension, monitoring operations and maintenance dimension, and security device operations and maintenance dimension. By analyzing the operations and maintenance data under each business operation node through multiple dimensions, corresponding analysis results are obtained, which can meet the various operation and maintenance needs of the data platform, and can comprehensively monitor the operating status of the data platform, realize accurate location and alarm of abnormal problems, and improve operation and maintenance efficiency.

[0062] Specifically, based on log-based operations and maintenance, log data corresponding to each business operation node is analyzed to obtain corresponding log data analysis reports. Based on monitoring operations and maintenance, monitoring data corresponding to each business operation node is analyzed to determine whether security events exist in the data platform, its corresponding servers, and application processes. Based on device operations and maintenance, security device data corresponding to each business operation node is analyzed to determine whether security events exist in the security devices. If security events are found, appropriate alarm handling is required to ensure the secure operation of the data platform, servers, and other related devices.

[0063] In determining whether a security event exists for a particular monitoring item, this can be done by comparing the current monitoring item data with the monitoring item threshold parameter. This application's embodiments not only support custom monitoring item threshold parameters but also recommend specific monitoring item threshold parameters to improve operational efficiency and accuracy. For different business operation nodes, the server analyzes the historical operational data of the business operation nodes to determine the corresponding monitoring item threshold parameter range based on the historical data. Then, based on the monitoring item threshold parameter range, it recommends specific monitoring item threshold parameters for analyzing the operational data. The specified monitoring item threshold parameters conform to the monitoring item threshold parameter range. By recommending appropriate monitoring item threshold parameters or customizing monitoring item threshold parameters according to actual operational needs, user experience and operational efficiency can be greatly improved.

[0064] After obtaining the analysis results corresponding to different operational dimensions, the data platform can be operated and maintained based on these results. The server needs to locate abnormal units within the data platform based on the log data analysis report and issue alerts for these abnormal units. Furthermore, security events need to be traced to determine the specific monitoring items that caused the security events. These specific monitoring items include servers, application processes, and security devices.

[0065] It should be noted that the server can generate a monitoring interface corresponding to the data platform, and visualize the analysis results through the monitoring interface to improve intuitiveness. In addition to the anomaly monitoring module, the monitoring interface can also display information such as data assets, business calls, data resources, and interface calls, facilitating management and monitoring by operations and maintenance personnel.

[0066] Figure 2 This application provides a hierarchical architecture diagram of a data platform operation and maintenance system. (See diagram below.) Figure 2 As shown in the embodiments of this application, a data platform operation and maintenance system can also be provided. The system includes a data aggregation layer, a data storage and computing layer, a security data analysis layer, and a data service layer. The data aggregation layer is mainly used to achieve multi-dimensional collection of operation and maintenance data, collecting monitoring data, log data, and security device data from multiple dimensions of the data platform. A centralized data storage platform is used to store the operation and maintenance data collected by the data aggregation layer. The security data analysis layer mainly generates user operation profiles through cross-validation and deep mining, and analyzes the operation and maintenance data using general big data analysis methods such as analysis decision-making, knowledge reasoning, pattern analysis, mathematical models, and security footprints to obtain corresponding analysis results. The data service layer is mainly used to summarize and organize the analysis results. The analysis results, as well as the business calls, interface calls, and other data generated by the data platform, and data assets and resources, can all be visualized through a monitoring interface to improve data intuitiveness. The application alarm platform is mainly used to issue anomaly alarms when anomalies are found in the analysis results.

[0067] The above are embodiments of the methods proposed in this application. Based on the same idea, some embodiments of this application also provide apparatus, devices, and non-volatile computer storage media corresponding to the above methods.

[0068] Figure 3 This is a schematic diagram of the structure of a data platform operation and maintenance device provided in an embodiment of this application, as shown below. Figure 3 As shown, the device includes:

[0069] The acquisition unit 301 is used to collect the operation and maintenance data corresponding to the data platform; the operation and maintenance data includes the running data corresponding to multiple monitoring items, including at least monitoring data, log data and security device data;

[0070] User operation profile generation unit 302 is used to obtain user behavior data corresponding to the data platform, cross-validate the user behavior data, and generate corresponding user operation profiles.

[0071] The lifecycle determination unit 303 is used to determine the lifecycle of the data platform and the business operation nodes included in the lifecycle based on the user operation profile.

[0072] Analysis unit 304 is used to determine the operation and maintenance dimensions corresponding to the data platform. For different operation and maintenance dimensions, it analyzes the operation and maintenance data under each business operation node, obtains the corresponding analysis results, and performs operation and maintenance on the data platform based on the analysis results.

[0073] Figure 4This is a schematic diagram of the structure of a data platform operation and maintenance device provided in an embodiment of this application. Figure 4 As shown, it includes:

[0074] At least one processor; and,

[0075] At least one processor-communication-connected memory; wherein,

[0076] The memory stores instructions that can be executed by at least one processor, and the instructions, when executed by at least one processor, enable at least one processor to:

[0077] The data collection platform includes the corresponding operation and maintenance data; the operation and maintenance data includes the running data corresponding to multiple monitoring items, including at least monitoring data, log data and security device data.

[0078] Acquire user behavior data corresponding to the data platform, cross-validate the user behavior data, and generate corresponding user operation profiles;

[0079] Based on user operation profiles, determine the lifecycle of the data platform and the various business operation nodes included in the lifecycle;

[0080] Determine the corresponding operation and maintenance dimensions for the data platform, analyze the operation and maintenance data under each business operation node for different operation and maintenance dimensions, obtain the corresponding analysis results, and perform operation and maintenance on the data platform based on the analysis results.

[0081] This application provides a non-volatile computer storage medium storing computer-executable instructions, which are configured as follows:

[0082] The data collection platform includes the corresponding operation and maintenance data; the operation and maintenance data includes the running data corresponding to multiple monitoring items, including at least monitoring data, log data and security device data.

[0083] Acquire user behavior data corresponding to the data platform, cross-validate the user behavior data, and generate corresponding user operation profiles;

[0084] Based on user operation profiles, determine the lifecycle of the data platform and the various business operation nodes included in the lifecycle;

[0085] Determine the corresponding operation and maintenance dimensions for the data platform, analyze the operation and maintenance data under each business operation node for different operation and maintenance dimensions, obtain the corresponding analysis results, and perform operation and maintenance on the data platform based on the analysis results.

[0086] The various embodiments in this application are described in a progressive manner. Similar or identical parts between embodiments can be referred to mutually. Each embodiment focuses on describing the differences from other embodiments. In particular, the device and medium embodiments are basically similar to the method embodiments, so the description is relatively simple; relevant parts can be referred to the description of the method embodiments.

[0087] The devices and media provided in this application are one-to-one with the methods. Therefore, the devices and media also have similar beneficial technical effects as their corresponding methods. Since the beneficial technical effects of the methods have been described in detail above, the beneficial technical effects of the devices and media will not be repeated here.

[0088] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0089] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart... Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0090] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0091] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0092] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0093] Memory may include non-persistent storage in computer-readable media, such as random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM. Memory is an example of computer-readable media.

[0094] Computer-readable media includes both permanent and non-permanent, removable and non-removable media that can store information using any method or technology. Information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, CD-ROM, digital versatile optical disc (DVD) or other optical storage, magnetic tape, magnetic magnetic disk storage or other magnetic storage devices, or any other non-transferable medium that can be used to store information accessible by a computing device. As defined herein, computer-readable media does not include transient computer-readable media, such as modulated data signals and carrier waves.

[0095] It should also be noted that the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0096] The above description is merely an embodiment of this application and is not intended to limit the scope of this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the scope of the claims of this application.

Claims

1. A data middleware operation and maintenance method, characterized in that, The method includes: The data collection platform includes operation and maintenance data corresponding to the data collection platform; wherein, the operation and maintenance data includes operational data corresponding to multiple monitoring items, including at least monitoring data, log data and security device data; The user behavior data corresponding to the data platform is obtained, and the user behavior data is cross-validated to generate a corresponding user operation profile; the user operation profile can reflect the lifecycle of the data flowing when different users perform business operations; Based on the user operation profile, the lifecycle corresponding to the data platform and the business operation nodes included in the lifecycle are determined; the lifecycle refers to the lifecycle of the business data flowing through the data platform. The operation and maintenance dimensions corresponding to the data platform are determined. For different operation and maintenance dimensions, the operation and maintenance data under each business operation node are analyzed to obtain the corresponding analysis results. Based on the analysis results, the data platform is operated and maintained. For different operational dimensions, the operational data under each of the aforementioned business operation nodes are analyzed to obtain corresponding analysis results, specifically including: Based on the log operation and maintenance dimension, the log data corresponding to each of the aforementioned business operation nodes is analyzed to obtain the corresponding log data analysis report; Based on the monitoring and operation dimension, the monitoring data corresponding to each of the business operation nodes is analyzed to determine whether there are security events in the data platform, the server corresponding to the data platform, and the application process. Based on the equipment operation and maintenance dimension, the security equipment data corresponding to each of the aforementioned business operation nodes are analyzed to determine whether there are security events in the security equipment; Based on the analysis results, the data platform is operated and maintained, specifically including: Based on the log data analysis report, the abnormal units in the data platform are located and alarms are issued for the abnormal units. The security event is traced to determine the specified monitoring item that caused it; wherein the specified monitoring item includes the server, application process, and security device.

2. The data platform operation and maintenance method according to claim 1, characterized in that, Before collecting the corresponding operation and maintenance data from the data platform, the method further includes: Determine the data flow logic corresponding to the data platform and the multiple data flow nodes included in the data flow logic. Perform data tracking on the data flow nodes to respond to the data operation corresponding to the data flow node at the tracking point and collect the corresponding log data. The business systems corresponding to the data platform are subjected to data tracking to collect corresponding monitoring data and security device data at the tracking points.

3. The data platform operation and maintenance method according to claim 1, characterized in that, The method further includes: Determine the operational and maintenance requirements of the data platform, generate new monitoring items that match the operational and maintenance requirements using a preset script, and add the new monitoring items to the corresponding monitoring items of the data platform.

4. The data platform operation and maintenance method according to claim 1, characterized in that, Before analyzing the operation and maintenance data under each of the aforementioned business operation nodes, the method further includes: For different business operation nodes, the historical operation and maintenance data of the business operation nodes are analyzed in order to determine the threshold parameter range of the monitoring items corresponding to the business operation nodes based on the historical operation and maintenance data. Based on the range of threshold parameters for the monitoring items, recommended threshold parameters for specific monitoring items are provided for analyzing the operation and maintenance data; wherein, the threshold parameters for specific monitoring items conform to the range of threshold parameters for the monitoring items.

5. A data platform operation and maintenance method according to claim 1, characterized in that, After obtaining the corresponding analysis results, the method further includes: Generate a monitoring interface corresponding to the data platform and display the analysis results on the monitoring interface.

6. A data platform operation and maintenance device, characterized in that, The device includes: The data acquisition unit is used to collect the operation and maintenance data corresponding to the data platform; wherein, the operation and maintenance data includes the operation data corresponding to multiple monitoring items, including at least monitoring data, log data and security device data; The user operation profile generation unit is used to acquire user behavior data corresponding to the data platform, perform cross-validation on the user behavior data, and generate a corresponding user operation profile; the user operation profile can reflect the lifecycle of data flowing when different users perform business operations. The lifecycle determination unit is used to determine the lifecycle corresponding to the data platform and the business operation nodes included in the lifecycle based on the user operation profile; the lifecycle refers to the lifecycle of the business data flowing through the data platform. The analysis unit is used to determine the operation and maintenance dimensions corresponding to the data platform, analyze the operation and maintenance data under each business operation node for different operation and maintenance dimensions, obtain the corresponding analysis results, and perform operation and maintenance on the data platform based on the analysis results. Specifically, it is used to analyze the log data corresponding to each of the aforementioned business operation nodes based on the log operation and maintenance dimension, and to obtain the corresponding log data analysis report; Based on the monitoring and operation dimension, the monitoring data corresponding to each of the business operation nodes is analyzed to determine whether there are security events in the data platform, the server corresponding to the data platform, and the application process. Based on the equipment operation and maintenance dimension, the security equipment data corresponding to each of the aforementioned business operation nodes are analyzed to determine whether there are security events in the security equipment; Specifically, it is used to locate abnormal units in the data platform based on the log data analysis report, and to issue an alarm for the abnormal units; The security event is traced to determine the specified monitoring item that caused it; wherein the specified monitoring item includes the server, application process, and security device.

7. A data platform operation and maintenance device, characterized in that the device... include: At least one processor; as well as, A memory communicatively connected to the at least one processor; wherein, The memory stores instructions executable by the at least one processor, which, when executed by the at least one processor, enable the at least one processor to: The data collection platform includes operation and maintenance data corresponding to the data collection platform; wherein, the operation and maintenance data includes operational data corresponding to multiple monitoring items, including at least monitoring data, log data and security device data; The user behavior data corresponding to the data platform is obtained, and the user behavior data is cross-validated to generate a corresponding user operation profile; the user operation profile can reflect the lifecycle of the data flowing when different users perform business operations; Based on the user operation profile, the lifecycle corresponding to the data platform and the business operation nodes included in the lifecycle are determined; the lifecycle refers to the lifecycle of the business data flowing through the data platform. The operation and maintenance dimensions corresponding to the data platform are determined. For different operation and maintenance dimensions, the operation and maintenance data under each business operation node are analyzed to obtain the corresponding analysis results. Based on the analysis results, the data platform is operated and maintained. For different operational dimensions, the operational data under each of the aforementioned business operation nodes are analyzed to obtain corresponding analysis results, specifically including: Based on the log operation and maintenance dimension, the log data corresponding to each of the aforementioned business operation nodes is analyzed to obtain the corresponding log data analysis report; Based on the monitoring and operation dimension, the monitoring data corresponding to each of the business operation nodes is analyzed to determine whether there are security events in the data platform, the server corresponding to the data platform, and the application process. Based on the equipment operation and maintenance dimension, the security equipment data corresponding to each of the aforementioned business operation nodes are analyzed to determine whether there are security events in the security equipment; Based on the analysis results, the data platform is operated and maintained, specifically including: Based on the log data analysis report, the abnormal units in the data platform are located and alarms are issued for the abnormal units. The security event is traced to determine the specified monitoring item that caused it; wherein the specified monitoring item includes the server, application process, and security device.

8. A non-volatile computer storage medium storing computer-executable instructions, characterized in that, The computer-executable instructions are set as follows: The data collection platform includes operation and maintenance data corresponding to the data collection platform; wherein, the operation and maintenance data includes operational data corresponding to multiple monitoring items, including at least monitoring data, log data and security device data; The user behavior data corresponding to the data platform is obtained, and the user behavior data is cross-validated to generate a corresponding user operation profile; the user operation profile can reflect the lifecycle of the data flowing when different users perform business operations; Based on the user operation profile, the lifecycle corresponding to the data platform and the business operation nodes included in the lifecycle are determined; the lifecycle refers to the lifecycle of the business data flowing through the data platform. The operation and maintenance dimensions corresponding to the data platform are determined. For different operation and maintenance dimensions, the operation and maintenance data under each business operation node are analyzed to obtain the corresponding analysis results. Based on the analysis results, the data platform is operated and maintained. For different operational dimensions, the operational data under each of the aforementioned business operation nodes are analyzed to obtain corresponding analysis results, specifically including: Based on the log operation and maintenance dimension, the log data corresponding to each of the aforementioned business operation nodes is analyzed to obtain the corresponding log data analysis report; Based on the monitoring and operation dimension, the monitoring data corresponding to each of the business operation nodes is analyzed to determine whether there are security events in the data platform, the server corresponding to the data platform, and the application process. Based on the equipment operation and maintenance dimension, the security equipment data corresponding to each of the aforementioned business operation nodes are analyzed to determine whether there are security events in the security equipment; Based on the analysis results, the data platform is operated and maintained, specifically including: Based on the log data analysis report, the abnormal units in the data platform are located and alarms are issued for the abnormal units. The security event is traced to determine the specified monitoring item that caused it; wherein the specified monitoring item includes the server, application process, and security device.

Images