Power grid data processing method and device, computer equipment, readable storage medium and program product

Abstract

The invention relates to a power grid data processing method and device, computer equipment, a computer readable storage medium and a computer program product. The method comprises the following steps: configuring a data management system, wherein the configuration content comprises a data processing framework used by the data management system, an encryption service type and an access control authority; power grid data are obtained, the power grid data are preprocessed through the data management system, and preprocessing comprises cleaning and duplicate removal; performing encryption and desensitization processing on the preprocessed power grid data through the data management system to obtain intermediate data; and performing anomaly analysis on the intermediate data through the data management system, analyzing log records generated in an anomaly analysis process to obtain a monitoring result of the anomaly analysis process, and performing automatic early warning according to the monitoring result. Therefore, by adopting the method, data leakage or tampering can be effectively prevented.

Description

Technical Field

[0001] The present application relates to the field of data processing technology, and in particular to a power grid data processing method, device, computer equipment, computer-readable storage medium and computer program product. Background Art

[0002] With the continuous development of society, data management technology plays an increasingly important role in organizing, operating and protecting enterprises. This technology is required for a series of technologies and processes in data analysis and decision-making activities. Effective data management can help improve data accuracy, availability and reliability, while ensuring data security and compliance with relevant regulations.

[0003] In traditional technology, the data management system in the existing large-scale data storage has the problem of weak encryption effect during use. Although the existing encryption method provides higher security, it is not completely impeccable. Technological development and the improvement of computing power may make encryption technology obsolete. Potential dangers may make the currently widely used encryption protocols easy to crack. Summary of the invention

[0004] Based on this, it is necessary to provide a power grid data processing method, device, computer equipment, computer-readable storage medium and computer program product that can prevent data leakage or tampering in order to address the above technical problems.

[0005] In a first aspect, the present application provides a power grid data processing method, comprising:

[0006] Configuring the data management system, including the data processing framework, encryption service type and access control permissions used by the data management system;

[0007] Acquire power grid data, and pre-process the power grid data through the data management system, wherein the pre-processing includes cleaning and deduplication;

[0008] The pre-processed power grid data is encrypted and desensitized by the data management system to obtain intermediate data;

[0009] Through the data management system, the intermediate data is analyzed for abnormalities, and the log records generated during the abnormal analysis process are analyzed to obtain monitoring results of the abnormal analysis process, and automatic warnings are issued based on the monitoring results.

[0010] In one embodiment, encrypting the pre-processed power grid data by the data management system includes:

[0011] Selecting an encryption algorithm according to at least one of the frequency of occurrence of data in the preprocessed power grid data, the degree of importance of the data, or the encryption requirement level;

[0012] Based on the selected encryption algorithm, the preprocessed power grid data is encrypted.

[0013] In one embodiment, desensitizing the pre-processed power grid data through the data management system includes:

[0014] The sensitive fields in the encrypted power grid data are replaced with preset characters, wherein the preset characters include placeholders, the first letters of the first words in the sensitive fields, or random numbers, and the sensitive fields include personal privacy information.

[0015] In one embodiment, the method further comprises:

[0016] Obtaining a data access request, and determining a data access permission corresponding to the data access request, wherein the data access permission is pre-assigned based on an account corresponding to the data access request;

[0017] Based on the data access permission, corresponding power grid data is returned.

[0018] In one of the embodiments, the log records generated during the anomaly analysis process include at least one of a network traffic log, an operating system log, an application log, or a database access log.

[0019] In one embodiment, the method further comprises:

[0020] According to the monitoring results, an automated response process is performed on the account accessing the power grid data, wherein the automated response process includes blocking the IP address of the account or stopping providing a preset type of service to the account;

[0021] Based on the automated response processing results and the automated warning results, the abnormal status of the data management system is displayed.

[0022] In a second aspect, the present application further provides a power grid data processing device, including:

[0023] A configuration module is used to configure the data management system, including the data processing framework, encryption service type and access control authority used by the data management system;

[0024] An acquisition module, used for acquiring power grid data, and preprocessing the power grid data through the data management system, wherein the preprocessing includes cleaning and deduplication;

[0025] A processing module, used to encrypt and desensitize the pre-processed power grid data through the data management system to obtain intermediate data;

[0026] The early warning module is used to perform abnormal analysis on the intermediate data through the data management system, and analyze the log records generated during the abnormal analysis process, obtain the monitoring results of the abnormal analysis process, and automatically issue an early warning based on the monitoring results.

[0027] In a third aspect, the present application further provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, the following steps are implemented:

[0028] Configuring the data management system, including the data processing framework, encryption service type and access control permissions used by the data management system;

[0029] Acquire power grid data, and pre-process the power grid data through the data management system, wherein the pre-processing includes cleaning and deduplication;

[0030] The pre-processed power grid data is encrypted and desensitized by the data management system to obtain intermediate data;

[0031] Through the data management system, the intermediate data is analyzed for abnormalities, and the log records generated during the abnormal analysis process are analyzed to obtain monitoring results of the abnormal analysis process, and automatic warnings are issued based on the monitoring results.

[0032] In a fourth aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, the following steps are implemented:

[0033] Configuring the data management system, including the data processing framework, encryption service type and access control permissions used by the data management system;

[0034] Acquire power grid data, and pre-process the power grid data through the data management system, wherein the pre-processing includes cleaning and deduplication;

[0035] The pre-processed power grid data is encrypted and desensitized by the data management system to obtain intermediate data;

[0036] Through the data management system, the intermediate data is analyzed for abnormalities, and the log records generated during the abnormal analysis process are analyzed to obtain monitoring results of the abnormal analysis process, and automatic warnings are issued based on the monitoring results.

[0037] In a fifth aspect, the present application further provides a computer program product, including a computer program, which implements the following steps when executed by a processor:

[0038] Configuring the data management system, including the data processing framework, encryption service type and access control permissions used by the data management system;

[0039] Acquire power grid data, and pre-process the power grid data through the data management system, wherein the pre-processing includes cleaning and deduplication;

[0040] The pre-processed power grid data is encrypted and desensitized by the data management system to obtain intermediate data;

[0041] Through the data management system, the intermediate data is analyzed for abnormalities, and the log records generated during the abnormal analysis process are analyzed to obtain monitoring results of the abnormal analysis process, and automatic warnings are issued based on the monitoring results.

[0042] The above-mentioned power grid data processing method, device, computer equipment, computer-readable storage medium and computer program product, first, configure the data management system, the configuration content includes the data processing framework, encryption service type and access control authority used by the data management system; obtain power grid data, and pre-process the power grid data through the data management system, the pre-processing includes cleaning and deduplication; encrypt and desensitize the pre-processed power grid data through the data management system to obtain intermediate data, thereby protecting private data; analyze the intermediate data through the data management system, and analyze the log records generated during the abnormal analysis process to obtain the monitoring results of the abnormal analysis process, and automatically warn according to the monitoring results. Therefore, the method can effectively respond to the challenges of the big data era, efficiently process and analyze a large amount of data from different sources, ensure continuous and real-time analysis and processing of data, meet the encryption requirements of different types of data, effectively prevent data leakage or tampering, and anonymize personal identification information during data calculation and transmission, so as to ensure the privacy and security of users from the source, and monitor log records in real time to achieve long-term, stable and efficient operation of the data management system. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the drawings required for use in the embodiments of the present application or related technical descriptions will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0044] FIG1 is a schematic flow chart of a method for processing power grid data in one embodiment;

[0045] FIG2 is a structural block diagram of a power grid data processing device in one embodiment;

[0046] FIG. 3 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION

[0047] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0048] In one embodiment, as shown in FIG1 , a power grid data processing method is provided. This embodiment illustrates the method by applying it to a terminal. It is understandable that the method can also be applied to a server, or to a system including a terminal and a server, and is implemented through the interaction between the terminal and the server.

[0049] In this embodiment, the method includes the following steps:

[0050] Step 102, configure the data management system, the configuration content includes the data processing framework, encryption service type and access control authority used by the data management system.

[0051] The data processing framework is a big data processing framework, which can be Hadoop and Spark. The encryption service type is a method for encrypting data during data processing, which can be a heap encryption algorithm, an asymmetric encryption algorithm, and a hash algorithm. This embodiment does not limit this. In actual implementation, it is selected according to the characteristics of the data to be processed and the security requirements.

[0052] In some embodiments, the terminal needs to deploy the system infrastructure in a physical or cloud environment, initialize the big data processing framework, encryption service type and access control permissions.

[0053] Step 104, acquiring power grid data, and preprocessing the power grid data through a data management system, wherein the preprocessing includes cleaning and deduplication.

[0054] Specifically, the terminal will obtain power grid data and clean and deduplicate the power grid data through the data management system.

[0055] Step 106, encrypting and desensitizing the pre-processed power grid data through the data management system to obtain intermediate data.

[0056] In some specific embodiments, the terminal selects an encryption algorithm based on at least one of the frequency of occurrence of data in the preprocessed power grid data, the degree of importance of the data, or the encryption requirement level, and encrypts the preprocessed power grid data according to the selected encryption algorithm. The data containing personal identification information in the encrypted power grid data is then desensitized and converted into anonymous information. After the processing is completed, intermediate data is obtained.

[0057] Step 108, through the data management system, perform abnormal analysis on the intermediate data, analyze the log records generated during the abnormal analysis process, obtain the monitoring results of the abnormal analysis process, and automatically issue an early warning based on the monitoring results.

[0058] In some embodiments, the terminal will perform anomaly analysis on intermediate data through the data management system, and monitor network traffic, system logs, and application logs in real time to detect potential security threats and abnormal behaviors, and issue automatic warnings based on the monitoring results.

[0059] In some embodiments, the terminal continuously trains the initial data management system through historical power grid data, and optimizes the system parameters through cross-validation technology, and obtains the data management system after the optimization is completed.

[0060] In some embodiments, the terminal periodically retrains the data management system with the latest grid data to continuously improve the system.

[0061] In the above-mentioned power grid data processing method, the data management system is configured, and the configuration content includes the data processing framework, encryption service type and access control authority used by the data management system; the power grid data is obtained, and the power grid data is preprocessed through the data management system, and the preprocessing includes cleaning and deduplication; the preprocessed power grid data is encrypted and desensitized through the data management system to obtain intermediate data, thereby protecting private data; through the data management system, the intermediate data is analyzed for abnormalities, and the log records generated during the abnormal analysis process are analyzed to obtain the monitoring results of the abnormal analysis process, and automatic warnings are issued based on the monitoring results. Therefore, this method can effectively respond to the challenges of the big data era, efficiently process and analyze a large amount of data from different sources, ensure continuous and real-time analysis and processing of data, meet the encryption requirements of different types of data, effectively prevent data leakage or tampering, and anonymize personal identification information during data calculation and transmission to ensure the privacy security of users from the source, and monitor log records in real time to achieve long-term, stable and efficient operation of the data management system.

[0062] In an exemplary embodiment, the preprocessed power grid data is encrypted through a data management system, including: selecting an encryption algorithm based on at least one of the frequency of occurrence of data in the preprocessed power grid data, the degree of data importance, or the encryption requirement level; and encrypting the preprocessed power grid data based on the selected encryption algorithm.

[0063] In actual implementation, the terminal will select a corresponding encryption algorithm based on at least one of the frequency of occurrence of the pre-processed power grid data, the importance of the data, or the level of demand. And encrypt the pre-processed power grid data according to the selected encryption algorithm. Among them, the encryption algorithm includes symmetric encryption algorithm, asymmetric encryption algorithm and hash algorithm.

[0064] In one embodiment, the symmetric encryption algorithm uses the AES-GCM-SIV algorithm, which combines the Advanced Encryption Standard (AES) and two operation modes: Galois / Counter Mode (GCM) and Synthetic Initialization Vector (SIV). Among them, AES (Advanced Encryption Standard) is a symmetric encryption algorithm used to encrypt (and decrypt) data blocks; the AES function can be expressed as: AES K (X); where K is the key and X is the data block to be encrypted. GCM is an operation mode that converts a block cipher (AES) into a stream cipher that can encrypt data of any length and provide message authentication (data integrity check). GCM uses the counter mode (CTR) to encrypt data and the GHASH function for integrity check.

[0065] CTR mode: Encrypts data blocks by combining each data block with a "count" and encrypting it. GHASH: A special hash function used for GCM that provides message integrity verification. SIV (encryption mode) inputs the key and plaintext into a key derivation function to generate a synthetic initialization vector (SIV), which is then used as the initial value of the counter in CTR mode to encrypt data.

[0066] In the above embodiments, the corresponding encryption algorithm is selected according to the characteristics and security requirements of the data to ensure the security of the data during transmission and storage. The AES-GCM-SIV lightweight and highly secure algorithm is adopted to provide an encryption technology that has data confidentiality, integrity verification and replay attack protection, and improves the original GCM mode in some aspects, especially providing stronger security when processing non-randomized data.

[0067] In some exemplary embodiments, the preprocessed power grid data is desensitized through a data management system, including: replacing sensitive fields in the encrypted power grid data with preset characters, the preset characters include placeholders, the first letters of the first word in the sensitive field, or random numbers, and the sensitive fields include personal privacy information.

[0068] In actual implementation, the terminal will replace sensitive fields with meaningless placeholders or other data, replace names with initials, replace phone numbers with random numbers, and reorganize or reorder data to eliminate the possibility of identifying individuals.

[0069] In the above embodiment, by desensitizing sensitive information and converting personal identification information into anonymous information, personal privacy can be protected while maintaining the usefulness of the data for related tasks.

[0070] In some exemplary embodiments, the power grid data processing method further includes: obtaining a data access request, determining a data access permission corresponding to the data access request, the data access permission being pre-allocated based on an account corresponding to the data access request; and returning corresponding power grid data based on the data access permission.

[0071] In actual implementation, when the terminal obtains a data access request, it will determine the data access permission corresponding to the data access request, and return the corresponding power grid data according to the data access permission.

[0072] In one of the embodiments, the terminal sets corresponding access permissions in advance, and only authorized accounts can access specific data or perform specific operations. Role-based access control (RBAC) or attribute-based access control (ABAC) is implemented to finely manage user access permissions to data.

[0073] Furthermore, by defining the accounts required for each position or job in the organization, specific data access rights and operation permissions are assigned to each account. These permissions clearly specify which resources the account can access and which operations it can perform. As the organizational structure or policies change, accounts and permissions can be flexibly updated or reconfigured. At the same time, relevant account attributes (age, department, position), resource attributes (sensitivity level, data type) and environmental attributes (access time, device type) are defined, and these attributes are used to formulate complex access control policies.

[0074] In the above embodiments, by implementing RBAC or ABAC, not only can it be precisely controlled who can access what data, when and where, but it can also greatly reduce the risk of data leakage and illegal access, thereby enhancing overall data security.

[0075] In some exemplary embodiments, the log records generated during the anomaly analysis process include at least one of a network traffic log, an operating system log, an application log, or a database access log.

[0076] In actual implementation, the terminal will monitor the log records generated during the anomaly analysis process in real time, including at least one of the network traffic log, operating system log, application log or database access log, to identify abnormal behaviors and threat indicators. Among them, abnormal behaviors and threat indicators refer to abnormal situations that occur during operation and indicators that may pose a threat to system security and data integrity.

[0077] In the above embodiment, by real-time monitoring of log records during the abnormal analysis process, potential threat indicators and abnormal behaviors can be identified more quickly, thereby more effectively defending against possible security attacks.

[0078] In some exemplary embodiments, the power grid data processing method further includes: performing automated response processing on accounts that access power grid data based on monitoring results, the automated response processing including blocking the account's IP address or ceasing to provide a preset type of service to the account; and displaying an abnormal status of the data management system based on the automated response processing results and the automatic warning results.

[0079] In actual implementation, when the terminal detects security risks in the monitoring results, it will automatically respond, including blocking the account's IP address or stopping providing preset types of services to the account, uploading detailed analysis results and recommended risk response methods, and displaying real-time automated response processing results and automatic warning results on a visual interface.

[0080] In the above embodiments, the reliance on manual operations is reduced through the automated response mechanism, thereby improving work efficiency.

[0081] To explain the power grid data processing method in the present application in detail, an embodiment is used for explanation below. By way of example, the present application is explained with a specific power grid data method.

[0082] First, the terminal needs to deploy the system infrastructure in a physical or cloud environment, initialize the big data processing framework, encryption service type, and access control permissions, obtain power grid data, and clean and deduplicate the power grid data through the data management system.

[0083] According to at least one of the occurrence frequency of the pre-processed power grid data, the importance of the data, or the demand level, a corresponding encryption algorithm is selected, and the pre-processed power grid data is encrypted according to the selected encryption algorithm.

[0084] The encryption algorithm selected is the heap encryption algorithm. The symmetric encryption algorithm uses the AES-GCM-SIV algorithm, which combines the Advanced Encryption Standard (AES) and two operation modes: Galois / Counter Mode (GCM) and SyntheticInitialization Vector (SIV). Among them, AES (Advanced Encryption Standard) is a symmetric encryption algorithm used to encrypt (and decrypt) data blocks; the AES function can be expressed as: AESK(X); where K is the key and X is the data block to be encrypted. GCM is an operation mode that converts the block cipher (AES) into a stream cipher that can encrypt data of any length and provide message authentication (data integrity check). GCM uses the counter mode (CTR) to encrypt data and the GHASH function for integrity check.

[0085] CTR mode: Encrypts data blocks by combining each data block with a "count" and encrypting it. GHASH: A special hash function used for GCM that provides message integrity verification. SIV (encryption mode) inputs the key and plaintext into a key derivation function to generate a synthetic initialization vector (SIV), which is then used as the initial value of the counter in CTR mode to encrypt data.

[0086] Sensitive fields will be replaced with meaningless placeholders or other data, names will be replaced with initials, phone numbers will be replaced with random numbers, and data will be reorganized or reordered to eliminate the possibility of identifying individuals.

[0087] When a data access request is obtained, the data access permission corresponding to the data access request is determined, and the corresponding power grid data is returned according to the data access permission.

[0088] Real-time monitoring of log records generated during abnormal analysis includes at least one of network traffic logs, operating system logs, application logs, or database access logs, and identifying abnormal behaviors and threat indicators. Abnormal behaviors and threat indicators refer to abnormal situations that occur during operation and indicators that may pose a threat to system security and data integrity.

[0089] When security risks are detected in the monitoring results, an automated response will be made, including blocking the account's IP address or stopping providing preset types of services to the account, uploading detailed analysis results and recommended risk response methods, and displaying real-time automated response processing results and automatic warning results on a visual interface.

[0090] The encryption algorithms used in this application include symmetric encryption, asymmetric encryption and hash algorithms, which meet the encryption requirements of different types of power grid data, effectively prevent data leakage or tampering, and implement a detailed access control mechanism to ensure that only authorized accounts can access specific data or perform specific operations. This fine-grained access control can effectively improve data security.

[0091] During the data calculation and transmission process, this application will anonymize personal identification information to ensure the privacy and security of users from the source. The data management system has the ability to monitor and automatically respond to various abnormal behaviors in real time, and continuously learn and optimize, significantly improving the system's security defense level, so that the system can continuously learn and optimize the data management model to achieve long-term, stable and efficient operation.

[0092] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0093] Based on the same inventive concept, the embodiment of the present application also provides a power grid data processing device for implementing the power grid data processing method involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in one or more power grid data processing device embodiments provided below can refer to the limitations of the power grid data processing method above, and will not be repeated here.

[0094] In an exemplary embodiment, as shown in FIG2 , a power grid data processing device is provided, including: a configuration module 201, an acquisition module 202, a processing module 203 and an early warning module 204, wherein:

[0095] The configuration module is used to configure the data management system, and the configuration content includes the data processing framework, encryption service type and access control authority used by the data management system.

[0096] The acquisition module is used to acquire power grid data and pre-process the power grid data through the data management system, wherein the pre-processing includes cleaning and deduplication.

[0097] The processing module is used to encrypt and desensitize the pre-processed power grid data through the data management system to obtain intermediate data.

[0098] The early warning module is used to perform abnormal analysis on the intermediate data through the data management system, and analyze the log records generated during the abnormal analysis process, obtain the monitoring results of the abnormal analysis process, and automatically issue an early warning based on the monitoring results.

[0099] In some embodiments, the device also includes an encryption module for selecting an encryption algorithm based on at least one of the frequency of occurrence of data in the preprocessed power grid data, the degree of data importance, or the encryption requirement level; and encrypting the preprocessed power grid data based on the selected encryption algorithm.

[0100] In some embodiments, the device also includes a desensitizing module for replacing sensitive fields in the encrypted power grid data with preset characters, the preset characters including placeholders, the first letters of the first word in the sensitive field, or random numbers, and the sensitive field includes personal privacy information.

[0101] In some embodiments, the device also includes an access module for obtaining a data access request, determining a data access permission corresponding to the data access request, the data access permission being pre-allocated based on an account corresponding to the data access request; and returning corresponding power grid data based on the data access permission.

[0102] In some embodiments, the device further includes an analysis module, and the log records generated during the anomaly analysis process include at least one of a network traffic log, an operating system log, an application log, or a database access log.

[0103] In some embodiments, the device also includes a display module for performing automated response processing on accounts accessing power grid data based on monitoring results, wherein the automated response processing includes blocking the account's IP address or stopping providing a preset type of service to the account; and displaying abnormal status of the data management system based on the automated response processing results and automatic warning results.

[0104] Each module in the above-mentioned power grid data processing device can be implemented in whole or in part by software, hardware or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute operations corresponding to each module above.

[0105] In an exemplary embodiment, a computer device is provided, which may be a server, and its internal structure diagram may be shown in FIG3. The computer device includes a processor, a memory, an input / output interface (Input / Output, referred to as I / O) and a communication interface, a display unit and an input device. The processor, the memory and the input / output interface are connected via a system bus, and the communication interface, the display unit and the input device are connected to the system bus via the input / output interface. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store power grid data. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a power grid data processing method is implemented.

[0106] The display unit of the computer device is used to form a visually visible picture, and can be a display screen, a projection device, or a virtual reality imaging device. The display screen can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device can be a touch layer covered on the display screen, or a key, trackball, or touchpad provided on the computer device housing, or an external keyboard, touchpad, or mouse, etc.

[0107] Those skilled in the art will understand that the structure shown in FIG. 3 is merely a block diagram of a partial structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than shown in the figure, or combine certain components, or have a different arrangement of components.

[0108] In an exemplary embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, the following steps are implemented:

[0109] Configuring the data management system, including the data processing framework, encryption service type and access control permissions used by the data management system;

[0110] Acquire power grid data, and pre-process the power grid data through the data management system, wherein the pre-processing includes cleaning and deduplication;

[0111] The pre-processed power grid data is encrypted and desensitized by the data management system to obtain intermediate data;

[0112] Through the data management system, the intermediate data is analyzed for abnormalities, and the log records generated during the abnormal analysis process are analyzed to obtain monitoring results of the abnormal analysis process, and automatic warnings are issued based on the monitoring results.

[0113] In one embodiment, a computer readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:

[0114] Configuring the data management system, including the data processing framework, encryption service type and access control permissions used by the data management system;

[0115] Acquire power grid data, and pre-process the power grid data through the data management system, wherein the pre-processing includes cleaning and deduplication;

[0116] The pre-processed power grid data is encrypted and desensitized by the data management system to obtain intermediate data;

[0117] Through the data management system, the intermediate data is analyzed for abnormalities, and the log records generated during the abnormal analysis process are analyzed to obtain monitoring results of the abnormal analysis process, and automatic warnings are issued based on the monitoring results.

[0118] In one embodiment, a computer program product is provided, comprising a computer program, which, when executed by a processor, implements the following steps:

[0119] Configuring the data management system, including the data processing framework, encryption service type and access control permissions used by the data management system;

[0120] Acquire power grid data, and pre-process the power grid data through the data management system, wherein the pre-processing includes cleaning and deduplication;

[0121] The pre-processed power grid data is encrypted and desensitized by the data management system to obtain intermediate data;

[0122] Through the data management system, the intermediate data is analyzed for abnormalities, and the log records generated during the abnormal analysis process are analyzed to obtain monitoring results of the abnormal analysis process, and automatic warnings are issued based on the monitoring results.

[0123] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant regulations.

[0124] A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment method can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, an artificial intelligence (AI) processor, etc., but are not limited to this.

[0125] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0126] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be construed as limiting the scope of the present application. It should be noted that, for a person of ordinary skill in the art, several modifications and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A method for processing power grid data, characterized in that: The method comprises: Configuring the data management system, including the data processing framework, encryption service type and access control permissions used by the data management system; Acquire power grid data, and pre-process the power grid data through the data management system, wherein the pre-processing includes cleaning and deduplication; The pre-processed power grid data is encrypted and desensitized by the data management system to obtain intermediate data; Through the data management system, the intermediate data is analyzed for abnormalities, and the log records generated during the abnormal analysis process are analyzed to obtain monitoring results of the abnormal analysis process, and automatic warnings are issued based on the monitoring results.

2. The method according to claim 1, characterized in that The pre-processed power grid data is encrypted by the data management system, including: Selecting an encryption algorithm according to at least one of the frequency of occurrence of data in the preprocessed power grid data, the degree of importance of the data, or the encryption requirement level; Based on the selected encryption algorithm, the preprocessed power grid data is encrypted.

3. The method according to claim 1, characterized in that The pre-processed power grid data is desensitized by the data management system, including: The sensitive fields in the encrypted power grid data are replaced with preset characters, wherein the preset characters include placeholders, the first letters of the first words in the sensitive fields, or random numbers, and the sensitive fields include personal privacy information.

4. The method according to claim 1, characterized in that: The method further comprises: Obtaining a data access request, and determining a data access permission corresponding to the data access request, wherein the data access permission is pre-assigned based on an account corresponding to the data access request; Based on the data access permission, corresponding power grid data is returned.

5. The method according to claim 1, characterized in that The log records generated during the anomaly analysis process include at least one of a network traffic log, an operating system log, an application log, or a database access log.

6. The method according to claim 1, characterized in that The method further comprises: According to the monitoring results, an automated response process is performed on the account accessing the power grid data, wherein the automated response process includes blocking the IP address of the account or stopping providing a preset type of service to the account; Based on the automated response processing results and the automated warning results, the abnormal status of the data management system is displayed.

7. A power grid data processing device, characterized in that: The device comprises: A configuration module is used to configure the data management system, including the data processing framework, encryption service type and access control authority used by the data management system; An acquisition module, used for acquiring power grid data, and preprocessing the power grid data through the data management system, wherein the preprocessing includes cleaning and deduplication; A processing module, used to encrypt and desensitize the pre-processed power grid data through the data management system to obtain intermediate data; The early warning module is used to perform abnormal analysis on the intermediate data through the data management system, and analyze the log records generated during the abnormal analysis process, obtain the monitoring results of the abnormal analysis process, and automatically issue an early warning based on the monitoring results.

8. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 6 are implemented.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

Images