Intelligent power plant data storage management method and system
Through differential evolution algorithms, optimize data compression and dynamic adjustment of access control, strengthen data security, and combine intelligent retrieval and multi-dimensional query, the efficiency and security issues of power plant data storage and management systems are solved, and data management and decision-making support of smart power plants are improved. ability.
Patent Information
- Application Number
- CN202411506187.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-28
- Publication Date
- 2024-11-26
- Estimated Expiration
- 2044-10-28
AI Technical Summary
The existing power plant data storage and management systems have low data compression and storage efficiency, insufficient data security and insufficient intelligence, resulting in high data storage costs, slow access speed and high security risks, making it difficult to support the efficient operation of smart power plants. and precise decision-making.
Differential evolution algorithm is used to optimize data compression, dynamically adjust access control and encryption strategies, provide intelligent retrieval and multi-dimensional complex query functions based on metadata, and support real-time data analysis and visual presentation.
It improves data storage and processing efficiency, ensures data security and privacy, improves data utilization efficiency and operation management level, and provides strong technical support for smart power plants.
Smart Images

Figure CN119025833A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of power plant data storage, and in particular to an intelligent power plant data storage management method and system. Background Art
[0002] With the development of smart power plants, the amount of data generated in the process of power production and management has increased exponentially. In order to ensure the safety, reliability and efficiency of power plant operation, these massive data must be effectively collected, stored, processed and analyzed. Smart power plants have many types of data, including real-time operation data, historical data and external environment data. These data are not only used for daily monitoring and operation optimization, but also play a key role in fault diagnosis, predictive maintenance and decision support. Therefore, how to effectively manage and utilize these data has become an important challenge for smart power plants to achieve intelligence and informatization.
[0003] Existing power plant data storage and management systems usually face multiple deficiencies. First, data compression and storage efficiency are low, and storage space and computing resources cannot be fully utilized, resulting in high data storage costs and slow access speeds. Second, data security and privacy protection measures are relatively weak, and they cannot be dynamically adjusted according to data sensitivity and system load, posing potential safety hazards. In addition, the existing systems are not intelligent enough in data retrieval and analysis, and it is difficult to support multi-dimensional complex queries and real-time data analysis, resulting in low data utilization efficiency and unable to meet the needs of efficient operation and accurate decision-making of smart power plants.
[0004] In order to solve the above problems, the present invention provides a smart power plant data storage management method and system, which aims to improve the data management level of the smart power plant, enable it to better utilize data resources in a complex operating environment, support the stable operation and efficient management of the power plant, and provide strong technical guarantee for the operation optimization and decision support of the smart power plant. Summary of the invention
[0005] The invention provides a smart power plant data storage management method and system.
[0006] A method for storing and managing data in an intelligent power plant comprises the following steps: S1, data collection and preprocessing: collect real-time power plant data, including operation data, historical data and external environment data, through sensors, equipment and information platforms in smart power plants, and preprocess the collected power plant data, including data cleaning, denoising, format conversion and standardization; S2, data classification and storage: the pre-processed power plant data is classified according to the data type, source and purpose, and stored in a distributed database; S3, data compression: Differential evolution algorithm is used to compress and optimize various types of power plant data, including: S31, initial population generation: for various types of power plant data, generate initial populations of multiple compression strategies, each individual represents a compression scheme, including the selection of compression algorithm, compression ratio, and block size; S32, differential mutation and crossover operation: through the mutation operation of the differential evolution algorithm, the differences between different individuals in the population are used to generate new candidate compression schemes (mutation vectors), and the new candidate compression schemes (mutation vectors) are cross-operated with the individuals in the initial population to generate new candidate solutions; S33, fitness evaluation and optimal strategy selection: according to the quality of compressed data, compression rate and resource consumption, set the fitness function, evaluate all candidate solutions, and eliminate the solutions with low fitness through multiple iterations, and finally select the compression strategy with the highest fitness; S4, data access control and encryption: set access control policies for various types of power plant data, and use encryption technology to encrypt and store power plant data. The encryption and access control policies are dynamically adjusted according to the classification and compression of the data; S5, data retrieval and intelligent analysis: provides metadata-based intelligent retrieval functions, supports multi-dimensional complex queries, and performs real-time analysis and visualization of stored power plant data.
[0007] Optionally, the data collection and preprocessing in S1 includes: S11, data collection: collect real-time power plant data, including operation data, historical data and external environment data, through sensors, equipment and information platforms in smart power plants; The operating data includes the output power of the power generation equipment, equipment temperature, pressure, speed, voltage, current, and power factor; The historical data includes accumulated equipment operation records, fault history, maintenance logs, production scheduling records and historical energy consumption data; The external environmental data includes external meteorological data (such as temperature, humidity, wind speed, wind direction), power grid load demand data, and environmental monitoring data; S12, data cleaning: cleaning the collected power plant data to remove noise data and abnormal values; S13, format conversion: convert the cleaned power plant data into a standard format; S14, data standardization: standardize the power plant data after format conversion.
[0008] Optionally, the data classification and storage in S2 includes: S21, data classification: classify the pre-processed power plant data according to the type, source and purpose of the data; The types include operational data, historical data, and external environment data; Said sources include power generation equipment, sensors and external information platforms; Said uses include real-time monitoring, historical analysis and environmental assessment; S22, data storage: storing the classified power plant data in a distributed database.
[0009] Optionally, the initial population generation in S31 includes: S311, compression algorithm selection: Select a compression algorithm according to the data type and data characteristics, including a lossless compression algorithm and a lossy compression algorithm, and select each compression algorithm through an empirical formula, which is expressed as: ; in, Choose a fitness score for the algorithm, is the weight coefficient of each compression algorithm, is the compressed data rate, is the original data rate before compression; S312, compression ratio determination: set an initial compression ratio for different power plant data types. The initial compression ratio is calculated based on data redundancy and information entropy and is expressed as: ; in, is the compression ratio, is the actual information entropy of the data, is the information entropy with maximum probability; S313, block size setting: For various types of power plant data, the block size is set according to the data access mode and storage requirements, expressed as: ; in, is the block size, is the total size of the data, is the frequency coefficient of data access.
[0010] Optionally, the differential mutation and crossover operation in S32 includes: S321, differential mutation operation: using differential evolution algorithm, by randomly selecting three individuals from the population , , Perform differential mutation operations to generate new candidate compression schemes (mutation vectors) , expressed as: ; in, is the generated candidate compression scheme (mutation vector), is the scaling factor; S322, crossover operation: generate candidate compression schemes (mutation vectors) With individuals in the initial population Perform crossover operations to generate new candidate solutions , the crossover operation is expressed as: ; in, is the candidate solution Quantity, is the crossover probability, The index of the randomly selected component.
[0011] Optionally, the scaling factor Settings include: Difference calculation: Calculate the average difference between all individuals in the current population , expressed as: ; in, is the number of individuals in the population, is the number of dimensions for each individual, For the The individual Quantity, For the The average value of the components; Maximum difference setting: Set the maximum probability value of population difference , The maximum difference when the initial population is generated; Scaling factor range setting: Set the minimum value of the scaling factor and maximum value , the range is , used to control the amplification degree of the differential vector; The scaling factor is calculated adaptively: according to the current diversity of the population The maximum difference from the setting , adaptively calculate the scaling factor The value of is expressed as: .
[0012] Optionally, the fitness evaluation and optimal strategy selection in S33 include: S331, fitness function setting: Set the fitness function according to the compressed data quality, compression rate and resource consumption. The candidate compression schemes are evaluated as: ; in, Score the quality of the compressed data. is the compression ratio, For resource consumption, is the weight coefficient; S332, candidate scheme evaluation and sorting: use the fitness function to evaluate all current candidate compression schemes, calculate the fitness value of each scheme, sort the schemes according to the fitness value, eliminate the bottom 50% of the schemes in terms of fitness value, and retain the top 50% of the schemes for iteration; S333, multiple iterations and optimization: Repeat the generation, fitness calculation, sorting and selection process of candidate solutions, and gradually improve the overall fitness of the population through multiple iterations; S334, optimal strategy selection: when the iteration process reaches a predetermined condition or a maximum number of iterations, the candidate solution with the highest fitness value is selected as the final optimal compression strategy.
[0013] Optionally, the data access control and encryption in S4 includes: S41, access control policy setting: according to the type of power plant data (such as operating data, historical data, external environment data) and its sensitivity level, set different access control policies, including user authority classification, data access records and role-based access control (RBAC); S42, data encryption storage: using AES encryption algorithm to encrypt and store power plant data; S43, Dynamically adjust the strategy: dynamically adjust the access control strategy and encryption strategy according to the data classification, compression ratio and real-time security requirements, including: S431, access control adjustment coefficient: according to the sensitivity of real-time data and the current platform load, the access control adjustment coefficient is calculated, which is expressed as: ; in, is the sensitivity level of the data, is the current platform load, is the user permission level; S432, encryption strength adjustment coefficient: Calculate the encryption strength adjustment coefficient based on the data compression ratio and the current environment response time , expressed as: ; in, is the sensitivity level of the data, is the compression ratio (the ratio of the compressed data size to the original data size), Parameters for environmental response time or real-time processing capability; S433, comprehensive adjustment decision: adjust the coefficient according to the access control and encryption strength adjustment factor The value of is used for comprehensive adjustment and the final dynamic adjustment coefficient is calculated. ,like If the threshold is exceeded, policy adjustments are triggered, including improving encryption strength or tightening access rights, as shown in the following example: ; in, and is the weight coefficient.
[0014] Optionally, the data retrieval and intelligent analysis in S5 includes: S51, intelligent retrieval based on metadata: Provides intelligent retrieval function based on metadata to annotate and index the stored power plant data. The metadata includes data type, timestamp, source device, data format and data content summary; S52, multi-dimensional complex query support: supports users to conduct multi-dimensional complex queries, allowing users to combine query conditions based on multiple metadata attributes, including filtering by time period, device type, and data type; S53, real-time analysis and visualization: Real-time analysis of the retrieved power plant data, including data aggregation analysis, trend analysis and prediction, and anomaly detection. Graphical tools are used to visualize the analysis results, including real-time curve graphs, historical trend graphs, and pie charts.
[0015] An intelligent power plant data storage management system, used to implement the above-mentioned intelligent power plant data storage management method, includes the following modules: Data acquisition module: collects real-time power plant data, including operation data, historical data and external environment data, through sensors, equipment and information platforms in smart power plants, and pre-processes the collected power plant data, including data cleaning, denoising, format conversion and standardization; Data classification and storage module: classifies the pre-processed power plant data according to the data type, source and purpose, and stores it in a distributed database; Data compression module: uses differential evolution algorithm to compress and optimize various types of power plant data; Data access control and encryption module: Set access control policies for various types of power plant data, use encryption technology to encrypt and store data, and make dynamic adjustments based on the classification and compression of power plant data; Data retrieval and intelligent analysis module: provides metadata-based intelligent retrieval functions, supports multi-dimensional complex queries, and performs real-time analysis and visualization of stored power plant data.
[0016] Beneficial effects of the present invention: The present invention, by adopting differential evolution algorithm to perform data compression optimization, effectively improves the efficiency of data storage and processing, ensures that data reaches the best balance between storage space, transmission speed and computing resource utilization, and by classifying and storing different types of power plant data, the system not only improves the response speed of data storage, but also ensures that real-time data can be quickly accessed, providing a solid foundation for subsequent data analysis and decision support.
[0017] The present invention adopts dynamic access control and encryption strategies, combines the sensitivity of real-time data, platform load and compression ratio, and intelligently adjusts access control and encryption strength to ensure data security and privacy under different operating conditions. The dynamic adjustment mechanism effectively enhances the adaptability and security of the system through real-time calculation and historical data analysis, ensuring that the smart power plant can still operate efficiently and safely in a complex environment.
[0018] The present invention greatly improves the availability and operational convenience of power plant data through metadata-based intelligent retrieval, multi-dimensional complex query, real-time analysis and visual display. Users can quickly locate and analyze required data, and intuitively understand data change trends and abnormal situations through visualization tools, thereby supporting the operation optimization and accurate decision-making of smart power plants, and further improving the overall operation efficiency and management level of smart power plants. BRIEF DESCRIPTION OF THE DRAWINGS
[0019] In order to more clearly illustrate the technical solutions in the present invention or the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings in the following description are only for the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0020] Figure 1 A schematic diagram of a management method flow chart of an embodiment of the present invention; Figure 2 Schematic diagram of system function modules according to an embodiment of the present invention. DETAILED DESCRIPTION
[0021] The present invention is described in detail below in conjunction with the accompanying drawings and specific embodiments. At the same time, it is explained here that in order to make the embodiments more detailed, the following embodiments are the best and preferred embodiments, and those skilled in the art may also adopt other alternatives to implement some known technologies; and the accompanying drawings are only for more specific description of the embodiments, and are not intended to specifically limit the present invention.
[0022] It should be noted that the references to "one embodiment", "embodiment", "exemplary embodiments", "some embodiments" and the like in the specification indicate that the embodiments described may include specific features, structures or characteristics, but not every embodiment may include the specific features, structures or characteristics. In addition, when a specific feature, structure or characteristic is described in conjunction with an embodiment, it should be within the knowledge of a person skilled in the art to implement such feature, structure or characteristic in conjunction with other embodiments (whether or not explicitly described).
[0023] In general, a term can be understood, at least in part, from its use in context. For example, depending, at least in part, on the context, the term "one or more" as used herein can be used to describe any feature, structure, or characteristic in the singular sense, or can be used to describe a combination of features, structures, or characteristics in the plural sense. Additionally, the term "based on" can be understood as not necessarily intended to convey an exclusive set of factors, but can instead, depending, at least in part, on the context, allow for the presence of other factors that are not necessarily explicitly described.
[0024] like Figure 1 As shown, a smart power plant data storage management method includes the following steps: S1, data collection and preprocessing: Through the sensors, equipment and information platform in the smart power plant, real-time power plant data, including operation data, historical data and external environment data, are collected, and the collected power plant data is preprocessed, including data cleaning, denoising, format conversion and standardization processing to ensure data consistency and integrity; S2, data classification and storage: the pre-processed power plant data is classified according to the data type, source and purpose, and stored in a distributed database; S3, data compression: Differential evolution algorithm is used to compress and optimize various types of power plant data, including: S31, initial population generation: for various types of power plant data, generate initial populations of multiple compression strategies, each individual represents a compression scheme, including the selection of compression algorithm, compression ratio, and block size; S32, differential mutation and crossover operation: through the mutation operation of the differential evolution algorithm, the differences between different individuals in the population are used to generate new candidate compression schemes (mutation vectors), and the new candidate compression schemes (mutation vectors) are cross-operated with the individuals in the initial population to generate new candidate solutions; S33, fitness evaluation and optimal strategy selection: according to the quality of compressed data, compression rate and resource consumption, set the fitness function, evaluate all candidate solutions, and eliminate the solutions with low fitness through multiple iterations, and finally select the compression strategy with the highest fitness; S4, data access control and encryption: To ensure data security and privacy, access control policies are set for various types of power plant data, and encryption technology is used to encrypt and store power plant data. The encryption and access control policies are dynamically adjusted according to the classification and compression of the data to ensure the security of data during storage and transmission; S5, data retrieval and intelligent analysis: Provides metadata-based intelligent retrieval functions, supports multi-dimensional complex queries, and performs real-time analysis and visualization of stored power plant data to support operation optimization and decision support for smart power plants; Through the above steps, not only the efficiency of data storage and processing is improved, but also the security and integrity of the data are ensured, providing strong technical guarantee for the efficient operation and decision support of smart power plants.
[0025] Data collection and preprocessing in S1 include: S11, data collection: collect real-time power plant data, including operation data, historical data and external environment data, through sensors, equipment and information platforms in smart power plants; Operation data include output power of power generation equipment, equipment temperature, pressure, speed, voltage, current, and power factor; Historical data includes accumulated equipment operation records, fault history, maintenance logs, production scheduling records, and historical energy consumption data; External environmental data includes external meteorological data (such as temperature, humidity, wind speed, wind direction), power grid load demand data, and environmental monitoring data; S12, data cleaning: cleaning the collected power plant data to remove noise data and outliers to ensure the accuracy and reliability of the data; S13, format conversion: convert the cleaned power plant data into a standard format to facilitate subsequent storage and processing; S14, data standardization: standardize the power plant data after format conversion to ensure the consistency of the data in terms of dimension, scope, etc.; Through the above content, not only the operating data, historical data and external environmental data are effectively integrated, providing a high-quality foundation for subsequent data storage, analysis and decision-making, but also the data processing efficiency and the overall intelligent level of power plant management are improved by eliminating noise and standardizing processing, ensuring that the power plant can obtain reliable and accurate data support under various operating conditions.
[0026] Data classification and storage in S2 include: S21, data classification: classify the pre-processed power plant data according to the type, source and purpose of the data; Types include operational data, historical data, and external environment data; Sources include power generation equipment, sensors, and external information platforms; Uses include real-time monitoring, historical analysis, and environmental assessment; S22, data storage: storing the classified power plant data in a distributed database; Through the above content, not only the efficiency and response speed of data storage are improved, but also the application of distributed databases ensures that real-time data can be quickly accessed.
[0027] The initial population generation in S31 includes: S311, compression algorithm selection: Select a compression algorithm according to the data type and data characteristics, including a lossless compression algorithm and a lossy compression algorithm, and select each compression algorithm through an empirical formula, which is expressed as: ; in, Choose a fitness score for the algorithm, is the weight coefficient of each compression algorithm, is the compressed data rate, is the original data rate before compression; S312, compression ratio determination: set an initial compression ratio for different power plant data types. The initial compression ratio is calculated based on data redundancy and information entropy and is expressed as: ; in, is the compression ratio, is the actual information entropy of the data, is the information entropy of maximum probability, that is, the theoretical maximum information entropy based on the highest probability distribution in the data; S313, block size setting: For various types of power plant data, the block size is set according to the data access mode and storage requirements, expressed as: ; in, is the block size, is the total size of the data, is the frequency coefficient of data access; Through the above content, not only the efficiency and effect of data compression are improved, but also a solid foundation is provided for the subsequent differential evolution algorithm, ensuring that the globally optimal compression strategy can be achieved in the processing of various types of power plant data, thereby improving the intelligence level of the entire data storage management system.
[0028] The differential mutation and crossover operations in S32 include: S321, differential mutation operation: using differential evolution algorithm, by randomly selecting three individuals from the population , , Perform differential mutation operations to generate new candidate compression schemes (mutation vectors) , expressed as: ; in, is the generated candidate compression scheme (mutation vector), is the scaling factor, which is used to control the magnification degree of the differential vector; S322, crossover operation: generate candidate compression schemes (mutation vectors) With individuals in the initial population Perform crossover operations to generate new candidate solutions , the crossover operation is expressed as: ; in, is the candidate solution Quantity, is the crossover probability, which controls the degree of feature exchange between the mutation vector and the original individual. is the randomly selected component index, ensuring that at least one component comes from the mutation vector; Through the above content, the differences between different individuals in the population are effectively utilized, the global search capability of the algorithm is enhanced, and while maintaining the diversity of the population, the balance between the breadth and precision of the search is ensured, which further improves the optimization effect of the candidate solutions and provides a more intelligent and optimized solution for the data compression strategy of the smart power plant, which helps to achieve more efficient data management.
[0029] Scaling Factor Settings include: Difference calculation: Calculate the average difference between all individuals in the current population , expressed as: ; in, is the number of individuals in the population, is the number of dimensions for each individual, For the The individual Quantity, For the The average value of the components; Maximum difference setting: Set the maximum probability value of population difference , The maximum difference when the initial population is generated, which serves as a reference for setting the scaling factor; Scaling factor range setting: Set the minimum value of the scaling factor and maximum value , the range is , used to control the amplification degree of the differential vector; The scaling factor is calculated adaptively: according to the current diversity of the population The maximum difference from the setting , adaptively calculate the scaling factor The value of is expressed as: ; Through the above content, the balance between global search capability and local refinement is optimized, and the optimization effect of data compression strategy is significantly improved.
[0030] The fitness evaluation and optimal strategy selection in S33 include: S331, fitness function setting: Set the fitness function according to the compressed data quality, compression rate and resource consumption. The candidate compression schemes are evaluated as: ; in, It is the quality score of compressed data. The higher the score, the better the integrity of data recovery. is the compression ratio, which is defined as the ratio of the compressed data size to the original data size. The smaller the better. It is the resource consumption, which indicates the computing resource consumption during compression and decompression. The lower the better. is the weight coefficient, which is used to balance the importance of different evaluation indicators; S332, candidate scheme evaluation and sorting: use the fitness function to evaluate all current candidate compression schemes, calculate the fitness value of each scheme, sort the schemes according to the fitness value, eliminate the bottom 50% of the schemes in terms of fitness value, and retain the top 50% of the schemes for iteration; S333, multiple iterations and optimization: Repeat the generation, fitness calculation, sorting and selection process of candidate solutions, and gradually improve the overall fitness of the population through multiple iterations; S334, optimal strategy selection: when the iteration process reaches a predetermined condition or a maximum number of iterations, the candidate solution with the highest fitness value is selected as the final optimal compression strategy; Through the above content, the transparency and efficiency of the optimization process are ensured, so that each round of iteration can continuously improve the compression strategy. Finally, the solution with the highest fitness is selected as the optimal strategy, which not only improves the data compression effect, but also optimizes the data management of the smart power plant, ensuring that the system achieves the best balance between data quality and resource utilization.
[0031] Data access control and encryption in S4 include: S41, access control policy setting: according to the type of power plant data (such as operating data, historical data, external environment data) and its sensitivity level, set different access control policies, including user authority classification, data access records and role-based access control (RBAC), to ensure that only authorized users can access the corresponding data; S42, data encryption storage: using AES encryption algorithm to encrypt and store power plant data; S43, Dynamically adjust the strategy: dynamically adjust the access control strategy and encryption strategy according to the data classification, compression ratio and real-time security requirements, including: S431, access control adjustment coefficient: according to the sensitivity of real-time data and the current platform load, the access control adjustment coefficient is calculated, which is expressed as: ; in, The sensitivity level of the data. The higher the value, the more sensitive the data. is the current platform load. The higher the value, the heavier the platform load. It is the user authority level, the higher the value is, the higher the user authority is; S432, encryption strength adjustment coefficient: Calculate the encryption strength adjustment coefficient based on the data compression ratio and the current environment response time , expressed as: ; in, is the sensitivity level of the data, is the compression ratio (the ratio of the compressed data size to the original data size), Parameters for environmental response time or real-time processing capability; S433, comprehensive adjustment decision: adjust the coefficient according to the access control and encryption strength adjustment factor The value of is used for comprehensive adjustment and the final dynamic adjustment coefficient is calculated. ,like If the threshold is exceeded, policy adjustments are triggered, including improving encryption strength or tightening access rights, as shown in the following example: ; in, and is the weight coefficient; The predetermined threshold is determined based on statistical analysis of historical data, current platform load, data sensitivity, and compression ratio, including: Historical data analysis: Collect and analyze historical platform operation data, record situations that trigger policy adjustments under different platform loads and data types, and use statistical methods, including standard deviation analysis or distribution-based analysis, to determine the platform's response under different load and data sensitivity conditions; Weighted average of load and sensitivity: Calculate the load of different platforms based on historical data and data sensitivity level The weighted average under , as the basis for the predetermined threshold, is expressed as: ; in, is the basic threshold, For the The load level recorded, For the The data sensitivity level of the sub-record, For the The adjustment trigger point of the second record, To record the number of times; Dynamic adjustment factor: combined with the current compression ratio and environmental response time , calculate the dynamic adjustment factor , so that the threshold is automatically adjusted according to the real-time situation, expressed as: ; in, The maximum response time recorded in history; Comprehensive threshold calculation: Final predetermined threshold It is calculated by combining the basic threshold and the dynamic adjustment factor, and is expressed as: ; Through the above contents, the security of various types of data in the smart power plant during storage and transmission is ensured, the intelligence level of data management is enhanced, and the power plant can maintain efficient and safe data processing and management under complex operating conditions.
[0032] Data retrieval and intelligent analysis in S5 include: S51, intelligent retrieval based on metadata: Provides intelligent retrieval function based on metadata to annotate and index the stored power plant data. The metadata includes data type, timestamp, source device, data format and data content summary. Through the analysis and matching of metadata, it supports rapid location of relevant data and provides intelligent recommended query paths. S52, Multi-dimensional Complex Query Support: Supports users to conduct multi-dimensional complex queries, allowing users to combine query conditions based on multiple metadata attributes, including filtering by time period, device type, and data type, ensuring efficient query response on large-scale data sets; S53, real-time analysis and visualization: real-time analysis of the retrieved power plant data, including data aggregation analysis, trend analysis and prediction, and anomaly detection, and visualization of the analysis results using graphical tools, including real-time curve graphs, historical trend graphs, and pie charts, to support operation optimization and decision support of smart power plants; Through the above content, the data management and decision support capabilities of smart power plants are improved, enabling users to use data more efficiently in complex environments and make wise operational decisions.
[0033] like Figure 2 As shown, a smart power plant data storage management system is used to implement the above-mentioned smart power plant data storage management method, including the following modules: Data acquisition module: collects real-time power plant data, including operation data, historical data and external environment data, through sensors, equipment and information platforms in smart power plants, and pre-processes the collected power plant data, including data cleaning, denoising, format conversion and standardization; Data classification and storage module: classifies the pre-processed power plant data according to the data type, source and purpose, and stores it in a distributed database; Data compression module: uses differential evolution algorithm to compress and optimize various types of power plant data; Data access control and encryption module: Set access control policies for various types of power plant data, use encryption technology to encrypt and store data, and make dynamic adjustments based on the classification and compression of power plant data; Data retrieval and intelligent analysis module: provides metadata-based intelligent retrieval functions, supports multi-dimensional complex queries, and performs real-time analysis and visualization of stored power plant data.
[0034] The present invention covers any substitution, modification, equivalent method and scheme made on the essence and scope of the present invention. In order to make the public have a thorough understanding of the present invention, specific details are described in detail in the following preferred embodiments of the present invention, but those skilled in the art can fully understand the present invention without the description of these details. In addition, in order to avoid unnecessary confusion about the essence of the present invention, well-known methods, processes, procedures, components and circuits are not described in detail.
[0035] The above is only a preferred embodiment of the present invention. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principle of the present invention. These improvements and modifications should also be regarded as the scope of protection of the present invention.
Claims
1. A method for data storage and management of smart power plants, characterized in that: The following steps are involved: S1, data collection and preprocessing: collect real-time power plant data, including operation data, historical data and external environment data, through sensors, equipment and information platforms in smart power plants, and preprocess the collected power plant data, including data cleaning, denoising, format conversion and standardization; S2, data classification and storage: the pre-processed power plant data is classified according to the data type, source and purpose, and stored in a distributed database; S3, data compression: Differential evolution algorithm is used to compress and optimize various types of power plant data, including: S31, initial population generation: for various types of power plant data, generate initial populations of multiple compression strategies, each individual represents a compression scheme, including the selection of compression algorithm, compression ratio, and block size; S32, differential mutation and crossover operation: through the mutation operation of the differential evolution algorithm, the differences between different individuals in the population are used to generate new candidate compression schemes, and the new candidate compression schemes are cross-operated with the individuals in the initial population to generate new candidate solutions; S33, fitness evaluation and optimal strategy selection: according to the quality of compressed data, compression rate and resource consumption, set the fitness function, evaluate all candidate solutions, and eliminate the solutions with low fitness through multiple iterations, and finally select the compression strategy with the highest fitness; S4, data access control and encryption: set access control policies for various types of power plant data, and use encryption technology to encrypt and store power plant data. The encryption and access control policies are dynamically adjusted according to the classification and compression of the data; S5, data retrieval and intelligent analysis: provides metadata-based intelligent retrieval functions, supports multi-dimensional complex queries, and performs real-time analysis and visualization of stored power plant data.
2. The method for storing and managing data in a smart power plant according to claim 1, characterized in that: The data collection and preprocessing in S1 include: S11, data collection: collect real-time power plant data, including operation data, historical data and external environment data, through sensors, equipment and information platforms in smart power plants; The operating data includes the output power of the power generation equipment, equipment temperature, pressure, speed, voltage, current, and power factor; The historical data includes accumulated equipment operation records, fault history, maintenance logs, production scheduling records and historical energy consumption data; The external environmental data includes external meteorological data, power grid load demand data, and environmental monitoring data; S12, data cleaning: cleaning the collected power plant data to remove noise data and abnormal values; S13, format conversion: convert the cleaned power plant data into a standard format; S14, data standardization: standardize the power plant data after format conversion.
3. The method for storing and managing data in a smart power plant according to claim 1, characterized in that: The data classification and storage in S2 include: S21, data classification: classify the pre-processed power plant data according to the type, source and purpose of the data; The types include operational data, historical data, and external environment data; Said sources include power generation equipment, sensors and external information platforms; Said uses include real-time monitoring, historical analysis and environmental assessment; S22, data storage: storing the classified power plant data in a distributed database.
4. The method for storing and managing data in a smart power plant according to claim 1, characterized in that: The initial population generation in S31 includes: S311, compression algorithm selection: Select a compression algorithm according to the data type and data characteristics, including a lossless compression algorithm and a lossy compression algorithm, and select each compression algorithm through an empirical formula, which is expressed as: ; in, Choose a fitness score for the algorithm, is the weight coefficient of each compression algorithm, is the compressed data rate, is the original data rate before compression; S312, compression ratio determination: set an initial compression ratio for different power plant data types. The initial compression ratio is calculated based on data redundancy and information entropy and is expressed as: ; in, is the compression ratio, is the actual information entropy of the data, is the information entropy with maximum probability; S313, block size setting: For various types of power plant data, the block size is set according to the data access mode and storage requirements, expressed as: ; in, is the block size, is the total size of the data, is the frequency coefficient of data access.
5. The method for storing and managing data in a smart power plant according to claim 4, characterized in that: The differential mutation and crossover operation in S32 includes: S321, differential mutation operation: using differential evolution algorithm, by randomly selecting three individuals from the population , , Perform differential mutation operations to generate new candidate compression schemes , expressed as: ; in, is the candidate compression scheme generated, is the scaling factor; S322, cross operation: generate candidate compression schemes With individuals in the initial population Perform crossover operations to generate new candidate solutions , the crossover operation is expressed as: ; in, is the candidate solution Quantity, is the crossover probability, The index of the randomly selected component.
6. The method for storing and managing data in a smart power plant according to claim 5, characterized in that: The scaling factor Settings include: Difference calculation: Calculate the average difference between all individuals in the current population , expressed as: ; in, is the number of individuals in the population, is the number of dimensions for each individual, For the The individual Quantity, For the The average value of the components; Maximum difference setting: Set the maximum probability value of population difference , The maximum difference when the initial population is generated; Scaling factor range setting: Set the minimum value of the scaling factor and maximum value , the range is , used to control the amplification degree of the difference vector; The scaling factor is calculated adaptively: according to the current diversity of the population The maximum difference from the setting , adaptively calculate the scaling factor The value of is expressed as: 。 7. The method for storing and managing data in a smart power plant according to claim 6, characterized in that: The fitness evaluation and optimal strategy selection in S33 include: S331, fitness function setting: Set the fitness function according to the compressed data quality, compression rate and resource consumption. The candidate compression schemes are evaluated as: ; in, Score the quality of the compressed data. is the compression ratio, For resource consumption, is the weight coefficient; S332, candidate scheme evaluation and sorting: use the fitness function to evaluate all current candidate compression schemes, calculate the fitness value of each scheme, sort the schemes according to the fitness value, eliminate the bottom 50% of the schemes in terms of fitness value, and retain the top 50% of the schemes for iteration; S333, multiple iterations and optimization: Repeat the generation, fitness calculation, sorting and selection process of candidate solutions, and gradually improve the overall fitness of the population through multiple iterations; S334, optimal strategy selection: when the iteration process reaches a predetermined condition or a maximum number of iterations, the candidate solution with the highest fitness value is selected as the final optimal compression strategy.
8. The method for storing and managing data in a smart power plant according to claim 1, characterized in that: The data access control and encryption in S4 include: S41, access control policy setting: according to the type of power plant data and its sensitivity level, set different access control policies, including user authority classification, data access records and role-based access control; S42, data encryption storage: using AES encryption algorithm to encrypt and store power plant data; S43, Dynamically adjust the strategy: dynamically adjust the access control strategy and encryption strategy according to the data classification, compression ratio and real-time security requirements, including: S431, access control adjustment coefficient: according to the sensitivity of real-time data and the current platform load, the access control adjustment coefficient is calculated, which is expressed as: ; in, is the sensitivity level of the data, is the current platform load, is the user permission level; S432, encryption strength adjustment coefficient: Calculate the encryption strength adjustment coefficient based on the data compression ratio and the current environment response time , expressed as: ; in, is the sensitivity level of the data, is the compression ratio, Parameters for environmental response time or real-time processing capability; S433, comprehensive adjustment decision: adjust the coefficient according to the access control and encryption strength adjustment factor The value of is used for comprehensive adjustment and the final dynamic adjustment coefficient is calculated. ,like If the threshold is exceeded, policy adjustments are triggered, including improving encryption strength or tightening access rights, as shown in the following example: ; in, and is the weight coefficient.
9. The method for storing and managing data in a smart power plant according to claim 1, characterized in that: The data retrieval and intelligent analysis in S5 include: S51, intelligent retrieval based on metadata: Provides intelligent retrieval function based on metadata to annotate and index the stored power plant data. The metadata includes data type, timestamp, source device, data format and data content summary; S52, multi-dimensional complex query support: supports users to conduct multi-dimensional complex queries, allowing users to combine query conditions based on multiple metadata attributes, including filtering by time period, device type, and data type; S53, real-time analysis and visualization: Real-time analysis of the retrieved power plant data, including data aggregation analysis, trend analysis and prediction, and anomaly detection. Graphical tools are used to visualize the analysis results, including real-time curve graphs, historical trend graphs, and pie charts.
10. A smart power plant data storage management system, used to implement a smart power plant data storage management method as claimed in any one of claims 1 to 9, characterized in that: Includes the following modules: Data acquisition module: collects real-time power plant data, including operation data, historical data and external environment data, through sensors, equipment and information platforms in smart power plants, and pre-processes the collected power plant data, including data cleaning, denoising, format conversion and standardization; Data classification and storage module: classifies the pre-processed power plant data according to the data type, source and purpose, and stores it in a distributed database; Data compression module: uses differential evolution algorithm to compress and optimize various types of power plant data; Data access control and encryption module: Set access control policies for various types of power plant data, use encryption technology to encrypt and store data, and make dynamic adjustments based on the classification and compression of power plant data; Data retrieval and intelligent analysis module: provides metadata-based intelligent retrieval functions, supports multi-dimensional complex queries, and performs real-time analysis and visualization of stored power plant data.
Citation Information
Patent Citations
Road positioning data compression and storage method and terminal equipment
CN114124104A
Data interaction system for archive management
CN117827743A
Distributed market data acquisition management system
CN117876016A
Large-scale distributed storage management and maintenance system
CN118349185A
Real-time data query method and system based on multi-level index
CN118673043A
Cited By
Multi-source sensor data sharing system and method under weak signal
CN119946730A
Government affair integrated data acquisition and storage management system
CN120407529A
Industrial equipment high-density data storage management optimization system and method
CN120653208A
A high-density data storage management optimization system and method for industrial equipment
CN120653208B
Intelligent power plant data storage management method and system
CN120848801A
