Station area heterogeneous phasor database automatic generation method, system, device and medium

Abstract

The application discloses a station area heterogeneous phasor database automatic generation method, system, equipment and medium, a database table is constructed based on pre-established station area distributed heterogeneous data capability description semantic information, the station area distributed heterogeneous data includes station area distributed load identification result data; station area real-time data of an access substation is analyzed, the analyzed station area real-time data and station area distributed load identification result data constitute station area heterogeneous phasor real-time data; station area heterogeneous phasor real-time data is divided into data items and encoded, the encoded station area heterogeneous phasor real-time data is matched to different cache structures based on data coding rules, and then is written into the database table in batches in parallel, to generate a station area heterogeneous phasor database. The application can satisfy wide-area mass data access real-time communication, has high reliability, better supports local analysis of heterogeneous phasor data and main substation interactive access, and guarantees safe and stable operation control of a power grid.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of power system automation, in particular to a station domain heterogeneous phasor database automatic generation method, system, device and medium. BACKGROUND

[0002] Building a new power system mainly based on new energy, increasing the proportion of new energy such as photovoltaic and wind power will make the dynamic characteristics of the power system more complex, and bring new challenges to the safe and stable operation of the power grid. In recent years, foreign blackouts have shown that the lack of timely and accurate understanding and judgment of the operation state of the power grid by dispatchers is one of the main reasons for the inability to control the accident in time and the increase of power loss.

[0003] Based on full PMU measurement, power system dynamic security situation awareness is an important means of power grid analysis and control. After a large amount of wide-area high-frequency PMU data is accessed, the real-time and reliability of the communication and data processing system will be challenged, but the current research lacks real-time communication optimization and reliable processing technology for wide-area mass data access, and most of the existing running WAMS systems cannot meet the 100Hz high-frequency data transmission.

[0004] In view of the above background, the document "Design and Application of Intelligent Concentrator Based on Data Edge Computing" (Measurement and Control Technology, 2021, 40(5), 91-96) mainly discusses how to realize the design and application of intelligent concentrator based on data edge computing. The design idea proposed can realize distributed computing of electric energy metering big data, reduce the computing pressure of cloud computing data center, and effectively improve the operation and maintenance efficiency of electric energy metering system. The document "Edge Node Perception Adaptive Data Processing Method for Ubiquitous Power Internet of Things" (High Voltage Technology, 2019, 45(6): 1715-1722) aims at the shortcoming that the traditional cloud computing operation mode of data center centralized processing cannot adapt to the rapidly expanding data scale. Based on the construction of ubiquitous power Internet of Things data processing architecture based on edge computing, the idea of edge computing is adopted to realize the effective collection of ubiquitous power Internet of Things data. Simulation verification shows that the method can effectively improve the processing performance of massive data. The document "Analysis and Research of Time Series Database Based on Power System" (Information Communication, 2021, 09, 140-1433) analyzes the current situation of the existing power system and finds that the relational database is not suitable for data storage of the power system. For data that changes with time, time series database is more suitable for data storage. It is proposed to replace the relational database with the time series database in the existing power system, and an implementation scheme is given. Further research on the advantages of time series database and its future development trend is carried out.

[0005] In summary, the current literature and reports mainly carry out research in the aspects of power database and edge computing technology, the research focuses on the application of the power database in the main station and the application of the edge computing in the distribution network, and the like, however, how to guarantee the real-time performance and reliability of wide-area mass data access, better support the station area analysis and the main and sub-station data interactive access, and meet the real-time interaction and application analysis of the analysis results in the local and the main station has not been reported. SUMMARY

[0006] The present application aims to provide a station area heterogeneous phasor database automatic generation method, system, equipment and medium, to overcome the defects existing in the prior art, the present application can meet the real-time communication of wide-area mass data access, has strong reliability, better supports the local analysis of heterogeneous phasor data and the interactive access of the main and sub-station, and guarantees the safe and stable operation control of the power grid.

[0007] To achieve the above-mentioned purpose, the present application adopts the following technical scheme:

[0008] The station area heterogeneous phasor database automatic generation method comprises the following steps:

[0009] Based on the pre-established station area distributed heterogeneous data capability description semantic information, a database table is constructed, wherein the station area distributed heterogeneous data comprises station area distributed load identification result data;

[0010] The station area real-time data of the access sub-station is parsed, and the parsed station area real-time data and the station area distributed load identification result data constitute station area heterogeneous phasor real-time data;

[0011] The station area heterogeneous phasor real-time data is divided into data items and encoded, the encoded station area heterogeneous phasor real-time data is matched to different cache structures based on the data encoding rule, and then is written into the database table in batches and in parallel, thereby generating the station area heterogeneous phasor database.

[0012] Further, the station area distributed heterogeneous data further comprises power frequency synchronous phasor measurement data;

[0013] The establishment of the station area distributed heterogeneous data capability description semantic information comprises the construction of the power frequency synchronous phasor measurement data capability description semantic information and the construction of the station area distributed load identification result data capability description semantic information, and specifically as follows:

[0014] The construction of the power frequency synchronous phasor measurement data capability description semantic information is specifically as follows: the power frequency synchronous phasor measurement data capability description semantic information is constructed, and the semantics of the power frequency synchronous phasor measurement data comprises the channel name, the conversion factor and the current and voltage types of the complete fundamental phasor and analog quantity measurement data measurement point;

[0015] The construction of the station area distributed load identification result data capability description semantic information is specifically: constructing station area distributed load identification result data capability description semantic information, and the semantics of the station area distributed load identification result data includes motor proportion, stator reactance, rotor resistance and rotor inertia time constant.

[0016] Further, the constructing a database table based on the pre-established station area distributed heterogeneous data capability description semantic information includes:

[0017] Defining data information of devices within a station area based on the pre-established station area distributed heterogeneous data capability description semantic information, and generating a heterogeneous data capability description semantic file through the defined data information;

[0018] Extracting phasor channel semantic data and analog data channel semantic data in the heterogeneous data capability description semantic file respectively, constructing the measuring point information of the database table, and completing the database table construction.

[0019] Further, the parsing of the station area real-time data of the accessed substation includes:

[0020] The station area real-time data of the accessed substation is binary stream data, the data parsing semantic structure of the binary stream data is defined according to the station area distributed heterogeneous data capability description semantic, the position of the station area real-time data in the database table is located in a position offset manner, and then the binary stream data is converted into real-time data values according to the data parsing semantic structure, and the parsing is completed.

[0021] Further, the dividing data items and encoding of the station area heterogeneous phasor real-time data includes:

[0022] The station area heterogeneous phasor real-time data is divided into corresponding data items based on the station area distributed heterogeneous data capability description semantic information;

[0023] A unique encoding item is generated for each data item corresponding to the data measuring point name, data type, data attribute and data item type, and the data item encoding is completed.

[0024] Further, the matching of the encoded station area heterogeneous phasor real-time data to different cache structures based on the data encoding rule, and then writing into the database table in batches in parallel, includes:

[0025] The encoded station area real-time data and the label point stored in the database table are established in a corresponding mapping relationship through the station area distributed heterogeneous data capability description semantic, and the encoded station area real-time data is matched and written into the cache structure in batches according to the mapping relationship;

[0026] The station area heterogeneous phasor real-time data written into the cache structure is written into the database table in multiple batches in parallel, and the station area heterogeneous phasor database is generated.

[0027] Further, after the generation of the station domain heterogeneous phasor database, the method further comprises:

[0028] The generated station domain heterogeneous phasor database is encapsulated with a service interface, through which station domain local query and master station remote query are realized.

[0029] The station domain local query comprises: the station domain directly queries the station domain heterogeneous phasor database through the service interface to realize station domain local data interaction.

[0030] The master station remote query comprises: when the station end of the substation receives a remote query command of the master station, the station end searches in the database to obtain the data required by the master station to query; the searched data is read and compressed in a streaming serialization manner to form a unified serialized compressed data stream, which is then sent to the master station to realize real-time data interaction between the substation and the master station.

[0031] The station domain heterogeneous phasor database automatic generation system comprises:

[0032] A database table construction module is configured to construct a database table based on pre-established station domain distributed heterogeneous data capability description semantic information, wherein the station domain distributed heterogeneous data comprises station domain distributed load identification result data.

[0033] An analysis module is configured to analyze the station domain real-time data accessed by the substation, and the analyzed station domain real-time data and the station domain distributed load identification result data form station domain heterogeneous phasor real-time data.

[0034] A database generation module is configured to divide data items of the station domain heterogeneous phasor real-time data and encode the station domain heterogeneous phasor real-time data, match the encoded station domain heterogeneous phasor real-time data to different cache structures based on a data encoding rule, and write the station domain heterogeneous phasor real-time data in batches and in parallel into the database table to generate the station domain heterogeneous phasor database.

[0035] Further, the station domain distributed heterogeneous data further comprises power frequency synchronous phasor measurement data.

[0036] The establishment of the station domain distributed heterogeneous data capability description semantic information comprises construction of power frequency synchronous phasor measurement data capability description semantic information and construction of station domain distributed load identification result data capability description semantic information, and specifically as follows:

[0037] The construction of the power frequency synchronous phasor measurement data capability description semantic information specifically comprises: constructing power frequency synchronous phasor measurement data capability description semantic information, wherein the semantics of the power frequency synchronous phasor measurement data comprises a complete fundamental phasor and channel names, conversion factors and current and voltage types of analog quantity measurement data points.

[0038] The construction of the station area distributed load identification result data capability description semantic information is specifically: constructing station area distributed load identification result data capability description semantic information, and the semantics of the station area distributed load identification result data includes motor proportion, stator reactance, rotor resistance, and rotor inertia time constant.

[0039] Further, the constructing a database table based on the pre-established station area distributed heterogeneous data capability description semantic information includes:

[0040] Defining data information of devices within a station area based on the pre-established station area distributed heterogeneous data capability description semantic information, and generating a heterogeneous data capability description semantic file through the defined data information;

[0041] Extracting phasor channel semantic data and analog data channel semantic data in the heterogeneous data capability description semantic file respectively, constructing the measuring point information of the database table, and completing the database table construction.

[0042] Further, the parsing of the station area real-time data of the accessed substation includes:

[0043] The station area real-time data of the accessed substation is binary stream data, the data parsing semantic structure of the binary stream data is defined according to the station area distributed heterogeneous data capability description semantic, the position of the station area real-time data in the database table is located in a position offset manner, and then the binary stream data is converted into real-time data values according to the data parsing semantic structure, and the parsing is completed.

[0044] Further, the dividing data items and encoding of the station area heterogeneous phasor real-time data includes:

[0045] The station area heterogeneous phasor real-time data is divided into corresponding data items based on the station area distributed heterogeneous data capability description semantic information;

[0046] A unique encoding item is generated for each data item corresponding to the data measuring point name, data type, data attribute, and data item type, and the data item encoding is completed;

[0047] The encoded station area heterogeneous phasor real-time data is matched to different cache structures based on the data encoding rule, and then written into the database table in batches in parallel, including:

[0048] The encoded station area real-time data is matched to the corresponding mapping relationship with the label point stored in the database table through the station area distributed heterogeneous data capability description semantic, and the encoded station area real-time data is matched and written into the cache structure in batches according to the mapping relationship;

[0049] The station area heterogeneous phasor real-time data written into the cache structure is written into the database table in multiple batches in parallel, and the station area heterogeneous phasor database is generated.

[0050] Further, after the generation of the station domain heterogeneous phasor database, the method further comprises:

[0051] The generated station domain heterogeneous phasor database is encapsulated with a service interface, through which station domain local query and master station remote query are realized.

[0052] The station domain local query comprises: the station domain directly queries the station domain heterogeneous phasor database through the service interface to realize station domain local data interaction.

[0053] The master station remote query comprises: when the station end of the substation receives a remote query command of the master station, the station end searches in the database to obtain the data required by the master station to be queried; the searched data is read and compressed in a streaming serialization manner to form a unified serialized compressed data stream, which is then sent to the master station, so as to realize real-time data interaction between the substation and the master station.

[0054] A computer device comprises a memory, a processor, and a computer program stored in the memory and executable on the processor, and the processor realizes the steps of the station domain heterogeneous phasor database automatic generation method when executing the computer program.

[0055] A computer readable storage medium stores a computer program, and the computer program realizes the steps of the station domain heterogeneous phasor database automatic generation method when executed by a processor.

[0056] Compared with the prior art, the present application has the following beneficial technical effects:

[0057] The present application designs a station domain heterogeneous phasor database automatic generation method, which aims at the challenge of real-time performance and reliability of the communication and data processing system caused by the access of massive wide-area high-frequency PMU data in the prior art, and fills the gap and defects of real-time communication optimization and reliable processing technology for wide-area massive data access. In the existing power system, based on the station domain distributed heterogeneous data information model, the idea of replacing the relational database with the time series database is used to automatically build the database of heterogeneous phasor data. The massive station domain real-time data is parsed first, and the parsed station domain real-time data and the station domain distributed load identification result data constitute the station domain heterogeneous phasor real-time data. The station domain heterogeneous phasor real-time data is coded, and the coded data forms a one-to-one mapping relationship with the data in the database. The coded data can be automatically written in batches to the cache structure in front of the database through the station domain distributed heterogeneous data capability description semantic information, and then written in batches from the cache structure to the database in parallel, so as to realize stable real-time storage of massive heterogeneous phasor data and solve the problems of large data volume, high concurrency and low efficiency in the storage of massive heterogeneous phasor data.

[0058] Further, the application can be directly accessed and inquired in the station area, and when the master station needs to inquire data, the corresponding access data can be quickly obtained according to the inquiry command, the corresponding data information is automatically searched and read and sent to the master station for access, the local inquiry of heterogeneous phasor data and the interactive access of heterogeneous phasor data of the master and sub-stations are realized, the real-time interaction and application analysis of the analysis result in the local and the master station are met, and the safety and stability of power grid operation control are improved. BRIEF DESCRIPTION OF DRAWINGS

[0059] The accompanying drawings are included to provide a further understanding of the application, and are incorporated in and constitute a part of this application. The schematic embodiments of the application and their descriptions are used to explain the application, and do not constitute an improper limitation on the application.

[0060] Figure 1 It is a real-time data analysis framework of the application;

[0061] Figure 2 It is a real-time data analysis flowchart of the application;

[0062] Figure 3 It is a data processing architecture based on coding and caching of the application;

[0063] Figure 4 It is a data caching principle schematic diagram based on coding of the application;

[0064] Figure 5 It is a method flowchart of the application;

[0065] Figure 6 It is a system structure diagram of the application. DETAILED DESCRIPTION

[0066] The application will be further described in detail below by combining the accompanying drawings and specific embodiments.

[0067] In order to make the personnel in the technical field better understand the application scheme, the technical scheme in the embodiments of the application will be clearly and completely described below by combining the drawings in the embodiments of the application. Obviously, the described embodiments are only a part of the embodiments of the application, but not all the embodiments. Based on the embodiments in the application, all other embodiments obtained by the personnel in the field without creative labor should belong to the protection scope of the application.

[0068] It should be noted that the terms "first", "second", and the like in the description and in the claims of the present application and in the above-described drawings are used only for distinguishing between similar objects and do not necessarily have to describe a specific order or sequence. It is to be understood that the data thus used can be interchanged, where appropriate, so that the embodiments of the present application described herein can be carried out in a different order than the one illustrated or described herein. Furthermore, the terms "comprising" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, processes, methods, systems, products, or devices that include a series of steps or units are not necessarily limited to those steps or units clearly listed, but can include other steps or units not clearly listed or inherent to these processes, methods, products, or devices.

[0069] Embodiment one

[0070] The present application provides a station area heterogeneous phasor database automatic generation method, see Figure 5 , comprising the following steps:

[0071] Based on the pre-established station area distributed heterogeneous data capability description semantic information to construct a database table, wherein the station area distributed heterogeneous data includes station area distributed load identification result data and power frequency synchronous phasor measurement data;

[0072] The station area real-time data of the access substation is parsed, and the parsed station area real-time data and the station area distributed load identification result data constitute the station area heterogeneous phasor real-time data;

[0073] The station area heterogeneous phasor real-time data is divided into data items and encoded, and the encoded station area heterogeneous phasor real-time data is matched to different cache structures based on the data encoding rule, and then is written into the database table in batches and in parallel, to generate the station area heterogeneous phasor database.

[0074] The application designs a station area heterogeneous phasor database automatic generation method, aiming at the challenge of real-time performance and reliability of communication and data processing system caused by massive wide-area high-frequency PMU data access in the prior art, and the blank and defect of real-time communication optimization and reliable processing technology related to wide-area massive data access, based on the semantic information of station area distributed heterogeneous data capability description in the existing power system, the idea of replacing the relational database with the time series database is used to automatically build the database of heterogeneous data, the massive station area real-time data accessed is parsed first, the parsed station area real-time data and the station area distributed load identification result data constitute the station area heterogeneous phasor real-time data and are coded, the coded data form a one-to-one mapping relationship with the data in the database, the coded data can be automatically batch-configured and written into the cache structure in front of the database through the station area distributed heterogeneous data information model, and then the data are written into the database in batches in parallel from the cache structure, so that the stable real-time data storage of massive data is completed, and the problems of large data volume, high concurrency and low efficiency in massive data storage are well solved.

[0075] Specifically, the station area heterogeneous phasor database automatic generation method provided by the application has the following specific steps in the implementation process:

[0076] 1. Station area distributed heterogeneous phasor data capability description semantic information definition

[0077] The station area distributed heterogeneous phasor data includes power frequency synchronous phasor measurement data and station area distributed load identification result data.

[0078] The power frequency synchronous phasor measurement data capability description semantic information is constructed according to the GB / T 26865.2 standard, as shown in Table 1, and the capability description semantic of the power frequency synchronous phasor measurement data includes the channel name, conversion factor and current and voltage type of the complete fundamental phasor and analog measurement data measurement point. The phasor includes the A, B and C three-phase and positive sequence component measurement data information of voltage and current, and the analog quantity includes the active power, reactive power, frequency and frequency change rate measurement data information.

[0079] Table 1: Power frequency synchronous phasor capability description semantic parameter name

[0080] Serial number Measurement data information Measurement designation 1 Voltage fundamental phasor U1V, UAV, UBV, UCV 2 Current fundamental phasor I1V, IAV, IBV, ICV 3 Active 00P 4 Reactive 00Q 5 Frequency 0DF 6 Rate of change of frequency DFT

[0081] Wherein, as shown in Table 2, the station area distributed load identification result data includes motor proportion, stator reactance, rotor resistance and rotor inertia time constant. Based on the GB / T 26865.2 standard, the station area distributed load identification result data description capability description semantic information is established, taking the virtual PMU device of the power system as an example, the PMU device is an important device to ensure the safe operation of the power grid, the synchronous phasor measurement device (PMU) is installed in the important substation and power plant of the power system, the real-time dynamic monitoring system of the power system is constructed, the virtual PMU device is defined by the station area distributed heterogeneous data capability description semantic information, the IDCODE of the virtual PMU device is: Loadinfo, the virtual PMU device contains one or more interval load identification result information of the whole station. The virtual PMU device contains two segment information of phasor and analog quantity, the load identification result information is defined in the analog quantity, and the defined information is shown in Table 2. The defined load identification result information and the capability description semantic information of the whole station form the heterogeneous data capability description semantic file STATION_CFG1 of the station area.

[0082] Table 2 Load parameter identification result parameter measurement point information

[0083]

[0084] 2. Automatically constructing database table based on heterogeneous data capability description semantic file

[0085] Based on the heterogeneous data capability description semantic file STATION_CFG1, the database table measurement point information is constructed. The heterogeneous data capability description semantic file STATION_CFG1 of the station area is loaded by using the streaming method, the phasor channel configuration data and the analog quantity channel configuration data are extracted respectively, and the measurement point information of the database table is constructed.

[0086] Wherein, the phasor channel configuration data respectively establishes two measurement points of amplitude and phase angle, the label point name of the amplitude measurement point is the phasor channel plus the suffix name amplitude of the amplitude, and the label point name of the phase angle measurement point is the phasor channel plus the suffix name angle of the angle.

[0087] Wherein, the measurement point information generated by STATION_CFG1 includes PMU device table and load identification table. Each PMU device establishes a device table information, and the name of each device table is the IDCODE of the PMU device. The virtual load identification device establishes an independent table information, and the table name is Loadinfo.

[0088] Database table creation. The database table needs to be verified and compared with the information in the STATION_CFG1 file to check whether the information is consistent, and the verification is divided into two parts of the database table information and the data measurement point in the database table.

[0089] First, based on the name of the database table to check if the table is added or deleted changes, if the check is a new table, will be created in the database table, if the check is deleted table, will be placed in the recycle bin in the database table, the table into the recycle bin can be restored as needed, but also can be completely deleted.

[0090] The database table contains the name, description and unique ID, the name and ID have uniqueness and match each other. The naming rules of the database table are: 1) the first character must be one of the 26 letters or one of the digits 0-9; 2) control characters such as line feed or tab are not allowed; 3) the following special characters are not allowed: '*', '?', ';', '{', '}'; 4) the table name length is maximized to 128.

[0091] Secondly, based on the name of each table in the database, the measurement point is checked to check if the measurement point under the table is added, deleted or modified. The measurement point is represented by the label point, and the label point of each table is established.

[0092] The label point table is unique. The label point structure is created, and each measurement point label point contains the following attributes: name, description, unit, value type, upper limit of data, lower limit of data.

[0093] The label point name is defined as follows: the amplitude of the phase quantity: phase channel name_amplitude, the phase angle of the phase quantity: phase channel name_angle, the analog quantity: analog channel name, and the switching quantity: switching channel name. The length of the database label point name is not more than 128 characters.

[0094] The label point description is consistent with the label point name; the engineering unit is voltage: kV, current kA, active: MW, reactive: Mvar, 0DF: Hz, speed: r / min, power angle: radian.

[0095] The value type: the data of the phase quantity and the analog quantity is float type, and the data type of the switching quantity is bool type.

[0096] The newly added label point is established according to the measurement point channel name, data type and data unit of the heterogeneous data capability description semantic file STATION_CFG1; the deleted label point is moved to the recycle bin, and the label point in the recycle bin can be restored or completely deleted; the modified label point refers to any attribute change of the label point, and the modified label point is updated based on the heterogeneous data description capability information model file STATION_CFG1.

[0097] 3. Heterogeneous data analysis and organization

[0098] The high-density power frequency synchronous phasor PMU data and the disturbance type load parameter identification result data are defined as multi-source heterogeneous data.

[0099] The PMU real-time data 100 frames / s of the station area is 10 ms interval data with stability and time sequence. The distributed load identification function module starts the load identification function to generate load identification result data when the power grid disturbance is monitored. The load identification result data has randomness and non-time sequence.

[0100] In order to realize the load identification result data and the PMU data with the same time scale, the high and low density data are organized into time sequence data, and the load identification result data is generated with a time scale of 10 ms to assign a time tag.

[0101] The station area real-time data message is binary stream data, which needs to be parsed, extracted, stored and analyzed. The semantic information of the name, position in the binary stream, occupied bytes, data occurrence time and the like of the real-time data is matched with the detailed information description in the heterogeneous data capability description semantic file STATION_CFG1. Based on the semantic configuration in the heterogeneous data capability description semantic file STATION_CFG1, the data parsing semantic structure of the binary stream data is constructed, the position of the data stream is quickly located by using the position offset method, and then the binary stream data is converted into real-time data value according to the semantic structure.

[0102] The semantic definition of the binary stream in the heterogeneous data description capability description semantic file STATION_CFG1 is mainly as follows: the semantic information of the substation and the real-time data provides information and parameters, the content includes all the output quantities that the substation can accommodate, all the fields should have fixed length, no delimiter is used, and the field definition of the semantic information is as shown in Table 3.

[0103] Table 3 Field definition of the heterogeneous data description capability description semantic file

[0104]

[0105] According to the semantic information of the distributed heterogeneous data capability description of the station area, the parsing semantic structure of the phasor data, the analog quantity data and the switching quantity data is defined. The parsing semantic structure is constructed in units of devices, each device establishes a phasor data parsing pool, an analog quantity data parsing pool and a switching quantity data parsing pool, and each parsing pool establishes a data parsing block for each channel. The data offset value, data length, conversion factor, channel name and other data semantic information of the channel are recorded in detail in each data parsing block. The value of the data is quickly extracted by using the byte stream offset mapping method when the data is extracted. The schematic diagram of the parsing semantic structure is shown in Figure 1 .

[0106] The flow of real-time data parsing is mainly as Figure 2As shown:

[0107] a. The received real-time data is verified by signature, and the legal message is stored in the message buffer, otherwise the message is discarded;

[0108] b. According to the pre-defined analysis structure, the phasor analysis pool address, analog quantity analysis pool address and switch quantity analysis pool address are located respectively to obtain the structure of the analysis pool;

[0109] c. In each analysis pool, the real-time data stream and the time tag of the data stream are extracted according to the offset of each channel in the real-time data stream;

[0110] d. The real-time data value is obtained by converting the phasor, analog quantity and switch quantity data respectively;

[0111] e. The corresponding data time tag is extracted according to the message time tag.

[0112] 4. High-concurrency non-blocking data encoding-based mass data warehousing

[0113] Define data set construction rules. That is, divide into items in units of devices, and one PMU device corresponds to one item. The virtual device of the load parameter identification result data establishes a corresponding load identification item, and each item establishes a data set in units of data measuring points.

[0114] The parsed data is divided into corresponding data items based on the heterogeneous data capability description semantic file STATION_CFG1 configuration, and each data item generates a corresponding encoding item through data encoding rules.

[0115] Among them, the method for constructing data item encoding is to generate unique feature encoding for each data item corresponding to data measuring point name, data type, data attribute, data item type, etc. In the system, these data item encodings and the label points stored in the database are automatically configured to establish a strict one-to-one mapping relationship, realize the association of the encoding item to the table and field that the data item needs to store, and then form the corresponding cache structure with these configuration information. Data is matched to different cache structures respectively, and based on the way of separating items and data sets, the parsed PMU data and load identification result data are batched and concurrently warehoused, greatly improving the warehousing efficiency.

[0116] For multi-data item and cross-table storage data model scenarios, the encoding items of data and the specific fields of database tables establish corresponding correspondence, the data interaction between modules uses data coding for interaction, the application layer and the database layer are decoupled, and the database storage structure can be changed without reflecting to the application layer. Through encoding mapping, the storage and reconstruction of the data model in the memory are supported, the scalability of the data model mapping is supported, and the data items and data models added later can be automatically mapped through the data coding mapping technology. The application module does not need to consider which specific data item exists in a certain field of a data table, greatly simplifying the program writing work, and improving the maintainability, scalability and reusability of the system. The specific technical architecture is shown in Figure 3 .

[0117] For the characteristics of station area phasor time series data, such as multiple data items, large data volume, and inconsistent data density, the batch data warehousing processing module of the system uses a data caching mechanism based on data item coding, maps the data table structure to the memory, and saves the corresponding data index and data type basic information. The data coding module converts the collected data into coding items and numerical values, calculates the offset according to the coding items through the index algorithm, finds the data area where the numerical value is stored, and finally stores the numerical value in the corresponding data area through the write data operation. The data warehousing module quickly converts the data value into the corresponding storage structure through the read data operation according to the index and data type basic information, thereby improving the database warehousing efficiency and reducing the number of database IO operations. The specific principle is shown in Figure 4 .

[0118] For the characteristics of million data fast warehousing, such as large data volume, high concurrency, and short time, if 100 million data are inserted into the database one by one, the efficiency is low. The data warehousing module uses a batch mode to write real-time mass time series data into the cache and write it into the database in multiple batches in parallel. At the same time, the non-blocking operation and transaction high-concurrency processing technology are used, based on the compare-and-swap strategy, to identify task conflicts and avoid deadlock operations. The data is read from the message queue to realize high-concurrency task non-blocking data warehousing, improve the high-concurrency performance of real-time data write operation, and use thread pool and connection pool and other multi-thread sharing technologies to reuse connections to reduce the time of creating and releasing connections to improve performance, avoid transaction processing performance loss caused by data processing task concurrency, connection, request and switching, and meet the requirements of single-node million-user data warehousing high-concurrency operation.

[0119] 5. Station area heterogeneous phasor data access technology

[0120] In order to realize station area local data access and main substation cooperative interaction, facilitate local and main station to review and query distributed processing data of the station end, the station area real-time data after warehousing is uniformly encapsulated based on a time axis service interface, local query directly queries data through the service interface, when remote query, the station end receives a main station query command, the station end calls a query interface to upload data information in a time range of the station area to the main station, and the main station reviews and uses.

[0121] The distributed processing data stored in the station area is identified by a time range, and the data is uniformly identified with a time label.

[0122] When the station area database queries data, the query start time is used as a time axis index start point, the query end time is used as a time axis index end point, and a time offset is used between the index start point and the index end point on the time axis for retrieval.

[0123] The review service interface reads and compresses the station area database data in a streaming serialization manner, forms uniform serialized compressed data stream, and uploads the data stream to the main station.

[0124] The application can directly review and query in the station area, and when the main station needs to query data, the corresponding data can be quickly obtained according to the query command, the corresponding data information is uploaded to the main station, and the main station reviews and uses the data, realizes local review of heterogeneous phasor data and interactive access of main substation heterogeneous phasor data, satisfies real-time interaction and application analysis of analysis results in the local and the main station, and improves the safety and stability of power grid operation control.

[0125] Embodiment two

[0126] The application further provides a station area database automatic generation system, which is shown in Figure 6 , and includes a database table construction module, an analysis module and a database generation module.

[0127] The database table construction module is used for constructing a database table based on pre-established station area distributed heterogeneous data capability description semantic information, wherein the station area distributed heterogeneous data includes station area distributed load identification result data.

[0128] The station area distributed heterogeneous data further includes power frequency synchronous phasor measurement data.

[0129] The establishment of the station area distributed heterogeneous data capability description semantic information includes construction of power frequency synchronous phasor measurement data capability description semantic information and construction of station area distributed load identification result data capability description semantic information, and specifically as follows.

[0130] The construction of the power frequency synchronous phasor measurement data capability description semantic information specifically is: constructing power frequency synchronous phasor measurement data capability description semantic information, and the semantic of the power frequency synchronous phasor measurement data includes a complete fundamental phasor and analog quantity measurement data point channel name, conversion factor and current voltage type;

[0131] The construction of the station area distributed load identification result data capability description semantic information specifically is: constructing station area distributed load identification result data capability description semantic information, and the semantic of the station area distributed load identification result data includes motor proportion, stator reactance, rotor resistance and rotor inertia time constant.

[0132] The construction of the database table based on the pre-established station area distributed heterogeneous data capability description semantic information includes:

[0133] Defining data information of devices in the station area based on the pre-established station area distributed heterogeneous data capability description semantic information, and generating a heterogeneous data capability description semantic file through the defined data information;

[0134] Extracting phasor channel semantic data and analog data channel semantic data in the heterogeneous data capability description semantic file respectively, constructing the measuring point information of the database table, and completing the construction of the database table.

[0135] The parsing module is configured to parse station area real-time data of an accessed substation, and the parsed station area real-time data and station area distributed load identification result data form station area heterogeneous phasor real-time data.

[0136] The parsing of the station area real-time data of the accessed substation includes:

[0137] The station area real-time data of the accessed substation is binary stream data, the data parsing semantic structure of the binary stream data is defined according to the station area distributed heterogeneous data capability description semantic, the position of the station area real-time data in the database table is located in a position offset manner, and then the binary stream data is converted into real-time data values according to the data parsing semantic structure, so as to complete the parsing.

[0138] The division of the station area heterogeneous phasor real-time data into data items and encoding includes:

[0139] The station area heterogeneous phasor real-time data is divided into corresponding data items based on the station area distributed heterogeneous data capability description semantic information;

[0140] The data point name, data type, data attribute and data item type corresponding to each data item are generated into a unique coding item, and data item coding is completed.

[0141] The coded station area heterogeneous phasor real-time data is matched to different cache structures based on a data coding rule, and then is written into a database table in batches in parallel.

[0142] The coded station area real-time data is mapped to a corresponding label point in the database table through a station area distributed heterogeneous data capability description semantic, and the coded station area real-time data is matched and written into the cache structure in batches according to the mapping relationship.

[0143] The station area heterogeneous phasor real-time data written into the cache structure is written into the database table in batches in parallel, and a station area heterogeneous phasor database is generated.

[0144] The database generation module is used for dividing data items and coding the station area heterogeneous phasor real-time data, matching the coded station area heterogeneous phasor real-time data to different cache structures based on a data coding rule, and then writing the coded station area heterogeneous phasor real-time data into a database table in batches in parallel to generate a station area heterogeneous phasor database.

[0145] After the station area heterogeneous phasor database is generated, the following steps are further included.

[0146] The generated station area heterogeneous phasor database is encapsulated with a service interface, and station area local query and main station remote query are realized through the service interface.

[0147] The station area local query includes that the station area directly queries and obtains data of the station area heterogeneous phasor database through the service interface to realize station area local data interaction.

[0148] The main station remote query includes that when the station end of the substation receives a remote query command of the main station, the station end searches in the database to obtain data required to be queried in the main station, reads and compresses data content in a streaming serialization manner, forms a unified serialized compressed data stream, and then uploads the data stream to the main station to realize real-time data interaction between the substation and the main station.

[0149] The present application constructs a heterogeneous information database of distributed analysis result data and PMU measurement data in a station area, supports distributed state perception of a power grid, avoids problems such as that an existing WAMS system cannot meet 100Hz high-frequency data transmission and that main station centralized analysis resources are insufficient, improves real-time performance of power grid stability control through main substation cooperation and interaction, supports analysis and application of new features of a new power system, and improves safety and stability of power grid operation.

[0150] Those skilled in the art will appreciate that embodiments of the application can be devised for a method, a system, or a computer program product. Accordingly, the present application can be embodied in the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application can take the form of a computer program product on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROMs, optical storage devices, etc.) embodying computer readable program code.

[0151] The present application is described in reference to the flowchart and / or block diagrams of the method, apparatus (system) and computer program product according to embodiments of the application. It will be understood that each block of the flowchart and / or block diagrams, and combinations of blocks in the flowchart and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart and / or block diagram block or blocks. Figure 1 one or more functions specified in the flowchart and / or block diagram block or blocks. Figure 1 one or more functions specified in the flowchart and / or block diagram block or blocks.

[0152] These computer program instructions can also be stored in a computer- readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instructions which implement the function specified in the flowchart and / or block diagram block or blocks. Figure 1 one or more functions specified in the flowchart and / or block diagram block or blocks. Figure 1 one or more functions specified in the flowchart and / or block diagram block or blocks.

[0153] These computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart and / or block diagram block or blocks. Figure 1 one or more functions specified in the flowchart and / or block diagram block or blocks. Figure 1 one or more functions specified in the flowchart and / or block diagram block or blocks.

[0154] Finally, it should be noted that the above-described embodiments are merely intended for describing the technical solutions of the present application, but not to limit the scope of protection of the present application. Although the present application has been described in detail with reference to the above embodiments, those skilled in the art should understand that: after reading the present application, those skilled in the art can make various changes, modifications or equivalent replacements to the specific embodiments of the present application, but these changes, modifications or equivalent replacements are all within the scope of protection of the claims of the present application.

Claims

1. A station-area heterogeneous phasor database automatic generation method, characterized in that, The method comprises the following steps: constructing a database table based on pre-established station area distributed heterogeneous data capability description semantic information, wherein the station area distributed heterogeneous data comprises station area distributed load identification result data; analyzing station area real-time data of an access substation, and combining the analyzed station area real-time data with the station area distributed load identification result data to form station area heterogeneous phasor real-time data; dividing the station area heterogeneous phasor real-time data into data items and encoding, matching the encoded station area heterogeneous phasor real-time data to different cache structures based on a data encoding rule, and writing the data into the database table in batches in parallel to generate a station area heterogeneous phasor database.

2. The station-area heterogeneous phasor database automatic generation method according to claim 1, characterized in that, The station area distributed heterogeneous data further comprises power frequency synchronous phasor measurement data. The establishment of the station area distributed heterogeneous data capability description semantic information comprises construction of power frequency synchronous phasor measurement data capability description semantic information and construction of station area distributed load identification result data capability description semantic information, and specifically as follows: The construction of the power frequency synchronous phasor measurement data capability description semantic information specifically comprises: constructing power frequency synchronous phasor measurement data capability description semantic information, and the semantics of the power frequency synchronous phasor measurement data comprises a complete fundamental phasor and channel names, conversion factors and current and voltage types of analog quantity measurement data points; The construction of the station area distributed load identification result data capability description semantic information specifically comprises: constructing station area distributed load identification result data capability description semantic information, and the semantics of the station area distributed load identification result data comprises motor proportion, stator reactance, rotor resistance and rotor inertia time constant.

3. The station-area heterogeneous phasor database automatic generation method of claim 1, wherein, The construction of the database table based on the pre-established station area distributed heterogeneous data capability description semantic information comprises: defining data information of devices within a station area based on the pre-established station area distributed heterogeneous data capability description semantic information, and generating a heterogeneous data capability description semantic file through the defined data information; extracting phasor channel semantic data and analog data channel semantic data in the heterogeneous data capability description semantic file respectively, constructing measurement point information of the database table, and completing construction of the database table.

4. The method of claim 1, wherein, The analysis of the station area real-time data of the access substation comprises: The station area real-time data of the access substation is binary stream data, the data analysis semantic structure of the binary stream data is defined according to the station area distributed heterogeneous data capability description semantic, the position of the station area real-time data in the database table is located in a position offset manner, the binary stream data is converted into real-time data values according to the data analysis semantic structure, and the analysis is completed.

5. The station-area heterogeneous phasor database automatic generation method of claim 1, wherein, The division of the station area heterogeneous phasor real-time data into data items and encoding comprises: dividing the station area heterogeneous phasor real-time data into corresponding data items based on the station area distributed heterogeneous data capability description semantic information; generating a unique encoding item for the data measurement point name, data type, data attribute and data item type of each data item, and completing data item encoding.

6. The station-area heterogeneous phasor database automatic generation method of claim 5, wherein, The matching of the encoded station area heterogeneous phasor real-time data to different cache structures based on the data encoding rule, and the writing of the data into the database table in batches in parallel comprises: The coded station area real-time data is mapped to the tag points stored in the database table by station area distributed heterogeneous data capability description semantics, and the coded station area real-time data is matched and written into the cache structure in batches according to the mapping relationship; The station area heterogeneous phasor real-time data written into the cache structure is written into the database table in multiple batches in parallel to generate a station area heterogeneous phasor database.

7. The station-area heterogeneous phasor database automatic generation method of claim 1, wherein, After the station area heterogeneous phasor database is generated, the following steps are further included: The generated station area heterogeneous phasor database is encapsulated with a service interface, and station area local query and master station remote query are realized through the service interface; The station area local query includes that the station area directly queries and obtains data of the station area heterogeneous phasor database through the service interface to realize station area local data interaction; The master station remote query includes that when the station end of the substation receives a remote query command of the master station, the station end searches in the database to obtain data required to be queried in the master station; the searched data is read and compressed in a streaming serialization manner, and after a unified serialized compressed data stream is formed, the data stream is sent to the master station to realize real-time data interaction between the substation and the master station.

8. A station-area heterogeneous phasor database auto-generation system, characterized by, The database table construction module is configured to construct a database table based on pre-established station area distributed heterogeneous data capability description semantic information, wherein the station area distributed heterogeneous data includes station area distributed load identification result data; The analysis module is configured to analyze station area real-time data accessed by the substation, and the analyzed station area real-time data and the station area distributed load identification result data form station area heterogeneous phasor real-time data; The database generation module is configured to divide data items of the station area heterogeneous phasor real-time data and encode the station area heterogeneous phasor real-time data, match the encoded station area heterogeneous phasor real-time data to different cache structures based on a data encoding rule, and write the station area heterogeneous phasor real-time data into the database table in batches in parallel to generate a station area heterogeneous phasor database. The station area distributed heterogeneous data further includes power frequency synchronous phasor measurement data; 9. The zonal heterogeneous phasor database automatic generation system according to claim 8, characterized in that, The establishment of the station area distributed heterogeneous data capability description semantic information includes construction of power frequency synchronous phasor measurement data capability description semantic information and construction of station area distributed load identification result data capability description semantic information, and specifically as follows: The construction of the power frequency synchronous phasor measurement data capability description semantic information specifically includes: constructing power frequency synchronous phasor measurement data capability description semantic information, and the semantics of the power frequency synchronous phasor measurement data includes a complete fundamental phasor, and channel names, conversion factors, and current and voltage types of analog quantity measurement data points; The construction of the station area distributed load identification result data capability description semantic information specifically includes: constructing station area distributed load identification result data capability description semantic information, and the semantics of the station area distributed load identification result data includes motor proportion, stator reactance, rotor resistance, and rotor inertia time constant. The construction of the database table based on the pre-established station area distributed heterogeneous data capability description semantic information includes:

10. The station-area heterogeneous phasor database auto-generation system of claim 8, wherein, Data information of devices in the station area is defined based on the pre-established station area distributed heterogeneous data capability description semantic information, and a heterogeneous data capability description semantic file is generated through the defined data information; ​ The phasor channel semantic data and the analog data channel semantic data are extracted respectively in the heterogeneous data capability description semantic file, and the measuring point information of the database table is constructed, and the database table construction is completed.

11. The station-area heterogeneous phasor database automatic generation system of claim 8, wherein, The parsing of the station area real-time data of the access substation includes: The station area real-time data of the access substation is binary stream data, the data parsing semantic structure of the binary stream data is defined according to the station area distributed heterogeneous data capability description semantic, the position of the station area real-time data in the database table is located by using the position offset, and then the binary stream data is converted into real-time data values according to the data parsing semantic structure, and the parsing is completed.

12. The station-area heterogeneous phasor database automatic generation system of claim 8, wherein, The division of the station area heterogeneous phasor real-time data into data items and the encoding include: The station area heterogeneous phasor real-time data is divided into corresponding data items based on the station area distributed heterogeneous data capability description semantic information; The data measuring point name, the data type, the data attribute and the data item type of each data item are generated into a unique encoding item, and the data item encoding is completed; The encoded station area heterogeneous phasor real-time data is matched to different cache structures based on the data encoding rule, and then is written into the database table in batches in parallel, and includes: The encoded station area real-time data is matched to the cache structure based on the station area distributed heterogeneous data capability description semantic, and the encoded station area real-time data is matched and written into the cache structure in batches according to the mapping relationship; The station area heterogeneous phasor real-time data written into the cache structure is written into the database table in parallel in multiple batches, and the station area heterogeneous phasor database is generated.

13. The station-area heterogeneous phasor database automatic generation system of claim 8, wherein, After the station area heterogeneous phasor database is generated, the following steps are further included: The generated station area heterogeneous phasor database is encapsulated with a service interface, and the station area local query and the master station remote query are realized through the service interface; The station area local query includes that the data of the station area heterogeneous phasor database is directly queried through the service interface to realize the station area local data interaction; The master station remote query includes that when the station end of the substation receives the remote query command of the master station, the station end searches in the database to obtain the data required to be queried in the master station; the searched data is read and compressed in a stream serialization manner, and the unified serialized compressed data stream is sent to the master station to realize the real-time data interaction between the substation and the master station.

14. A computer device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, The processor executes the computer program to realize the steps of the station area heterogeneous phasor database automatic generation method in any one of claims 1 to 7.

15. A computer-readable storage medium, the computer-readable storage medium storing a computer program, characterized in that, The computer program is executed by the processor to realize the steps of the station area heterogeneous phasor database automatic generation method in any one of claims 1 to 7.

Images