Broadband measurement data edge preprocessing method, system, device and storage medium

Through the edge preprocessing of broadband measurement data, the wideband harmonic, dominant component and interharmonic data are processed using the statistical rules of uniform distribution of data within the period, which solves the problem of broadband measurement data transmission and storage pressure, simplifies the power grid monitoring and analysis, and realizes the data Effective compression and secure transmission.

CN113377754BActive Publication Date: 2024-11-22CHINA ELECTRIC POWER RESEARCH INSTITUTE CO LTD +1
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
CN202110694532.X
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-06-22
Publication Date
2024-11-22
Estimated Expiration
2041-06-22

AI Technical Summary

Technical Problem

Existing broadband measurement devices are difficult to effectively process and transmit a large amount of broadband measurement data, resulting in an increase in monitoring complexity of safe and stable operation of the power grid, and an increase in transmission and storage pressure, which cannot meet the needs of modern power grid operation.

Method used

The edge preprocessing method of broadband measurement data is adopted, and by acquiring and cleaning broadband harmonics, dominant components and interharmonic data, preprocessing is performed using the statistical law of uniform distribution of data within the period, building a hierarchical structure, compressing the data volume, and using hierarchical Signature ensures the formality and immutability of data.

Benefits of technology

Preprocessing the second-level data into minutes, reducing the amount of data on the main site, reducing transmission and storage pressure, simplifying the main site analysis application, supporting further analysis applications of broadband measurement data, and ensuring the formality and security of the data.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113377754B_ABST
    Figure CN113377754B_ABST
Patent Text Reader

Abstract

The present invention provides a broadband measurement data edge preprocessing method, system, device and storage medium, the method comprising the following steps: obtaining broadband measurement data of multiple intervals and cleaning them; the broadband measurement data includes broadband harmonic data, broadband dominant component data and broadband interharmonic data; preprocessing the broadband harmonic data, broadband dominant component data and broadband interharmonic data, using the statistical law of uniform distribution of data within the period to describe the corresponding dynamic characteristics of the operation of broadband harmonic data, broadband dominant component data and broadband interharmonic data, and obtaining the result of preprocessing analysis; storing the result of preprocessing in a file in a preprocessing format. The method can simplify the analysis application of the broadband master station, which can be used by the edge side and the master station, and support the further analysis application of broadband measurement data.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention relates to a broadband measurement data edge preprocessing method, system, equipment and storage medium, and the invention relates to the technical field of power system automation. Background Art

[0002] As power electronic equipment related to new energy, DC transmission, and AC flexible transmission are widely used in all aspects of the power grid, the non-power frequency electrical quantities such as harmonics, interharmonics, and subsynchronous oscillations they bring are also increasing, endangering the safe and stable operation of the power grid. Traditional measurement devices have weak response capabilities to non-power frequency electrical quantities, and the measurement accuracy decreases when the waveform is distorted, making it difficult to meet the needs of modern power grid operation monitoring.

[0003] The broadband measurement device can cover all harmonic and interharmonic signals within the range of 2500Hz, with a frequency resolution of not less than 1Hz, which is at least 2500 times larger than the existing data volume that only focuses on 50Hz power frequency signals. Such a large amount of data transmitted to the master station in real time will put great pressure on the existing network transmission. In addition, when the power grid is running stably, a large amount of broadband measurement data is of no practical help to the monitoring and control of the master station. The master station only needs the substation to be able to transmit the required result data. Therefore, actively developing the edge preprocessing function of broadband measurement data and simplifying the information transmission to the master station have become urgent problems to be solved in the application of broadband measurement technology. Summary of the invention

[0004] In view of the problems existing in the prior art, the present invention provides a broadband measurement data edge preprocessing method, system, device and storage medium. The method can simplify the analysis application of the broadband master station for use by the edge side and the master station side, and support further analysis application of broadband measurement data.

[0005] In order to achieve the above object, the present invention adopts the following technical solutions:

[0006] A broadband measurement data edge preprocessing method comprises the following steps:

[0007] Acquire broadband measurement data of multiple intervals and clean them; the broadband measurement data includes broadband harmonic data, broadband dominant component data and broadband interharmonic data;

[0008] Preprocessing is performed on broadband harmonic data, broadband dominant component data and broadband interharmonic data, and the statistical law of uniform distribution of data within the period is used to describe the corresponding dynamic characteristics of broadband harmonic data, broadband dominant component data and broadband interharmonic data, and the results of preprocessing analysis are obtained;

[0009] Store the preprocessing results into a file in the preprocessing format.

[0010] As a further improvement of the present invention, the cleaning of broadband measurement data refers to identifying the redundant and invalid dirty data of broadband measurement data for broadband service analysis based on the broadband service function, and filtering and removing the data;

[0011] The dirty data refers to abnormal data, invalid data, duplicate data, inconsistent data, and zero-drift data.

[0012] As a further improvement of the present invention, the preprocessing of the broadband harmonic data specifically includes:

[0013] At the same time, multiple broadband measuring devices and multiple interval data in the station are processed in parallel to form the same section data. Each interval data is regarded as a unit for statistics. Each interval contains three-phase currents and three-phase voltages of A, B, and C, and a hierarchical structure of substation-device-interval-channel-harmonic processing data is constructed.

[0014] As a further improvement of the present invention, the statistical law of uniform distribution of data within a period specifically includes:

[0015] According to the configuration cycle in minutes, the maximum amplitude, minimum amplitude and average amplitude of the current and voltage amplitudes in the cycle are calculated within the cycle;

[0016] The preprocessing is performed in two dimensions: the number of occurrences and amplitudes of each harmonic. The preprocessing is performed in time periods such as hours, days, weeks, and months. The number of each harmonic and the maximum amplitude of each harmonic in each time period are analyzed respectively, and the maximum amplitudes are sorted in descending order.

[0017] According to different load types such as photovoltaic, wind power, traction, conventional, energy storage, and waste power generation, the distribution law of each harmonic amplitude and the distribution law of each harmonic phase angle are analyzed; the harmonic data law of various load types is formed, and the harmonic data change trend of the next period is predicted based on the law;

[0018] The harmonic data of different intervals of the same type of load are compared and analyzed to obtain the rules of the harmonic data between different intervals of the same type of load. The amplitude, phase angle, number of occurrences and time period of the harmonics are compared at different intervals to obtain the dynamic operating characteristics of the harmonic data at different intervals in the same station.

[0019] As a further improvement of the present invention, the preprocessing of the broadband dominant component data is specifically as follows:

[0020] Multiple broadband devices and multiple interval data of each broadband device are processed, and multiple maximum amplitudes and their corresponding frequencies of the three-phase current, voltage and power of A, B, and C are statistically obtained within the cycle time range, and a frequency-amplitude preprocessing template structure of the three-phase voltage and current of A, B, and C is constructed.

[0021] As a further improvement of the present invention, the processing specifically includes:

[0022] The broadband measurement data are sorted by using a sorting method for constructing a preprocessing tree to obtain multiple data in two dimensions of the largest number of times and the largest amplitude; the root node of the preprocessing data tree includes multiple device nodes, multiple interval nodes are established under the device nodes, and A, B, C three-phase current and voltage nodes and interval power nodes are established under the interval nodes;

[0023] Among them, the sorting method of the preprocessing tree method is:

[0024] Construct multiple tree nodes of dominant components, store all satellite data in leaf nodes, store only keywords and child pointers in internal nodes, string all leaf nodes into a linked list and traverse from beginning to end;

[0025] The dominant component data is about to be sorted when inserted into the tree node. When inserting an element, first determine whether it exists in the dominant component preprocessing tree. If not, end at the leaf node and then insert the element into the leaf node.

[0026] As a further improvement of the present invention, the preprocessing of the broadband interharmonic data includes:

[0027] At the same time, the data of multiple broadband measuring devices and multiple intervals in the station are processed in parallel, and the data of each interval is counted as a unit. Each interval contains three-phase currents and three-phase voltages of A, B, and C, and a hierarchical structure of substation-device-interval-channel-interharmonic processing data is constructed.

[0028] As a further improvement of the present invention, in the statistics of interharmonics, it is necessary to normalize the two interharmonic data frequency points sent by the broadband measurement device; specifically, the obtained precise signal frequency and amplitude are focused on the interval of center point matching, and the overall signal energy is obtained in a fixed interval of the center point frequency of the interharmonic band;

[0029] The received broadband interharmonic data are uniformly aggregated to the interval where the center frequency of the interharmonic band is located, and the center data of the interharmonic band is preprocessed by using the direct sorting method to obtain the maximum value, minimum value and average value within the period.

[0030] As a further improvement of the present invention, the direct sorting method specifically includes:

[0031] Taking the first interharmonic band center point data as the starting point, define the maximum value, minimum value and total value respectively;

[0032] Take the second data which is smaller than it and swap it, then compare it with the third one, and compare them one by one until all the data involved in the comparison are finished; after the comparison, get the smallest data value;

[0033] Similarly, the maximum data value is obtained; the average value is to add up all the data to form the sum, and then divide it by the total number to get the average value;

[0034] Get the maximum, minimum and average values ​​of the center point data of the interharmonic band within the cycle.

[0035] As a further improvement of the present invention, the preprocessed file includes preprocessed image data and preprocessed data semantic information;

[0036] The pre-processed mirror data file stores the harmonics, dominant component data and inter-harmonic data of the same section pre-processed for each cycle; the pre-processed data are stored in the file in the order of statistical time point, harmonic channel pre-processed data, dominant component data channel pre-processed data and inter-harmonic data channel pre-processed data;

[0037] The preprocessing data semantic format file includes the name and description of each device, the name and description of each interval, the name and description of each channel of harmonic preprocessing data, dominant component preprocessing data, and interharmonic preprocessing data;

[0038] The preprocessed semantic file and the mirror data file are stored in a compressed manner and hierarchical digital signatures are performed on the contents of the files.

[0039] A broadband measurement data edge preprocessing system, comprising:

[0040] An acquisition unit, used for acquiring broadband measurement data of multiple intervals and cleaning them; the broadband measurement data includes broadband harmonic data, broadband dominant component data and broadband interharmonic data;

[0041] A preprocessing unit is used to preprocess the broadband harmonic data, broadband dominant component data and broadband interharmonic data, and use the statistical law of uniform distribution of data within the period to describe the operation dynamic characteristics corresponding to the broadband harmonic data, broadband dominant component data and broadband interharmonic data to obtain the results of preprocessing analysis;

[0042] The storage unit is used to store the preprocessing result into a file in the preprocessing format.

[0043] An electronic device comprises a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the broadband measurement data edge preprocessing method when executing the computer program.

[0044] A computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the broadband measurement data edge preprocessing method are implemented.

[0045] The beneficial effects of the present invention are embodied in:

[0046] The broadband measurement data edge preprocessing method of the present invention describes the dynamic operation characteristics of the harmonic data of broadband measurement through uniform distribution statistical laws, preprocesses the second-level data into minute-level data, and reduces the amount of data sent to the main station. Avoid sending all the data of each harmonic to the main station, which puts pressure on the transmission and main station storage. In particular, through edge analysis of the preprocessing of broadband measurement data, statistical analysis of the operation laws of broadband data is performed to obtain the results of preprocessing analysis such as the dynamic characteristics of broadband data, compress the second-level data into typical minute-level data, and compress and store it at the edge. Only the preprocessing data results that the main station is concerned about are sent, which greatly reduces the amount of data transmission between the master and substations, reduces the density and storage space of the broadband measurement data of the main station in a stable state, and supports the main station to further analyze and apply the broadband measurement data.

[0047] Furthermore, a layered signature approach is used to ensure the formality and non-tamperability of the preprocessed data, effectively realizing edge preprocessing of broadband measurement data. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] Figure 1 This is a flow chart of edge preprocessing of broadband measurement data of the present invention;

[0049] Figure 2 Flow chart for sorting interharmonic center points;

[0050] Figure 3 This is a schematic diagram of the structure of a broadband measurement data edge preprocessing system according to a preferred embodiment of the present invention;

[0051] Figure 4 It is a schematic diagram of the structure of an electronic device according to a preferred embodiment of the present invention. DETAILED DESCRIPTION

[0052] The present invention will be described in detail below with reference to the accompanying drawings and in combination with embodiments. It should be noted that the embodiments and features in the embodiments of the present application can be combined with each other without conflict.

[0053] The following detailed description is an exemplary description, which is intended to provide further detailed description of the present invention. Unless otherwise specified, all technical terms used in the present invention have the same meaning as those generally understood by those skilled in the art to which the present application belongs. The terms used in the present invention are only for describing specific embodiments, and are not intended to limit exemplary embodiments according to the present invention.

[0054] With the development and utilization of large-scale new energy and the development of smart grids, the current power grid has a clear trend of power electronics. In addition, with the expansion of the scale of the power grid and the increase in transmission power, the structure and operation mode of the power grid have become more and more complex, and periodic power oscillations frequently occur, which seriously threatens the safe and stable operation of the power grid. Disturbance phenomena such as power grid harmonic interference and subsynchronous oscillation are more frequent, and the harmonics of the power grid show a trend of wide frequency domain. It is urgent to improve the monitoring ability of the power grid for different frequency disturbance components to ensure the safe operation of the power grid. At present, the focus of broadband measurement technology research is broadband measurement devices. The measurement range of broadband measurement devices is 0Hz-2500Hz, and the amount of data generated is 2500 times that of power frequency devices. However, there is still a lack of edge-side preprocessing methods for a large amount of broadband measurement data. Sending a large amount of broadband measurement data directly to the main station puts pressure on transmission and main station data storage. For the analysis of a large amount of data in the entire network, the complexity of the main station analysis and application of broadband measurement data is increased.

[0055] The existing broadband measurement devices only achieve data measurement, but do not provide edge preprocessing methods for broadband measurement data, which is not conducive to the interaction between the master and substation of broadband measurement data. Therefore, by drawing on the functional architecture of the perception layer, edge layer, and application layer of edge computing, the processing unit uses edge computing methods to achieve preprocessing and analysis of broadband measurement data, solving the bottleneck problem of a large amount of broadband measurement data transmission.

[0056] In summary, research has been carried out in the fields of broadband measurement technology and edge computing technology. The focus of the research is the realization of broadband measurement technology and the application of edge computing in distribution networks. There have been no reports on how to use edge computing methods in broadband measurement processing units to realize broadband measurement data preprocessing, reduce the bottleneck pressure of sending a large amount of broadband measurement data to the master station, obtain station-domain processing result data, and simplify the analysis and application of broadband master stations.

[0057] The present invention preprocesses broadband measurement data, firstly cleans a large amount of broadband measurement data, then preprocesses harmonics, interharmonics, and dominant component data, and stores the preprocessing results in a file in a preprocessing format for use by the edge side and the main station, thereby supporting further analysis and application of the broadband measurement data.

[0058] The present invention provides a broadband measurement data edge preprocessing analysis method, comprising the following steps:

[0059] 1) Cleaning of broadband measurement data;

[0060] 2) Broadband harmonic data preprocessing;

[0061] 3) Preprocessing of broadband dominant component data;

[0062] 4) Broadband interharmonic data preprocessing;

[0063] 5) The preprocessed data is stored in a preprocessed file.

[0064] In step 1), the broadband measurement processing unit concurrently subscribes to broadband measurement data of multiple intervals of multiple broadband measurement devices in real time.

[0065] The aforementioned broadband measurement data refers to the unified measurement data of fundamental wave, sub-supersynchronous wave, broadband oscillation signal, harmonics and interharmonics in the broadband domain of 0-2500Hz of the power grid electrical quantity with a sampling frequency of not less than 12.8kHz. The broadband measurement data includes phasors, analog quantities and digital quantities. The frequency range of broadband measurement data is divided into: low-frequency oscillation data in the range of 0.1-2.5Hz, sub-synchronous oscillation in the range of 2.5-45Hz and super-synchronous oscillation data in the range of 55-95Hz, broadband oscillation data in the frequency range of 100-300Hz, harmonics in the range of 100-2500Hz, and measurement data of interharmonics in the range of 300-2500Hz.

[0066] The aforementioned step 1) broadband measurement data cleaning refers to identifying broadband measurement data that is redundant and invalid for broadband service analysis based on broadband service functions, and filtering and removing the data.

[0067] The aforementioned broadband measurement dirty data refers to: abnormal data, invalid data, repeated data, inconsistent data, and zero-drift data.

[0068] Abnormal data refers to data for which binary code value signature verification of broadband measurement data received by the processing unit fails.

[0069] Invalid data refers to the extremely small amplitude data of current, voltage and power formed by secondary circuit interference in broadband measurement data. The extremely small amplitude of current and voltage refers to the ratio of the amplitude of sub / super synchronous, harmonic and interharmonic of A, B and C three-phase current to the amplitude of fundamental current and voltage respectively less than 0.1%; the extremely small amplitude of power refers to the ratio of the amplitude of interval sub / super synchronous power to the amplitude of interval power less than 0.01%.

[0070] Repeated data refers to broadband measurement data whose time stamp is equal to or less than the time stamp of the last received data.

[0071] Zero-value data refers to data that does not exist in the broadband measurement data, but has a zero amplitude due to communication coding, network anomalies, and software anomalies during broadband measurement data transmission.

[0072] Zero drift data refers to the situation where the load connected to the power grid is relatively light or no-load, and the amplitude of the broadband measurement data may be very small or even close to zero. Zero drift data is identified by threshold comparison. The identification basis is: the zero drift value of the AC secondary voltage loop should be less than 0.05V, and the zero drift value of the AC secondary current loop should be less than 0.1%In.

[0073] Inconsistent data means that the error between the fundamental frequency and the power frequency 50Hz is greater than plus or minus 0.2Hz;

[0074] Inconsistent data means that the phase angles of the three-phase voltage and current of the fundamental phasor are not 120°;

[0075] Inconsistent data means that the voltage value should conform to the voltage level of the equipment. Single-phase voltage value × 1.732 ≈ line voltage value ≈ voltage level value. If it is inconsistent with the value of the voltage level, it is considered invalid data. For the received A, B, C three-phase voltage fundamental broadband data, for example, for 220kV level, the transformation ratio is 220kV:100V, then the secondary voltage value sent should be 100V. If the difference is too large, the data is considered abnormal; the secondary values ​​corresponding to the voltage fundamental in the broadband data of different voltage levels are different. Since the secondary values ​​of the data sent by the broadband measurement device are valid values, the secondary data values ​​are as shown in the following table.

[0076] Voltage level Transformation ratio Secondary Value 500kV 500kV:100V 57.737 220kV 220kV:100V 57.737 110kV 110kV:100V 57.737 35kV 35kV:100V 57.737 10kV 10kV:100V 57.737

[0077] Inconsistent data refers to the situation where the sum of the phase angles of the received three-phase data does not satisfy zero;

[0078] Inconsistent data means that the sub-supersynchronous data is symmetrical with the power frequency of 50 Hz, the measured data is in the range of 10-40 Hz and 60-90 Hz, and the sub- / supersynchronous power oscillation frequency is between 10-40 Hz. If the sub-synchronous data and the supersynchronous data are not symmetrical with the power frequency of 50 Hz, the data is inconsistent.

[0079] Inconsistent data refers to whether the triggering cause of the broadband measurement data is consistent with the alarm event in the switch quantity data. Whether the current, voltage or power data exceeds the set value, if not, the measurement value is inconsistent with the switch quantity alarm.

[0080] The aforementioned step 2) preprocessing of broadband harmonic data refers to preprocessing the three-phase currents and three-phase voltages of A, B, and C in each interval respectively, with the frequency range of the harmonic data being 0 to 2500 Hz, and the corresponding harmonic order range being 1 to 50.

[0081] Each channel of the aforementioned harmonic data contains 1 to 50 orders of data. Based on the second-level characteristic of the harmonic data refresh cycle, the harmonic data is preprocessed and calculated once per second.

[0082] The aforementioned harmonic data preprocessing refers to using the statistical law of uniform data distribution within a period to describe the dynamic characteristics of the operation of the harmonic data measured by broadband, preprocessing the second-level data into minute-level data, and reducing the amount of data sent to the master station. Avoid sending all the data of each harmonic to the master station, which will put pressure on transmission and master station storage.

[0083] The statistical law of uniform distribution of data within a cycle refers to calculating the maximum amplitude, minimum amplitude and average amplitude of the current and voltage amplitudes within the cycle according to an elastically configurable cycle of not less than 1 minute in units of minutes. The typical cycle is set to 5 minutes.

[0084] The above preprocessing is to process the data of multiple broadband measurement devices and multiple intervals in the station in parallel to form the same section data, and take each interval data as a unit for statistics. Each interval contains 6 statistical channels, namely A, B, C three-phase current and three-phase voltage. 50 harmonic processing data are defined in each channel to build a hierarchical structure of substation-device-interval-channel-harmonic processing data.

[0085] The above method calculates the 6 channel distortion rate values ​​of the three-phase current and voltage of A, B, and C in each interval based on the real-time harmonic data of the broadband measurement of each channel. When the maximum value exceeds the preset constant, the occurrence time of the real-time data is recorded and an alarm message is generated. The constant value of the harmonic distortion rate can be flexibly adjusted, and the distortion rate set for different voltage levels of the fundamental wave is different. The distortion rate corresponding to 380V is 5%, and the distortion rate corresponding to 220kV is 2%.

[0086] The above harmonic preprocessing processes the amplitude of the three-phase harmonic data of A, B, and C in each interval, and obtains the percentage with the fundamental amplitude respectively. If the percentage exceeds the set value, the continuous time data before and after the data is recorded, and an alarm event information is formed. The alarm event information includes the time when the harmonic occurred, the data time value, the harmonic number, the interval name, the channel name and other information.

[0087] The above harmonic preprocessing process is to process the three-phase harmonic data of A, B, and C in each interval. When a certain harmonic data appears continuously and the amplitude changes suddenly, the continuous time data before and after the data is recorded, and alarm event information is formed. The alarm event information includes the occurrence time of the harmonic, the real-time value of the data, the harmonic number, the interval name, the channel name, etc. For example, if the 3rd, 5th, and 7th harmonic currents appear continuously and suddenly, the alarm information of the harmonic is generated.

[0088] The above-mentioned preprocessing is performed in two dimensions: the number of occurrences and amplitudes of each harmonic. The preprocessing is performed in time periods such as hours, days, weeks, and months; the number of each harmonic and the maximum amplitude of each harmonic in each time period are analyzed respectively, and the maximum amplitudes are sorted in order from large to small.

[0089] The above preprocessing analyzes the distribution law of each harmonic amplitude and each harmonic phase angle according to different load types such as photovoltaic, wind power, traction, conventional, energy storage, and waste power generation. The harmonic data law of various load types is formed, and the harmonic data change trend of the next period is predicted based on the law.

[0090] The above preprocessing compares and analyzes the harmonic data of different intervals of the same type of load, and obtains the rules of the harmonic data between different intervals of the same type of load. The amplitude, phase angle, number of occurrences and time period of the harmonics are compared at different intervals, so as to obtain the dynamic operating characteristics of the harmonic data at different intervals in the same station.

[0091] The step 3) preprocesses the broadband dominant component data. The dominant component data refers to the amplitude and phase angle of the oscillation data below 300 Hz and the broadband data. The oscillation data are: low-frequency oscillation data in the range of 0.1 to 2.5 Hz, subsynchronous oscillation of power in the range of 2.5 to 45 Hz, and supersynchronous oscillation of power in the range of 55 to 95 Hz; broadband data refers to the data of interharmonic voltage and current in the range of 100 Hz to 300 Hz, including the frequency and the amplitude corresponding to each frequency.

[0092] The dominant component of the aforementioned broadband measurement sends the frequencies and corresponding amplitudes of the 10 most important oscillation data in turn according to the strength of the amplitude, and the frequency resolution is 0.5 Hz.

[0093] The preprocessing is based on two dimensions: amplitude and frequency. The top 10 broadband data with the most occurrences and the top 10 largest amplitudes of the dominant components of voltage, current, and power are analyzed respectively.

[0094] The aforementioned broadband measurement preprocessing data refers to the 10 maximum amplitudes and their corresponding frequencies of the three-phase current, voltage and power of A, B and C, which are statistically obtained within the cycle time range.

[0095] The above broadband measurement preprocessing data is used in steps of 0.5 Hz to construct a preprocessing template structure for the frequency-amplitude of the three-phase voltage and current of A, B, and C. The template structure is stored in the form of feature-data pairs, where the feature is frequency, the statistical frequency points are in steps of 0.5 Hz, and the data is a structure data set, which contains the number of occurrences, maximum value, minimum value, and average value. The power is counted in intervals and the amplitude and phase angle of the three-phase current and voltage of A, B, and C in each interval.

[0096] The analyzed data includes multiple broadband devices and multiple intervals of each broadband device. Each interval contains 6 channels of A, B, and C three-phase current and voltage and power data of the interval.

[0097] The analyzed broadband measurement data are sorted by constructing a preprocessing tree to obtain 10 data in the two dimensions of the largest number of times and the largest amplitude.

[0098] The root node of the dominant component preprocessing data tree includes multiple device nodes, multiple interval nodes are established under the device nodes, and A, B, C three-phase current and voltage nodes and interval power nodes are established under the interval nodes.

[0099] The specific dominant component data preprocessing tree method sorting method is: construct 10 dominant component tree nodes, store all satellite data in leaf nodes, and only store keywords and child pointers in internal nodes. All leaf nodes can be strung into a linked list to traverse from beginning to end, avoiding traversal from beginning to end or traversing nodes in an in-order manner.

[0100] The dominant component data is about to be sorted when it is inserted into the tree node. When inserting an element, first check whether it exists in the dominant component preprocessing tree. If not, it ends at the leaf node and then inserts the new element into the leaf node.

[0101] The step 4) preprocesses the broadband interharmonic data. The broadband measurement interharmonic data preprocessing refers to taking intervals as units and preprocessing the interharmonics of the A, B, and C three-phase currents and three-phase voltages in each interval.

[0102] Each channel of the aforementioned interharmonic data contains 50 interharmonic data. Based on the interharmonic data refresh cycle of seconds, the interharmonic data is preprocessed and calculated once per second.

[0103] The aforementioned interharmonic data preprocessing refers to using the statistical law of uniform data distribution within a period to describe the dynamic characteristics of the interharmonic data measured by broadband, preprocessing the second-level data into minute-level data, and reducing the amount of data sent to the master station.

[0104] The statistical law of uniform distribution of data within a cycle refers to calculating the maximum amplitude, minimum amplitude and average amplitude of the current and voltage amplitudes within the cycle according to an elastically configurable cycle of not less than 1 minute in units of minutes. The typical cycle is set to 5 minutes.

[0105] The above preprocessing is to process the data of multiple broadband measurement devices and multiple intervals in parallel at the same time, and take each interval data as a unit for statistics. Each interval contains 6 statistical channels, namely A, B, C three-phase current and three-phase voltage. 50 interharmonic processing data are defined in each channel to build a hierarchical structure of substation-device-interval-channel-interharmonic processing data.

[0106] Interharmonics refer to the amount of electricity contained in current or voltage whose frequency is a non-integer multiple of the fundamental wave. Since it is a non-integer multiple of the power frequency, the frequency of interharmonics is not fixed. There are two types of frequencies in the interharmonic data sent on the broadband measurement device. One is the precise frequency point, that is, obtaining the precise signal frequency and amplitude. The other is the interharmonic subgroup clustering method, that is, obtaining the overall signal energy of the subgroup of interharmonics within a fixed interval, and uniformly gathering the frequencies within the interval to the center point to form the frequency and amplitude of the center point of the interharmonic band.

[0107] The above-mentioned interharmonic preprocessing statistics require the normalization of the two interharmonic data frequency points sent by the broadband measurement device. The precise signal frequency and amplitude obtained on the broadband processing unit are focused on the center point matching interval for processing, and the overall signal energy is obtained in a fixed interval of the center point frequency of the interharmonic band.

[0108] The ratio of the frequency of the center point of the interharmonic band to the fundamental frequency (n = fn / f1) is called the interharmonic order. The frequency range of broadband measurement data is 0-2500Hz, so the statistical interharmonic range is 1-50 times. The center frequency point of the interharmonic in the range of 0-2500Hz is an integer multiple of 25Hz. The frequency of the center frequency point of the Kth interharmonic band is: K*50-25, (K = 1, 2, ... 49, 50), for example: the frequency of the center frequency point of the 1st interharmonic band is: 25Hz, the frequency of the center frequency point of the 2nd interharmonic band is: 75Hz, .... Interharmonic statistics can simultaneously count the data of multiple broadband devices and multiple intervals in the station, and count the data of each interval as a unit.

[0109] The broadband measurement processing unit obtains accurate signal frequency and amplitude and focuses on the interval range corresponding to the center frequency of the interharmonic band. The interval range template corresponding to the center frequency of each interharmonic band in the range of 0 to 2500Hz is preset. The frequency range of each center interval is 50Hz, and the interval adopts the left-open and right-closed method. For example: the frequency range of the center frequency of the 1st interharmonic band is [0,50), the frequency range of the center frequency of the 2nd interharmonic band is [100,150), ..., the frequency range of the center frequency of the 50th interharmonic band is [2450,2500).

[0110] The interharmonic band center point data sorting adopts the direct sorting method. The flow chart of the center point sorting of interharmonic broadband measurement data preprocessing is as follows Figure 2 The process steps are:

[0111] First, the maximum value, minimum value, and total value are defined respectively with the first interharmonic band center point data as the starting point.

[0112] Secondly, swap the second data that is smaller than it, and then compare it with the third one, and compare them in sequence until all the data involved in the comparison are completed.

[0113] Finally, after comparison, the smallest data value can be obtained. Similarly, the largest data value can be obtained. The average value is to add up all the data to form a sum, and then divide it by the total number to get the average value.

[0114] After sorting, the sorting result data of each channel is written directly into the file.

[0115] The preprocessed data in step 5) is saved in a preprocessed file. The preprocessed file includes two files: preprocessed image data and preprocessed data semantic information, and the two files are used in conjunction with each other.

[0116] The aforementioned preprocessing data semantic format file is fixed in each station, and the corresponding semantic format file is generated when the preprocessing is initialized, that is, it is initialized once and used multiple times.

[0117] The aforementioned pre-processing data semantic format file includes the name and description of each device, the name and description of each interval, the name and description of each channel of harmonic pre-processing data, dominant component pre-processing data, and inter-harmonic pre-processing data.

[0118] The aforementioned preprocessed mirror data file saves the harmonics, dominant component data and interharmonic data of the same section preprocessed in each cycle; it is stored in the file in the order of statistical time point, harmonic channel preprocessing data, dominant component data channel preprocessing data and interharmonic data channel preprocessing data.

[0119] The aforementioned preprocessing semantic files and mirror data files are stored in a compressed manner. The file name format is: tag_station name_sequence number_year-month-day_hours-minutes-seconds_milliseconds.suffix. For example, the format of the preprocessing semantic file name is: DATA_CSB0_00001_20201010_131545_000.info; the format of the mirror data file name is: DATA_CSB0_00001_20201010_131545_000.dat.

[0120] The above-mentioned pre-processed files are digitally signed in layers according to the contents of the files, so as to ensure the authenticity and non-tamperability of the contents of the files.

[0121] The above-mentioned hierarchical signature method refers to digitally signing the contents of harmonic preprocessing data, dominant component preprocessing data and interharmonic preprocessing data to form three 512-bit signature values ​​of the first layer, signature_harm, signature_widefreq and signature_interharm, and then organizing the three signature values ​​to form the second layer 512-bit signature value signature_predata. The generated first-layer signature value and second-layer signature value are appended to the end of the preprocessing image file for the master station to perform hierarchical signature verification on the preprocessing data.

[0122] The above-mentioned layered signature verification means that the second-layer signature signature_predata is verified first, and if the verification passes, it can be used; if the verification fails, the three signatures of the first layer are further verified respectively, and the corresponding image data that passes the verification is used respectively.

[0123] Example

[0124] This section takes the interharmonic data preprocessing in broadband measurement data as an example to illustrate the preprocessing process. The interharmonic data preprocessing process is as follows:

[0125] 1. First, according to the number of broadband measurement devices and the interval data contained in each device, a hierarchical structure of interharmonic data cache of three-phase currents A, B, and C and three-phase voltages is established in units of intervals, and the center band frequency of the interharmonic band is predefined in the data cache structure;

[0126] 2. Secondly, the received broadband interharmonic data are uniformly aggregated to the interval where the center frequency of the interharmonic band is located. The frequency of the center of the k-th interharmonic band formed by the aggregation is: K*50-25, (K=0,1,2,...50);

[0127] 3. Third, the interharmonic band center data is preprocessed using a direct sorting algorithm to obtain the maximum, minimum and average values ​​within the period;

[0128] 4. Finally, the preprocessing result data of each channel after preprocessing is stored in the mirror data file of the section.

[0129] like Figure 3 As shown, another object of the present invention is to provide a broadband measurement data edge preprocessing system, comprising:

[0130] An acquisition unit, used for acquiring broadband measurement data of multiple intervals and cleaning them; the broadband measurement data includes broadband harmonic data, broadband dominant component data and broadband interharmonic data;

[0131] A preprocessing unit is used to preprocess the broadband harmonic data, broadband dominant component data and broadband interharmonic data, and use the statistical law of uniform distribution of data within the period to describe the operation dynamic characteristics corresponding to the broadband harmonic data, broadband dominant component data and broadband interharmonic data to obtain the results of preprocessing analysis;

[0132] The storage unit is used to store the preprocessing result into a file in the preprocessing format.

[0133] like Figure 4 As shown, the third object of the present invention is to provide an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the broadband measurement data edge preprocessing method when executing the computer program.

[0134] The broadband measurement data edge preprocessing method comprises the following steps:

[0135] Acquire broadband measurement data of multiple intervals and clean them; the broadband measurement data includes broadband harmonic data, broadband dominant component data and broadband interharmonic data;

[0136] Preprocessing is performed on broadband harmonic data, broadband dominant component data and broadband interharmonic data, and the statistical law of uniform distribution of data within the period is used to describe the corresponding dynamic characteristics of broadband harmonic data, broadband dominant component data and broadband interharmonic data, and the results of preprocessing analysis are obtained;

[0137] Store the preprocessing results into a file in the preprocessing format.

[0138] A fourth object of the present invention is to provide a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the broadband measurement data edge preprocessing method are implemented.

[0139] The broadband measurement data edge preprocessing method comprises the following steps:

[0140] Acquire broadband measurement data of multiple intervals and clean them; the broadband measurement data includes broadband harmonic data, broadband dominant component data and broadband interharmonic data;

[0141] Preprocessing is performed on broadband harmonic data, broadband dominant component data and broadband interharmonic data, and the statistical law of uniform distribution of data within the period is used to describe the corresponding dynamic characteristics of broadband harmonic data, broadband dominant component data and broadband interharmonic data, and the results of preprocessing analysis are obtained;

[0142] Store the preprocessing results into a file in the preprocessing format.

[0143] Those skilled in the art will appreciate that embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0144] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0145] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0146] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process in the computer or other programmable device. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0147] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the above embodiments, ordinary technicians in the relevant field should understand that the specific implementation methods of the present invention can still be modified or replaced by equivalents. Any modification or equivalent replacement that does not depart from the spirit and scope of the present invention should be covered within the scope of protection of the claims of the present invention.

Claims

1. A broadband measurement data edge preprocessing method, It is characterized in that The steps include: Acquire broadband measurement data of multiple intervals and clean them; the broadband measurement data includes broadband harmonic data, broadband dominant component data and broadband interharmonic data; Preprocessing is performed on broadband harmonic data, broadband dominant component data and broadband interharmonic data, and the statistical law of uniform distribution of data within the period is used to describe the corresponding dynamic characteristics of broadband harmonic data, broadband dominant component data and broadband interharmonic data, and the results of preprocessing analysis are obtained; Store the preprocessing results into a file in the preprocessing format; The preprocessing of the broadband dominant component data is specifically as follows: Process multiple broadband devices and multiple interval data of each broadband device, and obtain multiple data in two dimensions of the maximum number and the maximum amplitude of the three-phase current and voltage of A, B, and C and the power within the cycle time range, and construct a frequency-amplitude preprocessing template structure of the three-phase current and voltage of A, B, and C; The processing specifically includes: The broadband measurement data are sorted by using a sorting method for constructing a preprocessing data tree to obtain multiple data in two dimensions of the largest number of times and the largest amplitude; the root node of the preprocessing data tree includes multiple device nodes, multiple interval nodes are established under the device nodes, and A, B, C three-phase current and voltage nodes and interval power nodes are established under the interval nodes; Among them, the preprocessing data tree sorting method is: Construct multiple tree nodes of dominant component data, store all satellite data in leaf nodes, store only keywords and child pointers in internal nodes, string all leaf nodes into a linked list and traverse from beginning to end; The dominant component data will be sorted when inserted into the tree node. When inserting an element, first determine whether it exists in the preprocessed data tree. If not, end at the leaf node and then insert the element into the leaf node.

2. The method according to claim 1, It is characterized in that The cleaning of broadband measurement data refers to identifying the redundant and invalid dirty data of broadband measurement data for broadband service analysis based on the broadband service function, and filtering and removing the data; The dirty data refers to abnormal data, invalid data, duplicate data, inconsistent data or zero-drift data.

3. The method according to claim 1, It is characterized in that The preprocessing of the broadband harmonic data specifically includes: At the same time, multiple broadband measuring devices and multiple interval data in the station are processed in parallel to form the same section data. Each interval data is taken as a unit for statistics. Each interval contains the three-phase current and voltage of A, B, and C, and a hierarchical structure of substation-device-interval-channel-harmonic processing data is constructed.

4. The method according to claim 3, It is characterized in that The statistical laws of uniform data distribution within a period include: According to the configuration cycle in minutes, the maximum amplitude, minimum amplitude and average amplitude of the current and voltage amplitudes in the cycle are calculated within the cycle; The number and amplitude of each harmonic are preprocessed by time segment preprocessing; time segment preprocessing refers to preprocessing according to time periods; the number of each harmonic and the maximum amplitude of each harmonic in each time segment are analyzed respectively, and the maximum amplitude is sorted in descending order; According to different load types such as photovoltaic, wind power, traction, conventional, energy storage, and waste power generation, the distribution law of each harmonic amplitude and the distribution law of each harmonic phase angle are analyzed; the harmonic data law of various load types is formed, and the harmonic data change trend of the next period is predicted based on the law; The harmonic data of different intervals of the same type of load are compared and analyzed to obtain the rules of the harmonic data between different intervals of the same type of load. The amplitude, phase angle, number of occurrences and time period of the harmonics are compared at different intervals to obtain the dynamic operating characteristics of the harmonic data at different intervals in the same station.

5. The method according to claim 1, It is characterized in that The preprocessing of the broadband interharmonic data includes: At the same time, the data of multiple broadband measuring devices and multiple intervals in the station are processed in parallel, and the data of each interval is counted as a unit. Each interval contains three-phase currents and three-phase voltages of A, B, and C, and a hierarchical structure of substation-device-interval-channel-interharmonic processing data is constructed.

6. The method according to claim 5, It is characterized in that In the statistics of interharmonics, it is necessary to normalize the two interharmonic data frequency points sent by the broadband measurement device; specifically, the obtained precise signal frequency and amplitude are focused on the interval matching the center point, and the overall signal energy is obtained in a fixed interval of the center point frequency of the interharmonic band; The received broadband interharmonic data are uniformly aggregated to the interval where the center frequency of the interharmonic band is located, and the center data of the interharmonic band is preprocessed by using the direct sorting method to obtain the maximum value, minimum value and average value within the period.

7. The method according to claim 6, It is characterized in that The direct sorting method specifically includes: Taking the first interharmonic band center point data as the starting point, define the maximum value, minimum value and total value respectively; Take the second data that is smaller than it and swap it, then compare it with the third one, and compare them in sequence until all the data involved in the comparison are finished; after the comparison is completed, the minimum value is obtained; The maximum value is obtained in the same way; the average value is to add up all the data to form the sum, and then divide it by the total number to get the average value; Get the maximum, minimum and average values ​​of the center point data of the interharmonic band within the cycle.

8. The method according to claim 1, It is characterized in that The file in the preprocessing format includes preprocessing image data and preprocessing data semantic information; The pre-processed mirror data stores the harmonic data, dominant component data and inter-harmonic data of the same section pre-processed for each cycle; The statistical time point, harmonic channel preprocessing data, dominant component data channel preprocessing data and interharmonic data channel preprocessing data are stored in the file in sequence; The preprocessed data semantic information includes the name and description of each device, the name and description of each interval, the name and description of each channel of the harmonic preprocessed data, the dominant component preprocessed data, and the interharmonic preprocessed data; The pre-processed data semantic information and pre-processed image data are stored in a compressed manner and a hierarchical digital signature is performed on the content of the file.

9. A broadband measurement data edge preprocessing system, based on the broadband measurement data edge preprocessing method according to any one of claims 1 to 8, It is characterized in that include: An acquisition unit, used for acquiring broadband measurement data of multiple intervals and cleaning them; the broadband measurement data includes broadband harmonic data, broadband dominant component data and broadband interharmonic data; A preprocessing unit is used to preprocess the broadband harmonic data, broadband dominant component data and broadband interharmonic data, and use the statistical law of uniform distribution of data within the period to describe the operation dynamic characteristics corresponding to the broadband harmonic data, broadband dominant component data and broadband interharmonic data to obtain the results of preprocessing analysis; The storage unit is used to store the preprocessing result into a file in the preprocessing format.

10. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the broadband measurement data edge preprocessing method according to any one of claims 1 to 8 when executing the computer program.

11. A computer-readable storage medium storing a computer program, wherein the computer program, when executed by a processor, implements the steps of the broadband measurement data edge preprocessing method according to any one of claims 1 to 8.

Citation Information

Patent Citations

  • Method for producing digital sinature, print controling terminal unit and image forming apparatus

    CN101854448A

  • Station domain processing method and device of wideband measurement data

    CN110703008A

  • Updatable digital signature method for private key with label and application of updatable digital signature method in PoS block chain protocol

    CN110837659A

  • Power grid broadband oscillation wide-area real-time monitoring system and method

    CN111965415A

  • Big data similar text de-duplication preprocessing method and device and terminal equipment

    CN112883704A