A Compression and Transmission Method for Wave Recording Sampling Data

Abstract

The present invention belongs to the technical field of compression transmission, and specifically relates to a compression transmission method for waveform recording sampling data. The method includes: using the time length as a parameter of the SAX algorithm to compress and transmit the real-time waveform data sequence. The time length is the preselected length with the maximum preference degree. The process of calculating the preference degree is as follows: predicting the compression ratio according to the size of the preselected length, performing multi-dimensional Gaussian fitting on multiple historical waveform data sequences, calculating the first advantage of the preselected length according to the fitting effect and the consistency of the Gaussian parameters of all dimensions, decomposing each historical waveform data sequence to obtain a trend item sequence, respectively obtaining all segmentation points and all expected points of the trend item sequence according to the preselected length and the extreme points in the trend item sequence, so as to calculate the second advantage of the preselected length according to the quantity and distribution thereof, and calculating the preference degree of the preselected length according to the first advantage, the second advantage and the compression ratio. The present invention improves the efficiency of data transmission.

Description

Technical Field

[0001] The present invention relates to the technical field of compression transmission. More specifically, the present invention relates to a method for compressing and transmitting recorded wave sampling data. Background Art

[0002] In a power system, real-time monitoring is a key means to ensure the stable operation of the system and rapid fault diagnosis. As an important device for real-time monitoring, the acquisition module can collect and record the waveform data of the power system in real time; in practical applications, in order to reduce the burden on the system and improve the efficiency of data transmission, an efficient data compression method is required.

[0003] In related technologies, for example, the Chinese patent application document with the publication number CN111930725A discloses a method and device for compressing and fusing power distribution and utilization data, including: decomposing the original power distribution and utilization information data by using a parallelized EEMD algorithm, symbolizing the time series of the decomposed principal component power distribution and utilization information data based on feature-based symbolic aggregate approximation (SAX), and then reconstructing the symbolized power distribution and utilization information time series to complete the cleaning of the collected original power distribution and utilization information data; compressing the power distribution and utilization information data based on the SPIHT compression algorithm, and using a network structure with a multi-input - single-output mode to complete the classification and fusion of the compressed power distribution and utilization acquisition information data; this invention can accurately collect power distribution and utilization information on the basis of realizing the cleaning, compression, and fusion of the original power distribution and utilization information data, fully excavate the value of information data, and provide an important scientific basis for the operation of the power system.

[0004] In related technologies, the SAX (Symbolic Aggregate approximation) algorithm is an efficient data compression method; the SAX algorithm segments the time series by time length and symbolizes each segment to achieve data dimensionality reduction. Among them, the time length is an important factor affecting the compression effect of the SAX algorithm; therefore, in order to reduce the burden on the system and improve the efficiency of data transmission, it is necessary to reasonably select the time length according to the data characteristics of the waveform data. Summary of the Invention

[0005] To solve the above technical problem that in order to reduce the burden on the system and improve the efficiency of data transmission, it is necessary to reasonably select the time length according to the data characteristics of the waveform data, the present invention provides a method for compressing and transmitting recorded wave sampling data, including: each data point in the collected real-time waveform data sequence has a corresponding time and value; taking the time length as The parameters of the algorithm are used to compress and transmit the real-time waveform data sequence; the time length is the preselected length with the maximum preference degree. The process of calculating the preference degree is as follows: each integer within the preset range is used as a preselected length; according to the size of the preselected length, the compression ratio of compressing the real-time waveform data sequence through the algorithm is predicted; multi-dimensional Gaussian fitting is performed on multiple historical waveform data sequences, and according to the fitting effect of the obtained multi-dimensional Gaussian distribution and the consistency of the Gaussian parameters of all dimensions, the first advantage of the preselected length is calculated; the trend item sequences are obtained by decomposing each historical waveform data sequence; all segmentation points and all expected points of the trend item sequence are obtained respectively according to the preselected length and the extreme points in the trend item sequence; according to the th and the th segmentation points, the fitting slope of all data points therebetween is calculated, and the weight of the th segmentation point is calculated ; the second advantage of the preselected length is calculated , , is the natural exponential function, are the numbers of all segmentation points and all expected points respectively, is the moment corresponding to the th segmentation point, is the moment corresponding to the expected point closest to the th segmentation point at the corresponding moment; according to the first advantage, the second advantage and the compression ratio, the preference degree of the preselected length is calculated.

[0006] In the present invention, according to the data characteristics of the waveform data, the first advantage, the second advantage and the compression ratio when each integer within the preset range is used as the preselected length are calculated, and the preference degree of the preselected length is calculated according to the first advantage, the second advantage and the compression ratio. The time length is reasonably selected through the preference degree, ensuring that the selected time length can not only maximize the compression efficiency, but also ensure that the compressed data retains sufficient information and accuracy, so as to achieve the optimal performance in data storage and transmission; by selecting an appropriate time length, the compression effect of compressing the real-time waveform data sequence through the algorithm is improved, thereby reducing the burden on the system and improving the data transmission efficiency.

[0007] Preferably, the compression ratio is equal to the reciprocal of the preselected length.

[0008] By predicting the compression ratio in the present invention, it is possible to help evaluate the influence of different preselected lengths on the data compression efficiency, so as to select a time length that can maximize the compression efficiency while maintaining the data integrity.

[0009] Preferably, the multi-dimensional Gaussian fitting of the multiple historical waveform data sequences includes: dividing each historical waveform data sequence into multiple subsequences with a length equal to a preselected length; using all the subsequences of the multiple historical waveform data sequences as samples; performing multi-dimensional Gaussian fitting on the samples, where the number of all dimensions in the multi-dimensional Gaussian fitting is equal to the preselected length; the multi-dimensional Gaussian distribution obtained by the multi-dimensional Gaussian fitting includes an isotropic multi-dimensional Gaussian distribution and an anisotropic multi-dimensional Gaussian distribution; in the obtained multi-dimensional Gaussian distribution, the Gaussian parameters of each dimension include a mean and a variance, denoted as a first parameter and a second parameter respectively.

[0010] By performing multi-dimensional Gaussian fitting on the historical waveform data sequences, the present invention reveals the statistical characteristics of the waveform data and provides a mathematical model for subsequent compression and analysis.

[0011] Preferably, the first advantage of the preselected length satisfies the expression: ; where is the first advantage of the preselected length, is the fitting effect of the multi-dimensional Gaussian distribution, is the consistency of the Gaussian parameters of all dimensions of the multi-dimensional Gaussian distribution.

[0012] The present invention calculates the first advantage of the preselected length based on the fitting effect and the consistency of the Gaussian parameters, which can quantify the applicability of different preselected lengths and preferentially select the time length that can maintain the consistency and stability of data characteristics.

[0013] Preferably, the calculation method of the consistency of the Gaussian parameters of all dimensions includes: when the multi-dimensional Gaussian distribution is an isotropic multi-dimensional Gaussian distribution, the consistency of the Gaussian parameters of all dimensions of the obtained multi-dimensional Gaussian distribution satisfies the expression: ; when the multi-dimensional Gaussian distribution is an anisotropic multi-dimensional Gaussian distribution, the consistency of the Gaussian parameters of all dimensions of the obtained multi-dimensional Gaussian distribution satisfies the expression: ; where is the variance of the first parameter of the Gaussian parameters of all dimensions, is the variance of the second parameter of the Gaussian parameters of all dimensions, is the natural exponential function.

[0014] Preferably, the fitting effect of the multi-dimensional Gaussian distribution is obtained through a chi-square test. In this process: when the multi-dimensional Gaussian distribution is an isotropic multi-dimensional Gaussian distribution, when calculating the degrees of freedom in the chi-square test, the number of estimated Gaussian parameters is equal to a preselected length; when the multi-dimensional Gaussian distribution is an anisotropic multi-dimensional Gaussian distribution, when calculating the degrees of freedom in the chi-square test the number of estimated Gaussian parameters is equal to twice the preselected length.

[0015] Preferably, obtaining all the segmentation points and all the expected points of the trend term sequence respectively according to the preselected length and the extreme points in the trend term sequence includes: the extreme points include maximum points and minimum points; for any extreme point, when is greater than a preset threshold, take this extreme point as a segmentation point, where is the maximum value function, is the value corresponding to this extreme point, is the value corresponding to the extreme point closest to this extreme point and on the left side of this extreme point, is the value corresponding to the extreme point closest to this extreme point and on the right side of this extreme point, is taking the absolute value; take the data whose serial number in the trend term sequence is an integer multiple of the preselected length as the expected points.

[0016] By decomposing the historical waveform data sequence, the present invention obtains the trend term sequence, which helps to identify and remove the non-periodic changes in the waveform data, and provides a clearer trend pattern for subsequent compression; obtaining all the segmentation points and expected points according to the preselected length and the extreme points in the trend term sequence helps to retain the key information points during the compression process, ensuring that the compressed data can accurately reflect the important features and change trends of the original waveform data.

[0017] Preferably, the weight of the th segmentation point satisfies the expression: ; in the formula, is the trend intensity of the th segmentation point of the trend term sequence, and the trend intensity of the th segmentation point is equal to the slope of the linear fitting result of all the data points between the th segmentation point and the th segmentation point, is taking the absolute value, is the trend intensity of the th segmentation point of the trend term sequence, is the number of all the segmentation points of the trend term sequence.

[0018] Preferably, the preference degree of the preselected length satisfies the expression: ; is the preference degree of the preselected length, The first advantage and the second advantage of preselected lengths respectively, is the compression ratio, are the preset first coefficient, second coefficient and third coefficient respectively, and .

[0019] The present invention calculates the preference degree of the preselected length by integrating the first advantage, the second advantage and the compression ratio, provides a comprehensive evaluation index, helps to select the best time and compression balance point, and realizes the effective compression and efficient transmission of data.

[0020] Preferably, taking the time length as a parameter of the algorithm to compress the real-time waveform data sequence, including: converting the data points in the real-time waveform data sequence into PAA features, including: segmenting the real-time waveform data sequence by the time length, and taking the mean value of the numerical values corresponding to all the data points included in each segment as the PAA feature of each segment; converting the PAA feature into a character: performing Gaussian fitting on the PAA features of all segments to obtain a Gaussian distribution; obtaining a breakpoint list that divides the Gaussian distribution into any number of equally probable intervals, and then converting the PAA features of each segment into characters through the breakpoint list and the PAA features to complete symbolization, wherein the probability values of the Gaussian distribution corresponding to any two adjacent breakpoints in the breakpoint list are equal; taking the sequence composed of the characters corresponding to all segments as the compression result of the real-time waveform data sequence.

[0021] The beneficial effects of the present invention are as follows:

[0022] The present invention needs to calculate the first advantage, the second advantage and the compression ratio when each integer within a preset range is used as the preselected length according to the data characteristics of the waveform data, calculate the preference degree of the preselected length according to the first advantage, the second advantage and the compression ratio, and reasonably select the time length through the preference degree to ensure that the selected time length can not only maximize the compression efficiency, but also ensure that the compressed data maintains sufficient information and accuracy, so as to achieve the optimal performance in data storage and transmission; by selecting an appropriate time length, the compression effect of compressing the real-time waveform data sequence by the algorithm is improved, thereby reducing the burden on the system and improving the efficiency of data transmission. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] By reading the following detailed description with reference to the accompanying drawings, the above and other objects, features and advantages of the exemplary embodiments of the present invention will become readily understood. In the drawings, several embodiments of the present invention are shown in an exemplary and non-limiting manner, and the same or corresponding reference numerals represent the same or corresponding parts, wherein:

[0024] Figure 1It is a flowchart schematically showing a method for compressed transmission of waveform sampling data in the present invention;

[0025] Figure 2 It is a flowchart schematically showing step S2;

[0026] Figure 3 It is a schematic diagram schematically showing obtaining the PAA features of each segment;

[0027] Figure 4 It is a schematic diagram schematically showing converting the PAA features of each segment into characters. Detailed implementation manners

[0028] Next, the technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative efforts belong to the scope of protection of the present invention.

[0029] Next, the detailed implementation manners of the present invention will be described in detail with reference to the accompanying drawings.

[0030] An embodiment of the present invention discloses a method for compressed transmission of waveform sampling data. Referring to Figure 1 , it includes steps S1 to S3:

[0031] S1. Collect real-time waveform data sequences.

[0032] It should be noted that in the power system, real-time monitoring is a key means to ensure the stable operation of the system and rapid fault diagnosis. As an important device for real-time monitoring, the acquisition module can collect and record the waveform data of the power system in real time.

[0033] Specifically, install a GPS receiver or network time synchronization device on each acquisition module to ensure that all acquisition modules are connected to a unified clock source; configure the sampling rate of the acquisition module to 1000 samples per second, and the channel configuration is dual-channel, corresponding to the acquisition of positive and negative waveforms respectively; start the acquisition module to start real-time acquisition of waveform data to ensure the real-time and accuracy of data acquisition; among them, time synchronization calibration is automatically performed with each acquisition module through a network protocol (such as NTP) every minute to ensure that the time deviation is within the millisecond level.

[0034] Furthermore, the collected real-time waveform data sequence is a time sequence, and each data point in the real-time waveform data sequence has a corresponding time and value.

[0035] S2. Determine the time length according to the preference degrees of each preselected length within a preset range.

[0036] It should be noted that in practical applications, in order to reduce the burden of the system and improve the efficiency of data transmission, an efficient data compression method is needed; the SAX (Symbolic Aggregate approximation) algorithm is an efficient data compression method. The SAX algorithm maps a time series in a high-dimensional space to a low-dimensional space represented by symbols according to the time length, thereby achieving data compression.

[0037] Step S2 Flowchart Reference Figure 2 , including steps S201 to S204, specifically:

[0038] S201, according to the size of the pre-selected length, predict the The compression ratio of the algorithm to compress the real-time waveform data sequence.

[0039] Specifically, each integer within the preset range is used as a preselected length; according to the size of the preselected length, the prediction is passed The compression ratio of the algorithm to compress the real-time waveform data sequence, including: , the real-time waveform data sequence is divided into multiple segments, each segment is represented by the mean value, which is equivalent to dividing the real-time waveform data sequence into data points are compressed into 1 data point, so the compression ratio is equal to the inverse of the preselected length; where the preset range is [10,50].

[0040] Among them, the smaller the compression rate, the better the compression effect.

[0041] It should be noted that the present invention can help evaluate the impact of different pre-selected lengths on data compression efficiency by predicting the compression rate, so as to select a time length that can maximize the compression efficiency while maintaining data integrity.

[0042] S202, performing multi-dimensional Gaussian fitting on multiple historical waveform data sequences, and calculating the first advantage of the pre-selected length according to the fitting effect of the obtained multi-dimensional Gaussian distribution and the consistency of Gaussian parameters of all dimensions.

[0043] Specifically, each historical waveform data sequence is divided into multiple subsequences with a length equal to a preselected length; all subsequences of the multiple historical waveform data sequences are taken as samples, and multidimensional Gaussian fitting is performed on the samples, requiring that the number of all dimensions in the multidimensional Gaussian fitting is equal to the preselected length, and the first advantage of the preselected length is calculated based on the fitting effect of the obtained multidimensional Gaussian distribution and the consistency of the Gaussian parameters of all dimensions.

[0044] It should be noted that the present invention reveals the statistical characteristics of waveform data by performing multi-dimensional Gaussian fitting on the historical waveform data sequence, and provides a mathematical model for subsequent compression and analysis.

[0045] Among them, the Gaussian parameters of each dimension include mean and variance, which are respectively recorded as the first parameter and the second parameter; the multidimensional Gaussian distribution obtained by the multidimensional Gaussian fitting includes an isotropic multidimensional Gaussian distribution and an anisotropic multidimensional Gaussian distribution.

[0046] Among them, the isotropic multidimensional Gaussian distribution refers to a multidimensional Gaussian distribution in which the variance of each dimension is the same. When fitting, it is only necessary to make the length of each dimension the same to obtain isotropy, that is, the distribution density value is only related to the distance from the data point to the mean of the Gaussian parameter, but has nothing to do with the direction. At the same time, each dimension of the isotropic multidimensional Gaussian distribution is also independent of each other. The number of parameters of this type of Gaussian distribution increases linearly with the dimension, only the mean increases, and the variance is a scalar. Therefore, the isotropic multidimensional Gaussian fitting does not require much computation and storage.

[0047] Among them, the anisotropic multidimensional Gaussian distribution refers to a multidimensional Gaussian distribution with different variances in each dimension. When fitting, the length of each dimension is different, that is, the distribution density value is not only related to the distance from the data point to the mean in the Gaussian parameter, but also related to the direction. At the same time, each dimension of the anisotropic multidimensional Gaussian distribution is independent of each other. Therefore, the anisotropic multidimensional Gaussian fitting has a better fitting effect.

[0048] Further, the fitting effect of the multidimensional Gaussian distribution is calculated by a chi-square test; the consistency of the Gaussian parameters of all dimensions of the obtained multidimensional Gaussian distribution is calculated; and the first advantage of the preselected length is calculated based on the fitting effect of the obtained multidimensional Gaussian distribution and the consistency of the Gaussian parameters of all dimensions.

[0049] The Chi-Square Test is used to calculate the fitting effect of the multidimensional Gaussian distribution, including: (1) dividing the distribution range of the sample into multiple intervals, and calculating the expected frequency in each interval. The expected frequency is calculated based on the multidimensional Gaussian distribution and represents the number of data that should appear in the interval; (2) calculating the actual frequency in each interval, that is, the number of data that actually appears in the interval; (3) calculating the Chi-Square statistic based on the expected frequency and the actual frequency in all intervals. , which is used to measure the difference between the actual frequency and the expected frequency, then , the number of all intervals is equal to , Respectively represent The expected frequency and actual frequency within an interval; (4) Determine the degrees of freedom , , is the number of estimated Gaussian parameters; (5) According to the degrees of freedom and significance level, find the critical value from the chi-square distribution table, denoted as The specific value of the significance level can be set according to the actual application scenario and requirements, and the value of the significance level is [0.01, 0.1]. The significance level is set to 0.05 in this invention; (6) According to the chi-square statistic and the critical value, the fitting effect of the multidimensional Gaussian distribution is calculated. , .

[0050] In the above process of calculating the fitting effect of the multidimensional Gaussian distribution by the chi-square test: when the multidimensional Gaussian distribution is an isotropic multidimensional Gaussian distribution, it is only necessary to determine the mean of the Gaussian parameters of each dimension, and the number of all dimensions is equal to the preselected length. Therefore, in calculating the degrees of freedom The number of estimated Gaussian parameters is When the multidimensional Gaussian distribution is anisotropic, it is necessary to determine the mean and variance of the Gaussian parameters of each dimension, and the number of all dimensions is equal to the preselected length. Therefore, when calculating the degrees of freedom The number of estimated Gaussian parameters is Equal to twice the preselected length.

[0051] The method for calculating the consistency of Gaussian parameters of all dimensions includes: when the multidimensional Gaussian distribution is an isotropic multidimensional Gaussian distribution, the consistency of Gaussian parameters of all dimensions of the obtained multidimensional Gaussian distribution is: Satisfies the expression:

[0052] ;

[0053] In the formula, is the first parameter of the Gaussian parameters of all dimensions The square, is a natural exponential function.

[0054] When the multidimensional Gaussian distribution is an anisotropic multidimensional Gaussian distribution, the consistency of Gaussian parameters of all dimensions of the obtained multidimensional Gaussian distribution is Satisfies the expression:

[0055] ;

[0056] In the formula, is the first parameter of the Gaussian parameters of all dimensions The variance of The second parameter of the Gaussian parameters for all dimensions The variance of is a natural exponential function.

[0057] The first advantage of the preselected length satisfies the expression:

[0058] ;

[0059] In the formula, is the first advantage of the preselected length, is the fitting effect of the multi-dimensional Gaussian distribution, is the consistency of the Gaussian parameters of all dimensions of the multi-dimensional Gaussian distribution.

[0060] It should be noted that the present invention calculates the first advantage of the preselected length according to the fitting effect and the consistency of the Gaussian parameters, which can quantify the applicability of different preselected lengths, and preferentially select the time length that can maintain the consistency and stability of data characteristics.

[0061] S203. Decompose each historical waveform data sequence to obtain a trend term sequence, respectively obtain all segmentation points and all expected points of the trend term sequence, and calculate the second advantage of the preselected length according to the quantity and distribution of all segmentation points and all expected points.

[0062] Specifically, perform STL decomposition on each historical waveform data sequence to obtain a trend term sequence, a periodic term sequence, and a residual term sequence of each historical waveform data sequence; the trend term sequence includes the trend terms of each historical waveform data in the historical waveform data sequence; the periodic term sequence includes the periodic terms of each historical waveform data in the historical waveform data sequence; the residual term sequence includes the residual terms of each historical waveform data in the historical waveform data sequence; STL (Seasonal-Trend Decomposition using LOESS) decomposition is a decomposition technique for time series, which can decompose a time series into three parts: trend, seasonal, and residual; STL decomposition is a well-known technique and will not be elaborated here.

[0063] It should be noted that by decomposing the historical waveform data sequence to obtain a trend term sequence, the present invention helps to identify and remove non-periodic changes in the waveform data, providing a clearer trend pattern for subsequent compression.

[0064] Further, obtain all segmentation points of the trend term sequence, including: obtain all extreme points in the trend term sequence, and the extreme points include maximum points and minimum points; for any extreme point, when is greater than a preset threshold, use this extreme point as a segmentation point, where is the maximum value function, is the value corresponding to this extreme point, is the value corresponding to the extreme point located to the left of the extreme point and closest to the extreme point, is the value corresponding to the extreme point located to the right of the extreme point and closest to the extreme point, To take the absolute value.

[0065] The specific value of the preset threshold can be set according to the actual application scenario and requirements, and the method for obtaining the value of the preset threshold is as follows: , the present invention sets the preset threshold value to , They are the maximum and minimum values ​​in the trend item sequence respectively.

[0066] Furthermore, data in the trend item sequence whose sequence number is equal to an integer multiple of a preselected length are taken as expected points, thereby obtaining all expected points of the trend item sequence; wherein, an integer multiple of a number refers to the number multiplied by an integer, where an integer refers to an integer greater than or equal to 1; illustratively, integer multiples of 100 include 100, 200, 300, 1000, etc., while 98, 1050, and 3985 are not integer multiples of 100.

[0067] It should be noted that the present invention obtains all segmentation points and expected points based on the extreme points in the pre-selected length and trend item sequence, which helps to retain key information points during the compression process and ensure that the compressed data can accurately reflect the important characteristics and changing trends of the original waveform data.

[0068] Further, the second advantage of the preselected length is calculated according to all segmentation points and all expected points of the trend item sequence;

[0069] ;

[0070] In the formula, The second advantage of the preselected length is is the natural exponential function, To obtain the maximum value function, is the number of all segmentation points in the trend item sequence, is the number of all expected points in the trend term sequence, is the first The weight of the segment point, is the first The time corresponding to the segment point is is the first The time corresponding to the nearest expected point of each segment point at the corresponding time, To take the absolute value.

[0071] It should be noted that according to the number and distribution of segmentation points and expected points, the present invention calculates the second advantage of the preselected length, which can further optimize the selection of the time length, ensuring that the compressed data not only has a high information retention rate but also can effectively reduce the data volume.

[0072] Among them, the weight of the th segmentation point of the trend item sequence

[0073] satisfies the expression:

[0074] In the formula, is the trend intensity of the th segmentation point of the trend item sequence, and the trend intensity of the th segmentation point is equal to the slope of the linear fitting result of all data points between the th segmentation point and the th segmentation point, is to take the absolute value, is the trend intensity of the th segmentation point of the trend item sequence, is the number of all segmentation points of the trend item sequence.

[0075] It should be specifically noted that when , the trend intensity of the th segmentation point is equal to the slope of the linear fitting result of all data points between the th data point of the trend item sequence and the th segmentation point.

[0076] It should be noted that when compressing through the algorithm, for each segment, the compression result is closely related to the average value of the numerical values of this segment; in the trend item sequence, between two adjacent extreme points is a segment of trend, and a segment of trend can be divided into multiple segments. In this way, the compression result of each segment can still maintain the numerical characteristics of different parts in a segment of trend. However, multiple trends cannot be summarized by one segment. Otherwise, after processing by the average value, the compression result of this segment destroys the numerical characteristics of the trend, resulting in the loss of the numerical characteristics of multiple trends in the received compression result; therefore, can be less than or equal to ; however, when is greater than , the greater it is, the smaller the second advantage of the preselected length.

[0077] S204. Calculate the preference degree of the preselected length according to the first advantage, the second advantage and the compression ratio of the preselected length; obtain the time length according to the preference degree.

[0078] Specifically, the preference degree of the preselected length satisfies the expression:

[0079] ;

[0080] In the formula, is the preference degree of the preselected length, are respectively the first advantage and the second advantage of the preselected length, is the compression ratio, are respectively the preset first coefficient, second coefficient and third coefficient, and .

[0081] Among them, the preset first coefficient , the second coefficient and the third coefficient can be set according to the actual application scenario and requirements, and , in the present invention, the preset first coefficient , the second coefficient and the third coefficient are respectively set to , , .

[0082] It should be noted that the present invention calculates the preference degree of the preselected length by integrating the first advantage, the second advantage and the compression ratio, provides a comprehensive evaluation index, helps to select the best time and compression balance point, and realizes the effective compression and efficient transmission of data.

[0083] Further, the preselected length with the maximum preference degree within the preset range is used as the time length.

[0084] It should be noted that the present invention reasonably selects the time length through the preference degree, ensures that the selected time length can not only maximize the compression efficiency, but also ensure that the compressed data maintains sufficient information content and accuracy, so as to achieve the optimal performance in data storage and transmission.

[0085] S3. Use the time length as a parameter of the algorithm to compress and transmit the real-time waveform data sequence.

[0086] Specifically, at the sending end, according to the time length, compress the real-time waveform data sequence through the algorithm to obtain the compression result of the real-time waveform data sequence; and package the time stamp, the time length and the compression result of the real-time waveform data sequence together to obtain a data packet, and transmit the data packet.

[0087] Among them, the The algorithm includes two steps: (1) Convert the data points in the real-time waveform data sequence into PAA features, including: segment the real-time waveform data sequence by time length, and take the mean value of the numerical values corresponding to all data points included in each segment as the PAA feature of each segment; Exemplarily, the schematic diagram of obtaining the PAA features of each segment is as shown in Figure 3 Figure [1]; (2) Convert the PAA features into characters: perform Gaussian fitting on the PAA features of all segments to obtain a Gaussian distribution; obtain a list of breakpoints that divide the Gaussian distribution into any number of equally probable intervals, and then convert the PAA features of each segment into characters through the list of breakpoints and the PAA features to complete symbolization. The sequence composed of the characters corresponding to all segments is used as the compression result of the real-time waveform data sequence; where the probability values of the Gaussian distribution corresponding to any two adjacent breakpoints in the list of breakpoints are equal; Exemplarily, when there are two breakpoints and the breakpoints are -0.43 and 0.43 respectively, for all segments with PAA features less than -0.43, the corresponding character is "a", for all segments with PAA features greater than or equal to -0.43 and less than 0.43, the corresponding character is "b", and for all segments with PAA features greater than or equal to 0.43, the corresponding character is "c"; The schematic diagram of converting the PAA features of each segment into characters is as shown in Figure 4 Figure [2].

[0088] The data packet format is: packet header, the compression result of the real-time waveform data sequence, and a check code. According to the defined data packet format, encapsulate the compression result of the real-time waveform data sequence into a data packet to ensure the integrity and identifiability of the data; add a serial number to the packet header part of the data packet so that the receiving end can reorganize the data in order; The packet header includes the type of real-time waveform data, the source of the real-time waveform data, the time length, the list of breakpoints, and the timestamp of the first data point in the real-time waveform data sequence. The timestamp is accurate to the millisecond level and uses the UTC time format.

[0089] The transmission includes: establish a TCP connection between the sending end and the receiving end to ensure the reliability and stability of data transmission; through the established TCP connection, continuously send the encapsulated data packets to the receiving end; during the transmission process, use an acknowledgment mechanism to ensure that each data packet is correctly received by the receiving end. If there is a packet loss or error, the sending end retransmits according to the feedback of the receiving end. During the data transmission process, regularly monitor the network status, such as bandwidth utilization rate, packet loss rate, etc., so as to adjust the data transmission strategy in time or remind the user to optimize the network.

[0090] It should be noted that by selecting an appropriate time length, the present invention improves the compression effect of compressing the real-time waveform data sequence through the algorithm, thereby reducing the burden on the system and improving the efficiency of data transmission.

[0091] On the receiving device, a corresponding number of data receiving channels are configured according to the number of the sending acquisition modules; each channel has independent data processing capabilities and can receive and process data packets from a specific sending acquisition module; when the receiving device is started, it automatically detects and connects to the data streams of each sending acquisition module; once the connection is successful, the receiving channel begins to continuously monitor and receive data packets; after receiving the data packet, the receiving channel first parses it according to the header information of the data packet. The header information contains the type of real-time waveform data, the source of the real-time waveform data, the time length, and the timestamp of the first data point in the real-time waveform data sequence, which is used to guide the subsequent unpacking operation; during the parsing process, the compression result and time length of the real-time waveform data sequence are extracted for subsequent decompression.

[0092] On the receiving device, the decompression algorithm is pre-installed and configured; when the compression result of the real-time waveform data sequence is received, the compression result of the extracted real-time waveform data sequence is decompressed using the same decompression algorithm as the sending end; after the decompression is completed, check whether the decompressed real-time waveform data sequence is complete and lossless; if there is any abnormality, record the error information and try to re-receive and decompress the compression result of the real-time waveform data sequence.

[0093] It should be noted that the present invention calculates the first advantage, the second advantage and the compression rate when each integer within a preset range is used as the pre-selected length according to the data characteristics of the waveform data, calculates the preference of the pre-selected length according to the first advantage, the second advantage and the compression rate, and reasonably selects the time length according to the preference, ensuring that the selected time length can not only maximize the compression efficiency, but also ensure that the compressed data maintains sufficient information volume and accuracy, thereby achieving optimal performance in data storage and transmission; by selecting a suitable time length, the compression efficiency is improved. The algorithm compresses the real-time waveform data sequence to reduce the burden on the system and improve the efficiency of data transmission.

[0094] In the description of this specification, "plurality" or "several" means at least two, such as two, three or more, etc., unless otherwise clearly and specifically defined.

[0095] Although this specification has shown and described a number of embodiments of the present invention, it will be apparent to those skilled in the art that such embodiments are provided by way of example only. Those skilled in the art will conceive of many modifications, changes and alternatives without departing from the ideas and spirit of the present invention. It should be understood that in the practice of the present invention, alternatives to the embodiments of the present invention described herein may be employed.

Claims

1. A compression transmission method for recording sampling data, characterized in that: include: Each data point in the real-time waveform data sequence has a corresponding time and value; the time length is used as Algorithm parameters to compress and transmit real-time waveform data sequences; The time length is the pre-selected length with the highest preference, and the process of calculating the preference is: Each integer in the preset range is used as a preselected length; according to the size of the preselected length, the prediction is passed The compression ratio of the algorithm to compress the real-time waveform data sequence; Perform multi-dimensional Gaussian fitting on multiple historical waveform data sequences, and calculate the first advantage of the pre-selected length according to the fitting effect of the obtained multi-dimensional Gaussian distribution and the consistency of Gaussian parameters of all dimensions; Decompose each historical waveform data sequence to obtain a trend item sequence; obtain all segmentation points and all expected points of the trend item sequence according to the preselected length and the extreme value points in the trend item sequence; The first The fitting slope of all data points between segment points is calculated. The weight of the segment point ; Calculate the second advantage of the preselected length , , is the natural exponential function, are the number of all segmentation points and all expected points respectively, For the The time corresponding to the segment point is For the The time corresponding to the nearest expected point of each segment point at the corresponding time; The preference of the preselected length is calculated based on the first advantage, the second advantage and the compression ratio.

2. The method for compressing and transmitting wave recording sampling data according to claim 1, characterized in that: The compression ratio is equal to the inverse of the preselected length.

3. The method for compressing and transmitting wave recording sampling data according to claim 1, characterized in that: The multi-dimensional Gaussian fitting of multiple historical waveform data sequences includes: Dividing each historical waveform data sequence into a plurality of subsequences having a length equal to a preselected length; taking all subsequences of the plurality of historical waveform data sequences as samples; performing multidimensional Gaussian fitting on the samples, requiring that the number of all dimensions in the multidimensional Gaussian fitting is equal to the preselected length; The multidimensional Gaussian distribution obtained by the multidimensional Gaussian fitting includes an isotropic multidimensional Gaussian distribution and an anisotropic multidimensional Gaussian distribution; in the obtained multidimensional Gaussian distribution, the Gaussian parameters of each dimension include a mean and a variance, which are respectively recorded as a first parameter and a second parameter.

4. The method for compressing and transmitting wave recording sampling data according to claim 1, characterized in that: The first advantage of the preselected length satisfies the expression: ； In the formula, The first advantage of preselecting the length, is the fitting effect of multidimensional Gaussian distribution, is the consistency of the Gaussian parameters of all dimensions of a multidimensional Gaussian distribution.

5. The method for compressing and transmitting wave recording sampling data according to claim 1, characterized in that: The calculation method of the consistency of Gaussian parameters of all dimensions includes: When the multidimensional Gaussian distribution is an isotropic multidimensional Gaussian distribution, the consistency of Gaussian parameters of all dimensions of the obtained multidimensional Gaussian distribution is Satisfies the expression: ； When the multidimensional Gaussian distribution is an anisotropic multidimensional Gaussian distribution, the consistency of Gaussian parameters of all dimensions of the obtained multidimensional Gaussian distribution is Satisfies the expression: ； In the formula, is the first parameter of the Gaussian parameters of all dimensions The variance of The second parameter of the Gaussian parameters for all dimensions The variance of is a natural exponential function.

6. The method for compressing and transmitting wave recording sampling data according to claim 1, characterized in that: The fitting effect of the multidimensional Gaussian distribution is obtained by the chi-square test, in which: When the multidimensional Gaussian distribution is an isotropic multidimensional Gaussian distribution, the degrees of freedom in calculating the chi-square test The number of estimated Gaussian parameters is Equal to the preselected length; When the multidimensional Gaussian distribution is anisotropic, the degrees of freedom in calculating the chi-square test The number of estimated Gaussian parameters is Equal to twice the preselected length.

7. The method for compressing and transmitting wave recording sampling data according to claim 1, characterized in that: The method of obtaining all segmentation points and all expected points of the trend item sequence according to the preselected length and the extreme value points in the trend item sequence respectively includes: The extreme value points include maximum value points and minimum value points; for any extreme value point, when When it is greater than the preset threshold, the extreme point is used as the segmentation point, where To obtain the maximum value function, is the value corresponding to the extreme point, is the value corresponding to the extreme point located to the left of the extreme point and closest to the extreme point, is the value corresponding to the extreme point located to the right of the extreme point and closest to the extreme point, To take the absolute value; The data in the trend item sequence whose sequence number is an integer multiple of the pre-selected length is taken as the expected point.

8. The method for compressing and transmitting wave recording sampling data according to claim 1, characterized in that: The said The weight of the segment point Satisfies the expression: ； In the formula, is the first The trend strength of the segment points, and the The trend strength of the segment point is equal to the Segment point to The slope of the linear fitting results of all data points between segment points, To take the absolute value, is the first The trend strength of each segment point, The number of all segmentation points in the trend item sequence.

9. The method for compressing and transmitting wave recording sampling data according to claim 1, characterized in that: The preferred degree of the preselected length satisfies the expression: ； In the formula, is the preference of the preselected length, are the first and second advantages of the preselected length, is the compression ratio, are the preset first coefficient, second coefficient and third coefficient respectively, and .

10. The method for compressing and transmitting wave recording sampling data according to claim 1, characterized in that: The time length is taken as The parameters of the algorithm to compress the real-time waveform data sequence include: Converting data points in the real-time waveform data sequence into PAA features, including: segmenting the real-time waveform data sequence by time length, and taking the average of the values ​​corresponding to all data points contained in each segment as the PAA feature of each segment; Convert PAA features to characters: Gaussian fitting is performed on all segmented PAA features to obtain Gaussian distribution; a breakpoint list is obtained that divides the Gaussian distribution into any number of equally probable intervals, and then the PAA features of each segment are converted into characters through the breakpoint list and PAA features to complete symbolization, wherein the Gaussian distribution probability values ​​corresponding to any two adjacent breakpoints in the breakpoint list are equal; The sequence composed of characters corresponding to all segments is taken as the compression result of the real-time waveform data sequence.

Images